URL explorer / custom reports

Simple search

URLs can be filtered using the search field, with exact match or not. For exact matching search, use double quotes:

Exact match search
Exact match search to get the home page only

If you don’t use quotes, the URL table will display all URLs that contain the entered text.

Advanced URL explorer

Advanced URL explorer may be used to:

  • create custom reports,
  • isolate or filter specific URLs, for example for URL tagging.

Every custom filter you create is saved and may be re-used. So take care to properly name your custom filters so that you can easily know what they do and re-use them, without having to edit them again.

1. Create and name your custom filter:

Click on “Advanced URL explorer” > New > Name your filter > Click OK

Create a filter
Create a filter

2. Choose the columns to display in the URL table

Select your filter in the list > click on the “Columns” button > select the columns to display and their order. The default columns are those from the current report’s table.

Filter's columns
Choose columns to display

3. Create a query to filter the URLs

Select your filter in the list > click on the “Query…” button > click on “Add” > select the column to be filtered > select the operator > enter a value.

If you crawled a Magento website and want to display product URLs, you may search for URLs that contain the body class attribute “catalog-product-view”:

Custom request
Query condition

Available operators:

  • Equal to =
  • Not equal to !=
  • Greater than >
  • Less than <
  • Greater than or equal to >=
  • Less than or equal to <=
  • Like (use the special character % to match everything)
  • Not like
  • Empty
  • Not empty

You can apply several conditions to a custom filter; all conditions must be met for URLs to match the query: condition 1 AND condition 2 AND condition 3…

Query conditions
Query conditions

Data grid

Sorting

URL datagrid
URL datagrid

You can click on each column title to sort the data the way you need, e.g. by errors and warning: click on the second column “!”.

Columns

To add more data in a report, you can add other columns using the advanced URL explorer.

Data export

You can choose to export all data or just rows displayed in the current datagrid.

In Excel or OpenOffice Calc you can then investigate the way you want or make your own reports using filters, graphs, etc… If you only need HTML pages, you can filter your table on the “Nature” column by selecting “html”.

CSV export
CSV export