All Collections
How to Crawl via Sitemap XML URLs
How to Crawl via Sitemap XML URLs

Sitemap XML crawling is here!

Artur M avatar
Written by Artur M
Updated over a week ago

This feature is ideal If you have a specific list of URLs you wish to crawl
( as an alternative to using Advanced Filters ).

Important Notes:

1 - The sitemap XML file must be an accessible online URL.
ie: example

2 - Yes, we support nested XML files.

3 - The output map structure will be based on the URL structure.

4 - The total amount of pages that will be crawled is based on your plan's limit.

5 - You can additionally use any of the advanced settings for this crawl.

Sorry! We don't offer XML file uploads at this time, however you can upload a list of URLs via our CSV import.

Did this answer your question?