Skip to main content

How to Crawl via Sitemap XML URLs

Sitemap XML crawling is here!

Jeff avatar
Written by Jeff
Updated over 10 months ago

This feature is ideal If you have a specific list of URLs you wish to crawl
( as an alternative to using Advanced Filters ).

Update 2024: The XML URL field has moved into this Main Tab.


Important Notes:

1 - The sitemap XML file must be an accessible online URL.
ie: example

2 - Yes, we support nested XML files.

3 - The output map structure will only be based on the /directory/ URL structure.
It will not show the optional Referral structure. If you need that, we recommend doing a regular crawl instead.

4 - The total amount of pages that will be crawled is based on your plan's limit.

5 - You can additionally use any of the advanced settings for this crawl.

*We don't offer XML file uploads at this time, however you can upload a list of URLs via our CSV import.

Did this answer your question?