All Collections
FAQs
Can I crawl more pages with deeper levels ( on running sitemap) once I upgrade?
Can I crawl more pages with deeper levels ( on running sitemap) once I upgrade?
Jeff avatar
Written by Jeff
Updated over a week ago

Yes. 100%

We just made this easier for you.

Most of the time you won't know exactly how big the site is unless you:

A) search for it on Google via site:yoururl.com

B) Start crawling with us, and have our crawler find pages as it crawls and crawls.

Sometimes you will notice that a lot more pages were found during the crawl than were originally anticipated, and your plan doesn't cover it all. Happens to the best of us.

So what happens then?

1. We will auto-pause the crawling when you reach your plan's limit.

2. You can either wait until your next 30-day cycle to reset the limits, or just upgrade to get more instant crawling power.

Did this answer your question?