All our plans are simply based on a monthly allotment of X
pages crawled per month.
โ
If you don't originally cap your crawl via Max Pages
it will just keep crawling until it runs out of links to find...Or until you reach your monthly limits. And that is when we auto-pause it for you. This will allow you consider completing the crawl by upgrading to a larger plan with more credits. Alternatively you can wait a bit until your 30-day cycle resets as well.
โ
Occasionally this will happen - here's why:
Written by Jeff
Updated over 4 years ago