All Collections
Tutorials
How to crawl a site behind a Basic Authentication Password
How to crawl a site behind a Basic Authentication Password
Jeff avatar
Written by Jeff
Updated over a week ago

If your site uses Basic Auth to access it, simply follow these instructions:

1 - enter the base URL you wish to crawl.


2 - our crawler will detect if it is behind a Basic Auth Form.
IF so, it will show redirect you to the Advanced Settings > Basic Auth > User/Pswd fields.

3 - Enter the credentials, then go back to the top and click Select, then the crawler will verify the credentials.

If they are correct, the button changes to Selected

otherwise, it will say error , and you will need to enter the correct credentials.

* Security Note: we don't store these credentials, and they are auto-deleted after the crawl has stopped.

Did this answer your question?