Skip to main content

How to crawl a site behind a Basic Authentication Password

Written by Jeff

If your site uses Basic Auth to access it, simply follow these instructions:
​
1 - enter the base URL you wish to crawl.


2 - our crawler will detect if it is behind a Basic Auth Form.
IF so, it will show redirect you to the Advanced Settings > Basic Auth > User/Pswd fields.

3 - Enter the credentials, then go back to the top and click Select, then the crawler will verify the credentials.
​

If they are correct, the button changes to Selected
​

otherwise, it will say error , and you will need to enter the correct credentials.
​
​* Security Note: we don't store these credentials, and they are auto-deleted after the crawl has stopped.

Did this answer your question?