If your site uses Basic Auth to access it, simply follow these instructions:
1 - enter the base URL you wish to crawl.
2 - our crawler will detect if it is behind a Basic Auth Form.
IF so, it will show redirect you to the Advanced Settings > Basic Auth > User/Pswd fields.
3 - Enter the credentials, then go back to the top and click Select
, then the crawler will verify the credentials.
If they are correct, the button changes to Selected
otherwise, it will say error
, and you will need to enter the correct credentials.
* Security Note: we don't store these credentials, and they are auto-deleted after the crawl has stopped
.