Crawl responsibly.

Before starting a crawl

• Confirm you are authorised to crawl the target website.
• Start with a conservative page limit and one worker, especially on production sites.
• Use the request-rate limiter and respect robots.txt when appropriate.
• Exclude login, checkout, account, and other sensitive paths unless you have explicit permission to test them.

Prohibited activity

Do not use the service for denial-of-service activity, security scanning outside your authority, credential harvesting, bypassing access controls, automated betting or transactions, data theft, or any unlawful purpose. Do not run concurrent crawls beyond the capacity configured for this deployment.

Managing impact

Pause or stop a crawl if the target site shows signs of strain, if its owner asks you to stop, or if the results indicate that you are accessing an unintended area. A crawl should be as small and as slow as needed to achieve its stated audit purpose.

Data handling

Export only the information you need, store reports securely, and clear saved crawl history when it is no longer required. See the Privacy Policy for information about data stored by this deployment.