Acceptable Use Policy

1. Your responsibility

You are solely responsible for the URLs, queries, options, and other inputs you submit, for how you use crawl results, and for ensuring that your use is lawful and authorized. You must have a valid legal basis and any required rights, consents, or permissions for the data you collect through Supercrawl. You may not use Supercrawl to do anything you are not legally allowed to do yourself.

2. Comply with all applicable laws

You must comply with all laws and regulations that apply to your use of Supercrawl and to the data you collect, including data protection and privacy laws (such as the GDPR, UK GDPR, and CCPA/CPRA), intellectual property and trade-secret laws, computer-misuse and anti-hacking laws, consumer-protection laws, and applicable export controls and sanctions. You may not use Supercrawl if you or your end users are subject to sanctions or located in an embargoed jurisdiction.

3. Data you may not collect or process

Do not use Supercrawl to collect, store, or process:

• personal data without a lawful basis, or in violation of any individual's privacy rights or an applicable opt-out, deletion, or do-not-track request;
• special-category or sensitive personal data — including data revealing racial or ethnic origin, political opinions, religious or philosophical beliefs, trade-union membership, health, sex life, or sexual orientation, and genetic or biometric data — except where you have an explicit legal basis;
• government-issued identifiers, financial-account or payment-card numbers, authentication credentials, or protected health information;
• personal data of minors, or data from services directed to children;
• data you intend to use for unlawful discrimination, profiling, or for decisions that produce legal or similarly significant effects on individuals without appropriate safeguards.

4. Prohibited targets and content

Do not use Supercrawl to target or interact with:

• content or systems you are not authorized to access;
• material that is behind a login, paywall, or other access control, except sites and accounts you own or are expressly authorized to access;
• government, defense, critical-infrastructure, or other restricted systems where access or data collection is prohibited;
• content that is illegal, that sexually exploits or endangers minors, that promotes terrorism or violence, or that infringes intellectual-property or other third-party rights;
• individuals for the purpose of harassment, stalking, doxxing, surveillance, or other harm.

5. Prohibited technical conduct

Do not use Supercrawl, or attempt to use it, to:

• bypass or defeat authentication, paywalls, or CAPTCHAs, except where you are authorized to do so;
• gain unauthorized access to, probe, scan, or test the vulnerability of any system or network;
• distribute malware, conduct phishing or credential stuffing, or send spam or other unsolicited communications;
• overload, degrade, or disrupt any website, network, or service, including denial-of-service activity or unreasonable request volumes against a target;
• reverse engineer, resell, or sublicense the Service, or build a competing crawling or proxy service from it, except as expressly permitted in writing;
• misrepresent your identity to commit fraud or to evade enforcement of this Policy.

6. Respect source websites and third-party rights

You are responsible for reviewing and respecting the terms, rights, and restrictions that apply to the sites and sources you crawl, and for how you use, store, and share the results. We do not grant any rights in third-party content, and a successful crawl does not mean a particular use of the result is lawful or permitted.

7. Verification and cooperation

We may ask you to describe your use case, identify the sources you intend to crawl, or provide information needed to confirm that your use complies with this AUP and the law, and we may decline or stop a use that we cannot verify. We may monitor usage for abuse, security, and compliance, and we may cooperate with lawful requests from authorities and with rights-holders investigating misuse.

8. Enforcement

If we believe you have violated this AUP, or to protect Supercrawl, our infrastructure providers, target sites, or other users, we may rate-limit, suspend, or terminate your access, disable API keys, remove or refuse requests, and, where appropriate, notify or report the conduct to relevant authorities. Serious or repeated violations may result in immediate termination without notice.

9. Reporting abuse and contact

To report a suspected violation of this AUP, an abuse concern, or content that should not be accessible through Supercrawl, contactsupport@supercrawl.dev with the relevant details. We may update this AUP as the Service and the legal landscape evolve, and will post the updated version here with a new "Last updated" date.