AI Crawler Check icon AI Crawler Check

Which AI crawlers can access this site?

One click shows you exactly which AI bots a website blocks or allows in its robots.txt.

  • 20 AI crawlers: OpenAI, Anthropic, Google, Perplexity, Meta and more
  • Site-wide and current-page verdicts
  • llms.txt and meta robots checks included
  • No tracking, no data collection
Add to Chrome — it's free Free · Chrome, Edge, Brave · no account

Get started in 3 steps

It's live on the Chrome Web Store, so setup is one click.

  1. Add it to Chrome

    Click Add to Chrome above — it installs from the Chrome Web Store in one click. Works in Edge and Brave too.

  2. Open any website

    Browse to any site you want to check — a news site, a competitor, your own. Most news sites block the AI training bots, so they're a good first test.

  3. Click the icon

    Click the AI Crawler Check icon in your toolbar (pin it from the puzzle-piece menu). Every bot's verdict appears instantly, and one button copies the whole report as plain text.

Why it exists

AI crawler rules are their own layer of technical SEO now — and they're hidden.

Correct parsing

Follows RFC 9309: longest match wins, ties go to Allow, a named group overrides the wildcard. Most checkers take the first matching line and get it wrong.

Page as well as site

The site-wide verdict plus the answer for the exact URL you're on, whenever the two differ.

20 AI crawlers

Training bots, AI-search bots and assistant user agents across OpenAI, Anthropic, Google, Perplexity, Meta, Apple and more — each labelled with what it's for.

Copy the report

One button takes the whole result away as plain text, ready to paste straight into an audit.

Who it's for

Is it safe?

Yes. No account, no analytics, no tracking, no servers. It runs only when you click it, only on the tab you're on, and it stores nothing. The full statement is in the privacy policy.