Decide which AI crawlers can read your site, then copy a ready robots.txt.
- Runs in your browser
- Checks live pages
SEO and AI visibility
AI search readiness checker
Enter a public page to see whether AI search crawlers can get in, read its text, and find it. You get a checklist covering robots.txt rules for each crawler, noindex, the text in the HTML, structured data, the canonical address, the sitemap, and llms.txt, with what to do about anything that needs work.
- Free
- No sign-up
- Runs in your browser
- Checks live pages
Three steps
How it works
Enter the address of a public page, such as your homepage, a product page, or a blog post.
We read the page, plus the site's robots.txt, llms.txt, and sitemap, and check each against the crawler operators' documentation and the published standards.
Fix anything marked Fix, review the rest, and check again after you publish your changes.
GuideReviewed
What AI search readiness means
Contents
Reach: can crawlers get in?
AI search tools find pages with their own crawlers, such as OAI-SearchBot for ChatGPT search, Claude-SearchBot for Claude, and PerplexityBot for Perplexity. Google's AI Overviews and AI Mode use Google Search itself: Google says a page must be indexed and eligible to be shown with a snippet, and that there are no additional technical requirements.
- robots.txt decides which crawlers may read which pages. Blocking a training crawler such as GPTBot is a separate choice; it doesn't block AI search crawlers.
- A noindex rule, in a robots meta tag or the X-Robots-Tag header, keeps a page out of search results. When rules conflict, Google follows the more restrictive one.
- If robots.txt blocks a page, crawlers never read its meta tags, so they won't see a noindex rule there either.
Read: can they read the page?
Crawlers read the HTML your server sends. Google runs JavaScript, but its documentation notes that not all bots can, so text that appears only after scripts run may never reach some AI crawlers. The checker counts the visible text in that HTML, inside <main> when the page has one, and shows the count and the start of the text, so you can see exactly what it measured.
Structured data (JSON-LD) describes a page in a form machines can read, such as an article, a product, or your organization. Google says its AI features don't need special markup, so the checker treats it as optional, but any markup you add should match what the page shows.
Find: can they find and place it?
When the same page opens at several addresses, a canonical tag names the main one, so search engines know which to show. A sitemap lists the pages you want crawled; the sitemaps.org protocol allows up to 50,000 addresses and 50 MB, uncompressed, per file.
llms.txt is a proposed plain-text guide to a site for AI models. It's optional: Google says you don't need AI text files to appear in its AI features. The checker reads the file at the site root and checks that it has the one section the proposal requires, a heading with the site's name.
What a readiness check can't tell you
Readiness isn't visibility. Passing every item means crawlers can reach, read, and find the page. It doesn't mean any AI answer will show or cite it, which depends on the question asked, the other sources available, and each tool's own choices.
The checker reads public files only. It doesn't log in, run the page's scripts, or see your server logs, and some sites turn away automated checks like this one while still letting search crawlers in.
Frequently asked
Questions, answered.
What people ask before they use the AI search readiness checker.
Seven things for one page: which AI and search crawlers robots.txt lets in, noindex rules in the page and its headers, how much text is in the HTML before scripts run, JSON-LD structured data, the canonical address, the sitemap, and llms.txt. Each item says what we found, why it matters, and what to do next.
A score would suggest a ranking or a chance of being cited, and no checker can measure either. Instead, each item is marked Ready, Review, Fix, Optional, or Couldn't check, with the reason and what we measured.
No. Google says a page must be indexed and eligible to be shown with a snippet in Google Search, with no additional technical requirements, and that you don't need new AI text files or markup. The crawler and indexing items cover those basics.
No. It's a proposal, not a standard, and Google says you don't need AI text files to appear in its AI features. Some sites publish one as a plain-text guide for AI models, so the checker marks it as optional and links to a free generator.
Your browser runs the page's scripts. The checker reads the HTML your server sends, before any script runs, as many crawlers do. If your text appears only after scripts run, render it on the server or generate the page ahead of time.
Some sites block automated requests, need a login, or answer with an error. The checker still reads robots.txt, llms.txt, and the sitemap when it can, and marks the items it couldn't check. Make sure the address opens in a private browser window, or try another public page on the site.
Only public files: the page you enter, its site's robots.txt and llms.txt, and one sitemap, either the first one robots.txt lists or /sitemap.xml. It doesn't log in or follow links to other pages, and nothing is sent to an AI model. Results are kept for 10 minutes, so checking the same page again within that time shows the same result.
More free tools
All free toolsWrite a clean llms.txt that points AI tools to your most useful pages.
- Runs in your browser
- Checks live pages
Write JSON-LD for five common page types, or check a live page's markup.
- Runs in your browser
- Checks live pages
Related guides
- How do AI search engines choose which sources to cite?How AI search engines choose sources to cite: query fan-out, retrieval, passage selection, what citation studies show, and what makes a page easy to cite.
- Google AI Overviews and AI Mode: how they work and how content gets includedHow Google AI Overviews and AI Mode work, how pages get included and linked, which controls apply, and how to report their effect on clicks.
- How to do an SEO audit: a marketer's checklist for search and AI crawlersHow to do an SEO audit: check crawler access, indexing, rendering, on-page basics and content, then rank findings by severity. Includes a checklist.
- How to measure AI search visibilityLearn what AI search visibility means, which signals you can measure, and how to run a repeatable baseline audit without overstating the data.
From Ampere
Readiness is step one. Next: what do AI answers say?
Ampere is an AI marketing agent that can research how your brand and competitors show up in search and AI answers, find the visibility gaps, and turn them into content for your review.
No card required