Generate or check llms.txt
Free, no sign-up. We read your robots.txt and sitemap, group your pages and fetch real titles. Nothing is stored.
That is the free check. Want the full picture?
The tool tells you whether AI crawlers can reach you. It cannot tell you why ChatGPT recommends a competitor. That is what our GEO team does:
- Prompt audit: which questions in your category ChatGPT, Perplexity, Gemini and Google AI Overviews answer, and which brands and sources they cite
- Technical fixes: crawler access, rendering, llms.txt, structured data and page structure that answer engines can quote
- Citable content: comparison, alternative and FAQ pages built around the prompts buyers actually ask
- Third-party evidence: genuine, disclosed participation on Reddit, forums and review sites that AI answers lean on
What llms.txt is (and what it is not)
llms.txt is a plain markdown file at the root of your site (/llms.txt) that gives language models and AI agents a short, curated map of your most useful pages. The format was proposed in September 2024 by Jeremy Howard of Answer.AI and is documented at llmstxt.org.
The structure is deliberately simple:
- One H1 with your site or brand name (the only required element).
- A blockquote (
> …) with a one-sentence summary. - Optional free-text details: facts a model should know, such as markets served, currency or policies.
- One or more H2 sections, each a list of
- [Title](URL): notelinks. - An optional section literally named
## Optionalfor links an agent can skip when its context is short.
It is not robots.txt. It does not allow or block anything, and it does not replace your XML sitemap. A sitemap lists every URL for crawlers; llms.txt picks the dozens of pages that explain your business best, with human-readable titles. Some sites also publish /llms-full.txt with the full text of those pages in one file.
Does llms.txt actually help you get cited?
Honest answer: on its own, not much yet. Google has said publicly that Search and AI Overviews do not use llms.txt, and none of the major answer engines has documented reading it as a ranking or citation signal. If an agency sells llms.txt as a GEO strategy by itself, be careful.
It is still worth ten minutes, for three reasons:
- Agents and coding assistants read it. Developer tools and documentation fetchers look for
/llms.txtto find the right docs quickly; many SaaS and API companies now publish one. - It forces a useful exercise. Writing a one-line summary and picking your key pages exposes gaps: pages without clear titles, missing pricing or shipping pages, or docs no one can find.
- It costs nothing to maintain if you regenerate it when your sitemap changes.
What actually moves AI citations is upstream: crawlers must be able to reach you (check with our AI crawler checker), your pages must answer the question directly, and third-party sources such as Reddit threads, reviews and “best X” lists must mention you. Our guides on ranking in ChatGPT search and Google AI Overviews cover that in detail.
How this generator builds your file
- Reads
/robots.txtforSitemap:lines, falling back to/sitemap.xmland/sitemap_index.xml. - Follows up to three child sitemaps in a sitemap index, preferring pages, products, collections, posts and docs.
- Drops URLs that add noise for an AI reader: tags, categories, author archives, pagination, search, cart, account and media files. If most URLs sit under a language prefix (
/en/,/de/), it keeps the main language only. - Groups pages by their first path segment into sections such as Key pages, Docs, Products, Collections, Services, Blog and Comparisons, with overflow going to
## Optional. - Fetches real titles and meta descriptions for up to 12 key pages, and uses readable slugs for the rest.
- Validates the result against the llmstxt.org format as you edit.
Pages are fetched in your browser through the public Jina Reader proxy, because browsers cannot read another site’s files directly. MaxGrowth does not receive or store the domains you test. The proxy allows roughly 20 requests per minute, so very large sites may need a second run.
llms.txt example for an online store
Here is what a good file looks like for a small ecommerce store. Note the specific summary, the policy facts in the details paragraph, and short notes after the most important links:
# Northwind Coffee
> Northwind Coffee is a US online store selling single-origin coffee beans, subscriptions and brewing gear, shipping within 2 business days.
Prices are in USD. Subscriptions can be paused or cancelled any time from the account page.
## Key pages
- [Shipping & returns](https://northwind.example/pages/shipping): delivery times, free-shipping threshold, 30-day returns
- [Coffee subscription](https://northwind.example/pages/subscription): how plans, frequency and pausing work
- [About us](https://northwind.example/pages/about): roasting process and sourcing
## Collections
- [Single-origin beans](https://northwind.example/collections/single-origin)
- [Espresso blends](https://northwind.example/collections/espresso)
- [Brewing gear](https://northwind.example/collections/gear)
## Guides
- [Pour-over brew guide](https://northwind.example/blogs/guides/pour-over): grind size, ratio and timing
- [Best coffee for French press](https://northwind.example/blogs/guides/french-press-beans)
## Optional
- [Roastery news](https://northwind.example/blogs/news)
For a SaaS product, swap Collections for ## Docs, ## Pricing & plans and ## Integrations. For an agency or service business, lead with services, case studies and the pages that explain how you work.
Where to put llms.txt on Shopify, WordPress, Webflow and Next.js
| Platform | How to publish /llms.txt | Watch out for |
|---|---|---|
| Next.js, Astro, static sites | Save the file as public/llms.txt (or the static folder) and deploy. | Make sure middleware or i18n redirects do not intercept .txt paths. |
| WordPress | Upload to the web root over SFTP or your host’s file manager, or use an SEO plugin that offers an llms.txt feature. | Caching plugins may serve an old copy; purge after updating. |
| Shopify | Shopify does not let you upload files to the root. Upload the file under Content → Files, then add a URL redirect from /llms.txt to that file, or use an app that serves it. | A redirect works for most fetchers, but check the final URL returns 200 and plain text. |
| Webflow, Wix, Squarespace | Use a built-in llms.txt or custom-file setting if your plan has one; otherwise redirect /llms.txt to a hosted copy. | Do not paste it into a normal page; that serves HTML, not markdown. |
| Cloudflare in front of any site | Serve it from a Worker or a redirect rule. | Bot-fight or AI-bot blocking can stop the same crawlers you are writing it for. |
After publishing, open https://yourdomain.com/llms.txt in a browser: it should load as plain text with status 200. Then run the Check my existing /llms.txt button above.
Free tool vs. done-for-you GEO
This page is free and stays free. It solves the mechanical part. Getting recommended by ChatGPT, Perplexity, Gemini and Google AI Overviews is a different job: it depends on what those engines already read about your category.
Free with this tool
- A valid llms.txt built from your sitemap
- A robots.txt check against 22 AI user-agents
- A live fetch as 4 AI bots to catch CDN/WAF blocks and JavaScript-only content
- A copy-paste fix for blocked AI search bots
- Format validation you can rerun any time
What our GEO service adds
- Which buyer questions in your category trigger AI answers, and who gets cited today
- Why competitors are recommended instead of you (sources, pages, mentions)
- Page rewrites and new comparison / FAQ pages built to be quoted
- Ongoing tracking across ChatGPT, Perplexity, Gemini and Google AI Overviews
- Disclosed community work on Reddit and forums that AI answers rely on
FAQ
Is this llms.txt generator free?
Yes. There is no sign-up and no usage limit on our side; the only limit is the public fetch proxy’s rate limit of about 20 requests per minute.
Do you store my domain or file?
No. The tool runs in your browser and fetches pages through the Jina Reader proxy. MaxGrowth only receives data if you choose to fill in the audit form.
Does Google use llms.txt?
Google has said its Search and AI Overviews do not use llms.txt. Normal crawlability, helpful content and structured data matter far more for Google’s AI features.
Does ChatGPT read llms.txt?
OpenAI has not documented using llms.txt for ChatGPT search. ChatGPT search relies on its OAI-SearchBot crawler and search partners, so make sure OAI-SearchBot is allowed in robots.txt first.
What is the difference between llms.txt and llms-full.txt?
llms.txt is a short index of links. llms-full.txt contains the full text of the important pages in one file, which suits documentation sites that want agents to load everything at once.
How often should I update llms.txt?
Regenerate it when you launch or retire important pages, or monthly if your sitemap changes a lot. Keep the summary and key-page notes hand-edited.
Why does the generator say no sitemap was found?
Your robots.txt may not list a sitemap and /sitemap.xml may not exist, or the site may block the fetch proxy. The tool then falls back to links on your homepage, and you can edit the result by hand.
A clean llms.txt is the easy part. Want to know why AI answers recommend competitors instead of you?
Get a free GEO audit