Foundational
How to create an llms.txt file (and why ChatGPT actually reads it)
tl;dr
llms.txt is a small markdown file at the root of your site that tells AI assistants where your best pages live. Publish it at /llms.txt with a short intro and a list of your most important URLs. It takes 15 minutes.
// your move
See what AI assistants say about your site.
Free, 30 seconds, no signup. We'll check all 15 signals and tell you which ones to fix first.
Run the auditWhat is llms.txt?
Think of llms.txt as a guided tour for AI assistants. robots.txt tells crawlers what they're allowed to touch. llms.txt tells them what's worth reading first.
The proposal came out of work by Jeremy Howard in late 2024 and got picked up fast. Anthropic, Mintlify, Cloudflare, and a growing list of docs sites already publish one. It's plain markdown, no auth, no JavaScript, no waiting on render.
Why bother?
AI assistants have a context budget. When ChatGPT or Perplexity decides which pages to actually pull from your site, a flat markdown index beats guessing from your sitemap. You get to pick the winners.
It also future-proofs you. The big assistants are moving toward respecting these signposts the way search engines respect sitemap.xml.
How to build one in 15 minutes
- 01Open a text editor and create a file named llms.txt.
- 02Add a single H1 at the top with your site name. Example: # InvisibleRank
- 03Add a blockquote with one sentence describing what your site does. Example: > AI visibility audits for small business websites.
- 04Add an H2 for each major section of your site (Docs, Blog, Tools, Pricing).
- 05Under each H2, list the URLs as markdown links with a one-line description. Format: - [Page title](https://yoursite.com/page): what's on it.
- 06Save the file and upload it to your site root so it loads at https://yoursite.com/llms.txt.
- 07Open the URL in a browser. If you see plain text, you're done. If you see a 404, check your server's static file routing.
A real example
Here's a stripped-down version of what we publish:
- ·# InvisibleRank
- ·> AI visibility audits for small business websites. Free, instant, no signup.
- ·## Tools
- ·- [Run an audit](https://invisiblerank.com): paste a URL, get a 0-100 AI visibility score in 30 seconds.
- ·## Guides
- ·- [How to create an llms.txt file](https://invisiblerank.com/blog/how-to-create-an-llms-txt-file): the file you're reading.
“Here's a stripped-down version of what we publish:”
Hosting tips by stack
WordPress: drop llms.txt into your root via FTP, or use a plugin like WP File Manager. Some hosts block files at root — confirm with curl before declaring victory.
Next.js / TanStack / Astro: put llms.txt in /public. The framework serves it at /llms.txt automatically.
Webflow / Squarespace / Wix: these don't allow custom root files. Use a Cloudflare Worker in front of the domain to serve /llms.txt, or push your host to support it.
Common questions
Do AI assistants actually read llms.txt?
Anthropic's Claude, Perplexity, and several agent frameworks check for it. Adoption is rising fast. Treat it the way you treated sitemap.xml in 2006 — early but worth doing now.
Does llms.txt replace robots.txt or sitemap.xml?
No. They do different jobs. robots.txt controls access. sitemap.xml lists every URL for search crawlers. llms.txt is your curated highlight reel for AI assistants.
How often should I update it?
When you ship a new section or retire a major page. Monthly is plenty for most sites. It's not a real-time signal.
Will publishing llms.txt hurt my SEO?
No. Google ignores it. It only matters to AI assistants. It can't tank rankings.
Keep reading
// your move
See what AI assistants say about your site.
Free, 30 seconds, no signup. We'll check all 15 signals and tell you which ones to fix first.
Run the audit ⚡