llms.txt: Tell AI How to Read Your Site
llms.txt is a simple file you place at the root of your site that tells AI systems which pages matter and how to understand your content, the way robots.txt guides crawlers and sitemap.xml lists your pages. As AI search decides who gets read and cited, handing models a clean, curated map of your site is a low-effort, high-signal move. Here is what the file is, why it matters, and how to add one.
What llms.txt is
llms.txt is a markdown file served at yoursite.com/llms.txt. It lists your most important pages with short descriptions and points AI models at your canonical, high-value content instead of leaving them to guess their way through navigation, ads, and boilerplate. Think of it as a hand-drawn map for machines that read your site to answer questions.
Why it matters for AI search
AI engines have limited attention and a lot of messy HTML to parse. A curated map raises the odds that your best content is read and cited correctly rather than skipped or misquoted. It is proactive GEO: instead of hoping a model finds the right page, you tell it what deserves attention.
robots.txt controls what crawlers can access. llms.txt curates what AI models should actually pay attention to.
What goes in it
Start with a title and a one-line description of your business, then grouped links to your core pages: services, key blog posts, documentation, and contact, each with a short description of what it covers. Keep it clean and current. It complements, rather than replaces, your other machine-readable files.
| File | Job |
|---|---|
| robots.txt | What crawlers may or may not access |
| sitemap.xml | A full list of URLs for indexing |
| llms.txt | A curated map of what AI should read and trust |
How to add one
Create a plain markdown file, list your priority pages with short descriptions, and save it as llms.txt at your site root so it serves at /llms.txt. Update it as you publish. Pair it with schema markup and a strong brand entity so the signals reinforce each other, and write pages that are easy to quote in the first place.
It is not magic, it is hygiene
llms.txt does not guarantee citations. What it does is remove friction, so a model spends its attention on the content you want quoted rather than parsing clutter. Combined with quotable writing and entity signals, it makes you easier to read and trust. It is one part of a GEO setup, not the whole thing.
Who sets it up
Writing the file is a quick technical task. The value is in the curation, deciding which pages should represent you to AI, which is exactly the editorial judgement a fractional marketing director brings to the setup.
FREQUENTLY ASKED
What is llms.txt?
llms.txt is a markdown file at the root of your site that gives AI systems a curated map of your most important pages with short descriptions. It works alongside robots.txt and sitemap.xml, but its job is to tell models what to read and trust.
Does llms.txt help with AI search visibility?
It helps by removing friction. AI engines have limited attention and messy pages to parse, so a clean, curated map raises the odds your best content is read and cited correctly. It is not a guarantee of citations, but it is a low-effort signal.
How do I create an llms.txt file?
Write a plain markdown file with your business name, a one-line description, and grouped links to your key pages, each with a short description. Save it as llms.txt at your site root so it serves at yoursite.com/llms.txt, and keep it updated as you publish.
Is llms.txt different from robots.txt and sitemap.xml?
Yes. robots.txt controls what crawlers may access and sitemap.xml lists your URLs for indexing. llms.txt curates what AI models should pay attention to, pointing them at your canonical, high-value content instead of leaving them to guess.
RELATED SERVICES
Want this done for your business?
Free audit. No pitch. 24-hour turnaround.