AI Search

What Is llms.txt? What It Does, What It Does Not, and Whether Your Site Needs One

What Is llms.txt? What It Does, What It Does Not, and Whether Your Site Needs One

llms.txt is a plain text file, written in Markdown, placed at the root of a website to give large language models a short, curated guide to the site's most important content. It has become popular in SEO circles as a way to appear in AI answers. The reality is more modest, and this guide explains what it can and cannot do before you spend time on it.

Where did llms.txt come from?

It was proposed in 2024 by Jeremy Howard of Answer.AI as a convention for helping AI tools use websites at inference time, when a model is reading pages to answer a question. It is a proposal, not an official web standard like robots.txt, and support varies between tools.

What does an llms.txt file contain?

A title, a one-paragraph summary of the site or business, and lists of links to the most useful pages, each with a short description, grouped under headings such as Services, Guides and Tools. Some sites also publish an llms-full.txt with fuller text.

  • A heading with the site or business name.
  • A short summary of who you are and what you do.
  • Grouped links to key pages, each with one line of description.

Does it help you appear in AI answers?

There is no strong evidence that it does today. Google has said it does not use llms.txt for Search or AI Overviews, and the major AI assistants have not committed to reading it. It does no harm, and some developer-focused tools use similar files, but it should not be a priority over content quality, clear structure and a reputation that other sites mention.

What does help is covered in my guides to getting cited by AI search and answer engine optimisation.

How do you write one?

If you decide to publish one, keep it short and accurate. List the pages you would want someone to read first: your services, location pages, key guides and tools, and your contact page. Save it as llms.txt at the root of your domain and update it when you add important pages. This site has one, mostly as a tidy, human-readable index.

What should you prioritise instead?

Content that answers buyers' real questions clearly, consistent business information across the web, a fast and crawlable site, and being mentioned on other reputable sites. Those influence both traditional search and AI answers far more than any single file.

Frequently asked questions

What is llms.txt?
A plain Markdown file at the root of a website that summarises the site and links to its most important pages for AI tools to read.
Does Google use llms.txt?
Google has said it does not use llms.txt for Search or AI Overviews.
Should a small business create an llms.txt file?
It is optional. It takes a few minutes and does no harm, but improving your content and reputation will do far more for AI visibility.
Is llms.txt the same as robots.txt?
No. robots.txt is an established standard for controlling crawling. llms.txt is a proposed guide for AI tools and does not block or allow anything.

More on AI Search

Want a second pair of eyes on your ad account?

Book a strategy callSend a message
Available for work