llms.txt: what it is and what it does not do
Godfrey, lessClick
llms.txt is a plain Markdown file at the root of a website that lists the site’s most useful pages, with a one-line description of each, so a language model can find them quickly. It is a proposal, not a standard. lessClick has found no major AI assistant that says it reads the file, so treat it as cheap housekeeping, not a ranking tactic.
What is llms.txt?
llms.txt is a proposed convention for a file at /llms.txt that summarises a website for language models. It sits next to robots.txt and sitemap.xml, but its job is different. Robots.txt says what a crawler may read. A sitemap lists every page. llms.txt picks the pages that matter and says, in plain words, what each one is.
llms.txt was proposed by Jeremy Howard of Answer.AI in September 2024. The proposal is published at llmstxt.org.
What goes in the file?
The file is ordinary Markdown with a simple shape:
- A heading with the name of the site or company.
- A one-paragraph summary, written as a quote block, saying what the company does.
- Sections with lists of links, each link followed by a short description.
Here is the shape of lessClick’s own file:
# lessClick
> lessClick helps B2B software companies get named when buyers ask
> ChatGPT, Gemini and other AI assistants which tools to buy.
## Pages
- [Home](https://lessclick.co.uk/): What lessClick does, how Foundation works, pricing and the free snapshot.
- [About](https://lessclick.co.uk/about/): Why lessClick exists and what it believes.
## Playbooks
- [How to check whether AI recommends your software](https://lessclick.co.uk/playbooks/does-ai-recommend-your-software/): A 30-minute test anyone can run.
Keep the descriptions factual. The file is a table of contents, not a sales page.
What does llms.txt not do?
llms.txt does not make an assistant name you. It does not change rankings, it does not replace a sitemap, and it does not override robots.txt. lessClick has found no public commitment from OpenAI, Anthropic or Perplexity that their assistants read the file when answering buyers. Google goes further: its guidance on AI features in Search says you do not need new machine-readable files or AI text files to appear in AI Overviews or AI Mode.
That is why lessClick does not sell llms.txt as a service. Anyone who promises results from the file alone is promising something nobody has confirmed.
Why bother, then?
Because it costs almost nothing. Writing the file takes half an hour, and the work is useful in itself: deciding which pages matter most and describing each in one line is a good test of whether your site is clear. If a page cannot be described in one plain line, an assistant will struggle with it too.
Some developer tools and AI coding assistants do read llms.txt files, mostly for documentation sites. For a marketing site, the honest case is: low cost, unknown benefit, no harm.
How do you keep it up to date?
Generate it from the same source as your sitemap if you can, so new pages appear automatically. If you write it by hand, review it whenever you publish or retire a page. A file that lists pages which no longer exist is worse than no file.
lessClick’s file at /llms.txt is built from the site itself every time the site is published.