What is llms.txt?

llms.txt is a Markdown file at the root of a website that points language models to the pages that matter most. It was proposed by Jeremy Howard in September 2024. It is a proposal, not a standard, and no major search engine says it uses the file for ranking.

By the AnswerHawk team Updated November 17, 2026 2 min read

llms.txt is a plain Markdown file that sits at /llms.txt on your domain and tells language models, in a few lines, what your site is and which pages to read first. The proposal on llmstxt.org was published by Jeremy Howard on September 3, 2024. If you already have one, check your llms.txt file against the format before you go further.

The llms.txt format

The file is Markdown, and the sections come in a fixed order (llmstxt.org):

  1. An H1 with the name of the project or site. This is the only required section.
  2. A blockquote with a short summary of the site.
  3. Optional paragraphs or lists with more detail, without headings.
  4. H2 sections that each hold a list of links, written as [name](url): notes.
  5. An optional section called Optional, for links an agent can skip when it needs a shorter context.

An llms.txt example

# Brightlane

> Brightlane is invoicing software for freelancers who bill monthly retainers.

## Product

- [Features](https://brightlane.com/features): retainers, late-payment reminders, multi-currency
- [Pricing](https://brightlane.com/pricing): plans and limits

## Docs

- [Getting started](https://brightlane.com/docs/start.md): set up your first retainer

## Optional

- [Changelog](https://brightlane.com/changelog)

The proposal also suggests offering a clean Markdown copy of useful pages at the same URL with .md added, such as page.html.md (llmstxt.org).

How to add llms.txt to your site

  1. List the 10 to 30 pages a newcomer should read: product, pricing, docs, policies.
  2. Write a one-sentence summary that states what you do and for whom.
  3. Group the links under a few H2 headings and add a short note to each link.
  4. Save the file as UTF-8 and publish it at the root of your domain.
  5. Validate it, then keep it in sync when pages move.

On WordPress and on shops, the same rules apply; only the publishing step changes.

What llms.txt does not do

llms.txt does not block or allow crawlers: that is robots.txt. It doesn't list every URL: that is your sitemap. And it is not a ranking signal you can count on. Google says there are no special files needed to appear in AI Overviews or AI Mode, and that you "don't need to create new machine readable files, AI text files, or markup" (Google Search Central).

That makes llms.txt a low-cost courtesy to tools and agents that choose to read it. Add it if it takes you an hour; don't expect it to change how often AI engines mention you. To know whether anything changes, measure your visibility before and after.

llms.txt vs robots.txt vs sitemap.xml

File Purpose Who reads it
robots.txt Allow or block crawling Search and AI crawlers that honour it
sitemap.xml List every URL you want indexed Search engines
llms.txt Curated guide to your key pages Tools and agents that choose to read it

Sources

  1. The /llms.txt file · llmstxt.org (Jeremy Howard)
  2. AI features and your website · Google Search Central

Frequently asked questions

Is llms.txt a standard?

No. It is a proposal published on llmstxt.org in September 2024. Some tools read it; none of the large AI search engines has said it uses the file to rank or cite pages.

Where does the llms.txt file go?

At the root of the site, so it loads at https://example.com/llms.txt, the same way robots.txt does.

What is the only required part of llms.txt?

An H1 heading with the name of the project or site. The proposal lists everything else, the summary blockquote and the link sections, as optional.

Does llms.txt replace robots.txt or a sitemap?

No. robots.txt controls crawling and a sitemap lists URLs for search engines. llms.txt is a curated, human-readable guide to your most useful pages.

Does Google need llms.txt for AI Overviews?

Google says you don't need new machine-readable files or AI text files to appear in AI Overviews or AI Mode.

See where you stand in AI answers.

Free for 7 days. Your first answers in minutes.