Skip to content

What is llms.txt, and does it help search rankings?

What llms.txt is, who reads it, and what it won't do

llms.txt is a Markdown file at the root of a site that tells AI assistants what the site is and which pages matter, proposed by Jeremy Howard in September 2024. It doesn't help Google rankings: Google's guide says Google Search ignores it. It's worth an hour because other assistants and browser agents do read it, and it costs nothing in search.

When TechFabric sets Heddle up on your site, it writes llms.txt and a Markdown copy of every page from each build, and checks that the AI crawlers are allowed in. How an engagement works.

Sources read October 10, 2026 · by TechFabric

The format

The file is plain Markdown. The only part the proposal requires is an H1 with the name of the site or project. After it comes a one-paragraph summary in a blockquote, then any number of H2 sections, each a list of links with a short note after a colon. A section titled Optional holds links an assistant can skip when it's short of context.

The proposal also asks for a Markdown copy of each useful page at the same address with .md on the end, so /pricing has /pricing.md. Heddle writes both from the built HTML, which means the twin can't drift from the page a person reads.

Who reads it

Google doesn't. Its guide to generative AI features says you don't need machine-readable files to appear in Google Search, and that Google Search ignores them. That's a direct answer, and it's the one to repeat to anyone selling llms.txt as a ranking factor.

Other readers do exist. The proposal's own page says thousands of sites publish one, and that OpenAI, Anthropic and Google publish them for their developer documentation. Chrome's Lighthouse checks for the file in its agentic browsing audit. How much any general assistant relies on it isn't published. Our guess, unmeasured, is that coding assistants reading documentation get the most from it. Treat the file as a cheap bet.

Writing a good one

Lead with the sentence you'd want an assistant to repeat about the company, the same one the homepage and the profiles use. List the pages that answer buyer questions before the ones that answer nobody's, and keep the notes after each link to one line about what the page settles.

Regenerate it on every build. A hand-written llms.txt goes stale quickly. On the site Heddle came from, the hand-written version had two services missing and an address one digit off before anyone noticed.

Its limits

It won't move a ranking, and it won't get a page cited by an assistant that never found the page in the first place. Being crawlable, indexed in Google and Bing, and allowed for the answer-engine crawlers in robots.txt matters more. Heddle's agent-ready check reads all four on every build, with llms.txt last.

Sources

Each was read on October 10, 2026.

Questions

Does llms.txt improve Google rankings?

No. Google's own guide says Google Search ignores llms.txt and similar files, and that creating one neither helps nor harms visibility or rankings in Google Search.

Where does llms.txt go?

At the root of the site, at /llms.txt. The proposal allows a file under a subpath too, covering the pages beneath it, such as /docs/llms.txt for documentation.

What is llms-full.txt?

A convention many sites follow, not part of the proposal itself. It's llms.txt followed by the full Markdown text of every page it lists, so an assistant can load the whole site in one request.

Work with us

Let the agents bring you the leads.

Tell us about your business and who buys from you. On a short call we'll show you the searches your buyers make where you don't show up yet, and what the agents would do about them in their first month.

See the plans

On the call, for your site

  1. The searches your buyers makeMeasured, with how many people make each one
  2. Where you show up, and where you don'tOn Google and in ChatGPT's answers
  3. The agents' first monthThe pages, fixes and links they would start with