← All articles

llms.txt: What It Is, How to Write One, and Whether It Works

Short answer

llms.txt is a plain Markdown file at the root of your website (yoursite.com/llms.txt) that gives AI tools a short, curated summary of your site and links to its most important pages. It takes under an hour to create. So far there is little evidence that AI search engines read it, and Google says you don’t need it to appear in AI Overviews, so treat it as a cheap extra, not a strategy.

What is llms.txt?

llms.txt is a proposal for a simple text file that helps large language models (LLMs) and AI agents understand a website. Jeremy Howard published the proposal on September 3, 2024, at llmstxt.org. Its stated purpose is to give AI agents a short, curated entry point to a site.

The reasoning is simple. A normal web page is full of menus, scripts, cookie banners and footers. An AI model has limited room to read, so a single clean file that says “here is what this site is, and here are the pages that matter” saves it work.

It is not the same as robots.txt or a sitemap. Each file has its own job:

FileWhat it doesFormat
robots.txtTells crawlers which parts of the site they may visit.Plain text rules
sitemap.xmlLists every page you want search engines to find.XML
llms.txtSummarizes the site and points to its most important pages.Markdown

What does an llms.txt file look like?

The format is short. According to the proposal, a file has these parts, in this order:

  1. A title: an H1 with the name of the site or project. This is the only required part.
  2. A summary: a blockquote with a short description of the site.
  3. Details: optional paragraphs or lists with the key facts.
  4. Link sections: H2 headings, each followed by a list of Markdown links (the page name in square brackets, then its URL in round brackets), with an optional note after a colon.
  5. An “Optional” section: links an AI tool can skip when it needs a shorter version.

Here is a small example for a made-up bakery:

# Sunrise Bakery

> Sunrise Bakery is a family bakery in Austin, Texas. We bake sourdough,
> pastries and custom cakes, with local delivery and nationwide shipping.

Key facts:

- Open every day, 7am to 6pm
- Custom cake orders need 3 days' notice
- Contact: hello@sunrisebakery.example

## Main pages

- [Menu](https://sunrisebakery.example/menu/): Breads, pastries and prices
- [Custom cakes](https://sunrisebakery.example/cakes/): How to order and lead times
- [Delivery](https://sunrisebakery.example/delivery/): Areas, fees and shipping

## Optional

- [Our story](https://sunrisebakery.example/about/)

For a live example, open ours: dfxstudios.org/llms.txt. It follows the same structure: who we are, key facts, main pages, blog posts, then the legal pages under “Optional”.

How do you create an llms.txt file?

  1. Write one clear sentence about your business

    Say what you are, who you help and what you offer. If you can’t fit it in two sentences, your website probably has the same problem.

  2. List the key facts

    Services or products, where you work, how to contact you, and any terms people always ask about. Keep each fact to one line.

  3. Pick your 5 to 15 most important pages

    Services, pricing, your best guides, contact. This is a shortlist, not a copy of your sitemap.

  4. Add a short note to each link

    One line that says what the page answers, so a reader knows which link to follow.

  5. Put secondary links under “Optional”

    Legal pages, archives and anything nice to have.

  6. Save it as llms.txt in your site’s root folder

    Then open yoursite.com/llms.txt in a browser and check that it loads as plain text.

  7. Update it when your site changes

    A file that lists old offers or broken links is worse than no file.

Some website platforms and plugins can generate the file for you. Check the result by hand: an auto-generated list of every URL misses the point of a curated summary.

Does llms.txt actually work?

This is where most guides oversell it. Here is what the data says so far.

8.8×

Growth in sites with an llms.txt file in one year: from 4,088 in June 2025 to 36,120 by May 2026, in an Originality.ai study of more than 3 million websites.

Source: PPC Land

97%

Share of llms.txt files that received zero requests in May 2026, in an Ahrefs server-log study of 137,000 domains.

Source: PPC Land

1.1%

Share of llms.txt requests that came from AI retrieval bots in the same study. SEO audit tools were the biggest group, at 21.7%.

Source: PPC Land

So adoption is growing fast, but reading is not. Google is direct about its own products. Its guide to AI features in Search says: “You don’t need to create new machine readable files, AI text files, or markup to appear in these features.” (Google Search Central)

OpenAI’s crawler documentation doesn’t mention llms.txt either. It points site owners to robots.txt to control how ChatGPT search and training crawlers use a site (OpenAI).

Where the file does get used today is developer documentation. Coding assistants are often pointed at a documentation site’s llms.txt to find the right page quickly. For a typical business website, that use case doesn’t apply yet.

Should you add llms.txt to your site?

Yes, if you treat it as a small bet. It costs nothing, it takes less than an hour, and writing it forces you to describe your business in one clear paragraph, which is useful everywhere else too. If AI tools start reading the file more widely, you’re ready.

Just don’t expect it to change your rankings or get you cited on its own. These matter far more:

  • Let AI crawlers in. Check that robots.txt doesn’t block OAI-SearchBot, ClaudeBot, PerplexityBot or Googlebot.
  • Answer questions in the page text. A direct answer in the first two sentences is what AI tools quote.
  • Keep your brand facts consistent on your site, your social profiles and review sites.
  • Earn mentions on other websites. AI answers draw on many sources, not just yours.
  • Keep pages fresh and show when they were last updated.

We cover the full picture in SEO vs GEO and the step-by-step version in how to rank in ChatGPT.

What are the most common llms.txt mistakes?

  • Listing every URL. That’s what the sitemap is for. llms.txt is a shortlist.
  • Writing ad copy. “World-class solutions” tells a model nothing. Plain facts do.
  • Blocking AI crawlers in robots.txt and then adding llms.txt. The block wins.
  • Treating it as access control. llms.txt doesn’t stop anyone from reading or training on your content. robots.txt is the tool for that.
  • Letting it go stale. Old offers, dead links and pages that no longer exist.

Frequently asked questions

Is llms.txt an official standard?

No. It’s a community proposal published by Jeremy Howard in September 2024. No standards body has adopted it, and no major AI search engine has committed to reading it.

Where do you put the llms.txt file?

In the root folder of your website, so it opens at yoursite.com/llms.txt. The proposal also allows a file in a subfolder, such as /docs/llms.txt, that covers only that part of the site.

Does llms.txt help SEO or Google rankings?

No. Google says you don’t need AI text files to appear in AI Overviews or AI Mode. A page needs to be indexed and eligible to show in Google Search with a snippet. See our guide to SEO for small business for what does help.

Does llms.txt stop AI companies from training on my content?

No. It’s a summary, not a rule. To opt out of training, use robots.txt: for example, disallow GPTBot for OpenAI or Google-Extended for Google’s Gemini models.

What is the difference between llms.txt and llms-full.txt?

llms.txt is a short index with links. llms-full.txt is a variant that puts the full text of the important pages into one long file. It’s mostly used for software documentation.

How often should you update llms.txt?

Whenever your key pages, offers or contact details change. A good habit is to check it each time you publish an important new page.

Sources

  1. llmstxt.org: the llms.txt proposal by Jeremy Howard
  2. Google Search Central: AI features and your website
  3. OpenAI: Overview of OpenAI crawlers
  4. PPC Land: llms.txt adoption rises 8.8x but 97% of files get zero AI requests (July 2026)

Want your brand to show up in AI answers?

We build content that search engines and AI tools can find, understand and quote. Start with an audit of your content, or see how we handle SEO and GEO.

More from the blog

How to Rank in ChatGPT: 8 Steps to Get Your Brand Cited

You can’t buy a place in ChatGPT’s answers, but you can raise your chances. Eight practical steps, from letting its crawler in to earning mentions on the sites it already cites.