Skip to content
Try for free

Do I need an llms.txt file?

In short

llms.txt is a simple text file in your website's root that offers AI systems a curated table of contents of your key pages. In 2026 it's the most-discussed GEO topic — but it's present on only around 10% of sites, the major AI crawlers rarely fetch it, and Google has publicly stated it does not support llms.txt. It does no harm and takes little effort; just don't rely on it as a visibility lever.

What llms.txt actually is

llms.txt is a convention (not an official standard) proposed in 2024: a Markdown file at yourdomain.com/llms.txt that gives LLMs a tidy overview of your most important content — like a sitemap, but for answer engines rather than search-engine crawlers. The idea: instead of working through nested HTML, the AI gets a curated map of your site.

The 2026 reality check

The theory is good, the practice sobering. A study of around 300,000 domains (SE Ranking) found roughly 10% adoption — mostly among developer-facing SaaS, rarely in conservative sectors. More importantly, the major crawlers (GPTBot, ClaudeBot, PerplexityBot, Google-Extended) almost never fetch the file and crawl the HTML directly instead. In July 2025 Google, via Gary Illyes, publicly stated it does not support llms.txt and has no plans to.

Should you create one anyway?

Yes — with the right expectation. The file is quick to make, does no harm and signals that you take AI discoverability seriously. As a GEO tool yourself it's good form. But it replaces nothing: crawlability of your normal HTML, clean structure, authority and consistent brand representation move the needle today — llms.txt is optional, not essential.

Key takeaways

  • llms.txt is a convention, not a standard — and not a confirmed ranking factor.
  • ~10% adoption (SE Ranking study); the major AI crawlers currently rarely fetch it.
  • Google officially does not support llms.txt (Gary Illyes, July 2025).
  • Creating one is fine (low effort), but no substitute for crawlable, authoritative HTML.

Sources

  • SE Ranking, llms.txt adoption study (~10% of ~300,000 domains), 2026; overview: aeo.press, "State of llms.txt 2026".
  • Google / Gary Illyes (public statement, July 2025): no support for llms.txt.
  • Specification: llmstxt.org.

Frequently asked questions

Does an llms.txt file hurt my classic SEO?

No. llms.txt is meant for AI crawlers and doesn't affect Google rankings — neither positively nor negatively. Google stated in July 2025 that it doesn't use the file at all.

Why create an llms.txt if the major AI crawlers ignore it?

Because the effort is minimal and risk-free, some smaller tools use the file, and as a provider you set a credibility signal. In 2026 it's no more than a "nice to have," though.

Is an llms.txt enough to become visible in AI answers?

No. At ~10% adoption and rarely fetched by the major crawlers, what decides instead is crawlable HTML, authority (brand mentions) and consistency — not the file.

About the author

Christoph Schempershofe, founder of VISIBILIS. Since his studies he has combined marketing with technology: from websites and brand building through search engine marketing to AI visibility (GEO). As a lecturer at FOM and IU he teaches marketing, online and search engine marketing and content management systems.

LinkedIn