Glossary definition

llms.txt

/ˌɛl.ɛl.ɛm.ɛs.ˈtɛkst/ noun

A plain-text Markdown file placed at the root of a website (yoursite.com/llms.txt) that provides AI systems with a curated index of the site's most authoritative content. Proposed by Jeremy Howard of Answer.AI in late 2024. Functions as a routing guide for AI crawlers — telling them which pages are worth fetching among those they are allowed to access — complementing robots.txt (access control) and sitemap.xml (full URL index).

See it in action

Run an AI SEO audit

Check technical SEO, AEO readiness, GEO signals, crawler access, and content gaps in one workflow.

Explore Thoth

Read the full guide

Go deeper on llms.txt

Read a practical guide with examples, workflows, and implementation advice.

Read the Guide