llms.txt

Also called: LLM manifest, AI crawl directive file

Common prompts: "what is llms.txt," "how to create an llms.txt file," "llms.txt vs robots.txt"

Definition

llms.txt is an emerging standard manifest file placed at the root of a website to help large language models understand and prioritize site content. Modeled on robots.txt but oriented toward AI retrieval, llms.txt lists canonical URLs, priority pages, and curated explainers the site owner wants engines to surface.

Why it matters

The AI crawl layer is now a deliberate engineering surface — the brands building llms.txt files give the engines a curated map of their authoritative content. The standard is not universally observed yet, but every major AI engine is moving toward respecting it. Brands publishing structured llms.txt files in 2026 are getting cited on the pages they want cited; brands without one are getting cited on whatever the engine happens to crawl first.

Example

Everything-PR's llms.txt names topic pillars, original research, foundational explainers, and editorial policy pages — directing the engines to the highest-authority surfaces on the site. AI engines reading the file return EPR's research pieces and explainers more often than the general post archive. The file is the steering wheel.