AI search · Glossary
What is llms.txt?
llms.txt is a proposed plain-text file at the root of a website (/llms.txt) that summarizes the site and links to its most important pages in a format easy for large language models to read. It was proposed in September 2024 and is not an official standard.
Written by Noor KhanWhy llms.txt matters
It's a cheap, low-risk way to give AI tools a clean overview of who you are and where your key content lives. Adoption by AI companies is still limited, so treat it as helpful rather than essential.
How llms.txt works
- The file uses Markdown: a title, a short summary, then sections of links with descriptions.
- Some sites also provide Markdown versions of pages for easier processing.
- It doesn't control crawling; robots.txt still does that.
How to apply it
- Write a one-paragraph summary of your business and expertise.
- List your key services, articles and resources with one-line descriptions.
- Keep it updated as you publish.
Example
This site's /llms.txt summarizes Noor Khan's services and links to every article and podcast episode, each with a Markdown version.
Common mistake
Expecting llms.txt to improve rankings or force AI citations. It's a convenience for AI tools, not a ranking signal.
Not sure how llms.txt applies to your site? Book a strategy call, request a free gap snapshot, or ask the assistant.