AI Glossary / llms.txt
🌐 AI on the web
llms.txt
A file on a site with a content map for AI bots - like robots.txt, but for models.
llms.txt is a proposed standard: a text file in the site's root directory that describes the service in readable markdown and points to key content - a guide index, section descriptions, links. It helps AI models understand what the site offers, similar to how robots.txt tells crawlers where they can go. The standard is young and bot support varies, but implementation cost is negligible, and the file also helps organize thinking about your own content. More and more systems (including SEO plugins) now generate it automatically.
Related concepts