Skip to content
trending
AI Glossary / llms.txt
🌐 AI on the web

llms.txt

A file on a site with a content map for AI bots - like robots.txt, but for models.

llms.txt is a proposed standard: a text file in the site's root directory that describes the service in readable markdown and points to key content - a guide index, section descriptions, links. It helps AI models understand what the site offers, similar to how robots.txt tells crawlers where they can go. The standard is young and bot support varies, but implementation cost is negligible, and the file also helps organize thinking about your own content. More and more systems (including SEO plugins) now generate it automatically.

Related concepts
GEOAI crawlers (GPTBot and others)

← All terms in the AI Glossary

// site map
Quantslant in numbers 1,427posts in archive26news from the last 7 days18video models in the observatory
🎬 AI Video Benchmarks: Higgsfield DoP vs OpenAI Sora • Higgsfield vs Runway Gen-3 • AI Video Credit Calculator
× ‹ enlarge ›