Llms.txt
llms.txt is an emerging standard (analogous to robots.txt) that lets you communicate with large language models and AI crawlers about your content. It serves at the URL /llms.txt on your site.
What It Is For
While robots.txt controls which pages crawlers can access, llms.txt provides structured guidance specifically for AI systems: what your site is about, what content is available, how it should be cited, and any usage restrictions.
Format
llms.txt is a plain text file with a simple key: value structure. Common fields:
Name: Your site or organization name
Description: Brief description of your site’s purpose
Allow: Content types or paths AI may use
Disallow: Content types or paths AI should not use
Citation: How to credit your content if used
Backup and Restore
Like robots.txt, every save creates a backup of the previous version. One-click restore is available.
⭐ Pro: PIN protection for the llms.txt editor is a Pro feature. Free users can edit and save without PIN verification.
ℹ Note: The llms.txt standard is still evolving. Visit llmstxt.org for the latest specification and recommended fields.