This article introduces `llms.txt`, a new file analogous to `robots.txt` but designed for AI search engines. It's becoming critical by 2026 for websites to optimize their visibility in AI search tools like ChatGPT by helping them understand a business's core information.
The author developed a WordPress plugin that automatically generates llms.txt files from a sitemap, addressing the lack of a good solution for this emerging standard in Generative Engine Optimization (GEO). This file helps AI crawlers like ChatGPT, Perplexity, and Claude understand website content and page importance without manual updates.
A Brazilian rock band, HADEMANASTIA, implemented the llms.txt standard on its website, extending the practice with references in sitemap.xml and JSON-LD. This approach aims to control how AI crawlers interact with content, going beyond typical implementations.
The `llms.txt` is a standard markdown file, proposed by fast.ai, designed to improve how AI assistants interact with websites. It functions as a `robots.txt` for the AI era, enhancing content citation and comprehension, especially for complex JavaScript sites.