Is LLMs.txt Mandatory for Websites? Everything You Need to Know About
Listen to this article
Table of Contents
There's so much hype around llms.txt that you've probably heard every agency expert talk about how important it is to add llms.txt to your website. But is that actually true? Not really.
Google has confirmed that it does not use llms.txt in its Search, as well as Generative AI features such as AI Overviews and AI Mode. Likewise, many AI companies like OpenAI, Anthropic, and Perplexity have not yet confirmed using llms.txt for AI search, even though they do publish llms.txt for documentation.
Presently, llms.txt is mostly used among AI agents and developer tools only. So the question is: should you care to use llms.txt for your website? Let's break that down.
Google's AI Features and Your Website documentation, along with updates in March and June 2026, made it clear that llms.txt is not mandatory for websites, as far as Google and its AI features are concerned. However, this conversation does not necessarily apply to other sources of information that AI engines may parse to extract useful information from.
Since Google is a dominant discovery platform for the majority of AI bots, the real question is: should you be using llms.txt for your website? To answer this better, let's first understand what llms.txt means, why it is important, and then decide if you should care about it.
What is llms.txt?
LLMs.txt is a proposed standard in the form of a text file that is meant to help Large Language Models (LLMs) understand your website's content better, so that AI can easily parse your content and cite you in user queries.
Here are the official specifics:
The idea is simple. Instead of letting AI bots waste time and tokens searching the entire website or page for one query, llms.txt makes the work easier by giving crawlers the exact location of the answers or topics they are looking for.
Importance of llms.txt
Search behaviour has changed dramatically over the last few years. People ask AI chatbots like ChatGPT, Gemini, Perplexity, and Claude in AI mode, or use AI Overviews, instead of searching on Google and clicking on blue links.
This is why, to get cited or mentioned by AI, you need to be well understood by AI chatbots. This is where llms.txt becomes important.
llms.txt basically tries to solve two issues:
Websites Usually Have Too Much Information
Most websites are heavily loaded with information, and anyone searching for it will have to go through the entire content to extract something of value. llms.txt solves this by giving AI bots the whereabouts of the answer they are looking for.
Most Websites Are Hard to Read
The majority of AI crawlers can only read basic HTML and not content that gets loaded with JavaScript. llms.txt bridges that gap and provides clear information to AI crawlers for better understanding.
Where Did llms.txt Come From?
llms.txt was introduced by Jeremy Howard, co-founder of Answer.ai, in 2024, as an easy way to help AI crawlers understand content better. Google never supported it as a standard for itself.
However, many digital marketers and SEO experts assumed that Google may use it because of its convenience and promoted it as a vital addition to websites.
What Does Google Say About llms.txt?
Google officially responded to llms.txt usage in 2025 through its AI Features and Your Website guidance, stating clearly that you do not need an llms.txt file to be featured by Google or its AI features.
However, Google Chrome Lighthouse created some confusion around this by introducing an optional llms.txt audit to help developers build AI-friendly websites. This divided SEO experts' opinions, with many believing that llms.txt was important for Google discovery.
Further, with its March Core Update and June Spam Update in 2026, Google again maintained its previous stance by clarifying that Google Search and its generative AI features, including AI Overviews and AI Mode, do not use llms.txt.
Therefore, creating an llms.txt file will not affect your business's rankings or AI visibility in Google.
What Do Other Stakeholders Say About llms.txt?
As of now,
Here’s an anomaly, however- all 3 AI companies publish their own llms.txt for their documentation websites.
According to an Ahrefs study conducted in May 2026 using more than 38,000 domains with valid llms.txt files, 97% of these domains received zero requests for fetching llms.txt.
So far, based on available research and knowledge, llms.txt is confirmed to be mainly used by developer and AI agent tools such as:
- AI coding assistants like Cursor and GitHub Copilot
- Claude Code and other AI agents
- Custom RAG (Retrieval-Augmented Generation) systems
- MCP (Model Context Protocol) applications
- Documentation platforms like Mintlify
Should You Add llms.txt to Your Website?
At Finessse, we see llms.txt as a “nice to have” and not as a major driver of any AIO or AEO strategy.
It's also easy to implement, and there's hardly any downside to having one. So, why not? Our suggestion is simple: if you have the bandwidth and time, go ahead and add it.
For more information, get in touch with us today!
Watch Founders’ Bytes on YouTube and Subscribe to our Newsletter: Digital, Simplified & Unfiltered.
Frequently Asked Questions
1. Is llms.txt mandatory for websites?
llms.txt is not mandatory for websites. It is a proposed standard that helps AI systems understand your content better.
2. What is llms.txt?
llms.txt is a proposed standard that helps AI systems understand your content better and saves the time and tokens that may otherwise be required during deep research.
With llms.txt, AI systems get the exact whereabouts of answers to user queries and do not have to dig deeply through the content.
3. Does ChatGPT use llms.txt?
OpenAI has not officially confirmed that ChatGPT uses llms.txt to answer user queries. However, OpenAI does publish an llms.txt file for its documentation.
4. Does Google use llms.txt for AI Overviews or AI Mode?
Google does not use llms.txt for AI Overviews, AI Mode, or Google Search, as established through Google's AI Features and Your Website documentation, the March Core Update in 2026, and the June Spam Update in 2026.
5. Who actually uses llms.txt?
At present, llms.txt is mainly used by AI development tools such as coding assistants, AI agents, Retrieval-Augmented Generation (RAG) systems, MCP applications, and documentation platforms.
6. Should I add llms.txt to my website?
Even though llms.txt is not mandatory and has not yet been confirmed to have a direct effect on AI search visibility, it can be considered a useful supplementary addition to your website.
There is generally no significant downside to adding an llms.txt file, and it may prove useful as AI technologies and standards continue to evolve.
No related posts available.