As I said in my previous post (Is AI Killing SEO), traditional search is not going away any time soon. However, search traffic is plateauing, and click-through rates for informational searches are falling, as AI systems like ChatGPT and Gemini deliver direct answers to users’ questions. For content websites that depend on traffic, it’s important to be cited, and linked to, and AI search results.
Fortunately, as I’ve previously explained, a good SEO strategy will also help get you listed in those AI snippets.
A New Standard: the llms.txt File
There’s also a new and important tool in the AI landscape: the llms.txt file. This emerging standard gives website owners more control over how AI systems interact with their content: what they can access, what they can’t, and how they should interpret it. While not yet universally adopted, major AI platforms are beginning to support it, and adoption is expected to grow.
If you’re running a WordPress website, there are already several plugins to automatically generate an llms.txt file. I’ve reviewed the current batch of plugins, and found a winner.
Llms.txt Plugins Compared
Website LLMs.txt / version 7.1.4
Author: Ryan Howard
This is a minimal plugin. The Settings allow the user to select the type of content that appears in the llms.txt file (pages / posts), and also specify the frequency of updating the file (daily / weekly / immediate).
In addition to page URLs, the llms.txt file generated includes publication data and text. There is no way to control the file content.
LLMs.txt Generator / version 1.0.2
Author: AEOmatic (Pedro Ladeira)
I tested the free version of this plugin. It indexes pages (not posts or other content), and it has no other settings. The llms.txt file generated includes URLs, and also default access rules:
# Custom Rules Training: allowed Scraping: limited APIAccess: restricted
There is a paid version of the plugin, for $49, which I did not test. It claims to add the following features:
- Include Posts in your llms.txt file
- Daily and Weekly automatic updates
- Custom taxonomies support
- Custom generation rules
- Full Multisite support
LLMs Text Generator for WordPress / version 1.0.5
Author: Fulgid
A new version of this plugin was released the day after my initial tests, so I retested it. The description below is based on version 1.0.5.
The setting allow you to specify the type of content to index (posts / pages / media), and also provide a header block to describe your site in the llms.txt file.
In addition to URLs, the file contains publication data and and a text excerpt.
The plugin can also generate another file: llms-full.txt, which contains the full text of all pages. Although this is a part of the evolving standard, I don’t believe it adds value in this case, since AI engines can simple scan the pages themselves.
LLMs.txt for WP / version 1.0
Author: Balázs Piller
The plugin setting allow the user to specify the type of content to index (posts / pages).
There is also a setting to generate “markdown” (.md) files corresponding to each page on the site. This is part of the proposed llms.txt standard, but I do not expect this to be widely used, since AI engines are perfectly capable of understanding standard web pages.
After choosing the settings, I was unable to find a way to actually generate the files! In its current form – in my opinion – this plugin is useless.
LLMS Full TXT Generator / version 2.0
Author: rankth
The plugin has extension settings. The user can specify the type of content to index (posts / pages / media), and the file update frequency (daily / weekly / manual). The plugin can generate llms.txt and llms-full.txt files.
It’s also possible to use the robots.txt file to restrict site crawling, or to specific a list of URLs to include or exclude. Unfortunately, the URL exclusion feature did not work; URLs I listed still appeared in the llms.txt file.
The llms.txt file also includes default access rules (which cannot be changed in the settings):
# Custom Rules
Training: allowed
Scraping: limited
APIAccess: restricted
Despite the fact that the exclusion feature did not work, this is a powerful plugin with many options.
Recommended with reservations.
Advanced LLMs.txt Generator / version 1.7
Author: Taha Büyüktaş
This plugin has a very clean and attractive user interface. Unfortunately, all of the text on the Settings page is in Turkish! However, I was able to use Google Translate (built in to the Chrome browser) to understand the settings.
Like LLMS Full TXT Generator, this plugin allows the user to The user can specify the type of content to index (posts / pages / media), and the file update frequency (daily / weekly / manual). The plugin generates llms.txt, but not llms-full.txt files.
The plugin allows the user to specify access rules. This is important if you do not want AI bots to index your site.
Like LLMS Full TXT Generator, this plugin allows the user to specific a list of URLs to include or exclude, but as with the previous plugin, the exclusion feature does not work.
Recommended with reservations.
Summary of llms.txt Generators
| Plugin | Version | Author | llms.txt | llms-full.txt | Frequency | Content Types | Crawl Permissions | Disable URLs |
| Website LLMs.txt | 7.1.4 | Ryan Howard | X | X | X | |||
| LLMs.txt Generator / AEOmatic | 1.0.2 | Pedro Ladeira | X | |||||
| LLMs Text Generator for WordPress | 1.0.4 | Fulgid | X | |||||
| LLMs.txt for WP | 1 | Balázs Piller | X | X | X | |||
| LLMS Full TXT Generator | 2 | rankth | X | X | X | X | X | X |
| Advanced LLMs.txt Generator | 1.7 | Taha Büyüktaş | X | X | X | X | X | X |
Conclusions
The llms.txt standard and the plugins that support it are still evolving.
At this point, I think it is worthwhile to have an llm.txt file on your site, and I recommend both Advanced LLMs.txt Generator and LLMS Full TXT Generator for WordPress users.