llms.txt is a proposed file at the root of your site, written in Markdown, that tells AI tools what your site is about and links to your most useful pages.
What goes in it
- A heading with your site name.
- A short summary of what you offer.
- Sections with links to key pages: products, documentation, guides, policies.
Should you add one?
It is optional and not a ranking factor. It is quick to create, does no harm, and may help AI tools find the right pages.
Example
# Pepplo Web Technologies
> Web applications, recharge and bill payment APIs, and ready-made web products.
## Products
- [Pepplo SEO Suite](https://pepploweb.com/seo-suite): self-hosted SEO platform.
## Support
- [Help centre](https://pepploweb.com/kb): guides and FAQs.
- [Contact](https://pepploweb.com/contact)Keep it short and current
List your most important pages, not every page. Update it when you add products or move key pages.
It does not replace good pages
An llms.txt file only points to content; the pages themselves still need to be clear, accurate and accessible to crawlers.
Tools
Create one with the llms.txt generator and check an existing file with the llms.txt checker. Pair it with sensible AI crawler rules from the AI robots.txt builder.
0 comments