llms.txt glossary definition

llms.txt is a text file placed at the root of a website to provide artificial intelligence systems with structured information about the site’s content and most important resources.

Proposed as an emerging standard, the /llms.txt file is intended to help large language models (LLMs), including those used by search engines and AI assistants, better understand a website’s structure, context, and key content.

What Is the Purpose of llms.txt?

An llms.txt file can provide a selection of a website’s most important pages along with short descriptions. It can therefore serve as a guide for AI systems that need to understand or use information published on a website.

Unlike the robots.txt file, which primarily tells web crawlers which resources can or cannot be accessed, llms.txt is designed to provide context and useful information to AI systems.

llms.txt and SEO

The llms.txt file is part of the evolution of SEO in the age of artificial intelligence. It may help make a website’s content easier for AI systems to understand and access.

However, it is important to note that llms.txt is not currently an official Google ranking factor. Its adoption and use also vary among different AI systems.

In short, llms.txt acts as a guide for artificial intelligence systems, helping them better understand the content a website considers important.

← Back to Glossary