# LLMS.txt Explorer

> The world's largest searchable index of llms.txt files. Discovers, indexes, and provides API access to llms.txt and llms-full.txt files from across the internet, supporting the llmstxt.org standard for how websites communicate with Large Language Models.

## API

- [Search API](https://llms-text.ai/api/search-llms): Search 50K+ llms.txt entries by domain, topic, or keyword. Returns paginated JSON results with quality scores, topic rankings, and metadata.
- [Full Dataset API](https://llms-text.ai/api/search-llms-all): Retrieve the complete dataset of all indexed llms.txt records grouped by domain.
- [OpenAPI Specification](https://llms-text.ai/openapi.json): Machine-readable OpenAPI 3.1 spec for all API endpoints.
- [MCP Server](https://github.com/HillviewCap/llms/tree/main/mcp-server): Model Context Protocol server for tool-using LLMs — gives Claude, Cursor, and other MCP clients native access to the search index.

## Documentation

- [API Documentation](https://llms-text.ai/api): Interactive API docs with examples in JavaScript and Python, parameter reference, and sample responses.
- [About the Project](https://llms-text.ai/about): How we crawl the top 1M websites, validate against the llmstxt.org spec, and enrich with quality scores and topic classifications.
- [llms-full.txt](https://llms-text.ai/llms-full.txt): Comprehensive documentation of this project including data model, API details, and architecture.

## Blog

- [A New Web Standard](https://llms-text.ai/blog/a-new-web-standard): Overview of the llms.txt standard introduced in September 2024.
- [How Websites Are Utilizing llms.txt Files](https://llms-text.ai/blog/how-llmstxt-are-used): How different website types implement llms.txt for AI consumption.
- [llms.txt for E-Commerce](https://llms-text.ai/blog/llmstxt-ecommerce-ux): How llms.txt improves product discovery and AI interactions for online retailers.
- [Security Concerns with llms.txt](https://llms-text.ai/blog/llmstxt-security-concerns): Security risks and best practices for llms.txt implementation.
- [Generating llms.txt with Firecrawl](https://llms-text.ai/blog/generating-llmstxt-with-firecrawl): Guide to creating llms.txt files using Firecrawl tools.

## Other

- [Request or Report a Site](https://llms-text.ai/request): Submit new sites for indexing or report problematic entries via GitHub Issues.
- [Legal Information](https://llms-text.ai/legal): Terms of service, privacy policy, and data collection practices.