# llms.txt for agents

> Any site's llms.txt: find the covering index, read its linked docs as markdown, search sections. Remote MCP server over Streamable HTTP at `https://llmstxtmcp.dev/mcp`. Free, no API key. Tools: `llms_index`, `llms_page`, `llms_search`. The tool list is fixed per version.

Given any site or page URL, llms_index discovers the llms.txt that covers it (root, redirects, Link: rel="describedby" advertisements, subpath files with most-specific-wins), parses it into the v2 structure (title, summary, H2 sections of [title](url): notes links, the Optional section) and reports every rung it tried, so a miss is as informative as a hit. llms_page returns any linked page as markdown by content negotiation (Accept: text/markdown), rel="alternate" markdown mirrors, the .md / .html.md / index.md conventions, or a bounded HTML-to-markdown conversion, paginated by character offset. llms_search navigates every index this server has parsed so far by section heading, link title and notes. Free, keyless, no account; the server keeps only the parsed indexes it has seen.

Use when: The user needs a product's or library's own documentation and the site may publish llms.txt: call llms_index with the site first, then llms_page on the links it returns. Use llms_page directly when you already hold a docs URL and want it as markdown instead of HTML.

Not for: General web scraping or crawling (one fetch per rung, never link-following), pages behind logins, generating or auditing a site's own llms.txt, or searching the whole web for documentation.

Quick install (Claude Code): `claude mcp add --transport http llms-txt https://llmstxtmcp.dev/mcp -s user`

## Docs

- [Full reference](https://llmstxtmcp.dev/llms-full.txt): every tool with its JSON input schema and an example
- [Install for any client](https://llmstxtmcp.dev/install): Claude Code, Cursor, VS Code, Claude Desktop, ChatGPT, Codex, Gemini CLI, Windsurf, Cline, Continue, Zed
- [OpenAPI twin](https://llmstxtmcp.dev/openapi.json): the same tools as plain HTTP POST endpoints
- [Registry server.json](https://llmstxtmcp.dev/.well-known/mcp/server.json): machine-readable server record

## Upstreams

- [The /llms.txt file (v2 spec)](https://llmstxt.org/index.md): keyless
- [Markdown for Agents (Accept: text/markdown negotiation)](https://blog.cloudflare.com/markdown-for-agents/): keyless

## Optional

- [Health](https://llmstxtmcp.dev/healthz): liveness JSON
- [Owner](https://github.com/ux-xd/llms-txt-mcp): agie