AI Search guide

llms.txt template and llms-full.txt examples

Copy a practical llms.txt template, learn how to structure llms-full.txt, and avoid common AI crawler readiness mistakes.

Updated May 21, 2026 Resource/Template Resources / AI Search
Review the recommendation Compare AI visibility tools

Editorial note: llms.txt is treated here as an emerging AI-readable convention, not a confirmed ranking factor or guaranteed crawler signal.

Use this template to create a first version of /llms.txt. Keep it short, curated, and easy to maintain. The goal is not to list every URL. The goal is to give AI-oriented tools and human reviewers a clean map of the pages that best explain your site.

Important caveat: llms.txt is an emerging convention. It is not a guaranteed ranking factor, and it does not control crawler access. Use robots.txt for crawl rules and sitemap.xml for search URL discovery.

Basic llms.txt template

# [Site or Product Name]

> [One or two sentences explaining what the site does, who it serves, and what content is most useful.]

## Start here

- [Overview](https://example.com/): [Why this page matters.]
- [Pricing](https://example.com/pricing): [What a reader can decide here.]
- [Documentation](https://example.com/docs): [What the docs cover.]

## Key resources

- [Resource title](https://example.com/resource): [One-sentence description.]
- [Comparison title](https://example.com/compare/example-vs-alternative): [One-sentence description.]
- [Guide title](https://example.com/learn/example-guide): [One-sentence description.]

## Trust and policies

- [Security](https://example.com/security): [Security, privacy, and compliance details.]
- [Methodology](https://example.com/methodology): [How content, data, or evaluations are produced.]

## Optional

- [Changelog](https://example.com/changelog): [Recent product changes.]
- [Support](https://example.com/support): [Help and contact options.]

Template for an AI tools publisher

# ClawNewbie

> ClawNewbie is an AI tools and AI knowledge hub covering software comparisons, AI visibility, LLM infrastructure, AI agents, automation, and practical implementation resources.

## AI visibility and search

- [Best AI visibility tools](https://clawnewbie.com/reviews/best-ai-visibility-tools-2026): Tools for monitoring how brands and products appear in AI answers.
- [What is llms.txt?](https://clawnewbie.com/learn/llms-txt-explained-ai-search-2026): Guide to llms.txt, AI-readable site maps, and cautious adoption.
- [Best llms.txt generator tools](https://clawnewbie.com/reviews/best-llms-txt-generators-2026): Comparison of tools for creating and maintaining llms.txt and llms-full.txt.

## LLM infrastructure

- [Best LLM evaluation tools](https://clawnewbie.com/reviews/best-llm-evaluation-tools-2026): Tools for testing, scoring, and improving LLM applications.
- [Best LLM observability tools](https://clawnewbie.com/reviews/best-llm-observability-tools-2026): Platforms for traces, monitoring, debugging, and production visibility.
- [Best LLM gateway tools](https://clawnewbie.com/reviews/best-llm-gateway-tools-2026): Gateways for routing, policy, fallback, and cost control.

## AI crawler and data readiness

- [Best AI web scraping tools](https://clawnewbie.com/reviews/best-ai-web-scraping-tools-2026): Tools for AI-ready web data extraction and crawler workflows.

SaaS template

# [Product Name]

> [Product Name] helps [audience] solve [problem] with [category or product type].

## Product

- [Product overview](https://example.com/product): What the product does and who it is for.
- [Use cases](https://example.com/solutions): Common workflows and buyer scenarios.
- [Pricing](https://example.com/pricing): Plan details and packaging.

## Documentation

- [Docs home](https://docs.example.com/): Main documentation entry point.
- [API reference](https://docs.example.com/api): API endpoints, authentication, and examples.
- [Quickstart](https://docs.example.com/quickstart): First implementation steps.

## Trust

- [Security](https://example.com/security): Security and compliance overview.
- [Privacy](https://example.com/privacy): Privacy practices and policy.

Ecommerce template

# [Store Name]

> [Store Name] sells [product category] for [audience], with guides, policies, and product education.

## Shopping guides

- [Buying guide](https://example.com/guides/buying-guide): How to choose the right product.
- [Size guide](https://example.com/pages/size-guide): Sizing and fit help.
- [Best sellers](https://example.com/collections/best-sellers): Popular products and categories.

## Help

- [Shipping](https://example.com/pages/shipping): Shipping options and timelines.
- [Returns](https://example.com/pages/returns): Return and exchange policy.
- [Support](https://example.com/pages/contact): Customer support options.

llms-full.txt example structure

llms-full.txt is the larger companion file. It can include fuller page summaries or extracted Markdown content. Use it only when you can maintain it.

# [Site Name] Full Context

> Expanded context for key public pages on [Site Name]. Last reviewed: 2026-05-21.

## Product overview

Source: https://example.com/product

[Short extracted or edited explanation of the product page.]

## Documentation quickstart

Source: https://docs.example.com/quickstart

[Short extracted or edited quickstart summary.]

## Security

Source: https://example.com/security

[Short extracted or edited security summary.]

Formatting rules

Use Markdown headings. Keep links absolute. Use canonical URLs. Add descriptions that explain why the page matters. Group links by user intent. Keep private and gated URLs out. Revalidate the file after major site changes.

Do not stuff keywords, hide promotional claims, or list every low-value URL. A bloated file is less useful than a short, accurate one.

Pre-publish checklist

  • The file is available at /llms.txt.
  • Every listed URL returns 200.
  • Descriptions are accurate and not exaggerated.
  • Private, gated, duplicate, parameterized, and checkout URLs are excluded.
  • The file has an owner.
  • The update process is tied to content releases or docs changes.
  • Claims about AI visibility remain cautious.

FAQ

How long should llms.txt be?

Long enough to map your most important public pages, short enough that a person can review it quickly. For many sites, 10 to 50 links is a practical starting range.

Should I include noindex pages?

Usually no. Include pages that are public, canonical, useful, and meant to represent the site.

Use external links sparingly. The file should primarily explain your own site.

What is the difference between llms.txt and llms-full.txt?

llms.txt is the short curated map. llms-full.txt is the larger context file. Start short, then add the larger file if maintenance is realistic.

Related ClawNewbie guides

Publisher caveat

  • Template code blocks contain example domains and should remain examples unless Publisher creates a ClawNewbie operational llms.txt file separately.
  • The ClawNewbie sample assumes the four new pages are published and should be adjusted if Publisher changes slugs.

Copy the template, curate your most important public pages, and validate every URL before publishing.

Keep the file owned by the team that controls navigation, docs, or editorial architecture.

Explore Tools Compare