Blog

Getting Discovered by AI: Schemas, llms.txt and Beyond

Getting Discovered by AI Schemas, llms.txt, and the Future of Search A New Era of Discovery Discovery is no longer just "Can Google rank this page?". The new question is: "Can AI agents understand, trust, and act on this content?" The web is shifting from pages and keywords to en

←All resources

Getting Discovered by AI

Schemas, llms.txt, and the Future of Search

A New Era of Discovery

Discovery is no longer just "Can Google rank this page?". The new question is: "Can AI agents understand, trust, and act on this content?" The web is shifting from pages and keywords to entities, actions, and policies.

llms.txt: The AI Roadmap

This emerging file acts as the "robots.txt for AI," providing a curated map of your site's most important content for language models to follow.

Agentic Schema: The Action Layer

Schema is no longer just for rich snippets. It's becoming the primary interface for AI agents to perform tasks like booking, buying, or contacting.

Agentic Search: The New Paradigm

AI assistants are moving beyond link retrieval to execute multi-step tasks, fundamentally changing how discovery and ranking work.

Anatomy of an `llms.txt` File

Think of `llms.txt` as your AI-facing site map. It's a simple, human-readable file that guides AI agents to your most valuable content.

Site Identification

An H1 with your site name and a short summary of its purpose, audience, and scope.

Structured Links

Bulleted lists of priority URLs under H2 headings like "Docs," "Pricing," or "Case Studies."

Authority & Metadata

Pointers to sitemaps, authors (`PrimaryAuthor`), and preferred citation templates for correct attribution.

Architecting Schema for AI Agents

Agent-Ready Schema

Make your site "taskable" by explicitly defining entities, actions, and trust signals. Place JSON-LD schema in the document `` for priority parsing by agents.

40% Entities: Clearly define `Product`, `Service`, `Article`.
30% Actions: Use `potentialAction` for `BuyAction`, `ReserveAction`.
20% Verification: Link to authors, reviews, and licenses.
10% Head Placement: Prioritize schema in the `` for quick parsing.

The Agentic Search Workflow

1

Decompose Intent

Breaks user goals into subtasks.

→
2

Consult Sources

Uses `llms.txt` to find priority pages.

→
3

Read Structured Data

Parses schema for entities and actions.

→
4

Execute Action

Completes the task (books, buys, etc.).

Key Challenges

  • Fragmented standards and implementations.
  • Limited public data on direct impact.
  • Ongoing governance and content curation required.
  • Proprietary RAG pipelines limit optimization feedback.

Strategic Opportunities

  • Create a canonical `llms.txt` as a strategic artifact.
  • Architect schema for agents to make your site "taskable."
  • Design for AI "reading paths" to guide RAG systems.
  • Establish cross-functional AI discovery governance.

Ready to Optimize for AI Discovery?

Don't get left behind. Start building your AI discovery strategy today to become a preferred, authoritative source for the next generation of search.

Schedule some AWESOME and let's talk >