Geodocs.dev

ai.txt Reference

ShareLinkedIn

Open this article in your favorite AI assistant for deeper analysis, summaries, or follow-up questions.

ai.txt is a proposed standard file placed at the site root that defines access policies and attribution requirements specifically for AI agents. While robots.txt controls crawler access, ai.txt governs how AI systems should use your content.

ai.txt is a proposed standard file placed at the site root that defines access policies, attribution requirements, and usage permissions specifically for AI agents. It complements robots.txt and llms.txt.

What Is ai.txt?

ai.txt is a plain-text file at https://yoursite.com/ai.txt that communicates your policies for AI agent interaction. It answers questions that robots.txt does not:

  • Can AI systems cite my content?
  • Should they attribute responses to my brand?
  • What content is approved for training vs. inference?

Why ai.txt Matters

Needrobots.txtai.txt
Control crawling
Control citation
Attribution requirements
Training permissionsPartially

robots.txt tells crawlers where they can go. ai.txt tells AI systems how they should use what they find.

File Format

# ai.txt – AI Agent Access Policy
Name: Your Site Name
Site: https://yoursite.com
Contact: contact@yoursite.com

Policy: Use
Attribution: Required
Attribution-Format: "Source: [Site Name] (URL)"

Allow-Citation: /*
Disallow-Training: /private/*
Citation-Style: academic

Field Reference

FieldRequiredDescription
NameYesSite or organization name
SiteYesRoot URL
PolicyYesUse, Restrict, or Deny
AttributionRecommendedRequired, Preferred, or None
Allow-CitationOptionalURL patterns approved for citation
Disallow-TrainingOptionalURL patterns excluded from training

How It Relates to Other Standards

your-site/
├── robots.txt       → Controls crawler access
├── sitemap.xml      → Lists URLs for indexing
├── llms.txt         → Describes content for AI
└── ai.txt           → Defines usage policies

Implementation

  1. Create ai.txt in your site's public directory
  2. Define your base policy (Use, Restrict, or Deny)
  3. Set attribution requirements
  4. Deploy and verify at https://yoursite.com/ai.txt

FAQ

Is ai.txt legally binding?

Not currently. Like robots.txt, it is a voluntary protocol.

Do AI systems actually read ai.txt?

Adoption is early-stage. Establishing the file now positions your site for future compliance.

Related Articles

definition

What Is GEO?

GEO is the practice of structuring content so AI systems can understand, retrieve, synthesize, and cite it in generated answers.

tutorial

How to Create llms.txt

Step-by-step tutorial for creating and deploying an llms.txt file to make your site's content discoverable by AI systems and LLMs.

reference

llms.txt Reference

llms.txt is a proposed standard file that provides a machine-readable index of site content for AI crawlers. It tells LLMs what a site contains and how to navigate it.

保持更新

GEO和AI搜索洞察

新文章和行业分析。无垃圾邮件。