ai.txt Reference
ai.txt is a proposed standard file placed at the site root that defines access policies and attribution requirements specifically for AI agents. While robots.txt controls crawler access, ai.txt governs how AI systems should use your content.
ai.txt is a proposed standard file placed at the site root that defines access policies, attribution requirements, and usage permissions specifically for AI agents. It complements robots.txt and llms.txt.
What Is ai.txt?
ai.txt is a plain-text file at https://yoursite.com/ai.txt that communicates your policies for AI agent interaction. It answers questions that robots.txt does not:
- Can AI systems cite my content?
- Should they attribute responses to my brand?
- What content is approved for training vs. inference?
Why ai.txt Matters
| Need | robots.txt | ai.txt |
|---|---|---|
| Control crawling | ✅ | ❌ |
| Control citation | ❌ | ✅ |
| Attribution requirements | ❌ | ✅ |
| Training permissions | Partially | ✅ |
robots.txt tells crawlers where they can go. ai.txt tells AI systems how they should use what they find.
File Format
# ai.txt – AI Agent Access Policy
Name: Your Site Name
Site: https://yoursite.com
Contact: contact@yoursite.com
Policy: Use
Attribution: Required
Attribution-Format: "Source: [Site Name] (URL)"
Allow-Citation: /*
Disallow-Training: /private/*
Citation-Style: academicField Reference
| Field | Required | Description |
|---|---|---|
Name | Yes | Site or organization name |
Site | Yes | Root URL |
Policy | Yes | Use, Restrict, or Deny |
Attribution | Recommended | Required, Preferred, or None |
Allow-Citation | Optional | URL patterns approved for citation |
Disallow-Training | Optional | URL patterns excluded from training |
How It Relates to Other Standards
your-site/
├── robots.txt → Controls crawler access
├── sitemap.xml → Lists URLs for indexing
├── llms.txt → Describes content for AI
└── ai.txt → Defines usage policiesImplementation
- Create
ai.txtin your site's public directory - Define your base policy (
Use,Restrict, orDeny) - Set attribution requirements
- Deploy and verify at
https://yoursite.com/ai.txt
FAQ
Is ai.txt legally binding?
Not currently. Like robots.txt, it is a voluntary protocol.
Do AI systems actually read ai.txt?
Adoption is early-stage. Establishing the file now positions your site for future compliance.
Related Articles
- llms.txt Reference — Content index for AI
- How to Create llms.txt — Step-by-step tutorial
- What Is GEO? — Why AI readiness standards matter
Related Articles
What Is GEO?
GEO is the practice of structuring content so AI systems can understand, retrieve, synthesize, and cite it in generated answers.
How to Create llms.txt
Step-by-step tutorial for creating and deploying an llms.txt file to make your site's content discoverable by AI systems and LLMs.
llms.txt Reference
llms.txt is a proposed standard file that provides a machine-readable index of site content for AI crawlers. It tells LLMs what a site contains and how to navigate it.