Distribute
GLOSSARYAI visibility

What is robots.txt?

robots.txt is a file at the root of a site that tells crawlers which pages they may read. It can allow or block search engines and AI crawlers by name.

robots.txt is a file at the root of a site that tells crawlers which pages they may read. It can allow or block search engines and AI crawlers by name.

Why it matters

A wrong rule can hide your whole site from Google or from AI assistants.

Where it fits

robots.txt belongs to AI visibility, one of the six channels of distribution. AI visibility is whether assistants like ChatGPT, Claude, Gemini and Perplexity mention and recommend you when someone asks for a product like yours.

How Distribute handles AI visibility

Distribute asks ChatGPT, Claude, Gemini and Perplexity your buyers' questions on a schedule, records whether you are named and who is cited, and tells you which pages and mentions to fix. $0.50 per round of AI answer checks. The free scan includes one question to ChatGPT and Claude.

To see how your own business does on AI visibility, run the free distribution scan. For a step-by-step approach, open the playbooks.

Find out where your distribution leaks

Type in your website. In about a minute you get a score out of 100 across search, AI answers, social, video, ads and links, with the fixes in order.

Free. No account. About 30 seconds.