amisearchableami.cc

Guides

How to allow PerplexityBot

Paste-ready robots.txt rules so PerplexityBot can crawl your site, plus how to confirm the change with an AI crawler checker.

Updated 2026-09-06

Add a PerplexityBot group

Perplexity uses PerplexityBot to crawl the web for search. If your robots.txt blocks User-agent: * or names PerplexityBot under Disallow, Perplexity should not index those paths.

Put a specific group in robots.txt:

User-agent: PerplexityBot
Allow: /

The most specific matching user-agent group applies. A dedicated PerplexityBot group overrides a blanket * disallow for that bot.

If you currently block all bots

A common accidental block looks like this:

User-agent: *
Disallow: /

That hides the site from PerplexityBot and from Googlebot. Do not “fix AI” by opening * unless you mean to open every crawler. Prefer named groups for the bots you want.

User-agent: *
Disallow: /

User-agent: Googlebot
Allow: /

User-agent: PerplexityBot
Allow: /

Confirm the change

Deploy robots.txt at the site root — https://example.com/robots.txt — then run a check. The report should show PerplexityBot as Allowed. If it still says Blocked, you likely have another Disallow in the same group, a CDN-cached file, or a different host (www vs apex).

Allowing PerplexityBot does not guarantee a citation. It only removes the access block. See the other search bots if you also want ChatGPT and Claude fetch access.

Check your domain

See which of these bots can reach you. No account needed.

Related guides