Perplexity-User user agent and robots.txt rules

Perplexity-User fetches a page when someone asks Perplexity a question that needs it. It is not used for web crawling or training.

User-triggered May skip robots.txt Perplexity

User agent

As documented by Perplexity. Version numbers change; match on the token.

User agent
Mozilla/5.0 (compatible; Perplexity-User/1.0; +https://perplexity.ai/perplexity-user)

robots.txt rules for Perplexity-User

Paste one block into the robots.txt at the root of your domain. Changes can take up to a day to be read.

Block Perplexity-User

Disallows every path for Perplexity-User. That asks Perplexity not to fetch your pages when its users ask, though Perplexity says user-triggered fetches may not always follow robots.txt.

robots.txt
User-agent: Perplexity-User
Disallow: /

Allow Perplexity-User

Lets Perplexity-User fetch every path, whatever “User-agent: *” says.

robots.txt
User-agent: Perplexity-User
Allow: /

Good to know

Perplexity says that since a user requested the fetch, it generally ignores robots.txt rules.

Perplexity-User FAQ

What is Perplexity-User?

Perplexity-User fetches a page when someone asks Perplexity a question that needs it. It is not used for web crawling or training.

How do I block Perplexity-User?

Add “User-agent: Perplexity-User” and “Disallow: /” to your robots.txt. That asks Perplexity not to fetch your pages when its users ask, though Perplexity says user-triggered fetches may not always follow robots.txt.

Does Perplexity-User respect robots.txt?

Perplexity says that because a person starts these requests, robots.txt rules may not apply to Perplexity-User.

What is the Perplexity-User user agent?

Perplexity documents it as “Mozilla/5.0 (compatible; Perplexity-User/1.0; +https://perplexity.ai/perplexity-user)”. Version numbers change, so match on “Perplexity-User”.

How can I verify Perplexity-User requests?

Match the request IP against Perplexity’s published list (https://www.perplexity.ai/perplexity-user.json). The user agent alone can be faked.

Source: docs.perplexity.ai, checked Nov 17, 2026. AI Crawler Directory

Files are the start. Answers are the result.

Your buyers’ questions on eight AI engines, on your schedule, with history. Free for 7 days.