Perplexity-User user agent and robots.txt rules
Perplexity-User fetches a page when someone asks Perplexity a question that needs it. It is not used for web crawling or training.
User agent
As documented by Perplexity. Version numbers change; match on the token.
Mozilla/5.0 (compatible; Perplexity-User/1.0; +https://perplexity.ai/perplexity-user)
robots.txt rules for Perplexity-User
Paste one block into the robots.txt at the root of your domain. Changes can take up to a day to be read.
Block Perplexity-User
Disallows every path for Perplexity-User. That asks Perplexity not to fetch your pages when its users ask, though Perplexity says user-triggered fetches may not always follow robots.txt.
User-agent: Perplexity-User Disallow: /
Allow Perplexity-User
Lets Perplexity-User fetch every path, whatever “User-agent: *” says.
User-agent: Perplexity-User Allow: /
Good to know
Perplexity says that since a user requested the fetch, it generally ignores robots.txt rules.
Perplexity-User FAQ
What is Perplexity-User?
Perplexity-User fetches a page when someone asks Perplexity a question that needs it. It is not used for web crawling or training.
How do I block Perplexity-User?
Add “User-agent: Perplexity-User” and “Disallow: /” to your robots.txt. That asks Perplexity not to fetch your pages when its users ask, though Perplexity says user-triggered fetches may not always follow robots.txt.
Does Perplexity-User respect robots.txt?
Perplexity says that because a person starts these requests, robots.txt rules may not apply to Perplexity-User.
What is the Perplexity-User user agent?
Perplexity documents it as “Mozilla/5.0 (compatible; Perplexity-User/1.0; +https://perplexity.ai/perplexity-user)”. Version numbers change, so match on “Perplexity-User”.
How can I verify Perplexity-User requests?
Match the request IP against Perplexity’s published list (https://www.perplexity.ai/perplexity-user.json). The user agent alone can be faked.
Source: docs.perplexity.ai, checked Nov 17, 2026. AI Crawler Directory
Files are the start. Answers are the result.
Your buyers’ questions on eight AI engines, on your schedule, with history. Free for 7 days.