Meta-ExternalAgent user agent and robots.txt rules
Meta-ExternalAgent crawls the web to train Meta’s foundation AI models or to improve products by indexing content directly.
User agent
As documented by Meta. Version numbers change; match on the token.
meta-externalagent/1.1 (+https://developers.facebook.com/docs/sharing/webmasters/crawler)
robots.txt rules for Meta-ExternalAgent
Paste one block into the robots.txt at the root of your domain. Changes can take up to a day to be read.
Block Meta-ExternalAgent
Disallows every path for Meta-ExternalAgent. That keeps your future pages out of what Meta may use for training. It does not change search results.
User-agent: meta-externalagent Disallow: /
Allow Meta-ExternalAgent
Lets Meta-ExternalAgent fetch every path, whatever “User-agent: *” says.
User-agent: meta-externalagent Allow: /
Good to know
Meta says crawlers may cache your robots.txt for up to 24 hours.
Meta-ExternalAgent FAQ
What is Meta-ExternalAgent?
Meta-ExternalAgent crawls the web to train Meta’s foundation AI models or to improve products by indexing content directly.
How do I block Meta-ExternalAgent?
Add “User-agent: meta-externalagent” and “Disallow: /” to your robots.txt. That keeps your future pages out of what Meta may use for training. It does not change search results.
Does Meta-ExternalAgent respect robots.txt?
Yes. Meta says Meta-ExternalAgent follows robots.txt rules written for it.
What is the Meta-ExternalAgent user agent?
Meta documents it as “meta-externalagent/1.1 (+https://developers.facebook.com/docs/sharing/webmasters/crawler)”. Version numbers change, so match on “meta-externalagent”.
How can I verify Meta-ExternalAgent requests?
Meta publishes no IP list for Meta-ExternalAgent. Treat the user agent as a hint, not proof.
Source: developers.facebook.com, checked Nov 17, 2026. AI Crawler Directory
Files are the start. Answers are the result.
Your buyers’ questions on eight AI engines, on your schedule, with history. Free for 7 days.