Applebot user agent and robots.txt rules
Applebot is Apple’s web crawler. Its data powers search in Spotlight, Siri and Safari, and may also be used to train Apple’s generative AI foundation models.
User agent
Apple documents the name only: requests contain “Applebot”.
robots.txt rules for Applebot
Paste one block into the robots.txt at the root of your domain. Changes can take up to a day to be read.
Block Applebot
Disallows every path for Applebot. That keeps your pages out of Apple’s AI search index, so its answers can’t cite them.
User-agent: Applebot Disallow: /
Allow Applebot
Lets Applebot fetch every path, whatever “User-agent: *” says.
User-agent: Applebot Allow: /
Good to know
If your robots.txt has no rules for Applebot, it follows your Googlebot rules. It ignores Crawl-delay. Use Applebot-Extended to opt out of training only.
Applebot FAQ
What is Applebot?
Applebot is Apple’s web crawler. Its data powers search in Spotlight, Siri and Safari, and may also be used to train Apple’s generative AI foundation models.
How do I block Applebot?
Add “User-agent: Applebot” and “Disallow: /” to your robots.txt. That keeps your pages out of Apple’s AI search index, so its answers can’t cite them.
Does Applebot respect robots.txt?
Yes. Apple says Applebot follows robots.txt rules written for it.
What is the Applebot user agent?
Apple documents the name “Applebot”, which appears in its requests.
How can I verify Applebot requests?
Match the request IP against Apple’s published list (https://search.developer.apple.com/applebot.json). The user agent alone can be faked.
Source: support.apple.com, checked Nov 17, 2026. AI Crawler Directory
Files are the start. Answers are the result.
Your buyers’ questions on eight AI engines, on your schedule, with history. Free for 7 days.