Applebot user agent and robots.txt rules

Applebot is Apple’s web crawler. Its data powers search in Spotlight, Siri and Safari, and may also be used to train Apple’s generative AI foundation models.

AI search Follows robots.txt Apple

User agent

Apple documents the name only: requests contain “Applebot”.

robots.txt rules for Applebot

Paste one block into the robots.txt at the root of your domain. Changes can take up to a day to be read.

Block Applebot

Disallows every path for Applebot. That keeps your pages out of Apple’s AI search index, so its answers can’t cite them.

robots.txt
User-agent: Applebot
Disallow: /

Allow Applebot

Lets Applebot fetch every path, whatever “User-agent: *” says.

robots.txt
User-agent: Applebot
Allow: /

Good to know

If your robots.txt has no rules for Applebot, it follows your Googlebot rules. It ignores Crawl-delay. Use Applebot-Extended to opt out of training only.

Applebot FAQ

What is Applebot?

Applebot is Apple’s web crawler. Its data powers search in Spotlight, Siri and Safari, and may also be used to train Apple’s generative AI foundation models.

How do I block Applebot?

Add “User-agent: Applebot” and “Disallow: /” to your robots.txt. That keeps your pages out of Apple’s AI search index, so its answers can’t cite them.

Does Applebot respect robots.txt?

Yes. Apple says Applebot follows robots.txt rules written for it.

What is the Applebot user agent?

Apple documents the name “Applebot”, which appears in its requests.

How can I verify Applebot requests?

Match the request IP against Apple’s published list (https://search.developer.apple.com/applebot.json). The user agent alone can be faked.

Source: support.apple.com, checked Nov 17, 2026. AI Crawler Directory

Files are the start. Answers are the result.

Your buyers’ questions on eight AI engines, on your schedule, with history. Free for 7 days.