We publish a page. How long until AI finds it?
Every new page on mojodojo.io starts a clock. We time the first verified visit from each search engine and AI crawler, and the first time an assistant reads the page live for a person. These are aggregates across every new page published in the period.
8 blog posts
median. Bingbot was first on 62% of pages
median. PerplexityBot was first on 69%
of new pages had a visit from an AI crawler within a day
Hours from publish to first visit
The dot is the median across the new pages the crawler has reached (log scale), and the bar covers the middle half of those pages. Diamonds are live fetches for a person. Hollow dots mean fewer than 3 pages reached, so treat them as anecdotes.
- Search engine
- AI crawler
- Live user fetch
| Crawler | Type | Pages reached | Still waiting | Median | Middle half |
|---|---|---|---|---|---|
| Bingbot | Search engine | 10 of 13 | 23% | 4m | 1m to 1.3h |
| PerplexityBot | AI crawler | 13 of 13 | 0% | 48m | 32m to 4.2h |
| OAI-SearchBot | AI crawler | 11 of 13 | 15% | 1.4h | 55m to 17h |
| Googlebot | Search engine | 13 of 13 | 0% | 2.8h | 1.9h to 5.1h |
| GoogleOther | Search engine | 13 of 13 | 0% | 5.6h | 2.3h to 29h |
| ClaudeBot | AI crawler | 13 of 13 | 0% | 12h | 11h to 15h |
| Amazonbot | AI crawler | 11 of 13 | 15% | 22h | 11h to 30h |
| GPTBot | AI crawler | 4 of 13 | 69% | 30h | 16h to 47h |
| DuckDuckBot | Search engine | 2 of 13 | 85% | 41h | 32h to 2.1d |
| PetalBot | Search engine | 8 of 13 | 38% | 2.1d | 38h to 2.6d |
| Applebot | Search engine | 7 of 13 | 46% | 3.2d | 2.7d to 3.4d |
| Meta-ExternalAgent | AI crawler | 3 of 13 | 77% | 4.3d | 3.8d to 4.8d |
| Claude-User | Live user fetch | 2 of 13 | 85% | 23h | 18h to 29h |
| ChatGPT-User | Live user fetch | 7 of 13 | 46% | 36h | 14h to 2.3d |
| DuckAssistBot | Live user fetch | 2 of 13 | 85% | 41h | 32h to 2.1d |
Share of new pages found, over time since publishing
Of the new pages published in the period, the share each crawler had visited by that point after publishing. Pages published near the end of the period have had less time.
- Bingbot
- PerplexityBot
- OAI-SearchBot
- Googlebot
- GoogleOther
- ClaudeBot
Daily median time to discovery
Median time from publish for the pages published in each bucket (log scale). The number under each bucket is how many new pages it contains. Gaps are buckets with no new pages.
- First crawl, any bot
- First AI crawler
- First live user fetch
46 blog posts, 15 city pages, 45 service pages
median. Bingbot was first on 42% of pages
median. ClaudeBot was first on 35%
of new pages had a visit from an AI crawler within a day
Hours from publish to first visit
The dot is the median across the new pages the crawler has reached (log scale), and the bar covers the middle half of those pages. Diamonds are live fetches for a person. Hollow dots mean fewer than 3 pages reached, so treat them as anecdotes.
- Search engine
- AI crawler
- Live user fetch
| Crawler | Type | Pages reached | Still waiting | Median | Middle half |
|---|---|---|---|---|---|
| PerplexityBot | AI crawler | 116 of 128 | 9% | 12h | 1.7h to 5.4d |
| Bingbot | Search engine | 106 of 128 | 17% | 13h | 2.0h to 14h |
| ClaudeBot | AI crawler | 123 of 128 | 4% | 14h | 9.0h to 14h |
| OAI-SearchBot | AI crawler | 101 of 128 | 21% | 26h | 6.0h to 2.1d |
| GoogleOther | Search engine | 100 of 128 | 22% | 27h | 6.8h to 2.1d |
| Googlebot | Search engine | 111 of 128 | 13% | 38h | 5.6h to 5.4d |
| GPTBot | AI crawler | 51 of 128 | 60% | 38h | 38h to 38h |
| Amazonbot | AI crawler | 111 of 128 | 13% | 41h | 31h to 2.6d |
| PetalBot | Search engine | 109 of 128 | 15% | 2.1d | 38h to 3.5d |
| Applebot | Search engine | 96 of 128 | 25% | 3.5d | 3.0d to 4.1d |
| Meta-ExternalAgent | AI crawler | 112 of 128 | 13% | 3.9d | 2.5d to 4.1d |
| DuckDuckBot | Search engine | 10 of 128 | 92% | 8.3d | 6.6d to 12.5d |
| ChatGPT-User | Live user fetch | 53 of 128 | 59% | 2.5d | 18h to 5.9d |
| Claude-User | Live user fetch | 15 of 128 | 88% | 5.3d | 38h to 10.3d |
| DuckAssistBot | Live user fetch | 12 of 128 | 91% | 7.6d | 5.7d to 10.8d |
Share of new pages found, over time since publishing
Of the new pages published in the period, the share each crawler had visited by that point after publishing. Pages published near the end of the period have had less time.
- PerplexityBot
- Bingbot
- ClaudeBot
- OAI-SearchBot
- GoogleOther
- Googlebot
Weekly median time to discovery
Median time from publish for the pages published in each bucket (log scale). The number under each bucket is how many new pages it contains. Gaps are buckets with no new pages.
- First crawl, any bot
- First AI crawler
- First live user fetch
58 blog posts, 15 city pages, 50 service pages, 6 playbooks
median. Bingbot was first on 43% of pages
median. PerplexityBot was first on 32%
of new pages had a visit from an AI crawler within a day
Hours from publish to first visit
The dot is the median across the new pages the crawler has reached (log scale), and the bar covers the middle half of those pages. Diamonds are live fetches for a person. Hollow dots mean fewer than 3 pages reached, so treat them as anecdotes.
- Search engine
- AI crawler
- Live user fetch
| Crawler | Type | Pages reached | Still waiting | Median | Middle half |
|---|---|---|---|---|---|
| Bingbot | Search engine | 129 of 151 | 15% | 14h | 4.0h to 14h |
| PerplexityBot | AI crawler | 139 of 151 | 8% | 14h | 3.3h to 5.4d |
| ClaudeBot | AI crawler | 146 of 151 | 3% | 14h | 9.9h to 20h |
| GoogleOther | Search engine | 107 of 151 | 29% | 30h | 6.9h to 2.5d |
| Googlebot | Search engine | 132 of 151 | 13% | 38h | 6.3h to 5.9d |
| OAI-SearchBot | AI crawler | 123 of 151 | 19% | 38h | 9.0h to 2.9d |
| GPTBot | AI crawler | 69 of 151 | 54% | 38h | 38h to 38h |
| Amazonbot | AI crawler | 134 of 151 | 11% | 41h | 32h to 2.7d |
| PetalBot | Search engine | 131 of 151 | 13% | 2.3d | 38h to 6.5d |
| Applebot | Search engine | 119 of 151 | 21% | 3.6d | 3.0d to 4.4d |
| Meta-ExternalAgent | AI crawler | 135 of 151 | 11% | 3.9d | 2.7d to 4.6d |
| DuckDuckBot | Search engine | 11 of 151 | 93% | 8.9d | 6.8d to 13.9d |
| ChatGPT-User | Live user fetch | 71 of 151 | 53% | 3.1d | 25h to 10.3d |
| DuckAssistBot | Live user fetch | 12 of 151 | 92% | 7.6d | 5.7d to 10.8d |
| Claude-User | Live user fetch | 22 of 151 | 85% | 10.3d | 3.0d to 34.6d |
Share of new pages found, over time since publishing
Of the new pages published in the period, the share each crawler had visited by that point after publishing. Pages published near the end of the period have had less time.
- Bingbot
- PerplexityBot
- ClaudeBot
- GoogleOther
- Googlebot
- OAI-SearchBot
Weekly median time to discovery
Median time from publish for the pages published in each bucket (log scale). The number under each bucket is how many new pages it contains. Gaps are buckets with no new pages.
- First crawl, any bot
- First AI crawler
- First live user fetch
60 blog posts, 15 city pages, 50 service pages, 7 playbooks
median. Bingbot was first on 42% of pages
median. PerplexityBot was first on 32%
of new pages had a visit from an AI crawler within a day
Hours from publish to first visit
The dot is the median across the new pages the crawler has reached (log scale), and the bar covers the middle half of those pages. Diamonds are live fetches for a person. Hollow dots mean fewer than 3 pages reached, so treat them as anecdotes.
- Search engine
- AI crawler
- Live user fetch
| Crawler | Type | Pages reached | Still waiting | Median | Middle half |
|---|---|---|---|---|---|
| Bingbot | Search engine | 132 of 154 | 14% | 14h | 3.9h to 14h |
| PerplexityBot | AI crawler | 142 of 154 | 8% | 14h | 3.5h to 5.4d |
| ClaudeBot | AI crawler | 149 of 154 | 3% | 14h | 9.6h to 21h |
| GoogleOther | Search engine | 107 of 154 | 31% | 30h | 6.9h to 2.5d |
| Googlebot | Search engine | 135 of 154 | 12% | 38h | 6.1h to 5.9d |
| OAI-SearchBot | AI crawler | 126 of 154 | 18% | 38h | 8.8h to 2.9d |
| GPTBot | AI crawler | 72 of 154 | 53% | 38h | 36h to 38h |
| Amazonbot | AI crawler | 137 of 154 | 11% | 41h | 31h to 2.6d |
| PetalBot | Search engine | 134 of 154 | 13% | 2.5d | 38h to 7.1d |
| Applebot | Search engine | 122 of 154 | 21% | 3.6d | 3.0d to 4.4d |
| Meta-ExternalAgent | AI crawler | 138 of 154 | 10% | 4.0d | 2.7d to 4.7d |
| DuckDuckBot | Search engine | 12 of 154 | 92% | 9.4d | 7.0d to 15.3d |
| ChatGPT-User | Live user fetch | 74 of 154 | 52% | 3.1d | 23h to 9.4d |
| DuckAssistBot | Live user fetch | 13 of 154 | 92% | 8.0d | 6.3d to 13.3d |
| Claude-User | Live user fetch | 23 of 154 | 85% | 11.5d | 3.2d to 40.1d |
Share of new pages found, over time since publishing
Of the new pages published in the period, the share each crawler had visited by that point after publishing. Pages published near the end of the period have had less time.
- Bingbot
- PerplexityBot
- ClaudeBot
- GoogleOther
- Googlebot
- OAI-SearchBot
Monthly median time to discovery
Median time from publish for the pages published in each bucket (log scale). The number under each bucket is how many new pages it contains. Gaps are buckets with no new pages.
- First crawl, any bot
- First AI crawler
- First live user fetch
Method. Publish times come from the CMS (published_at). First visits come from our own server log and leave out any hit that fails verification against the operator's published IP ranges or reverse DNS, so fake bots never count. Pages whose URL was already being crawled before their publish date (republished or migrated pages) are excluded, so the clock only starts for pages that were genuinely new. Medians use only the pages a crawler has reached; "still waiting" counts the rest.
Cite this. Mojo Dojo, “AI Discovery Index”, mojodojo.io/ai-discovery-index, accessed 9 Nov 2026. Free to reuse under CC BY 4.0 with a link back.


