Skip to main content
Live data · Updated 9 Nov 2026

We publish a page. How long until AI finds it?

Every new page on mojodojo.io starts a clock. We time the first verified visit from each search engine and AI crawler, and the first time an assistant reads the page live for a person. These are aggregates across every new page published in the period.

New pages published
13

8 blog posts

First crawl, any bot
10m

median. Bingbot was first on 62% of pages

First AI crawler
38m

median. PerplexityBot was first on 69%

AI found within 24h
100%

of new pages had a visit from an AI crawler within a day

By crawler

Hours from publish to first visit

The dot is the median across the new pages the crawler has reached (log scale), and the bar covers the middle half of those pages. Diamonds are live fetches for a person. Hollow dots mean fewer than 3 pages reached, so treat them as anecdotes.

Median hours from publish to first visit, per crawler, for the last 7 days
  • Search engine
  • AI crawler
  • Live user fetch
CrawlerTypePages reachedStill waitingMedianMiddle half
BingbotSearch engine10 of 1323%4m1m to 1.3h
PerplexityBotAI crawler13 of 130%48m32m to 4.2h
OAI-SearchBotAI crawler11 of 1315%1.4h55m to 17h
GooglebotSearch engine13 of 130%2.8h1.9h to 5.1h
GoogleOtherSearch engine13 of 130%5.6h2.3h to 29h
ClaudeBotAI crawler13 of 130%12h11h to 15h
AmazonbotAI crawler11 of 1315%22h11h to 30h
GPTBotAI crawler4 of 1369%30h16h to 47h
DuckDuckBotSearch engine2 of 1385%41h32h to 2.1d
PetalBotSearch engine8 of 1338%2.1d38h to 2.6d
ApplebotSearch engine7 of 1346%3.2d2.7d to 3.4d
Meta-ExternalAgentAI crawler3 of 1377%4.3d3.8d to 4.8d
Claude-UserLive user fetch2 of 1385%23h18h to 29h
ChatGPT-UserLive user fetch7 of 1346%36h14h to 2.3d
DuckAssistBotLive user fetch2 of 1385%41h32h to 2.1d
Coverage

Share of new pages found, over time since publishing

Of the new pages published in the period, the share each crawler had visited by that point after publishing. Pages published near the end of the period have had less time.

Share of new pages visited by each crawler over time since publishing, for the last 7 days
  • Bingbot
  • PerplexityBot
  • OAI-SearchBot
  • Googlebot
  • GoogleOther
  • ClaudeBot
Trend

Daily median time to discovery

Median time from publish for the pages published in each bucket (log scale). The number under each bucket is how many new pages it contains. Gaps are buckets with no new pages.

Median time to discovery by publish day, for the last 7 days
  • First crawl, any bot
  • First AI crawler
  • First live user fetch
About this data. 382 pages were published since tracking began on 6 Jun 2026. 228 are excluded because their URL was already live before they were published. Visits since 12 Oct 2026 carry exact timestamps (100% of the pages in this view have at least one). Before that only the day is known, so first visits are estimated at the middle of the remaining day.
New pages published
128

46 blog posts, 15 city pages, 45 service pages

First crawl, any bot
8.9h

median. Bingbot was first on 42% of pages

First AI crawler
9.5h

median. ClaudeBot was first on 35%

AI found within 24h
84%

of new pages had a visit from an AI crawler within a day

By crawler

Hours from publish to first visit

The dot is the median across the new pages the crawler has reached (log scale), and the bar covers the middle half of those pages. Diamonds are live fetches for a person. Hollow dots mean fewer than 3 pages reached, so treat them as anecdotes.

Median hours from publish to first visit, per crawler, for the last 30 days
  • Search engine
  • AI crawler
  • Live user fetch
CrawlerTypePages reachedStill waitingMedianMiddle half
PerplexityBotAI crawler116 of 1289%12h1.7h to 5.4d
BingbotSearch engine106 of 12817%13h2.0h to 14h
ClaudeBotAI crawler123 of 1284%14h9.0h to 14h
OAI-SearchBotAI crawler101 of 12821%26h6.0h to 2.1d
GoogleOtherSearch engine100 of 12822%27h6.8h to 2.1d
GooglebotSearch engine111 of 12813%38h5.6h to 5.4d
GPTBotAI crawler51 of 12860%38h38h to 38h
AmazonbotAI crawler111 of 12813%41h31h to 2.6d
PetalBotSearch engine109 of 12815%2.1d38h to 3.5d
ApplebotSearch engine96 of 12825%3.5d3.0d to 4.1d
Meta-ExternalAgentAI crawler112 of 12813%3.9d2.5d to 4.1d
DuckDuckBotSearch engine10 of 12892%8.3d6.6d to 12.5d
ChatGPT-UserLive user fetch53 of 12859%2.5d18h to 5.9d
Claude-UserLive user fetch15 of 12888%5.3d38h to 10.3d
DuckAssistBotLive user fetch12 of 12891%7.6d5.7d to 10.8d
Coverage

Share of new pages found, over time since publishing

Of the new pages published in the period, the share each crawler had visited by that point after publishing. Pages published near the end of the period have had less time.

Share of new pages visited by each crawler over time since publishing, for the last 30 days
  • PerplexityBot
  • Bingbot
  • ClaudeBot
  • OAI-SearchBot
  • GoogleOther
  • Googlebot
Trend

Weekly median time to discovery

Median time from publish for the pages published in each bucket (log scale). The number under each bucket is how many new pages it contains. Gaps are buckets with no new pages.

Median time to discovery by publish week, for the last 30 days
  • First crawl, any bot
  • First AI crawler
  • First live user fetch
About this data. 382 pages were published since tracking began on 6 Jun 2026. 228 are excluded because their URL was already live before they were published. Visits since 12 Oct 2026 carry exact timestamps (96% of the pages in this view have at least one). Before that only the day is known, so first visits are estimated at the middle of the remaining day.
New pages published
151

58 blog posts, 15 city pages, 50 service pages, 6 playbooks

First crawl, any bot
11h

median. Bingbot was first on 43% of pages

First AI crawler
11h

median. PerplexityBot was first on 32%

AI found within 24h
81%

of new pages had a visit from an AI crawler within a day

By crawler

Hours from publish to first visit

The dot is the median across the new pages the crawler has reached (log scale), and the bar covers the middle half of those pages. Diamonds are live fetches for a person. Hollow dots mean fewer than 3 pages reached, so treat them as anecdotes.

Median hours from publish to first visit, per crawler, for the last 90 days
  • Search engine
  • AI crawler
  • Live user fetch
CrawlerTypePages reachedStill waitingMedianMiddle half
BingbotSearch engine129 of 15115%14h4.0h to 14h
PerplexityBotAI crawler139 of 1518%14h3.3h to 5.4d
ClaudeBotAI crawler146 of 1513%14h9.9h to 20h
GoogleOtherSearch engine107 of 15129%30h6.9h to 2.5d
GooglebotSearch engine132 of 15113%38h6.3h to 5.9d
OAI-SearchBotAI crawler123 of 15119%38h9.0h to 2.9d
GPTBotAI crawler69 of 15154%38h38h to 38h
AmazonbotAI crawler134 of 15111%41h32h to 2.7d
PetalBotSearch engine131 of 15113%2.3d38h to 6.5d
ApplebotSearch engine119 of 15121%3.6d3.0d to 4.4d
Meta-ExternalAgentAI crawler135 of 15111%3.9d2.7d to 4.6d
DuckDuckBotSearch engine11 of 15193%8.9d6.8d to 13.9d
ChatGPT-UserLive user fetch71 of 15153%3.1d25h to 10.3d
DuckAssistBotLive user fetch12 of 15192%7.6d5.7d to 10.8d
Claude-UserLive user fetch22 of 15185%10.3d3.0d to 34.6d
Coverage

Share of new pages found, over time since publishing

Of the new pages published in the period, the share each crawler had visited by that point after publishing. Pages published near the end of the period have had less time.

Share of new pages visited by each crawler over time since publishing, for the last 90 days
  • Bingbot
  • PerplexityBot
  • ClaudeBot
  • GoogleOther
  • Googlebot
  • OAI-SearchBot
Trend

Weekly median time to discovery

Median time from publish for the pages published in each bucket (log scale). The number under each bucket is how many new pages it contains. Gaps are buckets with no new pages.

Median time to discovery by publish week, for the last 90 days
  • First crawl, any bot
  • First AI crawler
  • First live user fetch
About this data. 382 pages were published since tracking began on 6 Jun 2026. 228 are excluded because their URL was already live before they were published. Visits since 12 Oct 2026 carry exact timestamps (91% of the pages in this view have at least one). Before that only the day is known, so first visits are estimated at the middle of the remaining day.
New pages published
154

60 blog posts, 15 city pages, 50 service pages, 7 playbooks

First crawl, any bot
10h

median. Bingbot was first on 42% of pages

First AI crawler
11h

median. PerplexityBot was first on 32%

AI found within 24h
82%

of new pages had a visit from an AI crawler within a day

By crawler

Hours from publish to first visit

The dot is the median across the new pages the crawler has reached (log scale), and the bar covers the middle half of those pages. Diamonds are live fetches for a person. Hollow dots mean fewer than 3 pages reached, so treat them as anecdotes.

Median hours from publish to first visit, per crawler, for all time
  • Search engine
  • AI crawler
  • Live user fetch
CrawlerTypePages reachedStill waitingMedianMiddle half
BingbotSearch engine132 of 15414%14h3.9h to 14h
PerplexityBotAI crawler142 of 1548%14h3.5h to 5.4d
ClaudeBotAI crawler149 of 1543%14h9.6h to 21h
GoogleOtherSearch engine107 of 15431%30h6.9h to 2.5d
GooglebotSearch engine135 of 15412%38h6.1h to 5.9d
OAI-SearchBotAI crawler126 of 15418%38h8.8h to 2.9d
GPTBotAI crawler72 of 15453%38h36h to 38h
AmazonbotAI crawler137 of 15411%41h31h to 2.6d
PetalBotSearch engine134 of 15413%2.5d38h to 7.1d
ApplebotSearch engine122 of 15421%3.6d3.0d to 4.4d
Meta-ExternalAgentAI crawler138 of 15410%4.0d2.7d to 4.7d
DuckDuckBotSearch engine12 of 15492%9.4d7.0d to 15.3d
ChatGPT-UserLive user fetch74 of 15452%3.1d23h to 9.4d
DuckAssistBotLive user fetch13 of 15492%8.0d6.3d to 13.3d
Claude-UserLive user fetch23 of 15485%11.5d3.2d to 40.1d
Coverage

Share of new pages found, over time since publishing

Of the new pages published in the period, the share each crawler had visited by that point after publishing. Pages published near the end of the period have had less time.

Share of new pages visited by each crawler over time since publishing, for all time
  • Bingbot
  • PerplexityBot
  • ClaudeBot
  • GoogleOther
  • Googlebot
  • OAI-SearchBot
Trend

Monthly median time to discovery

Median time from publish for the pages published in each bucket (log scale). The number under each bucket is how many new pages it contains. Gaps are buckets with no new pages.

Median time to discovery by publish month, for all time
  • First crawl, any bot
  • First AI crawler
  • First live user fetch
About this data. 382 pages were published since tracking began on 6 Jun 2026. 228 are excluded because their URL was already live before they were published. Visits since 12 Oct 2026 carry exact timestamps (90% of the pages in this view have at least one). Before that only the day is known, so first visits are estimated at the middle of the remaining day.

Method. Publish times come from the CMS (published_at). First visits come from our own server log and leave out any hit that fails verification against the operator's published IP ranges or reverse DNS, so fake bots never count. Pages whose URL was already being crawled before their publish date (republished or migrated pages) are excluded, so the clock only starts for pages that were genuinely new. Medians use only the pages a crawler has reached; "still waiting" counts the rest.

Cite this. Mojo Dojo, “AI Discovery Index”, mojodojo.io/ai-discovery-index, accessed 9 Nov 2026. Free to reuse under CC BY 4.0 with a link back.