Skip to main content
Get Free Audit
Live data · Updated 20 Oct 2026

We publish a page. How long until AI finds it?

Every new page on mojodojo.io starts a clock. We time the first verified visit from each search engine and AI crawler, and the first time an assistant reads the page live for a person. These are aggregates across every new page published in the period.

New pages published
73

14 blog posts, 15 city pages, 40 service pages

First crawl, any bot
14h

median. Bingbot was first on 51% of pages

First AI crawler
14h

median. ClaudeBot was first on 49%

AI found within 24h
77%

of new pages had a visit from an AI crawler within a day

By crawler

Hours from publish to first visit

The dot is the median across the new pages the crawler has reached (log scale), and the bar covers the middle half of those pages. Diamonds are live fetches for a person. Hollow dots mean fewer than 3 pages reached, so treat them as anecdotes.

Median hours from publish to first visit, per crawler, for the last 7 days
  • Search engine
  • AI crawler
  • Live user fetch
CrawlerTypePages reachedStill waitingMedianMiddle half
BingbotSearch engine56 of 7323%14h14h to 14h
ClaudeBotAI crawler55 of 7325%14h13h to 14h
GoogleOtherSearch engine49 of 7333%36h14h to 38h
GooglebotSearch engine45 of 7338%38h14h to 2.2d
PetalBotSearch engine48 of 7334%38h38h to 2.3d
OAI-SearchBotAI crawler45 of 7338%38h23h to 2.1d
GPTBotAI crawler43 of 7341%38h38h to 38h
AmazonbotAI crawler52 of 7329%2.4d38h to 2.8d
ApplebotSearch engine50 of 7332%3.8d3.2d to 4.3d
PerplexityBotAI crawler52 of 7329%3.8d12h to 5.4d
Meta-ExternalAgentAI crawler57 of 7322%4.0d3.9d to 4.1d
ChatGPT-UserLive user fetch14 of 7381%19h9.6h to 2.8d
DuckDuckBotSearch engine0 of 73100%n/an/a
Claude-UserLive user fetch0 of 73100%n/an/a
DuckAssistBotLive user fetch0 of 73100%n/an/a
Coverage

Share of new pages found, over time since publishing

Of the new pages published in the period, the share each crawler had visited by that point after publishing. Pages published near the end of the period have had less time.

Share of new pages visited by each crawler over time since publishing, for the last 7 days
  • Bingbot
  • ClaudeBot
  • GoogleOther
  • Googlebot
  • PetalBot
  • OAI-SearchBot
Trend

Daily median time to discovery

Median time from publish for the pages published in each bucket (log scale). The number under each bucket is how many new pages it contains. Gaps are buckets with no new pages.

Median time to discovery by publish day, for the last 7 days
  • First crawl, any bot
  • First AI crawler
  • First live user fetch
About this data. 330 pages were published since tracking began on 6 Jun 2026. 219 are excluded because their URL was already live before they were published. Visits since 12 Oct 2026 carry exact timestamps (89% of the pages in this view have at least one). Before that only the day is known, so first visits are estimated at the middle of the remaining day.
New pages published
89

25 blog posts, 15 city pages, 45 service pages

First crawl, any bot
14h

median. Bingbot was first on 49% of pages

First AI crawler
14h

median. ClaudeBot was first on 40%

AI found within 24h
73%

of new pages had a visit from an AI crawler within a day

By crawler

Hours from publish to first visit

The dot is the median across the new pages the crawler has reached (log scale), and the bar covers the middle half of those pages. Diamonds are live fetches for a person. Hollow dots mean fewer than 3 pages reached, so treat them as anecdotes.

Median hours from publish to first visit, per crawler, for the last 30 days
  • Search engine
  • AI crawler
  • Live user fetch
CrawlerTypePages reachedStill waitingMedianMiddle half
BingbotSearch engine67 of 8925%14h12h to 14h
ClaudeBotAI crawler66 of 8926%14h14h to 14h
PerplexityBotAI crawler63 of 8929%32h9.6h to 5.4d
GooglebotSearch engine55 of 8938%38h14h to 3.8d
GoogleOtherSearch engine57 of 8936%38h14h to 2.1d
OAI-SearchBotAI crawler56 of 8937%38h22h to 2.1d
GPTBotAI crawler43 of 8952%38h38h to 38h
PetalBotSearch engine58 of 8935%2.1d38h to 2.6d
AmazonbotAI crawler63 of 8929%2.2d38h to 2.8d
ApplebotSearch engine61 of 8931%3.8d3.4d to 4.3d
Meta-ExternalAgentAI crawler68 of 8924%3.9d3.5d to 4.1d
ChatGPT-UserLive user fetch24 of 8973%2.4d12h to 3.1d
Claude-UserLive user fetch2 of 8998%8.4d6.9d to 10.0d
DuckDuckBotSearch engine0 of 89100%n/an/a
DuckAssistBotLive user fetch0 of 89100%n/an/a
Coverage

Share of new pages found, over time since publishing

Of the new pages published in the period, the share each crawler had visited by that point after publishing. Pages published near the end of the period have had less time.

Share of new pages visited by each crawler over time since publishing, for the last 30 days
  • Bingbot
  • ClaudeBot
  • PerplexityBot
  • Googlebot
  • GoogleOther
  • OAI-SearchBot
Trend

Weekly median time to discovery

Median time from publish for the pages published in each bucket (log scale). The number under each bucket is how many new pages it contains. Gaps are buckets with no new pages.

Median time to discovery by publish week, for the last 30 days
  • First crawl, any bot
  • First AI crawler
  • First live user fetch
About this data. 330 pages were published since tracking began on 6 Jun 2026. 219 are excluded because their URL was already live before they were published. Visits since 12 Oct 2026 carry exact timestamps (82% of the pages in this view have at least one). Before that only the day is known, so first visits are estimated at the middle of the remaining day.
New pages published
108

33 blog posts, 15 city pages, 50 service pages, 6 playbooks

First crawl, any bot
14h

median. Bingbot was first on 48% of pages

First AI crawler
14h

median. ClaudeBot was first on 33%

AI found within 24h
72%

of new pages had a visit from an AI crawler within a day

By crawler

Hours from publish to first visit

The dot is the median across the new pages the crawler has reached (log scale), and the bar covers the middle half of those pages. Diamonds are live fetches for a person. Hollow dots mean fewer than 3 pages reached, so treat them as anecdotes.

Median hours from publish to first visit, per crawler, for the last 90 days
  • Search engine
  • AI crawler
  • Live user fetch
CrawlerTypePages reachedStill waitingMedianMiddle half
BingbotSearch engine86 of 10820%14h10h to 14h
ClaudeBotAI crawler85 of 10821%14h12h to 14h
PerplexityBotAI crawler82 of 10824%32h11h to 5.4d
GoogleOtherSearch engine62 of 10843%38h14h to 2.1d
OAI-SearchBotAI crawler74 of 10831%38h31h to 2.9d
GPTBotAI crawler61 of 10844%38h38h to 38h
GooglebotSearch engine73 of 10832%2.2d24h to 5.6d
PetalBotSearch engine77 of 10829%2.2d38h to 10.6d
AmazonbotAI crawler82 of 10824%2.3d36h to 2.8d
Meta-ExternalAgentAI crawler86 of 10820%4.0d3.9d to 4.4d
ApplebotSearch engine80 of 10826%4.1d3.5d to 5.7d
DuckDuckBotSearch engine1 of 10899%25.4d25.4d to 25.4d
ChatGPT-UserLive user fetch38 of 10865%3.1d25h to 15.9d
Claude-UserLive user fetch5 of 10895%40.1d11.5d to 40.1d
DuckAssistBotLive user fetch0 of 108100%n/an/a
Coverage

Share of new pages found, over time since publishing

Of the new pages published in the period, the share each crawler had visited by that point after publishing. Pages published near the end of the period have had less time.

Share of new pages visited by each crawler over time since publishing, for the last 90 days
  • Bingbot
  • ClaudeBot
  • PerplexityBot
  • GoogleOther
  • OAI-SearchBot
  • GPTBot
Trend

Weekly median time to discovery

Median time from publish for the pages published in each bucket (log scale). The number under each bucket is how many new pages it contains. Gaps are buckets with no new pages.

Median time to discovery by publish week, for the last 90 days
  • First crawl, any bot
  • First AI crawler
  • First live user fetch
About this data. 330 pages were published since tracking began on 6 Jun 2026. 219 are excluded because their URL was already live before they were published. Visits since 12 Oct 2026 carry exact timestamps (78% of the pages in this view have at least one). Before that only the day is known, so first visits are estimated at the middle of the remaining day.
New pages published
111

35 blog posts, 15 city pages, 50 service pages, 7 playbooks

First crawl, any bot
14h

median. Bingbot was first on 47% of pages

First AI crawler
14h

median. ClaudeBot was first on 32%

AI found within 24h
73%

of new pages had a visit from an AI crawler within a day

By crawler

Hours from publish to first visit

The dot is the median across the new pages the crawler has reached (log scale), and the bar covers the middle half of those pages. Diamonds are live fetches for a person. Hollow dots mean fewer than 3 pages reached, so treat them as anecdotes.

Median hours from publish to first visit, per crawler, for all time
  • Search engine
  • AI crawler
  • Live user fetch
CrawlerTypePages reachedStill waitingMedianMiddle half
BingbotSearch engine89 of 11120%14h10h to 14h
ClaudeBotAI crawler88 of 11121%14h12h to 15h
PerplexityBotAI crawler85 of 11123%30h10.0h to 5.4d
GoogleOtherSearch engine62 of 11144%38h14h to 2.1d
OAI-SearchBotAI crawler77 of 11131%38h26h to 2.9d
GPTBotAI crawler64 of 11142%38h38h to 38h
GooglebotSearch engine76 of 11132%2.2d19h to 5.6d
AmazonbotAI crawler85 of 11123%2.2d34h to 2.8d
PetalBotSearch engine80 of 11128%2.3d38h to 29.0d
ApplebotSearch engine83 of 11125%4.0d3.5d to 5.5d
Meta-ExternalAgentAI crawler89 of 11120%4.1d3.9d to 6.3d
DuckDuckBotSearch engine2 of 11198%74.3d49.8d to 98.7d
ChatGPT-UserLive user fetch41 of 11163%3.1d12h to 14.4d
Claude-UserLive user fetch5 of 11195%40.1d11.5d to 40.1d
DuckAssistBotLive user fetch1 of 11199%123.2d123.2d to 123.2d
Coverage

Share of new pages found, over time since publishing

Of the new pages published in the period, the share each crawler had visited by that point after publishing. Pages published near the end of the period have had less time.

Share of new pages visited by each crawler over time since publishing, for all time
  • Bingbot
  • ClaudeBot
  • PerplexityBot
  • GoogleOther
  • OAI-SearchBot
  • GPTBot
Trend

Monthly median time to discovery

Median time from publish for the pages published in each bucket (log scale). The number under each bucket is how many new pages it contains. Gaps are buckets with no new pages.

Median time to discovery by publish month, for all time
  • First crawl, any bot
  • First AI crawler
  • First live user fetch
About this data. 330 pages were published since tracking began on 6 Jun 2026. 219 are excluded because their URL was already live before they were published. Visits since 12 Oct 2026 carry exact timestamps (77% of the pages in this view have at least one). Before that only the day is known, so first visits are estimated at the middle of the remaining day.

Method. Publish times come from the CMS (published_at). First visits come from our own server log and leave out any hit that fails verification against the operator's published IP ranges or reverse DNS, so fake bots never count. Pages whose URL was already being crawled before their publish date (republished or migrated pages) are excluded, so the clock only starts for pages that were genuinely new. Medians use only the pages a crawler has reached; "still waiting" counts the rest.

Cite this. Mojo Dojo, “AI Discovery Index”, mojodojo.io/ai-discovery-index, accessed 20 Oct 2026. Free to reuse under CC BY 4.0 with a link back.