Log In · Signup for Free
EN  DE  FR  ES  IT  Русский  한국어  日本語  简体中文  عربي

Bot Internet Indexing

What Bots Index Websites?

This page shows the bots and automated agents visiting our secret root domain endpoint since 18 June 2026. To make it harder to find, the domain name was an obscure random string of letters and numbers on a rarely used TLD. The website loaded JavaScript, Images and Media and premium web technologies to determine how deep the site was being indexed.

Where are the competitors? 😳

Since our secret website was created on 18th June 2026, not a single company that considers themselves a technology indexing competitor found the website in the 109 days the experiment has run for.

 

BuiltWith found the website within 2 days of the site existing without any insider knowledge from ourselves. This means if you were using a competitor for technology tracking it will miss sites by a very, very large margin if it finds them at all.

424 identified user agents made 121,950 requests across 74,056 sessions from 10,316 IP addresses. Data last generated 05 October 2026 00:20 UTC.

perplexity.ai was identified through 19 user agents, making 223 requests from 13 IP addresses.

Its first visit was 19 hours, 35 minutes, 1 second after the site was made live.

Clear Filter
October 2026
perplexity.ai
perplexity.ai AI Search

Perplexity is an AI answer engine whose agents crawl or fetch public pages for search results and user questions.
Mozilla/5.0 (Linux; Android 13; Pixel 7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.4198.147 Mobile Safari/537.36; compatible; Perplexity-User/1.0; +https://perplexity.ai/perplexity-user

Requests: 1 · IPs: 1 · Pages: 1 · Assets: 0
2026-09-10 09:37:04 UTC
84 days since site launch
perplexity.ai
perplexity.ai AI Search

Perplexity is an AI answer engine whose agents crawl or fetch public pages for search results and user questions.
Mozilla/5.0 (Windows NT 10.0; rv:143.1) Gecko/20100101 Firefox/143.1; compatible; Perplexity-User/1.0; +https://perplexity.ai/perplexity-user

Requests: 1 · IPs: 1 · Pages: 1 · Assets: 0
2026-09-10 09:36:56 UTC
84 days since site launch
perplexity.ai
perplexity.ai AI Search

Perplexity is an AI answer engine whose agents crawl or fetch public pages for search results and user questions.
Mozilla/5.0 (Linux; Android 12; Pixel 6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/134.0.3339.43 Mobile Safari/537.36; compatible; Perplexity-User/1.0; +https://perplexity.ai/perplexity-user

Requests: 1 · IPs: 1 · Pages: 1 · Assets: 0
2026-09-10 09:36:49 UTC
84 days since site launch
perplexity.ai
perplexity.ai AI Search

Perplexity is an AI answer engine whose agents crawl or fetch public pages for search results and user questions.
Mozilla/5.0 (X11; Ubuntu; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko; compatible; Perplexity-User/1.0; +https://perplexity.ai/perplexity-user) Chrome/126.0.5779.14 Safari/537.36

Requests: 1 · IPs: 1 · Pages: 1 · Assets: 0
2026-09-10 09:36:35 UTC
84 days since site launch
perplexity.ai
perplexity.ai AI Search

Perplexity is an AI answer engine whose agents crawl or fetch public pages for search results and user questions.
Mozilla/5.0 (Linux; Android 13; Pixel 7) AppleWebKit/537.36 (KHTML, like Gecko; compatible; Perplexity-User/1.0; +https://perplexity.ai/perplexity-user) Chrome/91.0.5433.153 Mobile Safari/537.36

☕
Requests: 1 · IPs: 1 · Pages: 0 · Assets: 1
2026-09-10 09:35:25 UTC
84 days since site launch
perplexity.ai
perplexity.ai AI Search

Perplexity is an AI answer engine whose agents crawl or fetch public pages for search results and user questions.
Mozilla/5.0 (Macintosh; Intel Mac OS X 14_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/109.0.2775.12 Safari/537.36; compatible; Perplexity-User/1.0; +https://perplexity.ai/perplexity-user

Requests: 1 · IPs: 1 · Pages: 1 · Assets: 0
2026-09-10 09:35:25 UTC
84 days since site launch
perplexity.ai
perplexity.ai AI Search

Perplexity is an AI answer engine whose agents crawl or fetch public pages for search results and user questions.
Mozilla/5.0 (Windows NT 11.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/147.0.5937.176 Safari/537.36; compatible; Perplexity-User/1.0; +https://perplexity.ai/perplexity-user

Requests: 1 · IPs: 1 · Pages: 1 · Assets: 0
2026-09-10 09:35:17 UTC
84 days since site launch
perplexity.ai
perplexity.ai AI Search

Perplexity is an AI answer engine whose agents crawl or fetch public pages for search results and user questions.
Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:149.9) Gecko/20100101 Firefox/149.9; compatible; PerplexityBot/1.0; +https://perplexity.ai/perplexitybot

Requests: 1 · IPs: 1 · Pages: 1 · Assets: 0
2026-09-10 09:35:04 UTC
84 days since site launch
perplexity.ai
perplexity.ai AI Search

Perplexity is an AI answer engine whose agents crawl or fetch public pages for search results and user questions.
Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:143.3) Gecko/20100101 Firefox/143.3; compatible; Perplexity-User/1.0; +https://perplexity.ai/perplexity-user

Requests: 1 · IPs: 1 · Pages: 1 · Assets: 0
2026-09-10 09:34:54 UTC
84 days since site launch
perplexity.ai
perplexity.ai AI Search

Perplexity is an AI answer engine whose agents crawl or fetch public pages for search results and user questions.
Mozilla/5.0 (iPhone; CPU iPhone OS 17_0 like Mac OS X) AppleWebKit/537.36 (KHTML, like Gecko; compatible; Perplexity-User/1.0; +https://perplexity.ai/perplexity-user) Chrome/133.0.752.134 Mobile Safari/537.36

Requests: 1 · IPs: 1 · Pages: 1 · Assets: 0
2026-09-10 09:34:47 UTC
84 days since site launch
perplexity.ai
perplexity.ai AI Search

Perplexity is an AI answer engine whose agents crawl or fetch public pages for search results and user questions.
Mozilla/5.0 (compatible; Perplexity-User/1.0; +https://perplexity.ai/perplexity-user)

Requests: 5 · IPs: 1 · Pages: 5 · Assets: 0
2026-09-10 09:34:41 UTC
84 days since site launch
perplexity.ai
perplexity.ai AI Search

Perplexity is an AI answer engine whose agents crawl or fetch public pages for search results and user questions.
Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:127.8) Gecko/20100101 Firefox/127.8; compatible; Perplexity-User/1.0; +https://perplexity.ai/perplexity-user

Requests: 1 · IPs: 1 · Pages: 1 · Assets: 0
2026-09-10 09:34:27 UTC
84 days since site launch
perplexity.ai
perplexity.ai AI Search

Perplexity is an AI answer engine whose agents crawl or fetch public pages for search results and user questions.
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Perplexity-User/1.0; +https://perplexity.ai/perplexity-user)

Requests: 5 · IPs: 1 · Pages: 5 · Assets: 0
2026-09-10 09:34:21 UTC
84 days since site launch
perplexity.ai
perplexity.ai AI Search

Perplexity is an AI answer engine whose agents crawl or fetch public pages for search results and user questions.
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; PerplexityBot/1.0; +https://perplexity.ai/perplexitybot)

Requests: 5 · IPs: 1 · Pages: 5 · Assets: 0
2026-09-10 09:34:21 UTC
84 days since site launch
perplexity.ai
perplexity.ai AI Search

Perplexity is an AI answer engine whose agents crawl or fetch public pages for search results and user questions.
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko; compatible; Perplexity-User/1.0; +https://perplexity.ai/perplexity-user) Chrome/133.0.732.182 Safari/537.36

Requests: 1 · IPs: 1 · Pages: 1 · Assets: 0
2026-09-10 09:34:15 UTC
84 days since site launch
perplexity.ai
perplexity.ai AI Search

Perplexity is an AI answer engine whose agents crawl or fetch public pages for search results and user questions.
Mozilla/5.0 (Linux; Android 12; Pixel 6) AppleWebKit/537.36 (KHTML, like Gecko; compatible; Perplexity-User/1.0; +https://perplexity.ai/perplexity-user) Chrome/126.0.3654.143 Mobile Safari/537.36

Requests: 1 · IPs: 1 · Pages: 1 · Assets: 0
2026-09-10 09:34:14 UTC
84 days since site launch
perplexity.ai
perplexity.ai AI Search

Perplexity is an AI answer engine whose agents crawl or fetch public pages for search results and user questions.
Mozilla/5.0 (compatible; PerplexityBot/1.0; +https://perplexity.ai/perplexitybot)

🤖 ☕
Requests: 186 · IPs: 12 · Pages: 140 · Assets: 7
2026-06-20 07:00:42 UTC
2 days since site launch
perplexity.ai
perplexity.ai AI Search

Perplexity is an AI answer engine whose agents crawl or fetch public pages for search results and user questions.
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; PerplexityBot/1.0; +https://perplexity.ai/perplexitybot

Requests: 1 · IPs: 1 · Pages: 1 · Assets: 0
2026-06-19 00:06:08 UTC
0 days since site launch
perplexity.ai
perplexity.ai AI Search

Perplexity is an AI answer engine whose agents crawl or fetch public pages for search results and user questions.
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; Perplexity-User/1.0; +https://perplexity.ai/perplexity-user

Requests: 8 · IPs: 2 · Pages: 8 · Assets: 0
2026-06-19 00:05:58 UTC
0 days since site launch
Site Launched on 18 June 2026