Bot Internet Indexing

What Bots Index Websites?

This page shows the bots visiting our secret root domain endpoint between 30th October 2022 and 30th October 2023. To make it harder to find, the domain name was an obscure random string of letters and numbers on a rarely used TLD. The website loaded JavaScript, Images and Media and premium web technologies to determine how deep the site was being indexed.

Where are the competitors? 😳

Since our secret website was created on 30th October 2022 not a single company that considers themselves a technology indexing competitor found the website in the 365 days the experiment ran for.

 

BuiltWith found the website within 5 days of the site existing without any insider knowledge from ourselves. This means if you were using a competitor for technology tracking it will miss sites by a very, very large margin if it finds them at all.

AHREFs and Bing are excluded from the results as they indexed the site multiple times per day.

SHODAN has visited our secret endpoint 74 times since the website was created on 30th October 2022, 364 days ago. That is on average once every 5 days.

SHODAN's first visit was 21 days after the site was made live.

October 2023
SHODAN

https://shodan.io
Internet Connected Server Search Engine

7 days, 22 hours, 29 minutes, 56 seconds ago
SHODAN

https://shodan.io
Internet Connected Server Search Engine

8 days, 4 hours, 49 minutes, 44 seconds ago
SHODAN

https://shodan.io
Internet Connected Server Search Engine

8 days, 8 hours, 34 minutes, 33 seconds ago
SHODAN

https://shodan.io
Internet Connected Server Search Engine

8 days, 20 hours, 14 minutes, 24 seconds ago
SHODAN

https://shodan.io
Internet Connected Server Search Engine

62 days, 23 hours, 40 minutes, 56 seconds ago
August 2023
SHODAN

https://shodan.io
Internet Connected Server Search Engine

63 days, 6 hours, 14 minutes, 54 seconds ago
SHODAN

https://shodan.io
Internet Connected Server Search Engine

73 days, 7 hours, 20 minutes, 11 seconds ago
SHODAN

https://shodan.io
Internet Connected Server Search Engine

73 days, 9 hours, 26 minutes, 3 seconds ago
SHODAN

https://shodan.io
Internet Connected Server Search Engine

115 days, 9 hours, 43 minutes, 37 seconds ago
SHODAN

https://shodan.io
Internet Connected Server Search Engine

115 days, 12 hours, 1 minute, 28 seconds ago
July 2023
SHODAN

https://shodan.io
Internet Connected Server Search Engine

120 days, 15 hours, 43 minutes, 10 seconds ago
SHODAN

https://shodan.io
Internet Connected Server Search Engine

132 days, 23 hours, 38 minutes, 5 seconds ago
SHODAN

https://shodan.io
Internet Connected Server Search Engine

142 days, 18 hours, 11 minutes, 7 seconds ago
SHODAN

https://shodan.io
Internet Connected Server Search Engine

142 days, 19 hours, 2 minutes, 10 seconds ago
SHODAN

https://shodan.io
Internet Connected Server Search Engine

143 days, 10 hours, 48 minutes, 8 seconds ago
June 2023
SHODAN

https://shodan.io
Internet Connected Server Search Engine

143 days, 18 hours, 24 minutes, 42 seconds ago
SHODAN

https://shodan.io
Internet Connected Server Search Engine

148 days, 8 hours, 25 minutes, 11 seconds ago
SHODAN

https://shodan.io
Internet Connected Server Search Engine

148 days, 18 hours, 1 minute, 44 seconds ago
SHODAN

https://shodan.io
Internet Connected Server Search Engine

202 days, 22 hours, 54 minutes, 5 seconds ago
SHODAN

https://shodan.io
Internet Connected Server Search Engine

202 days, 23 hours, 15 minutes, 10 seconds ago
April 2023
SHODAN

https://shodan.io
Internet Connected Server Search Engine

203 days, 5 hours, 49 minutes, 5 seconds ago
SHODAN

https://shodan.io
Internet Connected Server Search Engine

203 days, 10 hours, 14 minutes, 10 seconds ago
SHODAN

https://shodan.io
Internet Connected Server Search Engine

208 days, 5 hours, 9 minutes, 14 seconds ago
SHODAN

https://shodan.io
Internet Connected Server Search Engine

208 days, 10 hours, 16 minutes, 49 seconds ago
SHODAN

https://shodan.io
Internet Connected Server Search Engine

218 days, 9 hours, 58 minutes, 27 seconds ago
March 2023
SHODAN

https://shodan.io
Internet Connected Server Search Engine

233 days, 10 hours, 5 minutes, 8 seconds ago
SHODAN

https://shodan.io
Internet Connected Server Search Engine

248 days, 10 hours, 11 minutes, 48 seconds ago
SHODAN

https://shodan.io
Internet Connected Server Search Engine

253 days, 12 hours, 49 minutes, 41 seconds ago
SHODAN

https://shodan.io
Internet Connected Server Search Engine

262 days, 20 hours, 31 minutes, 53 seconds ago
SHODAN

https://shodan.io
Internet Connected Server Search Engine

272 days, 17 hours, 34 minutes, 6 seconds ago
January 2023
SHODAN

https://shodan.io
Internet Connected Server Search Engine

273 days, 9 hours, 55 minutes, 3 seconds ago
SHODAN

https://shodan.io
Internet Connected Server Search Engine

273 days, 14 hours, 8 minutes, 42 seconds ago
SHODAN

https://shodan.io
Internet Connected Server Search Engine

277 days, 16 hours, 35 minutes, 22 seconds ago
SHODAN

https://shodan.io
Internet Connected Server Search Engine

278 days, 4 hours, 32 minutes, 22 seconds ago
SHODAN

https://shodan.io
Internet Connected Server Search Engine

282 days, 23 hours, 29 minutes, 13 seconds ago
SHODAN

https://shodan.io
Internet Connected Server Search Engine

283 days, 10 hours, 33 minutes, 14 seconds ago
SHODAN

https://shodan.io
Internet Connected Server Search Engine

283 days, 20 hours, 58 minutes, 25 seconds ago
SHODAN

https://shodan.io
Internet Connected Server Search Engine

293 days, 6 hours, 29 minutes, 21 seconds ago
SHODAN

https://shodan.io
Internet Connected Server Search Engine

293 days, 12 hours, 34 minutes, 6 seconds ago
SHODAN

https://shodan.io
Internet Connected Server Search Engine

297 days, 23 hours, 9 minutes, 2 seconds ago
SHODAN

https://shodan.io
Internet Connected Server Search Engine

298 days, 5 hours, 50 minutes, 4 seconds ago
SHODAN

https://shodan.io
Internet Connected Server Search Engine

298 days, 11 hours, 2 seconds ago
SHODAN

https://shodan.io
Internet Connected Server Search Engine

298 days, 13 hours, 29 minutes, 39 seconds ago
SHODAN

https://shodan.io
Internet Connected Server Search Engine

298 days, 22 hours, 3 minutes, 30 seconds ago
SHODAN

https://shodan.io
Internet Connected Server Search Engine

302 days, 22 hours, 30 minutes, 41 seconds ago
December 2022
SHODAN

https://shodan.io
Internet Connected Server Search Engine

303 days, 6 hours, 44 minutes, 32 seconds ago
SHODAN

https://shodan.io
Internet Connected Server Search Engine

303 days, 11 hours, 22 minutes, 22 seconds ago
SHODAN

https://shodan.io
Internet Connected Server Search Engine

308 days, 6 hours, 27 minutes, 14 seconds ago
SHODAN

https://shodan.io
Internet Connected Server Search Engine

308 days, 9 hours, 18 minutes, 31 seconds ago
SHODAN

https://shodan.io
Internet Connected Server Search Engine

308 days, 14 hours, 6 minutes, 17 seconds ago
SHODAN

https://shodan.io
Internet Connected Server Search Engine

308 days, 16 hours, 32 minutes, 39 seconds ago
SHODAN

https://shodan.io
Internet Connected Server Search Engine

313 days, 4 hours, 46 minutes, 21 seconds ago
SHODAN

https://shodan.io
Internet Connected Server Search Engine

313 days, 14 hours, 19 minutes, 34 seconds ago
SHODAN

https://shodan.io
Internet Connected Server Search Engine

317 days, 23 hours, 25 minutes, 45 seconds ago
SHODAN

https://shodan.io
Internet Connected Server Search Engine

318 days, 5 hours, 12 minutes ago
SHODAN

https://shodan.io
Internet Connected Server Search Engine

318 days, 7 hours, 53 minutes, 6 seconds ago
SHODAN

https://shodan.io
Internet Connected Server Search Engine

318 days, 20 hours, 53 minutes, 8 seconds ago
SHODAN

https://shodan.io
Internet Connected Server Search Engine

322 days, 20 hours, 20 minutes, 11 seconds ago
SHODAN

https://shodan.io
Internet Connected Server Search Engine

323 days, 11 hours, 4 minutes, 25 seconds ago
SHODAN

https://shodan.io
Internet Connected Server Search Engine

323 days, 19 hours, 6 minutes, 59 seconds ago
SHODAN

https://shodan.io
Internet Connected Server Search Engine

327 days, 6 hours, 55 minutes, 16 seconds ago
SHODAN

https://shodan.io
Internet Connected Server Search Engine

327 days, 22 hours, 15 minutes, 51 seconds ago
SHODAN

https://shodan.io
Internet Connected Server Search Engine

328 days, 11 hours, 12 minutes, 3 seconds ago
SHODAN

https://shodan.io
Internet Connected Server Search Engine

328 days, 13 hours, 46 minutes, 50 seconds ago
SHODAN

https://shodan.io
Internet Connected Server Search Engine

328 days, 22 hours, 36 minutes, 27 seconds ago
SHODAN

https://shodan.io
Internet Connected Server Search Engine

332 days, 9 hours, 52 minutes, 27 seconds ago
SHODAN

https://shodan.io
Internet Connected Server Search Engine

332 days, 12 hours, 41 minutes, 23 seconds ago
SHODAN

https://shodan.io
Internet Connected Server Search Engine

333 days, 10 hours, 50 minutes, 53 seconds ago
SHODAN

https://shodan.io
Internet Connected Server Search Engine

333 days, 13 hours, 45 minutes, 14 seconds ago
SHODAN

https://shodan.io
Internet Connected Server Search Engine

333 days, 17 hours, 35 minutes, 57 seconds ago
November 2022
SHODAN

https://shodan.io
Internet Connected Server Search Engine

342 days, 7 hours, 41 minutes, 30 seconds ago
SHODAN

https://shodan.io
Internet Connected Server Search Engine

342 days, 14 hours, 59 minutes, 3 seconds ago
SHODAN

https://shodan.io
Internet Connected Server Search Engine

343 days, 10 hours, 2 minutes, 11 seconds ago
SHODAN

https://shodan.io
Internet Connected Server Search Engine

343 days, 14 hours, 25 minutes, 45 seconds ago
Site Launched on 30 October 2022