봇 인터넷 인덱싱

어떤 봇이 웹사이트를 색인화하나요?

이 페이지는 특정 시점부터 당사의 비밀 루트 도메인 엔드포인트를 방문하는 봇 및 자동화 에이전트를 보여줍니다. 18 6월 2026. 찾기 어렵게 하기 위해 도메인 이름은 거의 사용되지 않는 TLD에 있는 모호한 무작위 문자와 숫자 문자열이었습니다. 웹사이트는 JavaScript, 이미지, 미디어 및 프리미엄 웹 기술을 로드하여 사이트가 얼마나 깊이 색인되었는지 확인했습니다.

경쟁자는 어디에 있나요? 😳

우리의 비밀 웹사이트가 만들어진 이래로 18th 6월 2026, 기술 인덱싱 경쟁업체라고 자칭하는 회사 중 단 한 곳도 해당 웹사이트를 찾지 못했습니다. 에서 109 실험이 진행된 일수입니다.

 

BuiltWith는 해당 웹사이트가 생성된 지 이틀 만에 웹사이트를 발견했습니다. 우리 자신에 대한 내부 정보 없이. 즉, 기술 추적을 위해 경쟁사를 이용한다면 경쟁사가 사이트를 찾더라도 매우 큰 차이로 놓칠 것입니다.

424 식별된 사용자 에이전트가 만들어졌습니다. 121,950 다양한 요청에 대한 답변 74,056 세션에서 10,316 IP 주소. 마지막 생성 날짜 05 10월 2026 00:20 UTC.

google.com 다음을 통해 확인되었습니다. 43 사용자 에이전트, 만들기 2,747 요청 87 IP 주소.

첫 방문은 19 시간s, 35 분s 사이트가 공개된 후.

10월 2026
google.com
google.com Search

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +http://www.google.com/bot.html) Chrome/153.0.8010.36 Safari/537.36

100 날 사이트 출시 이후
google.com
google.com Search

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +http://www.google.com/bot.html) Chrome/153.0.8010.52 Safari/537.36

98 날 사이트 출시 이후
google.com
google.com Search

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/153.0.8010.52 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)

97 날 사이트 출시 이후
google.com
google.com Search

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/153.0.8010.47 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)

92 날 사이트 출시 이후
google.com
google.com Search

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/153.0.8010.36 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)

85 날 사이트 출시 이후
google.com
google.com Search

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/136.0.3122.188 Safari/537.36; compatible; Google-Extended/1.0; +http://www.google.com/bot.html

84 날 사이트 출시 이후
google.com
google.com Search

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/124.0.6086.134 Safari/537.36 Edg/124.0.6086.134; compatible; Google-Extended/1.0; +http://www.google.com/bot.html

84 날 사이트 출시 이후
google.com
google.com Search

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Mozilla/5.0 (Linux; Android 14; Pixel 8) AppleWebKit/537.36 (KHTML, like Gecko; compatible; Google-Extended/1.0; +http://www.google.com/bot.html) Chrome/148.0.8932.35 Mobile Safari/537.36

84 날 사이트 출시 이후
google.com
google.com Search

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:149.7) Gecko/20100101 Firefox/149.7; compatible; Google-Extended/1.0; +http://www.google.com/bot.html

84 날 사이트 출시 이후
google.com
google.com Search

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Mozilla/5.0 (Linux; Android 13; Pixel 7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/134.0.1250.235 Mobile Safari/537.36; compatible; Google-Extended/1.0; +http://www.google.com/bot.html

84 날 사이트 출시 이후
google.com
google.com Search

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; Google-Extended/1.0; +http://www.google.com/bot.html

84 날 사이트 출시 이후
google.com
google.com Search

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/152.0.7977.82 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)

83 날 사이트 출시 이후
google.com
google.com Search

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/152.0.7977.64 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)

83 날 사이트 출시 이후
google.com
google.com Search

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +http://www.google.com/bot.html) Chrome/152.0.7977.64 Safari/537.36

83 날 사이트 출시 이후
google.com
google.com Search

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +http://www.google.com/bot.html) Chrome/151.0.7922.173 Safari/537.36

71 날 사이트 출시 이후
8월 2026
google.com
google.com Search

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/151.0.7922.173 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)

70 날 사이트 출시 이후
google.com
google.com Search

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/151.0.7922.137 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)

60 날 사이트 출시 이후
google.com
google.com Search

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/151.0.7922.108 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)

57 날 사이트 출시 이후
google.com
google.com Search

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +http://www.google.com/bot.html) Chrome/151.0.7922.108 Safari/537.36

57 날 사이트 출시 이후
google.com
google.com Search

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +http://www.google.com/bot.html) Chrome/150.0.7871.186 Safari/537.36

43 날 사이트 출시 이후
7월 2026
google.com
google.com Search

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/150.0.7871.186 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)

42 날 사이트 출시 이후
google.com
google.com Search

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Googlebot/2.1 (+http://www.google.com/bot.html)

36 날 사이트 출시 이후
google.com
google.com Search

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/150.0.7871.128 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)

32 날 사이트 출시 이후
google.com
google.com Search

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/150.0.7871.124 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)

28 날 사이트 출시 이후
google.com
google.com Search

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/150.0.7871.114 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)

28 날 사이트 출시 이후
google.com
google.com Search

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +http://www.google.com/bot.html) Chrome/150.0.7871.46 Safari/537.36

26 날 사이트 출시 이후
google.com
google.com Search

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +https://www.google.com/bot.html) Safari/537.36

16 날 사이트 출시 이후
google.com
google.com Search

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/150.0.7871.46 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)

14 날 사이트 출시 이후
google.com
google.com Search

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +http://www.google.com/bot.html) Chrome/149.0.7827.200 Safari/537.36

14 날 사이트 출시 이후
google.com
google.com Search

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/149.0.7827.200 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)

13 날 사이트 출시 이후
google.com
google.com Search

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Mozilla/5.0 (compatible; Googlebot/2.1; http://www.google.com/bot.html)

11 날 사이트 출시 이후
google.com
google.com Search

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Mozilla/5.0 (iPhone; U; CPU iPhone OS) (compatible; Googlebot-Mobile/2.1; http://www.google.com/bot.html)

11 날 사이트 출시 이후
google.com
google.com Search

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/125.0.0.0 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)

10 날 사이트 출시 이후
google.com
google.com Search

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
DoCoMo/2.0 N905i(c100;TB;W24H16) (compatible; Googlebot-Mobile/2.1; http://www.google.com/bot.html)

10 날 사이트 출시 이후
google.com
google.com Search

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
SAMSUNG-SGH-E250/1.0 Profile/MIDP-2.0 Configuration/CLDC-1.1 UP.Browser/6.2.3.3.c.1.101 (GUI) MMP/2.0 (compatible; Googlebot-Mobile/2.1; http://www.google.com/bot.html)

7 날 사이트 출시 이후
6월 2026
google.com
google.com Search

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
AdsBot-Google ( http://www.google.com/adsbot.html)

7 날 사이트 출시 이후
google.com
google.com Search

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Googlebot-Image/1.0

2 날 사이트 출시 이후
google.com
google.com Search

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +http://www.google.com/bot.html) Chrome/148.0.7778.96 Safari/537.36

2 날 사이트 출시 이후
google.com
google.com Search

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/99.0.4844.84 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)

2 날 사이트 출시 이후
google.com
google.com Search

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Googlebot-News

1 낮 사이트 출시 이후
google.com
google.com Search

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/148.0.7778.96 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)

1 낮 사이트 출시 이후
google.com
google.com Search

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)

0 날 사이트 출시 이후
google.com
google.com Search

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Mozilla/5.0 (compatible; Google-Extended/1.0; +http://www.google.com/bot.html)

0 날 사이트 출시 이후
사이트 출시일 18 6월 2026