Индексация ботов в Интернете

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +http://www.google.com/bot.html) Chrome/153.0.8010.36 Safari/537.36

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +http://www.google.com/bot.html) Chrome/153.0.8010.52 Safari/537.36

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/153.0.8010.52 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/153.0.8010.47 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/153.0.8010.36 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/136.0.3122.188 Safari/537.36; compatible; Google-Extended/1.0; +http://www.google.com/bot.html

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/124.0.6086.134 Safari/537.36 Edg/124.0.6086.134; compatible; Google-Extended/1.0; +http://www.google.com/bot.html

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Mozilla/5.0 (Linux; Android 14; Pixel 8) AppleWebKit/537.36 (KHTML, like Gecko; compatible; Google-Extended/1.0; +http://www.google.com/bot.html) Chrome/148.0.8932.35 Mobile Safari/537.36

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:149.7) Gecko/20100101 Firefox/149.7; compatible; Google-Extended/1.0; +http://www.google.com/bot.html

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Mozilla/5.0 (Linux; Android 13; Pixel 7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/134.0.1250.235 Mobile Safari/537.36; compatible; Google-Extended/1.0; +http://www.google.com/bot.html

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; Google-Extended/1.0; +http://www.google.com/bot.html

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/152.0.7977.82 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/152.0.7977.64 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +http://www.google.com/bot.html) Chrome/152.0.7977.64 Safari/537.36

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +http://www.google.com/bot.html) Chrome/151.0.7922.173 Safari/537.36

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/151.0.7922.173 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/151.0.7922.137 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/151.0.7922.108 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +http://www.google.com/bot.html) Chrome/151.0.7922.108 Safari/537.36

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +http://www.google.com/bot.html) Chrome/150.0.7871.186 Safari/537.36

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/150.0.7871.186 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Googlebot/2.1 (+http://www.google.com/bot.html)

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/150.0.7871.128 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/150.0.7871.124 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/150.0.7871.114 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +http://www.google.com/bot.html) Chrome/150.0.7871.46 Safari/537.36

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +https://www.google.com/bot.html) Safari/537.36

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/150.0.7871.46 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +http://www.google.com/bot.html) Chrome/149.0.7827.200 Safari/537.36

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/149.0.7827.200 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Mozilla/5.0 (compatible; Googlebot/2.1; http://www.google.com/bot.html)

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Mozilla/5.0 (iPhone; U; CPU iPhone OS) (compatible; Googlebot-Mobile/2.1; http://www.google.com/bot.html)

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/125.0.0.0 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
DoCoMo/2.0 N905i(c100;TB;W24H16) (compatible; Googlebot-Mobile/2.1; http://www.google.com/bot.html)

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
SAMSUNG-SGH-E250/1.0 Profile/MIDP-2.0 Configuration/CLDC-1.1 UP.Browser/6.2.3.3.c.1.101 (GUI) MMP/2.0 (compatible; Googlebot-Mobile/2.1; http://www.google.com/bot.html)

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
AdsBot-Google ( http://www.google.com/adsbot.html)

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Googlebot-Image/1.0

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +http://www.google.com/bot.html) Chrome/148.0.7778.96 Safari/537.36

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/99.0.4844.84 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Googlebot-News

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/148.0.7778.96 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Mozilla/5.0 (compatible; Google-Extended/1.0; +http://www.google.com/bot.html)