Индексация ботов в Интернете

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +http://www.google.com/bot.html) Chrome/151.0.7922.173 Safari/537.36

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/151.0.7922.173 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/151.0.7922.137 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/151.0.7922.108 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +http://www.google.com/bot.html) Chrome/151.0.7922.108 Safari/537.36

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +http://www.google.com/bot.html) Chrome/150.0.7871.186 Safari/537.36

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/150.0.7871.186 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Googlebot/2.1 (+http://www.google.com/bot.html)

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/150.0.7871.128 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/150.0.7871.124 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/150.0.7871.114 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +http://www.google.com/bot.html) Chrome/150.0.7871.46 Safari/537.36

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +https://www.google.com/bot.html) Safari/537.36

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/150.0.7871.46 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +http://www.google.com/bot.html) Chrome/149.0.7827.200 Safari/537.36

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/149.0.7827.200 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Mozilla/5.0 (compatible; Googlebot/2.1; http://www.google.com/bot.html)

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Mozilla/5.0 (iPhone; U; CPU iPhone OS) (compatible; Googlebot-Mobile/2.1; http://www.google.com/bot.html)

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/125.0.0.0 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
DoCoMo/2.0 N905i(c100;TB;W24H16) (compatible; Googlebot-Mobile/2.1; http://www.google.com/bot.html)

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
SAMSUNG-SGH-E250/1.0 Profile/MIDP-2.0 Configuration/CLDC-1.1 UP.Browser/6.2.3.3.c.1.101 (GUI) MMP/2.0 (compatible; Googlebot-Mobile/2.1; http://www.google.com/bot.html)

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
AdsBot-Google ( http://www.google.com/adsbot.html)

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Googlebot-Image/1.0

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +http://www.google.com/bot.html) Chrome/148.0.7778.96 Safari/537.36

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/99.0.4844.84 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Googlebot-News

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/148.0.7778.96 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)

Google operates crawlers including Googlebot to discover and index public content for Search and related services.
Mozilla/5.0 (compatible; Google-Extended/1.0; +http://www.google.com/bot.html)