404enemy AdsTxtCrawlerTP AfD-Verbotsverfahren Alexibot Anarchy99 AwarioRssBot Badass BlowFish Brandprotect BuiltBotTough BuzzSumo ChatGPT-User Copier CrazyWebCrawler Crescent Custo DigitalPebble Evil Extreme Picture Finder Gigabot GridBot HTMLparser HTTP::Lite HTTrack IDBot IRLbot Iblog IlseBot InterGET Kenjin Spider Keybot Translation-Search-Machine Kozmosbot Larbin LexiBot Libwhisker LinkextractorPro LinksManager Lipperhey Spider MFC_Tear_Sample Mail.RU_Bot Majestic12 MarkMonitor Mata Hari MeanPath Bot Morfeus Fucking Scanner Mozlila NICErsPRO NearSite Nessus Nibbler Nimbostratus Nmap Octopus PECL::HTTP Page Analyzer Panscient PeoplePal Pimonster Pockey Proximic Pu_iN Quick-Crawler RankingBot2 RocketCrawler Rogerbot SEOlyt SEOprofiler SEOstats Scanbot Screaming SemanticJuice SentiBot Snake SocialRankIOBot Spider_Bot SputnikBot Sqlworm SuperBot Surfbot The Intraformant TinyTestBot Upflow Web Auto Web Fetch WebBandit WebEnhancer WebStripper Widow Wprecon Xaldon_WebSpider Zauba crawl.sogou.com domainsproject.org iubenda-radar magpie-crawler oBot ripz sexsearcher spyfu zauba.io