360Spider ADmantX Abonti Alligator Anarchie AwarioRssBot AwarioSmartBot BBBike Badass Bitacle BotALot Calculon ChinaClaw Cliqzbot Cosmos Crawling at Home Project CrazyWebCrawler Crescent DataCha0s Demon DigitalPebble DomCopBot DomainAppender EasyDL EirGrabber ExtractorPro FDM Firefox/7.0 Fuzz GPTBot GalaxyBot GrapeshotCrawler HaosouSpider Iria Iskanie JetCar Jorgee Jyxobot Keyword Density Kozmosbot Likse LinkWalker LinkextractorPro LinkpadBot LinqiaMetadataDownloaderBot LinqiaScrapeBot Lipperhey Litemage_walker MQQBrowser MTRobot Metauri Microsoft Data Access Nameprotect NearSite Ninja OrangeSpider OutclicksBot PECL::HTTP PageAnalyzer ProPowerBot Psbot QueryN Metasearch RankingBot2 ReGet SemrushBot-OCOB SemrushBot-SWA SentiBot SenutoBot Site Sucker SiteLockSpider Sitebeam Snake Sosospider Spammen Spbot Sucuri TeleportPro TinyTestBot Trendictionbot Turingos URLy.Warning V-BOT WISENutbot WWW::Mechanize Web Collage WebWhacker Webalta Zauba ZyBorg arquivo-web-crawler demandbase-bot lwp-request magpie-crawler mediawords page scorer probe-image-size seocompany.store siteripz ubermetrics-technologies.com zgrab