360Spider 404checker Aboundex Anarchy Aspiegel BLEXBot Badass Barkrowler Bitacle Cocolyzebot Cogentbot Copier Crescent Deusu Ebingbong Ezooms Firefox/7.0 Flunky Freeuploader Fuzz G-i-g-a-b-o-t Gotit HEADMasterSEO Haansoft Harvest Iblog Intelliseek InternetSeer JennyBot LinkpadBot LinksManager Lipperhey Spider Litemage_walker Ltx71 Magnet Majestic SEO Masscan MeanPath Bot Moblie Safari Musobot Name Intelligence Navroad Needle Niki-bot Nimbostratus Nmap Nuclei Offline Explorer OnCrawl OpenLinkProfiler Openfind OrangeSpider PECL::HTTP PageGrabber PictureFinder Piepmatz Pimonster RankFlex RankurBot SEOkicks SMTBot ScrepyBot Searchestate SemanticJuice SemrushBot-BA SeoCherryBot SeoSiteCheckup Sitebeam Snapbot Sosospider Sottopop Spider_Bot/3.0 SputnikBot Steeler Swiftbot Titan V-BOT WISENutbot WebReaper WebStripper WebSucker WebWhacker WebZIP Wonderbot Xaldon_WebSpider ZoomBot arquivo-web-crawler cah.io.community clark-crawler com.plumanalytics facebookscraper lwp-trivial meanpathbot polaris version ripz siteripz sp_auditbot trendiction.de ubermetrics-technologies.com webgains-bot