404enemy AIBOT Aboundex Aboundexbot AfD-Verbotsverfahren Aipbot Alexibot AllSubmitter Anarchy99 Ankit Aspiegel AwarioRssBot BLEXBot BackWeb Badass Bandit BetaBot Black Hole BlackWidow Bolt BotALot Brandwatch Buck BuiltWith Bullseye BuzzSumo CSHttp Cegbfeieh CensysInspect Cocolyzebot Collector Copier CopyRightCheck Craftbot Crawling at Home Project CrunchBot Custo CyotekWebCopy DIIbot DSearch DataCha0s DatabaseDriverMysqli Devil DigitalPebble Dirbuster Dispatch DomainAppender DomainSigmaCrawler DomainStatsBot Dragonfly Drip ECCP/1.0 EMail Wolf EroCrawler Evil Extreme Picture Finder EyeNetIE FDM FHscan Fimap Firefox/7.0 Flunky Fuzz GetRight GetWeb Getintent Gigabot GoZilla HTTP::Lite HTTrack Harvest Havij Heritrix HonoluluBot IDBTE4M IRLbot IlseBot Indy Library Intelliseek JamesBOT Jbrofuzz Joomla JustView Jyxobot Kenjin Spider Keyword Density LeechFTP LeechGet LexiBot Lftp LibWeb LieBaoFast Likse LinkpadBot LinqiaRSSBot LinqiaScrapeBot Lipperhey MIIxpc MSIECrawler MTRobot Majestic SEO Majestic-SEO Masscan Mb2345Browser Meanpathbot Microsoft Data Access Mojolicious Musobot NPbot Nameprotect Navroad NetZIP Netvibes NextGenSearchBot Nikto NimbleCrawler Not Octopus Offline Explorer Offline Navigator OpenVAS OutfoxBot PageGrabber PageThing.com Papa Foto PeoplePal Pi-Monster Picscout Picsearch Pimonster PleaseCrawl Pockey ProPowerBot ProWebWalker Probethenet Pump PxBroker PyCurl QueryN Metasearch RankActiveLinkBot RankingBot RankurBot ReGet Rogerbot SBIder SEOkicks-Robot ScanAlert Scrapy Seekport SemanticJuice SemrushBot SeobilityBot Seomoz Shodan Site Sucker SiteExplorer SiteSnagger SiteSucker Sitebeam Sitevigil SmartDownload Snake Snoopy Sociscraper Sosospider SpankBot Spbot Sqlworm Sucker SuperHTTP SurveyBot Szukacz Teleport Telesoft Telesphoreo Telesphorep TheNomad Thumbor Titan Toata Toweyabot Trendiction Turnitin Typhoeus URLy Warning URLy.Warning V-BOT VB Project Voltron WEBDAV WPScan WWW-Collector-E WWW-Mechanize WWW::Mechanize Web Collage Web Enhancer Web Fuck Web Sucker WebAuto WebEnhancer WebGo IS WebImageCollector WebLeacher WebPix WebStripper WebWhacker WebZIP WebmasterWorldForumBot WebsiteExtractor WebsiteQuester Widow WinHTTrack WiseGuys Robot Xaldon WebSpider YoudaoBot Zauba Zermelo Zeus Zitebot ZmEu ZoominfoBot ZumBot ZyBorg archive.org_bot arquivo-web-crawler autoemailspider clark-crawler coccocbot com.plumanalytics domainsproject.org facebookscraper gopher heritrix internetVista monitor ips-agent linkdexbot magpie-crawler mediawords ripz satoristudio.net scan.lol seobility seostar sitechecker.pro sp_auditbot trendiction.com voyagerx.com webprosbot x22Mozilla zauba.io