404enemy 80legs ALittle Client Aboundexbot Acunetix AiHitBot Aipbot Alligator Ankit Attach BBBike BackDoorBot BackWeb BetaBot Bitacle Black Hole BlackWidow Blackboard Blow Boardreader Bolt Brandwatch Buck Bullseye BuzzSumo CATExplorador CCBot CSHttp ChinaClaw Chlooe Copier Copyscape Craftbot CrazyWebCrawler DSearch DTS Agent DataCha0s DatabaseDriverMysqli Digincore Dirbuster Disco DittoSpyder DnBCrawler-Analytics DomainAppender Domains Project Dotbot EMail Siphon Ebingbong EroCrawler Express WebPictures ExtLinksBot Extractor Extreme Picture Finder Ezooms FDM Flunky G-i-g-a-b-o-t GalaxyBot Genieo GermCrawler GetRight Gigabot GoZilla Grabber GrapeFX HTTrack Harvest Heritrix Hloader IDBTE4M IDBot Iblog InternetSeer IstellaBot JamesBOT JennyBot JetCar Jetty JikeSpider Jyxobot Kenjin Spider Kinza LNSpiderguy LWP::Simple LeechFTP Lightspeedsystems Likse LinqiaScrapeBot Lipperhey Lipperhey Spider Litemage_walker MFC_Tear_Sample MIIxpc Mag-Net Mail.RU_Bot Majestic SEO Majestic12 MarkMonitor MeanPath Bot Meanpathbot MegaIndex.ru Metauri Microsoft Data Access Microsoft URL Control Mojeek Morfeus Fucking Scanner Mozlila NPbot Nameprotect NearSite Nessus NetAnts NetZIP Netcraft Nettrack Nibbler Nikto NimbleCrawler Nmap Octopus OpenLinkProfiler Openvas OrangeSpider OutclicksBot OutfoxBot PECL::HTTP PHPCrawl POE-Component-Client-HTTP PageGrabber Pandalytics Pimonster Probethenet Pu_iN PxBroker QueryN Metasearch RankActive RankActiveLinkBot RankFlex RankingBot Re-re ReGet RedesScrapy RepoMonkey Rogerbot SEOkicks-Robot SEOstats Scanbot Scrapy Screaming ScreenerBot ScrepyBot SearchmetricsBot SeobilityBot Seomoz Siphon SiteCheckerBotCrawler SiteExplorer SiteLockSpider SiteSnagger Sitebeam Snake SocialRankIOBot Sociscraper Sogou web spider SpaceBison Spammen SpankBot Spanner SputnikBot Sqlmap Steeler Stripper Suzuran Szukacz T0PHackTeam Teleport Telesoft TheNomad TightTwatBot Trendiction Trendictionbot Turingos URLy Warning V-BOT VB Project VCI Vagabondo VidibleScraper WASALive-Bot WWW::Mechanize Wallpapers Web Collage Web Sauger WebAuto WebBandit WebCopier WebEnhancer WebFuck WebImageCollector WebLeacher WebPix WebReaper WebSucker WebZIP WebmasterWorldForumBot Website Quester Whacker Who.is Bot WiseGuys Robot Wonderbot Wprecon Xaldon_WebSpider Xenu Zade Zauba Zeus ZoomBot ZoominfoBot ZumBot arquivo.pt autoemailspider backlink-check cah.io.community cognitiveseo com.plumanalytics crawler.feedback crawler4j demandbase-bot facebookscraper gopher heritrix instabid lwp-trivial magpie-crawler mediawords muhstik-scan polaris version ripz s1z.ru satoristudio.net seoscanners seostar siteripz sysscan trendiction.de webprosbot x09Mozilla xpymep1.exe zauba.io zgrab