360Spider 404enemy ADmantX AIBOT ALittle Client ASPSeek Aboundexbot Acunetix AfD-Verbotsverfahren AlphaBot Anarchy99 Anthill AwarioRssBot BBBike Backlink-Ceck BacklinkCrawler BetaBot Bigfoot Blackboard Boardreader Bolt Brandprotect Brandwatch Buddy BuiltBotTough Bullseye CCBot CODE87 CazoodleBot CheTeam CheeseBot CherryPicker Claritybot Copyscape Cosmos Crawling at Home Project CrazyWebCrawler Crescent DIIbot DSearch DTS Agent DataCha0s Devil Digincore DigitalPebble Dirbuster Disco Dispatch DnyzBot DomainCrawler DomainSigmaCrawler Download Wonder Drip EMail Wolf Ebingbong Ecxi EirGrabber Evil ExtLinksBot FHscan Fimap Firefox/7.0 Flunky Fuzz Fyrebot GT::WWW GetWeb Gigabot Go!Zilla GoZilla Gotit Grabber GrapeshotCrawler GridBot HTTrack Harvest Humanlinks IRLbot Iblog IlseBot IndeedBot InterGET Internet Ninja Iria Iskanie JOC Web Spider JamesBOT JikeSpider Jyxobot Kinza Larbin Leap LeechFTP LexiBot Lftp Libwhisker Lightspeedsystems LinkScan Linkdexbot LinqiaScrapeBot Lipperhey Litemage_walker Lmspider Ltx71 MFC_Tear_Sample MIDown tool MSFrontPage MSIECrawler MTRobot Mag-Net Majestic-SEO Majestic12 MarkMonitor MarkWatch Masscan MauiBot MeanPath Bot Meanpathbot Mediatoolkitbot Metauri Microsoft Data Access Mr.4x3 Needle Netvibes Nikto NimbleCrawler Nimbostratus Ninja Nutch Octopus Offline Navigator Openfind OrangeSpider OutclicksBot OutfoxBot PHPCrawl POE-Component-Client-HTTP Page Analyzer PageAnalyzer PageScorer PageThing.com Papa Foto Picsearch Piepmatz PleaseCrawl ProPowerBot Probethenet PxBroker QueryN Metasearch RankActive RedesScrapy RepoMonkey Ripper SEOlyticsCrawler SEOprofiler SalesIntelligent ScanAlert Scanbot Screaming ScrepyBot SearchmetricsBot SentiBot Seomoz Site Sucker SiteCheckerBotCrawler SiteLockSpider Sitebeam SlySearch Snapbot Snoopy SocialRankIOBot Sogou web spider SpaceBison Spammen Spanner Spinn3r SputnikBot Sqlworm Steeler Sucker SuperHTTP Suzuran T8Abot Telesphorep The Intraformant Thumbor TightTwatBot Turingos TurnitinBot Typhoeus URLy Warning URLy.Warning UnisterBot V-BOT Vagabondo VelenPublicWebCrawler VeriCiteCrawler Virusdie VoidEYE WBSearchBot WWW-Collector-E WWWOFFLE Wallpapers WallpapersHD Web Pix Web Sauger WebBandit WebCollage WebCopier WebFuck WebReaper Webalta WebmasterWorldForumBot Webster Whack Who.is Bot WinHTTrack Wonderbot YoudaoBot Zade Zermelo Zitebot ZoominfoBot ZyBorg archive.org_bot arquivo.pt autoemailspider backlink-check coccocbot-web cognitiveseo com.plumanalytics crawler4j facebookscraper gopher internetVista monitor lwp-request lwp-trivial magpie-crawler mediawords page scorer pcBrowser probe-image-size satoristudio.net serpstatbot sexsearcher sitechecker.pro tAkeOut trendiction.de voyagerx.com x09Mozilla