404enemy ALittle Client AfD-Verbotsverfahren Aipbot Anarchie Anarchy Anarchy99 Anthill Apexoo Attach BBBike BLEXBot BackWeb Backlink-Ceck Battleztar Bazinga Bitacle Black Hole BotALot Brandprotect Buck Buddy BuiltWith BunnySlippers BuzzSumo CATExplorador CODE87 CazoodleBot CherryPicker ChinaClaw Chlooe Claritybot Cliqzbot Cloud mapping Collector Cosmos Craftbot CrazyWebCrawler Curious CyotekWebCopy DIIbot DatabaseDriverMysqli Devil Discobot DittoSpyder DnyzBot DomCopBot Download Wonder EMail Siphon Ebingbong Ecxi Exabot Extreme Picture Finder EyeNetIE Firefox/7.0 Foobot Fyrebot G-i-g-a-b-o-t GT::WWW Genieo Go!Zilla Go-Ahead-Got-It GridBot HTTP::Lite HTTrack Haansoft Havij Heritrix Hloader Humanlinks IDBTE4M IRLbot Iblog Image Fetch InfoNaviRobot InterGET Iskanie JOC Web Spider JetCar Jyxobot Kozmosbot LNSpiderguy LWP::Simple LeechGet Lftp LibWeb Libwhisker Lightspeedsystems Likse LinkextractorPro LinksManager Lipperhey Spider Ltx71 MIIxpc MSIECrawler Mag-Net Magnet Majestic-SEO MarkMonitor MarkWatch MauiBot Mediatoolkitbot Microsoft Data Access Microsoft URL Control Minefield Mister PiX Mojolicious Morfeus Fucking Scanner Mozlila Msrabot Musobot NICErsPRO NPbot Name Intelligence Navroad Net Vampire NetAnts Netcraft Nettrack Netvibes Nibbler NimbleCrawler Nuclei Offline Explorer OpenVAS Openfind OrangeSpider OutfoxBot PHPCrawl PageThing.com PeoplePal Petalbot Pi-Monster Picscout Picsearch PictureFinder Probethenet Pu_iN QueryN Metasearch RankActiveLinkBot RankFlex Reaper RebelMouse Ripper SBIder SEOkicks SEOlyticsCrawler SMTBot SalesIntelligent ScoutJet Screaming ScreenerBot ScrepyBot SemanticJuice SeoSiteCheckup SeobilityBot Seomoz Siphon SiteCheckerBotCrawler SiteExplorer SiteLockSpider SiteSucker Sitebeam SlySearch Snapbot SocialRankIOBot Spammen Spanner Spbot Sqlworm Sqworm Steeler Stripper SuperHTTP SurveyBot Szukacz Teleport TeleportPro Telesphoreo Telesphorep Thumbor Tracemyfile Turnitin TwengaBot Twice Typhoeus VCI Vacuum Vagabondo VelenPublicWebCrawler VeriCiteCrawler Virusdie WASALive-Bot WBSearchBot WEBDAV WeSEE Web Auto WebAuto WebCollage WebFuck WebImageCollector WebPix WebReaper Webalta WebmasterWorldForumBot WebsiteQuester Whacker Widow WiseGuys Robot Woobot Xaldon_WebSpider YoudaoBot Zade Zauba Zeus Zitebot ZmEu ZyBorg adscanner archive.org_bot arquivo-web-crawler arquivo.pt backlink-check cah.io.community check1.exe crawler.feedback dataforseo.com demandbase-bot gopher instabid iubenda-radar linkdexbot lwp-trivial mediawords pcBrowser plumanalytics probe-image-size ripz satoristudio.net scalaj-http serpstatbot sogouspider sp_auditbot tAkeOut trendiction.com ubermetrics-technologies.com voyagerx.com webmeup-crawler webpros.com webprosbot x09Mozilla