404enemy ALittle Client AfD-Verbotsverfahren AlphaBot Anarchie Anarchy99 Apexoo Asterias AwarioSmartBot BBBike BLEXBot BackStreet BackWeb BatchFTP Battleztar Bazinga BetaBot Bigfoot BlackWidow BotALot Brandwatch Buddy CSHttp Calculon CensysInspect CheeseBot CherryPicker Chlooe Claritybot Copier CopyRightCheck Craftbot Custo CyotekWebCopy DIIbot DTS Agent Deusu Digincore DigitalPebble Discobot Domains Project ECCP/1.0 EMail Wolf EasyDL EirGrabber EroCrawler ExtLinksBot ExtractorPro Extreme Picture Finder FemtosearchBot FlashGet Foobot Freeuploader Fuzz Fyrebot GermCrawler GetRight Gigablast Go!Zilla Gotit GrabNet Grafula GridBot HMView HaosouSpider Harvest Hloader IRLbot Image Sucker InfoNaviRobot InfoTekies InterGET Internet Ninja JOC Web Spider JamesBOT Jbrofuzz JennyBot JetCar Jetty Jyxobot Kenjin Spider Keyword Density Kinza LNSpiderguy LWP::Simple Lanshanbot Leap LexiBot Lftp LibWeb Libwhisker Likse LinkScan Linkdexbot LinkextractorPro LinqiaMetadataDownloaderBot LinqiaScrapeBot Lipperhey Spider Litemage_walker Ltx71 MFC_Tear_Sample MIDown tool MJ12bot MSFrontPage MSIECrawler Magnet Majestic12 MarkWatch Mass Downloader Masscan MeanPath Bot Meanpathbot Metauri MicroMessenger Microsoft Data Access Moblie Safari Morfeus Fucking Scanner NICErsPRO NPbot Nameprotect Nessus Net Vampire NetAnts NetLyzer NetZIP Netcraft Nettrack NextGenSearchBot Nibbler Nikto NimbleCrawler Nuclei Octopus Offline Explorer OnCrawl OpenLinkProfiler OutclicksBot PHPCrawl POE-Component-Client-HTTP PageGrabber Pandalytics Papa Foto PeoplePal Petalbot Pi-Monster Picscout Piepmatz PleaseCrawl Pockey ProPowerBot ProWebWalker Psbot Pu_iN QueryN Metasearch RankActive Rankivabot RankurBot Re-re ReGet RealDownload Reaper RebelMouse Recorder RepoMonkey RocketCrawler SBIder SEOkicks-Robot SalesIntelligent ScanAlert Scanbot ScrepyBot SemrushBot Seomoz Shodan Siphon Site Sucker SiteExplorer SiteLockSpider SiteSnagger SiteSucker Sitebeam Sitevigil SlySearch SocialRankIOBot SpaceBison SpankBot Spanner Spbot SuperBot Surfbot SurveyBot Swiftbot Szukacz T0PHackTeam T8Abot Thumbor Toata TurnitinBot TwengaBot Twice Typhoeus V-BOT VelenPublicWebCrawler Virusdie Voltron WASALive-Bot WEBDAV WPScan WWW-Mechanize Wallpapers/3.0 Web Fetch Web Fuck Web Sucker WebAuto WebGo IS WebReaper WebSucker Webalta Website Quester Whacker Who.is Bot Widow WinHTTrack WiseGuys Robot Wonderbot Woobot Wotbox Wprecon Xaldon WebSpider Xaldon_WebSpider Zauba Zeus archive.org_bot crawler.feedback crawler4j demandbase-bot eCatch gopher muhstik-scan oBot page scorer satoristudio.net scalaj-http sysscan tAkeOut voyagerx.com x09Mozilla x22Mozilla xpymep1.exe zauba.io zgrab