404checker
404enemy
Aboundexbot
ADmantX
AhrefsBot
AIBOT
AllSubmitter
arquivo.pt
Asterias
BackDoorBot
Backlink-Ceck
BackStreet
Bandit
Battleztar Bazinga
BDCbot
BDFetch
Boardreader
BotALot
Brandprotect
Buddy
BuiltWith
Bullseye
BuzzSumo
Calculon
CATExplorador
Cegbfeieh
CherryPicker
ChinaClaw
Cliqzbot
Collector
com.plumanalytics
Craftbot
crawler4j
crawl.sogou.com
CrazyWebCrawler
DatabaseDriverMysqli
DataCha0s
DBLBot
demandbase-bot
Devil
Discobot
DittoSpyder
DomainAppender
DomainCrawler
DomainSigmaCrawler
Download Wonder
Drip
eCatch
ECCP/1.0
Ecxi
EirGrabber
EMail Siphon
EroCrawler
evc-batch
Evil
Exabot
ExtractorPro
Extreme Picture Finder
facebookscraper
FDM
FemtosearchBot
FHscan
Firefox/7.0
FlashGet
Freeuploader
FrontPage
FyberSpider
GetWeb
Harvest
Havij
Hloader
HTTP::Lite
HTTrack
Humanlinks
IDBot
IlseBot
Indy Library
InfoNaviRobot
instabid
Intelliseek
InterGET
internetVista monitor
JamesBOT
JetCar
Joomla
JustView
Lanshanbot
Larbin
LeechGet
LexiBot
Libwhisker
LinksManager
LinkWalker
LinqiaRSSBot
Lipperhey
LWP::Simple
lwp-trivial
Mag-Net
magpie-crawler
Mail.RU_Bot
MarkWatch
Masscan
Mata Hari
MauiBot
MeanPath Bot
Mediatoolkitbot
MegaIndex.ru
Metauri
MFC_Tear_Sample
MIDown tool
Mister PiX
Morfeus Fucking Scanner
MSFrontPage
MSIECrawler
Musobot
Needle
Nessus
NetAnts
Netcraft
netEstate NE Crawler
NetZIP
Niki-bot
Ninja
Nmap
NPbot
Offline Explorer
Openfind
OpenLinkProfiler
OrangeBot
OutclicksBot
Page Analyzer
PageGrabber
Papa Foto
Pavuk
PECL::HTTP
PHPCrawl
Picscout
Pimonster
Pi-Monster
Pixray
PleaseCrawl
POE-Component-Client-HTTP
Psbot
Pump
PxBroker
PyCurl
QueryN Metasearch
RankActiveLinkBot
RankFlex
RankingBot
Rankivabot
RebelMouse
RedesScrapy
RocketCrawler
Rogerbot
RSSingBot
SalesIntelligent
SBIder
ScanAlert
ScoutJet
Scrapy
Screaming
ScreenerBot
SearchmetricsBot
Semrush
SemrushBot
SEOkicks
SEOkicks-Robot
SeoSiteCheckup
sexsearcher
Shodan
SISTRIX
Siteimprove
SiteSnagger
SiteSucker
SmartDownload
SMTBot
Snapbot
SocialRankIOBot
Sogou web spider
Sottopop
SpaceBison
Spammen
Spinn3r
SputnikBot
Sqlmap
Steeler
SuperBot
SuperHTTP
Swiftbot
Szukacz
T0PHackTeam
T8Abot
tAkeOut
The Intraformant
Thumbor
TightTwatBot
Titan
Toata
Toweyabot
Tracemyfile
Trendictionbot
True_Robot
Turingos
Twice
URLy.Warning
Vacuum
VB Project
VidibleScraper
Virusdie
VoidEYE
Voil
Wallpapers/3.0
WASALive-Bot
WBSearchBot
Webalta
WebBandit
WebCollage
Web Enhancer
WebFetch
WebFuck
WebImageCollector
WebLeacher
WebmasterWorldForumBot
webmeup-crawler
WebPix
Web Sauger
Webshag
WebsiteExtractor
WebsiteQuester
Webster
WebZIP
Whacker
Whatweb
WiseGuys Robot
WISENutbot
Wonderbot
Woobot
Wotbox
WWW-Collector-E
WWW-Mechanize
x09Mozilla
x22Mozilla
Xaldon_WebSpider
Xenu
Zade
Zauba
Zeus
ZmEu
ZumBot