360Spider
404checker
80legs
Aipbot
Alexibot
AlphaBot
Ankit
archive.org_bot
Aspiegel
Attach
AwarioRssBot
Bandit
BatchFTP
Battleztar Bazinga
BBBike
BDCbot
BDFetch
BLEXBot
Brandwatch
BuiltBotTough
BuzzSumo
Calculon
CheeseBot
CherryPicker
CheTeam
Claritybot
Cliqzbot
Copier
Copyscape
Cosmos
crawler.feedback
CrazyWebCrawler
Crescent
CrunchBot
CSHttp
DatabaseDriverMysqli
DataCha0s
Demon
Devil
Digincore
DIIbot
Disco
Discoverybot
Dispatch
DomainAppender
Dotbot
Download Wonder
eCatch
Ecxi
EirGrabber
Evil
Express WebPictures
ExtractorPro
Extreme Picture Finder
facebookscraper
FDM
FHscan
Fimap
FlashGet
Foobot
Fyrebot
GalaxyBot
Genieo
Getintent
GetRight
Gigablast
Gigabot
G-i-g-a-b-o-t
Gotit
GoZilla
Grafula
GrapeFX
GridBot
GT::WWW
Haansoft
HaosouSpider
HEADMasterSEO
heritrix
HTTP::Lite
Humanlinks
HybridBot
Iblog
IlseBot
InfoNaviRobot
InfoTekies
Intelliseek
ips-agent
Iria
IRLbot
JamesBOT
JennyBot
JetCar
Jetty
JikeSpider
JOC Web Spider
Jorgee
JustView
Kenjin Spider
Kozmosbot
LexiBot
Libwhisker
LieBaoFast
Lightspeedsystems
Linkdexbot
LinkextractorPro
LinkScan
LinkWalker
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey
Litemage_walker
Ltx71
lwp-request
Mag-Net
MarkMonitor
MarkWatch
Meanpathbot
MeanPath Bot
Mediatoolkitbot
MegaIndex.ru
MFC_Tear_Sample
Mojeek
Mojolicious
Morfeus Fucking Scanner
MSFrontPage
Musobot
Nameprotect
Navroad
Needle
NetSpider
Nettrack
Net Vampire
NetZIP
NextGenSearchBot
Nmap
NPbot
Nutch
Offline Explorer
Offline Navigator
Openfind
OpenVAS
OutfoxBot
PageScorer
Papa Foto
pcBrowser
PECL::HTTP
PeoplePal
Picscout
Picsearch
Pi-Monster
PleaseCrawl
Probethenet
ProPowerBot
Psbot
Pump
PxBroker
PyCurl
RankActiveLinkBot
RankFlex
RankingBot2
Rankivabot
RealDownload
ReGet
s1z.ru
satoristudio.net
ScanAlert
Scrapy
Screaming
ScreenerBot
Searchestate
SearchmetricsBot
Semrush
SEOlyticsCrawler
Seomoz
SEOprofiler
seoscanners
SISTRIX
Sitebeam
SiteExplorer
SiteSucker
Sitevigil
SlySearch
SmartDownload
SMTBot
Snapbot
Snoopy
SocialRankIOBot
SpankBot
sp_auditbot
Spbot
SputnikBot
spyfu
Sqlmap
Sqworm
SuperBot
SuperHTTP
Surfbot
Swiftbot
Szukacz
TeleportPro
Telesoft
Thumbor
Toata
Tracemyfile
Trendictionbot
trendiction.com
trendiction.de
Turnitin
TurnitinBot
TwengaBot
Twice
Typhoeus
UnisterBot
Upflow
Vacuum
Vagabondo
VCI
VeriCiteCrawler
Virusdie
VoidEYE
WBSearchBot
Webalta
Web Auto
WebCopier
Web Enhancer
WebFetch
Web Fetch
WebImageCollector
webmeup-crawler
WebPix
Webshag
WebsiteExtractor
WebsiteQuester
Website Quester
Who.is Bot
WinHTTrack
WiseGuys Robot
Wotbox
Wprecon
WWWOFFLE
x22Mozilla
Xaldon_WebSpider
Zade
Zauba
zauba.io
Zermelo
Zitebot
ZmEu
ZumBot
ZyBorg