360Spider
404checker
404enemy
80legs
Aboundex
Acunetix
AhrefsBot
Alexibot
AlphaBot
Anarchie
archive.org_bot
autoemailspider
BackDoorBot
BackWeb
Badass
BDCbot
BetaBot
Bigfoot
Blackboard
BlackWidow
Blow
Bolt
Buddy
BuiltBotTough
BunnySlippers
BuzzSumo
CATExplorador
CCBot
Cegbfeieh
CheTeam
ChinaClaw
Cloud mapping
coccocbot-web
Cogentbot
Collector
com.plumanalytics
Copyscape
Craftbot
crawler4j
crawler.feedback
CrazyWebCrawler
Crescent
CrunchBot
Custo
DBLBot
Deusu
Devil
DIIbot
Dirbuster
Disco
Dispatch
DittoSpyder
DomainAppender
DomainSigmaCrawler
DSearch
EasyDL
Ecxi
EirGrabber
EMail Siphon
Express WebPictures
ExtLinksBot
Extractor
ExtractorPro
Extreme Picture Finder
Ezooms
facebookscraper
FemtosearchBot
FHscan
Firefox/7.0
Freeuploader
FrontPage
FyberSpider
GalaxyBot
GermCrawler
Go-Ahead-Got-It
GoZilla
Go!Zilla
Grabber
Grafula
GrapeFX
GrapeshotCrawler
GridBot
GT::WWW
Hloader
HMView
HTTP::Lite
HTTrack
HybridBot
Iblog
Image Fetch
IndeedBot
InfoNaviRobot
InfoTekies
Intelliseek
InterGET
InternetSeer
ips-agent
Iria
JamesBOT
Jbrofuzz
JennyBot
JikeSpider
Kozmosbot
Lanshanbot
Larbin
LeechGet
LexiBot
Lftp
Lightspeedsystems
LinkWalker
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Lipperhey Spider
LWP::Simple
Magnet
Mag-Net
Mail.RU_Bot
Majestic12
Majestic-SEO
MarkMonitor
Meanpathbot
MeanPath Bot
Mediatoolkitbot
MegaIndex.ru
Metauri
MIDown tool
MJ12bot
Morfeus Fucking Scanner
MSFrontPage
MSIECrawler
Msrabot
MS Web Services Client Protocol
Name Intelligence
Nameprotect
Navroad
Needle
NetAnts
NetLyzer
NetMechanic
Net Vampire
Netvibes
NetZIP
Nikto
NimbleCrawler
Nimbostratus
oBot
Octopus
Openfind
OpenLinkProfiler
OpenVAS
OrangeBot
OrangeSpider
PageScorer
Panscient
Pavuk
PECL::HTTP
PHPCrawl
Pimonster
Pi-Monster
Pixray
POE-Component-Client-HTTP
ProWebWalker
Pump
RankActive
RankActiveLinkBot
RankFlex
RankingBot2
RebelMouse
Recorder
RedesScrapy
ReGet
RocketCrawler
s1z.ru
scan.lol
Scrapy
Screaming
ScreenerBot
Searchestate
Semrush
SemrushBot
SEOkicks
seoscanners
serpstatbot
Siphon
SiteExplorer
SlySearch
Snake
SpaceBison
Spammen
Spanner
sp_auditbot
Spbot
Spinn3r
SputnikBot
Sucuri
SuperHTTP
SurveyBot
Suzuran
Szukacz
tAkeOut
Telesoft
Telesphoreo
The Intraformant
Thumbor
TightTwatBot
Titan
Toata
Tracemyfile
Trendiction
trendiction.com
TwengaBot
Twice
Typhoeus
Upflow
URLy Warning
VCI
VoidEYE
Webalta
WebAuto
Web Auto
WebCollage
WEBDAV
WebEnhancer
Web Fuck
WebGo IS
WebImageCollector
WebPix
WebReaper
Website Quester
Webster
WebStripper
WebZIP
WeSEE
Whack
Whatweb
Who.is Bot
WISENutbot
Wonderbot
Wprecon
WWW-Collector-E
WWW-Mechanize
Xaldon WebSpider
Xaldon_WebSpider
Xenu
xpymep1.exe
YoudaoBot
Zade
zauba.io
zgrab
ZumBot