360Spider
404checker
Abonti
Aboundex
Aboundexbot
ADmantX
AIBOT
Aipbot
AllSubmitter
AlphaBot
Apexoo
Asterias
BackStreet
BackWeb
Barkrowler
Battleztar Bazinga
BDCbot
Bigfoot
Bitacle
Blow
BlowFish
BotALot
Brandwatch
BuiltBotTough
BunnySlippers
BuzzSumo
CCBot
Cegbfeieh
CherryPicker
ChinaClaw
Chlooe
Cogentbot
cognitiveseo
CopyRightCheck
Craftbot
crawler4j
crawl.sogou.com
CrunchBot
CSHttp
Curious
DatabaseDriverMysqli
DBLBot
Demon
Devil
DIIbot
Dirbuster
Discobot
Dispatch
DittoSpyder
DomainAppender
DomainStatsBot
Download Wonder
DTS Agent
eCatch
EMail Wolf
evc-batch
Express WebPictures
ExtLinksBot
ExtractorPro
Extreme Picture Finder
facebookscraper
FHscan
Fimap
Foobot
Freeuploader
FyberSpider
Fyrebot
GetRight
Gigabot
G-i-g-a-b-o-t
GrabNet
Grafula
GrapeshotCrawler
GT::WWW
HaosouSpider
Heritrix
Hloader
HMView
HTTrack
IDBot
IndeedBot
Indy Library
instabid
Intelliseek
Internet Ninja
InternetSeer
ips-agent
Iria
IRLbot
IstellaBot
Jbrofuzz
JetCar
Jetty
JOC Web Spider
Joomla
Jyxobot
Keyword Density
Lanshanbot
Larbin
LeechGet
LexiBot
LibWeb
Libwhisker
Lightspeedsystems
Likse
LinkextractorPro
LinkpadBot
LinkScan
Lipperhey
Lipperhey Spider
lwp-request
LWP::Simple
magpie-crawler
Majestic-SEO
MarkWatch
Masscan
Mata Hari
meanpathbot
mediawords
Microsoft Data Access
Microsoft URL Control
MIIxpc
Mister PiX
Morfeus Fucking Scanner
Mr.4x3
MSFrontPage
MSIECrawler
Msrabot
Musobot
Nameprotect
NearSite
Needle
Nessus
NetLyzer
NetSpider
Nettrack
NextGenSearchBot
Nibbler
Ninja
oBot
Offline Explorer
OnCrawl
Openfind
Openvas
OrangeBot
OrangeSpider
Page Analyzer
PageGrabber
PageScorer
Pandalytics
Panscient
Papa Foto
pcBrowser
PECL::HTTP
PeoplePal
Picscout
PictureFinder
Pixray
plumanalytics
POE-Component-Client-HTTP
Probethenet
ProPowerBot
Psbot
PxBroker
Quick-Crawler
RankActive
RankFlex
RankingBot
Rankivabot
RankurBot
RealDownload
Reaper
ReGet
RepoMonkey
Ripper
Rogerbot
s1z.ru
Scanbot
scan.lol
ScoutJet
Screaming
Semrush
SEOkicks-Robot
SEOprofiler
seoscanners
sexsearcher
Sitebeam
Sitevigil
SlySearch
Snapbot
Snoopy
Sociscraper
Spanner
sp_auditbot
SputnikBot
spyfu
Sqlmap
Sqlworm
Steeler
Sucker
Sucuri
SuperBot
SuperHTTP
Suzuran
Swiftbot
T0PHackTeam
tAkeOut
Teleport
Toata
Tracemyfile
Trendiction
Trendictionbot
True_Robot
Turingos
TurnitinBot
TwengaBot
Typhoeus
UnisterBot
URLy.Warning
VB Project
Virusdie
WASALive-Bot
WBSearchBot
WEBDAV
Web Enhancer
WebImageCollector
WebmasterWorldForumBot
webmeup-crawler
Web Pix
WebReaper
Web Sauger
Webshag
WebsiteExtractor
WebsiteQuester
Website Quester
WebSucker
WeSEE
Who.is Bot
Woobot
Wotbox
Wprecon
WWWOFFLE
Xaldon WebSpider
Xaldon_WebSpider
xpymep1.exe
YoudaoBot
zauba.io
Zeus
ZmEu
ZyBorg