360Spider
404checker
404enemy
80legs
Aboundex
ADmantX
AiHitBot
Alexibot
Alligator
Anarchie
archive.org_bot
ASPSeek
autoemailspider
backlink-check
BacklinkCrawler
BackStreet
Bandit
Barkrowler
BatchFTP
Battleztar Bazinga
BBBike
BDFetch
Blackboard
BlackWidow
Blow
BlowFish
Calculon
CazoodleBot
CCBot
CherryPicker
CheTeam
ChinaClaw
Claritybot
Cliqzbot
Cloud mapping
coccocbot-web
com.plumanalytics
Copier
CopyRightCheck
crawl.sogou.com
CrunchBot
CSHttp
Curious
Custo
DataCha0s
DBLBot
demandbase-bot
Demon
Digincore
DigitalPebble
DIIbot
Disco
DittoSpyder
DnyzBot
DomainCrawler
Dotbot
Dragonfly
Drip
ECCP/1.0
EirGrabber
EMail Siphon
EMail Wolf
EroCrawler
Express WebPictures
facebookscraper
FDM
FHscan
Freeuploader
FyberSpider
Fyrebot
Genieo
GermCrawler
Getintent
GetRight
Gigablast
G-i-g-a-b-o-t
Go!Zilla
GrapeshotCrawler
GridBot
HaosouSpider
Harvest
Havij
Heritrix
HTTP::Lite
Humanlinks
Id-search
IlseBot
Image Sucker
InfoNaviRobot
instabid
InternetSeer
IRLbot
JamesBOT
JennyBot
JetCar
Jetty
JustView
Kenjin Spider
Kozmosbot
Larbin
Lftp
LibWeb
Libwhisker
Lightspeedsystems
Likse
LinksManager
LinkWalker
Lipperhey Spider
Ltx71
Magnet
Mag-Net
magpie-crawler
Mail.RU_Bot
Majestic SEO
Majestic-SEO
MarkMonitor
Mass Downloader
MeanPath Bot
Mediatoolkitbot
MFC_Tear_Sample
MIIxpc
Mojeek
Morfeus Fucking Scanner
MSIECrawler
MS Web Services Client Protocol
muhstik-scan
Musobot
Name Intelligence
NetAnts
netEstate NE Crawler
Netvibes
NextGenSearchBot
Ninja
Nmap
Nutch
Offline Navigator
OpenLinkProfiler
OrangeBot
OutfoxBot
Panscient
Papa Foto
Pavuk
PECL::HTTP
PeoplePal
Picscout
Pi-Monster
Pixray
Pockey
ProWebWalker
Pump
PxBroker
PyCurl
RankFlex
Reaper
RebelMouse
Recorder
ReGet
RepoMonkey
RocketCrawler
Rogerbot
SalesIntelligent
SBIder
ScanAlert
Screaming
SEOkicks
SEOkicks-Robot
SEOprofiler
SeoSiteCheckup
SEOstats
Shodan
Siphon
Siteimprove
SiteLockSpider
SiteSucker
Sitevigil
SmartDownload
SMTBot
SocialRankIOBot
sogouspider
Sogou web spider
Sosospider
SpaceBison
Spanner
Spbot
Spinn3r
spyfu
Steeler
Stripper
SuperBot
Suzuran
sysscan
T0PHackTeam
T8Abot
Teleport
TeleportPro
Telesoft
Telesphoreo
Telesphorep
The Intraformant
TightTwatBot
Titan
Toata
Toweyabot
Tracemyfile
trendiction.de
True_Robot
Turingos
TwengaBot
Twice
Upflow
URLy Warning
URLy.Warning
Vacuum
Vagabondo
VCI
Virusdie
VoidEYE
Voil
Web Auto
WebBandit
Web Collage
WebEnhancer
WebFuck
WebImageCollector
WebLeacher
WebmasterWorldForumBot
WebSauger
WebsiteQuester
Webster
Web Sucker
WebZIP
Whack
Whacker
Whatweb
Who.is Bot
Widow
WiseGuys Robot
WISENutbot
Wonderbot
Wotbox
WPScan
WWW-Collector-E
WWW-Mechanize
WWWOFFLE
x22Mozilla
Xaldon_WebSpider
Xenu
xpymep1.exe
YoudaoBot
ZumBot