360Spider
404checker
404enemy
80legs
Aboundex
Aboundexbot
Acunetix
ADmantX
Alexibot
Alligator
AllSubmitter
Apexoo
archive.org_bot
ASPSeek
Asterias
AwarioRssBot
AwarioSmartBot
BackDoorBot
BackStreet
BackWeb
Barkrowler
Battleztar Bazinga
BBBike
BDCbot
BetaBot
Bigfoot
Blackboard
Black Hole
BlowFish
Boardreader
Bolt
Brandwatch
Buddy
BuiltWith
BunnySlippers
BuzzSumo
Calculon
CATExplorador
ChinaClaw
Chlooe
coccocbot-web
cognitiveseo
Collector
Copier
Copyscape
Cosmos
Craftbot
crawler4j
Crescent
CrunchBot
Curious
demandbase-bot
Deusu
Devil
Digincore
DIIbot
Dirbuster
Discobot
Discoverybot
Dispatch
DnyzBot
DomainAppender
DomainSigmaCrawler
DomainStatsBot
Download Wonder
Dragonfly
Ebingbong
eCatch
EMail Siphon
Evil
Express WebPictures
ExtLinksBot
Extractor
Ezooms
facebookscraper
FDM
FHscan
Fimap
Freeuploader
FrontPage
Fyrebot
GetWeb
Gigabot
Go!Zilla
GrabNet
GridBot
Haansoft
HaosouSpider
Havij
HEADMasterSEO
HMView
HTMLparser
Humanlinks
HybridBot
Image Fetch
Image Sucker
InfoTekies
instabid
Internet Ninja
InternetSeer
ips-agent
Iria
IRLbot
IstellaBot
Jbrofuzz
JennyBot
JetCar
JustView
Jyxobot
Kenjin Spider
Kozmosbot
Lanshanbot
Larbin
Lftp
LibWeb
LinkextractorPro
LinksManager
LinqiaRSSBot
LinqiaScrapeBot
Lmspider
LNSpiderguy
Ltx71
lwp-request
Mag-Net
magpie-crawler
Majestic12
MarkMonitor
Mata Hari
Mediatoolkitbot
MFC_Tear_Sample
MJ12bot
Mojolicious
MSFrontPage
MSIECrawler
Msrabot
Musobot
Name Intelligence
Nameprotect
Navroad
NearSite
Nessus
NetAnts
netEstate NE Crawler
NetMechanic
Nettrack
Niki-bot
NimbleCrawler
Ninja
Offline Navigator
OnCrawl
Openfind
OpenLinkProfiler
Openvas
OpenVAS
OrangeBot
OutclicksBot
PageScorer
Pandalytics
Panscient
Pavuk
PECL::HTTP
PeoplePal
Picsearch
PictureFinder
Pixray
PleaseCrawl
Pockey
POE-Component-Client-HTTP
QueryN Metasearch
RankActive
RankActiveLinkBot
RankingBot
RankurBot
RealDownload
Recorder
Ripper
Rogerbot
RSSingBot
SalesIntelligent
SBIder
ScanAlert
scan.lol
ScoutJet
Screaming
Searchestate
Semrush
SemrushBot
SEOkicks-Robot
serpstatbot
Shodan
SiteLockSpider
SiteSucker
Sitevigil
Snake
Sociscraper
sogouspider
Sogou web spider
Sosospider
SpaceBison
Spanner
sp_auditbot
Spbot
Sqlmap
Sqlworm
SuperBot
Suzuran
Swiftbot
sysscan
Szukacz
T0PHackTeam
tAkeOut
TeleportPro
Telesphoreo
TheNomad
TightTwatBot
Titan
Toata
Tracemyfile
Trendictionbot
True_Robot
Turingos
TwengaBot
Typhoeus
URLy.Warning
Vacuum
VB Project
VCI
Wallpapers/3.0
WBSearchBot
WebAuto
Web Auto
WEBDAV
WebEnhancer
WebmasterWorldForumBot
WebSauger
Web Sauger
Webshag
Website Quester
WebSucker
WebZIP
WeSEE
Whack
Whacker
Whatweb
WISENutbot
x22Mozilla
Xaldon_WebSpider
Xenu
xpymep1.exe
Zade