360Spider
404enemy
Aboundex
Aboundexbot
AIBOT
AiHitBot
Alexibot
AlphaBot
Apexoo
ASPSeek
autoemailspider
Backlink-Ceck
backlink-check
BackWeb
BBBike
BDCbot
BetaBot
Bigfoot
Bitacle
BlowFish
BunnySlippers
Calculon
CazoodleBot
Cegbfeieh
ChinaClaw
Claritybot
Cliqzbot
cognitiveseo
com.plumanalytics
Craftbot
CrunchBot
Curious
DBLBot
demandbase-bot
Demon
DIIbot
Disco
DittoSpyder
DnyzBot
DomainAppender
DomainSigmaCrawler
DomainStatsBot
Dragonfly
DSearch
DTS Agent
Ebingbong
EirGrabber
Evil
Extreme Picture Finder
EyeNetIE
facebookscraper
FDM
FemtosearchBot
Firefox/7.0
Foobot
Fyrebot
Genieo
Gigabot
G-i-g-a-b-o-t
GrapeshotCrawler
GridBot
GT::WWW
Haansoft
Havij
HEADMasterSEO
HTTrack
Iblog
IDBot
Id-search
IlseBot
Image Fetch
Image Sucker
InterGET
ips-agent
Iria
Jbrofuzz
Jetty
JOC Web Spider
Joomla
Kenjin Spider
Keyword Density
Kozmosbot
Larbin
LeechFTP
Lftp
Libwhisker
Lightspeedsystems
Linkdexbot
LinkextractorPro
LinkScan
LinksManager
LinkWalker
Lipperhey
Litemage_walker
Lmspider
Ltx71
lwp-trivial
Majestic12
Majestic SEO
MarkMonitor
MarkWatch
Masscan
Mass Downloader
MauiBot
meanpathbot
Meanpathbot
Mediatoolkitbot
mediawords
Metauri
MFC_Tear_Sample
Microsoft URL Control
MIIxpc
Morfeus Fucking Scanner
MSFrontPage
Msrabot
MS Web Services Client Protocol
Musobot
Nameprotect
Navroad
NearSite
Needle
Nessus
Netcraft
NetMechanic
NetSpider
Nettrack
NextGenSearchBot
Niki-bot
Nikto
Ninja
NPbot
Nutch
Octopus
Offline Explorer
Openvas
OrangeBot
OutclicksBot
PageGrabber
page scorer
Pandalytics
Pavuk
PECL::HTTP
PHPCrawl
Picsearch
PictureFinder
Pixray
plumanalytics
ProWebWalker
Psbot
Pump
PxBroker
RankActiveLinkBot
RankingBot
RankurBot
RealDownload
Reaper
RebelMouse
Recorder
RedesScrapy
RepoMonkey
Ripper
Rogerbot
s1z.ru
SBIder
ScanAlert
Scanbot
Scrapy
Screaming
Semrush
SemrushBot
SEOprofiler
serpstatbot
Shodan
SISTRIX
SiteExplorer
Siteimprove
SiteSucker
Sitevigil
SmartDownload
Snake
Snapbot
Snoopy
SocialRankIOBot
sogouspider
SpankBot
sp_auditbot
Spbot
Spinn3r
SputnikBot
spyfu
Steeler
Stripper
Sucker
Sucuri
Surfbot
sysscan
T0PHackTeam
tAkeOut
Teleport
Telesphoreo
TheNomad
TightTwatBot
Toweyabot
Tracemyfile
Trendiction
True_Robot
Turingos
Turnitin
TurnitinBot
TwengaBot
UnisterBot
Upflow
URLy.Warning
Vagabondo
VB Project
VCI
VoidEYE
WallpapersHD
WASALive-Bot
WBSearchBot
Webalta
WebAuto
WebBandit
Web Collage
WebFetch
Web Fetch
Web Fuck
webmeup-crawler
WebPix
Web Pix
WebReaper
Web Sauger
WebsiteQuester
Website Quester
Webster
WebSucker
WebZIP
Whack
Whatweb
Who.is Bot
WISENutbot
Wonderbot
Woobot
WWW-Mechanize
WWW::Mechanize
Xaldon WebSpider
Zauba
zauba.io
zgrab
ZmEu