404checker
80legs
AIBOT
ALittle Client
ASPSeek
Aboundex
Aboundexbot
AhrefsBot
Anarchy
Apexoo
Asterias
Atomseobot
Attach
BBBike
BDCbot
BDFetch
BLEXBot
BackDoorBot
BackStreet
Bandit
Battleztar Bazinga
BetaBot
Black Hole
Blackboard
Brandprotect
BuzzSumo
CODE87
Calculon
ChinaClaw
Cliqzbot
Cloud mapping
Cocolyzebot
Cogentbot
Collector
Copier
Curious
CyotekWebCopy
DBLBot
DIIbot
Deusu
Disco
Discobot
DittoSpyder
DomCopBot
DomainSigmaCrawler
Domains Project
Dragonfly
Drip
EasyDL
Ecxi
EroCrawler
Evil
Exabot
Express WebPictures
Ezooms
FHscan
FemtosearchBot
Fimap
Firefox/7.0
Foobot
Fyrebot
GT::WWW
GalaxyBot
Genieo
GermCrawler
GetWeb
Go!Zilla
GrabNet
Grafula
GrapeshotCrawler
HEADMasterSEO
HMView
HTMLparser
HTTrack
HaosouSpider
Hloader
HonoluluBot
IDBTE4M
Iblog
Id-search
IlseBot
Image Fetch
Image Sucker
IndeedBot
Intelliseek
Iria
IstellaBot
JamesBOT
JikeSpider
Joomla
JustView
Kenjin Spider
Kinza
Kozmosbot
LNSpiderguy
LexiBot
LibWeb
LieBaoFast
LinkWalker
LinkpadBot
LinqiaRSSBot
Ltx71
MIDown tool
MIIxpc
MJ12bot
MSFrontPage
Mag-Net
Mail.RU_Bot
Majestic SEO
Majestic12
MarkMonitor
Mb2345Browser
MicroMessenger
Microsoft Data Access
Minefield
Mister PiX
Morfeus Fucking Scanner
NICErsPRO
Nameprotect
Navroad
NearSite
NetLyzer
NetZIP
Nettrack
Netvibes
Nibbler
Nimbostratus
Nmap
Offline Navigator
Openvas
PHPCrawl
POE-Component-Client-HTTP
Panscient
Papa Foto
Picscout
Pixray
PleaseCrawl
ProPowerBot
Probethenet
PyCurl
RSSingBot
RankActive
RankActiveLinkBot
RankingBot
RankingBot2
Rankivabot
Reaper
RebelMouse
RepoMonkey
Ripper
SBIder
SEOkicks-Robot
SEOprofiler
SMTBot
ScreenerBot
ScrepyBot
Searchestate
SearchmetricsBot
SemanticJuice
Semrush
Shodan
SiteLockSpider
SiteSucker
Siteimprove
Sitevigil
SlySearch
SmartDownload
Snapbot
Snoopy
Sociscraper
Sottopop
SpaceBison
Spammen
Spanner
Spbot
SputnikBot
Sqlworm
Sqworm
Steeler
Sucker
SuperHTTP
SurveyBot
T8Abot
Teleport
TeleportPro
Telesoft
Telesphoreo
TightTwatBot
Titan
Toweyabot
Tracemyfile
Turingos
TurnitinBot
TwengaBot
Typhoeus
UnisterBot
VCI
VeriCiteCrawler
VidibleScraper
VoidEYE
Voil
Voltron
WASALive-Bot
WPScan
WWWOFFLE
Wallpapers
Web Collage
Web Fuck
Web Pix
WebBandit
WebCollage
WebCopier
WebEnhancer
WebFuck
WebWhacker
Webshag
Webster
Whacker
Who.is Bot
Widow
Woobot
Wprecon
Xaldon_WebSpider
Xenu
YoudaoBot
Zade
Zauba
Zermelo
ZumBot
adscanner
archive.org_bot
check1.exe
crawler4j
demandbase-bot
gopher
linkdexbot
lwp-request
meanpathbot
plumanalytics
satoristudio.net
seocompany.store
seostar
sitechecker.pro
siteripz
spyfu
tAkeOut
webmeup-crawler
webprosbot
x09Mozilla
zgrab