404enemy
Aboundexbot
Acunetix
ADmantX
AIBOT
Alexibot
AlphaBot
arquivo.pt
arquivo-web-crawler
Attach
AwarioRssBot
BackDoorBot
backlink-check
BackStreet
Bandit
Battleztar Bazinga
BBBike
BLEXBot
Blow
BotALot
Brandprotect
Brandwatch
Bullseye
BunnySlippers
BuzzSumo
Cegbfeieh
CherryPicker
CheTeam
Cliqzbot
coccocbot-web
Cogentbot
cognitiveseo
Collector
com.plumanalytics
Copier
Copyscape
Cosmos
Craftbot
crawler.feedback
crawl.sogou.com
DatabaseDriverMysqli
DataCha0s
DBLBot
Demon
Deusu
Devil
Digincore
DIIbot
Dirbuster
DittoSpyder
domainsproject.org
Download Wonder
Dragonfly
Drip
DTS Agent
EasyDL
ECCP/1.0
EirGrabber
Evil
Exabot
Extractor
Extreme Picture Finder
Ezooms
facebookscraper
FemtosearchBot
FHscan
Fimap
Flunky
Foobot
Fyrebot
GalaxyBot
Getintent
Gigablast
Go-Ahead-Got-It
Go!Zilla
Grabber
Grafula
GrapeFX
GrapeshotCrawler
GridBot
GT::WWW
Haansoft
heritrix
Heritrix
HMView
HTTP::Lite
HTTrack
Humanlinks
IlseBot
IndeedBot
InfoNaviRobot
InternetSeer
internetVista monitor
ips-agent
Jbrofuzz
Jetty
JikeSpider
Jorgee
Kenjin Spider
Lanshanbot
LeechFTP
LexiBot
Libwhisker
LieBaoFast
Likse
Linkdexbot
LinkextractorPro
LinkScan
LinqiaScrapeBot
Lipperhey
Lipperhey Spider
Lmspider
LNSpiderguy
Ltx71
LWP::Simple
Magnet
Mag-Net
Mail.RU_Bot
Majestic SEO
Majestic-SEO
MarkMonitor
Mass Downloader
MauiBot
MegaIndex.ru
Microsoft Data Access
MIIxpc
Mister PiX
Mojeek
Mojolicious
MQQBrowser
Mr.4x3
MSFrontPage
Msrabot
Name Intelligence
Nameprotect
Navroad
NearSite
netEstate NE Crawler
NetSpider
Nettrack
Netvibes
NetZIP
Nibbler
NICErsPRO
Niki-bot
Nutch
OnCrawl
OpenLinkProfiler
OPPO A33
OrangeSpider
OutfoxBot
PageAnalyzer
page scorer
Panscient
Pavuk
pcBrowser
PeoplePal
PHPCrawl
Picsearch
PictureFinder
Pimonster
Pi-Monster
plumanalytics
Pockey
Probethenet
ProPowerBot
ProWebWalker
Psbot
PxBroker
RankActive
RankFlex
RankingBot2
Reaper
Recorder
RepoMonkey
RSSingBot
s1z.ru
SalesIntelligent
ScreenerBot
SearchmetricsBot
SemrushBot
Seomoz
SeoSiteCheckup
serpstatbot
Shodan
Siphon
SISTRIX
Siteimprove
Site Sucker
Sitevigil
SocialRankIOBot
Sociscraper
Sogou web spider
Sottopop
SpaceBison
SpankBot
Spanner
Spbot
Sqworm
Steeler
Stripper
SurveyBot
Swiftbot
sysscan
TeleportPro
Telesphoreo
TheNomad
Trendictionbot
trendiction.com
trendiction.de
True_Robot
Turnitin
TurnitinBot
Typhoeus
URLy.Warning
Vagabondo
VCI
VidibleScraper
VoidEYE
WBSearchBot
Webalta
WebAuto
Web Auto
WebCollage
Web Collage
Web Enhancer
WebFuck
Web Fuck
WebLeacher
WebmasterWorldForumBot
webmeup-crawler
Webshag
WebsiteExtractor
WebZIP
Whack
Whatweb
WinHTTrack
WISENutbot
Woobot
WPScan
WWW-Collector-E
WWW::Mechanize
WWWOFFLE
x22Mozilla
YoudaoBot
zauba.io
Zermelo
Zitebot
ZmEu
ZyBorg