404checker
404enemy
Aboundexbot
Acunetix
ADmantX
AIBOT
Aipbot
Alligator
AlphaBot
Anarchie
Apexoo
archive.org_bot
ASPSeek
Attach
Backlink-Ceck
BackStreet
Badass
Bandit
Battleztar Bazinga
BDCbot
BetaBot
Blackboard
BlackWidow
BLEXBot
Blow
Boardreader
BotALot
Buddy
BuzzSumo
CATExplorador
CazoodleBot
Cegbfeieh
CheeseBot
CherryPicker
CheTeam
Chlooe
Claritybot
coccocbot-web
Cocolyzebot
com.plumanalytics
Copier
CopyRightCheck
Cosmos
crawler.feedback
crawl.sogou.com
CyotekWebCopy
DatabaseDriverMysqli
DBLBot
Deusu
Devil
DigitalPebble
DIIbot
Discoverybot
DnyzBot
DomainCrawler
DomainSigmaCrawler
domainsproject.org
Dotbot
Download Wonder
Dragonfly
Drip
Ebingbong
ECCP/1.0
Evil
Extractor
ExtractorPro
facebookscraper
FDM
Fimap
Firefox/7.0
FlashGet
Fuzz
Fyrebot
GalaxyBot
GermCrawler
Getintent
Gigablast
Gigabot
Go-Ahead-Got-It
Grabber
GrabNet
GrapeFX
Haansoft
HaosouSpider
HEADMasterSEO
heritrix
Hloader
HTMLparser
HTTP::Lite
HTTrack
HybridBot
Iblog
IDBot
IDBTE4M
Id-search
IlseBot
IndeedBot
Indy Library
InfoNaviRobot
InfoTekies
Intelliseek
InternetSeer
Iria
IstellaBot
JamesBOT
JennyBot
Kenjin Spider
Kozmosbot
Lanshanbot
LexiBot
LieBaoFast
Likse
LinkextractorPro
LinkpadBot
LinkWalker
LinqiaMetadataDownloaderBot
LinqiaRSSBot
LinqiaScrapeBot
LNSpiderguy
lwp-trivial
magpie-crawler
Mail.RU_Bot
Majestic-SEO
Mata Hari
MauiBot
mediawords
Metauri
Microsoft URL Control
Mister PiX
MJ12bot
Mozlila
Mr.4x3
MSFrontPage
MSIECrawler
Msrabot
Musobot
NearSite
Needle
Netvibes
NetZIP
NICErsPRO
Nuclei
OnCrawl
Openfind
OpenLinkProfiler
OpenVAS
OrangeBot
OrangeSpider
OutclicksBot
PageGrabber
PageThing.com
Pavuk
PeoplePal
Petalbot
PHPCrawl
Picsearch
Piepmatz
Pimonster
Pixray
plumanalytics
polaris version
Psbot
PxBroker
PyCurl
QueryN Metasearch
RankActive
RankActiveLinkBot
Rankivabot
Reaper
Recorder
RedesScrapy
RepoMonkey
RocketCrawler
RSSingBot
Scanbot
Scrapy
ScreenerBot
Semrush
SemrushBot
SentiBot
SEOkicks
Seomoz
SEOprofiler
serpstatbot
SISTRIX
Sitebeam
Siteimprove
Site Sucker
SMTBot
Snake
Snoopy
Sogou web spider
Sosospider
Spammen
Sqlmap
Sucker
Swiftbot
sysscan
T0PHackTeam
T8Abot
tAkeOut
Teleport
The Intraformant
TightTwatBot
Titan
Trendiction
Trendictionbot
True_Robot
Turnitin
TwengaBot
Typhoeus
URLy Warning
URLy.Warning
VeriCiteCrawler
VidibleScraper
Virusdie
VoidEYE
Voil
Voltron
WallpapersHD
WASALive-Bot
Webalta
Web Auto
Web Enhancer
WebFuck
WebImageCollector
WebmasterWorldForumBot
WebPix
Web Sauger
WebSucker
WebWhacker
WebZIP
Whacker
Who.is Bot
Widow
WISENutbot
Wonderbot
WPScan
WWW-Collector-E
WWW-Mechanize
x09Mozilla
x22Mozilla
Xaldon WebSpider
Xaldon_WebSpider
YoudaoBot
Zade
Zauba
Zeus
Zitebot
ZmEu