404checker
404enemy
ADmantX
ALittle Client
Abonti
AllSubmitter
Alligator
Anarchy99
Ankit
Aspiegel
Atomseobot
Attach
BDCbot
BLEXBot
BackWeb
Barkrowler
Bigfoot
Blow
Boardreader
Bolt
BotALot
Brandprotect
Brandwatch
BuiltBotTough
BunnySlippers
CCBot
Calculon
Cegbfeieh
CheeseBot
Claritybot
Cliqzbot
Cloud mapping
Cogentbot
Collector
Copyscape
Crawling at Home Project
Crescent
CyotekWebCopy
DBLBot
DIIbot
DatabaseDriverMysqli
Devil
Discobot
Dispatch
DittoSpyder
DnBCrawler-Analytics
DnyzBot
DomainAppender
DomainSigmaCrawler
DomainStatsBot
Domains Project
Download Wonder
Dragonfly
Drip
ECCP/1.0
EMail Wolf
EasyDL
Ecxi
Evil
Extractor
ExtractorPro
EyeNetIE
Ezooms
FHscan
FemtosearchBot
Foobot
FyberSpider
Fyrebot
GT::WWW
GalaxyBot
GermCrawler
GetWeb
Gigabot
Go-Ahead-Got-It
GoZilla
Gotit
GrapeshotCrawler
GridBot
HEADMasterSEO
HMView
HTMLparser
HTTP::Lite
Haansoft
HaosouSpider
Harvest
Heritrix
HybridBot
IDBot
IRLbot
Id-search
Image Sucker
Indy Library
InfoTekies
InterGET
Internet Ninja
JamesBOT
JennyBot
Jetty
JikeSpider
Kenjin Spider
LNSpiderguy
LWP::Simple
Lanshanbot
Leap
LexiBot
LibWeb
LieBaoFast
Likse
LinkScan
Linkbot
LinkextractorPro
LinksManager
LinqiaMetadataDownloaderBot
LinqiaRSSBot
LinqiaScrapeBot
Litemage_walker
Lmspider
MFC_Tear_Sample
MQQBrowser
MSFrontPage
Majestic-SEO
Mass Downloader
MauiBot
MeanPath Bot
Meanpathbot
MegaIndex.ru
Metauri
Microsoft URL Control
Mozlila
NICErsPRO
NPbot
Name Intelligence
Nessus
Netcraft
Nettrack
Netvibes
Nikto
NimbleCrawler
Ninja
Nmap
Not
Nuclei
Offline Explorer
Offline Navigator
OrangeBot
OutfoxBot
POE-Component-Client-HTTP
PageScorer
Pi-Monster
Picscout
PictureFinder
Pixray
ProPowerBot
ProWebWalker
Psbot
Pump
RankActive
RankingBot2
ReGet
RealDownload
RebelMouse
Recorder
RepoMonkey
RocketCrawler
SEOkicks
SMTBot
ScoutJet
Searchestate
Semrush
SemrushBot
SentiBot
Siphon
Site Sucker
Sitebeam
Sitevigil
SlySearch
Snoopy
SocialRankIOBot
SpaceBison
Spammen
Spbot
Spinn3r
SputnikBot
Sqlmap
Sqlworm
Sqworm
Sucker
SuperBot
Suzuran
Swiftbot
Teleport
TeleportPro
Titan
TurnitinBot
TwengaBot
UnisterBot
Upflow
V-BOT
VCI
Vacuum
VeriCiteCrawler
WWWOFFLE
WallpapersHD
Web Fuck
Web Sucker
WebAuto
WebCopier
WebFetch
WebFuck
WebGo IS
WebSucker
WebWhacker
Webalta
Webster
Whacker
Wonderbot
Zade
Zauba
Zermelo
Zeus
Zitebot
ZoomBot
ZoominfoBot
ZyBorg
adscanner
archive.org_bot
arquivo-web-crawler
arquivo.pt
autoemailspider
cah.io.community
coccocbot
crawler4j
dataforseo.com
eCatch
instabid
isitwp.com
lwp-request
lwp-trivial
meanpathbot
page scorer
polaris version
ripz
seobility
seoscanners
sysscan
tAkeOut
trendiction.de
ubermetrics-technologies.com
voyagerx.com
zgrab