404checker
404enemy
ADmantX
ASPSeek
Aboundexbot
AfD-Verbotsverfahren
AiHitBot
Aipbot
AlphaBot
Anarchie
Ankit
Apexoo
Asterias
BDCbot
BackStreet
BacklinkCrawler
Badass
Bigfoot
Boardreader
BotALot
Brandprotect
BuiltWith
BunnySlippers
BuzzSumo
CODE87
CSHttp
Calculon
Cegbfeieh
CensysInspect
Cliqzbot
Cogentbot
Collector
CopyRightCheck
Craftbot
Crawling at Home Project
Crescent
CrunchBot
Custo
CyotekWebCopy
DTS Agent
Devil
Digincore
Dirbuster
DittoSpyder
DomainAppender
DomainCrawler
DomainSigmaCrawler
DomainStatsBot
Dotbot
Download Wonder
Dragonfly
ECCP/1.0
EMail Siphon
EasyDL
Exabot
EyeNetIE
Ezooms
FDM
Fimap
FlashGet
Flunky
Foobot
FyberSpider
Fyrebot
G-i-g-a-b-o-t
Gotit
GrapeFX
HEADMasterSEO
HTMLparser
HTTrack
HaosouSpider
Harvest
IDBTE4M
IDBot
Iblog
Image Sucker
InfoTekies
Intelliseek
InternetSeer
Iria
JamesBOT
Jbrofuzz
Jetty
JikeSpider
Kinza
Kozmosbot
Larbin
LeechFTP
LexiBot
LibWeb
LieBaoFast
Linkbot
LinqiaMetadataDownloaderBot
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey
Litemage_walker
Ltx71
MFC_Tear_Sample
MIDown tool
MSFrontPage
MTRobot
Mail.RU_Bot
Majestic12
Masscan
Mb2345Browser
MeanPath Bot
Metauri
Microsoft Data Access
Minefield
Moblie Safari
Nameprotect
Navroad
NearSite
Net Vampire
NetMechanic
NetZIP
Netcraft
Nettrack
Netvibes
NextGenSearchBot
Nibbler
Niki-bot
NimbleCrawler
Nimbostratus
Ninja
Nuclei
Offline Explorer
Openfind
OrangeBot
POE-Component-Client-HTTP
Page Analyzer
PageAnalyzer
PageGrabber
PageScorer
Pandalytics
Pimonster
Probethenet
RankFlex
Rankivabot
Re-re
RealDownload
Reaper
SBIder
SEOkicks
ScanAlert
ScreenerBot
Semrush
SemrushBot
SentiBot
Shodan
Siteimprove
Sitevigil
SlySearch
Snapbot
Snoopy
Sogou web spider
SpankBot
Spinn3r
Sqworm
Steeler
Stripper
Sucuri
SuperHTTP
Surfbot
Suzuran
T0PHackTeam
T8Abot
Telesoft
Telesphoreo
Telesphorep
Thumbor
Toata
Tracemyfile
Trendiction
Trendictionbot
Turingos
Turnitin
TurnitinBot
TwengaBot
Typhoeus
URLy Warning
UnisterBot
Vacuum
VelenPublicWebCrawler
VeriCiteCrawler
Virusdie
Voltron
WASALive-Bot
WWW::Mechanize
WWWOFFLE
WallpapersHD
Web Auto
Web Pix
Web Sauger
Web Sucker
WebEnhancer
WebImageCollector
WebReaper
WebStripper
Webalta
WebmasterWorldForumBot
Webshag
Whack
Whacker
Who.is Bot
Widow
Wprecon
Zauba
Zermelo
Zeus
Zitebot
ZmEu
ZoomBot
ZumBot
adscanner
archive.org_bot
arquivo.pt
clark-crawler
coccocbot
cognitiveseo
crawler.feedback
crawler4j
demandbase-bot
eCatch
heritrix
ips-agent
iubenda-radar
linkdexbot
lwp-request
lwp-trivial
magpie-crawler
oBot
page scorer
polaris version
ripz
s1z.ru
scalaj-http
scan.lol
sexsearcher
sitechecker.pro
sogouspider
sp_auditbot
trendiction.com
ubermetrics-technologies.com
voyagerx.com
webgains-bot
webprosbot
x09Mozilla
x22Mozilla