nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-04-28 10:07:23 +00:00

100 lines
1.1 KiB
Text

80legs
Acunetix
AfD-Verbotsverfahren
Asterias
Atomseobot
Attach
AwarioSmartBot
BackWeb
Battleztar Bazinga
BetaBot
Boardreader
BuiltWith
CheeseBot
CherryPicker
Cosmos
Craftbot
Crawling at Home Project
CrunchBot
CyotekWebCopy
Dragonfly
EasyDL
ExtLinksBot
FlashGet
Foobot
Grafula
GrapeshotCrawler
HTTrack
Havij
Id-search
Iria
JOC Web Spider
Keybot Translation-Search-Machine
LNSpiderguy
LWP::Simple
LinqiaRSSBot
MIDown tool
Majestic-SEO
MarkWatch
Meanpathbot
Mr.4x3
Name Intelligence
Nameprotect
NetLyzer
NetSpider
NetZIP
Nibbler
Ninja
OpenLinkProfiler
Openvas
OutclicksBot
POE-Component-Client-HTTP
Pu_iN
Quick-Crawler
RankActive
RankingBot2
Rankivabot
RankurBot
Re-re
RealDownload
Recorder
RedesScrapy
Ripper
SemrushBot
Sitebeam
Sogou web spider
Sosospider
SpankBot
Sqworm
Sucker
Suzuran
Telesoft
The Intraformant
TheNomad
Trendiction
Turingos
V-BOT
VB Project
Vacuum
VelenPublicWebCrawler
VeriCiteCrawler
Voltron
WASALive-Bot
WallpapersHD
Web Auto
WebImageCollector
WebPix
ZoomBot
adscanner
archive.org_bot
com.plumanalytics
crawl.sogou.com
domainsproject.org
gopher
ips-agent
page scorer
seoscanners
trendiction.de
ubermetrics-technologies.com
webgains-bot
xpymep1.exe