nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2025-02-15 22:07:44 +00:00

100 lines
1 KiB
Text

Aboundex
Anarchie
Anthill
BDFetch
BacklinkCrawler
Badass
Bandit
Calculon
CheTeam
CherryPicker
Collector
CyotekWebCopy
DBLBot
DIIbot
DSearch
DataCha0s
DomCopBot
DomainSigmaCrawler
Dragonfly
Drip
Ecxi
Evil
Extreme Picture Finder
FHscan
FemtosearchBot
Fimap
Fuzz
GT::WWW
GrabNet
GridBot
Hloader
Humanlinks
HybridBot
IRLbot
Indy Library
Information Security Team InfraSec Scanner
Iria
JOC Web Spider
Joomla
Leap
LeechFTP
LibWeb
Linkbot
Lipperhey Spider
Majestic SEO
Mata Hari
Minefield
Moblie Safari
MolokaiBot
NetAnts
NetMechanic
NetZIP
Netcraft
NextGenSearchBot
Niki-bot
Ninja
OpenLinkProfiler
Openvas
OutfoxBot
Panscient
Pavuk
PeoplePal
Pi-Monster
RankActiveLinkBot
RankingBot2
RankurBot
Re-re
RedesScrapy
SEOprofiler
ScoutJet
Searchestate
SemrushBot-SI
SemrushBot-SWA
Snake
Sociscraper
Sosospider
SpankBot
Szukacz
Twice
UnisterBot
Upflow
V-BOT
VelenPublicWebCrawler
Voltron
WISENutbot
Web Collage
Web Sucker
WebAuto
WebCopier
WebWhacker
Wprecon
Xenu
Zitebot
archive.org_bot
crawl.sogou.com
dataforseobot
ips-agent
meanpathbot
muhstik-scan
x09Mozilla