nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-05-21 22:04:49 +00:00

100 lines
1 KiB
Text

ALittle Client
Alligator
Apexoo
Bandit
Battleztar Bazinga
BetaBot
Bytespider
CheeseBot
CherryPicker
Citoid
Curious
DIIbot
Discoverybot
DittoSpyder
Domains Project
Dragonfly
EasyDL
Evil
Express WebPictures
Extractor
ExtractorPro
FemtosearchBot
Foobot
Getintent
Google-Extended
Grabber
Grafula
IRLbot
InfoTekies
Jbrofuzz
JetCar
Kenjin Spider
Keyword Density
LWP::Simple
Linkbot
LinkpadBot
Litemage_walker
MIIxpc
Majestic SEO
MarkMonitor
Meanpathbot
Mojolicious
Msrabot
NetSpider
Netcraft
Netvibes
NextGenSearchBot
Niki-bot
Openfind
OrangeBot
OrangeSpider
PECL::HTTP
Pandalytics
Panscient
QueryN Metasearch
RankurBot
SMTBot
Searchestate
SeekportBot
SemanticJuice
Semrush
SemrushBot
Shodan
Site Sucker
SiteSnagger
SlySearch
Snake
Spinn3r
Sucker
SuperBot
SuperHTTP
Suzuran
Twice
Vagabondo
VoidEYE
WISENutbot
WWW-Collector-E
WallpapersHD
Web Enhancer
Web Pix
WebCopier
WebReaper
WebStripper
WebWhacker
Webshag
WinHTTrack
Wprecon
YoudaoBot
ZoominfoBot
ZumBot
adscanner
cognitiveseo
eCatch
instabid
ips-agent
isitwp.com
page scorer
polaris version
satoristudio.net
x09Mozilla