nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-05-14 22:04:46 +00:00

100 lines
1.1 KiB
Text

404checker
80legs
Aboundexbot
Anarchie
Apexoo
Attach
Barkrowler
Blackboard
Blow
BotALot
CODE87
CSHttp
ChatGPT-User
Crawling at Home Project
CrazyWebCrawler
DIIbot
DataCha0s
Dirbuster
Disco
Download Wonder
Ebingbong
Ecxi
ExtractorPro
Fuzz
GetWeb
GoZilla
Google-Extended
Id-search
Intelliseek
InternetSeer
Iria
JOC Web Spider
JetCar
Keyword Density
Larbin
Libwhisker
LinqiaMetadataDownloaderBot
MIIxpc
Mail.RU_Bot
Mb2345Browser
Mister PiX
Name Intelligence
Nameprotect
NearSite
Needle
NetAnts
Offline Navigator
OpenLinkProfiler
Openvas
PHPCrawl
POE-Component-Client-HTTP
PageScorer
Pavuk
Pi-Monster
Picsearch
Piepmatz
Pixray
ProPowerBot
ProWebWalker
Probethenet
Psbot
PxBroker
Quick-Crawler
RankFlex
RedesScrapy
SEOlyticsCrawler
SearchmetricsBot
SeekportBot
Sociscraper
Sogou web spider
SpaceBison
Spbot
Spinn3r
SputnikBot
Sucuri
SuperBot
Suzuran
Titan
True_Robot
Turnitin
TwengaBot
VoidEYE
Web Auto
WebCopier
WebGo IS
WebSauger
Whack
Who.is Bot
Wotbox
Zermelo
Zeus
ZyBorg
facebookscraper
gopher
iubenda-radar
linkdexbot
netEstate NE Crawler
s1z.ru
seocompany.store
ubermetrics-technologies.com