nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-09-05 10:07:14 +00:00

100 lines
1.1 KiB
Text

ADmantX
AiHitBot
Anarchie
Anarchy
Apexoo
Atomseobot
AwarioRssBot
BDFetch
BacklinkCrawler
BlackWidow
BotALot
Bullseye
CATExplorador
Calculon
CensysInspect
ChinaClaw
Demon
Digincore
DittoSpyder
DnBCrawler-Analytics
DnyzBot
DomainAppender
Express WebPictures
FHscan
FacebookBot
FlashGet
Go-Ahead-Got-It
IRLbot
Id-search
IlseBot
InfoTekies
InfraSec Scanner
InternetSeer
Jbrofuzz
JustView
Leap
LeechGet
Likse
LinkScan
LinkWalker
LinksManager
LinqiaScrapeBot
MQQBrowser
Mail.RU_Bot
Majestic12
MarkMonitor
MeanPath Bot
MegaIndex.ru
Metauri
Microsoft URL Control
Mr.4x3
Net Vampire
NetMechanic
Netvibes
PageAnalyzer
Picscout
Picsearch
PleaseCrawl
QueryN Metasearch
RankingBot2
SEOprofiler
SMTBot
SalesIntelligent
ScanAlert
Scrapy
SentiBot
Siphon
SiteSucker
Snake
Snapbot
Spammen
Spider_Bot/3.0
Suzuran
T0PHackTeam
TightTwatBot
True_Robot
Turnitin
TwengaBot
Upflow
Voltron
WEBDAV
WallpapersHD
Web Enhancer
Web Sauger
Web Sucker
WebFetch
WebsiteQuester
WinHTTrack
WiseGuys Robot
YoudaoBot
Zade
check1.exe
cohere-ai
demandbase-bot
eCatch
heritrix
instabid
internetVista monitor
lwp-request
spyfu