nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-12-10 10:08:11 +00:00

100 lines
996 B
Text

404checker
404enemy
ADmantX
ASPSeek
AlphaBot
BDCbot
BackWeb
Barkrowler
BlackWidow
Blackboard
Blow
BotALot
Brandwatch
BuzzSumo
CCBot
Chlooe
Crescent
Disco
Discobot
DomCopBot
DomainCrawler
EirGrabber
Ezooms
Firefox/7.0
Fuzz
Fyrebot
GalaxyBot
GetRight
GetWeb
Gotit
GrabNet
GrapeFX
GridBot
Havij
Hloader
IDBTE4M
Iblog
Indy Library
InfoNaviRobot
Iria
JOC Web Spider
Jbrofuzz
JustView
LWP::Simple
LieBaoFast
LinqiaMetadataDownloaderBot
LinqiaRSSBot
Masscan
Mojeek
Musobot
NPbot
NetAnts
PECL::HTTP
PageScorer
Panscient
Pavuk
Pi-Monster
PleaseCrawl
ProPowerBot
Psbot
RankingBot
ScanAlert
Scrapy
ScrepyBot
SiteLockSpider
SiteSucker
Siteimprove
Snapbot
Sogou web spider
Sottopop
Spider_Bot/3.0
Sucuri
Swiftbot
True_Robot
VB Project
Voltron
WWWOFFLE
Wallpapers
WallpapersHD
Web Enhancer
WebBandit
WebFetch
WebLeacher
Who.is Bot
Xenu
YoudaoBot
ZoominfoBot
ZyBorg
autoemailspider
awario.com
backlink-check
cohere-ai
crawl.sogou.com
facebookscraper
openai
probe-image-size
seostar
sp_auditbot
spyfu
webprosbot