nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2025-06-21 10:12:07 +00:00

100 lines
1.1 KiB
Text

ALittle Client
Aipbot
Anarchy
Ankit
Atomseobot
BBBike
BlowFish
Brandwatch
Calculon
CazoodleBot
Citoid
CrazyWebCrawler
Custo
DBLBot
Devil
DnyzBot
DomainStatsBot
Dragonfly
Ebingbong
Exabot
Express WebPictures
Ezooms
FemtosearchBot
GPTBot
GalaxyBot
Go-Ahead-Got-It
GrabNet
HTMLparser
IlseBot
IndeedBot
JOC Web Spider
Jorgee
JustView
Larbin
LeechFTP
Lftp
LinkWalker
LinkpadBot
LinqiaScrapeBot
Litemage_walker
Ltx71
MSFrontPage
Masscan
Microsoft URL Control
Mojolicious
NPbot
Navroad
NetSpider
Netcraft
Offline Navigator
OrangeSpider
OutfoxBot
POE-Component-Client-HTTP
PageGrabber
Pandalytics
Proximic
Psbot
RankingBot2
Ripper
Rogerbot
SMTBot
Scanbot
ScrepyBot
SemrushBot-FT
SemrushBot-OCOB
SenutoBot
Sottopop
Spider_Bot
Sqlworm
Swiftbot
Szukacz
TheNomad
Typhoeus
URLy.Warning
Virusdie
WallpapersHD
Web Fetch
Web Sauger
WebBandit
WebFuck
WebImageCollector
Website Quester
Whack
WiseGuys Robot
Xaldon_WebSpider
Zauba
adscanner
arquivo.pt
autoemailspider
coccocbot
crawl.sogou.com
crawler4j
iubenda-radar
openai.com
probe-image-size
ripz
sysscan
webmeup-crawler
x09Mozilla
x22Mozilla