nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2025-08-24 22:08:05 +00:00

100 lines
1.1 KiB
Text

ALittle Client
AhrefsBot
Aliyun
Apexoo
Asterias
Atomseobot
AwarioSmartBot
BacklinksExtendedBot
Badass
Buddy
CCBot
CODE87
Cegbfeieh
CheTeam
Crawling at Home Project
Crescent
CrunchBot
DatabaseDriverMysqli
Deusu
DomCopBot
Download Wonder
ECCP/1.0
EasyDL
EirGrabber
Exabot
ExtractorPro
FemtosearchBot
FlashGet
GT::WWW
GalaxyBot
Genieo
Haansoft
Humanlinks
IndeedBot
Indy Library
InfoNaviRobot
InfoTekies
Jorgee
Jyxobot
LeechFTP
LinqiaScrapeBot
Lipperhey Spider
Litemage_walker
Lmspider
Ltx71
MFC_Tear_Sample
Masscan
Metauri
Mojeek
Mr.4x3
Nameprotect
Net Vampire
Netvibes
Openfind
Openvas
OrangeSpider
PageAnalyzer
PageScorer
PictureFinder
RankFlex
Recorder
Rogerbot
ScanAlert
ScreenerBot
Site Sucker
Siteimprove
Snapbot
Snoopy
SpaceBison
Spider_Bot/3.0
Tracemyfile
Trendiction
TurnitinBot
URLy.Warning
VCI
Vacuum
VeriCiteCrawler
Virusdie
WBSearchBot
WISENutbot
WPScan
Web Auto
Web Fetch
Web Pix
WebCollage
WebImageCollector
WebSucker
Website Quester
Who.is Bot
Xenu
ZoomBot
ZumBot
dataforseobot
demandbase-bot
facebookscraper
heritrix
internetVista monitor
linkdexbot
openai
zauba.io