nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2025-02-25 10:11:46 +00:00

100 lines
1 KiB
Text

Alexibot
AllSubmitter
AwarioSmartBot
BDCbot
BackStreet
Backlink-Ceck
BacklinksExtendedBot
Brandprotect
Buck
Buddy
BunnySlippers
CCBot
CODE87
CSHttp
Calculon
Citoid
Cliqzbot
Crescent
CrunchBot
Custo
DTS Agent
Drip
ECCP/1.0
EasyDL
EirGrabber
Fimap
GetWeb
Go!Zilla
Grabber
GrapeshotCrawler
Haansoft
IDBTE4M
Image Fetch
ImagesiftBot
Internet Ninja
Iria
Jorgee
Kozmosbot
LexiBot
LibWeb
LieBaoFast
Linkbot
LinksManager
MFC_Tear_Sample
MTRobot
Majestic12
MarkMonitor
Metauri
MicroMessenger
Mister PiX
Msrabot
Nameprotect
NearSite
Net Vampire
NetSpider
Nikto
Offline Explorer
OpenLinkProfiler
OpenVAS
PECL::HTTP
Page Analyzer
Pi-Monster
Pixray
SemrushBot-SI
SiteCheckerBotCrawler
Snoopy
Spinn3r
SurveyBot
TinyTestBot
Tracemyfile
UnisterBot
VB Project
Voltron
WASALive-Bot
Web Collage
Web Fuck
Web Sucker
WebCollage
WebEnhancer
WebFetch
Webster
Whack
WinHTTrack
Wonderbot
Xenu
ZumBot
autoemailspider
coccocbot
crawler.feedback
imagesift.com
ips-agent
isitwp.com
meanpathbot
netEstate NE Crawler
openai.com
seostar
sogouspider
sp_auditbot
trendiction.de
voyagerx.com