nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-12-30 10:07:18 +00:00

100 lines
1 KiB
Text

01h4x.com
ASPSeek
AfD-Verbotsverfahren
Anarchie
BBBike
BDCbot
BlackWidow
Blow
Brandprotect
Brandwatch
Buddy
Bytespider
Cliqzbot
Demon
DomCopBot
ECCP/1.0
EasyDL
FHscan
Foobot
FyberSpider
Gotit
GridBot
IndeedBot
Intelliseek
Internet Ninja
Joomla
Keyword Density
Lftp
Libwhisker
LieBaoFast
LinkScan
LinqiaMetadataDownloaderBot
Lipperhey
Lmspider
MQQBrowser
MarkWatch
Mass Downloader
Meanpathbot
Minefield
Moblie Safari
Mojeek
Msrabot
Name Intelligence
Needle
NetSpider
Nimbostratus
Octopus
Offline Explorer
Page Analyzer
PageAnalyzer
PageGrabber
PictureFinder
Psbot
Pump
QueryN Metasearch
RankActiveLinkBot
Reaper
Recorder
Rogerbot
SBIder
SEOkicks
SEOkicks-Robot
SISTRIX
ScanAlert
ScrepyBot
Shodan
SiteLockSpider
Siteimprove
Sogou web spider
SpaceBison
Stripper
Sucuri
SuperBot
Suzuran
T8Abot
Telesphorep
Thumbor
TightTwatBot
Tracemyfile
Turnitin
TurnitinBot
TwengaBot
VCI
VelenPublicWebCrawler
VoidEYE
WWW-Collector-E
Web Enhancer
Webshag
Webster
Woobot
Wprecon
Zade
Zeus
ZmEu
archive.org_bot
magpie-crawler
mediawords
netEstate NE Crawler
openai.com
sysscan