nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-04-03 22:04:50 +00:00

100 lines
1 KiB
Text

360Spider
Abonti
AhrefsBot
Apexoo
AwarioSmartBot
BackWeb
BuzzSumo
Bytespider
CSHttp
Cegbfeieh
ChatGPT-User
Cloud mapping
Dispatch
Download Wonder
Dragonfly
FHscan
FlashGet
FyberSpider
Grabber
HMView
Haansoft
HaosouSpider
HonoluluBot
Humanlinks
Id-search
IstellaBot
JikeSpider
MFC_Tear_Sample
MQQBrowser
MSIECrawler
MarkWatch
Mass Downloader
Minefield
Moblie Safari
Needle
Net Vampire
NetLyzer
Netvibes
Nibbler
Nuclei
Octopus
Offline Navigator
OpenLinkProfiler
OutfoxBot
PHPCrawl
Page Analyzer
PageGrabber
Papa Foto
Pavuk
PictureFinder
Pimonster
Psbot
Rainbot
RankurBot
RealDownload
ScoutJet
Shodan
Snoopy
Sogou web spider
Spanner
Sqlmap
Stripper
SuperHTTP
Swiftbot
T8Abot
Telesphorep
Thumbor
TurnitinBot
UnisterBot
Upflow
Vagabondo
Virusdie
WBSearchBot
WEBDAV
WPScan
WWW-Collector-E
WebGo IS
Webshag
Website Quester
WebsiteExtractor
WebsiteQuester
Webster
WinHTTrack
Woobot
Zitebot
ZoomBot
ZyBorg
anthropic-ai
backlink-check
coccocbot
com.plumanalytics
crawler4j
eCatch
evc-batch
isitwp.com
meanpathbot
netEstate NE Crawler
seobility
seostar
sp_auditbot