nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2026-04-18 10:24:40 +00:00

100 lines
1 KiB
Text

AIBOT
Acunetix
AdsTxtCrawlerTP
Apexoo
BDFetch
Bandit
BatchFTP
Black Hole
Buddy
BuzzSumo
CSHttp
CherryPicker
Cocolyzebot
Cogentbot
Cosmos
Custo
DataCha0s
Deusu
Digincore
Disco
DnyzBot
DomCopBot
Ebingbong
Evil
Exabot
FDM
Fimap
GT::WWW
GalaxyBot
Gigabot
GrapeshotCrawler
HaosouSpider
Harvest
HonoluluBot
Indy Library
InfraSec Scanner
Kinza
Leap
LeechGet
MFC_Tear_Sample
MJ12bot
MarkMonitor
Mass Downloader
Mb2345Browser
Meanpathbot
Microsoft Data Access
Mojeek
Morfeus Fucking Scanner
Msrabot
Name Intelligence
Nameprotect
Navroad
Niki-bot
OpenVAS
PageGrabber
Quick-Crawler
RankingBot
Re-re
SEOlyticsCrawler
SISTRIX
Searchestate
Semrush
SemrushBot-FT
SeobilityBot
Site Sucker
SiteExplorer
SpankBot
Stripper
Sucker
SuperHTTP
Surfbot
Teleport
TeleportPro
Thumbor
Twice
Typhoeus
WWWOFFLE
WebAuto
WebBandit
WebGo IS
WebImageCollector
Webshag
Xaldon_WebSpider
Xenu
YaK
ZyBorg
backlink-check
cah.io.community
com.plumanalytics
crawler4j
domainsproject.org
internetVista monitor
linkfluence
lwp-request
mediawords
omgili
seobility
seoscanners
sp_auditbot
x22Mozilla