nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2025-08-11 10:13:24 +00:00

100 lines
1 KiB
Text

AhrefsBot
Aliyun
AlphaBot
Apexoo
BDFetch
BackDoorBot
Backlink-Ceck
Bitacle
Blow
CCBot
Chlooe
Cocolyzebot
Curious
Custo
DSearch
Discoverybot
Dispatch
Extractor
FDM
FacebookBot
GeedoProductSearch
GoZilla
GrapeshotCrawler
GridBot
Harvest
HybridBot
IDBTE4M
IndeedBot
Indy Library
IstellaBot
JustView
Kinza
LNSpiderguy
Leap
LeechGet
Lightspeedsystems
LinkextractorPro
LinkpadBot
MQQBrowser
Masscan
Meanpathbot
MegaIndex.ru
Microsoft URL Control
NearSite
Nimbostratus
Openvas
Page Analyzer
PageAnalyzer
Picsearch
Pixray
ProPowerBot
ProWebWalker
PyCurl
RankFlex
RankurBot
Reaper
SEOprofiler
Screaming
SenutoBot
Shodan
Site Sucker
SiteSnagger
Sitebeam
SmartDownload
Sottopop
Spider_Bot
Sqlmap
Steeler
Sucuri
SuperHTTP
T0PHackTeam
T8Abot
Telesphorep
TightTwatBot
Typhoeus
URLy Warning
Voil
Web Pix
Web Sucker
WebBandit
WebPix
WebWhacker
Webalta
Widow
Zade
backlink-check
cah.io.community
check1.exe
cognitiveseo
crawl.sogou.com
isitwp.com
linkfluence
lwp-request
satoristudio.net
seostar
sitechecker.pro
webgains-bot
webmeup-crawler
x22Mozilla
xpymep1.exe