nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-03-19 22:04:48 +00:00

100 lines
1.1 KiB
Text

Aboundex
Acunetix
Aspiegel
Asterias
Attach
AwarioSmartBot
BDCbot
BackWeb
BatchFTP
Blow
Bolt
BuiltWith
CheTeam
Crawling at Home Project
DSearch
DTS Agent
DnBCrawler-Analytics
DomainSigmaCrawler
Domains Project
Drip
EirGrabber
EyeNetIE
FDM
FlashGet
FyberSpider
Fyrebot
GalaxyBot
Go!Zilla
Go-Ahead-Got-It
Internet Ninja
InternetSeer
Iskanie
Jyxobot
Kinza
LinqiaScrapeBot
Lmspider
MSFrontPage
MTRobot
Majestic-SEO
MauiBot
MeanPath Bot
Minefield
Mister PiX
Moblie Safari
Net Vampire
Octopus
OpenLinkProfiler
OpenVAS
OutclicksBot
Panscient
Petalbot
Piepmatz
ProWebWalker
Proximic
QueryN Metasearch
SEOprofiler
SISTRIX
SalesIntelligent
Screaming
ScreenerBot
SemrushBot
Siphon
SiteCheckerBotCrawler
SiteLockSpider
Snoopy
Sosospider
SpaceBison
SuperBot
SurveyBot
Swiftbot
T0PHackTeam
TinyTestBot
Titan
Trendiction
Twice
URLy Warning
VB Project
VCI
Vacuum
VoidEYE
WISENutbot
WWW-Collector-E
Web Fuck
WebEnhancer
WebFetch
Website Quester
Webster
Woobot
Wprecon
arquivo-web-crawler
backlink-check
cognitiveseo
crawler4j
dataforseo.com
imagesift.com
iubenda-radar
netEstate NE Crawler
spyfu
sysscan
zgrab