nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-10-25 22:05:19 +00:00

100 lines
1 KiB
Text

404checker
ASPSeek
Aipbot
Anarchy
Badass
Blow
Boardreader
CensysInspect
Cliqzbot
CrunchBot
CyotekWebCopy
DSearch
DTS Agent
Demon
Digincore
DigitalPebble
Discobot
DnBCrawler-Analytics
DomainAppender
DomainStatsBot
ECCP/1.0
Ebingbong
EirGrabber
Fimap
FlashGet
Fuzz
Gigabot
HonoluluBot
Internet Ninja
InternetSeer
Iria
Iskanie
JOC Web Spider
JikeSpider
Joomla
Kinza
Lanshanbot
Larbin
Mag-Net
Magnet
Masscan
Mata Hari
MauiBot
Metauri
Mojolicious
Nameprotect
Navroad
NetMechanic
NetZIP
Nibbler
Ninja
Pavuk
Pi-Monster
Probethenet
Pu_iN
Quick-Crawler
RealDownload
RepoMonkey
SMTBot
SalesIntelligent
Scanbot
ScrepyBot
SearchmetricsBot
SeekportBot
SemanticJuice
Semrush
Site Sucker
Snapbot
SocialRankIOBot
SpaceBison
SpankBot
Spbot
Sqworm
Surfbot
Titan
URLy Warning
URLy.Warning
UnisterBot
VCI
VidibleScraper
Voil
Voltron
WASALive-Bot
WPScan
Wallpapers/3.0
Web Collage
Web Sauger
WebImageCollector
Who.is Bot
archive.org_bot
crawler.feedback
dataforseo.com
eCatch
isitwp.com
polaris version
sitechecker.pro
sp_auditbot
voyagerx.com
webgains-bot
x22Mozilla