nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-09-24 10:07:43 +00:00

100 lines
1.1 KiB
Text

AhrefsBot
Alligator
BacklinksExtendedBot
Boardreader
Bytespider
CCBot
CODE87
CensysInspect
CherryPicker
Cogentbot
DigitalPebble
DomainCrawler
ECCP/1.0
Ebingbong
Ecxi
EroCrawler
Extreme Picture Finder
Flunky
Genieo
HMView
HaosouSpider
IDBot
Id-search
Information Security Team InfraSec Scanner
InternetSeer
JikeSpider
JustView
Leap
LeechGet
LinkWalker
Linkbot
LinkextractorPro
Litemage_walker
Magnet
Mb2345Browser
Metauri
MicroMessenger
Morfeus Fucking Scanner
Mozlila
Msrabot
NPbot
Navroad
Page Analyzer
Picscout
Pockey
Probethenet
QueryN Metasearch
Rainbot
SEOstats
SemrushBot
SeoSiteCheckup
SiteSucker
Spammen
Sqworm
Steeler
Stripper
Sucker
Swiftbot
TeleportPro
Telesoft
Titan
Tracemyfile
True_Robot
Turnitin
URLy Warning
UnisterBot
V-BOT
VCI
VeriCiteCrawler
WWW-Collector-E
WWW-Mechanize
WeSEE
Web Collage
Web Fetch
Web Pix
WebAuto
WebImageCollector
WebStripper
WebZIP
Webalta
Webster
WiseGuys Robot
Wonderbot
Xenu
YaK
YoudaoBot
anthropic-ai
arquivo.pt
awario.com
backlink-check
crawler.feedback
iubenda-radar
meanpathbot
omgili
pcBrowser
satoristudio.net
seocompany.store
tAkeOut
trendiction.de
x09Mozilla