nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-11-11 10:07:51 +00:00

100 lines
1.1 KiB
Text

404enemy
AhrefsBot
AiHitBot
Attach
BLEXBot
Badass
BlowFish
Buck
Buddy
BuiltBotTough
CherryPicker
ClaudeBot
Cliqzbot
Cogentbot
Copier
Cosmos
CrazyWebCrawler
DSearch
DTS Agent
DataCha0s
Discoverybot
DomainStatsBot
Download Wonder
Exabot
Extractor
FacebookBot
Foobot
Freeuploader
GT::WWW
Go!Zilla
GrapeFX
HTMLparser
Haansoft
Harvest
Hloader
Image Sucker
InfraSec Scanner
InternetMeasurement
JOC Web Spider
LNSpiderguy
Libwhisker
Linkbot
LinkpadBot
MSFrontPage
MTRobot
MarkMonitor
MarkWatch
Mediatoolkitbot
Metauri
MolokaiBot
NetLyzer
Niki-bot
NimbleCrawler
Offline Navigator
OpenLinkProfiler
Openvas
OrangeBot
Page Analyzer
Panscient
Petalbot
Proximic
PxBroker
RepoMonkey
SalesIntelligent
ScoutJet
Shodan
Siphon
Sociscraper
SpankBot
Sqworm
Swiftbot
Szukacz
Telesphorep
True_Robot
Typhoeus
URLy Warning
Upflow
VidibleScraper
WASALive-Bot
WWW-Collector-E
WWWOFFLE
Web Enhancer
WebFuck
Webalta
WebmasterWorldForumBot
Who.is Bot
ZoomBot
ZoominfoBot
arquivo-web-crawler
cognitiveseo
eCatch
ips-agent
lwp-request
muhstik-scan
page scorer
pcBrowser
s1z.ru
spyfu
webmeup-crawler
x22Mozilla