nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2025-02-16 10:10:34 +00:00

100 lines
1.1 KiB
Text

80legs
ADmantX
Abonti
Anarchie
Anthill
AwarioRssBot
Brandwatch
Buck
CATExplorador
CensysInspect
ChinaClaw
CrazyWebCrawler
Curious
EMail Wolf
Extreme Picture Finder
EyeNetIE
FHscan
Flunky
FrontPage
GrapeshotCrawler
Hloader
InfoNaviRobot
InterGET
Internet Ninja
InternetMeasurement
JennyBot
Kenjin Spider
Lanshanbot
LieBaoFast
Lightspeedsystems
LinkScan
LinkpadBot
Lipperhey
Lmspider
MTRobot
MarkMonitor
Masscan
Mb2345Browser
MicroMessenger
Mozlila
Musobot
Name Intelligence
NearSite
Nessus
Nettrack
Netvibes
Nikto
NimbleCrawler
Nutch
Octopus
OpenLinkProfiler
OrangeBot
OutclicksBot
Petalbot
Pu_iN
RankingBot
Rankivabot
RankurBot
ReGet
Reaper
SemrushBot
SemrushBot-SWA
SeobilityBot
Siphon
SiteAuditBot
SiteSnagger
SlySearch
Sottopop
SpankBot
Spanner
SputnikBot
Steeler
TeleportPro
The Intraformant
Trendiction
V-BOT
WWWOFFLE
Web Sauger
WebFuck
WebReaper
WebStripper
WebSucker
Website Quester
Whacker
WinHTTrack
Zauba
check1.exe
crawler.feedback
dataforseo.com
domainsproject.org
ips-agent
isitwp.com
s1z.ru
satoristudio.net
seobility
serpstatbot
sogouspider
webgains-bot
webprosbot
x22Mozilla