nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-03-29 10:07:47 +00:00

100 lines
1 KiB
Text

01h4x.com
404enemy
AdsTxtCrawlerTP
Anthill
BackWeb
Blackboard
Brandprotect
BuiltBotTough
Bullseye
BuzzSumo
CazoodleBot
Custo
Devil
Dispatch
DnBCrawler-Analytics
DomainSigmaCrawler
Drip
EasyDL
Foobot
Fyrebot
G-i-g-a-b-o-t
Genieo
Gigabot
Google-Extended
Gotit
HonoluluBot
IndeedBot
JOC Web Spider
Jbrofuzz
JetCar
Kenjin Spider
LNSpiderguy
LinkpadBot
LinksManager
Lmspider
Ltx71
MFC_Tear_Sample
MQQBrowser
MTRobot
NimbleCrawler
OpenLinkProfiler
OrangeBot
PageAnalyzer
Panscient
Pavuk
Pixray
ProWebWalker
Proximic
RankActiveLinkBot
RankingBot
RealDownload
Recorder
Ripper
Rogerbot
SISTRIX
ScoutJet
Screaming
SemrushBot
Shodan
Siphon
Site Sucker
SiteExplorer
SiteLockSpider
SiteSucker
Siteimprove
Snake
SocialRankIOBot
Spanner
Spbot
SuperBot
Toata
TurnitinBot
URLy Warning
VoidEYE
WASALive-Bot
WWW-Collector-E
WWWOFFLE
Web Auto
Web Collage
Web Enhancer
WebFuck
WebSucker
WebWhacker
Webster
Widow
Zade
Zeus
ZumBot
anthropic-ai
coccocbot
instabid
lwp-request
omgili
openai
scan.lol
seoscanners
sitechecker.pro
sp_auditbot
x09Mozilla
zgrab