nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-12-17 10:07:02 +00:00

100 lines
1 KiB
Text

AfD-Verbotsverfahren
Ankit
BDFetch
BackDoorBot
BetaBot
Black Hole
Blackboard
CODE87
Calculon
CheTeam
Citoid
Cogentbot
Copier
CrunchBot
Dragonfly
ECCP/1.0
FlashGet
Flunky
GPTBot
GetRight
Grabber
Grafula
Havij
HybridBot
IRLbot
Iria
JOC Web Spider
Jetty
JikeSpider
Keyword Density
Kozmosbot
Larbin
Ltx71
MTRobot
Mail.RU_Bot
Majestic-SEO
Mediatoolkitbot
Metauri
Minefield
Mister PiX
Mr.4x3
Msrabot
NetLyzer
NetMechanic
NetSpider
Niki-bot
NimbleCrawler
Nutch
POE-Component-Client-HTTP
Page Analyzer
PageThing.com
Panscient
Piepmatz
PleaseCrawl
PxBroker
PyCurl
RankActiveLinkBot
Recorder
Ripper
SlySearch
SmartDownload
Snapbot
Sogou web spider
SpaceBison
Spammen
SpankBot
Spanner
SuperHTTP
T0PHackTeam
Telesoft
Telesphorep
Trendiction
VB Project
WEBDAV
Web Fuck
Web Pix
WebCopier
WebFuck
WebPix
WebWhacker
WinHTTrack
Wprecon
Xaldon_WebSpider
Zade
ZoominfoBot
ZumBot
adscanner
com.plumanalytics
isitwp.com
linkdexbot
lwp-request
meanpathbot
pcBrowser
plumanalytics
seoscanners
seostar
sp_auditbot
trendiction.com
voyagerx.com
webmeup-crawler