nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-02-03 10:06:45 +00:00

100 lines
1 KiB
Text

360Spider
AIBOT
ALittle Client
Aboundex
AllSubmitter
Backlink-Ceck
BatchFTP
Bitacle
BlackWidow
Blow
Boardreader
Bullseye
CATExplorador
CensysInspect
Citoid
Claritybot
Curious
Custo
DIIbot
DatabaseDriverMysqli
Digincore
Discobot
DomCopBot
ECCP/1.0
EasyDL
EirGrabber
ExtractorPro
FrontPage
Fyrebot
Go-Ahead-Got-It
GrapeFX
Hloader
InfoTekies
Iria
IstellaBot
Jorgee
JustView
Jyxobot
LexiBot
LieBaoFast
Lmspider
MIIxpc
Minefield
Navroad
Nessus
Octopus
Openvas
PHPCrawl
POE-Component-Client-HTTP
Page Analyzer
Papa Foto
Pi-Monster
Pockey
Probethenet
PyCurl
RankingBot2
ReGet
SEOkicks-Robot
Scrapy
SemrushBot
Site Sucker
SiteExplorer
SiteSucker
Sqlworm
Stripper
Telesoft
Turingos
Twice
VelenPublicWebCrawler
WASALive-Bot
Wallpapers
Web Collage
Web Fuck
Web Sucker
WebCollage
WebPix
WebReaper
WebWhacker
Webalta
WebmasterWorldForumBot
WebsiteExtractor
Webster
WinHTTrack
ZmEu
cognitiveseo
cohere-ai
com.plumanalytics
evc-batch
isitwp.com
lwp-trivial
mediawords
openai
scalaj-http
seoscanners
serpstatbot
trendiction.de
webprosbot
x09Mozilla
x22Mozilla
zgrab