nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-08-23 22:04:54 +00:00

100 lines
1 KiB
Text

AfD-Verbotsverfahren
AiHitBot
Ankit
BDCbot
Bandit
Brandwatch
Calculon
CheTeam
ChinaClaw
Citoid
ClaudeBot
Curious
DTS Agent
DigitalPebble
Dirbuster
Discobot
DnyzBot
Download Wonder
Drip
Exabot
Firefox/7.0
G-i-g-a-b-o-t
GalaxyBot
GetRight
GetWeb
Gigabot
Go-Ahead-Got-It
GrapeshotCrawler
GridBot
HMView
Hloader
Id-search
Intelliseek
InternetMeasurement
Iria
JustView
Kenjin Spider
LWP::Simple
LieBaoFast
LinkpadBot
MQQBrowser
Majestic12
MarkWatch
Meanpathbot
Minefield
NetLyzer
Nimbostratus
Octopus
PHPCrawl
Page Analyzer
PageGrabber
Papa Foto
Pavuk
Pixray
ProWebWalker
Probethenet
Pu_iN
PxBroker
QueryN Metasearch
RSSingBot
RankFlex
ReGet
Ripper
SEOkicks
SEOprofiler
SeekportBot
SeoSiteCheckup
SiteSnagger
SmartDownload
Sogou web spider
Spinn3r
Sqworm
Suzuran
Telesoft
True_Robot
Typhoeus
URLy Warning
V-BOT
VidibleScraper
WWW::Mechanize
Wallpapers
Web Fetch
WebCollage
WebFuck
WebGo IS
WebImageCollector
WebPix
Wonderbot
Wotbox
Wprecon
com.plumanalytics
dataforseo.com
domainsproject.org
magpie-crawler
meanpathbot
mediawords
s1z.ru
seostar
sitechecker.pro
zgrab