nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-03-25 10:07:07 +00:00

100 lines
1,021 B
Text

AfD-Verbotsverfahren
Alligator
Anarchy
Attach
AwarioSmartBot
BackWeb
Backlink-Ceck
BlowFish
Boardreader
BotALot
Buddy
Bullseye
CCBot
CensysInspect
CheeseBot
CopyRightCheck
Crawling at Home Project
DataCha0s
Dirbuster
Disco
ECCP/1.0
Ebingbong
EroCrawler
FDM
Fimap
Foobot
Getintent
Grabber
Grafula
GridBot
HTTP::Lite
HaosouSpider
Heritrix
HonoluluBot
Humanlinks
IDBTE4M
Image Sucker
Iria
IstellaBot
Jbrofuzz
JennyBot
Joomla
Jyxobot
Kinza
LNSpiderguy
LinkWalker
LinkextractorPro
LinkpadBot
Majestic-SEO
MauiBot
Mojeek
Mojolicious
Nessus
NetMechanic
Octopus
Offline Explorer
OpenVAS
Openfind
Page Analyzer
Panscient
Pockey
PyCurl
RankFlex
RankingBot
Reaper
Rogerbot
SEOprofiler
Scanbot
SearchmetricsBot
SeoSiteCheckup
SiteSucker
Sitevigil
Snoopy
Sucuri
Suzuran
TheNomad
Thumbor
URLy.Warning
VB Project
VeriCiteCrawler
WASALive-Bot
WallpapersHD
WebZIP
Whack
Whatweb
Widow
Wotbox
Zermelo
arquivo-web-crawler
backlink-check
crawl.sogou.com
crawler4j
gopher
heritrix
scalaj-http
scan.lol
seobility
sogouspider
sysscan
x22Mozilla