nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-11-09 22:04:48 +00:00

100 lines
1.1 KiB
Text

80legs
ADmantX
AfD-Verbotsverfahren
AllSubmitter
BDCbot
BackStreet
Boardreader
Cloud mapping
Copyscape
Deusu
Digincore
DigitalPebble
DnyzBot
EMail Siphon
Evil
Flunky
Fuzz
HMView
IDBot
InfoNaviRobot
Iria
JustView
Keybot Translation-Search-Machine
Keyword Density
LNSpiderguy
LWP::Simple
Larbin
LexiBot
Lftp
LinkpadBot
MFC_Tear_Sample
Majestic SEO
Majestic12
MarkMonitor
MeanPath Bot
Mediatoolkitbot
Metauri
MicroMessenger
Mojeek
NearSite
Net Vampire
Netcraft
Netvibes
NextGenSearchBot
OutclicksBot
PHPCrawl
Pavuk
Picscout
PictureFinder
Psbot
RankFlex
ReGet
Recorder
RedesScrapy
ScanAlert
ScoutJet
ScreenerBot
SemanticJuice
SentiBot
SeoCherryBot
Shodan
Siphon
SiteCheckerBotCrawler
SiteSucker
SmartDownload
Sociscraper
Sogou web spider
Sottopop
Spammen
SurveyBot
True_Robot
Twice
VelenPublicWebCrawler
VoidEYE
Voil
Voltron
WWW-Collector-E
WWWOFFLE
WallpapersHD
WebEnhancer
Website Quester
Wonderbot
Wprecon
Xaldon WebSpider
Zade
Zeus
ZoomBot
ZumBot
check1.exe
dataforseo.com
dataforseobot
eCatch
lwp-request
mediawords
satoristudio.net
scan.lol
seobility
sitechecker.pro
spyfu
ubermetrics-technologies.com