nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2025-03-17 10:13:23 +00:00

100 lines
1.1 KiB
Text

AfD-Verbotsverfahren
Anarchy
Anthill
AwarioSmartBot
BackStreet
Bigfoot
Black Hole
Bolt
Buck
Buddy
Bytespider
CCBot
CazoodleBot
CheTeam
CheeseBot
Chlooe
Cliqzbot
DataCha0s
DnBCrawler-Analytics
DomainAppender
DomainSigmaCrawler
Dragonfly
Drip
EasyDL
Express WebPictures
FDM
FHscan
Go!Zilla
Grafula
HTTrack
HaosouSpider
Harvest
JetCar
Joomla
Kozmosbot
Lftp
LibWeb
LieBaoFast
Lightspeedsystems
Likse
LinkWalker
Lipperhey
MarkMonitor
Mata Hari
Mb2345Browser
MeanPath Bot
Minefield
NetAnts
Offline Navigator
OutclicksBot
POE-Component-Client-HTTP
Pandalytics
Panscient
Picscout
Rainbot
Rankivabot
SBIder
SISTRIX
SalesIntelligent
Screaming
Seekport
Semrush
SemrushBot-SWA
Seomoz
Shodan
Siteimprove
Sosospider
Sqlworm
Sqworm
Stripper
Szukacz
URLy Warning
VoidEYE
Voil
WASALive-Bot
WWWOFFLE
WebCopier
WebReaper
WebStripper
WebSucker
Website Quester
Whacker
WiseGuys Robot
Xaldon_WebSpider
ZoominfoBot
arquivo.pt
awario.com
demandbase-bot
internetVista monitor
linkdexbot
openai
openai.com
ripz
s1z.ru
seocompany.store
sexsearcher
sogouspider
tAkeOut
ubermetrics-technologies.com
x22Mozilla