nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-03-23 22:07:12 +00:00

250 lines
2.6 KiB
Text

360Spider
80legs
ALittle Client
Abonti
Aboundex
Aboundexbot
Acunetix
AfD-Verbotsverfahren
AhrefsBot
Aipbot
Alexibot
Anarchie
Anarchy99
Aspiegel
AwarioSmartBot
BLEXBot
Badass
Bandit
Barkrowler
BatchFTP
BetaBot
BlackWidow
Blow
Boardreader
BotALot
Brandprotect
Buck
BuiltWith
Bullseye
BuzzSumo
CCBot
CODE87
CSHttp
CazoodleBot
Chlooe
Citoid
Cliqzbot
Copier
Craftbot
CrunchBot
DatabaseDriverMysqli
Demon
Devil
Digincore
Dirbuster
Disco
Dispatch
DomainCrawler
DomainSigmaCrawler
DomainStatsBot
Domains Project
Download Wonder
Dragonfly
Drip
ECCP/1.0
EMail Siphon
EMail Wolf
Ebingbong
EroCrawler
Evil
Extractor
Extreme Picture Finder
FlashGet
Flunky
GalaxyBot
Genieo
Getintent
Go-Ahead-Got-It
Gotit
Grafula
GrapeshotCrawler
GridBot
HEADMasterSEO
HMView
HTTP::Lite
HTTrack
Haansoft
HaosouSpider
Humanlinks
HybridBot
IDBTE4M
IDBot
IRLbot
Id-search
IlseBot
Indy Library
InfoNaviRobot
Internet Ninja
InternetSeer
IstellaBot
JamesBOT
JetCar
Joomla
Jorgee
Jyxobot
Lanshanbot
Larbin
LeechFTP
Lftp
LieBaoFast
LinkWalker
Linkbot
Linkdexbot
LinkpadBot
LinqiaMetadataDownloaderBot
LinqiaRSSBot
Lmspider
Ltx71
Mag-Net
Mail.RU_Bot
Meanpathbot
Mediatoolkitbot
Metauri
Microsoft Data Access
Mojolicious
MolokaiBot
Morfeus Fucking Scanner
Mozlila
Mr.4x3
Msrabot
Musobot
NPbot
NetLyzer
Nettrack
NextGenSearchBot
Nibbler
NimbleCrawler
Octopus
Offline Explorer
Offline Navigator
Openvas
OrangeBot
OrangeSpider
OutclicksBot
OutfoxBot
PageScorer
Papa Foto
PeoplePal
Petalbot
Picsearch
PictureFinder
Piepmatz
Pixray
PleaseCrawl
ProWebWalker
Probethenet
PyCurl
QueryN Metasearch
Quick-Crawler
ReGet
Ripper
RocketCrawler
SBIder
SEOkicks
SEOlyticsCrawler
SISTRIX
SMTBot
ScanAlert
ScoutJet
ScreenerBot
Searchestate
SearchmetricsBot
Seekport
Semrush
SemrushBot
SentiBot
SeoSiteCheckup
SiteCheckerBotCrawler
SiteSnagger
SiteSucker
Sitebeam
SlySearch
Snapbot
Sociscraper
Sosospider
Sottopop
SpaceBison
Spbot
SputnikBot
Sqlmap
Sqworm
Sucuri
Szukacz
T0PHackTeam
TheNomad
TightTwatBot
Titan
Tracemyfile
True_Robot
Turingos
Turnitin
TurnitinBot
TwengaBot
URLy Warning
VB Project
Virusdie
Voil
WASALive-Bot
WBSearchBot
WWW-Collector-E
WeSEE
Web Auto
Web Sauger
WebCollage
WebCopier
WebGo IS
WebPix
WebSauger
WebStripper
WebSucker
WebZIP
Website Quester
WebsiteExtractor
WebsiteQuester
Whatweb
Who.is Bot
WiseGuys Robot
Woobot
Wotbox
Xaldon WebSpider
Xaldon_WebSpider
Xenu
Zauba
Zeus
ZumBot
arquivo.pt
clark-crawler
coccocbot
cognitiveseo
com.plumanalytics
crawler.feedback
dataforseo.com
demandbase-bot
domainsproject.org
eCatch
iubenda-radar
magpie-crawler
meanpathbot
mediawords
seostar
sexsearcher
sp_auditbot
sysscan
trendiction.com
trendiction.de
voyagerx.com
webmeup-crawler
x09Mozilla
x22Mozilla
xpymep1.exe