nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-08-29 22:07:05 +00:00

250 lines
2.7 KiB
Text

01h4x.com
360Spider
404enemy
ALittle Client
ASPSeek
Aboundex
AfD-Verbotsverfahren
Alexibot
AllSubmitter
AlphaBot
Anthill
Asterias
Backlink-Ceck
BacklinkCrawler
Barkrowler
BatchFTP
Blow
BotALot
Brandprotect
Brandwatch
Buck
BunnySlippers
BuzzSumo
CODE87
CSHttp
Calculon
CazoodleBot
CheTeam
CheeseBot
CherryPicker
Cliqzbot
Cloud mapping
Cocolyzebot
Collector
Cosmos
Craftbot
Crescent
Curious
DBLBot
DTS Agent
Devil
Discoverybot
Dispatch
DittoSpyder
DnBCrawler-Analytics
DnyzBot
DomCopBot
DomainAppender
DomainCrawler
DomainSigmaCrawler
DomainStatsBot
Download Wonder
EMail Siphon
EMail Wolf
Ecxi
Exabot
Extractor
Extreme Picture Finder
EyeNetIE
FHscan
Firefox/7.0
FlashGet
Foobot
Fyrebot
G-i-g-a-b-o-t
GalaxyBot
GermCrawler
Getintent
HEADMasterSEO
HMView
HTMLparser
Harvest
Hloader
HonoluluBot
HybridBot
IDBTE4M
Iblog
IlseBot
Indy Library
InternetSeer
JOC Web Spider
Joomla
Jorgee
Keybot Translation-Search-Machine
LWP::Simple
LexiBot
LibWeb
Libwhisker
LieBaoFast
Lightspeedsystems
LinkWalker
Linkbot
LinkpadBot
LinksManager
LinqiaRSSBot
Lipperhey Spider
Ltx71
MFC_Tear_Sample
MIIxpc
MQQBrowser
Mail.RU_Bot
Majestic-SEO
Mata Hari
MauiBot
MeanPath Bot
Mediatoolkitbot
MicroMessenger
Microsoft Data Access
Microsoft URL Control
Mojolicious
Morfeus Fucking Scanner
Mozlila
Mr.4x3
Musobot
NICErsPRO
Nameprotect
NearSite
Needle
Net Vampire
NetMechanic
Nikto
Nimbostratus
Nutch
Octopus
Offline Explorer
OpenLinkProfiler
OrangeBot
OutclicksBot
OutfoxBot
PHPCrawl
POE-Component-Client-HTTP
Page Analyzer
PageScorer
Pandalytics
Panscient
Pavuk
Pi-Monster
ProPowerBot
ProWebWalker
Probethenet
Pump
QueryN Metasearch
Quick-Crawler
RankActive
RankingBot
RedesScrapy
RepoMonkey
SBIder
SEOlyticsCrawler
SEOstats
SISTRIX
SalesIntelligent
Scanbot
ScoutJet
ScreenerBot
ScrepyBot
Searchestate
SemanticJuice
SemrushBot
SeobilityBot
Shodan
Siphon
SiteExplorer
Sitevigil
SlySearch
Snake
Snapbot
Sosospider
SpaceBison
SpankBot
Spanner
Spbot
Sqlworm
Stripper
Swiftbot
Teleport
Telesoft
Telesphorep
TightTwatBot
Titan
Toata
TwengaBot
URLy.Warning
UnisterBot
VelenPublicWebCrawler
VeriCiteCrawler
WBSearchBot
WPScan
WWW-Mechanize
Wallpapers/3.0
WallpapersHD
WeSEE
Web Collage
Web Enhancer
Web Pix
Web Sauger
WebAuto
WebCollage
WebGo IS
WebPix
WebSucker
WebWhacker
Webalta
WebmasterWorldForumBot
Webshag
Webster
Whack
Whatweb
Who.is Bot
Woobot
Wprecon
Xaldon WebSpider
Xaldon_WebSpider
YoudaoBot
Zauba
Zeus
ZmEu
ZumBot
arquivo-web-crawler
arquivo.pt
autoemailspider
cah.io.community
coccocbot
cognitiveseo
crawler.feedback
dataforseo.com
domainsproject.org
facebookscraper
gopher
heritrix
internetVista monitor
lwp-trivial
magpie-crawler
oBot
plumanalytics
satoristudio.net
seobility
seocompany.store
seoscanners
seostar
serpstatbot
sogouspider
sp_auditbot
spyfu
tAkeOut
trendiction.com
trendiction.de
voyagerx.com
x22Mozilla
zgrab