nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-01-15 10:09:20 +00:00

250 lines
2.6 KiB
Text

404enemy
80legs
ADmantX
AIBOT
Abonti
Aboundexbot
Acunetix
AfD-Verbotsverfahren
AiHitBot
Aipbot
Anarchie
Aspiegel
Attach
AwarioSmartBot
BDFetch
BackWeb
Backlink-Ceck
Barkrowler
Black Hole
BlackWidow
Blackboard
BlowFish
Bolt
Brandprotect
BuiltBotTough
BuiltWith
Bullseye
CCBot
CSHttp
Cegbfeieh
CheTeam
ChinaClaw
Chlooe
Citoid
Claritybot
Cliqzbot
Cocolyzebot
Copier
Cosmos
CrazyWebCrawler
Crescent
CrunchBot
Custo
DIIbot
DSearch
DTS Agent
Devil
Disco
Discobot
Dispatch
Domains Project
Download Wonder
Dragonfly
ECCP/1.0
EMail Siphon
EasyDL
Ecxi
EirGrabber
EroCrawler
Extractor
Extreme Picture Finder
FHscan
FyberSpider
GalaxyBot
GermCrawler
GoZilla
Gotit
Grabber
GrapeFX
HTTP::Lite
HTTrack
Havij
Heritrix
Hloader
Iblog
Id-search
Image Fetch
Image Sucker
JennyBot
Jyxobot
Kenjin Spider
Keybot Translation-Search-Machine
Kinza
LWP::Simple
LeechGet
LexiBot
LibWeb
LieBaoFast
LinkScan
Linkbot
LinkextractorPro
LinksManager
LinqiaMetadataDownloaderBot
LinqiaRSSBot
MJ12bot
MSFrontPage
Majestic-SEO
MauiBot
Meanpathbot
Metauri
MicroMessenger
Mister PiX
Moblie Safari
Mojeek
Morfeus Fucking Scanner
Mozlila
Name Intelligence
Navroad
Nessus
Net Vampire
NetAnts
NetLyzer
Netcraft
Niki-bot
NimbleCrawler
Ninja
Nmap
Nuclei
Nutch
OnCrawl
OpenVAS
Openvas
OrangeBot
OrangeSpider
POE-Component-Client-HTTP
PageAnalyzer
PageGrabber
PageScorer
Pavuk
PeoplePal
Petalbot
Pi-Monster
Picsearch
Probethenet
Pu_iN
PyCurl
QueryN Metasearch
RankActive
RankingBot
RankingBot2
Rankivabot
RankurBot
RealDownload
RedesScrapy
Ripper
RocketCrawler
Rogerbot
SBIder
SEOstats
SISTRIX
SalesIntelligent
Scanbot
ScreenerBot
Searchestate
SearchmetricsBot
SentiBot
Siphon
SiteLockSpider
SiteSnagger
SiteSucker
Sitebeam
Sitevigil
SmartDownload
SocialRankIOBot
Sogou web spider
Sosospider
SpaceBison
SpankBot
Spanner
Spinn3r
Sqlmap
Sqlworm
Sqworm
Stripper
Sucuri
SuperHTTP
SurveyBot
T0PHackTeam
T8Abot
Teleport
Telesoft
Telesphorep
The Intraformant
TheNomad
TightTwatBot
Trendictionbot
True_Robot
Typhoeus
VCI
Vacuum
Vagabondo
VeriCiteCrawler
VoidEYE
Voltron
WBSearchBot
WISENutbot
WWW-Collector-E
WWW::Mechanize
Web Auto
Web Fetch
WebCopier
WebFetch
WebFuck
WebImageCollector
WebLeacher
WebPix
WebSauger
WebStripper
WebSucker
Webalta
Website Quester
WebsiteQuester
Whack
Whatweb
Widow
Wonderbot
Xaldon_WebSpider
Zermelo
Zeus
ZoomBot
ZoominfoBot
archive.org_bot
autoemailspider
cah.io.community
check1.exe
clark-crawler
cognitiveseo
com.plumanalytics
crawl.sogou.com
demandbase-bot
eCatch
facebookscraper
gopher
instabid
ips-agent
iubenda-radar
linkdexbot
meanpathbot
mediawords
muhstik-scan
netEstate NE Crawler
pcBrowser
polaris version
probe-image-size
s1z.ru
sogouspider
sp_auditbot
ubermetrics-technologies.com
webprosbot
x22Mozilla