nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-11-19 22:07:07 +00:00

250 lines
2.6 KiB
Text

360Spider
404checker
80legs
AIBOT
ALittle Client
Aboundexbot
AfD-Verbotsverfahren
AhrefsBot
AlphaBot
Anarchie
Anarchy
Anarchy99
Ankit
Aspiegel
Attach
AwarioRssBot
BDFetch
BackStreet
BacklinkCrawler
Bandit
Black Hole
BlackWidow
Blackboard
BlowFish
Boardreader
BotALot
Brandwatch
BuiltWith
BunnySlippers
BuzzSumo
CATExplorador
CODE87
CSHttp
CazoodleBot
CensysInspect
CheTeam
CheeseBot
Collector
Cosmos
Crawling at Home Project
CrazyWebCrawler
Crescent
CrunchBot
Curious
CyotekWebCopy
DIIbot
DTS Agent
DatabaseDriverMysqli
Demon
Digincore
Dirbuster
Dispatch
DittoSpyder
DnBCrawler-Analytics
DomCopBot
DomainStatsBot
EMail Siphon
EasyDL
Ebingbong
Ecxi
Express WebPictures
Extractor
ExtractorPro
Extreme Picture Finder
Freeuploader
FrontPage
Fuzz
GalaxyBot
Gigabot
Go!Zilla
GoZilla
Gotit
GrapeshotCrawler
HMView
Haansoft
Heritrix
Hloader
HybridBot
IDBTE4M
IRLbot
Id-search
IlseBot
JamesBOT
Jbrofuzz
JennyBot
JetCar
Jorgee
Kozmosbot
LNSpiderguy
Lanshanbot
Leap
LeechFTP
LexiBot
LieBaoFast
Likse
LinkScan
LinkpadBot
LinqiaRSSBot
Lipperhey Spider
Lmspider
MIIxpc
MJ12bot
Mag-Net
Magnet
Majestic-SEO
Majestic12
Mass Downloader
Mb2345Browser
MeanPath Bot
Metauri
Microsoft Data Access
Morfeus Fucking Scanner
Mr.4x3
Msrabot
Musobot
NICErsPRO
NPbot
Nameprotect
Navroad
Needle
NetMechanic
NetSpider
Netcraft
Netvibes
Niki-bot
Nimbostratus
Ninja
Nmap
Nuclei
OnCrawl
OpenLinkProfiler
OpenVAS
OrangeBot
OutclicksBot
POE-Component-Client-HTTP
PageAnalyzer
PageGrabber
PageScorer
Pimonster
Pixray
ProPowerBot
ProWebWalker
Psbot
PxBroker
PyCurl
RSSingBot
RankingBot2
Re-re
ReGet
RealDownload
RebelMouse
Ripper
RocketCrawler
SBIder
SEOkicks
SEOlyticsCrawler
SEOprofiler
SEOstats
SISTRIX
SMTBot
ScoutJet
ScrepyBot
SearchmetricsBot
SemrushBot
SeoSiteCheckup
Siphon
SiteLockSpider
SiteSnagger
SiteSucker
Sitebeam
Sitevigil
SmartDownload
Snake
Snapbot
Snoopy
Sociscraper
Sogou web spider
Sottopop
SpaceBison
Spammen
Spanner
SputnikBot
Stripper
Sucker
Suzuran
T0PHackTeam
Telesoft
Telesphorep
The Intraformant
Toata
Tracemyfile
Turingos
TurnitinBot
Twice
URLy.Warning
V-BOT
Vagabondo
VelenPublicWebCrawler
VeriCiteCrawler
Virusdie
Voil
WASALive-Bot
WPScan
WallpapersHD
WeSEE
Web Auto
Web Collage
Web Enhancer
Web Fuck
Web Pix
WebBandit
WebCollage
WebPix
WebSucker
WebsiteQuester
Webster
Whack
Whacker
Whatweb
Who.is Bot
Wonderbot
Wotbox
Xaldon WebSpider
Xaldon_WebSpider
Zeus
ZyBorg
autoemailspider
crawler.feedback
evc-batch
facebookscraper
gopher
instabid
magpie-crawler
mediawords
muhstik-scan
netEstate NE Crawler
pcBrowser
plumanalytics
ripz
s1z.ru
seocompany.store
seostar
trendiction.com
trendiction.de
ubermetrics-technologies.com
voyagerx.com
webmeup-crawler
webprosbot
x22Mozilla
zauba.io