nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-05-07 10:09:19 +00:00

250 lines
2.6 KiB
Text

360Spider
ADmantX
ASPSeek
Abonti
Acunetix
AfD-Verbotsverfahren
AiHitBot
AlphaBot
Anarchie
Apexoo
Atomseobot
Attach
AwarioRssBot
BBBike
BLEXBot
Barkrowler
BatchFTP
Battleztar Bazinga
BlackWidow
Blackboard
Boardreader
Bolt
BuiltWith
Bullseye
BunnySlippers
BuzzSumo
Calculon
CazoodleBot
CensysInspect
CheTeam
ChinaClaw
Chlooe
Citoid
Cliqzbot
Cocolyzebot
Cogentbot
Copier
CopyRightCheck
Copyscape
Craftbot
Crawling at Home Project
CrazyWebCrawler
CrunchBot
Custo
CyotekWebCopy
DBLBot
DSearch
Demon
Deusu
Digincore
Dispatch
Dotbot
Download Wonder
Dragonfly
EasyDL
Ebingbong
EirGrabber
Evil
Express WebPictures
Extractor
Extreme Picture Finder
FHscan
Flunky
Freeuploader
FrontPage
Fuzz
G-i-g-a-b-o-t
GT::WWW
GalaxyBot
Genieo
GetRight
Gigabot
Grafula
GrapeshotCrawler
HEADMasterSEO
HMView
Harvest
HonoluluBot
IDBTE4M
IRLbot
Iblog
Image Fetch
Indy Library
InfoTekies
Internet Ninja
InternetSeer
Iskanie
Jetty
Jorgee
JustView
Kenjin Spider
Kozmosbot
Lanshanbot
Larbin
LibWeb
Likse
LinkWalker
LinkextractorPro
LinkpadBot
LinqiaMetadataDownloaderBot
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey
Lmspider
Ltx71
MQQBrowser
MSIECrawler
MTRobot
Majestic SEO
MarkMonitor
Mb2345Browser
Meanpathbot
Mediatoolkitbot
MegaIndex.ru
MicroMessenger
Microsoft Data Access
Microsoft URL Control
Moblie Safari
MolokaiBot
Morfeus Fucking Scanner
Name Intelligence
Needle
NetAnts
NetMechanic
NetZIP
Nettrack
Netvibes
Niki-bot
Nimbostratus
Not
Nutch
OpenLinkProfiler
OpenVAS
Openfind
OrangeBot
OutclicksBot
Page Analyzer
PageScorer
Petalbot
PictureFinder
PleaseCrawl
Pockey
ProWebWalker
PyCurl
Quick-Crawler
RSSingBot
RankFlex
RankingBot
RankingBot2
RankurBot
ReGet
RealDownload
Recorder
RedesScrapy
RocketCrawler
SBIder
SISTRIX
Scanbot
Screaming
ScreenerBot
ScrepyBot
Searchestate
SearchmetricsBot
SemanticJuice
Semrush
SemrushBot
SentiBot
Seomoz
Shodan
Site Sucker
SiteLockSpider
SiteSnagger
Sitebeam
Sitevigil
Snapbot
Snoopy
Spammen
SpankBot
Spbot
Stripper
Sucker
Sucuri
Telesoft
Thumbor
TightTwatBot
Titan
Turingos
Turnitin
TurnitinBot
TwengaBot
Twice
URLy Warning
URLy.Warning
VB Project
Vagabondo
VelenPublicWebCrawler
VeriCiteCrawler
Virusdie
VoidEYE
WASALive-Bot
WEBDAV
WPScan
WWW-Mechanize
Wallpapers/3.0
WeSEE
Web Enhancer
Web Pix
Web Sucker
WebBandit
WebLeacher
WebReaper
WebStripper
WebZIP
WebmasterWorldForumBot
WebsiteQuester
Whack
Wonderbot
Woobot
Wprecon
YoudaoBot
Zeus
Zitebot
ZoomBot
ZumBot
arquivo-web-crawler
arquivo.pt
check1.exe
cognitiveseo
crawler.feedback
demandbase-bot
domainsproject.org
facebookscraper
gopher
heritrix
isitwp.com
iubenda-radar
lwp-request
muhstik-scan
plumanalytics
polaris version
ripz
s1z.ru
satoristudio.net
seoscanners
seostar
sitechecker.pro
spyfu
trendiction.com
webpros.com
xpymep1.exe