nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-12-26 08:02:10 +00:00

250 lines
2.6 KiB
Text

ADmantX
AIBOT
ALittle Client
Abonti
Acunetix
AfD-Verbotsverfahren
AiHitBot
Anarchy99
Anthill
Attach
AwarioSmartBot
BLEXBot
BackWeb
BacklinkCrawler
Bandit
Barkrowler
BetaBot
Bigfoot
Black Hole
BlackWidow
Buck
Buddy
BuiltBotTough
Cegbfeieh
CherryPicker
ChinaClaw
Claritybot
Cliqzbot
Cocolyzebot
Copier
Copyscape
Crescent
CrunchBot
DBLBot
DIIbot
DataCha0s
DatabaseDriverMysqli
Digincore
Discobot
Dispatch
DnBCrawler-Analytics
DomainCrawler
Domains Project
Dotbot
Drip
EasyDL
Ebingbong
Ecxi
EroCrawler
ExtractorPro
Extreme Picture Finder
EyeNetIE
Flunky
GT::WWW
Genieo
GermCrawler
Gigabot
Go!Zilla
Go-Ahead-Got-It
GrabNet
GrapeFX
GridBot
HMView
Haansoft
Harvest
Heritrix
Humanlinks
HybridBot
IndeedBot
Indy Library
InfoNaviRobot
Internet Ninja
Iria
Iskanie
IstellaBot
JamesBOT
Jbrofuzz
JennyBot
JetCar
Joomla
Jorgee
LNSpiderguy
LWP::Simple
Leap
LeechGet
Libwhisker
LieBaoFast
LinkWalker
LinqiaRSSBot
Lipperhey Spider
Litemage_walker
MFC_Tear_Sample
MIIxpc
MQQBrowser
Majestic SEO
Majestic-SEO
MarkMonitor
Masscan
MauiBot
MeanPath Bot
Meanpathbot
MicroMessenger
Microsoft URL Control
Mojolicious
Morfeus Fucking Scanner
Msrabot
NPbot
NearSite
Nessus
Net Vampire
NetMechanic
Nettrack
Netvibes
NextGenSearchBot
NimbleCrawler
Nimbostratus
Ninja
Not
Nuclei
Offline Explorer
Offline Navigator
OpenVAS
PECL::HTTP
PHPCrawl
Page Analyzer
PageGrabber
PageScorer
Papa Foto
Pavuk
PeoplePal
Pi-Monster
Pimonster
ProPowerBot
Pump
PyCurl
RankActive
Re-re
Reaper
Recorder
RepoMonkey
SEOkicks
SEOstats
SMTBot
SalesIntelligent
Scanbot
Scrapy
ScreenerBot
ScrepyBot
SeoSiteCheckup
Seomoz
Shodan
Siphon
SiteCheckerBotCrawler
SiteLockSpider
Sitebeam
SlySearch
SmartDownload
Snake
SocialRankIOBot
Sogou web spider
Sosospider
SpaceBison
Spammen
SpankBot
Spanner
Spinn3r
Steeler
Stripper
Sucker
Sucuri
SuperBot
Surfbot
T8Abot
Teleport
The Intraformant
TheNomad
TightTwatBot
Toata
Toweyabot
Trendiction
Trendictionbot
Turingos
TurnitinBot
Twice
Typhoeus
URLy Warning
V-BOT
VidibleScraper
Voltron
WEBDAV
WPScan
WWW-Collector-E
WWW-Mechanize
Wallpapers
Web Auto
Web Collage
Web Pix
Web Sucker
WebAuto
WebBandit
WebCollage
WebImageCollector
WebLeacher
WebPix
WebReaper
WebSucker
WebWhacker
Webshag
WebsiteExtractor
WebsiteQuester
Whack
Whacker
Whatweb
Widow
Woobot
Wprecon
Xaldon_WebSpider
Xenu
Zade
Zauba
Zitebot
ZyBorg
archive.org_bot
autoemailspider
clark-crawler
cognitiveseo
com.plumanalytics
crawl.sogou.com
crawler.feedback
demandbase-bot
heritrix
internetVista monitor
isitwp.com
meanpathbot
oBot
page scorer
plumanalytics
polaris version
probe-image-size
s1z.ru
seoscanners
sexsearcher
spyfu
trendiction.de
ubermetrics-technologies.com
webgains-bot
webpros.com
webprosbot
x22Mozilla
zgrab