nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-05-02 22:07:19 +00:00

250 lines
2.7 KiB
Text

360Spider
ALittle Client
Aboundexbot
Acunetix
AfD-Verbotsverfahren
AhrefsBot
Alligator
Anarchy
Ankit
Anthill
Apexoo
Aspiegel
Attach
AwarioRssBot
BBBike
BackDoorBot
BacklinkCrawler
Bandit
Bigfoot
Black Hole
Blackboard
Brandwatch
Buck
Buddy
BuiltWith
CensysInspect
CheTeam
Cocolyzebot
Cogentbot
CrazyWebCrawler
Crescent
DigitalPebble
Dirbuster
Discobot
Dispatch
DnyzBot
DomCopBot
DomainAppender
DomainCrawler
DomainSigmaCrawler
DomainStatsBot
Domains Project
EasyDL
Ebingbong
Ecxi
EirGrabber
Evil
ExtractorPro
Extreme Picture Finder
FemtosearchBot
Firefox/7.0
FrontPage
Fuzz
G-i-g-a-b-o-t
GT::WWW
GalaxyBot
Go!Zilla
Go-Ahead-Got-It
GoZilla
Gotit
GrapeFX
Haansoft
Harvest
HybridBot
IRLbot
IlseBot
Image Fetch
IndeedBot
InfoNaviRobot
InfoTekies
InterGET
InternetSeer
Iria
JamesBOT
JennyBot
Jorgee
Keybot Translation-Search-Machine
Kinza
Kozmosbot
Lanshanbot
Larbin
LeechFTP
Lftp
Lightspeedsystems
Likse
LinkScan
Linkbot
LinkextractorPro
Litemage_walker
Lmspider
MIIxpc
MJ12bot
MSFrontPage
MSIECrawler
MTRobot
Majestic SEO
Majestic12
MarkMonitor
MarkWatch
Masscan
Mata Hari
Meanpathbot
MegaIndex.ru
Metauri
Microsoft Data Access
Minefield
Moblie Safari
Mojeek
MolokaiBot
Morfeus Fucking Scanner
Mr.4x3
Musobot
NPbot
Name Intelligence
Nameprotect
Navroad
NearSite
Needle
Nessus
NetAnts
NextGenSearchBot
Niki-bot
Nimbostratus
Octopus
Offline Navigator
Openfind
Openvas
OutclicksBot
PECL::HTTP
PHPCrawl
Page Analyzer
PageScorer
PageThing.com
Pavuk
PeoplePal
Picsearch
PictureFinder
Piepmatz
Pimonster
ProPowerBot
QueryN Metasearch
RSSingBot
RankActive
RankActiveLinkBot
RankingBot
RankingBot2
Rankivabot
RankurBot
ReGet
RepoMonkey
RocketCrawler
SEOkicks-Robot
SEOprofiler
SISTRIX
SMTBot
SalesIntelligent
ScanAlert
Scanbot
Screaming
ScreenerBot
Searchestate
Semrush
Seomoz
SiteExplorer
SiteSnagger
Sitebeam
Siteimprove
SmartDownload
Snake
Snoopy
SocialRankIOBot
Stripper
SuperHTTP
T0PHackTeam
Telesphoreo
Telesphorep
The Intraformant
TheNomad
Toata
Toweyabot
True_Robot
Turingos
TwengaBot
UnisterBot
VelenPublicWebCrawler
VeriCiteCrawler
Virusdie
WASALive-Bot
WBSearchBot
WEBDAV
WISENutbot
WPScan
WWW-Collector-E
WWWOFFLE
Wallpapers/3.0
WallpapersHD
Web Fuck
Web Sauger
Web Sucker
WebBandit
WebPix
WebReaper
WebSauger
Webster
Whatweb
Who.is Bot
Widow
WinHTTrack
Wonderbot
Wprecon
YoudaoBot
Zade
Zauba
Zermelo
Zitebot
ZoomBot
adscanner
autoemailspider
cah.io.community
clark-crawler
com.plumanalytics
crawl.sogou.com
demandbase-bot
facebookscraper
gopher
heritrix
instabid
internetVista monitor
ips-agent
isitwp.com
lwp-request
lwp-trivial
meanpathbot
muhstik-scan
oBot
pcBrowser
plumanalytics
polaris version
scan.lol
seobility
seoscanners
sitechecker.pro
sysscan
tAkeOut
trendiction.de
voyagerx.com
x22Mozilla
xpymep1.exe
zauba.io
zgrab