vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-04 03:29:57 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V3.2017.07.632 [ci skip]

Browse source
This commit is contained in:
Travis 2017-07-06 15:33:34 +02:00
parent 751f2198cf
commit 95077c0108
6 changed files with 1245 additions and 1236 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

5
AUTO-CONFIGURATION.md
View file

@ -5,6 +5,11 @@
##### Copyright Mitchell Krog <mitchellkrog@gmail.com> ##### Copyright Mitchell Krog <mitchellkrog@gmail.com>
### Version Information # ### Version Information #
********************************************
#### Version: V3.2017.07.632
#### Bad Referrer Count: 4948
#### Bad Bot Count: 480
********************************************
### Version Information ## ### Version Information ##
## Update Notification System ## Update Notification System

5
MANUAL-CONFIGURATION.md
View file

@ -5,6 +5,11 @@
##### Copyright Mitchell Krog <mitchellkrog@gmail.com> ##### Copyright Mitchell Krog <mitchellkrog@gmail.com>
### Version Information # ### Version Information #
********************************************
#### Version: V3.2017.07.632
#### Bad Referrer Count: 4948
#### Bad Bot Count: 480
********************************************
### Version Information ## ### Version Information ##
## Update Notification System ## Update Notification System

5
README.md
View file

@ -9,6 +9,11 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking
### Version Information # ### Version Information #
********************************************
#### Version: V3.2017.07.632
#### Bad Referrer Count: 4948
#### Bad Bot Count: 480
********************************************
### Version Information ## ### Version Information ##
## If this helps you [why not buy me a beer](https://www.paypal.com/cgi-bin/webscr?cmd=_s-xclick&hosted_button_id=BKF9XT6WHATLG):beer: ## If this helps you [why not buy me a beer](https://www.paypal.com/cgi-bin/webscr?cmd=_s-xclick&hosted_button_id=BKF9XT6WHATLG):beer:

1301
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

144
robots.txt/robots.txt
View file

@ -1,13 +1,14 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V3.2017.06.631 ### Version: V3.2017.07.632
### Updated: Wed Jun 28 16:42:57 SAST 2017 ### Updated: Thu Jul 6 15:33:34 SAST 2017
### Bad Referrer Count: 4948
### Bad Bot Count: 480 ### Bad Bot Count: 480
################################################### ###################################################
### Version Information ## ### Version Information ##
User-agent: *
Disallow: /wp-admin/
Allow: /wp-admin/admin-ajax.php
User-agent: 360Spider User-agent: 360Spider
Disallow:/ Disallow:/
User-agent: 80legs User-agent: 80legs
@ -58,7 +59,7 @@ User-agent: Bandit
Disallow:/ Disallow:/
User-agent: BatchFTP User-agent: BatchFTP
Disallow:/ Disallow:/
User-agent: Battleztar Bazinga User-agent: Battleztar\ Bazinga
Disallow:/ Disallow:/
User-agent: BBBike User-agent: BBBike
Disallow:/ Disallow:/
@ -72,7 +73,7 @@ User-agent: Bitacle
Disallow:/ Disallow:/
User-agent: Blackboard User-agent: Blackboard
Disallow:/ Disallow:/
User-agent: Black Hole User-agent: Black\ Hole
Disallow:/ Disallow:/
User-agent: BlackWidow User-agent: BlackWidow
Disallow:/ Disallow:/
@ -182,17 +183,17 @@ User-agent: DomainSigmaCrawler
Disallow:/ Disallow:/
User-agent: Dotbot User-agent: Dotbot
Disallow:/ Disallow:/
User-agent: Download Demon User-agent: Download\ Demon
Disallow:/ Disallow:/
User-agent: Download Devil User-agent: Download\ Devil
Disallow:/ Disallow:/
User-agent: Download Wonder User-agent: Download\ Wonder
Disallow:/ Disallow:/
User-agent: Dragonfly User-agent: Dragonfly
Disallow:/ Disallow:/
User-agent: Drip User-agent: Drip
Disallow:/ Disallow:/
User-agent: DTS Agent User-agent: DTS\ Agent
Disallow:/ Disallow:/
User-agent: EasyDL User-agent: EasyDL
Disallow:/ Disallow:/
@ -206,13 +207,13 @@ User-agent: Ecxi
Disallow:/ Disallow:/
User-agent: EirGrabber User-agent: EirGrabber
Disallow:/ Disallow:/
User-agent: EMail Collector User-agent: EMail\ Collector
Disallow:/ Disallow:/
User-agent: EMail Extractor User-agent: EMail\ Extractor
Disallow:/ Disallow:/
User-agent: EMail Siphon User-agent: EMail\ Siphon
Disallow:/ Disallow:/
User-agent: EMail Wolf User-agent: EMail\ Wolf
Disallow:/ Disallow:/
User-agent: EroCrawler User-agent: EroCrawler
Disallow:/ Disallow:/
@ -220,7 +221,7 @@ User-agent: Evil
Disallow:/ Disallow:/
User-agent: Exabot User-agent: Exabot
Disallow:/ Disallow:/
User-agent: Express WebPictures User-agent: Express\ WebPictures
Disallow:/ Disallow:/
User-agent: Extractor User-agent: Extractor
Disallow:/ Disallow:/
@ -320,13 +321,13 @@ User-agent: Id-search
Disallow:/ Disallow:/
User-agent: IlseBot User-agent: IlseBot
Disallow:/ Disallow:/
User-agent: Image Fetch User-agent: Image\ Fetch
Disallow:/ Disallow:/
User-agent: Image Stripper User-agent: Image\ Stripper
Disallow:/ Disallow:/
User-agent: Image Sucker User-agent: Image\ Sucker
Disallow:/ Disallow:/
User-agent: Indy Library User-agent: Indy\ Library
Disallow:/ Disallow:/
User-agent: InfoNaviRobot User-agent: InfoNaviRobot
Disallow:/ Disallow:/
@ -336,11 +337,11 @@ User-agent: Intelliseek
Disallow:/ Disallow:/
User-agent: InterGET User-agent: InterGET
Disallow:/ Disallow:/
User-agent: Internet Ninja User-agent: Internet\ Ninja
Disallow:/ Disallow:/
User-agent: InternetSeer User-agent: InternetSeer
Disallow:/ Disallow:/
User-agent: internetVista monitor User-agent: internetVista\ monitor
Disallow:/ Disallow:/
User-agent: Iria User-agent: Iria
Disallow:/ Disallow:/
@ -358,7 +359,7 @@ User-agent: JetCar
Disallow:/ Disallow:/
User-agent: JikeSpider User-agent: JikeSpider
Disallow:/ Disallow:/
User-agent: JOC Web Spider User-agent: JOC\ Web\ Spider
Disallow:/ Disallow:/
User-agent: Joomla User-agent: Joomla
Disallow:/ Disallow:/
@ -366,9 +367,9 @@ User-agent: JustView
Disallow:/ Disallow:/
User-agent: Jyxobot User-agent: Jyxobot
Disallow:/ Disallow:/
User-agent: Kenjin Spider User-agent: Kenjin\ Spider
Disallow:/ Disallow:/
User-agent: Keyword Density User-agent: Keyword\ Density
Disallow:/ Disallow:/
User-agent: Lanshanbot User-agent: Lanshanbot
Disallow:/ Disallow:/
@ -440,9 +441,9 @@ User-agent: MarkWatch
Disallow:/ Disallow:/
User-agent: Masscan User-agent: Masscan
Disallow:/ Disallow:/
User-agent: Mass Downloader User-agent: Mass\ Downloader
Disallow:/ Disallow:/
User-agent: Mata Hari User-agent: Mata\ Hari
Disallow:/ Disallow:/
User-agent: Meanpathbot User-agent: Meanpathbot
Disallow:/ Disallow:/
@ -452,15 +453,15 @@ User-agent: Metauri
Disallow:/ Disallow:/
User-agent: MFC_Tear_Sample User-agent: MFC_Tear_Sample
Disallow:/ Disallow:/
User-agent: Microsoft Data Access User-agent: Microsoft\ Data\ Access
Disallow:/ Disallow:/
User-agent: Microsoft URL Control User-agent: Microsoft\ URL\ Control
Disallow:/ Disallow:/
User-agent: MIDown tool User-agent: MIDown\ tool
Disallow:/ Disallow:/
User-agent: MIIxpc User-agent: MIIxpc
Disallow:/ Disallow:/
User-agent: Mister PiX User-agent: Mister\ PiX
Disallow:/ Disallow:/
User-agent: MJ12bot User-agent: MJ12bot
Disallow:/ Disallow:/
@ -468,17 +469,17 @@ User-agent: Mojeek
Disallow:/ Disallow:/
User-agent: MSFrontPage User-agent: MSFrontPage
Disallow:/ Disallow:/
User-agent: MSIE 6.0 User-agent: MSIE\ 6.0
Disallow:/ Disallow:/
User-agent: MSIECrawler User-agent: MSIECrawler
Disallow:/ Disallow:/
User-agent: Msrabot User-agent: Msrabot
Disallow:/ Disallow:/
User-agent: MS Web Services Client Protocol User-agent: MS\ Web\ Services\ Client\ Protocol
Disallow:/ Disallow:/
User-agent: Musobot User-agent: Musobot
Disallow:/ Disallow:/
User-agent: Name Intelligence User-agent: Name\ Intelligence
Disallow:/ Disallow:/
User-agent: Nameprotect User-agent: Nameprotect
Disallow:/ Disallow:/
@ -494,7 +495,7 @@ User-agent: NetAnts
Disallow:/ Disallow:/
User-agent: Netcraft User-agent: Netcraft
Disallow:/ Disallow:/
User-agent: netEstate NE Crawler User-agent: netEstate\ NE\ Crawler
Disallow:/ Disallow:/
User-agent: NetLyzer User-agent: NetLyzer
Disallow:/ Disallow:/
@ -504,7 +505,7 @@ User-agent: NetSpider
Disallow:/ Disallow:/
User-agent: Nettrack User-agent: Nettrack
Disallow:/ Disallow:/
User-agent: Net Vampire User-agent: Net\ Vampire
Disallow:/ Disallow:/
User-agent: NetZIP User-agent: NetZIP
Disallow:/ Disallow:/
@ -530,9 +531,9 @@ User-agent: Nutch
Disallow:/ Disallow:/
User-agent: Octopus User-agent: Octopus
Disallow:/ Disallow:/
User-agent: Offline Explorer User-agent: Offline\ Explorer
Disallow:/ Disallow:/
User-agent: Offline Navigator User-agent: Offline\ Navigator
Disallow:/ Disallow:/
User-agent: Openfind User-agent: Openfind
Disallow:/ Disallow:/
@ -548,19 +549,19 @@ User-agent: OutfoxBot
Disallow:/ Disallow:/
User-agent: PageAnalyzer User-agent: PageAnalyzer
Disallow:/ Disallow:/
User-agent: Page Analyzer User-agent: Page\ Analyzer
Disallow:/ Disallow:/
User-agent: PageGrabber User-agent: PageGrabber
Disallow:/ Disallow:/
User-agent: Page Grabber User-agent: Page\ Grabber
Disallow:/ Disallow:/
User-agent: page scorer User-agent: page\ scorer
Disallow:/ Disallow:/
User-agent: PageScorer User-agent: PageScorer
Disallow:/ Disallow:/
User-agent: Panscient User-agent: Panscient
Disallow:/ Disallow:/
User-agent: Papa Foto User-agent: Papa\ Foto
Disallow:/ Disallow:/
User-agent: Pavuk User-agent: Pavuk
Disallow:/ Disallow:/
@ -602,7 +603,7 @@ User-agent: Pump
Disallow:/ Disallow:/
User-agent: PyCurl User-agent: PyCurl
Disallow:/ Disallow:/
User-agent: QueryN Metasearch User-agent: QueryN\ Metasearch
Disallow:/ Disallow:/
User-agent: Qwantify User-agent: Qwantify
Disallow:/ Disallow:/
@ -640,7 +641,7 @@ User-agent: Scrapy
Disallow:/ Disallow:/
User-agent: Screaming User-agent: Screaming
Disallow:/ Disallow:/
User-agent: Screaming Frog SEO Spider User-agent: Screaming\ Frog\ SEO\ Spider
Disallow:/ Disallow:/
User-agent: ScreenerBot User-agent: ScreenerBot
Disallow:/ Disallow:/
@ -668,7 +669,7 @@ User-agent: Siphon
Disallow:/ Disallow:/
User-agent: SISTRIX User-agent: SISTRIX
Disallow:/ Disallow:/
User-agent: SISTRIX Crawler User-agent: SISTRIX\ Crawler
Disallow:/ Disallow:/
User-agent: Sitebeam User-agent: Sitebeam
Disallow:/ Disallow:/
@ -682,7 +683,7 @@ User-agent: SiteSnagger
Disallow:/ Disallow:/
User-agent: SiteSucker User-agent: SiteSucker
Disallow:/ Disallow:/
User-agent: Site Sucker User-agent: Site\ Sucker
Disallow:/ Disallow:/
User-agent: Sitevigil User-agent: Sitevigil
Disallow:/ Disallow:/
@ -700,7 +701,7 @@ User-agent: Snoopy
Disallow:/ Disallow:/
User-agent: SocialRankIOBot User-agent: SocialRankIOBot
Disallow:/ Disallow:/
User-agent: Sogou web spider User-agent: Sogou\ web\ spider
Disallow:/ Disallow:/
User-agent: Sosospider User-agent: Sosospider
Disallow:/ Disallow:/
@ -762,7 +763,7 @@ User-agent: Telesphoreo
Disallow:/ Disallow:/
User-agent: Telesphorep User-agent: Telesphorep
Disallow:/ Disallow:/
User-agent: The Intraformant User-agent: The\ Intraformant
Disallow:/ Disallow:/
User-agent: TheNomad User-agent: TheNomad
Disallow:/ Disallow:/
@ -782,9 +783,9 @@ User-agent: Turingos
Disallow:/ Disallow:/
User-agent: TurnitinBot User-agent: TurnitinBot
Disallow:/ Disallow:/
User-agent: Turnitin Bot User-agent: Turnitin\ Bot
Disallow:/ Disallow:/
User-agent: Turnitin Robot User-agent: Turnitin\ Robot
Disallow:/ Disallow:/
User-agent: TwengaBot User-agent: TwengaBot
Disallow:/ Disallow:/
@ -796,13 +797,13 @@ User-agent: UnisterBot
Disallow:/ Disallow:/
User-agent: URLy.Warning User-agent: URLy.Warning
Disallow:/ Disallow:/
User-agent: URLy Warning User-agent: URLy\ Warning
Disallow:/ Disallow:/
User-agent: Vacuum User-agent: Vacuum
Disallow:/ Disallow:/
User-agent: Vagabondo User-agent: Vagabondo
Disallow:/ Disallow:/
User-agent: VB Project User-agent: VB\ Project
Disallow:/ Disallow:/
User-agent: VCI User-agent: VCI
Disallow:/ Disallow:/
@ -828,41 +829,41 @@ User-agent: Webalta
Disallow:/ Disallow:/
User-agent: WebAuto User-agent: WebAuto
Disallow:/ Disallow:/
User-agent: Web Auto User-agent: Web\ Auto
Disallow:/ Disallow:/
User-agent: WebBandit User-agent: WebBandit
Disallow:/ Disallow:/
User-agent: Web Bandit User-agent: Web\ Bandit
Disallow:/ Disallow:/
User-agent: WebCollage User-agent: WebCollage
Disallow:/ Disallow:/
User-agent: Web Collage User-agent: Web\ Collage
Disallow:/ Disallow:/
User-agent: WebCopier User-agent: WebCopier
Disallow:/ Disallow:/
User-agent: Web Copier User-agent: Web\ Copier
Disallow:/ Disallow:/
User-agent: WEBDAV User-agent: WEBDAV
Disallow:/ Disallow:/
User-agent: WEBDAV Client User-agent: WEBDAV\ Client
Disallow:/ Disallow:/
User-agent: WebEnhancer User-agent: WebEnhancer
Disallow:/ Disallow:/
User-agent: Web Enhancer User-agent: Web\ Enhancer
Disallow:/ Disallow:/
User-agent: WebFetch User-agent: WebFetch
Disallow:/ Disallow:/
User-agent: Web Fetch User-agent: Web\ Fetch
Disallow:/ Disallow:/
User-agent: WebFuck User-agent: WebFuck
Disallow:/ Disallow:/
User-agent: Web Fuck User-agent: Web\ Fuck
Disallow:/ Disallow:/
User-agent: WebGo IS User-agent: WebGo\ IS
Disallow:/ Disallow:/
User-agent: WebImageCollector User-agent: WebImageCollector
Disallow:/ Disallow:/
User-agent: Web Image Collector User-agent: Web\ Image\ Collector
Disallow:/ Disallow:/
User-agent: WebLeacher User-agent: WebLeacher
Disallow:/ Disallow:/
@ -872,39 +873,39 @@ User-agent: webmeup-crawler
Disallow:/ Disallow:/
User-agent: WebPix User-agent: WebPix
Disallow:/ Disallow:/
User-agent: Web Pix User-agent: Web\ Pix
Disallow:/ Disallow:/
User-agent: WebReaper User-agent: WebReaper
Disallow:/ Disallow:/
User-agent: Web Reaper User-agent: Web\ Reaper
Disallow:/ Disallow:/
User-agent: WebSauger User-agent: WebSauger
Disallow:/ Disallow:/
User-agent: Web Sauger User-agent: Web\ Sauger
Disallow:/ Disallow:/
User-agent: Webshag User-agent: Webshag
Disallow:/ Disallow:/
User-agent: WebsiteExtractor User-agent: WebsiteExtractor
Disallow:/ Disallow:/
User-agent: Website Extractor User-agent: Website\ Extractor
Disallow:/ Disallow:/
User-agent: WebsiteQuester User-agent: WebsiteQuester
Disallow:/ Disallow:/
User-agent: Website Quester User-agent: Website\ Quester
Disallow:/ Disallow:/
User-agent: Webster User-agent: Webster
Disallow:/ Disallow:/
User-agent: WebStripper User-agent: WebStripper
Disallow:/ Disallow:/
User-agent: Web Stripper User-agent: Web\ Stripper
Disallow:/ Disallow:/
User-agent: WebSucker User-agent: WebSucker
Disallow:/ Disallow:/
User-agent: Web Sucker User-agent: Web\ Sucker
Disallow:/ Disallow:/
User-agent: WebWhacker User-agent: WebWhacker
Disallow:/ Disallow:/
User-agent: Web Whacker User-agent: Web\ Whacker
Disallow:/ Disallow:/
User-agent: WebZIP User-agent: WebZIP
Disallow:/ Disallow:/
@ -920,7 +921,7 @@ User-agent: Widow
Disallow:/ Disallow:/
User-agent: WinHTTrack User-agent: WinHTTrack
Disallow:/ Disallow:/
User-agent: WiseGuys Robot User-agent: WiseGuys\ Robot
Disallow:/ Disallow:/
User-agent: WISENutbot User-agent: WISENutbot
Disallow:/ Disallow:/
@ -946,7 +947,7 @@ User-agent: x22Mozilla
Disallow:/ Disallow:/
User-agent: Xaldon_WebSpider User-agent: Xaldon_WebSpider
Disallow:/ Disallow:/
User-agent: Xaldon WebSpider User-agent: Xaldon\ WebSpider
Disallow:/ Disallow:/
User-agent: Xenu User-agent: Xenu
Disallow:/ Disallow:/
@ -968,3 +969,4 @@ User-agent: ZumBot
Disallow:/ Disallow:/
User-agent: ZyBorg User-agent: ZyBorg
Disallow:/ Disallow:/

5
travisCI/globalblacklist.template
View file

@ -139,11 +139,9 @@ map $http_user_agent $bad_bot {
"~Kraken/0.1" 0; "~Kraken/0.1" 0;
"~LinkedInBot" 0; "~LinkedInBot" 0;
"~Mediapartners-Google" 0; "~Mediapartners-Google" 0;
"~Mozilla/5.0" 0;
"~msnbot" 0; "~msnbot" 0;
"~msnbot-media" 0; "~msnbot-media" 0;
"~SAMSUNG" 0; "~SAMSUNG" 0;
"~SAMSUNG-SGH-E250" 0;
"~slurp" 0; "~slurp" 0;
"~teoma" 0; "~teoma" 0;
"~TwitterBot" 0; "~TwitterBot" 0;
@ -260,7 +258,6 @@ map $http_user_agent $bad_bot {
"~Claritybot" 3; "~Claritybot" 3;
"~Cliqzbot" 3; "~Cliqzbot" 3;
"~Cogentbot" 3; "~Cogentbot" 3;
"~cognitiveseo" 3;
"~Collector" 3; "~Collector" 3;
"~Copier" 3; "~Copier" 3;
"~CopyRightCheck" 3; "~CopyRightCheck" 3;
@ -339,6 +336,7 @@ map $http_user_agent $bad_bot {
"~GrapeshotCrawler" 3; "~GrapeshotCrawler" 3;
"~GridBot" 3; "~GridBot" 3;
"~GT::WWW" 3; "~GT::WWW" 3;
"~GuzzleHttp" 3;
"~HaosouSpider" 3; "~HaosouSpider" 3;
"~Harvest" 3; "~Harvest" 3;
"~Havij" 3; "~Havij" 3;
@ -526,7 +524,6 @@ map $http_user_agent $bad_bot {
"~SEOlyticsCrawler" 3; "~SEOlyticsCrawler" 3;
"~Seomoz" 3; "~Seomoz" 3;
"~SEOprofiler" 3; "~SEOprofiler" 3;
"~seoscanners" 3;
"~SEOstats" 3; "~SEOstats" 3;
"~Siphon" 3; "~Siphon" 3;
"~SISTRIX" 3; "~SISTRIX" 3;