vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-02 18:50:13 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
3643 commits 2 branches 2981 tags 634 MiB
Commit graph

187 commits

Author SHA1 Message Date
Travis
03e8a7cd0d V4.2021.06.2368 [ci skip] 2021-06-02 16:09:47 +02:00
Mitchell Krog
be80c14b57
Update bad-user-agents.list 2021-06-02 15:57:41 +02:00
Travis
e38e86b94a V4.2021.05.2363 [ci skip] 2021-05-27 08:55:39 +02:00
Mitchell Krog
e005970c39
+ UA [ci skip] 2021-05-27 08:43:12 +02:00
Travis
4997ad0ead V4.2021.05.2362 [ci skip] 2021-05-27 08:29:47 +02:00
Mitchell Krog
5bdd231a53
Update bad-user-agents.list 2021-05-27 08:17:40 +02:00
Travis
ea98352feb V4.2021.02.2284 [ci skip] 2021-02-18 10:35:38 +02:00
Mitchell Krog
f15720ab89
Update UA [skip ci] 2021-02-18 10:21:00 +02:00
Mitchell Krog
c0d861b141
Remove node-fetch 
Ref: https://github.com/mitchellkrogza/apache-ultimate-bad-bot-blocker/issues/150
 2021-02-10 05:38:11 +02:00
Travis
bc81eb2d51 V4.2021.02.2274 [ci skip] 2021-02-08 09:51:37 +02:00
Mitchell Krog
d55ca21398
Update bad-user-agents.list 2021-02-08 09:39:29 +02:00
Mitchell Krog
247f71f1e0
Update UA [skip ci] 2021-02-08 09:37:40 +02:00
Travis
09a953987d V4.2021.02.2273 [ci skip] 2021-02-08 08:55:25 +02:00
Mitchell Krog
e009688cea
Update bad-user-agents.list 2021-02-08 08:43:36 +02:00
Mitchell Krog
a27cc5a10e
Update bad-user-agents.list 2021-02-06 09:25:12 +02:00
Travis
137ff4f650 V4.2021.02.2269 [ci skip] 2021-02-05 10:06:00 +02:00
Mitchell Krog
de874654f9
Update bad-user-agents.list 2021-02-05 09:51:38 +02:00
Travis
27e64f20b6 V4.2021.02.2268 [ci skip] 2021-02-05 09:50:29 +02:00
Mitchell Krog
380cc31555
Update bad-user-agents.list 2021-02-05 09:36:17 +02:00
Mitchell Krog
41a3d7f793
Update user-agents [skip ci] 2021-02-05 08:48:22 +02:00
Travis
17f8fc36ee V4.2021.02.2266 [ci skip] 2021-02-04 10:25:12 +02:00
Mitchell Krog
856919363a
Update bad-user-agents [ci skip] 2021-02-04 10:04:16 +02:00
Travis
1ed8ca5096 V4.2021.02.2263 [ci skip] 2021-02-02 09:47:24 +02:00
Mitchell Krog
9c7324d9a7
Update bad-user-agents.list 2021-02-02 09:08:46 +02:00
Travis
43bbeb156b V4.2021.01.2241 [ci skip] 2021-01-04 12:50:21 +02:00
Mitchell Krog
27894b178d
Merge pull request #423 from doomedraven/patch-2 
Add CensysInspect - thanks @doomedraven merging. Many of them are already being blocked from the daily list of IP's from badips.com

```
:74.120.14.33 - - xxxxxx [17/Oct/2020:08:01:30 +0200] "GET / HTTP/1.1" 301 162 "-" "Mozilla/5.0 (compatible; CensysInspect/1.1; +https://about.censys.io/)" "-"PORT:80 0.000 - . "GZIP:-"
:74.120.14.33 - - xxxxxx [17/Oct/2020:08:01:31 +0200] "GET / HTTP/1.1" 200 18619 "-" "Mozilla/5.0 (compatible; CensysInspect/1.1; +https://about.censys.io/)" "-"PORT:443 0.000 - . "GZIP:5.14"
:74.120.14.50 - - xxxxxx [25/Oct/2020:01:34:51 +0200] "GET / HTTP/1.1" 301 162 "-" "Mozilla/5.0 (compatible; CensysInspect/1.1; +https://about.censys.io/)" "-"PORT:80 0.000 - . "GZIP:-"
:74.120.14.50 - - xxxxxx [25/Oct/2020:01:34:52 +0200] "GET / HTTP/1.1" 200 18618 "-" "Mozilla/5.0 (compatible; CensysInspect/1.1; +https://about.censys.io/)" "-"PORT:443 0.494 0.496 . "GZIP:5.14"
:162.142.125.36 - - xxxxxx [25/Oct/2020:01:35:31 +0200] "GET / HTTP/1.1" 200 18618 "-" "Mozilla/5.0 (compatible; CensysInspect/1.1; +https://about.censys.io/)" "-"PORT:443 0.000 - . "GZIP:5.14"
:162.142.125.50 - - xxxxxx [28/Oct/2020:02:09:33 +0200] "GET / HTTP/1.1" 301 162 "-" "Mozilla/5.0 (compatible; CensysInspect/1.1; +https://about.censys.io/)" "-"PORT:80 0.000 - . "GZIP:-"
:162.142.125.50 - - xxxxxx [28/Oct/2020:02:09:34 +0200] "GET / HTTP/1.1" 200 18619 "-" "Mozilla/5.0 (compatible; CensysInspect/1.1; +https://about.censys.io/)" "-"PORT:443 0.423 0.420 . "GZIP:5.14"
:162.142.125.50 - - xxxxxx [28/Oct/2020:02:09:39 +0200] "GET / HTTP/1.1" 200 18619 "-" "Mozilla/5.0 (compatible; CensysInspect/1.1; +https://about.censys.io/)" "-"PORT:443 0.000 - . "GZIP:5.14"
:162.142.125.49 - - xxxxxx [04/Nov/2020:17:02:02 +0200] "GET / HTTP/1.1" 200 19392 "-" "Mozilla/5.0 (compatible; CensysInspect/1.1; +https://about.censys.io/)" "-"PORT:443 0.000 - . "GZIP:5.32"
:162.142.125.49 - - xxxxxx [04/Nov/2020:17:02:10 +0200] "GET / HTTP/1.1" 301 162 "-" "Mozilla/5.0 (compatible; CensysInspect/1.1; +https://about.censys.io/)" "-"PORT:80 0.000 - . "GZIP:-"
:162.142.125.49 - - xxxxxx [04/Nov/2020:17:02:11 +0200] "GET / HTTP/1.1" 200 19392 "-" "Mozilla/5.0 (compatible; CensysInspect/1.1; +https://about.censys.io/)" "-"PORT:443 0.000 - . "GZIP:5.32"
:162.142.125.38 - - xxxxxx [12/Nov/2020:00:58:54 +0200] "GET / HTTP/1.1" 301 162 "-" "Mozilla/5.0 (compatible; CensysInspect/1.1; +https://about.censys.io/)" "-"PORT:80 0.000 - . "GZIP:-"
:162.142.125.38 - - xxxxxx [12/Nov/2020:00:58:55 +0200] "GET / HTTP/1.1" 200 19412 "-" "Mozilla/5.0 (compatible; CensysInspect/1.1; +https://about.censys.io/)" "-"PORT:443 0.000 - . "GZIP:5.30"
:162.142.125.56 - - xxxxxx [12/Nov/2020:00:58:58 +0200] "GET / HTTP/1.1" 200 19412 "-" "Mozilla/5.0 (compatible; CensysInspect/1.1; +https://about.censys.io/)" "-"PORT:443 0.000 - . "GZIP:5.30"
:162.142.125.37 - - xxxxxx [24/Nov/2020:20:59:38 +0200] "GET / HTTP/1.1" 444 0 "-" "Mozilla/5.0 (compatible; CensysInspect/1.1; +https://about.censys.io/)" "-"PORT:443 0.000 - . "GZIP:-"
:162.142.125.39 - - xxxxxx [24/Nov/2020:20:59:52 +0200] "GET / HTTP/1.1" 444 0 "-" "Mozilla/5.0 (compatible; CensysInspect/1.1; +https://about.censys.io/)" "-"PORT:80 0.000 - . "GZIP:-"
:74.120.14.56 - - xxxxxx [24/Nov/2020:21:15:45 +0200] "GET / HTTP/1.1" 444 0 "-" "Mozilla/5.0 (compatible; CensysInspect/1.1; +https://about.censys.io/)" "-"PORT:443 0.000 - . "GZIP:-"
:74.120.14.53 - - xxxxxx [24/Nov/2020:21:16:08 +0200] "GET / HTTP/1.1" 444 0 "-" "Mozilla/5.0 (compatible; CensysInspect/1.1; +https://about.censys.io/)" "-"PORT:80 0.000 - . "GZIP:-"
:167.248.133.37 - - xxxxxx [24/Nov/2020:21:23:32 +0200] "GET / HTTP/1.1" 444 0 "-" "Mozilla/5.0 (compatible; CensysInspect/1.1; +https://about.censys.io/)" "-"PORT:443 0.000 - . "GZIP:-"
:167.248.133.54 - - xxxxxx [24/Nov/2020:21:23:45 +0200] "GET / HTTP/1.1" 444 0 "-" "Mozilla/5.0 (compatible; CensysInspect/1.1; +https://about.censys.io/)" "-"PORT:80 0.000 - . "GZIP:-"
:167.248.133.39 - - xxxxxx [25/Nov/2020:02:07:16 +0200] "GET / HTTP/1.1" 444 0 "-" "Mozilla/5.0 (compatible; CensysInspect/1.1; +https://about.censys.io/)" "-"PORT:80 0.000 - . "GZIP:-"
:167.248.133.39 - - xxxxxx [25/Nov/2020:02:07:18 +0200] "GET / HTTP/1.1" 444 0 "-" "Mozilla/5.0 (compatible; CensysInspect/1.1; +https://about.censys.io/)" "-"PORT:443 0.000 - . "GZIP:-"
:167.248.133.53 - - xxxxxx [25/Nov/2020:02:15:39 +0200] "GET / HTTP/1.1" 444 0 "-" "Mozilla/5.0 (compatible; CensysInspect/1.1; +https://about.censys.io/)" "-"PORT:80 0.000 - . "GZIP:-"
:167.248.133.53 - - xxxxxx [25/Nov/2020:02:15:40 +0200] "GET / HTTP/1.1" 444 0 "-" "Mozilla/5.0 (compatible; CensysInspect/1.1; +https://about.censys.io/)" "-"PORT:443 0.000 - . "GZIP:-"
:162.142.125.40 - - xxxxxx [25/Nov/2020:02:25:52 +0200] "GET / HTTP/1.1" 444 0 "-" "Mozilla/5.0 (compatible; CensysInspect/1.1; +https://about.censys.io/)" "-"PORT:80 0.000 - . "GZIP:-"
:162.142.125.40 - - xxxxxx [25/Nov/2020:02:25:53 +0200] "GET / HTTP/1.1" 444 0 "-" "Mozilla/5.0 (compatible; CensysInspect/1.1; +https://about.censys.io/)" "-"PORT:443 0.000 - . "GZIP:-"
:162.142.125.55 - - xxxxxx [01/Jan/2021:02:05:32 +0200] "GET / HTTP/1.1" 444 0 "-" "Mozilla/5.0 (compatible; CensysInspect/1.1; +https://about.censys.io/)" "-"PORT:80 0.000 - . "GZIP:-"
:162.142.125.55 - - xxxxxx [01/Jan/2021:02:05:33 +0200] "GET / HTTP/1.1" 444 0 "-" "Mozilla/5.0 (compatible; CensysInspect/1.1; +https://about.censys.io/)" "-"PORT:443 0.000 - . "GZIP:-"

```
 2021-01-04 12:38:08 +02:00
doomedraven
9774622914
Add CensysInspect 
167.248.133.40 - - [03/Jan/2021:09:19:31 +0000] "GET / HTTP/1.1" 301 169 "-" "Mozilla/5.0 (compatible; CensysInspect/1.1; +https://about.censys.io/)" "-"
 2021-01-03 10:26:42 +01:00
Łukasz Rżanek
629429aacc
Update bad-user-agents.list 
Adding:
* Cocolyze bot: `Mozilla/5.0 (compatible; Cocolyzebot/1.0; https://cocolyze.com/bot)`
  Actually, whatever it is. I cannot access the given link from any location (tried four different networks!). I always get the Cloudflare lock page. So, sorry, bad crawler as it doesn't even want me to identify it.
* ZoomBot/LiknBot - different user agents!, i.e.: `ZoomBot (Linkbot 1.0 http://suite.seozoom.it/bot.html)`
  No information if they obey robots.txt, because when I go to the given URL I am informed the website is only available for paying customers. So, sorry, no...
* Velen - `Mozilla/5.0 (compatible; VelenPublicWebCrawler/1.0; +https://velen.io)`
  Link takes me to a Google 404 page. Strange. Crawling my website like crazy, not obeying (as far as I can tell) robots.txt.
 2021-01-02 15:46:38 +01:00
Travis
18e469d230 V4.2021.01.2230 [ci skip] 2021-01-02 15:47:42 +02:00
Mitchell Krog
61bf0219af
Update bad-user-agents.list 
REF: https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/pull/416
REF: https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/pull/417/files
 2021-01-02 15:35:54 +02:00
Travis
1e039f3e16 V4.2020.12.2193 [ci skip] 2020-12-14 09:48:49 +02:00
Mitchell Krog
3a39d469c0
Update bad-user-agents.list 
Another pesky crawler - Pandalytics/1.0
 2020-12-14 09:35:57 +02:00
Travis
93a8fb97b3 V4.2020.12.2187 [ci skip] 2020-12-04 11:13:21 +02:00
Mitchell Krog
b2bdbe6c44
Update bad-user-agents.list 2020-12-04 10:18:28 +02:00
Mitchell Krog
72c4808c12
Update bad-user-agents.list 2020-11-24 08:49:02 +02:00
Travis
b5bd695219 V4.2020.07.2108 [ci skip] 2020-07-28 09:16:08 +02:00
Mitchell Krog
9a09d72cbf
Update bad-user-agents.list 2020-07-28 09:04:31 +02:00
Travis
3802d3dc9a V4.2020.06.2081 [ci skip] 2020-06-15 11:25:39 +02:00
Mitchell Krog
5a9c2cfcb5
+ Bad Bot - Mozlila 2020-06-15 11:08:03 +02:00
Travis
5594e36132 V4.2020.04.2055 [ci skip] 2020-04-26 10:33:38 +02:00
Mitchell Krog
041661dea9
+BOT - Closes: #378 
domainsproject.org
 2020-04-26 10:21:43 +02:00
Mitchell Krog
ce7c133e1d
Fix Spelling of Aspiegel 2020-04-15 12:10:53 +02:00
Mitchell Krog
52174ef11b
Moving zh_CN zh-CN to limited bots 
REF: #366
 2020-03-14 09:23:54 +02:00
Travis
41078a2384 V4.2020.03.2017 [ci skip] 2020-03-12 15:27:40 +02:00
Mitchell Krog
2972c957d3
+ Aggressive Chinese Scrapers Closes: #364 2020-03-12 15:15:30 +02:00
Ronie Martinez
de86fc75c8 Add "Ankit" and "polaris version" to bad-user-agents.list 2020-02-26 23:32:29 +08:00
Travis
50732ab1ac V4.2019.10.1867 [ci skip] 2019-10-16 09:53:04 +02:00
Mitchell Krog
86214d08f8
Update Bad Referrers | Update Bad User Agents 2019-10-16 09:42:46 +02:00
Mitchell Krog
a576e3457d - [UA] MS Web Services Client Protocol 
REF: https://github.com/mitchellkrogza/apache-ultimate-bad-bot-blocker/pull/132
 2019-08-16 14:24:00 +02:00
Mitchell Krog
1288e4870a
+ RSSingBot 
+ RSSingBot
 2019-08-03 17:11:27 +02:00