vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-02 02:29:58 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
3451 commits 2 branches 2980 tags 633 MiB
Commit graph

3451 commits

This branch
This branch
All branches
Author SHA1 Message Date
Travis
c32e1f9059 V4.2021.01.2242 [ci skip] 2021-01-04 13:26:08 +02:00
Mitchell Krog
91a03d1b91
Update Bad Referrers 
REF: https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/pull/423
 2021-01-04 13:12:02 +02:00
Travis
43bbeb156b V4.2021.01.2241 [ci skip] 2021-01-04 12:50:21 +02:00
Mitchell Krog
27894b178d
Merge pull request #423 from doomedraven/patch-2 
Add CensysInspect - thanks @doomedraven merging. Many of them are already being blocked from the daily list of IP's from badips.com

```
:74.120.14.33 - - xxxxxx [17/Oct/2020:08:01:30 +0200] "GET / HTTP/1.1" 301 162 "-" "Mozilla/5.0 (compatible; CensysInspect/1.1; +https://about.censys.io/)" "-"PORT:80 0.000 - . "GZIP:-"
:74.120.14.33 - - xxxxxx [17/Oct/2020:08:01:31 +0200] "GET / HTTP/1.1" 200 18619 "-" "Mozilla/5.0 (compatible; CensysInspect/1.1; +https://about.censys.io/)" "-"PORT:443 0.000 - . "GZIP:5.14"
:74.120.14.50 - - xxxxxx [25/Oct/2020:01:34:51 +0200] "GET / HTTP/1.1" 301 162 "-" "Mozilla/5.0 (compatible; CensysInspect/1.1; +https://about.censys.io/)" "-"PORT:80 0.000 - . "GZIP:-"
:74.120.14.50 - - xxxxxx [25/Oct/2020:01:34:52 +0200] "GET / HTTP/1.1" 200 18618 "-" "Mozilla/5.0 (compatible; CensysInspect/1.1; +https://about.censys.io/)" "-"PORT:443 0.494 0.496 . "GZIP:5.14"
:162.142.125.36 - - xxxxxx [25/Oct/2020:01:35:31 +0200] "GET / HTTP/1.1" 200 18618 "-" "Mozilla/5.0 (compatible; CensysInspect/1.1; +https://about.censys.io/)" "-"PORT:443 0.000 - . "GZIP:5.14"
:162.142.125.50 - - xxxxxx [28/Oct/2020:02:09:33 +0200] "GET / HTTP/1.1" 301 162 "-" "Mozilla/5.0 (compatible; CensysInspect/1.1; +https://about.censys.io/)" "-"PORT:80 0.000 - . "GZIP:-"
:162.142.125.50 - - xxxxxx [28/Oct/2020:02:09:34 +0200] "GET / HTTP/1.1" 200 18619 "-" "Mozilla/5.0 (compatible; CensysInspect/1.1; +https://about.censys.io/)" "-"PORT:443 0.423 0.420 . "GZIP:5.14"
:162.142.125.50 - - xxxxxx [28/Oct/2020:02:09:39 +0200] "GET / HTTP/1.1" 200 18619 "-" "Mozilla/5.0 (compatible; CensysInspect/1.1; +https://about.censys.io/)" "-"PORT:443 0.000 - . "GZIP:5.14"
:162.142.125.49 - - xxxxxx [04/Nov/2020:17:02:02 +0200] "GET / HTTP/1.1" 200 19392 "-" "Mozilla/5.0 (compatible; CensysInspect/1.1; +https://about.censys.io/)" "-"PORT:443 0.000 - . "GZIP:5.32"
:162.142.125.49 - - xxxxxx [04/Nov/2020:17:02:10 +0200] "GET / HTTP/1.1" 301 162 "-" "Mozilla/5.0 (compatible; CensysInspect/1.1; +https://about.censys.io/)" "-"PORT:80 0.000 - . "GZIP:-"
:162.142.125.49 - - xxxxxx [04/Nov/2020:17:02:11 +0200] "GET / HTTP/1.1" 200 19392 "-" "Mozilla/5.0 (compatible; CensysInspect/1.1; +https://about.censys.io/)" "-"PORT:443 0.000 - . "GZIP:5.32"
:162.142.125.38 - - xxxxxx [12/Nov/2020:00:58:54 +0200] "GET / HTTP/1.1" 301 162 "-" "Mozilla/5.0 (compatible; CensysInspect/1.1; +https://about.censys.io/)" "-"PORT:80 0.000 - . "GZIP:-"
:162.142.125.38 - - xxxxxx [12/Nov/2020:00:58:55 +0200] "GET / HTTP/1.1" 200 19412 "-" "Mozilla/5.0 (compatible; CensysInspect/1.1; +https://about.censys.io/)" "-"PORT:443 0.000 - . "GZIP:5.30"
:162.142.125.56 - - xxxxxx [12/Nov/2020:00:58:58 +0200] "GET / HTTP/1.1" 200 19412 "-" "Mozilla/5.0 (compatible; CensysInspect/1.1; +https://about.censys.io/)" "-"PORT:443 0.000 - . "GZIP:5.30"
:162.142.125.37 - - xxxxxx [24/Nov/2020:20:59:38 +0200] "GET / HTTP/1.1" 444 0 "-" "Mozilla/5.0 (compatible; CensysInspect/1.1; +https://about.censys.io/)" "-"PORT:443 0.000 - . "GZIP:-"
:162.142.125.39 - - xxxxxx [24/Nov/2020:20:59:52 +0200] "GET / HTTP/1.1" 444 0 "-" "Mozilla/5.0 (compatible; CensysInspect/1.1; +https://about.censys.io/)" "-"PORT:80 0.000 - . "GZIP:-"
:74.120.14.56 - - xxxxxx [24/Nov/2020:21:15:45 +0200] "GET / HTTP/1.1" 444 0 "-" "Mozilla/5.0 (compatible; CensysInspect/1.1; +https://about.censys.io/)" "-"PORT:443 0.000 - . "GZIP:-"
:74.120.14.53 - - xxxxxx [24/Nov/2020:21:16:08 +0200] "GET / HTTP/1.1" 444 0 "-" "Mozilla/5.0 (compatible; CensysInspect/1.1; +https://about.censys.io/)" "-"PORT:80 0.000 - . "GZIP:-"
:167.248.133.37 - - xxxxxx [24/Nov/2020:21:23:32 +0200] "GET / HTTP/1.1" 444 0 "-" "Mozilla/5.0 (compatible; CensysInspect/1.1; +https://about.censys.io/)" "-"PORT:443 0.000 - . "GZIP:-"
:167.248.133.54 - - xxxxxx [24/Nov/2020:21:23:45 +0200] "GET / HTTP/1.1" 444 0 "-" "Mozilla/5.0 (compatible; CensysInspect/1.1; +https://about.censys.io/)" "-"PORT:80 0.000 - . "GZIP:-"
:167.248.133.39 - - xxxxxx [25/Nov/2020:02:07:16 +0200] "GET / HTTP/1.1" 444 0 "-" "Mozilla/5.0 (compatible; CensysInspect/1.1; +https://about.censys.io/)" "-"PORT:80 0.000 - . "GZIP:-"
:167.248.133.39 - - xxxxxx [25/Nov/2020:02:07:18 +0200] "GET / HTTP/1.1" 444 0 "-" "Mozilla/5.0 (compatible; CensysInspect/1.1; +https://about.censys.io/)" "-"PORT:443 0.000 - . "GZIP:-"
:167.248.133.53 - - xxxxxx [25/Nov/2020:02:15:39 +0200] "GET / HTTP/1.1" 444 0 "-" "Mozilla/5.0 (compatible; CensysInspect/1.1; +https://about.censys.io/)" "-"PORT:80 0.000 - . "GZIP:-"
:167.248.133.53 - - xxxxxx [25/Nov/2020:02:15:40 +0200] "GET / HTTP/1.1" 444 0 "-" "Mozilla/5.0 (compatible; CensysInspect/1.1; +https://about.censys.io/)" "-"PORT:443 0.000 - . "GZIP:-"
:162.142.125.40 - - xxxxxx [25/Nov/2020:02:25:52 +0200] "GET / HTTP/1.1" 444 0 "-" "Mozilla/5.0 (compatible; CensysInspect/1.1; +https://about.censys.io/)" "-"PORT:80 0.000 - . "GZIP:-"
:162.142.125.40 - - xxxxxx [25/Nov/2020:02:25:53 +0200] "GET / HTTP/1.1" 444 0 "-" "Mozilla/5.0 (compatible; CensysInspect/1.1; +https://about.censys.io/)" "-"PORT:443 0.000 - . "GZIP:-"
:162.142.125.55 - - xxxxxx [01/Jan/2021:02:05:32 +0200] "GET / HTTP/1.1" 444 0 "-" "Mozilla/5.0 (compatible; CensysInspect/1.1; +https://about.censys.io/)" "-"PORT:80 0.000 - . "GZIP:-"
:162.142.125.55 - - xxxxxx [01/Jan/2021:02:05:33 +0200] "GET / HTTP/1.1" 444 0 "-" "Mozilla/5.0 (compatible; CensysInspect/1.1; +https://about.censys.io/)" "-"PORT:443 0.000 - . "GZIP:-"

```
 2021-01-04 12:38:08 +02:00
Travis
86580be9e3 V4.2021.01.2240 [ci skip] 2021-01-04 12:29:42 +02:00
Mitchell Krog
6f0186fda8
Update bad Referrers 
REF: https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/pull/420
 2021-01-04 12:17:07 +02:00
Travis
f6051266aa V4.2021.01.2239 [ci skip] 2021-01-04 12:10:06 +02:00
Mitchell Krog
f6ed5fcb32
Merge pull request #420 from uded/uded-zoombot_velen_cocolyze 
Uded zoombot velen cocolyze

Thank you for the PR @uded merging.
 2021-01-04 11:57:43 +02:00
Travis
3121c3e595 V4.2021.01.2238 [ci skip] 2021-01-04 11:20:10 +02:00
Mitchell Krog
cc666bc696
Merge pull request #421 from ics-forks/master 
Add spammy referrals
 2021-01-04 11:08:12 +02:00
Travis
dcf505d82e V4.2021.01.2237 [ci skip] 2021-01-04 00:52:34 +02:00
ics
3881735f99 Remove good my.pixsy.com referral 2021-01-03 13:44:55 +00:00
doomedraven
9774622914
Add CensysInspect 
167.248.133.40 - - [03/Jan/2021:09:19:31 +0000] "GET / HTTP/1.1" 301 169 "-" "Mozilla/5.0 (compatible; CensysInspect/1.1; +https://about.censys.io/)" "-"
 2021-01-03 10:26:42 +01:00
ics
1219e7f7d8 Add spammy referrals 2021-01-03 01:02:37 +00:00
Łukasz Rżanek
629429aacc
Update bad-user-agents.list 
Adding:
* Cocolyze bot: `Mozilla/5.0 (compatible; Cocolyzebot/1.0; https://cocolyze.com/bot)`
  Actually, whatever it is. I cannot access the given link from any location (tried four different networks!). I always get the Cloudflare lock page. So, sorry, bad crawler as it doesn't even want me to identify it.
* ZoomBot/LiknBot - different user agents!, i.e.: `ZoomBot (Linkbot 1.0 http://suite.seozoom.it/bot.html)`
  No information if they obey robots.txt, because when I go to the given URL I am informed the website is only available for paying customers. So, sorry, no...
* Velen - `Mozilla/5.0 (compatible; VelenPublicWebCrawler/1.0; +https://velen.io)`
  Link takes me to a Google 404 page. Strange. Crawling my website like crazy, not obeying (as far as I can tell) robots.txt.
 2021-01-02 15:46:38 +01:00
Łukasz Rżanek
22b952b5f5
Merge pull request #1 from mitchellkrogza/master 
Updating
 2021-01-02 15:37:48 +01:00
Travis
18e469d230 V4.2021.01.2230 [ci skip] 2021-01-02 15:47:42 +02:00
Mitchell Krog
61bf0219af
Update bad-user-agents.list 
REF: https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/pull/416
REF: https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/pull/417/files
 2021-01-02 15:35:54 +02:00
Travis
b11630cba2 V4.2021.01.2229 [ci skip] 2021-01-02 14:26:07 +02:00
Mitchell Krog
1565505232
Update README.md 
REF: https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/pull/415
 2021-01-02 14:14:25 +02:00
Travis
211e5f0de1 V4.2021.01.2228 [ci skip] 2021-01-02 14:09:18 +02:00
Mitchell Krog
f78411584a
Merge pull request #418 from mitchellkrogza/revert-415-patch-1 
Revert "Update README.md"
 2021-01-02 13:57:23 +02:00
Mitchell Krog
03f8d00909
Revert "Update README.md" 2021-01-02 12:23:28 +02:00
Travis
a6d6cfafbd V4.2021.01.2208 [ci skip] 2021-01-01 00:50:04 +02:00
Travis
c8440659dd V4.2020.12.2207 [ci skip] 2020-12-30 00:50:28 +02:00
Travis
f479d3493a V4.2020.12.2205 [ci skip] 2020-12-28 09:26:55 +02:00
Mitchell Krog
fe8f5c1cf6
Update bad-referrers.list 
Spammy referrers
 2020-12-28 09:14:43 +02:00
Travis
da8b68bb60 V4.2020.12.2204 [ci skip] 2020-12-28 00:47:15 +02:00
Travis
c66af1c397 V4.2020.12.2202 [ci skip] 2020-12-26 00:46:32 +02:00
Travis
0b51ac1fa9 V4.2020.12.2201 [ci skip] 2020-12-24 00:50:46 +02:00
Travis
ccd38ad8ea V4.2020.12.2199 [ci skip] 2020-12-22 12:10:45 +02:00
Mitchell Krog
49a0838e86
Update bad-referrers.list 
Some more spammy referrers
 2020-12-22 11:55:28 +02:00
Travis
93c201e7ef V4.2020.12.2198 [ci skip] 2020-12-21 00:44:02 +02:00
Travis
0acc3b4b36 V4.2020.12.2197 [ci skip] 2020-12-19 08:26:40 +02:00
Mitchell Krog
ed3fca750a
Update bad-referrers.list 
Image hotlinking
 2020-12-19 08:14:10 +02:00
Travis
25b8ccac0d V4.2020.12.2196 [ci skip] 2020-12-18 01:18:29 +02:00
Travis
ac974f173f V4.2020.12.2195 [ci skip] 2020-12-16 10:24:45 +02:00
Mitchell Krog
291daf8b91
Update bad-referrers.list 
Another wallpaper site hot-linking images
 2020-12-16 10:01:51 +02:00
Travis
2e1202491b V4.2020.12.2194 [ci skip] 2020-12-15 09:10:06 +02:00
Mitchell Krog
92db3351d3
Update bad-referrers.list 
Another sneaky redirect domain to xtraffic
 2020-12-15 08:41:44 +02:00
Travis
1e039f3e16 V4.2020.12.2193 [ci skip] 2020-12-14 09:48:49 +02:00
Mitchell Krog
3a39d469c0
Update bad-user-agents.list 
Another pesky crawler - Pandalytics/1.0
 2020-12-14 09:35:57 +02:00
Travis
31342e5443 V4.2020.12.2192 [ci skip] 2020-12-13 00:57:24 +02:00
Travis
e6659ff0fb V4.2020.12.2191 [ci skip] 2020-12-11 02:25:06 +02:00
Travis
ed6c09957c V4.2020.12.2190 [ci skip] 2020-12-09 11:25:28 +02:00
Mitchell Krog
0b5165f886
Update bad-referrers.list 2020-12-09 10:45:14 +02:00
Travis
5ac1041155 V4.2020.12.2189 [ci skip] 2020-12-08 01:31:58 +02:00
Travis
648b56535f V4.2020.12.2188 [ci skip] 2020-12-06 00:37:04 +02:00
Travis
93a8fb97b3 V4.2020.12.2187 [ci skip] 2020-12-04 11:13:21 +02:00
Mitchell Krog
b2bdbe6c44
Update bad-user-agents.list 2020-12-04 10:18:28 +02:00