Commit graph

3645 commits

Author SHA1 Message Date
Travis
f6051266aa V4.2021.01.2239 [ci skip] 2021-01-04 12:10:06 +02:00
Mitchell Krog
f6ed5fcb32
Merge pull request #420 from uded/uded-zoombot_velen_cocolyze
Uded zoombot velen cocolyze

Thank you for the PR @uded merging.
2021-01-04 11:57:43 +02:00
Travis
3121c3e595 V4.2021.01.2238 [ci skip] 2021-01-04 11:20:10 +02:00
Mitchell Krog
cc666bc696
Merge pull request #421 from ics-forks/master
Add spammy referrals
2021-01-04 11:08:12 +02:00
Travis
dcf505d82e V4.2021.01.2237 [ci skip] 2021-01-04 00:52:34 +02:00
ics
3881735f99 Remove good my.pixsy.com referral 2021-01-03 13:44:55 +00:00
doomedraven
9774622914
Add CensysInspect
167.248.133.40 - - [03/Jan/2021:09:19:31 +0000] "GET / HTTP/1.1" 301 169 "-" "Mozilla/5.0 (compatible; CensysInspect/1.1; +https://about.censys.io/)" "-"
2021-01-03 10:26:42 +01:00
ics
1219e7f7d8 Add spammy referrals 2021-01-03 01:02:37 +00:00
Łukasz Rżanek
629429aacc
Update bad-user-agents.list
Adding:
* Cocolyze bot: `Mozilla/5.0 (compatible; Cocolyzebot/1.0; https://cocolyze.com/bot)`
  Actually, whatever it is. I cannot access the given link from any location (tried four different networks!). I always get the Cloudflare lock page. So, sorry, bad crawler as it doesn't even want me to identify it.
* ZoomBot/LiknBot - different user agents!, i.e.: `ZoomBot (Linkbot 1.0 http://suite.seozoom.it/bot.html)`
  No information if they obey robots.txt, because when I go to the given URL I am informed the website is only available for paying customers. So, sorry, no...
* Velen - `Mozilla/5.0 (compatible; VelenPublicWebCrawler/1.0; +https://velen.io)`
  Link takes me to a Google 404 page. Strange. Crawling my website like crazy, not obeying (as far as I can tell) robots.txt.
2021-01-02 15:46:38 +01:00
Łukasz Rżanek
22b952b5f5
Merge pull request #1 from mitchellkrogza/master
Updating
2021-01-02 15:37:48 +01:00
Travis
18e469d230 V4.2021.01.2230 [ci skip] 2021-01-02 15:47:42 +02:00
Mitchell Krog
61bf0219af
Update bad-user-agents.list
REF: https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/pull/416
REF: https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/pull/417/files
2021-01-02 15:35:54 +02:00
Travis
b11630cba2 V4.2021.01.2229 [ci skip] 2021-01-02 14:26:07 +02:00
Mitchell Krog
1565505232
Update README.md
REF: https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/pull/415
2021-01-02 14:14:25 +02:00
Travis
211e5f0de1 V4.2021.01.2228 [ci skip] 2021-01-02 14:09:18 +02:00
Mitchell Krog
f78411584a
Merge pull request #418 from mitchellkrogza/revert-415-patch-1
Revert "Update README.md"
2021-01-02 13:57:23 +02:00
Mitchell Krog
03f8d00909
Revert "Update README.md" 2021-01-02 12:23:28 +02:00
Travis
a6d6cfafbd V4.2021.01.2208 [ci skip] 2021-01-01 00:50:04 +02:00
Travis
c8440659dd V4.2020.12.2207 [ci skip] 2020-12-30 00:50:28 +02:00
Travis
f479d3493a V4.2020.12.2205 [ci skip] 2020-12-28 09:26:55 +02:00
Mitchell Krog
fe8f5c1cf6
Update bad-referrers.list
Spammy referrers
2020-12-28 09:14:43 +02:00
Travis
da8b68bb60 V4.2020.12.2204 [ci skip] 2020-12-28 00:47:15 +02:00
Travis
c66af1c397 V4.2020.12.2202 [ci skip] 2020-12-26 00:46:32 +02:00
Travis
0b51ac1fa9 V4.2020.12.2201 [ci skip] 2020-12-24 00:50:46 +02:00
Travis
ccd38ad8ea V4.2020.12.2199 [ci skip] 2020-12-22 12:10:45 +02:00
Mitchell Krog
49a0838e86
Update bad-referrers.list
Some more spammy referrers
2020-12-22 11:55:28 +02:00
Travis
93c201e7ef V4.2020.12.2198 [ci skip] 2020-12-21 00:44:02 +02:00
Travis
0acc3b4b36 V4.2020.12.2197 [ci skip] 2020-12-19 08:26:40 +02:00
Mitchell Krog
ed3fca750a
Update bad-referrers.list
Image hotlinking
2020-12-19 08:14:10 +02:00
Travis
25b8ccac0d V4.2020.12.2196 [ci skip] 2020-12-18 01:18:29 +02:00
Travis
ac974f173f V4.2020.12.2195 [ci skip] 2020-12-16 10:24:45 +02:00
Mitchell Krog
291daf8b91
Update bad-referrers.list
Another wallpaper site hot-linking images
2020-12-16 10:01:51 +02:00
Travis
2e1202491b V4.2020.12.2194 [ci skip] 2020-12-15 09:10:06 +02:00
Mitchell Krog
92db3351d3
Update bad-referrers.list
Another sneaky redirect domain to xtraffic
2020-12-15 08:41:44 +02:00
Travis
1e039f3e16 V4.2020.12.2193 [ci skip] 2020-12-14 09:48:49 +02:00
Mitchell Krog
3a39d469c0
Update bad-user-agents.list
Another pesky crawler - Pandalytics/1.0
2020-12-14 09:35:57 +02:00
Travis
31342e5443 V4.2020.12.2192 [ci skip] 2020-12-13 00:57:24 +02:00
Travis
e6659ff0fb V4.2020.12.2191 [ci skip] 2020-12-11 02:25:06 +02:00
Travis
ed6c09957c V4.2020.12.2190 [ci skip] 2020-12-09 11:25:28 +02:00
Mitchell Krog
0b5165f886
Update bad-referrers.list 2020-12-09 10:45:14 +02:00
Travis
5ac1041155 V4.2020.12.2189 [ci skip] 2020-12-08 01:31:58 +02:00
Travis
648b56535f V4.2020.12.2188 [ci skip] 2020-12-06 00:37:04 +02:00
Travis
93a8fb97b3 V4.2020.12.2187 [ci skip] 2020-12-04 11:13:21 +02:00
Mitchell Krog
b2bdbe6c44
Update bad-user-agents.list 2020-12-04 10:18:28 +02:00
Travis
5a104e49ab V4.2020.12.2186 [ci skip] 2020-12-04 10:08:42 +02:00
Mitchell Krog
85e491766b
Update bad-referrers.list 2020-12-04 09:13:26 +02:00
Travis
3690299b54 V4.2020.12.2185 [ci skip] 2020-12-03 15:38:49 +02:00
Mitchell Krog
060809de09
Update bad-referrers.list 2020-12-03 14:27:09 +02:00
Travis
5239844ecf V4.2020.12.2184 [ci skip] 2020-12-02 19:37:17 +02:00
Stuart Cardall
d62132344c
Merge pull request #410 from hong823/update-configurable-files-list
Update full list of configurable files in /etc/nginx/bots.d
2020-12-02 15:51:30 +00:00