Commit graph

294 commits

Author SHA1 Message Date
Travis
41078a2384 V4.2020.03.2017 [ci skip] 2020-03-12 15:27:40 +02:00
Mitchell Krog
2972c957d3
+ Aggressive Chinese Scrapers Closes: #364 2020-03-12 15:15:30 +02:00
Ronie Martinez
de86fc75c8 Add "Ankit" and "polaris version" to bad-user-agents.list 2020-02-26 23:32:29 +08:00
Travis
50732ab1ac V4.2019.10.1867 [ci skip] 2019-10-16 09:53:04 +02:00
Mitchell Krog
86214d08f8
Update Bad Referrers | Update Bad User Agents 2019-10-16 09:42:46 +02:00
Mitchell Krog
a576e3457d - [UA] MS Web Services Client Protocol
REF: https://github.com/mitchellkrogza/apache-ultimate-bad-bot-blocker/pull/132
2019-08-16 14:24:00 +02:00
Mitchell Krog
1288e4870a
+ RSSingBot
+ RSSingBot
2019-08-03 17:11:27 +02:00
Travis
9fa8feb7c2 V4.2019.06.1584 [ci skip] 2019-06-25 08:16:05 +02:00
Mitchell Krog
e5e2946dd1
+ Bad Bot / Thumbor/6.4.2
thumbor is a smart imaging service. It enables on-demand crop, resizing and flipping of images.

It also features a VERY smart detection of important points in the image for better cropping and resizing, using state-of-the-art face and feature detection algorithms (more on that in Detection Algorithms).

https://github.com/thumbor/thumbor
2019-06-25 08:10:26 +02:00
Travis
314995230f V4.2019.06.1583 [ci skip] 2019-06-24 20:42:42 +02:00
Mitchell Krog
c96e78086f
+Bad Bot OutclicksBot 2019-06-24 20:36:53 +02:00
Mitchell Krog
4e325e0f09
Remove Slackbot-LinkExpanding False Positive 2019-06-23 16:42:11 +02:00
Mitchell Krog
3ce74818eb
Remove Bubing from bad-bots Duplicate as it's in rate limited BUbiNG 2019-06-23 11:23:26 +02:00
Travis
0a4b3b0efd V3.2019.06.1437 [ci skip] 2019-06-20 09:35:09 +02:00
Mitchell Krog
b64214033b
Update bad-user-agents 2019-06-20 09:31:47 +02:00
Travis
cc1b102dad V3.2019.06.1436 [ci skip] 2019-06-20 09:11:00 +02:00
Mitchell Krog
5973deddb6
Update bad-user-agents 2019-06-20 09:07:42 +02:00
Travis
f580816ed0 V3.2019.06.1435 [ci skip] 2019-06-19 18:25:29 +02:00
Mitchell Krog
e6eea71f25
Update bad-user-agents 2019-06-19 18:19:45 +02:00
Travis
0925bff34c V3.2019.06.1434 [ci skip] 2019-06-19 10:22:22 +02:00
Mitchell Krog
28d3fc67e8
Update bad-user-agents 2019-06-19 10:19:12 +02:00
Travis
675260442d V3.2019.06.1433 [ci skip] 2019-06-19 10:00:25 +02:00
Mitchell Krog
4a364cc22f
Update bad-user-agents 2019-06-19 09:56:56 +02:00
Travis
e4884c8a26 V3.2019.06.1432 [ci skip] 2019-06-19 09:53:37 +02:00
Mitchell Krog
8eba38de21
Update bad-referrers / Update bad-user-agents 2019-06-19 09:49:54 +02:00
Mitchell Krog
c895de7ddd
Remove x22 cases - Require Exact Matching 2019-04-02 11:05:27 +02:00
Travis
32c69933b0 V3.2019.04.1358 [ci skip] 2019-04-01 13:31:58 +02:00
Mitchell Krog
a6e0e00f05
Update bad-user-agents.list + bad-referrers.list 2019-04-01 13:29:33 +02:00
Travis
e5db42a129 V3.2019.03.1355 [ci skip] 2019-03-28 11:53:17 +02:00
Mitchell Krog
74f4d6f9cb
Update bad-user-agents.list 2019-03-28 11:21:28 +02:00
Mitchell Krog
48e99f5b29 Add Mediatoolkitbot
Closes: #245
2019-01-25 15:10:51 +02:00
Ondrej Simek
6b9c46f47f Remove Seznam.cz from bad user agents. 2019-01-11 11:05:01 +01:00
Travis
a2aeeb4932 V3.2018.08.1176 [ci skip] 2018-08-24 16:57:07 +02:00
Mitchell Krog
14dbf10a21
User-Agents (+)
Closes: #206
2018-08-24 16:54:04 +02:00
Travis
bd6c13629c V3.2018.08.1155 [ci skip] 2018-08-09 11:36:04 +02:00
Mitchell Krog
b326f13416
User-Agent (+) Tracemyfile
REF: https://github.com/mitchellkrogza/apache-ultimate-bad-bot-blocker/pull/93
REF: https://www.webmasterworld.com/search_engine_spiders/4901456.htm
2018-08-09 11:33:10 +02:00
Travis
3bc0f89a34 V3.2018.08.1150 [ci skip] 2018-08-05 17:45:22 +02:00
Mitchell Krog
4582583051
Merge pull request #182 from Jos512/fyberspider
Added FyberSpider bot
2018-08-05 17:42:56 +02:00
Mitchell Krog
9f4914790f
Merge pull request #183 from Jos512/archiveBot
Add archive.org bot
2018-08-05 17:37:14 +02:00
Mitchell Krog
24545724ed
Update User-Agent OpenVAS 2018-07-24 09:08:44 +02:00
Jos512
9778d57afd Added archive bot 2018-06-16 14:27:58 +02:00
Jos512
c380089e90 Added FyberSpider bot 2018-06-16 14:23:23 +02:00
Travis
2a3bc40f73 V3.2018.06.1113 [ci skip] 2018-06-08 10:44:03 +02:00
Mitchell Krog
ec919d888f
Bot (+) Quick-Crawler
Referrer (+) scrapinghub.com
Closes: #181
2018-06-08 10:28:26 +02:00
Travis
cdc76609d9 V3.2018.06.1112 [ci skip] 2018-06-07 11:21:22 +02:00
Mitchell Krog
ad5750f32d
Bot (+) Referrer (+)
- PXBroker / db.speedup.gdn
Closes: #180
2018-06-07 11:12:56 +02:00
Travis
a9ef73b12b V3.2018.06.1109 [ci skip] 2018-06-06 16:46:52 +02:00
Mitchell Krog
fe2647c0e6
User-Agent + - Mr.4x3
Closes: #177
2018-06-06 16:36:40 +02:00
Mitchell Krog
99a41f81e3
Remove "NYU" already covered by "scan.lol"
-REF: ab1c59ad02 (commitcomment-29255444)
2018-06-06 08:40:45 +02:00
Mark Beech
f5fdf6ec02
Update bad-user-agents.list 2018-05-16 21:44:27 +01:00