134 commits

Author	SHA1	Message	Date
Mitchell Krog	c96e78086f	+Bad Bot OutclicksBot	2019-06-24 20:36:53 +02:00
Mitchell Krog	4e325e0f09	Remove Slackbot-LinkExpanding False Positive	2019-06-23 16:42:11 +02:00
Mitchell Krog	3ce74818eb	Remove Bubing from bad-bots Duplicate as it's in rate limited BUbiNG	2019-06-23 11:23:26 +02:00
Travis	0a4b3b0efd	V3.2019.06.1437 [ci skip]	2019-06-20 09:35:09 +02:00
Mitchell Krog	b64214033b	Update bad-user-agents	2019-06-20 09:31:47 +02:00
Travis	cc1b102dad	V3.2019.06.1436 [ci skip]	2019-06-20 09:11:00 +02:00
Mitchell Krog	5973deddb6	Update bad-user-agents	2019-06-20 09:07:42 +02:00
Travis	f580816ed0	V3.2019.06.1435 [ci skip]	2019-06-19 18:25:29 +02:00
Mitchell Krog	e6eea71f25	Update bad-user-agents	2019-06-19 18:19:45 +02:00
Travis	0925bff34c	V3.2019.06.1434 [ci skip]	2019-06-19 10:22:22 +02:00
Mitchell Krog	28d3fc67e8	Update bad-user-agents	2019-06-19 10:19:12 +02:00
Travis	675260442d	V3.2019.06.1433 [ci skip]	2019-06-19 10:00:25 +02:00
Mitchell Krog	4a364cc22f	Update bad-user-agents	2019-06-19 09:56:56 +02:00
Travis	e4884c8a26	V3.2019.06.1432 [ci skip]	2019-06-19 09:53:37 +02:00
Mitchell Krog	8eba38de21	Update bad-referrers / Update bad-user-agents	2019-06-19 09:49:54 +02:00
Mitchell Krog	c895de7ddd	Remove x22 cases - Require Exact Matching	2019-04-02 11:05:27 +02:00
Travis	32c69933b0	V3.2019.04.1358 [ci skip]	2019-04-01 13:31:58 +02:00
Mitchell Krog	a6e0e00f05	Update bad-user-agents.list + bad-referrers.list	2019-04-01 13:29:33 +02:00
Travis	e5db42a129	V3.2019.03.1355 [ci skip]	2019-03-28 11:53:17 +02:00
Mitchell Krog	74f4d6f9cb	Update bad-user-agents.list	2019-03-28 11:21:28 +02:00
Mitchell Krog	48e99f5b29	Add Mediatoolkitbot ... Closes: #245	2019-01-25 15:10:51 +02:00
Ondrej Simek	6b9c46f47f	Remove Seznam.cz from bad user agents.	2019-01-11 11:05:01 +01:00
Travis	a2aeeb4932	V3.2018.08.1176 [ci skip]	2018-08-24 16:57:07 +02:00
Mitchell Krog	14dbf10a21	User-Agents (+) ... Closes: #206	2018-08-24 16:54:04 +02:00
Travis	bd6c13629c	V3.2018.08.1155 [ci skip]	2018-08-09 11:36:04 +02:00
Mitchell Krog	b326f13416	User-Agent (+) Tracemyfile ... REF: https://github.com/mitchellkrogza/apache-ultimate-bad-bot-blocker/pull/93 REF: https://www.webmasterworld.com/search_engine_spiders/4901456.htm	2018-08-09 11:33:10 +02:00
Travis	3bc0f89a34	V3.2018.08.1150 [ci skip]	2018-08-05 17:45:22 +02:00
Mitchell Krog	4582583051	Merge pull request #182 from Jos512/fyberspider ... Added FyberSpider bot	2018-08-05 17:42:56 +02:00
Mitchell Krog	9f4914790f	Merge pull request #183 from Jos512/archiveBot ... Add archive.org bot	2018-08-05 17:37:14 +02:00
Mitchell Krog	24545724ed	Update User-Agent OpenVAS	2018-07-24 09:08:44 +02:00
Jos512	9778d57afd	Added archive bot	2018-06-16 14:27:58 +02:00
Jos512	c380089e90	Added FyberSpider bot	2018-06-16 14:23:23 +02:00
Travis	2a3bc40f73	V3.2018.06.1113 [ci skip]	2018-06-08 10:44:03 +02:00
Mitchell Krog	ec919d888f	Bot (+) Quick-Crawler ... Referrer (+) scrapinghub.com Closes: #181	2018-06-08 10:28:26 +02:00
Travis	cdc76609d9	V3.2018.06.1112 [ci skip]	2018-06-07 11:21:22 +02:00
Mitchell Krog	ad5750f32d	Bot (+) Referrer (+) ... - PXBroker / db.speedup.gdn Closes: #180	2018-06-07 11:12:56 +02:00
Travis	a9ef73b12b	V3.2018.06.1109 [ci skip]	2018-06-06 16:46:52 +02:00
Mitchell Krog	fe2647c0e6	User-Agent + - Mr.4x3 ... Closes: #177	2018-06-06 16:36:40 +02:00
Mitchell Krog	99a41f81e3	Remove "NYU" already covered by "scan.lol" ... -REF: ab1c59ad02 (commitcomment-29255444)	2018-06-06 08:40:45 +02:00
Mark Beech	f5fdf6ec02	Update bad-user-agents.list	2018-05-16 21:44:27 +01:00
Travis	fd87312e39	V3.2018.04.1098 [ci skip]	2018-04-21 13:23:48 +02:00
Mitchell Krog	23fb3f62c6	Referrers (+) / Bots (+)	2018-04-21 13:17:11 +02:00
Travis	5d04fa114d	V3.2018.04.1095 [ci skip]	2018-04-20 11:23:39 +02:00
Mitchell Krog	b4795ed886	Bots (+) ... OutclicksBot	2018-04-20 11:16:50 +02:00
Travis	9ead97e9d6	V3.2018.04.1094 [ci skip]	2018-04-20 09:28:10 +02:00
Mitchell Krog	4f83090d8c	Bots (+) ... Zauba Search for Research; http://www.zauba.io/; admin@zauba.io - Does not request robots.txt	2018-04-20 09:21:32 +02:00
Travis	83596094ae	V3.2018.04.1091 [ci skip]	2018-04-14 16:58:58 +02:00
Mitchell Krog	5a75d55c5e	Merge pull request #153 from StarkRavingZA/master ... Request Re-Addition of RankingBot	2018-04-14 16:55:41 +02:00
Travis	1611ce1591	V3.2018.04.1090 [ci skip]	2018-04-13 09:00:19 +02:00
Mitchell Krog	c56c381dd3	Bots (+) ... IndeedBot Closes: #155	2018-04-13 08:53:37 +02:00