vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-02 18:50:13 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

Update bad-user-agents.list

Browse source 
Adding:
* Cocolyze bot: `Mozilla/5.0 (compatible; Cocolyzebot/1.0; https://cocolyze.com/bot)`
  Actually, whatever it is. I cannot access the given link from any location (tried four different networks!). I always get the Cloudflare lock page. So, sorry, bad crawler as it doesn't even want me to identify it.
* ZoomBot/LiknBot - different user agents!, i.e.: `ZoomBot (Linkbot 1.0 http://suite.seozoom.it/bot.html)`
  No information if they obey robots.txt, because when I go to the given URL I am informed the website is only available for paying customers. So, sorry, no...
* Velen - `Mozilla/5.0 (compatible; VelenPublicWebCrawler/1.0; +https://velen.io)`
  Link takes me to a Google 404 page. Strange. Crawling my website like crazy, not obeying (as far as I can tell) robots.txt.
This commit is contained in:
Łukasz Rżanek 2021-01-02 15:46:38 +01:00 • committed by GitHub
parent 22b952b5f5
commit 629429aacc
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
1 changed files with 4 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

4
_generator_lists/bad-user-agents.list
View file

@ -80,6 +80,7 @@ Claritybot
Cliqzbot Cliqzbot
Cloud\ mapping Cloud\ mapping
coccocbot-web coccocbot-web
Cocolyzebot
CODE87 CODE87
Cogentbot Cogentbot
cognitiveseo cognitiveseo
@ -244,6 +245,7 @@ Libwhisker
LieBaoFast LieBaoFast
Lightspeedsystems Lightspeedsystems
Likse Likse
Linkbot
Linkdexbot Linkdexbot
LinkextractorPro LinkextractorPro
LinkpadBot LinkpadBot
@ -505,6 +507,7 @@ Vacuum
Vagabondo Vagabondo
VB\ Project VB\ Project
VCI VCI
VelenPublicWebCrawler
VeriCiteCrawler VeriCiteCrawler
VidibleScraper VidibleScraper
Virusdie Virusdie
@ -582,6 +585,7 @@ Zeus
zgrab zgrab
Zitebot Zitebot
ZmEu ZmEu
ZoomBot
ZoominfoBot ZoominfoBot
ZumBot ZumBot
ZyBorg ZyBorg