vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-05 04:00:13 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2019.12.1902 [ci skip]

Browse source
This commit is contained in:
Travis 2019-12-10 21:17:07 +02:00
parent 737f7bfa07
commit 36f5427152
52 changed files with 15592 additions and 15556 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

1614
.dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
.dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
35.188.1.99 1; 35.188.73.34 1;
127.0.0.1 1; 127.0.0.1 1;

2
.dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
35.188.1.99 0; 35.188.73.34 0;
127.0.0.1 0; 127.0.0.1 0;

1614
.dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
.dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
35.188.1.99 1; 35.188.73.34 1;
127.0.0.1 1; 127.0.0.1 1;

2
.dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
35.188.1.99 0; 35.188.73.34 0;
127.0.0.1 0; 127.0.0.1 0;

1614
.dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
.dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
35.188.1.99 1; 35.188.73.34 1;
127.0.0.1 1; 127.0.0.1 1;

2
.dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
35.188.1.99 0; 35.188.73.34 0;
127.0.0.1 0; 127.0.0.1 0;

1614
.dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

1614
.dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

1614
.dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
.dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
35.192.85.2 0; 104.154.113.151 0;

1614
.dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
.dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
35.193.7.13 1; 34.68.144.114 1;
127.0.0.1 1; 127.0.0.1 1;

2
.dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
35.193.7.13 0; 34.68.144.114 0;
127.0.0.1 0; 127.0.0.1 0;

1614
.dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
.dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
35.193.7.13 1; 34.68.144.114 1;
127.0.0.1 1; 127.0.0.1 1;

2
.dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
35.193.7.13 0; 34.68.144.114 0;
127.0.0.1 0; 127.0.0.1 0;

1614
.dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
.dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
35.193.7.13 1; 34.68.144.114 1;
127.0.0.1 1; 127.0.0.1 1;

2
.dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
35.193.7.13 0; 34.68.144.114 0;
127.0.0.1 0; 127.0.0.1 0;

1614
.dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

3
.dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,5 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
35.202.145.110 0; 34.68.144.114 0;
35.193.7.13 0;

1614
.dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

28
.dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,30 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
35.222.7.205 0; <!DOCTYPE html>
<html>
<head>
<meta name="viewport" content="width=device-width, initial-scale=1">
<meta charset="utf-8">
<title>Application Error</title>
<style media="screen">
html,body,iframe {
margin: 0;
padding: 0;
}
html,body {
height: 100%;
overflow: hidden;
}
iframe {
width: 100%;
height: 100%;
border: 0;
}
</style>
</head>
<body>
<iframe src="//www.herokucdn.com/error-pages/application-error.html"></iframe>
</body>
</html> 0;
35.193.14.140 0;

1614
.dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

5
.dev-tools/test4_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,5 +45,6 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
35.224.112.202 0; 35.188.73.34 0;
35.202.145.110 0; 35.192.136.167 0;
35.192.187.174 0;

1614
.dev-tools/test4_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

6
.dev-tools/test5_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,6 +45,6 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
104.154.120.187 0; 34.68.144.114 0;
35.184.226.236 0; 35.188.73.34 0;
35.224.112.202 0; 104.198.131.58 0;

1614
.dev-tools/test5_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
.dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
35.188.1.99 1; 35.188.73.34 1;
127.0.0.1 1; 127.0.0.1 1;

18
.dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
Alligator Alligator
Apexoo BuzzSumo
Drip Calculon
ExtLinksBot DnyzBot
LibWeb eCatch
Lipperhey Heritrix
MFC_Tear_Sample HybridBot
Pump lwp-trivial
Rankivabot Meanpathbot
URLy Warning Netcraft

254
.dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
360Spider
404checker
404enemy
Abonti Abonti
Acunetix Acunetix
ADmantX ADmantX
AfD-Verbotsverfahren AfD-Verbotsverfahren
AhrefsBot
AIBOT
AiHitBot AiHitBot
Aipbot Aipbot
Alexibot Alexibot
Alligator AllSubmitter
Anarchie AlphaBot
arquivo.pt
arquivo-web-crawler
ASPSeek ASPSeek
AwarioSmartBot autoemailspider
BackDoorBot AwarioRssBot
backlink-check BackStreet
BackWeb
Bandit Bandit
Barkrowler Barkrowler
Battleztar Bazinga
BBBike BBBike
BDCbot BDCbot
BetaBot Bitacle
BLEXBot Black Hole
Blow
Bolt
BotALot BotALot
Brandwatch Brandwatch
Buddy
BuiltBotTough BuiltBotTough
BunnySlippers Bullseye
BuzzSumo
Calculon
CheeseBot CheeseBot
CheTeam CherryPicker
ChinaClaw Claritybot
Cliqzbot Craftbot
Cogentbot
Copier
CopyRightCheck
crawler4j crawler4j
crawler.feedback
crawl.sogou.com crawl.sogou.com
CrazyWebCrawler Crescent
CrunchBot
CSHttp CSHttp
Custo
DatabaseDriverMysqli
DataCha0s
DBLBot DBLBot
Digincore demandbase-bot
DigitalPebble Demon
DIIbot Deusu
Discobot DnyzBot
Discoverybot DomainCrawler
DittoSpyder
DomainAppender
DomainStatsBot
Dragonfly Dragonfly
DSearch Drip
EasyDL DTS Agent
ECCP/1.0 EMail Siphon
EMail Wolf
EroCrawler EroCrawler
evc-batch evc-batch
Evil
Express WebPictures
ExtLinksBot ExtLinksBot
Extreme Picture Finder Extractor
EyeNetIE ExtractorPro
facebookscraper Ezooms
FDM FDM
FemtosearchBot FemtosearchBot
FHscan
Firefox/7.0 Firefox/7.0
Flunky Freeuploader
FrontPage
FyberSpider FyberSpider
GalaxyBot
Genieo Genieo
GermCrawler
Gigabot Gigabot
G-i-g-a-b-o-t G-i-g-a-b-o-t
Go-Ahead-Got-It
GoZilla GoZilla
Grabber Grabber
GrapeFX GrapeFX
GridBot GrapeshotCrawler
GT::WWW GT::WWW
Haansoft
Harvest
Havij Havij
HEADMasterSEO Heritrix
heritrix HMView
Hloader HTTrack
IDBot Humanlinks
HybridBot
Iblog
Id-search Id-search
IlseBot
Image Fetch
IndeedBot IndeedBot
InfoNaviRobot InfoNaviRobot
Intelliseek instabid
InterGET InterGET
Internet Ninja Internet Ninja
InternetSeer InternetSeer
Iria internetVista monitor
Iskanie IRLbot
JamesBOT
Jbrofuzz Jbrofuzz
JennyBot JennyBot
JetCar
JOC Web Spider
Joomla Joomla
Jyxobot Kenjin Spider
Keyword Density
Lanshanbot
Larbin Larbin
LexiBot
LibWeb LibWeb
Libwhisker
Lightspeedsystems Lightspeedsystems
Likse Likse
Linkdexbot Linkdexbot
Lipperhey Spider LinkpadBot
Litemage_walker LinkScan
Lmspider LinkWalker
LNSpiderguy LinqiaMetadataDownloaderBot
lwp-request Lipperhey
Ltx71
lwp-trivial
magpie-crawler magpie-crawler
Majestic12
MarkMonitor
MarkWatch MarkWatch
Masscan Masscan
Mata Hari Meanpathbot
meanpathbot
MeanPath Bot MeanPath Bot
Mediatoolkitbot Mediatoolkitbot
Metauri
Microsoft Data Access Microsoft Data Access
Microsoft URL Control Microsoft URL Control
MIIxpc
Mister PiX Mister PiX
MJ12bot MJ12bot
Mojeek
Mojolicious
Morfeus Fucking Scanner
Mr.4x3 Mr.4x3
MSFrontPage MSFrontPage
muhstik-scan MSIECrawler
Name Intelligence Musobot
Navroad Navroad
NearSite NearSite
Needle Needle
Nessus Nessus
NetLyzer NetAnts
NetMechanic Netcraft
Nettrack netEstate NE Crawler
NetSpider
Net Vampire
Netvibes Netvibes
NetZIP NextGenSearchBot
Nikto NICErsPRO
Niki-bot
NimbleCrawler NimbleCrawler
Nimbostratus Nimbostratus
Ninja NPbot
Nmap oBot
Nutch Offline Navigator
OnCrawl OnCrawl
Openfind
OpenLinkProfiler
Openvas
OpenVAS OpenVAS
OrangeBot OrangeBot
OrangeSpider OrangeSpider
PageAnalyzer OutclicksBot
Page Analyzer OutfoxBot
Pandalytics Pandalytics
Pavuk Panscient
PeoplePal pcBrowser
Picscout PECL::HTTP
PHPCrawl
Picsearch Picsearch
Pimonster
Pi-Monster
Pixray Pixray
PleaseCrawl PleaseCrawl
POE-Component-Client-HTTP Pockey
ProWebWalker Probethenet
Psbot ProPowerBot
PxBroker Pump
QueryN Metasearch QueryN Metasearch
Quick-Crawler Quick-Crawler
RankActive
RankActiveLinkBot RankActiveLinkBot
RankingBot
Rankivabot
RankurBot RankurBot
RealDownload RealDownload
Reaper Reaper
RebelMouse
Recorder Recorder
RedesScrapy RedesScrapy
ReGet ReGet
RepoMonkey RepoMonkey
RSSingBot RSSingBot
s1z.ru SBIder
scan.lol Screaming
Searchestate ScreenerBot
SEOlyticsCrawler SearchmetricsBot
SemrushBot
Seomoz Seomoz
SEOprofiler SEOprofiler
seoscanners seoscanners
Sitebeam SEOstats
SiteLockSpider serpstatbot
SiteSnagger SiteSnagger
SiteSucker SiteSucker
Site Sucker Site Sucker
Sitevigil
SMTBot
Snake
Snapbot Snapbot
Snoopy Snoopy
Sosospider Sogou web spider
Sottopop SpankBot
Spanner sp_auditbot
Spinn3r Spinn3r
SputnikBot
Sqlmap
Sqlworm Sqlworm
Sqworm Sqworm
Steeler
Stripper
SuperHTTP
SurveyBot SurveyBot
Suzuran
Swiftbot
Szukacz Szukacz
T8Abot Telesoft
Teleport
TeleportPro
TheNomad TheNomad
TightTwatBot
Titan Titan
Toata Trendictionbot
Tracemyfile
Turingos Turingos
Turnitin
TurnitinBot TurnitinBot
Vacuum TwengaBot
VB Project Upflow
VCI Vagabondo
VidibleScraper VidibleScraper
VoidEYE VoidEYE
Wallpapers/3.0 Voil
WallpapersHD WallpapersHD
Web Auto WASALive-Bot
Webalta
WebBandit
WebCopier WebCopier
WebEnhancer WEBDAV
Web Fetch
Web Fuck
WebGo IS WebGo IS
WebImageCollector
WebLeacher WebLeacher
WebmasterWorldForumBot
WebReaper WebReaper
WebsiteQuester
WebSucker
WebWhacker
WebZIP
WeSEE WeSEE
Whacker Whacker
Who.is Bot
Widow Widow
WiseGuys Robot WiseGuys Robot
WISENutbot Wonderbot
Woobot Woobot
Wotbox Wotbox
Wprecon WPScan
WWW-Collector-E WWW-Collector-E
WWWOFFLE WWWOFFLE
x22Mozilla x22Mozilla
Xaldon_WebSpider
Xenu Xenu
xpymep1.exe xpymep1.exe
zauba.io
zgrab zgrab
ZumBot
ZyBorg

260
.dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
404checker 404checker
Abonti 404enemy
Aboundex Aboundexbot
AfD-Verbotsverfahren ADmantX
AhrefsBot AhrefsBot
AIBOT AIBOT
Alexibot
Alligator
AllSubmitter AllSubmitter
Anarchie arquivo.pt
Apexoo
Asterias Asterias
autoemailspider BackDoorBot
Backlink-Ceck Backlink-Ceck
backlink-check
BacklinkCrawler
BackStreet BackStreet
Bandit Bandit
BatchFTP Battleztar Bazinga
BDCbot
BDFetch BDFetch
BetaBot
Blackboard
Black Hole
BLEXBot
Blow
BlowFish
Boardreader Boardreader
Bolt
BotALot BotALot
Brandprotect Brandprotect
BuiltBotTough Buddy
BunnySlippers BuiltWith
Bullseye
BuzzSumo BuzzSumo
CazoodleBot Calculon
CATExplorador
Cegbfeieh Cegbfeieh
CheeseBot CherryPicker
CheTeam
ChinaClaw ChinaClaw
Claritybot
Cliqzbot Cliqzbot
cognitiveseo
Collector Collector
com.plumanalytics com.plumanalytics
Copier Craftbot
Copyscape
crawler4j crawler4j
crawler.feedback
crawl.sogou.com crawl.sogou.com
Custo CrazyWebCrawler
DatabaseDriverMysqli
DataCha0s DataCha0s
DBLBot DBLBot
demandbase-bot demandbase-bot
DigitalPebble Devil
Disco Discobot
Discoverybot DittoSpyder
Dispatch
DnyzBot
DomainAppender DomainAppender
DomainCrawler DomainCrawler
Dragonfly DomainSigmaCrawler
DSearch Download Wonder
DTS Agent Drip
eCatch
ECCP/1.0
Ecxi
EirGrabber EirGrabber
EMail Siphon EMail Siphon
EroCrawler
evc-batch evc-batch
Evil Evil
Exabot Exabot
ExtractorPro
Extreme Picture Finder
facebookscraper facebookscraper
FDM
FemtosearchBot
FHscan FHscan
Firefox/7.0 Firefox/7.0
Foobot FlashGet
Freeuploader Freeuploader
GalaxyBot FrontPage
Genieo FyberSpider
Getintent GetWeb
Gigabot Harvest
G-i-g-a-b-o-t
Go-Ahead-Got-It
Grafula
GrapeshotCrawler
HaosouSpider
Havij Havij
heritrix
Heritrix
Hloader Hloader
HTMLparser HTTP::Lite
HTTrack HTTrack
Iblog Humanlinks
IDBot IDBot
IlseBot IlseBot
Image Fetch
Indy Library Indy Library
InfoNaviRobot
instabid
Intelliseek
InterGET InterGET
Internet Ninja internetVista monitor
InternetSeer JamesBOT
ips-agent JetCar
Jorgee Joomla
JustView JustView
Jyxobot Lanshanbot
Keyword Density
Kozmosbot
Larbin Larbin
LeechFTP LeechGet
Lftp LexiBot
Libwhisker Libwhisker
Lightspeedsystems
Likse
LinkextractorPro
LinkScan
LinksManager LinksManager
LinkWalker LinkWalker
LinqiaScrapeBot LinqiaRSSBot
Lipperhey Lipperhey
Litemage_walker LWP::Simple
Lmspider lwp-trivial
LNSpiderguy Mag-Net
Ltx71
Magnet
magpie-crawler magpie-crawler
Mail.RU_Bot Mail.RU_Bot
MarkWatch
Masscan
Mata Hari Mata Hari
MauiBot MauiBot
MeanPath Bot
Mediatoolkitbot Mediatoolkitbot
mediawords MegaIndex.ru
Metauri Metauri
MFC_Tear_Sample MFC_Tear_Sample
MJ12bot MIDown tool
Mojeek Mister PiX
Msrabot Morfeus Fucking Scanner
Nameprotect MSFrontPage
MSIECrawler
Musobot
Needle Needle
Nessus
NetAnts NetAnts
NetLyzer Netcraft
NetSpider netEstate NE Crawler
Netvibes
NetZIP NetZIP
NextGenSearchBot
Nibbler
Niki-bot Niki-bot
Nikto Ninja
Nutch Nmap
oBot NPbot
Offline Explorer Offline Explorer
Offline Navigator Openfind
OnCrawl
OpenLinkProfiler OpenLinkProfiler
OrangeSpider OrangeBot
OutclicksBot OutclicksBot
PageAnalyzer Page Analyzer
PageGrabber PageGrabber
page scorer
Pandalytics
Papa Foto Papa Foto
Pavuk
PECL::HTTP
PHPCrawl PHPCrawl
Picsearch Picscout
PictureFinder
Pimonster Pimonster
Pi-Monster
Pixray
PleaseCrawl PleaseCrawl
plumanalytics
Pockey
POE-Component-Client-HTTP POE-Component-Client-HTTP
Probethenet Psbot
ProWebWalker
Pump Pump
PxBroker PxBroker
PyCurl
QueryN Metasearch
RankActiveLinkBot RankActiveLinkBot
RankFlex
RankingBot RankingBot
RankurBot Rankivabot
RebelMouse RebelMouse
RedesScrapy RedesScrapy
RepoMonkey RocketCrawler
Ripper
Rogerbot Rogerbot
RSSingBot RSSingBot
SalesIntelligent
SBIder SBIder
ScanAlert ScanAlert
ScoutJet ScoutJet
Scrapy Scrapy
Screaming
ScreenerBot ScreenerBot
Searchestate SearchmetricsBot
Semrush
SemrushBot
SEOkicks SEOkicks
SEOkicks-Robot SEOkicks-Robot
seoscanners
SeoSiteCheckup SeoSiteCheckup
sexsearcher sexsearcher
Shodan Shodan
Siphon SISTRIX
SiteExplorer
Siteimprove Siteimprove
SiteSnagger SiteSnagger
SiteSucker SiteSucker
SlySearch SmartDownload
SMTBot
Snapbot Snapbot
SocialRankIOBot SocialRankIOBot
sogouspider Sogou web spider
Sottopop
SpaceBison
Spammen Spammen
Spanner Spinn3r
SputnikBot SputnikBot
spyfu Sqlmap
Steeler
SuperBot
SuperHTTP SuperHTTP
sysscan Swiftbot
Teleport Szukacz
TeleportPro T0PHackTeam
Telesoft T8Abot
Telesphoreo tAkeOut
Telesphorep The Intraformant
TheNomad
Thumbor Thumbor
TightTwatBot TightTwatBot
Titan
Toata Toata
Toweyabot Toweyabot
Trendiction Tracemyfile
Trendictionbot
True_Robot True_Robot
Turingos Turingos
Twice Twice
Typhoeus URLy.Warning
UnisterBot Vacuum
VB Project VB Project
VidibleScraper VidibleScraper
Virusdie Virusdie
VoidEYE
Voil
Wallpapers/3.0
WASALive-Bot WASALive-Bot
WBSearchBot WBSearchBot
Webalta
WebBandit
WebCollage WebCollage
WebEnhancer Web Enhancer
WebFetch WebFetch
WebFuck WebFuck
Web Fuck
WebImageCollector WebImageCollector
WebLeacher
WebmasterWorldForumBot
webmeup-crawler webmeup-crawler
WebSauger WebPix
Web Sucker Web Sauger
WebWhacker Webshag
WeSEE WebsiteExtractor
Whack WebsiteQuester
Webster
WebZIP
Whacker Whacker
Whatweb Whatweb
Widow WiseGuys Robot
WISENutbot WISENutbot
Wonderbot
Woobot Woobot
Wprecon Wotbox
WWW-Collector-E
WWW-Mechanize WWW-Mechanize
WWW::Mechanize x09Mozilla
x22Mozilla
Xaldon_WebSpider
Xenu Xenu
xpymep1.exe
YoudaoBot
Zade Zade
Zauba Zauba
Zermelo
Zeus Zeus
ZmEu ZmEu
ZumBot

20
.dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
aa08daf7e13b6345e09e92f771507fa5f4.com aaa38852e886ac4af1a3cff9b47cab6272.com
brianhenry.co apisecretsaucebi-a.akamaihd.net
buynorxx.com arraty.altervista.org
californianews.cf kinohall.ru
finteks.ru massage-info.nl
karadene.com nodding-passion.tk
myyour.eu regdefense.com
natali-forex.com seorankinglinks.com
q-moto.ru valueclick.com
songoo.wz.cz wosik-dach.service-for-web.de

942
.dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
00author.com 0912701309f8ce.com
13tabs.com 123movies.love
12u.info
2015god.org
2345.com
2ads.co.uk
2daytrendingnews.com
2rich4bitches.com
3-letter-domains.net 3-letter-domains.net
4k-player.pl 5tey7463.weebly.com
4replicawatch.net 7fon.ru
4senses.co 8kisses.eu
66cpwgln.space 8lufu.com
8gold.com aab94f698f36684c5a852a2ef272e031bb.com
a14download.com absolute-s.ru
a96527gi.beget.tech abusora.com
academiacsmendoza.org academia-nsk.org
adamoads.com adclickthru.net
adbetclickin.pink addbin.men
addray.pro adexprts.com
adinterax.com adf.ly
adzpower.com adhome.biz
afmuseum.com adimmix.com
ageofclones.com adserver-e7.com
aibolita.com ads-seo.men
alfapro.ru adultfriendfinder.com
alive-ua.com adultmeetonline.info
alkoravto.ru advancedcleaner.com
all4invest.ru afora.ru
allboard.xobor.de alert-hgd.xyz
alpharma.net algerianembassy.co.in
allmarketsnewdayli.gdn
allproblog.com
allstatesugarbowl.org
allwidewallpapers.com
allwomen.info
alphaforum.ru
altamayoztourism.com altamayoztourism.com
alvtank.se aludecor.info
am15.net amoi.tn
am-se.com amospalla.es
anal-acrobats.com
anapa-inns.ru anapa-inns.ru
animal-drawings.com anime.dougasouko.com
anlimebel.kiev.ua apelsinnik.website
anonymizeme.pro apifasterlightin-a.akamaihd.net
apiportalmorecom-a.akamaihd.net apioasisspacenet-a.akamaihd.net
apishops.ru ap.senai.br
api.stathat.com arabgirls.adultgalls.com
astana.xxxkaz.org arabsexxxtube.com
atley.eu.pn arcteryxstore.online
atmovs.com arkartex.ru
atovh.local-finders.com arvut.org
australia-opening-times.com asiavirtualsolutions.com
auto4style.ru asophoto.com
asseenontvonline.ru
atlant-auto.info
audiobangout.com
autobrennero.it
autodo.info autodo.info
autorn.ru autorn.ru
aviav.eu auto.rusvile.lt
aviva-limoux.com autoseo-traffic.com
avkzarabotok.info avtocredit-legko.ru
avramstroy.ru azartclub.org
avtolombard-krasnodar.com azazu.ru
azartmix.com bag77.ru
babespcs.com baikaleminer.com
baksman.com baksman.com
bala.getenjoyment.net bamo.xsl.pt
balook.com bazaronline24.ru
bannerconnect.net bdsmgalls.net
basedecor.ru best-games.today
batanga.net best-mam.ru
bbsoldes.fr beta.hotkeys.com
beachtoday.ru beyan.host.sk
becuo.com bif-ru.info
bestpornuha.com biketank.ga
bestwebsiteawards.com billiard-classic.com.ua
bestwebsitesawards.com binaryoptionscops.info
biteg.xyz bio.trade-jp.net
bizfly.info biznesrealnost.ru
bjgugu.net.ua bonzbuddy.com
blog.axant.it brainxs.us
bloggerads.net brandehk.dk
bloglag.com brg8.com
bmsco.co briomotor.co
bmw.afora.ru builtwith.com
bmw-ark.ru burkesales.com
brainboosting.club businescoop.men
brokergid.ru cakesplus.com.au
buckspar.gq calc-for-credit.ru
bugof.gq canacopegdl.com
buqayy0.livejournal.com cartierlove2u.com
buron.pw cejewelry.xyz
butstrap.space cenokos.ru
buttons-for-your-website.com cgi2.nintendo.co.jp
buyclomidonlaine.com chiblackhawks-jerseys.com
buzzsumo.com christianlouboutinsaleoutletonline.us
byme.se cleanallspyware.com
c1.onedmp.com clickbank.net
cactussoft.biz clickso.com
candy-glam-hp.com clips.ua.ac.be
carapics.com cometorussia.net
cardsdumps.com com-onlinesupport.host
cars-modification.net compliance-jack.top
caulderwoodkennels.com compliance-jess.top
cbcseward.com compucelunlock.net
ccbill.com com-supportcenter.website
cementaresearch.se concealthyself.com
centrdebut.ru contentsexpress.com
cete.ru cordstrap.cc
chatroulette.online cracksplanet.com
cheapbarbour.online daretodonate.co
chelnytruck.ru darkages.info
chidporn.com ddospanel.com
chinajerseyswholesalecoupons.com deadlinkchecker.com
cienum.fr decorazilla.com
clickaider.com deda-moroza-zakaz.ru
clickprotects.com discountliv.com
clknsee.com divatraffic.com
cntravelre.com diy-handmade-ideas.com
coaching-netz.info djekxa.ru
community.allhiphop.com dogoimage.com
compliance-alex.xyz domaincdn.xyz
compliance-elena.top domain-tracker.com
compliance-josh.top domain.webkeyit.com
constantaservice.net downvids.net
coolwallpapers-hd.com dstroy.su
copenergo.ru dyt.net
creditnation.ru eas-seo.com
dame-ns.kz easycommerce.cf
daooda.com e-commerce-seo.com
deanmoore.ie
decoratinghomes.ga
digest-project.ru
digitalfaq.com
dinkolove.ya.ru
dirtpics.pw
dktr.ru
dnsrsearch.com
domainsatcost.com
domination.ml
dood.live
drillsaw.ru
drunkmoms.net
ecookna.com.ua
edelstahlschornstein-123.de
edge.sharethis.com edge.sharethis.com
elitedollars.com ege-essay.ru
enews.tech egovaleo.it
en.home-task.com ekspresihati.info
enskedesquashclub.se elektrischezigarettekaufen2.cowblog.fr
etm-consult.de elektrischezigaretten2.beeplog.com
eugenevaultstorage.com elitesportsadvisor.com
enge-fotzen.info
erectile.bid
eropho.com
eropho.net
erotik0049.com
escortplius.com
eshop.md
espaceinventoristes.com
etur.ru
europages.com.ru
europeanwatches.ru
eurosamodelki.ru eurosamodelki.ru
evening-dating-club.info excaliburfilms.com
everypony.ru exct.net
eyelike.com.ua executehosting.com
ezigarettenshop2.postbit.com eyemagination.com
ezigaretteshop.webs.com ezigarettekaufen1.hpage.com
facebook-mobile.xyz ezrvrentals.com
falcoware.com fable.in.ua
fantasticpixcool.com falllow.gq
fastcrawl.com familyphysician.ru
filesdatabase.net fickkontaktehobbyhuren.com
finuse.com fil.ru
footballfarrago.com finansov.info
forex-indextop20.ru finteks.ru
forum.poker4life.ru firstdrugmall.ru
foxjuegos.com flauntyoursite.com
freelotto.com floridamhca.org
freemags.cc flprog.com
freeuploader.ml fodelsedagspresenter.nu
footbalive.org
forum20.smailik.org
forum69.info
forum-engineering.ru
forumprofi.de
forum.tvmir.org
foto-telok.net
foxinsocks.ru
franch.info
freegamesplay.online
freemaintenancesysforpcandmac.top
free-social-buttons.com
free-today.com
free-video-tool.com free-video-tool.com
freza-sverlo.ru freshmac.space
frivgame250.com funnel.co.za
front.to gabeshop.ru
frvo.alptandem.ru games.kolossale.ru
gamewrath.com gamevalue7.weebly.com
gavuer.ru gaytube.com
gaygalls.net gazobeton-p.com.ua
gcup.ru gaz-voshod.ru
genetworx.com gdcentre.ru
getaclueamerica.com getresponse.com
get-your-social-buttons.info gilsonchiro.xyz
girlgamerdaily.com globetrotting-culture.ru
gktt.ru gok-kasten.net
glasof.es golden-catalog.pro
glass-msk.ru googst2.ru
glcomputers.ru gotomontenegro.net
goblacked.com gowreckdiving.com
gogalleryawesome.com greatgrace.ru
goldandcard.ru gsasearchengineranker.pw
gox.com.ua guigyverpo.cf
graphicwe.org gz2.bbsoldes.fr
grtyi.com
guardlink.org
h2monline.com h2monline.com
hahashka.ru handicapvansarea.com
hd-film.pl hauleddes.com
hdpixion.com hdhc.ru
healthcarestore.info helicalpile.us
health-medical-portal.info hentaiheroes.com
heroz.fr hermesbirkinhandbagoutlets.com
high-speed1.net heygidday.biz
hoholikik.club hikesearch.net
homedecoguide.info histock.info
homedecorpicture.us hit-men.men
homemature.net homedo.fabpage.com
hostingclub.lk homegardenlova.com
hotblognetwork.com hostcritique.com
hotgirlhdwallpaper.com hotgirlhdwallpaper.com
hoverboard360.de hotshoppymac.com
hspline.com houdom.net
htmlcorner.com hoverboard360.nl
ilovevitaly.ru howtoclean.club
imagefinder.site hscsscotland.com
images-graphics-pics.com iccornacircri.cf
imediadesk.com ideawheel.com
immobiliaremassaro.com ilikevitaly.com
inclk.com imfamous.info
import-sales.com
infodocsportal.com infodocsportal.com
infogame.name intelhdgraphicsgtdrive6w.metroblog.com
inome.com.ua internetproviderstucson.com
inspiring-desperate.tk intimshop-fantasy.ru
instabid.tech investzalog.ru
insurple.com ip-guide.com
invest-pamm.ru iplogger.org
io9.com istripper.com
iradiology.ru jacago.com
j33x.com janettabridal.com
jamiembrown.com jerseyschinabizwholesale.us
jennyfire.ru justdating.online
jikoman.info justkillingti.me
jovencitas.gratis kazan.xrus.org
kaliningrad.zrus.org kenaba.su
kanimage.com keywordteam.net
kerei.ru kinoplen.ru
keyword-suggestions.com kinostorm.net
kicknights.gq kinozapas.com
kirov.zrus.org konpax.com
kongoultry.net kvartira-sutochno.com
kostenloser-sex.com labafydjxa.su
krasivoe-hd.net labelwater.se
krassh.ru
kretpicf.pw
ku6.com
kupiproday.com.ua
labplus.ru labplus.ru
lacloop.info lacloop.info
lafourmiliaire.com lafriore.ru
lampokrat.ws laserpen.club
lancheck.net lasvegaslockandsafe.com
landoftracking.com layola.biz.tc
laptop-4-less.com leboard.ru
laptoper.net letmacworkfaster.world
leftofcentrist.com lexaprogeneric.link
lifehacĸer.com life.biz.ua
liupis.com lincolntheatre.com
lombia.co linkredirect.biz
lomza.info liumimgx.pw
lost-alpha.ru liverpool.gsofootball.com
louisvuittonoutletstore.net ljusihus.se
lowephotos.info localflirtbuddies.com
lsp-awak-perikanan.com lookingglassemb.com
ltvperf.com lostaruban.com
mailemedicinals.com lostfilm-online.ru
manuscript.su luciddiagnostics.in
manve.info magicplayer-s.acestream.net
maranbrinfo.com.br mararoom.ru
markjaybeefractal.com mathgym.com.au
marwer.info mearns-tractors.co.uk
massage-info.nl mebelcomplekt.ru
masserect.com
medispainstitute.com.au
medmajor.ru medmajor.ru
medosmotr-ufa.ru megakino.net
meduza-consult.ru meget.co.za
mega-bony2017.pl mesbuta.info
mejoresfotos.eu metabar.ru
michaelkorssaleoutletonline.net microsoftportal.net
migente.com mirmedinfo.ru
minyetki.ru mitrasound.ru
missclub.info mmgq.ru
mmofreegames.online mobile.ok.ru
mmog-play.ru monarhs.info
mockupui.com monsterdivx.tv
monclerboots.xyz monthlywinners.com
moncleroutletonline.pw moomi-daeri.com
moncleroutletonline.win morefastermac.trade
moncleroutletonline.xyz most.gov.iq
mossmesi.com mouselink.co
mostantikor.ru movies-in-theaters.net
moyaterapiya.ru mydownloadengine.com
musicktab.com myhydros.org
muz-baza.net narkologiya-peterburg.ru
mydoctorok.ru national-today-winning-winner.club
myfreetutorials.com naturalbreakthroughsresearch.com
mylida.org networkcheck.xyz
mystats.xyz nibbler.silktide.com
naturalshair.site nikitabuch.com
neks.info nonews.co
nextlnk12.com notaria-desalas.com
nhl17coinsforps3.gratisblog.biz nyfinance.ml
nofreezingmac.click nzfilecloud.weebly.com
normalegal.ru odoratus.net
no-rx.info offtime.ru
nuup.info online-hd.pl
oakleyglassesonline.us onlineku.com
oda.as open-odyssey.org
o-dachnik.ru optibuymac.com
odesproperty.com optitrade24.com
okmedia.sk origin-my.ru
oksrv.com orion-v.com
onetravelguides.com orsonet.ru
onlineslotmaschine.com pacificair.com
onlythegames.com panouri-solare-acoperis.com
ons-add.men paparazzistudios.com.au
oops-cinema.ru papasdelivery.ru
openfrost.com park.above.com
openlibrary.org partner-stop.men
ororodnik.goodbb.ru partnerworkroom.men
osb.se11.ru pcads.ru
osnova3.ru pc-test.net
oxford-book.com.ua pdns.cz
palocco.it pdns.download
paramountmarble.co.uk penisvergrotendepillennl.ovh
partybunny.ru percin.biz.ly
pc-virus-d0l92j2.pw perfection-pleasure.ru
pechikamini.ru photostudiolightings.com
pestomou.info picphotos.net
petedrummond.com pinkduck.ga
picmoonco.pw
picturesfrom.com
pillscheap24h.com
piratecams.com
pisanieprac.info pisanieprac.info
pivka.xyz piuminiita.com
pix24x7.com pixell.club
plastgran.com pixgood.com
plohaya-kreditnaya-istoriya.ru poems.com.ua
pl-vouchers.com pogodnyyeavarii.gq
pobeiranie.pl pomoc-drogowa.cba.pl
popup-fdm.xyz pooleroadmedicalcentre.co.uk
popup-hgd.xyz poquoson.org
pornhub-forum.ga porndroids.com
pornoklad.net potoideas.us
pornosee.info privhosting.com
porn-w.org produkto.net
porodasobak.net pro-poly.ru
priora-2.com prostitutki-kharkova.org
privatefx-in.ru pulseonclick.com
privatov-zapisi.ru pussysaga.com
prizeestates.cricket py100.ru
profit-opportunity.com rankia.com
prointer.net.ua ranksays.com
prosperent.com rednise.com
psa48.ru renewablewealth.com
pufip.com rennlist.com
qld10000.net risparmiocasa.bz.it
qpypcx.com rn-to-bsn.com
queerspace.com rome2rio.com
quizzitch.net romhacking.ru
qwertty.net royal-betting.net
radiogambling.com ruscoininvest.company
ranksignals.com sajatvelemeny.com
rapidsites.pro samolet.fr
raschtextil.com.ua sandhillsonline.com
razorweb-a.akamaihd.net sbt-aqua.ru
realitykings.com scanner-andrew.top
realresultslist.com scanner-george.top
recordpage-a.akamaihd.net scanner-jack.top
redbottomheels.xyz scenarii-1-sentyabrya.uroki.org.ua
redirectme.net scopich.com
redirect.trafficreceiver.club searchlock.com
registry-clean-up.net security60-e.com
robertefuller.com
robot-forex.biz
rogervivierforsale.com
royal-investments.net
ruclicks.com
sack.net
samo-soznanie.ru
sanidumps.com
saveindex.xyz
sawin.beth.webd.pl
sbwealthsolutions.ca
scanner-margo.top
scanner-marwin.top
scat.porn
scenicmissouri.us
scripted.com
sdelatmebel.ru
searchaddis.com
searchinquire.com
secretscook.ru
seksotur.ru seksotur.ru
seksvideoonlain.com
sell-fb-group-here.com sell-fb-group-here.com
semrush.com
seocheki.net
seofied.com
seorank.info seorank.info
servicecenter.co.ua seorankinglinks.com
se-welding.ru sexpartygirls.net
sex-foto.pw
sex-tracker.de
sextracker.de sextracker.de
sexxdate.net
sexyali.com sexyali.com
shama-rc.net sfd-chess.ru
shopperifymac.com sharebutton.org
shopvilleroyboch.com.ua share-buttons-for-free.com
shtora66.ru sharebutton.to
shymkent.xkaz.org sharpchallenge.com
silvercash.com shohanb.com
simple-image.com.ua signx.info
simplepooltips.com silverage.ru
sitebeam.net siteexpress.co.il
siteheart.net siteripz.net
site.ru sixcooler.de
sklad-24.ru smsactivator.ru
slowmacfaster.trade sneakyboy.com
socialseet.ru social-buttons.com
sofit-dmd.ru social-button.xyz
softlinesolutions.me sohoindia.net
solnplast.ru space-worry.ml
sonnikforme.ru spasswelt.net
spy-sts.com splendorsearch-a.akamaihd.net
stair.registrydomainservices.com spy-app.info
staticfs.host srdrvp.com
sstroy44.ru
staff.prairiesouth.ca
stardevine.com
startwp.org
stats-public.grammarly.io stats-public.grammarly.io
stickers-market.ru statustroll.com
streha-metalko.si stretchingabuckblog.com
suhanpacktech.com strigkaomsk.ru
sundrugstore.com students-cheapskate.ml
superkanpo.com summerlinhomes411.info
svetlotorg.ru svnuppsalaorebro.se
swimpool.ca svolze.com
sygraem.com swiped.su
tattomedia.com tabletkinaodchudzanie.com.pl
td-33.ru takeprofitsystem.com
tattooha.com
teenbbw.yopoint.in
telefonsexsofort.tk telefonsexsofort.tk
telegraf.by terraclicks.com
thebestphotos.eu terrafootwear.us
thebestweightlosspills.ovh textads.men
thebluenoodle.com thefarmergame.com
thelottosecrets.com thefotosgratis.eu
themestotal.com thegamerznetwork.com
timer4web.com tizanidinehcl4mgtab.blogspot.com
tizanidine4mgstreetvalue.blogspot.com tizanidinehydrochloride2mg.blogspot.com
tizanidine4mguses.blogspot.com tizanidineinfo.blogspot.com
tizanidinedosage.blogspot.com
tizanidinehcl2mg.blogspot.com
tizanidinehcl4mgtabinfo.blogspot.com
tizanidinehcl4mgtablet.blogspot.com
tizanidineonline.blogspot.com
tizanidinerecreationaluse.blogspot.com tizanidinerecreationaluse.blogspot.com
tobeyouday.win tobeyouday.win
toloka.hurtom.com tonerbox.kz
tongkatmadura.info tongkatmadura.info
tsstcorpcddvdwshbbdriverfb.aircus.com topmira.com
tsyndicate.com toursmaps.com
tuckpointingmasonrysystems.com tozup.com
tvand.ru trafaret74.ru
tversvet.ru trafficgenius.xyz
tytoona.com trafficstars.com
ua.tc traffixer.com
ublaze.ru tsan.net
ucoz.ru uhodzalijami.ru
um-razum.ru umg-stroy.ru
univerfiles.com umityangin.net
universals.com.ua unisexjewelry.org
unlimitdocs.net unrealcommander.com
uptime-gamma.net upstore.me
usadacha.net uroffer.link
us-america.ru ustion.ru
utrolive.ru validdomain.xyz
vadimkravtcov.ru vancleefreplica.pw
varikoz24.com vashsvet.com
venerologiya.com veselokloun.ru
vgoloveboli.net vesnatehno.ru
viddyoze.com videospornogratisx.net
video-chat.love vseigru.one
vinylvault.co.uk vucms.com
vladimir.zrus.org vvpg.ru
voloo.ru vzlomsn.org
vtcdns.com watchmyfb.pl
wallpapersist.com wdfdocando.com
wareseeker.com webnode.me
weblo.com wedding0venues.tk
websiteaccountant.de wellcome2slovenia.ru
whatsappdownload10.com westermarkanjou.se
whatzmyip.net whatzmyip.net
wma-x.com where-toget.com
womensplay.net winner7777.net
word-vorlagen.net w-journal.ru
www.888.com womens-journal.net
wwwadultcheck.com womensterritory.ru
wygraj-teraz.com woodyguthrie.se
xdoza.com worst-sites.online
www.kabbalah-red-bracelets.com
xerox-douglas.cf xerox-douglas.cf
xjrul.com xfluro.com
x-lime.net x-lime.net
xn------7cdbapdecfd4ak1bn0amjffj7afu3y.xn--p1ai xn--24-glceagatoq7c2a6ioc.xn--p1ai
xn-----7kceclhb4abre1b4a0ccl2fxch1a.xn--p1ai xn--h1ahbi.com.ua
xn----9sbubg3ambdfl1j.xn--p1ai x-rates.ru
xn--b1ag5cfn.xn--p1ai xxxnatelefon.ru
yopoint.in xxxtubesafari.com
youandcredit.ru yaoguangdj.com
youjizz.com yougotanewdomain.com
youradexchange.com ytmnd.com
zaimite.ru zaidia.xhost.ro
zarabiaj-dzis.pl zaimhelp.ru
zastroyka.org zaloro.com
zeroredirect2.com zerocash.msk.ru
zscalerone.net zeroredirect11.com
zhuravlev.info
zlatnajesen.com
znakomstva-piter78.ru
zoogdinsney.com
zooggames.com
zoosexart.com
zrizvtrnpale.tk
zx6.ru

472
.dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
1000n1.ru
123locker.com
4k-player.pl
5000-cotydzien.com
5forex.ru 5forex.ru
72-news.com 8gold.com
7fon.ru admatic.com.tr
7minuteworkout.com admitad.com
8lufu.com adrenalin-stk.ru
aa625d84f1587749c1ab011d6f269f7d64.com aero2.ru
aasoldes.fr akita.kz
addray.pro akvamaster.dp.ua
adktrailmap.com alborzan.com
alfabot.xyz albumsuper.info
alif-ba-ta.com alekseevec.ru
allwidewallpapers.com all4wap.ru
alpharma.net allfinweb.com
animal-drawings.com amt-k.ru
apessay.com animalia-life.club
aproposde.com animebox.com.ua
aquarium-pro.ru anime.dougasouko.com
arkartex.ru anonymous-redirect.com
artefakct.com apccargo.com
artparquet.ru appsaurus.com
avon-ukraine.com arendovalka.xyz
balla-boo.se autodo.info
beachfix.co axbocz.net
bala.getenjoyment.net
bang-hotties.com
bannertesting.com
belinvestdom.by belinvestdom.by
bestmouthwash.club bestmouthwash.club
bigames.online betonka.pro
blog.remote-computer.de bjanshee.ru
bmw.afora.ru blobar.org
bonzybuddy.com blogig.org
braindaily.xyz bnt-team.com
b-styles.xyz brillianty.info
buchananshardware.com builtwith.com
business-suggested.tk bumskontakte.org
buntube.net
business-made-fun.com
buy-loft.ru buy-loft.ru
bvlgaribracelet.xyz buzzzg.men
canzoni.ru chatroulette.life
cartechnic.ru cialisndbrx.com
cartiertrinity.xyz cicaki.net
christianlouboutinoutlet.win clean-start.net
christianlouboutinreplica.pw cmd.kz
cognitiveseo.com compliance-alexa.top
com-onlinesupport.host compliance-irvin.top
compliance-viktor.top compliance-john.top
compliance-walter.top connectionstrenth.com
comsysnet.com cowlmash.com
cpajunkies.com creditmoney.com.ua
cranly.net
creatives.adbetclickin.pink
customerpromos-a.akamaihd.net customerpromos-a.akamaihd.net
damasarenai.info danashop.ru
dayibiao.com dating-app.ru
degerlund.net degerlund.net
dellalimov.com dentalpearls.com.au
digital-video-processing.com derevesendeco.com
dikqlyremy.info descargar-musica-gratis.net
dipstar.org detective01.ru
djihispano.com detsky-nabytek.info
dnsrsearch.com dfiles.me
droidlook.net dood.live
dumuelave.xyz download-wallpaper.net
econom.co dptaughtme.com
education-cz.ru drunkenstepfather.com
elektir.ru eldiariodeguadalajara.com
elektrischeziga.livejournal.com elektrischeziga.livejournal.com
elitepcgames.com elektrischezigarette2.devhub.com
elmifarhangi.com elektronischezigarettekaufen2.tumblr.com
el-nation.com el-nation.com
estibot.com energydiet-info.ru
evogarage.com eonpal.com
expdom.com este-line.com.ua
extremal-blog.com fashionavenuegame.com
eyessurgery.ru fikasound.tk
ezigaretteshop.webs.com filesmonster.porn
f5mtrack.com free-share-buttons.blogspot.com
failingmarriege.blogspot.com fungirlsgames.net
falopicm.pw gamedayhouse.com
fatmaelgarny.com gaygalls.net
film-one.ru gemara.com
financetip.eu get-free-traffic-now.com
formularz-konkurs.tk
forum69.info
franch.info
franecki.net
free-deals.faith
freeuploader.ml
funnymama.com
geilehausfrauen.net
get-seo-domain.com get-seo-domain.com
gigablast.com gifspics.com
gktt.ru goodhousekeeping.com
glavtral.ru goo.ne.jp
globalscam.ga greatfind-a.akamaihd.net
golaya.pw gribokstop.com
googlepositions.com guigyverpo.cf
gratuitxblcodes.com hasfun.com
greendream.com.ua hermesbirkinhandbagoutlets.com
gwebtools.com.br histats.com
happy.new.yeartwit.com hitsbox.info
hawaiisurf.com hkdiiohi.skyrock.com
healgastro.com horoshieokna.com
herokuapp.com hothot.ru
hostcritique.com hplaserjetpdriver8y.pen.io
housemilan.ru idegenvezeto.eu
hut1.ru ilikevitaly.com
ibb.com.ua imgarit.pw
iideaidekonkatu.info imguramx.pw
incanto.in.ua intervsem.ru
insomniagamingfestival.com iplusbit.blogspot.co.za
investyb.com janerikholst.se
invivo.hu justucalling32211123456789.tk
iomoio.net kareliatobacco.ru
iqoption-bin.com kemerovo.zrus.org
irkutsk.online-podarki.com klikbonus.com
iweblist.info kmgamex.cf
janettabridal.com knowsitall.info
javrip.net konpax.com
jovencitas.gratis kosmetyki.tm.pl
kamen-e.ru ks1234.com
kleine-titten.biz kung-fu-ru.com
koptims.tiu.ru letslowbefast.site
kustanay.kz letslowbefast.today
lanasshop.ru lion.bolegapakistan.com
law-check-two.xyz lmrauction.com
ledis.top loftdigital.eu
letmacwork.world lolnex.us
letsrepair.in m4ever.net
levaquin750mg.blogspot.com manyresultshub-a.akamaihd.net
lollypopgaming.com marblestyle.ru
lomb.co marinetraffic.com
lombia.co matrixalchemy.com
lumb.co mb140.ru
m1media.net medkletki.ru
medmajor.ru meetingrainstorm.bid
megaapteka.ru mega-bony-2017.pl
mikozstop.com michaelkorssaleoutletonline.net
mlf.hordo.win militarysale.pro
moetomnenie.com mindbox.co.za
moje-recenze.cz mobilierland.com
mojpreskumanie.com monthlywinners.com
monarchfind-a.akamaihd.net mrbojikobi4.biz
movies-in-theaters.net muycerdas.xxx
moviezbonkerssk.cf muz-tracker.net
mp3ritm.top myblogregistercm.tk
mycaf.it mymobilemoneypages.com
negral.pluto.ro myseoconsultant.com
nextlnk12.com national-today-winning-winner.club
nextrent-crimea.ru nextrent-crimea.ru
nikkiewart.ru nfljerseyscheapchinabiz.com
nlfjjunb5.ru nofreezingmac.click
nootrino.com notasprensa.info
nrv.co.za onlineserialy.ru
odesproperty.com onlinewritingjobs17.blogspot.ru
okeinfo.online orion-code-access.net
oklogistic.ru orion-v.com
olympescort.com paparazzistudios.com.au
o-o-8-o-o.ru parajumpersjakkesalgnorge.info
openfrost.com photochki.com
orel-reshka.net piccshare.com
paclitor.com pics-group.com
panouri-solare-acoperis.com pictures-and-images.net
pdn-4.com piuminiita.com
photorepair.ru pivka.xyz
piccdata.com pkr1hand.com
picturesboss.com pk-services.ru
pio.polytopesexempt.com pladform.ru
plaff-go.ru play.leadzupc.com
pl-top.pl poppen-nw.net
pornoforadult.com portside.cc
pornogratisdiario.com potolokelekor.ru
porn-w.org prchecker.info
potoideas.us pricheskaonline.ru
printie.com
privhosting.com
psoriasis-file.trade
pussysaga.com
putitin.me putitin.me
pwwysydh.com raisedseo.com
quebec-bin.com reckonstat.info
rangjued.com registrationdomainsite.com
rapidsites.pro resant.ru
realizmobi.com research.ifmo.ru
remontbiz.ru rff-cfal.info
reyel1985.webnode.fr rialp.getenjoyment.net
richinvestmonitor.com royal-investments.net
rubbed.us rumamba.com
sajatvelemeny.com rustic-quiver.win
sanidumps.com saecsa.co
sbtdesign.co.uk savememoney.co.za
search-error.com sax-sex.com
searchinquire.com scenicmissouri.us
se.bnt-team.com seminarykansas904.ml
seminarygeorgia59.ga seocdvig.ru
seogadget.ru
seo-platform.com seo-platform.com
serving.adbetclickin.pink seo-tools-optimizing.com
serviporno.com sexad.net
sharebutton.to shinikiev.com.ua
skanninge.se sicfor.bcu.cc
skuteczna-dieta.co.pl sinestesia.host.sk
smsactivator.ru socialmadesimple.com
socialmediasuggest.com soserfis.com
sofit-dmd.ru sovinsteel.ru
stroilka.info spidtest.org
stroyplus.ru spy-sts.com
stroy-portal22.ru stats-collector.org
superstats.com stroymonolit.su
support.nopeas.sk svetlotorg.ru
swiped.su tacbelarus.ru
sygraem.com takeprofitsystem.com
t-bygg.com tampabaywatch.org
thin.me.pn tandvardshuset.net
tizanidine4mgtablets.blogspot.com template-kid.com
tizanidinesleepaid.blogspot.com thebestphotos.eu
topclickguru.com thelottosecrets.com
top-deal.com.pl time-japan.ru
top-karkas.ru tizanidineandhydrocodone.blogspot.com
track-rankings.online topshef.ru
traffic100.com track112.site
truck-addzilla.life traffictrade.life
u555u.info triumf-realty.ru
uac.net.au tubeoffline.com
uamtrk.com tuckpointingmasonrysystems.com
uhodzalijami.ru tula.howotorg.ru
utrolive.ru uchil.net
vacances-voyages.info unitexindia.com
viberdownload10.com urdoot.win
vipsiterip.org usacasino.com
vitalads.net userequip.com
vkontarkte.com vacuumscleaner.com
webenlace.com.ar vesnatehno.com
website-analytics.online via-energy-order.com
weekes.biz.tc vizag.kharkov.ua
wieseversa.no vkonche.com
wiosenny-bon-1500.pl vladimir.zrus.org
vodaodessa.com
watchmyfb.pl
wellcome2slovenia.ru
wemarketing.se
westen-v.life
whereverdesperate.gq
wineitudes.wordpress.com
wineration.com
wnhjavlhezp.gq
wnoz.de wnoz.de
wordpresscore.com xblognetwork.com
workle.website x-diesel.info
worldtraveler.world xjrul.com
xedserver.com xn--80aanaardaperhcem4a6i.com
xn--80ab4aa2g.xn--p1ai xn--d1abj0abs9d.in.ua
xuki.us x-porno.video
xtube.com
yourads.website
your-bearings.com your-bearings.com
zarajbuilders.com yourporngay.com
zed21.net zahvat.ru
zerocash.msk.ru zhuravlev.info
zixizop.net.ru z-master.ru
znakomstva-piter78.ru zootravel.com
zvetki.ru

35
.dev-tools/test_units/ratelimittest-beta.txt
View file

@ -1,13 +1,11 @@
<!DOCTYPE html> <html>
<html> <head><title>503 Service Temporarily Unavailable</title></head>
<head> <body>
<title>Welcome to NginX</title> <center><h1>503 Service Temporarily Unavailable</h1></center>
</head> <hr><center>nginx/1.16.1</center>
<body> </body>
<div align=center> </html>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> ody>
<p>This is merely used for testing !!!</p>
</body>
</html><html> </html><html>
<head><title>503 Service Temporarily Unavailable</title></head> <head><title>503 Service Temporarily Unavailable</title></head>
<body> <body>
@ -484,13 +482,6 @@
<hr><center>nginx/1.16.1</center> <hr><center>nginx/1.16.1</center>
</body> </body>
</html> </html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.16.1</center>
</body>
</html>
<!DOCTYPE html> <!DOCTYPE html>
<html> <html>
<head> <head>
@ -581,4 +572,14 @@
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html> </html>

15
.dev-tools/test_units/ratelimittest-master.txt
View file

@ -1,12 +1,21 @@
<html> <!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html><html>
<head><title>503 Service Temporarily Unavailable</title></head> <head><title>503 Service Temporarily Unavailable</title></head>
<body> <body>
<center><h1>503 Service Temporarily Unavailable</h1></center> <center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.16.1</center> <hr><center>nginx/1.16.1</center>
</body> </body>
</html> </html>
ody> <html>
</html><html>
<head><title>503 Service Temporarily Unavailable</title></head> <head><title>503 Service Temporarily Unavailable</title></head>
<body> <body>
<center><h1>503 Service Temporarily Unavailable</h1></center> <center><h1>503 Service Temporarily Unavailable</h1></center>

2
.dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
35.188.1.99 0; 35.188.73.34 0;
127.0.0.1 0; 127.0.0.1 0;

BIN
.latest_release/bots.d.tar.gz
View file

Binary file not shown.

BIN
.latest_release/conf.d.tar.gz
View file

Binary file not shown.

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2019.12.1901 #### Version: V4.2019.12.1902
#### Bad Referrers Blocked: [6782](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [6782](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [562](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [562](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [214](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [214](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2019.12.1901 #### Version: V4.2019.12.1902
#### Bad Referrers Blocked: [6782](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [6782](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [562](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [562](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [214](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [214](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -11,7 +11,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2019.12.1901 #### Version: V4.2019.12.1902
#### Bad Referrers Blocked: [6782](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [6782](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [562](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [562](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [214](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [214](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

1610
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2019.12.1901 #### Version: V4.2019.12.1902
#### Bad Referrers Blocked: [6782](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [6782](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [562](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [562](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [214](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [214](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

1614
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

1614
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

1614
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2019.12.1901 ### Version: V4.2019.12.1902
### Updated: Sun Dec 8 21:06:48 SAST 2019 ### Updated: Tue Dec 10 21:07:13 SAST 2019
### Bad Bot Count: 562 ### Bad Bot Count: 562
################################################### ###################################################
### Version Information ## ### Version Information ##