vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-02 10:40:36 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2020.06.2084 [ci skip]

Browse source
This commit is contained in:
Travis 2020-06-18 18:36:21 +02:00
parent ea3520acc8
commit 6f35d7b97f
51 changed files with 16900 additions and 16897 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

1756
.dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
.dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
34.73.66.97 1; 35.231.58.0 1;
127.0.0.1 1; 127.0.0.1 1;

2
.dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
34.73.66.97 0; 35.231.58.0 0;
127.0.0.1 0; 127.0.0.1 0;

1756
.dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
.dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
34.73.66.97 1; 35.231.58.0 1;
127.0.0.1 1; 127.0.0.1 1;

2
.dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
34.73.66.97 0; 35.231.58.0 0;
127.0.0.1 0; 127.0.0.1 0;

1756
.dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
.dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
34.73.66.97 1; 35.231.58.0 1;
127.0.0.1 1; 127.0.0.1 1;

2
.dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
34.73.66.97 0; 35.231.58.0 0;
127.0.0.1 0; 127.0.0.1 0;

1756
.dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

1756
.dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

1756
.dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
.dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
34.73.34.132 0; 35.227.58.83 0;

1756
.dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
.dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
35.196.82.30 1; 34.74.91.53 1;
127.0.0.1 1; 127.0.0.1 1;

2
.dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
35.196.82.30 0; 34.74.91.53 0;
127.0.0.1 0; 127.0.0.1 0;

1756
.dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
.dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
35.196.82.30 1; 34.74.91.53 1;
127.0.0.1 1; 127.0.0.1 1;

2
.dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
35.196.82.30 0; 34.74.91.53 0;
127.0.0.1 0; 127.0.0.1 0;

1756
.dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
.dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
35.196.82.30 1; 34.74.91.53 1;
127.0.0.1 1; 127.0.0.1 1;

2
.dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
35.196.82.30 0; 34.74.91.53 0;
127.0.0.1 0; 127.0.0.1 0;

1756
.dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
.dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,5 +45,5 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
34.73.66.97 0; 35.196.82.30 0;
35.231.58.0 0; 35.231.58.0 0;

1756
.dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

4
.dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,5 +45,5 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
35.231.58.0 0; 34.73.66.97 0;
34.74.91.53 0; 34.73.34.132 0;

1756
.dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

3
.dev-tools/test4_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,5 +45,6 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
34.73.66.97 0;
35.227.58.83 0; 35.227.58.83 0;
34.74.91.53 0; 35.196.82.30 0;

1756
.dev-tools/test4_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

4
.dev-tools/test5_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,6 +45,6 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
35.196.82.30 0; 35.231.58.0 0;
35.227.58.83 0;
34.73.34.132 0; 34.73.34.132 0;
34.74.91.53 0;

1756
.dev-tools/test5_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
.dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
34.73.66.97 1; 35.231.58.0 1;
127.0.0.1 1; 127.0.0.1 1;

20
.dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
ChinaClaw Badass
EMail Siphon Cliqzbot
Express WebPictures DomainSigmaCrawler
Hloader Go-Ahead-Got-It
Jyxobot Lmspider
Mozlila muhstik-scan
NextGenSearchBot NearSite
Papa Foto Toweyabot
Xenu UnisterBot
ZyBorg WebWhacker

282
.dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
404checker 404checker
404enemy Aboundexbot
Aboundex
Acunetix Acunetix
ADmantX ADmantX
AfD-Verbotsverfahren AfD-Verbotsverfahren
AhrefsBot AhrefsBot
AIBOT AIBOT
AiHitBot
Alexibot Alexibot
Alligator Alligator
AllSubmitter AllSubmitter
AlphaBot AlphaBot
Anarchie
Ankit Ankit
Apexoo ASPSeek
arquivo.pt
Asterias
Attach
autoemailspider autoemailspider
BackDoorBot BackStreet
backlink-check
BacklinkCrawler
BackWeb
Badass
Bandit Bandit
Barkrowler Barkrowler
Battleztar Bazinga BBBike
BDFetch
BetaBot BetaBot
Bitacle Bitacle
Blackboard BlowFish
Black Hole Boardreader
BlackWidow Bolt
BLEXBot
Blow
Brandprotect Brandprotect
BuiltBotTough Brandwatch
BuiltWith BuiltWith
Bullseye
BunnySlippers BunnySlippers
CazoodleBot Calculon
CheeseBot Cegbfeieh
ChinaClaw CheTeam
cognitiveseo
Collector Collector
CopyRightCheck com.plumanalytics
Copier
Copyscape Copyscape
crawler.feedback
crawl.sogou.com
CrazyWebCrawler CrazyWebCrawler
CSHttp Crescent
Custo CrunchBot
demandbase-bot DataCha0s
Deusu DBLBot
DIIbot Devil
DigitalPebble
Dirbuster Dirbuster
Disco Disco
Discoverybot
DittoSpyder
DnyzBot
DomainAppender
DomainCrawler DomainCrawler
DomainSigmaCrawler DomainSigmaCrawler
Domains Project Domains Project
Download Wonder DSearch
EasyDL EasyDL
Ecxi eCatch
EirGrabber EirGrabber
EroCrawler
evc-batch
Express WebPictures
ExtLinksBot ExtLinksBot
Extractor Extractor
ExtractorPro Extreme Picture Finder
facebookscraper FDM
FemtosearchBot FemtosearchBot
Flunky Fimap
Firefox/7.0
Foobot Foobot
Freeuploader
FyberSpider
Fyrebot
GalaxyBot GalaxyBot
GermCrawler
Getintent Getintent
GetWeb GetWeb
Gotit Gigablast
Go!Zilla G-i-g-a-b-o-t
Grabber Grabber
GridBot GrabNet
GT::WWW Grafula
Havij GrapeFX
Hloader Haansoft
HaosouSpider
Harvest
HEADMasterSEO
heritrix
HMView
HTMLparser HTMLparser
HTTP::Lite
HTTrack HTTrack
Humanlinks HybridBot
IndeedBot Iblog
Indy Library Indy Library
InfoNaviRobot InfoNaviRobot
InfoTekies instabid
Intelliseek InternetSeer
InterGET ips-agent
Internet Ninja IstellaBot
internetVista monitor Jbrofuzz
IRLbot
JennyBot JennyBot
JetCar Jorgee
JustView
Jyxobot Jyxobot
Kenjin Spider
Kozmosbot Kozmosbot
Lanshanbot
LeechGet LeechGet
LexiBot
Lftp Lftp
Lightspeedsystems LibWeb
Likse LieBaoFast
Linkdexbot
LinkextractorPro LinkextractorPro
LinkpadBot LinkpadBot
LinksManager
LinkWalker
LinqiaMetadataDownloaderBot LinqiaMetadataDownloaderBot
LinqiaRSSBot
LinqiaScrapeBot LinqiaScrapeBot
Lipperhey Lipperhey
Lipperhey Spider Lmspider
LNSpiderguy LWP::Simple
Ltx71
Magnet Magnet
Mag-Net
magpie-crawler magpie-crawler
Majestic SEO
Majestic-SEO
MarkMonitor
MarkWatch
Masscan Masscan
Mata Hari
MauiBot MauiBot
Mb2345Browser Mb2345Browser
meanpathbot meanpathbot
Meanpathbot Metauri
MeanPath Bot MFC_Tear_Sample
mediawords
MicroMessenger MicroMessenger
Microsoft Data Access
Microsoft URL Control Microsoft URL Control
MIIxpc MJ12bot
Mister PiX Mr.4x3
MSIECrawler
muhstik-scan muhstik-scan
Musobot Name Intelligence
Nameprotect Navroad
Needle Needle
Nessus NetMechanic
netEstate NE Crawler
NetLyzer
Nettrack Nettrack
Net Vampire
Netvibes
NetZIP NetZIP
NextGenSearchBot
Nibbler Nibbler
NICErsPRO Nikto
Niki-bot
NimbleCrawler NimbleCrawler
Nmap oBot
NPbot OpenLinkProfiler
Octopus Openvas
Offline Explorer
Offline Navigator
OnCrawl
Openfind
OpenVAS OpenVAS
OPPO A33 OPPO A33
OutclicksBot OrangeSpider
OutfoxBot
PageGrabber PageGrabber
page scorer Pandalytics
Pavuk
pcBrowser pcBrowser
PHPCrawl
Picscout Picscout
Picsearch Picsearch
Pi-Monster Pimonster
Pixray plumanalytics
polaris version POE-Component-Client-HTTP
Probethenet Probethenet
ProWebWalker PxBroker
Quick-Crawler PyCurl
RankActive RankFlex
RankActiveLinkBot Rankivabot
RankingBot2 Reaper
RepoMonkey Recorder
Ripper
RocketCrawler
ScanAlert ScanAlert
Scanbot
scan.lol
Scrapy Scrapy
Screaming
Searchestate
SemrushBot SemrushBot
SEOkicks-Robot SEOkicks
Seomoz
SEOprofiler SEOprofiler
SeoSiteCheckup seoscanners
SEOstats SEOstats
serpstatbot Shodan
sexsearcher Sitebeam
Siphon
SiteSnagger SiteSnagger
SiteSucker
SlySearch
Snake Snake
Snapbot
Snoopy Snoopy
SocialRankIOBot Sosospider
Sottopop
SpaceBison
Spanner Spanner
sp_auditbot Steeler
Sqlmap Stripper
Sucker Sucker
Sucuri Sucuri
SuperHTTP
Surfbot Surfbot
Suzuran Suzuran
Swiftbot
Szukacz Szukacz
T8Abot
tAkeOut tAkeOut
Teleport
TeleportPro TeleportPro
Telesphoreo Telesoft
Telesphorep
The Intraformant The Intraformant
TightTwatBot
Toata
Toweyabot Toweyabot
trendiction.com Tracemyfile
Trendictionbot
True_Robot
Turingos Turingos
Turnitin
UnisterBot
Upflow
URLy.Warning URLy.Warning
Vacuum
Vagabondo Vagabondo
VCI VCI
Virusdie VidibleScraper
WallpapersHD VoidEYE
Voil
Wallpapers/3.0
WASALive-Bot WASALive-Bot
Webalta WBSearchBot
WebAuto
WebBandit WebBandit
WebCopier WEBDAV
Web Enhancer WebEnhancer
WebmasterWorldForumBot Web Fetch
WebFuck
WebImageCollector
webmeup-crawler webmeup-crawler
Web Pix WebPix
WebReaper WebReaper
WebSauger
Web Sauger Web Sauger
Website Quester Webshag
WebsiteQuester
Webster
WebStripper WebStripper
WebZIP WebSucker
Web Sucker
WebWhacker
Whack
Whatweb Whatweb
Who.is Bot Who.is Bot
WiseGuys Robot
WISENutbot
Wonderbot Wonderbot
WWW-Mechanize Woobot
Wprecon
WPScan
WWW::Mechanize WWW::Mechanize
WWWOFFLE x09Mozilla
x22Mozilla x22Mozilla
Xaldon WebSpider
Xaldon_WebSpider Xaldon_WebSpider
xpymep1.exe Xenu
YoudaoBot
Zermelo Zermelo
Zeus
zgrab zgrab
Zitebot ZmEu
ZumBot
ZyBorg ZyBorg

294
.dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
360Spider ADmantX
404enemy AfD-Verbotsverfahren
AhrefsBot
AiHitBot AiHitBot
Alligator Alligator
Anarchie AllSubmitter
Ankit AlphaBot
Aspiegel Apexoo
archive.org_bot
arquivo.pt
ASPSeek ASPSeek
autoemailspider Asterias
BackDoorBot Attach
Backlink-Ceck AwarioRssBot
AwarioSmartBot
BacklinkCrawler
BackWeb
Badass Badass
BBBike Barkrowler
BetaBot Battleztar Bazinga
BDCbot
BDFetch
Blackboard Blackboard
Black Hole
Blow
Boardreader Boardreader
Bolt Bolt
BotALot Brandprotect
BuiltWith Buddy
BunnySlippers BuiltBotTough
CATExplorador Bullseye
CCBot CCBot
Cloud mapping Cloud mapping
coccocbot-web coccocbot-web
Cogentbot
cognitiveseo cognitiveseo
Collector
Copier Copier
CopyRightCheck
Cosmos Cosmos
crawler4j
CrazyWebCrawler
Crescent
CrunchBot CrunchBot
Custo
DatabaseDriverMysqli DatabaseDriverMysqli
DataCha0s DataCha0s
DBLBot
demandbase-bot
Demon
Deusu Deusu
Devil Devil
DigitalPebble Discobot
Disco DomainAppender
DomainCrawler
DomainSigmaCrawler DomainSigmaCrawler
Dotbot domainsproject.org
Download Wonder DomainStatsBot
Dragonfly Dragonfly
Drip Drip
DSearch DSearch
DTS Agent DTS Agent
Ebingbong EasyDL
eCatch ECCP/1.0
EirGrabber
EMail Siphon EMail Siphon
EroCrawler EMail Wolf
evc-batch Evil
Exabot Exabot
Express WebPictures FemtosearchBot
ExtLinksBot Fimap
Extractor Firefox/7.0
ExtractorPro
FDM
FHscan
Foobot
FrontPage FrontPage
FyberSpider GermCrawler
GalaxyBot
Getintent Getintent
GetRight Gigabot
Gigablast
G-i-g-a-b-o-t
Go-Ahead-Got-It Go-Ahead-Got-It
Gotit
GoZilla
Go!Zilla Go!Zilla
Grabber GrabNet
Grafula
GrapeshotCrawler GrapeshotCrawler
GridBot
GT::WWW GT::WWW
HaosouSpider
Harvest
HEADMasterSEO HEADMasterSEO
heritrix
Heritrix Heritrix
HMView HTMLparser
HTTP::Lite HTTP::Lite
Humanlinks Humanlinks
IDBot IDBot
IlseBot Id-search
Image Fetch Image Sucker
InfoNaviRobot
instabid instabid
Intelliseek Internet Ninja
InternetSeer InternetSeer
ips-agent internetVista monitor
Iria
IstellaBot IstellaBot
JamesBOT
JetCar JetCar
Jetty Jetty
Kenjin Spider JikeSpider
Keyword Density Joomla
Kinza JustView
Jyxobot
Kozmosbot
Larbin Larbin
LeechFTP LexiBot
Libwhisker Lftp
LieBaoFast LibWeb
Lightspeedsystems Linkdexbot
Likse
LinkpadBot
LinkScan
LinkWalker LinkWalker
LinqiaMetadataDownloaderBot
Lipperhey Lipperhey
lwp-request Lipperhey Spider
LWP::Simple
lwp-trivial lwp-trivial
magpie-crawler Magnet
Mail.RU_Bot meanpathbot
MarkWatch Meanpathbot
Masscan
Mass Downloader
MauiBot
MegaIndex.ru MegaIndex.ru
Metauri MFC_Tear_Sample
MicroMessenger MicroMessenger
Microsoft Data Access MIDown tool
Microsoft URL Control MJ12bot
Mister PiX Mojolicious
Mojeek
Morfeus Fucking Scanner Morfeus Fucking Scanner
Mozlila
Mr.4x3 Mr.4x3
MSIECrawler MSIECrawler
Msrabot
muhstik-scan muhstik-scan
Name Intelligence Name Intelligence
Nameprotect
Navroad
Needle
Nessus Nessus
netEstate NE Crawler Net Vampire
NetMechanic NextGenSearchBot
Nettrack NICErsPRO
Netvibes Niki-bot
Nimbostratus NimbleCrawler
Ninja
NPbot NPbot
Nutch
oBot oBot
Offline Explorer Octopus
Offline Navigator
OnCrawl
Openfind Openfind
OpenLinkProfiler Openvas
OpenVAS OpenVAS
OPPO A33 OPPO A33
OutclicksBot OrangeBot
OutfoxBot Page Analyzer
PageGrabber PageGrabber
page scorer
PageScorer PageScorer
Pandalytics Pandalytics
Panscient Panscient
Papa Foto Pavuk
pcBrowser PECL::HTTP
Picscout
Picsearch
PictureFinder PictureFinder
PleaseCrawl Pimonster
Pockey Pixray
plumanalytics
POE-Component-Client-HTTP POE-Component-Client-HTTP
Pump Psbot
PyCurl PyCurl
QueryN Metasearch QueryN Metasearch
Quick-Crawler
RankActive RankActive
RankFlex
RankingBot2 RankingBot2
RealDownload RealDownload
Reaper
Recorder
RedesScrapy RedesScrapy
RepoMonkey ReGet
RSSingBot Ripper
s1z.ru RocketCrawler
SBIder
ScanAlert ScanAlert
Screaming ScoutJet
SearchmetricsBot Semrush
SEOkicks-Robot SemrushBot
SEOprofiler SEOkicks
SEOstats Seomoz
seoscanners
SeoSiteCheckup
sexsearcher sexsearcher
Siphon Shodan
Sitebeam Sitebeam
SiteExplorer SiteLockSpider
SiteSnagger SiteSnagger
Site Sucker
SlySearch SlySearch
SmartDownload SmartDownload
SMTBot Snapbot
Snake Sociscraper
Snoopy
SocialRankIOBot
sogouspider
Sogou web spider
Sosospider
SpaceBison SpaceBison
SpankBot SpankBot
sp_auditbot sp_auditbot
Spbot Spbot
Spinn3r Sqlmap
SputnikBot Sqlworm
spyfu
Steeler Steeler
Stripper Sucuri
SuperHTTP SuperBot
Surfbot
SurveyBot
Swiftbot Swiftbot
TeleportPro Szukacz
T0PHackTeam
Teleport
Telesphoreo Telesphoreo
Telesphorep
The Intraformant The Intraformant
TheNomad Titan
Toweyabot
Tracemyfile
Trendiction Trendiction
Trendictionbot trendiction.de
True_Robot
Turingos Turingos
Turnitin
TurnitinBot TurnitinBot
Twice
Typhoeus Typhoeus
UnisterBot UnisterBot
URLy.Warning URLy.Warning
Vacuum
VB Project
VeriCiteCrawler
Voltron
Wallpapers/3.0 Wallpapers/3.0
WallpapersHD WASALive-Bot
Webalta Webalta
WebAuto WebAuto
WebBandit
WebCollage WebCollage
Web Collage Web Collage
WebCopier WebEnhancer
WEBDAV WebFetch
Web Enhancer Web Fetch
WebPix WebFuck
Web Fuck
WebGo IS
WebLeacher
WebmasterWorldForumBot
webmeup-crawler
WebReaper WebReaper
Webshag WebSauger
Web Sauger
WebsiteExtractor WebsiteExtractor
Website Quester
Webster Webster
Web Sucker WebStripper
WebWhacker WebZIP
Whacker WinHTTrack
Widow WISENutbot
Wprecon Wonderbot
WPScan WWW-Collector-E
WWW::Mechanize
WWWOFFLE WWWOFFLE
Xaldon WebSpider Xaldon WebSpider
Xaldon_WebSpider xpymep1.exe
Xenu Zauba
Zade
zauba.io zauba.io
Zeus
zgrab zgrab
Zitebot
ZmEu
ZumBot ZumBot

20
.dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
aloofly.com arvut.org
asacopaco.tk bestprofits-there.com
azinoofficial777.ru jyvopys.com
drpornogratisx.xxx play-mp3.com
elite-sex-finders.com reckonstat.info
eyelike.com.ua school-diplomat.ru
fikasound.tk socialtrade.biz
gotorussia.com topshef.ru
koral.se underthesite.com
medicine-4u.org win-spy.com

922
.dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
00go.com
0912701309f8ce.com 0912701309f8ce.com
101raccoon.ru 0daymusic.org
4webmasters.org 101flag.ru
7fon.ru 178evakuator178.ru
7makemoneyonline.com 1adult.com
999webdesign.com 1kdailyprofit.me
9med.net 51unlim.ru
abbanreddy.com 55wmz.ru
abovetherivernc.com aa8780bb28a1de4eb5bff33c28a218a930.com
adcash.com abcguru.xyz
adrenalin-stk.ru academiacsmendoza.org
adultgalls.com acads.net
adultnet.in actulite.com
adzerg.com admeasures.com
aerogo.com adserver-e7.com
albamargroup.com adsref.men
all-number.com adssafeprotected.com
alveris.ru adventureparkcostarica.com
android4fun.org agahinameh.com
androids-store.com agapovdg.ru
anniemation.com airlandsea.info
anonymous-redirect.com aliexpresscashback.club
api.stathat.com alloysteel.ru
apple.com-cleaner.systems allproblog.com
app-ready.xyz amateurgalls.com
aquarium-pro.ru amateurlivechat.org
amigobulls.com
anaksma.info
an-donut.com
angel1777.kz
animebox.com.ua
apartmentratings.com
apioutoboxnet-a.akamaihd.net
aproposde.com
arcadeplayhouse.com arcadeplayhouse.com
arkkivoltti.net arendas.net
artdeko.info asrv-a.akamoihd.net
as5000.com astrochicks.com
asia-forum.ru
audiofree.ru
auto4style.ru
autorn.ru
autoseo-traffic.com autoseo-traffic.com
aviva-limoux.com autoua.top
avtolombard-krasnodar.ru avirasecureserver.com
azartmsl.com baixar-musicas-gratis.com
babosas.com balans.shahterworld.org
backuperwebcam.weebly.com balkanfarma.org
bag77.ru bankcrediti.ru
bannerads.de belinvestdom.by
beachfix.co benchmarkcommunications.co.uk
becuo.com berlininsl.com
best-mam.ru
best-seo-solution.com best-seo-solution.com
bestserials.com
bestwebsitesawards.com
betonka.pro betonka.pro
betune.onlinewebshop.net bezsporno.ru
bezcmexa.ru binaryoptionscops.info
bigcareer.info bioca.org
bigpictures.club blackhatworth.com
bingo8888.com blog.koreadaily.com
bio-japan.net bolezniorganov.ru
bitcoins-live.ru bombla.org
biteg.xyz browsepulse-a.akamaihd.net
biznesluxe.ru bugof.gq
blacktwhite.com bumskontakte.org
blockety.co burger-tycoon.com
bloke.com burkesales.com
bluerobot.info businescoop.men
bmwhighperformers.com business-suggested.tk
bocoarchives.org buy-cheap-pills-order-online.com
boo-arts.com buyhoverboard.com
bookmark4you.com buyk.host.sk
brainsandeggs.blogspot.com bvlgariwallet.xyz
brewdom.ru
briomotor.co
bristolhotel.com
budilneg.xyz
bukleteg.xyz
buttons-for-website.com
buyessaynow.biz
buzzzg.men
bzero1jewelry.net bzero1jewelry.net
cactussoft.biz camsex.xxx-cam.webcam
calc-for-credit.ru candcstuccoandstone.com
callstevens.com carfax.com.ua
cartierlove2u.xyz cartierlove2u.xyz
cashkitten-a.akamaihd.net cartierlovebraceletreplica.xyz
caveavins.fr cartierlovestore.xyz
cdncash.org cercacamion.it
ceotrk.com cete.ru
cerev.info cheapjerseysfootballshop.com
cheapbelstaff.online cheapmarmot.online
cheapestjerseysonwholesale.com chee-by.biz
checkm8.com circlesl.com
chinese-amezon.com ci.ua
ciceros.co cjmc.info
classicakuhni.ru clayvasedesigns.tk
clean-start.net cleanallspyware.com
clickaider.com cleanmypc.com
clicksor.net clevernt.com
clodo.ru clickintext.net
compliance-barak.xyz clubfashionista.com
compliance-irvin.xyz cntravelre.com
collegeessay19.blogspot.ru
communisave.co.za
compliance-alex.xyz
compliance-jess.top compliance-jess.top
craftinsta.ru compliance-julia.top
creditwell.ru comsysnet.com
cubs-jerseys.us contextualyield.com
cv.wallhade.co cookie-law-enforcement-aa.xyz
cyclobenzaprinevstizanidine.blogspot.com coolgamechannel.com
czeshop.info coprofam.org
ddospanel.com cougfan.info
dealighted.com cowlmash.com
dear-diary.ru cranly.net
den-noch24.ru creams.makeforum.eu
deplim.com cryptoswap.biz
dfiles.me cxpromote.com
dieta-personalna.pl ddsoldes.fr
dirtpics.pw design-lands.ru
discountbarbour.online diarioaconcagua.com
downloads-whatsapp.com dickssportinggoods.com
driving.kiev.ua diesel-parts28.ru
dustyorate.com digital-video-processing.com
dvd-famille.com dildofotzen.net
dyt.net dinosaurus.site
e705.net discovertreasure-a.akamaihd.net
ec-file.info distver.ru
ee77ee.com docstoc.com
efkt.jp doctissimo.fr
elektronischezigarettekaufen1.myblog.de dogclothing.store
elektrozigaretten1.webs.com domcran.net
elkacentr.ru dtm-spain.com
el-nation.com earl-brown.info
elstal.com.pl ecommerce-seo.org
embedle.com editors.choice6912650.hulfingtonpost.com
en.home-task.com educatemetv.com
eralph.tk electro-prom.com
erot.co elektrozigarettekaufen2.blogse.nl
esopini.com elexies.info
everypony.ru englishdictionaryfree.com
everytalk.tv erotik-kostenlos.net
exct.net ertelecom.ru
eshop4u.jp
eupornstar.info
executehosting.com executehosting.com
exportshop.us exhibitionplus.eu
factorynightclub.com exmasters.com
familyholiday.ml eyessurgery.ru
faptitans.com ezigarettekaufen1.hpage.com
fashionindeed.ml falllow.gq
fdzone.org familienzahnaerzte.com
fertilitetsradgivningen.se femmesdenudees.com
fetlifeblog.com fickkontaktehobbyhuren.com
filmidivx.com filmi-onlain.info
financetip.eu flashbannernow.com
fishtauto.ru flauntyoursite.com
flashlarevista.com folowsite.com
fok.nl forex-indextop20.ru
fortunejack.com forpostlock.ru
foto-basa.com forum20.smailik.org
fototravel.eu forums.d2jsp.org
franecki.net freelinkbuilding.website.tk
fr-bearings.ru freemaintenancesysforpcandmac.top
frbizlist.com freenode.info
freelotto.com free-social-buttons.com
freenom.link freewhatsappload.com
free-social-buttons.xyz g33.org
frequiry.com gagrasector.ru
frustrated-favorable.gq galaxy-family.ru
fungamelands.com gallerily.com
galeria-zdjec.com gamerscorps.com
gamebackyard.com gamevalue7.weebly.com
gamedayhouse.com gaming-journal.com
game-mmorpg.net gamingspark.com
gay-site.store garciniaxt.us
gaz-voshod.ru gardene.ru
gcup.ru gay.adultgalls.com
genetworx.com ge0ip.net
gk-atlant.info geilehausfrauen.net
gentamicineyedrops.blogspot.com
gepezz.info
getlamborghini.ga
getmiro.com
gigablast.com
given2.com
gktt.ru gktt.ru
glavtral.ru glavtral.ru
goldandcard.ru glcomputers.ru
goldpanningtools.com globalsurfari.com
googlepositions.com googlemare.com
goo.ne.jp graphics8.info
goosefishpost.bid graphid.com
gopixdatabase.com
gosmeb.ru
gotcher.us
gowreckdiving.com
gratuitbaise.com
greatgrace.ru greatgrace.ru
growboxbl.ru gribkovye-zabolevaniya.com
gsasearchengineranker.site gsmlab.pl
guildebzh.info gstatey.net
handicapbathtubarea.com guod.me
hannasolution.ru handicapvantoday.com
hanwei.us hanwei.us
hasfun.com happy.new.yeartwit.com
haveinc.xyz
hccoder.info
healing-dysplasia.ru
hentai-manga.porn hentai-manga.porn
hermesreplica.pw hidemyass.com
historichometeam.com hifidesign.ru
histock.info
hjaoopoa.top hjaoopoa.top
hobbyhuren-datenbank.com hotblog.top
https-legalrc.biz hotshoppymac.com
hully.altervista.org hoverboardforsaledirect.com
husky-shop.cz hscsscotland.com
hydropump.su hspline.com
iboss.com ico.re
ifmo.ru ictizanidinehcl4mg.blogspot.com
imagine-ex.co idegenvezeto.eu
imgata.com ie.57883.net
impisr.edunsk.ru ifirestarter.ru
impresagaia.it imitex-plus.ru
inbabes.sexushost.com
incanto.in.ua
indiakino.net indiakino.net
interior-stickers.ru insider.pro
investsuccess.org instasexyblog.com
investzalog.ru invivo.hu
iopeninghours.co.uk iqoption-bin.com
javxxx18.com isitpaleo.info
jerseychinabizwholesale.com islamtoday.co.za
jerseywholesaleelitestore.com istock-mebel.ru
jumptap.com itbc.kiev.ua
justdating.online itch.io
justprofit.xyz itis4you.com
kadashihotel.com ivoiretechnocom.ci
karpun-iris.ru jacago.com
katushka.net jagg.info
keenoutlet.online javatex.co.id
kerwinandcariza.com jus0wil.pp.ua
keywordsdoctor.com kaliningrad.zrus.org
keywordsking.com ketoanhanoi.info
keyword-suggestions.com kinoduh.ru
keywordteam.net kinoflux.net
kidskunst.info kinomaniatv.pl
knowyournextmove.com kinosed.net
kochanelli.com kleine-titten.biz
kolotiloff.ru klitimg.pw
komp-pomosch.ru klosetkitten.com
komputernaya-pomosh-moscow.ru knowsitall.info
konpax.com
koopilka.com koopilka.com
kosova.de krafte.ru
kovrenok.ru kraljeva-sutjeska.com
kung-fu-ru.com krasivoe-hd.net
kvartira-sutochno.com krasnodar-avtolombards.ru
kw21.org lafriore.ru
kwzf.net laudit.ru
lacloop.info laxdrills.com
landinez.co leadn.pl
law-check-seven.xyz lider-zhaluzi.kiev.ua
letmacworkfaster.world liky.co.ua
letsart.ru lineavabit.it
libertybilisim.com linksharingt.com
limtu.ifmo.ru liveu.infoteka.hu
linkbuddies.com lonfon.xyz
linkrr.com
lion.playtap.us
littleberry.ru
liveshoppersmac.com
livetsomudvekslingstudent.bloggersdelight.dk
llastbuy.ru
localflirtbuddies.com
longgreen.info
lost-alpha.ru
lulea-auktionsverk.se lulea-auktionsverk.se
lunamedia.co mabdoola.blogspot.com
lunchrock.co mamasuper.prom.ua
lutherstable.org marketingvici.com
mac-shield.com mature.free-websites.com
mactechinfo.info mazda-roadsters.com
mail.allnews24.in mcadamssupplyco.com
malwareremovalcenter.com mebel-alait.ru
mansiondelrio.co medicines-choice.com
mansparskats.com meds-online24.com
marcowebonyodziezowe.pl mesbuta.info
maxxtor.eu m-google.xyz
meccadumps.net minneapoliscopiers.com
mega-bony-2017.pl mir-limuzinov.ru
mega-bony2017.pl mmstat.com
menhealed.net mojaocena.com
message-warning.net montredemarque.nl
metascephe.com morlat.altervista.org
mexicosleevegastrectomy.com msfsaar.de
micasainvest.com
mobot.site
motherboard.vice.com
movies-in-theaters.net
mp3ringtone.info
mriyadh.com
mrmoneymustache.com
mturkcontent.com mturkcontent.com
mundoaberrante.com
musflashtv.com
mustwineblog.com mustwineblog.com
myanyone.net
mycaf.it
mydeathspace.com mydeathspace.com
mzdish.site myfreemp3.eu
nac-bearings.ru mygameplus.com
narkologiya-belgorod.ru mysexpics.ru
navalwiki.info nbsproject.ru
news-readers.ru networkcheck.xyz
newhairstylesformen2014.com
newsperuse.com
newstraveller.ru
nfljerseyscheapbiz.us nfljerseyscheapbiz.us
nhl17coins.exblog.jp nhl17coinsforps3.gratisblog.biz
ningessaybe.me njpalletremoval.com
nomuos.it nlfjjunb5.ru
nodup.ru
nonews.co
nootrino.com
nordstar.pro nordstar.pro
nottyu.xyz nrjmobile.fr
odoratus.net nucia.biz.ly
offergroup.info nyfinance.ml
oktube.ru obsessionphrases.com
onlinetvseries.me oil-td.ru
o-o-6-o-o.com o.light.d0t.ru
o-o-6-o-o.ru one-gear.com
optibuymac.com online-hd.pl
osoznanie-narkotikam.net ontargetseo.us
ostroike.org osagonline.ru
outshop.ru osb.se11.ru
ourtherapy.ru
ownshop.cf
oxotl.com
pagesense.com pagesense.com
paramountmarble.co.uk pammik.ru
partners-ship.pro paphoselectricianandplumber.com
pc4download.co partner-host.men
pendelprognos.se partner-stop.men
photosaga.info pateaswing.com
picsfair.com pensplan4u.com
picturesfrom.com petedrummond.com
piluli.info pewit.pw
pinkduck.ga physfunc.ru
pinstake.com pihl.se
pivka.xyz pixell.club
pizza-imperia.com pizdopletka.club
pizza-tycoon.com pizza-tycoon.com
platezhka.net play.leadzupc.com
ploenjitmedia.azurewebsites.net pochemychka.net
podshipniki-ntn.ru poiskzakona.ru
poems.com.ua poppen-nw.net
polybuild.ru popunder.ru
pornotubexxx.name posible.net
pornstartits.xblog.in positive2b.ru
postclass.com pozdrawleniya.com
potolokelekor.ru pravoholding.ru
praisong.net prefersurvey.net
preg.marketingvici.com prizefestival.mobi
princevc.com proprostatit.com
promalp-universal.ru prostitutki-rostova.org
prostitutki-kiev.org psa48.ru
prpops.com pussyspace.net
psoriasis-file.trade
pst2017.onlinewebshop.net
ptr.ruvds.com
pyramidlitho.webs.com
rainbowice.ru rainbowice.ru
rankings-analytics.com rankingchart.de
rankscanner.com
ranksonic.org
realtytimes.com
redirect.trafficreceiver.club
registrysweeper.com registrysweeper.com
remedyotc.com reining.lovasszovetseg.hu
resultshub-a.akamaihd.net relax.ru
rixpix.ru relayblog.com
robot-forex.biz remontbiz.ru
roll123.com renecaovilla.online
roznica.com.ua renecaovillasale.online
rus-teh.narod.ru renewablewealth.com
sadaholding.com respublica-otel.ru
sa-live.com rewardit.com
salut-camp.ru rfid-locker.co
sanyuprojects.com ringtonepartner.com
sawin.beth.webd.pl rock-cafe.info
scanner-brian.top roleforum.ru
scanner-mary.top roma-kukareku.livejournal.com
sdsjweb.com romhacking.ru
search-error.com roofers.org.uk
securityallianceservices.com rootandroid.org
selectads.men rosbalt.com.ua
seofied.com rp9.ru
seogadget.ru ruex.org.ua
seonetwizard.com rus-pornuha.com
rusprostitute.com
russia-today-video.ru
rutor.group
sakhboard.ru
sandhillsonline.com
sankt-peterburg.nodup.ru
sape.top
saveindex.xyz
scottbywater.com
seansonline24.pl
searchencrypt.com
seasaltwithfood.com
segol.tv
semprofile.com
seocheki.net
seorussian.ru seorussian.ru
serptehnika.ru seo-traffic-ranking.info
servicecenter.co.ua serialsway.ucoz.ru
se-welding.ru share-buttons-for-free.com
sexflirtbook.com
sex.hotblog.top
sexkontakteao.info
sexpornotales.net
shama-rc.net
sharebutton.net
sharebutton.to
sharpchallenge.com
shijian.ac.cn shijian.ac.cn
shymkent.xkaz.org shivafurnishings.com
signal03.ru shop.xz618.com
sims-sims.ru sierraapps.com
sigmund-freud.co.uk
simul.co simul.co
sitebeam.net sirpornogratis.xxx
skyway24.ru siteimprove.com
slavkokacunko.de sitiz.club
sms2x2.ru sitopreferito.it
sneakyboy.com skachat-besplatno-obrazcy.ru
snip.to sledstvie-veli.net
soc-econom-problems.ru snjack.info
socialmediasuggest.com socas.pluto.ro
social-s-hhh.xyz socialtrade.biz
softlinesolutions.me solicita.info
softtor.com soserfis.com
soheavyblog.com
solinf.co
solitaire-game.ru
souvenir.cc souvenir.cc
spb-plitka.ru soviet-portal.do.am
stairliftsarea.com spb.afora.ru
startwp.org spywarebegone.com
stjamesschool.info standardchartered-forex.com
stmassage.ru statoutlook.info
stockquotes.wooeb.com
strag-invest.ru strag-invest.ru
streha-metalko.si strangeduckfilms.com
stretchmate.net stroicol.net
strfls.com stroiminsk.com
suhanpacktech.com
sukarame.net
sundrugstore.com sundrugstore.com
supermesta.ru tanieaukcje.com.pl
survival.betteroffers.review terrafootwear.us
szamponrevita.pl thepokertimer.com
tarad.com threecolumnblogger.com
tds-advert005.info titslove.yopoint.in
tdsing.ru tizanidine4mg.blogspot.com
tfxiq.com tizanidine4mguses.blogspot.com
thebluffs.com tizanidineformigraines.blogspot.com
thedownloadfromwarez.blogspot.com tizanidinehcl2mg.blogspot.com
theguardlan.com toonfamilies.net
thexart.club totu.info
timer4web.com tpu.ru
titelhelden.eu tracksurf.daooda.com
tizanidinehclsideeffects.blogspot.com triumf-realty.ru
tizanidineoral.blogspot.com trkur.com
tizanidineusedfor.blogspot.com
tizanidinewithdrawalsymptoms.blogspot.com
tmearegion26.com
topclickguru.com
topsy.com
torontoplumbinggroup.com
torrents.cd
toys.erolove.in
tozup.com
track112.site
tracksz.co
trackzapper.com
trafaret74.ru
traffic100.com
traxdom.ru
trichizobswiv.agddns.net
truck-land.life truck-land.life
ttsq.fr trustedhealthtips.com
tubeoffline.com try-rx.com
turbodsp.com tuberkulezanet.ru
tvnewsclips.info tuberkuleznik.ru
ufa.xrus.org turizmus.us
uhod-za-sobakoj.ru turn-up-life.life
ukkala.xyz turvgori.ru
unrealcommander.com twinderbella.com
uptimechecker.com uchetunet.su
ucsol.ru
uhdtv.website
unpredictable.ga
uptime.com
upupa.net
us-america.ru us-america.ru
vbikse.com valoresito.com
varikozdok.ru
vchulkax.com vchulkax.com
veerotech.com vegascosmetics.ru
vellings.info via-energy-order.com
veselokloun.ru video--production.com
video-chat.love
videochat.world
viktoria-center.ru viktoria-center.ru
visa-pasport.ru vkak.ru
vita.com.hr vksex.ru
vizag.kharkov.ua vladimir.xrus.org
vmnmvzsmn.over-blog.com
voloo.ru voloo.ru
vsdshnik.com vpnmouse.com
vvon.co.uk vsesubwaysurfers.com
vzglyadriv.kg vut.com.ru
w3data.co vysigy.su
watch-movies.ru vzlom-na-zakaz.com
wdrake.com watchmygf.net
webstatsdomain.org waterpurifier.club
weekes.biz.tc webinstantservice.com
wildnatureimages.com webix.me
wingsoffury2.com webjam.com
winner7777.net websiteaccountant.de
winwotgold.pl websites-reviews.com
xblog.in weclipart.com
xchat26.myfreecams.com wemedinc.com
x-diesel.org wholesalecheapjerseysfree.com
wineitudes.wordpress.com
w-journal.ru
wordkeyhelper.com
wpthemedetector.co.uk
xboxster.ru
xerox-douglas.cf
xn----7sbaphztdjeboffeiof6c.xn--p1ai
xn----7sbifcamovvfggw9d.xn--p1ai
xn--80abgj3a5acid6ghs.top
xn--80ak6aa92e.com xn--80ak6aa92e.com
x-stars.ru xn----9sbebi2bvzr7h.xn--p1ai
xtrafficplus.com xn--d1abj0abs9d.in.ua
xwatt.ru xn--e1aggki3c.xn--80adxhks
xxxguitars.com xn--hxazdsfy.blogspot.com
yadro.ru xpresscare.ru
yellowstonevisitortours.com xtraffic.plus
yogamatsexpert.com xtube.com
youporn-forum.ga yaaknaa.info
yourporngay.com yginekologa.com
yubikk.info yhit.press
yunque.pluto.ro yoopsie.com
zaimhelp.ru youdesigner.kz
zakonobosago.ru youporn-ru.com
zaobao.com.sg your-bearings.com
zero1.it yourserverisdown.com
zigarettenonl.canalblog.com yugo-star.ru
zigarettenonlinekaufen2.bloog.pl zahvat.ru
zirondelli.it zajm-zalog-krasnodar.ru
z-master.ru zarabiaj-dzis.pl
zocaparj.kz zed21.net
zolotoy-lis.ru
zryydi.com

482
.dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
214jaluwobapef.cf 256bit.by
2kata.ru 40cg.com
2x2fan.ru 5elementov.ru
777-club.ru aasoldes.fr
888.com abcdeg.xyz
acheterviagrafr24.com activepr.ru
adloads.net adultwebhosting.info
adsfresh.men adverster.com
adtology.com adzpower.com
adultnet.in affrh2015.com
adventureparkcostarica.com alfa-medosmotr.ru
adzerg.com alldezservice.kz
airlandsea.info anime.dougasouko.com
akama.com anmysite.com
aktivator-windows10.blogspot.com
akuhni.by
amoi.tn
apibrowsesmartne-a.akamaihd.net
apiitsthirteende-a.akamaihd.net apiitsthirteende-a.akamaihd.net
atofilms.com appleid-verification.com
autobudpostach.club arcadepages.com
autodo.info arcteryxsale.online
autoplate.info arraty.altervista.org
avek.ru asdfz.pro
bad-stars.net autogrep.ru
beetpics.pw azazu.ru
beget.tech balkanfarma.org
beremenyashka.com balla-boo.se
bigcareer.info battle.net
bildsuche.ru bbtec.net
beachpics.com
bensbargains.net
berrymall.ru
biglistofwebsites.com
bitporno.sx
blackle.com blackle.com
bluesalt.co bloggedporn.com
board.f00d.de bongacams.com
boole.onlinewebshop.net bristolhotel.com.ua
bouda.kvalitne.cz callmd5map.com
buybest1.biz cbcseward.com
canrioloadm.gq cellfun.mobi
carabela.com.do chatroulette.si
carloans.com cheapbarbour.online
cartierlove2u.com chimiver.info
cashkitten-a.akamaihd.net cicaki.net
casite-513049.cloudaccess.net clickso.com
caveavins.fr cl.s7.exct.net
centraletermice.us coderstate.com
cgi2.nintendo.co.jp coindirect.io
cheapjerseysfootballshop.com compliance-alex.top
christianlouboutinsaleonline.us cookielawblog.wordpress.com
clayvasedesigns.tk copyrightclaims.org
clubfashionista.com cowlmash.com
coinsspb.com crystalslot.com
collegerentals.com culturevie.info
contextualyield.com customsua.com.ua
corta.co cvety24.by
crafthubs.com damedingel.ya.ru
craftinsta.ru delfin-aqua.com.ua
creativehutindia.com dfiles.me
daneshetabiat.com dipstar.org
darmebel.com.ua dscaas.website
deadlinkchecker.com dtm-spain.com
dealitright.click educatemetv.com
dealwifi.com education-cz.ru
degerlund.net ee77ee.com
designdevise.com egovaleo.it
detskie-zabavi.ru energy-ua.com
devochki.top epicbrogaming.com
dichvuvesinhhanoi.com ero-advertising.com
dieta-personalna.pl etm-consult.de
div.as ezigaretteshop2.vefblog.net
domain-tracker.com fastcrawl.com
dumuelave.xyz favorcosmetics.com
dyt.net fermersovet.ru
eaplay.ru footbalive.org
ecxtracking.com fordsonmajbor.cf
elektrischezi.canalblog.com forensicpsychiatry.ru
enthuse.computernetworksonline.com forex.osobye.ru
envaseslotusama.com forodvd.com
exoclick.com fortunejack.com
ezigaretteshop2.mywapblog.com forum.tvmir.org
ezrvrentals.com freenode.info
f1nder.org free-share-buttons.blogspot.com
famix.xyz froggytube.com
fashion.stellaconstance.co fuckmill.com
feargames.ru fuck-paid-share-buttons.xyz
feel-planet.com
findpik.com
firma-legion.ru
fiverr.com
flowersbazar.com
formularz-konkurs.tk
forum.doctissimo.fr
fres-news.com
fxgallery.com
fyl.com.ru fyl.com.ru
generalporn.org gamezblox.com
gentamicineyedrops.blogspot.com generic-pills-online.com
gidonline.one getridofstretchmarks.org
gkvector.ru getyourimage.club
goforexvps.com gfaq.ru
grtyi.com gg-arena.ru
hanink.biz.ly girlgamerdaily.com
hauleddes.com globalsurfari.com
hazardky.net gotcher.us
hd-film.pl gsasearchengineranker.pw
help.tpu.ru gsasearchengineranker.xyz
hkladys.com haikuware.com
homemature.net hatdc.org
hotxnights.info hoholikik.club
hyiphunter.org homeart.space
ilo134uloh.com hostsshop.ru
imitex-plus.ru htmlcorner.com
iscblog.info humanelydrew.com
junglenet-a.akamaihd.net hunthillfarmtrust.org
justbcause.com hut1.ru
justucalling32211123456789.tk iamsport.org
jyvopys.com igadgetsworld.com
kakablog.net i-hobot.ru
kinky-fetishes.com inboxdollars.com
inzn.ru
ixora.pro
javxxx18.com
kamorel.com
katjimej.blog.fc2.com
ketrzyn.pl
kinotorka.ru
klikbonus.com klikbonus.com
klitimg.pw kol-energo.ru
kmd-pto.ru kretpicf.pw
knowsitall.info krynica.info
koronirealestate.gr ktotut.net
kountrylife.com kursy-ege.ru
kredit-blog.ru lazymanyoga.com
kurbappeal.info ledpolice.ru
law-check-seven.xyz lego4x4.ru
lernur.net levaquin750mg.blogspot.com
lescinq.com lifehacĸer.com
lexaprogeneric.link lincolntheatre.com
lida-ru.com lion.snapmap.us
linkbolic.com liquimondo.com
lizace.com liver-chintai.org
lkbennettstore.online lostfilm-online.ru
magento-crew.net low-format.ru
mansiondelrio.co mactechinfo.info
marcowebonyodziezowe.pl mainlinehobby.net
medicines-choice.com meetingrainstorm.bid
mobplayer.ru megaapteka.ru
multgo.ru members.ghanaweb.com
musicas.baixar-musicas-gratis.com menstennisforums.com
mvpicton.co.uk mesto-x.com
myindospace.com microstatic.pl
nibbler.silktide.com militarysale.pro
offer.camp mirobuvi.com.ua
officedocuments.net moncleroutletonline.xyz
ourtherapy.ru moxo.com
partner-host.men mrinsidesales.com
parvezmia.xyz mycaf.it
pc-services.ru myhitmp3.club
picsforkeywordsuggestion.com nailsimg.com
pivka.xyz nash-krym.info
pix-hd.com nextrent-crimea.ru
pizza-imperia.com nonameread45.live
pl.aasoldes.fr nosecret.com.ua
pomoc-drogowa.cba.pl ntic.fr
pornoforadult.com offers.bycontext.com
pornoreino.com okroshki.ru
portnoff.od.ua online-podarki.com
pozdrawleniya.com opinionreelle.com
prointer.net.ua orsonet.ru
pron.pro pacificair.com
paidonlinesites.com
paramountmarble.co.uk
parfusale.se
partners-ship.pro
pdamods.ru
penisvergrotendepillennl.ovh
phelissota.xyz
picphotos.net
pigrafix.at
pizdopletka.club
prizeestates.cricket
professionaldieselcare.com
prostitutki-kharkova.org prostitutki-kharkova.org
pussyspace.net pskcijdc.bloger.index.hr
puteshestvennik.com psvita.ru
putitin.me quickchange.cc
rankexperience.com ranksonic.info
rapidokbrain.com regdefense.com
realizmobi.com registratciya-v-moskve.ru
recipedays.ru ritlweb.com
reeyanaturopathy.com rosbalt.com.ua
relayblog.com rus-teh.narod.ru
remontgruzovik.ru sashagreyblog.ga
rniaeba.ga saveindex.xyz
rucrypt.com scanner-andrew.top
sbetodiodnye-lampy.ru scansafe.net
seksvideoonlain.com scenicmissouri.us
seofirmreviewsus.info search-error.com
seonetwizard.com service.adtech.us
servisural.ru sexpartygirls.net
sexflirtbook.com sexpornotales.com
sexreliz.com shakhtar-doneck.ru
sextracker.com shijian.ac.cn
simplepooltips.com sibvitr.ru
skanninge.se simul.co
sisiynas.ru
skuteczna-dieta.co.pl skuteczna-dieta.co.pl
smadihome.com sky-mine.ru
small-games.biz smichovbike.cz
sms2x2.ru
snegozaderzhatel.ru
snip.to
snjack.info snjack.info
social-buttons.xyz social-s-hhh.xyz
softlinesolutions.me soochi.co
space2019.top special-porn.com
speedup-my.site
stackthatbucks.com
stairliftstrue.com stairliftstrue.com
stal-rulon.ru stardevine.com
start.myplaycity.com stevemonsen.com
stpolice.com stpolice.com
strag-invest.ru stretchmate.net
strongsignal-a.akamaihd.net stroydetali.ru
technika-remont.ru strv.se
timeallnews.ru suggest-keywords.com
token-lab.org susanholtphotography.com
toolsky.com t3chtonic.com
topsy.com tacbelarus.ru
topvidos.ru telemetryverification.net
traffic2cash.org thecounter.com
trafficnetzwerk.de thejournal.ru
trahic.ru tmearegion26.com
uasb.ru top10-way.com
uchebavchehii.ru topquality.cf
ugguk.online totu.us
um-razum.ru tracfone.com
uptimechecker.com traffmonster.info
uroffer.link truck-addzilla.life
veerotech.com trudogolik.net
vegan-foods.us trustedmaccleaner.com
via-gra.webstarts.com txxx.com
viandpet.com ua.tc
video-chat.in u-cheats.ru
videogamesecrets.com uchetunet.su
videospornogratisx.net videojam.tv
visa-china.ru vikistars.com
vita.com.hr vizag.kharkov.ua
vitanail.ru vut.com.ru
vladhistory.com webix.biz
vladimir.zrus.org website-speed-up.site
vsesubwaysurfers.com website-speed-up.top
warning.or.kr wholesalejerseys-cheapest.com
webscouter.net wleuaprpxuvr.ga
webshoppermac.com wttavern.com
websitevaluebot.com xaijo.com
wetgames.ru xchangetrak.com
whatsupinfoley.com xn--24-glceagatoq7c2a6ioc.xn--p1ai
wnhjavlhezp.gq youraticles.pl
wordkeyhelper.com yugk.net
xaylapdiendanang.com zacreditom.ru
xcombear.ru zapatosenventa.info
x-diesel.biz zeroredirect2.com
xn--80ab4aa2g.xn--p1ai znakom.sibtest.ru
xn--b1agm2d.net zrus.org
x-rates.ru
xtraffic.plus
xxlargepop.com
youbloodyripper.com
yun56.co
zeroredirect.com
zoolubimets.ru

118
.dev-tools/test_units/ratelimittest-master.txt
View file

@ -1,11 +1,13 @@
<html> <!DOCTYPE html>
<head><title>503 Service Temporarily Unavailable</title></head> <html>
<body> <head>
<center><h1>503 Service Temporarily Unavailable</h1></center> <title>Welcome to NginX</title>
<hr><center>nginx/1.16.1</center> </head>
</body> <body>
</html> <div align=center>
ody> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html><html> </html><html>
<head><title>503 Service Temporarily Unavailable</title></head> <head><title>503 Service Temporarily Unavailable</title></head>
<body> <body>
@ -433,55 +435,6 @@ ody>
<hr><center>nginx/1.16.1</center> <hr><center>nginx/1.16.1</center>
</body> </body>
</html> </html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.16.1</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.16.1</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.16.1</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.16.1</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.16.1</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.16.1</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.16.1</center>
</body>
</html>
<!DOCTYPE html> <!DOCTYPE html>
<html> <html>
<head> <head>
@ -492,7 +445,56 @@ ody>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html><!DOCTYPE html> </html><html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.16.1</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.16.1</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.16.1</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.16.1</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.16.1</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.16.1</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.16.1</center>
</body>
</html>
<!DOCTYPE html>
<html> <html>
<head> <head>
<title>Welcome to NginX</title> <title>Welcome to NginX</title>

2
.dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
34.73.66.97 0; 35.231.58.0 0;
127.0.0.1 0; 127.0.0.1 0;

BIN
.latest_release/bots.d.tar.gz
View file

Binary file not shown.

BIN
.latest_release/conf.d.tar.gz
View file

Binary file not shown.

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2020.06.2082 #### Version: V4.2020.06.2084
#### Bad Referrers Blocked: [6831](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [6831](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [574](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [574](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2020.06.2082 #### Version: V4.2020.06.2084
#### Bad Referrers Blocked: [6831](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [6831](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [574](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [574](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -11,7 +11,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2020.06.2082 #### Version: V4.2020.06.2084
#### Bad Referrers Blocked: [6831](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [6831](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [574](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [574](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

1752
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2020.06.2082 #### Version: V4.2020.06.2084
#### Bad Referrers Blocked: [6831](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [6831](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [574](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [574](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

1756
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

1756
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

1756
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2020.06.2082 ### Version: V4.2020.06.2084
### Updated: Tue Jun 16 23:01:14 SAST 2020 ### Updated: Thu Jun 18 18:26:36 SAST 2020
### Bad Bot Count: 574 ### Bad Bot Count: 574
################################################### ###################################################
### Version Information ## ### Version Information ##