vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-14 09:09:49 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2021.02.2282 [ci skip]

Browse source
This commit is contained in:
Travis 2021-02-16 08:49:05 +02:00
parent f48606e666
commit 8820a4f043
53 changed files with 89502 additions and 89523 deletions
Download patch file Download diff file Expand all files Collapse all files

9829
.dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
.dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
34.122.173.211 1; 35.193.184.18 1;
127.0.0.1 1; 127.0.0.1 1;

2
.dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
34.122.173.211 0; 35.193.184.18 0;
127.0.0.1 0; 127.0.0.1 0;

9829
.dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
.dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
34.122.173.211 1; 35.193.184.18 1;
127.0.0.1 1; 127.0.0.1 1;

2
.dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
34.122.173.211 0; 35.193.184.18 0;
127.0.0.1 0; 127.0.0.1 0;

9829
.dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
.dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
34.122.173.211 1; 35.193.184.18 1;
127.0.0.1 1; 127.0.0.1 1;

1
.dev-tools/beta_conf_files_whitelist/bots.d/custom-bad-referrers.conf
View file

@ -4042,7 +4042,6 @@
"~*(?:\b)nastroyke\.net(?:\b)" 0; "~*(?:\b)nastroyke\.net(?:\b)" 0;
"~*(?:\b)nastydollars\.com(?:\b)" 0; "~*(?:\b)nastydollars\.com(?:\b)" 0;
"~*(?:\b)natali\-forex\.com(?:\b)" 0; "~*(?:\b)natali\-forex\.com(?:\b)" 0;
"~*(?:\b)nate\.com(?:\b)" 0;
"~*(?:\b)national\-today\-winning\-winner\.club(?:\b)" 0; "~*(?:\b)national\-today\-winning\-winner\.club(?:\b)" 0;
"~*(?:\b)nationalbreakdown\.com(?:\b)" 0; "~*(?:\b)nationalbreakdown\.com(?:\b)" 0;
"~*(?:\b)naturalbreakthroughsresearch\.com(?:\b)" 0; "~*(?:\b)naturalbreakthroughsresearch\.com(?:\b)" 0;

2
.dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
34.122.173.211 0; 35.193.184.18 0;
127.0.0.1 0; 127.0.0.1 0;

9829
.dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

9829
.dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

9829
.dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

1
.dev-tools/referrers-regex-format-whitelist-test.txt
View file

@ -3995,7 +3995,6 @@
"~*(?:\b)nastroyke\.net(?:\b)" 0; "~*(?:\b)nastroyke\.net(?:\b)" 0;
"~*(?:\b)nastydollars\.com(?:\b)" 0; "~*(?:\b)nastydollars\.com(?:\b)" 0;
"~*(?:\b)natali\-forex\.com(?:\b)" 0; "~*(?:\b)natali\-forex\.com(?:\b)" 0;
"~*(?:\b)nate\.com(?:\b)" 0;
"~*(?:\b)national\-today\-winning\-winner\.club(?:\b)" 0; "~*(?:\b)national\-today\-winning\-winner\.club(?:\b)" 0;
"~*(?:\b)nationalbreakdown\.com(?:\b)" 0; "~*(?:\b)nationalbreakdown\.com(?:\b)" 0;
"~*(?:\b)naturalbreakthroughsresearch\.com(?:\b)" 0; "~*(?:\b)naturalbreakthroughsresearch\.com(?:\b)" 0;

1
.dev-tools/referrers-regex-format.txt
View file

@ -3994,7 +3994,6 @@
"~*(?:\b)nastroyke\.net(?:\b)" 1; "~*(?:\b)nastroyke\.net(?:\b)" 1;
"~*(?:\b)nastydollars\.com(?:\b)" 1; "~*(?:\b)nastydollars\.com(?:\b)" 1;
"~*(?:\b)natali\-forex\.com(?:\b)" 1; "~*(?:\b)natali\-forex\.com(?:\b)" 1;
"~*(?:\b)nate\.com(?:\b)" 1;
"~*(?:\b)na\-telefon\.biz(?:\b)" 1; "~*(?:\b)na\-telefon\.biz(?:\b)" 1;
"~*(?:\b)nationalbreakdown\.com(?:\b)" 1; "~*(?:\b)nationalbreakdown\.com(?:\b)" 1;
"~*(?:\b)national\-today\-winning\-winner\.club(?:\b)" 1; "~*(?:\b)national\-today\-winning\-winner\.club(?:\b)" 1;

2
.dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
104.154.182.187 0; 35.193.184.18 0;

9829
.dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

9829
.dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

9829
.dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

1
.dev-tools/test1_conf_files_whitelist/bots.d/custom-bad-referrers.conf
View file

@ -4042,7 +4042,6 @@
"~*(?:\b)nastroyke\.net(?:\b)" 0; "~*(?:\b)nastroyke\.net(?:\b)" 0;
"~*(?:\b)nastydollars\.com(?:\b)" 0; "~*(?:\b)nastydollars\.com(?:\b)" 0;
"~*(?:\b)natali\-forex\.com(?:\b)" 0; "~*(?:\b)natali\-forex\.com(?:\b)" 0;
"~*(?:\b)nate\.com(?:\b)" 0;
"~*(?:\b)national\-today\-winning\-winner\.club(?:\b)" 0; "~*(?:\b)national\-today\-winning\-winner\.club(?:\b)" 0;
"~*(?:\b)nationalbreakdown\.com(?:\b)" 0; "~*(?:\b)nationalbreakdown\.com(?:\b)" 0;
"~*(?:\b)naturalbreakthroughsresearch\.com(?:\b)" 0; "~*(?:\b)naturalbreakthroughsresearch\.com(?:\b)" 0;

9829
.dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
.dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -46,4 +46,4 @@
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
104.154.182.187 0; 104.154.182.187 0;
35.193.184.18 0; 34.122.173.211 0;

9829
.dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

3
.dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,5 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
34.122.173.211 0; 34.122.208.80 0;
35.193.184.18 0;

9829
.dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
.dev-tools/test4_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,5 +45,5 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
34.122.208.80 0;
35.193.184.18 0; 35.193.184.18 0;
34.122.208.80 0;

9829
.dev-tools/test4_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

1
.dev-tools/test5_conf_files/bots.d/whitelist-ips.conf
View file

@ -47,3 +47,4 @@
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
34.122.208.80 0; 34.122.208.80 0;
35.193.184.18 0; 35.193.184.18 0;
104.154.182.187 0;

9829
.dev-tools/test5_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
.dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
34.122.173.211 1; 35.193.184.18 1;
127.0.0.1 1; 127.0.0.1 1;

1
.dev-tools/test_units/custom-bad-referrers.conf
View file

@ -4042,7 +4042,6 @@
"~*(?:\b)nastroyke\.net(?:\b)" 0; "~*(?:\b)nastroyke\.net(?:\b)" 0;
"~*(?:\b)nastydollars\.com(?:\b)" 0; "~*(?:\b)nastydollars\.com(?:\b)" 0;
"~*(?:\b)natali\-forex\.com(?:\b)" 0; "~*(?:\b)natali\-forex\.com(?:\b)" 0;
"~*(?:\b)nate\.com(?:\b)" 0;
"~*(?:\b)national\-today\-winning\-winner\.club(?:\b)" 0; "~*(?:\b)national\-today\-winning\-winner\.club(?:\b)" 0;
"~*(?:\b)nationalbreakdown\.com(?:\b)" 0; "~*(?:\b)nationalbreakdown\.com(?:\b)" 0;
"~*(?:\b)naturalbreakthroughsresearch\.com(?:\b)" 0; "~*(?:\b)naturalbreakthroughsresearch\.com(?:\b)" 0;

20
.dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
arquivo.pt 404enemy
CopyRightCheck Ebingbong
DomainSigmaCrawler Havij
Extreme Picture Finder IDBot
Mata Hari LexiBot
Nimbostratus Metauri
pcBrowser RealDownload
Sqlmap Reaper
Turnitin Re-re
WebBandit Sqlworm

296
.dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
01h4x.com
404enemy 404enemy
Aboundex AfD-Verbotsverfahren
Acunetix AhrefsBot
AIBOT
Aipbot Aipbot
Alexibot
Alligator Alligator
AllSubmitter AllSubmitter
AlphaBot AlphaBot
Anarchie Anarchie
Anarchy Anarchy
Anarchy99 Ankit
Anthill
Apexoo
arquivo.pt arquivo.pt
arquivo-web-crawler arquivo-web-crawler
autoemailspider Aspiegel
Asterias
Attach
AwarioRssBot
AwarioSmartBot
Backlink-Ceck
BacklinkCrawler
BackWeb
Bandit Bandit
BatchFTP Battleztar Bazinga
BBBike
BDCbot
BDFetch
BetaBot BetaBot
Bigfoot Bigfoot
Bitacle
Blackboard Blackboard
Black Hole Blow
BlackWidow BlowFish
Brandwatch Bolt
Brandprotect
Buddy Buddy
BuiltBotTough BuiltWith
BuzzSumo
Calculon
CATExplorador CATExplorador
CCBot CCBot
Cegbfeieh
check1.exe
CheeseBot
CheTeam CheTeam
Chlooe ChinaClaw
Claritybot Claritybot
Cliqzbot CODE87
coccocbot-web
Cogentbot Cogentbot
cognitiveseo Collector
com.plumanalytics
Copyscape Copyscape
Cosmos
Craftbot
crawler.feedback crawler.feedback
crawl.sogou.com
Crescent Crescent
CrunchBot
Curious
Custo
CyotekWebCopy CyotekWebCopy
DatabaseDriverMysqli DatabaseDriverMysqli
DataCha0s DataCha0s
Demon
Deusu Deusu
Devil
Digincore Digincore
DigitalPebble DigitalPebble
DIIbot DIIbot
Disco Dirbuster
Discoverybot Dispatch
DnyzBot DomainAppender
DomainCrawler DomainCrawler
DomainSigmaCrawler DomainStatsBot
Domains Project Download Wonder
Dotbot
DTS Agent
Ebingbong Ebingbong
ECCP/1.0
EirGrabber EirGrabber
EroCrawler evc-batch
Evil Evil
ExtLinksBot Exabot
Express WebPictures
Extractor Extractor
Ezooms ExtractorPro
FDM Extreme Picture Finder
EyeNetIE
FemtosearchBot FemtosearchBot
FHscan Firefox/7.0
Fimap
Flunky Flunky
Freeuploader
FyberSpider
GalaxyBot
Genieo
GermCrawler
Gigabot Gigabot
Go-Ahead-Got-It Go-Ahead-Got-It
GoZilla
Go!Zilla Go!Zilla
Grabber
GrabNet
GrapeFX
GrapeshotCrawler
GridBot GridBot
GT::WWW GT::WWW
Haansoft Haansoft
Harvest
Havij Havij
HEADMasterSEO
HMView HMView
Humanlinks HybridBot
IDBTE4M Iblog
Image Sucker Id-search
Indy Library IndeedBot
InfoNaviRobot InfoNaviRobot
InfoTekies InterGET
Intelliseek internetVista monitor
Internet Ninja ips-agent
InternetSeer Iria
IRLbot
isitwp.com
JamesBOT JamesBOT
Jbrofuzz
JennyBot
JikeSpider JikeSpider
JOC Web Spider Jorgee
Keyword Density JustView
Jyxobot
Kinza Kinza
Kozmosbot
Lanshanbot Lanshanbot
Larbin Larbin
LexiBot Libwhisker
LieBaoFast
Lightspeedsystems Lightspeedsystems
Likse
Linkdexbot Linkdexbot
LinkextractorPro
LinkScan
LinksManager LinksManager
LinkWalker LinqiaRSSBot
LinqiaMetadataDownloaderBot
LinqiaScrapeBot LinqiaScrapeBot
Lmspider Lipperhey
LNSpiderguy LNSpiderguy
Ltx71
lwp-request lwp-request
lwp-trivial
Magnet Magnet
magpie-crawler Mag-Net
Mail.RU_Bot
Majestic12 Majestic12
MarkMonitor MarkMonitor
Mass Downloader Masscan
Mata Hari MauiBot
Mb2345Browser meanpathbot
MegaIndex.ru mediawords
Metauri
MicroMessenger MicroMessenger
Microsoft Data Access MIIxpc
Microsoft URL Control Mister PiX
Mojolicious
Mr.4x3 Mr.4x3
MSFrontPage
Msrabot
MTRobot MTRobot
Musobot Musobot
Navroad Nameprotect
NetMechanic NearSite
Netvibes Needle
Niki-bot Netcraft
NimbleCrawler NetLyzer
Nettrack
Net Vampire
NetZIP
NextGenSearchBot
Nikto
Nimbostratus Nimbostratus
Ninja Ninja
NPbot Nmap
Nutch Nuclei
OnCrawl Octopus
OrangeBot Offline Explorer
OutclicksBot Offline Navigator
Openfind
OpenVAS
OutfoxBot OutfoxBot
PageGrabber PageGrabber
page scorer page scorer
PageThing.com PageThing.com
Pandalytics PeoplePal
Pavuk Picscout
Petalbot
Picsearch
Pimonster Pimonster
plumanalytics Pi-Monster
Probethenet Pixray
POE-Component-Client-HTTP
polaris version
ProPowerBot ProPowerBot
ProWebWalker Pu_iN
Pump Pump
PxBroker
PyCurl PyCurl
RankActive QueryN Metasearch
RankActiveLinkBot RankFlex
RankingBot2 RankingBot2
Rankivabot Rankivabot
RankurBot RankurBot
RealDownload
Reaper Reaper
RebelMouse RebelMouse
ReGet Recorder
RocketCrawler ripz
SalesIntelligent scalaj-http
Scanbot ScoutJet
scan.lol
Scrapy
Screaming Screaming
ScreenerBot Seomoz
Searchestate SEOstats
SearchmetricsBot
SemrushBot
SEOkicks
SEOprofiler
SeoSiteCheckup
serpstatbot
Shodan Shodan
Sitebeam Siphon
SiteExplorer
Site Sucker Site Sucker
Sitevigil Sogou web spider
SlySearch
SMTBot
Snoopy
Sociscraper
sogouspider
Sosospider Sosospider
SpankBot Spanner
sp_auditbot
Spbot
SputnikBot SputnikBot
Sqlmap spyfu
Sqworm Sqlworm
Steeler Sucker
Stripper SuperBot
SuperHTTP SuperHTTP
sysscan sysscan
Szukacz TeleportPro
T0PHackTeam Telesphorep
tAkeOut TheNomad
Titan Titan
Toata Trendiction
True_Robot Trendictionbot
Turingos TurnitinBot
Twice Twice
Typhoeus
URLy Warning URLy Warning
URLy.Warning URLy.Warning
VB Project Vagabondo
VeriCiteCrawler VCI
VidibleScraper VelenPublicWebCrawler
Voil Voil
Voltron WallpapersHD
WBSearchBot
Webalta
Web Auto Web Auto
WebBandit WebBandit
Web Collage Web Collage
WebEnhancer WebCopier
Web Fetch WEBDAV
WebImageCollector WebFuck
webmeup-crawler WebLeacher
WebReaper
WebSauger WebSauger
Web Sauger Webshag
WebsiteExtractor
Website Quester Website Quester
WebStripper Webster
WebSucker
Web Sucker Web Sucker
WebZIP WebZIP
Widow WeSEE
WinHTTrack Whacker
Who.is Bot
WiseGuys Robot
WISENutbot WISENutbot
Woobot
WPScan WPScan
WWW-Collector-E
WWW-Mechanize WWW-Mechanize
WWW::Mechanize
WWWOFFLE WWWOFFLE
Xaldon WebSpider
Xenu Xenu
zauba.io YoudaoBot
zgrab Zermelo
Zitebot ZmEu
ZumBot

282
.dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
01h4x.com 360Spider
Aboundexbot 404checker
AIBOT Aipbot
AlphaBot Alexibot
Alligator
AllSubmitter
Anarchie Anarchie
Anarchy99
Anthill Anthill
Apexoo
arquivo-web-crawler
ASPSeek ASPSeek
AwarioSmartBot
BackDoorBot BackDoorBot
Backlink-Ceck backlink-check
BackStreet BackStreet
Bandit BackWeb
BatchFTP
Battleztar Bazinga Battleztar Bazinga
BetaBot BDCbot
Bitacle Bigfoot
BlackWidow Blackboard
Blow Blow
BlowFish BlowFish
Boardreader Boardreader
Bolt BotALot
Brandprotect
Brandwatch Brandwatch
Buddy
BuiltWith BuiltWith
BuzzSumo BunnySlippers
CATExplorador Calculon
CazoodleBot CazoodleBot
CCBot CensysInspect
Cegbfeieh check1.exe
CherryPicker CheeseBot
Chlooe CheTeam
Cloud mapping Cloud mapping
coccocbot-web coccocbot-web
Cocolyzebot Cocolyzebot
CODE87
cognitiveseo
Copier Copier
CopyRightCheck
crawler4j crawler4j
CrazyWebCrawler crawl.sogou.com
Crescent
CrunchBot
Curious Curious
Custo Custo
CyotekWebCopy CyotekWebCopy
DataCha0s DatabaseDriverMysqli
demandbase-bot
Demon Demon
Deusu
Devil
Digincore
Disco Disco
Discobot
Discoverybot Discoverybot
Dispatch DittoSpyder
DomainSigmaCrawler DomainCrawler
Dotbot domainsproject.org
Download Wonder DomainStatsBot
DTS Agent
EasyDL EasyDL
Ebingbong
eCatch
ECCP/1.0 ECCP/1.0
Ecxi Ecxi
EirGrabber EirGrabber
EMail Siphon EMail Siphon
EMail Wolf
EroCrawler EroCrawler
evc-batch
Exabot Exabot
Express WebPictures
ExtLinksBot ExtLinksBot
Extreme Picture Finder
EyeNetIE
facebookscraper facebookscraper
FHscan FemtosearchBot
Freeuploader Foobot
Fyrebot Fyrebot
GalaxyBot
Genieo
GetRight
GetWeb GetWeb
G-i-g-a-b-o-t Gigabot
Go-Ahead-Got-It
gopher
GoZilla GoZilla
Go!Zilla Go!Zilla
Grabber GrabNet
Grafula
GridBot
GT::WWW
Haansoft Haansoft
HaosouSpider Harvest
Hloader Hloader
HMView HTMLparser
HTTP::Lite IDBTE4M
Humanlinks Image Sucker
IndeedBot
Indy Library Indy Library
InfoNaviRobot InfoTekies
instabid
InterGET InterGET
Internet Ninja Internet Ninja
internetVista monitor internetVista monitor
ips-agent Iskanie
isitwp.com JennyBot
Jbrofuzz
Jetty
JikeSpider JikeSpider
Joomla
Jyxobot
Kenjin Spider Kenjin Spider
Keyword Density Keyword Density
Kozmosbot
Lanshanbot Lanshanbot
Larbin LeechFTP
LeechGet LibWeb
Libwhisker
LieBaoFast
Lightspeedsystems Lightspeedsystems
Likse Likse
Linkbot LinkScan
LinkWalker LinkWalker
LinqiaMetadataDownloaderBot LNSpiderguy
Lipperhey Spider magpie-crawler
Litemage_walker
lwp-trivial
Magnet
Mag-Net
Mail.RU_Bot Mail.RU_Bot
Mata Hari Majestic SEO
Mb2345Browser MarkWatch
meanpathbot meanpathbot
Meanpathbot
Mediatoolkitbot Mediatoolkitbot
mediawords mediawords
Metauri MegaIndex.ru
MFC_Tear_Sample Microsoft Data Access
MicroMessenger
Microsoft URL Control Microsoft URL Control
MIDown tool
MIIxpc
Mister PiX Mister PiX
Mojeek
Mojolicious Mojolicious
Mozlila
MQQBrowser
MSFrontPage
Msrabot Msrabot
MTRobot Name Intelligence
Nameprotect Nameprotect
Navroad Navroad
NearSite
NetAnts
Netcraft Netcraft
netEstate NE Crawler netEstate NE Crawler
NetLyzer
NetMechanic
NetSpider
Nettrack
Net Vampire
Netvibes
NextGenSearchBot
Niki-bot Niki-bot
NPbot Nikto
Nutch Nmap
oBot
Offline Explorer Offline Explorer
Offline Navigator
OnCrawl
OpenLinkProfiler OpenLinkProfiler
OpenVAS OrangeSpider
OutclicksBot
OutfoxBot OutfoxBot
PageAnalyzer PageAnalyzer
PageGrabber PageGrabber
page scorer page scorer
PageScorer
PageThing.com PageThing.com
Pandalytics Panscient
Papa Foto Papa Foto
pcBrowser
PECL::HTTP
PeoplePal
Petalbot Petalbot
PHPCrawl
Picscout Picscout
PictureFinder Picsearch
Pimonster Pockey
Pi-Monster
PleaseCrawl
POE-Component-Client-HTTP
probe-image-size
ProPowerBot ProPowerBot
ProWebWalker
Psbot Psbot
RankActive PyCurl
RankingBot Quick-Crawler
RankActiveLinkBot
RankFlex
RankingBot2 RankingBot2
Rankivabot RankurBot
RedesScrapy Reaper
RebelMouse
ReGet
RepoMonkey RepoMonkey
Ripper Ripper
ripz RocketCrawler
RSSingBot
s1z.ru
SBIder SBIder
scalaj-http scalaj-http
Scanbot ScanAlert
scan.lol scan.lol
Scrapy
Screaming Screaming
ScreenerBot ScreenerBot
Semrush Searchestate
SemrushBot
SEOkicks
SEOkicks-Robot SEOkicks-Robot
SEOprofiler SEOprofiler
seoscanners
SEOstats
Sitebeam Sitebeam
sitechecker.pro
Siteimprove Siteimprove
SiteSnagger SmartDownload
SiteSucker
Site Sucker
Sitevigil
SlySearch
SMTBot
Snake
Snapbot
SocialRankIOBot
Sociscraper
sogouspider
Sosospider Sosospider
Spammen sp_auditbot
SpankBot Spbot
Spinn3r Spinn3r
SputnikBot SputnikBot
spyfu
Sqlmap
Sqworm Sqworm
Steeler
Stripper Stripper
Sucker Sucker
Surfbot Sucuri
SurveyBot SuperBot
Suzuran
Swiftbot Swiftbot
sysscan sysscan
T8Abot T8Abot
Teleport tAkeOut
TeleportPro Telesoft
Telesphoreo
Telesphorep
The Intraformant The Intraformant
Titan Toata
Toweyabot Toweyabot
Tracemyfile trendiction.com
True_Robot TwengaBot
UnisterBot Typhoeus
URLy Warning Vagabondo
URLy.Warning
VB Project VB Project
VelenPublicWebCrawler VeriCiteCrawler
VoidEYE VidibleScraper
Voil
WallpapersHD
WBSearchBot WBSearchBot
WebEnhancer Web Auto
WebBandit
WEBDAV
Web Fetch Web Fetch
WebFuck WebmasterWorldForumBot
Web Fuck WebPix
WebGo IS WebReaper
WebSauger WebSauger
Web Sauger Webshag
WebsiteQuester WebWhacker
Webster
WebZIP WebZIP
Whatweb WeSEE
Who.is Bot Widow
WiseGuys Robot WinHTTrack
Woobot Wonderbot
Wotbox Wotbox
Wprecon Wprecon
WWWOFFLE WWW::Mechanize
x22Mozilla x22Mozilla
Xaldon WebSpider
Xenu Xenu
xpymep1.exe
YoudaoBot YoudaoBot
Zermelo Zade
zauba.io
zgrab zgrab
Zitebot
ZumBot
ZyBorg ZyBorg

20
.dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
anlimebel.kiev.ua 7wind.ru
cheapjerseysa.com bestpriceninja.com
empirepoker.com bosman.pluto.ro
financehint.eu c1.onedmp.com
freeuploader.com es5.com
plohaya-kreditnaya-istoriya.ru focalink.com
prod2016.com nfljerseys.online
rabot.host.sk ororodnik.goodbb.ru
royalvegascasino.com sideeffectsoftizanidine.blogspot.com
turn-up-life.life villakohlanta.nu

928
.dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
00it.com 24-ak.ru
0912701309f8ce.com 2728fb936f0.com
11pikachu.ru
123any.com
123kuma.com
123movies.love
12masterov.com
1hwy.com
2020iscoming.info
24videos.tv
2kata.ru
2rich4bitches.com
3dracergames.com
4rent.ru
4webmasters.com 4webmasters.com
7makemoneyonline.com 51.la
7ooo.ru
8xv8.com
91abcw.com
999webdesign.com 999webdesign.com
absugars.com aa625d84f1587749c1ab011d6f269f7d64.com
academia-nsk.org aab94f698f36684c5a852a2ef272e031bb.com
adnotbad.com abiente.ru
adobereader-free.ru above.com
adtology.com absolutelyanalog.com
adult3dgames.com adclickservice.com
ad-words.ru adloads.com
affiliate-fr.com afmuseum.com
a.frcls.fr agadelha.com.br
alfapro.ru alive-ua.com
alienwheel.es alldubai.biz
all4invest.info all-number.com
allwidewallpapers.com allpdfmags.net
alpinism.ru alpharma.net
amazingpic.net ameblo.top
anniemation.com apccargo.com
aosexkontakte.net apelsinnik.website
apiadanaknet-a.akamaihd.net apimossnetinfo-a.akamaihd.net
apibrowsesmartne-a.akamaihd.net appearance-cool.com
apisecretsaucebi-a.akamaihd.net approved.su
apiwoodensealcom-a.akamaihd.net apxeo.info
applyneedy.xyz aramaicmedia.org
artavenuegardenstudios.com arcteryxstore.online
autonew.biz arkkivoltti.net
autorn.ru asacopaco.tk
autovideobroadcast.com atofilms.com
avitocars.ru ausergrubhof.info
avto-oligarh.ru auto4style.ru
azartmsl.com azazaporn.com
babespcs.com azbuka-mo.ru
backgroundpictures.net baixar-musicas-gratis.com
baditri.com bang-hotties.com
balitouroffice.com bankmib.ru
bambi.ck.ua battleforupdating.site
bannertesting.com
basedecor.ru
bayareaaeroclub.org bayareaaeroclub.org
bazaronline24.ru
beachdriveblog.com
beachfix.co
bear.gotcher.us
belinka.com.ua
bensbargains.net
best-mam.ru
bestmouthwash.club bestmouthwash.club
bestofupload.info bestpornuha.com
bestssaker.com bestsexyblog.com
betterhdporn.com bestwaystogetpaid.us
bg6s0.com big-cash.net
bikini-image.com bigcities.org
bimatoprost-careprost.com bitcoins-live.ru
bin-brokers.com
blackbabesporn.com blackbabesporn.com
blogig.org bluerobot.info
bnt-team.com
board.f00d.de
bodybuilding-shop.biz
bombla.org bombla.org
braindaily.xyz bonvillan.com
brainxs.us brainzpod.win
brakehawk.com brandbucket.com
brandov.ru breastaugmentation.co.za
bravegirlsclub.com bronzeaid-a.akamaihd.net
bristolhostel.com btvn.ru
brus-vsem.ru buy-loft.ru
buypanicdisorderpill.com buyparajumpers.online
callstevens.com candcstuccoandstone.com
cand.jp canvas.gloverid.site
carsdined.org carloans.com
cartierlove2u.com cbcseward.com
cashkitten-a.akamaihd.net cb.iphantom.com
centraletermice.us cdn.walkme.com
cerev.info cellfun.mobi
charmstroy.info cenoval.ru
cheapcigarettesc.info ceotrk.com
chocolateslim-en-espana.com cfacarrosserie74.com
chocolateslim-u-srbiji.com cheapmoncler.win
christianlouboutinreplica.win cheapmoncler.xyz
chuckguilford.com chelnytruck.ru
cialgenisrx.com children-learningreading.info
cialis-samples.com citetick.com
ciceros.co cleansearch.net
cinemaenergy-hd.ru clickintext.net
click2pawn.com clicksor.com
clickbanksites.info clickzzs.nl
communisave.co.za clips.ua.ac.be
community.allhiphop.com clksite.com
compliance-jane.top clothesforcash.com
compliance-mary.top compliance-checker.info
com-supportcenter.website compliance-irvin.xyz
concealthyself.com compliance-john.top
copro.pw compliance-mark.top
cornomase.win confib.ifmo.ru
cscwtalkto.site connectingsingles.com
cs-passion.pl cookie-law-enforcement-hh.xyz
customchocolate.business-for-home.com cookingmeat.ru
d2jsp.org coprofam.org
darkbooks.org cougfan.info
datract.com crafthubs.com
dear-diary.ru cranly.net
defenderxtactical.com crazyprotocol.com
delfin-aqua.com.ua creditnation.ru
den-noch24.ru culmimg.pw
design-lands.ru customboxes4less.com
detalizaciya-tut.biz cwetochki.ru
darkages.info
data1.scopich.com
date-withme.com
deanmoore.ie
decoratinghomes.ga
dekoration.us
detoxmed24.ru detoxmed24.ru
dfwu1013.info diamond-necklace.info
dispo.de dickssportinggoods.com
dneprsvet.com.ua digest-project.ru
doctormakarova.ru dkvorota.ru
domoysshop.ru dlya-android.org
doska-vsem.ru domik-derevne.ru
drhomes.biz dotmass.top
duplicashapp.com dyt.net
e-commerce-seo.com eandsgallery.com
ednorxmed.com earl-brown.info
e-kwiaciarz.pl easytuningshop.ru
elektrischezigaretten2.beeplog.com ecommerce-seo.org
elektrozigarettekaufen2.blogse.nl edelstahlschornstein-123.de
editmedios.com
educatemetv.com
ee77ee.com
elektrischezigarettekaufen2.cowblog.fr
elmifarhangi.com elmifarhangi.com
energydiet24.ru emerson-rus.ru
enternet.ee empis.magix.net
erotag.com eng-lyrics.com
eu-cookie-law.blogspot.com erectile.bid
european-torches.ru ero-advertising.com
expresstoplivo.ru etotupo.ru
extlabs.io ewebarticle.info
extractorandburner.com exportshop.us
extremez.net ezrvrentals.com
ezigarettenshop2.postbit.com factorynightclub.com
f012.de failingmarriege.blogspot.com
f5mtrack.com familyholiday.ml
falcoware.com farmingworm.com
familienzahnaerzte.com fatfasts-4tmz.com
fanpagerobot.com
fatmaelgarny.com
felizporno.com
femmesdenudees.com femmesdenudees.com
ff30236ddef1465f88547e760973d70a.com ff30236ddef1465f88547e760973d70a.com
fidelityfunding.com filmidivx.com
filmci.pro
finstroy.net finstroy.net
fitness-video.net finteks.ru
fiverr.com foodcrafts.website
fix-website-errors.com forex-indextop20.ru
f-loaded.de forexunion.net
flooringinstallation-edmonton.com forsex.info
floridamhca.org
footballfarrago.com
forexgb.ru
forum20.smailik.org
forums.toucharcade.com forums.toucharcade.com
fotopop.club foxydeal.com
frcls.fr franklinfire.co
free-video-tool.com free-laptop-reward.com
fuck-paid-share-buttons.xyz freelotto.com
gael-s.ru free-social-buttons.xyz
galaxyflowers.ru free-traffic.xyz
galeon.com freeuploader.com
gambarkataku.co frivgame250.com
gameprimary.com g7m.pl
generousdeal-a.akamaihd.net galaxys6manual.info
gaming-journal.com
ge0ip.com
generalporn.org
get-free-social-traffic.com
getprismatic.com
ghernnqr.skyrock.com
gigapeta.com gigapeta.com
gigixo.com glicol.kz
globetrotting-culture.ru golden-catalog.pro
gloverid.site golmau.host.sk
goodnightjournal.com gotcher.us
gorodservis.ru greenidesign.co
greatdealshop.com gribokstop.com
green-tea.tv guigyverpo.cf
growmyfunds.ca gwagka.com
gsasearchenginerankerdiscount.com h2monline.com
havepussy.com hackers-crackers.tk
hawaiielectriclight.com hamacapty.com
healbio.ru headpharmacy.com
hesteel.pl helvetia.com.ua
hmmm.cz highstairs-a.akamaihd.net
himazin.info
historichometeam.com
hledejvshopech.cz
hmywwogw.bloger.index.hr hmywwogw.bloger.index.hr
homik.pw hol.es
hostsshop.ru homedecoguide.info
hoterika.com homedo.fabpage.com
houseofgaga.ru hostcritique.com
houtings.xyz houseofrose.com
hoverboard360.es howopen.ru
hoverboard360.se humanorightswatch.org
howtowhitenteethfast.xyz iccornacircri.cf
htmlcorner.com ikritikimou.gr
huhn.altervista.org ilbe.club
hunterboots.online immobiliaremassaro.com
husky-shop.cz incep.imagine-ex.co
hybrid.ru infobabki.ru
ibmdatamanagement.co inmate-locator.us
ico.re innodgfdriverhm.aircus.com
ideibiznesa2015.ru
ie.57883.net
igru-xbox.net
ilo134uloh.com
imabase.com
import-sales.com
infokonkurs.ru
insider.pro
instasexyblog.com
insurple.com insurple.com
interferencer.ru irunfar.com
investingclub.ru i-service.kz
investyb.com isistaylorporn.info
io9.com istizanidineacontrolledsubstance.blogspot.com
ip-guide.com istizanidineanarcoticdrug.blogspot.com
iskalko.ru istmira.ru
itservicesthatworkforyou.com istripper.com
javlibrary.cc ix20.ru
jerseywholesalebizchina.com jacago.com
kalb.ru janavibekken.no
kandidos.com japan-bearings.ru
kanimage.com jerseysbizwholesalecheap.com
kazka.ru jikoman.info
keywordsdoctor.com johannesburgsingles.co.za
keywords-monitoring-success.com journalhome.com
kichenaid.ru jrcigars.com
jrpmakati.com
justprofit.xyz
kakadu-interior.com.ua
kambasoft.com
karaganda.xkaz.org
karting196.ru
kartiniresto.com
kazinogames.lv
kazrent.com
kenaba.su
kidd.reunionwatch.com kidd.reunionwatch.com
kiwe-analytics.com kidskunst.info
knigonosha.net kino-key.info
kollesa.ru kinopolet.net
kometars.xyz kiskinhouse.com
konturkrasoty.ru kiwi237au.tk
kongoultry.net
kopihijau.info kopihijau.info
koronirealestate.gr kountrylife.com
kovrenok.ru
krasnodar.zrus.org
kurbappeal.info
kuzinsp.ru
kvartir-remont.biz
kw21.org kw21.org
lacapilla.info ladov.ru
lacave.ntic.fr ladsup.com
lacloop.info languagecode.com
landoftracking.com layola.biz.tc
lasvegaslockandsafe.com ldrtrack.com
lawyers.cafe lenpipet.ru
lechtaczka.net lidoradio.com
legionalpha.com lifehacĸer.com
life.biz.ua
limads.men
linkarena.com
linkbolic.com
linkredirect.biz linkredirect.biz
liran-locks.com lirunet.ru
littleberry.ru lonerangergames.com
littlecity.ch lovi-moment.com.ua
liverpool.gsofootball.com luciddiagnostics.in
livetsomudvekslingstudent.bloggersdelight.dk
liveu.infoteka.hu
lkbennettoutlet.online
locustdesign.co
lomza.info
longlifelomilomi.info
lutherstable.org
luxmagazine.cf luxmagazine.cf
mackeeper-center.club macrotek.ru
magicdiet.gq manipulyator-peterburg.ru
maju.bluesalt.co mansiondelrio.co
makis.nu
manualterap.roleforum.ru
maranbrinfo.com.br maranbrinfo.com.br
mararoom.ru mararoom.ru
marwer.info mastershef.club
matb3aa.com matchpal-a.akamaihd.net
mature.free-websites.com maxthon.com
max-eclat.men mebeldekor.com.ua
mecash.ru medicineseasybuy.com
medicine-4u.org meetingrainstorm.bid
medkletki.ru mega-bony2017.pl
megakino.net
me-ke.com me-ke.com
mezaruk.info mere.host.sk
mmostrike.ru metaxalonevstizanidine.blogspot.com
mnogabukaff.net micasainvest.com
mobplayer.net michaelkorsoutletstore.net
modnie-futbolki.net minegam.com
moi-glazki.ru mlf.hordo.win
mojpregled.com mmgq.ru
morf.snn.gr mobile-appster.ru
morlat.altervista.org moje-recenze.cz
mp3downloadhq.com moyaterapiya.ru
mulberryoutletonlineeu.com muznachas-service.ru
muschisexbilder.com
music7s.me
muztops.ru muztops.ru
myonlinepayday.co mxgetcode.com
myxdate.info mycaf.it
napalm51.nut.cc myfreecams.com
negociosdasha.com myghillie.info
netvouz.com mymobilemoneypages.com
nevansk.ru mzdish.site
normalegal.ru nacap.ru
nvssf.com naphukete.ru
oconto.ru narkologiya-penza.ru
odesproperty.com neks.info
offer.wpsecurity.website newfilmsonline.ru
ohmyrings.com newsperuse.com
newtechspb.ru
newyorkhotelsmotels.info
nextbackgroundcheck.gq
nlfjjunb5.ru
nofreezingmac.click
nofreezingmac.work
nomuos.it
nucia.biz.ly
nudejapan.net
oakridgemo.com
oballergiya.ru
ofanda.com
of-ireland.info
okayimage.com
oklogistic.ru oklogistic.ru
oneminutesite.it okmedia.sk
onthemarch.co o.light.d0t.ru
o-o-11-o-o.com one-gear.com
o-o-8-o-o.com online-zaymy.ru
oops-cinema.ru optom-deshevo.ru
ordernorxx.com
otbelivanie-zubov.com otbelivanie-zubov.com
pc-virus-d0l92j2.pw par-fallen.ga
petedrummond.com partnerline.men
picscout.com partner-trustworthy.men
paydayloanslocal.com
pekori.to
pewit.pw
phelissota.xyz
picmoonco.pw
picphotos.net
picsforkeywordsuggestion.com picsforkeywordsuggestion.com
pijoto.net picturesboss.com
pintattoos.com pinkduck.ga
pizdopletka.club pizdopletka.club
plastweb.ru platezhka.net
play-movie.pl pl.id-forex.com
poisk-zakona.ru plugingeorgia.com
poiskzakona.ru pogodnyyeavarii.gq
pontiacsolstice.info pooleroadmedicalcentre.co.uk
popander.mobi popads.net
poptool.net popcash.net
popugaychiki.com popunder.ru
popup-jdh.xyz porndairy.in
porngalleries.top pornoblood.com
pornhub-forum.ga pornoforadult.com
pornohd1080.online pornoxxx.com.mx
pornotubs.com
pornowarp.info
portnoff.od.ua portnoff.od.ua
portside.cc pourvous.info
praisong.net powenlite24.ru
pretty-mart.com preventheadacheguide.info
printdirectforless.com pricheski-video.com
priscilarodrigues.com.br privacylocationforloc.com
privatefx-in.ru privatamateure.com
prizestohandle.club prod2016.com
producm.ru produkto.net
prohoster.info proekt-gaz.ru
projectforte.ru profit-opportunity.com
pronorm.fr prokotov.com
prosperent.com promover.org
pssucai.info proprostatit.com
pussyfleet.com pshare.biz
qwarckoine.com puteshestvennik.com
qwertty.net qpypcx.com
randalljhoward.com radiogambling.com
ranksignals.com ragecash.com
recinziireale.com rangoman.date
rednise.com razleton.com
rcb101.ru
recordpage-a.akamaihd.net
refererx.com
reklamuss.ru reklamuss.ru
repeatlogo.co.uk remont-fridge-tv.ru
reward-survey.net remont-ustanovka-tehniki.ru
rfid-locker.co renecaovillasale.online
rospromtest.ru replicaclub.ru
royalcar-ufa.ru rniaeba.ga
rus-teh.narod.ru rollercoin.com
rvi.biz romhacking.ru
sady-urala.ru royal-investments.net
sakhboard.ru ruex.org.ua
sarafangel.ru rvzr-a.akamaihd.net
sbt-aqua.ru sale-japan.com
scanner-donald.top saltspray.ru
scanner-margo.top sammyweaver.com
screentoolkit.com satellite.maps.ilovevitaly.com
seasaltwithfood.com sawin.beth.webd.pl
seeingmeerkat.com scrapinghub.com
seojokes.net searchinquire.com
service.adtech.us secret.xn--oogle-wmc.com
servingnotice.com semp.net
seorankinglinks.us
seorussian.ru
seotoolsagency.com
seryeznie-znakomstva.ru seryeznie-znakomstva.ru
sexpartygirls.net sexcamamateurchat.com
sexvporno.ru sexphoto.site
sexy.babes.frontend-stack.top sex-tracker.de
sex-znakomstva.online sexyali.com
shemale-sex.net signal03.ru
sherlock.se simplepooltips.com
silverage.ru sitechecker.pro
sindragosa.comxa.com smartbalanceworld.com
skladvaz.ru smartshoppymac.com
slowmacfaster.trade smstraf.ru
snegozaderzhatel.ru snip.to
snsdeainavi.info snsdeainavi.info
socialbookmarksubmission.org social-buttons.com
socialbuttons.xyz
social-fun.ru social-fun.ru
socialmonkee.com social-s-iii.xyz
soc-proof.su social-vestnik.ru
solnplast.ru sofit-dmd.ru
speeddream.xyz softtor.com
speedup-my.site souvenir.cc
spinnerco.ca spidtest.space
splendorsearch-a.akamaihd.net spl63.fr
sprttrack.com standardchartered-forex.com
spywarespy.com stretchmate.net
stroydetali.ru suggest-keywords.com
sundrugstore.com supernew.org
superkanpo.com svolze.com
swinon.site sweepstakes.rewardit.com
symbaloo.com swinginwithme.ru
takeflyte.com td-l-market.ru
tako3.com technopellet.gr
tam-gde-more.ru
tattooreligion.ru
teguh.info
telsis.com telsis.com
template-kid.com thefarmergame.com
terraclicks.com
theendivechronicles.com
thegalerie.eu thegalerie.eu
thegamerznetwork.com thelottosecrets.com
thegolfclub.info theplacetoupdating.pw
thetardistimes.ovh thetoiletpaper.com
the-torrent-tracker.blogspot.com tizanidine4mguses.blogspot.com
thexart.club tizanidinecapsules.blogspot.com
tiens2010.ru tizanidinecost.blogspot.com
timeallnews.ru tizanidinedruginteractions.blogspot.com
tizanidinedrugtest.blogspot.com tizanidineformigraines.blogspot.com
tizanidineduringpregnancy.blogspot.com tizanidinemusclerelaxant.blogspot.com
tizanidinefibromyalgia.blogspot.com tizanidineorflexeril.blogspot.com
tizanidinepain.blogspot.com tizanidinesleepaid.blogspot.com
tizanidinevsvalium.blogspot.com tizanidinestreetvalue.blogspot.com
todohr.com tkanorganizma.ru
tomck.com tnctrx.com
toon-families.com tomatis.gospartner.com
topads.men tonivedu.it
torture.ml toonfamilies.net
totu.info topbestgames.com
trafficnetzwerk.de top-karkas.ru
traffictrade.life torrentgamer.net
trucri.me torrents-tracker.com
twittrading.com traderzplanet.in
udsgame.online trafficmp.com
uggsale.online trahvid.com
ukkelberg.no treasuretrack-a.akamaihd.net
unblocksit.es truck-land.life
uptime.com turbo-suslik.org
ural-buldozer.ru turist-strani.ru
videojam.tv twitlinks.com
vip2ch.com ufa.xrus.org
virtuagirl.com ugguk.online
vltai.com ukr-lit.com
voltrknc1.com umekana.ru
vucms.com unimodemhalfduplefw.pen.io
vzglyadriv.kg urlopener.blogspot.com.au
wareseeker.com utiblog.fr
watchmygf.net vabasa.inwtrade.com
wdfdocando.com valkiria-tk.ru
webenlace.com.ar valsalud.com
wejdz-tu.pl vchulkax.com
wesharepics.com velen.io
wesharepics.info velobikestock.com
wineitudes.wordpress.com videonsk.com
wingsoffury2.com videos-for-your-business.com
winterclassichockeyjerseys.com vipms.ru
withstandingheartwarming.com vita.com.hr
world-mmo.com voluumtrk.com
worldtraveler.world vote-up.ru
vseigru.one
vvon.co.uk
vzlomsn.org
webads.co.nz
webextract.profound.net
webix.biz
webjam.com
webkeyit.com
weblo.com
website-analyzer.info
websitevaluebot.com
webtherapy.ru
westen-z.life
westermarkanjou.se
wetgames.ru
whatsappdownload10.com
williamrobsonproperty.com
worldoffiles.ru
wormix-cheats.ru wormix-cheats.ru
wovis.site woweb.com.ua
wpthemedetector.co.uk xcc24.pl
writingservices17.blogspot.ru xn--80aebbcbcdemfkhba4byaehoejh8dza3v.xn--p1ai
wsgames.ru xxxsiterips.xyz
ww1943.ru yaoguangdj.com
www.kabbalah-red-bracelets.com your-bearings.com
xboxster.ru yourdesires.ru
x-diesel.org zaimhelp.ru
xnxx699.com zhacker.net
xnxx-n.com zvezdagedon.ru
xtraffic.plus zzlgxh.com
xxlargepop.com
xxxdatinglocal.us
xxxguitars.com
yebocasino.co.za
yogamatsexpert.com
youbrainboost.asia
youdesigner.kz
youjizz.vc
yourporngay.com
yugk.net
zagadki.in.ua
zaidia.xhost.ro
zaobao.com.sg
zeg-distribution.com
zerocash.msk.ru
zetgie.com.pl
znakomstva-piter78.ru
zona-aqua.ru
zoogdinsney.com
zs2vm.top
zygophyceous.womanstars.site

478
.dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
00webcams.com 007angels.com
10bet.com 3dracergames.com
2015god.org 4webmasters.com
20pascals.nl a1security.com.ua
2pxg8bcf.top abovetherivernc.com
40cg.com acmebtn.ml
66cpwgln.space adcash.com
7wind.ru adinterax.com
abbanreddy.com adprotect.net
acc.eu.org adtiger.tk
acunetix-referrer.com affordablewebsitesandmobileapps.com
adf.ly alltheviews.com
adloads.com amehdaily.com
alert-hgd.xyz android-style.com
alive-ua.com animenime.ru
allknow.info apparel-offer.com
amazon-seo-service.com appsaurus.com
ampower.me artavenuegardenstudios.com
apimossnetinfo-a.akamaihd.net
app5.letmacworkfaster.world
ardimobileinfo.ml
astrochicks.com astrochicks.com
avek.ru atmagroup.ru
avramstroy.ru autotop.com.ua
baersaratov.ru avtochehli.by
bannertesting.com beauby.ru
bensbargains.net
bestpornuha.com
besttorrentknifta.weebly.com
bestwebsiteawards.com
bget.ru
bizlist.com.de bizlist.com.de
blog.f00kclan.de blagovest-med.ru
bonanza-fortune.men bolezniorganov.ru
bonzbuddy.com brianhenry.co
brewdom.ru buyk.host.sk
burkesales.com bzero1jewelry.net
buy-cheap-online.info cakesplus.com.au
buy-loft.ru candelluxsklep.pl
cardul.ru canyougethighofftizanidine.blogspot.com
carson.getenjoyment.net cars-modification.net
cartierlove2u.com cartierring.xyz
catalogs-parts.com cbox.ws
cheapjerseysbizwholesale.us celejihad.info
classicakuhni.ru charmstroy.info
clmforexeu.com cheapestjerseys-wholesale.com
cl.s7.exct.net ciekawinki.pl
compliance-elena.xyz cityadspix.com
compliance-jack.top cjs.com.ru
compliance-julia.top clayvasedesigns.tk
compliance-olga.top cmhomestayagency.com
copenergo.ru com-supportcenter.website
copyrightclaims.org construmac.com.mx
crafthubs.com customsua.com.ua
crynet.cc daretodonate.co
cryptoswap.biz darkbooks.org
cypernhuset.se deanmoore.ie
digilander.libero.it defenderxtactical.com
distver.ru devochki.top
djekxa.ru diegolopezcastan.com
dolohen.com dneprsvet.com.ua
domaineaneblanc.com
dosug-lux.ru
downloaddy.net
draniki.org draniki.org
dscaas.website dvrlists.com
eas-seo.com e2click.com
edelstahlschornstein-123.de
education-cz.ru education-cz.ru
elektrischezigarette2.devhub.com ee77ee.com
elstal.com.pl elektronischezigarette2.mex.tl
empathica.com englishgamer.com
englate.com evehemming.blogspot.com.au
erotag.com f07.de
evaashop.ru falopicm.pw
exchangeit.gq felizporno.com
extener.org ferrotodo.com
fakehandbags.xyz
fidelityfunding.com
filunika.com.ru filunika.com.ru
findthe.pet finteks.ru
fiverr.com fodelsedagspresenter.nu
foto-basa.com forex-indextop20.ru
free-share-buttons.top free411games.com
gallictures.com freesitetest.com
gerhardhealer.com freewlan.info
glastecfilms.com.my freshwallpapers.info
gok-kasten.net frighteningremain.cf
gratuitxblcodes.com gamevalue7.weebly.com
grizzlysgrill.com gateway.zscalertwo.net
gwebtools.com.br gdzkurokam.ru
hanink.biz.ly getmyads24.com
hcate.com goroda-vsego-mira.ru
health-medical-portal.info gotorussia.com
hol.es graphicwe.org
homemade.gq gsasearchenginerankerhelp.com
hotgirlhdwallpaper.com gymi.name
housemilan.ru h2monline.com
ido3.com healgastro.com
indiakino.net helpmymacfaster.trade
infektsii.com huhn.altervista.org
infospot.pt hyiphunter.org
inspiring-desperate.tk iboss.com
intermesh.net ico.re
intim-uslugi.info ilikevitaly.com
ipchicken.com images.gyffu.com
jav-fetish.site imk.com.ua
inboundlinks.win
irkutsk.online-podarki.com
iron-age.info
isistaylorporn.info
janavibekken.no
javatex.co.id
je7.us
jennyfire.ru
jerseyswholesalechinalimited.com jerseyswholesalechinalimited.com
j-times.ru joy-penguin.com
kadashihotel.com justbcause.com
karachev-city.ru kakadu-interior.com.ua
kartiniresto.com karpun-iris.ru
kazrent.com kerei.ru
keywordglobal.co.za kino2018.cc
kinostorm.net koronirealestate.gr
kung-fu-ru.com koversite.info
ladov.ru kskjco.club
lightinghomes.net lennatin.info
likrot.com lifebyleese.com
linkpulse.com linkpulse.com
littleberry.ru liupis.com
louboutinbooties.xyz livetsomudvekslingstudent.bloggersdelight.dk
lunchrock.co llastbuy.ru
mailemedicinals.com loadopia.com
martlinker.com lovelycraftyhome.com
master-muznachas.ru madot.onlinewebshop.net
mecash.ru maximilitary.ru
meet-flirt-dating.com
mirmedinfo.ru mirmedinfo.ru
misswell.net mobilierland.com
mister-shop.com modabutik.ru
mixed-wrestling.ru moje-recenze.cz
mojowhois.com
mojpreskumanie.com mojpreskumanie.com
mompussy.net monitorwebsitespeed.com
monetizer.com-01.site mossmesi.com
monsterdivx.tv music7s.me
more-letom.ru
moscow.xrus.org
mosrif.ru
mrcsa.com.au
mtmtv.info
mug-na-chas-moscow.ru
musirc.com
muztops.ru
mydownlodablefiles.com mydownlodablefiles.com
my-floor.in.ua navalwiki.info
mypornfree.ru netoil.no
naperehresti.info new-post.tk
naval.jislaaik.com newstudio.tv
nevansk.ru notasprensa.info
nippon-bearings.ru nyfinance.ml
okout.ru oakleyglassesonline.us
ok.ru oivcvx.website
onetravelguides.com okeinfo.online
onlinetvseries.me online-podarki.com
o-o-6-o-o.com openmediasoft.com
papasdelivery.ru pagesense.com
paydayonlinecom.com paleohub.info
photo-clip.ru parlament.biz
pic2fly.com pcgroup.com.uy
pigrafix.at pdn-4.com
pl.aasoldes.fr pekori.to
pl.id-forex.com peugeot-club.org
popserve.adscpm.net pihl.se
popup-fdm.xyz play.leadzupc.com
pornokorol.com plohaya-kreditnaya-istoriya.ru
printdirectforless.com polska-poezja.com
printingpeach.com popugauka.ru
privatbank46.ru pornofiljmi.com
prizesbook.online pornpost.in
prizestohandle.club pospr.waw.pl
prodess.ru pourvous.info
pwwysydh.com powitania.pl
randki-sex.com prchecker.info
reklama-i-rabota.ru progonrumarket.ru
revistaindustria.com prokotov.com
rfid-locker.co pts163.ru
rimedia.org queerspace.com
roleforum.ru quickbuck.com
rrutw.com referencemoi.com
santechnik.jimdo.com remote-dba.de
satoristudio.net rep-am.com
sbetodiodnye-lampy.ru retailwith.com
sbf441.com roma-kukareku.livejournal.com
sbt-aqua.ru rusenvironmental.net
scanner-walter.top rusprostitute.com
search.1and1.com russia-tao.ru
seofirmreviewsus.info sandhillsonline.com
seokicks.de scanner-mary.top
sheerseo.com scansafe.net
shohanb.com scenarii-1-sentyabrya.uroki.org.ua
sicfor.bcu.cc sdrescher.net
sisi-go.ru searchkut.com
snworks.com s-forum.biz
snyatie-lomki-v-stacionare.ru shoesonlinebuy.cn
softonicads.com shoplvlv.us
silvermature.net
sitebeam.net
sitevaluation.org
sizeplus.work
slayerlife.com
slutloadlive.com
socialmonkee.com
social-search.me
sovinsteel.ru sovinsteel.ru
spb.afora.ru svbur.ru
spitfiremusic.com svetodiodoff.ru
spravka-medosmotr.ru takeprofitsystem.com
stjamesschool.info tattomedia.com
stretchingabuckblog.com tengohydar.tk
techart24.com thegalerie.eu
telegraf.by thruport.com
testingads.pro tizanidinehclsideeffects.blogspot.com
thepornsex.org tk-assortiment.ru
the-torrent-tracker.blogspot.com tksn.ru
the-usa-games.blogspot.com torture.ml
titangel-vietnam.com toxicwap.com
tizanidineoral.blogspot.com toyota.7zap.com
tizanidinerecreationaluse.blogspot.com trackzapper.com
tonivedu.it turizm.bz
top-study.work typimga.pw
trafaret74.ru uggbootsoutletsale.us
trafficmania.com unlimitdocs.net
udsgame.online urlcut.ru
ukrobstep.com valkiria-tk.ru
umityangin.net viagroid.ru
upproar.com videochat.cafe
upstore.me viktoria-center.ru
validdomain.xyz vipps.com.my
valuado.com vipromoffers.com
vapeface.club vizitki.net
vesnatehno.ru voditeltrezviy.ru
video-hollywood.ru voltrknc1.com
vietimgy.pw vzubah.com
vipsexfinders.com web-betting.ru
vkgaleria.com webix.biz
wallpaperstock.net webix.me
webads.co.nz webjam.com
webradiology.ru weblo.com
wedding-salon.net whatistizanidinehclusedfor.blogspot.com
whatsupinfoley.com www.timer4web.com
whos.amung.us xn--80aafb2a.xn--p1ai
whosonmyserver.com xn----8sbhefaln6acifdaon5c6f4axh.xn--p1ai
wikes.20fr.com xn--b1addnj3cah.xn--p1ai
w-journal.ru xn----dtbndd4ae7eub.top
www.solartek.ru xn----itbeirbjbi7bc6bh2d.xn--p1ai
wygraj-skiny.win xvideosporn.biz
wyniki-lista.pl xxart.ru
x69ty.ru xxxkaz.org
xaijo.com yopoint.in
xn-----6kcaacnblni5c5bicdpcmficy.xn--p1ai youghbould.wordpress.com
xn-----7kcabaipgeakzcss7bjdqdwpfnhv.xn--p1ai youradulthosting.com
xxxsiterips.xyz yur-p.ru
xxxtubesafari.com zaapplesales.blogspot.com
xz618.com zarajbuilders.com
yaaknaa.info zarepta.com
yellocloud.be zdesoboi.com
zapatosenventa.info z-master.ru
zkjovpdgxivg.ga zolotoy-lis.ru
znakomstva-piter78.ru zoodrawings.com
zryydi.com
zx6.ru

22
.dev-tools/test_units/ratelimittest-master.txt
View file

@ -1,11 +1,21 @@
<!DOCTYPE html>
<html> <html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html><html>
<head><title>503 Service Temporarily Unavailable</title></head> <head><title>503 Service Temporarily Unavailable</title></head>
<body> <body>
<center><h1>503 Service Temporarily Unavailable</h1></center> <center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center> <hr><center>nginx/1.18.0 (Ubuntu)</center>
</body> </body>
</html> </html>
ml><html> <html>
<head><title>503 Service Temporarily Unavailable</title></head> <head><title>503 Service Temporarily Unavailable</title></head>
<body> <body>
<center><h1>503 Service Temporarily Unavailable</h1></center> <center><h1>503 Service Temporarily Unavailable</h1></center>
@ -571,14 +581,4 @@ ml><html>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html> </html>

2
.dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
34.122.173.211 0; 35.193.184.18 0;
127.0.0.1 0; 127.0.0.1 0;

BIN
.latest_release/bots.d.tar.gz
View file

Binary file not shown.

BIN
.latest_release/conf.d.tar.gz
View file

Binary file not shown.

4
AUTO-CONFIGURATION.md
View file

@ -4,8 +4,8 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2021.02.2281 #### Version: V4.2021.02.2282
#### Bad Referrers Blocked: [6937](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [6936](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [607](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [607](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)
____________________ ____________________

4
MANUAL-CONFIGURATION.md
View file

@ -4,8 +4,8 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2021.02.2281 #### Version: V4.2021.02.2282
#### Bad Referrers Blocked: [6937](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [6936](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [607](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [607](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)
____________________ ____________________

4
README.md
View file

@ -11,8 +11,8 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2021.02.2281 #### Version: V4.2021.02.2282
#### Bad Referrers Blocked: [6937](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [6936](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [607](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [607](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)
____________________ ____________________

9822
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

4
_google_analytics_ghost_spam/README.md
View file

@ -3,8 +3,8 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2021.02.2281 #### Version: V4.2021.02.2282
#### Bad Referrers Blocked: [6937](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [6936](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [607](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [607](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)
____________________ ____________________

2
_google_analytics_ghost_spam/google-exclude-03.txt
View file

File diff suppressed because one or more lines are too long

1
_google_webmaster_disavow_links/google-disavow.txt
View file

@ -3995,7 +3995,6 @@ domain:nash-krym.info
domain:nastroyke.net domain:nastroyke.net
domain:nastydollars.com domain:nastydollars.com
domain:natali-forex.com domain:natali-forex.com
domain:nate.com
domain:national-today-winning-winner.club domain:national-today-winning-winner.club
domain:nationalbreakdown.com domain:nationalbreakdown.com
domain:naturalbreakthroughsresearch.com domain:naturalbreakthroughsresearch.com

9829
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

9829
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

9829
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2021.02.2281 ### Version: V4.2021.02.2282
### Updated: Mon Feb 15 11:31:00 SAST 2021 ### Updated: Tue Feb 16 08:39:36 SAST 2021
### Bad Bot Count: 607 ### Bad Bot Count: 607
################################################### ###################################################
### Version Information ## ### Version Information ##