vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-02 10:40:36 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2020.04.2049 [ci skip]

Browse source
This commit is contained in:
Travis 2020-04-18 22:45:09 +02:00
parent 47ffdc3464
commit 44c7154e98
51 changed files with 25011 additions and 25013 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2656
.dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
.dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
34.73.34.132 1; 35.196.158.85 1;
127.0.0.1 1; 127.0.0.1 1;

2
.dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
34.73.34.132 0; 35.196.158.85 0;
127.0.0.1 0; 127.0.0.1 0;

2656
.dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
.dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
34.73.34.132 1; 35.196.158.85 1;
127.0.0.1 1; 127.0.0.1 1;

2
.dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
34.73.34.132 0; 35.196.158.85 0;
127.0.0.1 0; 127.0.0.1 0;

2656
.dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
.dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
34.73.34.132 1; 35.196.158.85 1;
127.0.0.1 1; 127.0.0.1 1;

2
.dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
34.73.34.132 0; 35.196.158.85 0;
127.0.0.1 0; 127.0.0.1 0;

2656
.dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2656
.dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

2656
.dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
.dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
35.231.58.0 0; 34.74.79.111 0;

2656
.dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
.dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
34.73.34.132 1; 104.196.57.92 1;
127.0.0.1 1; 127.0.0.1 1;

2
.dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
34.73.34.132 0; 104.196.57.92 0;
127.0.0.1 0; 127.0.0.1 0;

2656
.dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
.dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
34.73.34.132 1; 104.196.57.92 1;
127.0.0.1 1; 127.0.0.1 1;

2
.dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
34.73.34.132 0; 104.196.57.92 0;
127.0.0.1 0; 127.0.0.1 0;

2656
.dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
.dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
34.73.34.132 1; 104.196.57.92 1;
127.0.0.1 1; 127.0.0.1 1;

2
.dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
34.73.34.132 0; 104.196.57.92 0;
127.0.0.1 0; 127.0.0.1 0;

2656
.dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

4
.dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,5 +45,5 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
34.73.34.132 0; 34.74.79.111 0;
35.231.58.0 0; 35.196.158.85 0;

2656
.dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

3
.dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,5 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
35.196.82.30 0; 104.196.57.92 0;
34.73.34.132 0;

2656
.dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

5
.dev-tools/test4_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,5 +45,6 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
35.196.82.30 0; 35.196.72.151 0;
34.73.34.132 0; 35.227.97.188 0;
35.196.158.85 0;

2656
.dev-tools/test4_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

4
.dev-tools/test5_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,5 +45,5 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
34.73.34.132 0; 35.196.158.85 0;
35.231.58.0 0; 34.74.79.111 0;

2656
.dev-tools/test5_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
.dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
34.73.34.132 1; 35.196.158.85 1;
127.0.0.1 1; 127.0.0.1 1;

20
.dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
Calculon Bandit
Chlooe Digincore
ips-agent HMView
Msrabot Net Vampire
muhstik-scan Nimbostratus
Netvibes ProPowerBot
NPbot SlySearch
OpenVAS TwengaBot
OPPO A33 Upflow
Snapbot WebImageCollector

278
.dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
360Spider 404enemy
404checker
Abonti
Aboundex
Aboundexbot Aboundexbot
Acunetix
AhrefsBot AhrefsBot
Aipbot
Alexibot Alexibot
AllSubmitter AllSubmitter
Ankit
Apexoo Apexoo
archive.org_bot archive.org_bot
arquivo-web-crawler arquivo.pt
ASPSeek
Asterias Asterias
Attach Attach
AwarioSmartBot autoemailspider
AwarioRssBot
BackDoorBot BackDoorBot
backlink-check BacklinkCrawler
BackStreet Bandit
Badass Barkrowler
BatchFTP
BBBike
Bigfoot
Bitacle Bitacle
Blackboard BlackWidow
Black Hole
Blow
Bolt Bolt
BotALot
Brandprotect
Brandwatch Brandwatch
Bullseye BuiltWith
BuzzSumo BuzzSumo
CATExplorador
CazoodleBot
Cegbfeieh Cegbfeieh
CherryPicker CheeseBot
Chlooe
Claritybot Claritybot
Cliqzbot Cloud mapping
Cogentbot Cogentbot
com.plumanalytics Collector
Copyscape Copyscape
crawler4j
crawler.feedback
Crescent
CrunchBot CrunchBot
Curious Custo
DBLBot DatabaseDriverMysqli
demandbase-bot demandbase-bot
Demon Deusu
Devil Devil
Digincore Digincore
DigitalPebble DigitalPebble
DIIbot Disco
Discobot Discobot
Discoverybot Discoverybot
Dispatch DnyzBot
DomainCrawler
DomainSigmaCrawler DomainSigmaCrawler
Dotbot DomainStatsBot
Dragonfly Drip
DSearch
DTS Agent
eCatch eCatch
EroCrawler ECCP/1.0
Evil Ecxi
EirGrabber
EMail Wolf
evc-batch
ExtLinksBot
ExtractorPro ExtractorPro
Extreme Picture Finder Extreme Picture Finder
EyeNetIE EyeNetIE
Ezooms
FDM FDM
FHscan FemtosearchBot
Fimap
Firefox/7.0
Foobot
Freeuploader
Fyrebot Fyrebot
GalaxyBot
Genieo Genieo
GermCrawler GermCrawler
Getintent Go-Ahead-Got-It
G-i-g-a-b-o-t
Gotit Gotit
Go!Zilla GoZilla
Grabber
GrapeshotCrawler GrapeshotCrawler
GridBot GridBot
GT::WWW GT::WWW
Haansoft
HaosouSpider HaosouSpider
Harvest Havij
heritrix Hloader
Heritrix HTMLparser
HMView HTTP::Lite
HTTrack HTTrack
Humanlinks
HybridBot
Iblog
Id-search Id-search
IlseBot Image Fetch
Image Sucker InfoNaviRobot
IndeedBot
InfoTekies InfoTekies
instabid instabid
Internet Ninja Intelliseek
internetVista monitor
Iria Iria
IRLbot IRLbot
Iskanie Iskanie
JamesBOT Jorgee
JetCar
Jetty
JOC Web Spider
Joomla
JustView JustView
Jyxobot
Kinza
Kozmosbot Kozmosbot
LeechGet Larbin
LeechFTP
Libwhisker Libwhisker
Lightspeedsystems LieBaoFast
Likse Linkdexbot
LinkextractorPro
LinkpadBot
LinkWalker
LinqiaScrapeBot LinqiaScrapeBot
Lipperhey Spider Lipperhey Spider
LNSpiderguy
lwp-request
lwp-trivial lwp-trivial
Mag-Net Magnet
magpie-crawler
Mail.RU_Bot Mail.RU_Bot
Majestic-SEO Majestic12
MarkMonitor MarkMonitor
MarkWatch
Masscan Masscan
Mass Downloader Mass Downloader
MeanPath Bot Mb2345Browser
Mediatoolkitbot meanpathbot
MegaIndex.ru Meanpathbot
mediawords
MFC_Tear_Sample MFC_Tear_Sample
MicroMessenger Microsoft URL Control
Mister PiX
Mojeek Mojeek
Mojolicious MQQBrowser
Mr.4x3
MSFrontPage MSFrontPage
muhstik-scan MSIECrawler
Musobot Musobot
Name Intelligence Name Intelligence
Nameprotect
Navroad Navroad
Needle NearSite
Nessus
NetLyzer NetLyzer
Net Vampire NetSpider
NICErsPRO Netvibes
NextGenSearchBot
Niki-bot Niki-bot
Nikto Nikto
NimbleCrawler Nimbostratus
Nutch Ninja
OpenLinkProfiler Nmap
OpenVAS NPbot
OrangeBot oBot
OrangeSpider Octopus
OutfoxBot Offline Explorer
PageAnalyzer Offline Navigator
OnCrawl
Openfind
Openvas
OPPO A33
Page Analyzer
page scorer
Pandalytics Pandalytics
Pavuk Pavuk
pcBrowser pcBrowser
PeoplePal
PHPCrawl
Picsearch Picsearch
PictureFinder PictureFinder
Pimonster
Pi-Monster Pi-Monster
PleaseCrawl
Probethenet
ProPowerBot ProPowerBot
Psbot ProWebWalker
Pump
PyCurl
QueryN Metasearch
Quick-Crawler Quick-Crawler
RankFlex RankFlex
RankingBot RankingBot
RankingBot2 RankingBot2
RealDownload Rankivabot
RedesScrapy RankurBot
RebelMouse
Recorder
ReGet ReGet
RepoMonkey
RocketCrawler
Rogerbot
SalesIntelligent SalesIntelligent
ScanAlert SBIder
ScoutJet ScoutJet
Screaming Screaming
SearchmetricsBot Searchestate
SemrushBot SEOprofiler
SEOkicks-Robot
SEOlyticsCrawler
Seomoz
seoscanners
SeoSiteCheckup
serpstatbot
sexsearcher
SISTRIX SISTRIX
Sitebeam
SiteExplorer SiteExplorer
Siteimprove
SiteSnagger SiteSnagger
SiteSucker
Site Sucker Site Sucker
SlySearch
SMTBot SMTBot
Snapbot
Snoopy Snoopy
sogouspider SocialRankIOBot
SpaceBison Sociscraper
Sottopop
sp_auditbot sp_auditbot
Spbot
SputnikBot SputnikBot
Sqlmap
Sqlworm Sqlworm
Sucker Sucker
SuperBot Sucuri
SuperHTTP
Surfbot Surfbot
SurveyBot Suzuran
Swiftbot Swiftbot
sysscan T0PHackTeam
Szukacz tAkeOut
TeleportPro Telesphoreo
Telesoft The Intraformant
TheNomad
Thumbor
Titan Titan
Trendiction trendiction.com
Turnitin
TurnitinBot
TwengaBot
Typhoeus
UnisterBot UnisterBot
Upflow Upflow
URLy Warning
URLy.Warning URLy.Warning
Vacuum Vacuum
Vagabondo VB Project
Wallpapers/3.0 VeriCiteCrawler
WASALive-Bot VidibleScraper
VoidEYE
Voil
WallpapersHD
WBSearchBot
WebAuto WebAuto
Web Auto Web Auto
WebCollage
Web Collage
WebCopier
WEBDAV WEBDAV
WebGo IS WebImageCollector
WebmasterWorldForumBot
webmeup-crawler webmeup-crawler
WebReaper WebPix
WebSauger
Web Sauger Web Sauger
Webshag Webshag
WebsiteExtractor Website Quester
Webster
WebStripper WebStripper
WebSucker WeSEE
Web Sucker
WebWhacker
Whack Whack
Whacker
Whatweb
Wonderbot Wonderbot
Woobot
WWW-Collector-E WWW-Collector-E
WWW-Mechanize
WWWOFFLE WWWOFFLE
x22Mozilla
Xaldon WebSpider Xaldon WebSpider
Xaldon_WebSpider Xenu
xpymep1.exe
YoudaoBot
Zauba Zauba
zauba.io zauba.io
Zermelo ZumBot
Zeus
ZyBorg ZyBorg

272
.dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
360Spider 360Spider
404checker 404enemy
80legs 80legs
Acunetix Aboundex
ADmantX Aboundexbot
AfD-Verbotsverfahren
AhrefsBot AhrefsBot
AIBOT
Aipbot Aipbot
Alexibot
Alligator Alligator
AllSubmitter
Anarchie Anarchie
archive.org_bot
arquivo.pt arquivo.pt
arquivo-web-crawler
Aspiegel Aspiegel
ASPSeek
Attach Attach
autoemailspider
AwarioSmartBot AwarioSmartBot
Backlink-Ceck Backlink-Ceck
BacklinkCrawler backlink-check
BackStreet
BackWeb
Badass Badass
Battleztar Bazinga
BBBike BBBike
BDCbot BDCbot
BDFetch BDFetch
BetaBot BetaBot
Bigfoot
Bitacle Bitacle
BLEXBot BLEXBot
Blow
BlowFish
Boardreader
Bolt Bolt
BotALot
Brandprotect
Buddy Buddy
BuzzSumo BuiltWith
Bullseye
BunnySlippers
Calculon Calculon
CCBot CazoodleBot
CheeseBot CheeseBot
CheTeam CheTeam
ChinaClaw ChinaClaw
Claritybot
Cloud mapping
coccocbot-web coccocbot-web
Craftbot Collector
crawl.sogou.com Cosmos
Crescent crawler.feedback
CrunchBot CrunchBot
CSHttp
Curious Curious
Custo DataCha0s
DBLBot
demandbase-bot demandbase-bot
Demon Devil
Deusu
Digincore Digincore
DIIbot DIIbot
Dirbuster Discoverybot
Dispatch Dispatch
DomainAppender DnyzBot
DomainCrawler DomainCrawler
DomainSigmaCrawler
DomainStatsBot DomainStatsBot
Dotbot Dragonfly
Drip Drip
DSearch DTS Agent
eCatch EasyDL
ECCP/1.0
EirGrabber
EMail Siphon EMail Siphon
EroCrawler EroCrawler
Evil
Exabot Exabot
Express WebPictures Express WebPictures
ExtLinksBot ExtLinksBot
ExtractorPro EyeNetIE
Extreme Picture Finder
Ezooms Ezooms
facebookscraper
FDM FDM
Fimap FemtosearchBot
Freeuploader FlashGet
FrontPage
FyberSpider FyberSpider
Gigablast GalaxyBot
G-i-g-a-b-o-t Genieo
Getintent
GetRight
GetWeb
Gigabot
Go-Ahead-Got-It
Gotit Gotit
GoZilla
GrabNet GrabNet
Grafula
GrapeshotCrawler GrapeshotCrawler
GridBot
GT::WWW GT::WWW
Harvest Harvest
Havij
HEADMasterSEO HEADMasterSEO
heritrix
Hloader Hloader
HMView
HTMLparser HTMLparser
Humanlinks
Iblog
Id-search Id-search
Image Fetch
Image Sucker Image Sucker
InfoNaviRobot Indy Library
InfoTekies Intelliseek
Internet Ninja
InternetSeer InternetSeer
internetVista monitor ips-agent
Iskanie
IstellaBot IstellaBot
JamesBOT JamesBOT
Jbrofuzz Jbrofuzz
JennyBot JennyBot
JetCar JetCar
Jetty Jetty
JOC Web Spider Jorgee
Kenjin Spider JustView
Keyword Density
Kinza Kinza
Lanshanbot
Larbin
LeechFTP
LeechGet
Lftp Lftp
LieBaoFast
Likse
Linkdexbot
LinkScan
LinksManager LinksManager
LinqiaMetadataDownloaderBot LinqiaMetadataDownloaderBot
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey
Litemage_walker Litemage_walker
LNSpiderguy
LWP::Simple LWP::Simple
lwp-trivial lwp-trivial
Mail.RU_Bot magpie-crawler
Majestic-SEO Majestic SEO
Masscan
MauiBot MauiBot
Mb2345Browser Mb2345Browser
meanpathbot
Meanpathbot Meanpathbot
Mediatoolkitbot
Metauri
MFC_Tear_Sample MFC_Tear_Sample
MicroMessenger Microsoft Data Access
Microsoft URL Control MIIxpc
Morfeus Fucking Scanner Mister PiX
MSFrontPage Mojeek
Msrabot Mojolicious
Needle MSIECrawler
Netcraft Musobot
NetZIP Nameprotect
Niki-bot Nessus
NimbleCrawler NetAnts
Ninja netEstate NE Crawler
Nutch NetMechanic
Nettrack
Net Vampire
Netvibes
Nimbostratus
oBot oBot
Offline Explorer Octopus
Offline Navigator
OnCrawl OnCrawl
Openvas
OpenVAS OpenVAS
OPPO A33 OPPO A33
OrangeSpider OrangeBot
OutclicksBot OutclicksBot
PageGrabber OutfoxBot
PageAnalyzer
Page Analyzer
PageScorer
Pandalytics Pandalytics
Panscient Panscient
Papa Foto
pcBrowser pcBrowser
PECL::HTTP
PHPCrawl PHPCrawl
Picscout Picsearch
plumanalytics PictureFinder
ProWebWalker Pi-Monster
polaris version
Probethenet
ProPowerBot
Psbot Psbot
Pump
PxBroker PxBroker
PyCurl
QueryN Metasearch
Quick-Crawler Quick-Crawler
RankActive
RankFlex
RankingBot RankingBot
RankurBot RankingBot2
RealDownload RealDownload
RedesScrapy
ReGet ReGet
Ripper
Rogerbot
RSSingBot RSSingBot
SalesIntelligent s1z.ru
SBIder SBIder
ScanAlert scan.lol
Scanbot
ScoutJet ScoutJet
SearchmetricsBot Screaming
SEOprofiler Semrush
SeoSiteCheckup Seomoz
seoscanners
SEOstats SEOstats
sexsearcher serpstatbot
Shodan Shodan
SISTRIX SISTRIX
Siteimprove Siteimprove
SiteSnagger
SiteSucker SiteSucker
Sitevigil Sitevigil
SocialRankIOBot SlySearch
SmartDownload
Snoopy
Sociscraper Sociscraper
sogouspider
Sogou web spider Sogou web spider
Sosospider Sottopop
Spammen
Spanner
sp_auditbot
Spbot Spbot
Spinn3r
SputnikBot
Sqlmap
Sqworm Sqworm
Sucuri Steeler
Surfbot Stripper
Swiftbot Sucker
SuperBot
SuperHTTP
sysscan sysscan
Szukacz Szukacz
T0PHackTeam Teleport
TheNomad Telesphoreo
Thumbor Thumbor
TightTwatBot TightTwatBot
Titan Toata
Toweyabot
Tracemyfile Tracemyfile
Trendiction
trendiction.com trendiction.com
trendiction.de TwengaBot
Turnitin URLy.Warning
Typhoeus
UnisterBot
URLy Warning
Vacuum
VidibleScraper VidibleScraper
Voil Virusdie
WASALive-Bot Voltron
Web Enhancer WBSearchBot
WebAuto
Web Auto
WebCollage
Web Collage
WebEnhancer
WebFetch WebFetch
Web Fetch
WebFuck
Web Fuck
WebLeacher WebLeacher
WebmasterWorldForumBot WebmasterWorldForumBot
webmeup-crawler
WebPix
Web Pix Web Pix
WebSauger
Webshag Webshag
WebSucker WebStripper
WebWhacker WebZIP
WeSEE
Whack
Whacker Whacker
WinHTTrack
WiseGuys Robot WiseGuys Robot
Wprecon WISENutbot
WWW-Collector-E Wonderbot
Wotbox
WWW-Mechanize
WWW::Mechanize
x22Mozilla x22Mozilla
Xaldon WebSpider YoudaoBot
xpymep1.exe
Zade Zade
Zauba zgrab
Zermelo Zitebot
ZumBot
ZyBorg

20
.dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
adpremium.org ampower.me
alot.com avtolombard-krasnodar.ru
darodar.com cheapcigarettesc.info
davebestdeals.com club-samodelkin.ru
eugenevaultstorage.com generousdeal-a.akamaihd.net
gaz-voshod.ru getridofstretchmarks.org
liveinternet.ro imagui.eu
metarip.ru moomi-daeri.com
sandhillsonline.com mydeathspace.com
via-energy-cumpara.com social-vestnik.ru

922
.dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
0n-line.tv 100dollars-seo.com
123kuma.com 13tabs.com
1bet.com 1adult.com
1xbet4you.com 23kw.ru
2728fb936f0.com 2rich4bitches.com
2drittel.de
2itech.ru
2pxg8bcf.top
300richmond.co.nz 300richmond.co.nz
4replicawatch.net 45en.ru
66cpwgln.space 4istoshop.com
7a2rnuey1tw9ar.ru 4kpics.rocks
7xc4n.com 4webmasters.org
7yue.org 5i2.net
aa8780bb28a1de4eb5bff33c28a218a930.com 5u.com
aa9d046aab36af4ff182f097f840430d51.com 70casino.online
aasoldes.fr 7makemoneyonline.com
absolutelyanalog.com 83net.jp
aarbur.com
abcguru.xyz
actulite.com actulite.com
adexprts.com adamoads.com
adtiger.tk affordablewebsitesandmobileapps.com
adultgalls.com ahrntal.verymes.xyz
advocatemsk.ru aktobe.xkaz.org
adzerg.com
afftrack001.com
aimayangzhi.com
akuhni.by akuhni.by
alevinefesleri.com albuteroli.com
alf-img.com alert-jdh.xyz
alive-ua.com alfa-medosmotr.ru
allesohnegirls.net alibestsale.com
allfinweb.com allornamenti.com
all-number.com analytics-ads.xyz
alloysteel.ru
all-streaming-media.com
alphaforum.ru
alt-servis.ru
ameblo.jp
amoi.tn
anal-acrobats.com
an-donut.com an-donut.com
andpolice.com animaltoplist.com
apiadanaknet-a.akamaihd.net animebox.com.ua
apioasisspacenet-a.akamaihd.net animenime.ru
apishops.ru apisecretsaucebi-a.akamaihd.net
apparel-offer.com apiwoodensealcom-a.akamaihd.net
appsecurityr.com arcadeplayhouse.com
arabseyes.com artefakct.com
architecturebest.com artpicso.com
arclk.net asiengirls.net
ascat.porn auto-moto-elektronika.cz
ausergrubhof.info b2b-lounge.com
autolombard-krasnodar.ru bag77.ru
autoseo-traffic.com balook.com
autovideobroadcast.com banksrf.ru
availit.weebly.com bannerpower.com
aviav.eu bayareaaeroclub.org
avkzarabotok.info beauty-b0x.pl
avtolombard-krasnodar.ru beetpics.pw
avtovolop.ru belinvestdom.by
azinoofficial777.ru berrymall.ru
babyguns.ru
backlink4u.net
banan.tv
beauty-bracelet.com
best-coupon-offer.com
bestempresas.es
bestofpicture.com bestofpicture.com
bestssaker.com betterhdporn.com
binomo.com biglistofwebsites.com
bio-japan.net blobar.org
bioscorp.ru blockety.co
bitcoinremote.com bmw.afora.ru
bloggers.nl board.f00d.de
blogsfunky672.weebly.com boazpower.com
bmsco.co bobba.dzaba.com
bodybuilding-shop.biz bocoarchives.org
bonky.biz bonanza-fortune.men
boom-celebs.com
bpro1.top
brateg.xyz
brianhenry.co
bristolhotel.com
browserprotecter.com browserprotecter.com
brus-vsem.ru builtwith.com
bupropion-sr-150-mg.us bukleteg.xyz
burkesales.com buttons-for-website.com
business-suggested.tk buyfriend.ru
buydissertation.net buyhoverboard.com
buypanicdisorderpill.com cakemediahq.com.au
buytizanidineonline.blogspot.com callcafe.info
canrioloadm.gq carrauterie.be
carfax.com.ua cbox.ws
carina-sy.de cdncash.org
cartierlovebraceletreplica.xyz cheapjerseysa.com
cartierloveringreplica.xyz cheapjerseysap.com
cartierreplica.top clicksor.net
cctva.tv clips.ua.ac.be
cete.ru compliance-ivan.top
chatroulette.life compliance-jane.top
chatroulette.world compliance-walter.top
cheapbarbour.online
cheapmoncler.pw
cialischstgerts.com
clickso.com
codq.info
coinsspb.com
com-cleaner.systems
compliance-alex.top
compliance-donald.xyz
compliance-irvin.xyz
compliance-nelson.top
com-secure.download
connectingsingles.com connectingsingles.com
copypaste.traderzplanet.in contentsexpress.com
covetnica.com cottageofgrace.com
cpajunkies.com crirussian.ru
cscwtalkto.site customboxes4less.com
cs-passion.pl customcatchcan.com
custodieva.ru cyse.tk
customsua.com.ua
dailyrank.net dailyrank.net
dame-ns.kz daretodonate.co
daneshetabiat.com dealitright.click
danschawbel.com dekoration.us
delfin-aqua.com.ua derevesendeco.com
delitime.info dichvuvesinhhanoi.com
deniven.1bb.ru dimaka.info
dentalpearls.com.au dimfour.com
design-ideas.info dipstar.org
directivepub.com disruptingdinnerparties.com
div.as
divku.ru divku.ru
dnsrsearch.com dneprsvet.com.ua
dominateforex.ml docstoc.com
dostavka-v-ukrainu.ru dood.live
drillsaw.ru dostavimvdom.ru
drivotracker.com doxysexy.com
dscaas.website drpornogratisx.xxx
earthmagic.info dumpsmania24.com
e-avon.ru eaplay.ru
econom.co eas-seo.com
ekspertmed.com edge.sharethis.com
elektroniksigaraankara.info edwinkonijn.com.au
elektronischezigarettekaufen2.tumblr.com e-kwiaciarz.pl
elektrozigarette2.wordpressy.pl elektrischezigarette1.onsugar.com
elidelcream.weebly.com elektronischezigarette2.mex.tl
empirepoker.com elektrozigaretten1.webs.com
en.altezza.travel emailaccountlogin.co
englate.com empis.magix.net
en.home-task.com eorogo.top
ereko.ru eredijovon.com
ertelecom.ru
escort-russian.com
eshop.md eshop.md
evogarage.com etotupo.ru
europeanwatches.ru
executehosting.com
extremez.net extremez.net
eyelike.com.ua
ezigarettekaufen2.blox.pl ezigarettekaufen2.blox.pl
ezigarettenshop2.postbit.com ezigarettekaufen2.mpbloggar.se
f012.de ezigarettenkaufen2.dreamwidth.org
falopicm.pw ezigaretteshop.webs.com
faracontrol.ir failingmarriege.blogspot.com
fapgon.com
fashionindeed.ml
fashion-mk.net fashion-mk.net
fatfasts-4tmz.com fatmaelgarny.com
favoritemoney.ru favorcosmetics.com
feargames.ru faz99.com
fermersovet.ru fenoyl.batcave.net
fickkontaktehobbyhuren.com fetroshok.ru
fickluder69.com filesclub.net
filmidivx.com find1friend.com
financehint.eu findsexguide.com
findthe.pet flipper.top
firesub.pl forex21.ru
fitnesspiks.com formseo.com
flashahead.info forpackningsutveckling.se
forex-indextop20.ru fortunejack.com
fortwosmartcar.pw forum.doctissimo.fr
forumprofi.de foto-sisek.porngalleries.top
forums.d2jsp.org free411games.com
foxydeal.com freshberry.com.ua
franch.info freshwallpapers.info
franklinfire.co freza-sverlo.ru
frcls.fr fxgallery.com
freecamdollars.com gaming-journal.com
free-video-tool.com gay.adultgalls.com
freshdz.com gaz-voshod.ru
frivgame250.com getmyads24.com
fsalas.com gigapeta.com
funponsel.com gilsonchiro.xyz
fz139.ttk.ru goldandcard.ru
gallery.rennlist.com goldenggames.com
gemara.com gratis-sexkontakte.com
genericviagrasildenafiled.net gratuitbaise.com
genetworx.com gribokstop.com
getdot.ru growshop.es
ghostvisitor.com gungamesz.com
global-ics.co.za guod.me
gomusix.com habermetre.com
googlemare.com hackers-crackers.tk
gotomontenegro.net hahashka.ru
gotwebsite1.com hao123.com
grizzlysgrill.com hauleddes.com
grupografico-pilar.com.ar hawaiielectriclight.com
gsmtlf.ru
guardlink.org
guge.io
guigyverpo.cf
hamptonoaks.ca
handicapvansarea.com
handsandlegs.ru
hd-filmy.net
hdfreeporno.net hdfreeporno.net
hdwallpapers-free.com hdimagegallery.net
heatpower.ru hdwalls.xyz
heroz.fr helvetia.com.ua
hifidesign.ru
hildinghr.se
hit-kino.ru
hkdiiohi.skyrock.com
hmywwogw.bloger.index.hr hmywwogw.bloger.index.hr
hoporno.com homeandhealth.ru
hotloans.ru hotdl.in
ideashome.id hotkeys.com
ilbe.club housekuba.org
imagefinder.site hspline.com
imperia31.ru husky-shop.cz
intellekt21.ru hyhj.info
internet-apteka.ru i4track.net
investsuccess.org ilmen.net
investyb.com imfamous.info
iplusbit.blogspot.co.za iminent.com
irkutsk.online-podarki.com imk.com.ua
irunfar.com impisr.edunsk.ru
jagg.info inboundlinks.win
javitas.info infokonkurs.ru
javxxx18.com instabid.tech
jewelryandfiligree.com iplogger.org
jmat.cn itch.io
juliaworld.net iusstf.org
kerch.site j33x.com
kmd-pto.ru javspace.net
konkursowo-24.pl jerseyschinabizwholesale.us
konturkrasoty.ru jerseywholesalebizchina.com
kraljeva-sutjeska.com jongose.ninja
ketoanhanoi.info
keywordhouse.com
kino-rating.ru
kinosed.net
kinozapas.com
klin3952.ru
kochanelli.com
koral.se
kostenloser-sex.com
kung-fu-ru.com
kupiproday.com.ua kupiproday.com.ua
kupit-adenu.ru
kuzinsp.ru kuzinsp.ru
kwzf.net kvartiry-remont.ucoz.ru
kw21.org
ladsblue.com
la-fa.ru
languagecode.com
laptop-4-less.com
larutti.ru
lasvegaslockandsafe.com
laulini.soclog.se
lawyersinfo.org lawyersinfo.org
lider-zhaluzi.kiev.ua lexaprogeneric.link
lifeinsurancekb.com linksharingt.com
light.ifmo.ru livefixer.com
likesdesign.com liveinternet.ro
littleberry.ru lmrauction.com
longadventure.com lomb.co
longgreen.info
louboutinshoes.xyz
love-baby.cz love-baby.cz
m0r0zk0-krava.ru ltvperf.com
mailemedicinals.com luciddiagnostics.in
mamasuper.prom.ua m1media.net
magento-crew.net
makedo.ru
markjaybeefractal.com markjaybeefractal.com
maslenka.kz marsgatan.com
massage-info.nl masturbate.co.uk
masthopehomes.com matrixalchemy.com
mbiologi.ru matsdale.com
mebel-vstroika.ru mecash.ru
meccadumps.net mediafresh.online
medosmotr-ufa.ru medicovi.com
meget.co.za megakino.net
meltwater.com mejoresfotos.eu
militarysale.pro menetie.ru
minharevisao.com michaelkorssaleoutletonline.net
mister-shop.com midst.eu
moesen-ficken.com minneapoliscopiers.com
moi-glazki.ru mmog-play.ru
mole.pluto.ro mokrayakiska.com
monclerjacketsoutlet.pw moonci.ru
money-every-day.com mosdverka.ru
moneyteam24.com mossmesi.com
monthlywinners.com muizre.ru
mototsikl.org musicktab.com
mrinsidesales.com mybinaryoptionsrobot.com
mriyadh.com myperiod.club
msfsaar.de myyour.eu
muschisexbilder.com nac-bearings.ru
musezone.su namenectar.com
myghillie.info nardulan.com
myhealthcare.com naturalpharm.com.ua
mymobilemoneypages.com netallergy.ru
najaden.no netfacet.net
nalogovyykodeks.ru net-profits.xyz
naphukete.ru ngps1.ru
needtosellmyhousefast.com
nero-us.com
netoil.no
nextconseil.com
nhl17coins.exblog.jp nhl17coins.exblog.jp
noclegonline.info nikitabuch.com
no-fuel.org nufaq.com
november-lax.com o-dachnik.ru
nrjmobile.fr offside2.5v.pl
nuker.com offtopic.biz
offtime.ru ohmyrings.com
okel.co okeinfo.online
okmusic.jp oksrv.com
olympescort.com okuos.com
onemactrckr.com onlineporno.site
online7777.com onload.pw
online-hd.pl onlyforemont.ru
onlywoman.org openstat.com
ownshop.win optom-deshevo.ru
partner-print.men origin-my.ru
partner-trustworthy.men orion-v.com
pdns.download owohho.com
phormchina.com page2rss.com
physfunc.ru panicatack.com
picswe.com partner-pop.men
pictures-and-images.net pay2me.pl
pivka.xyz percin.biz.ly
pixshark.com perso.wanadoo.es
pk-services.ru petrovka-online.com
play.leadzupc.com petsblogroll.com
pochtovyi-index.ru photostudiolightings.com
polcin.de picturesfrom.com
polybuild.ru pintattoos.com
popunder.net pinwallpaper.top
porndl.org pixell.club
porno.simple-image.com.ua pixelrz.com
portal-eu.ru pladform.ru
portside.xyz plastjulgranar.se
potolokelekor.ru pl.id-forex.com
pregnant.guru poems.com.ua
presleycollectibles.com poiskzakona.ru
produkto.net pokerniydom.ru
proekt-mos.ru popander.mobi
prohoster.info popunder.ru
promoheads.com pornhub-ru.com
proposal-engine.com pornofiljmi.com
prostitutki-tyumeni.org pornokajf.com
pornoreino.com
pozdrawleniya.ru
priora-2.com
prize44.com
profitkode.com
proftests.net
pron.pro
prospekt-st.ru
prostitutki-rostova.org
pro-tec.kz pro-tec.kz
pts163.ru pst2017.onlinewebshop.net
pukaporn.com ptr.ruvds.com
puzzleweb.ru purplestats.com
q-moto.ru qexyfu.bugs3.com
queerspace.com queerspace.com
radiodigital.co questionmarque.ch
rank-checker.online qwesa.ru
rapidsites.pro rabotaetvse.ru
rarbg.to realnye-otzyvy.info
razleton.com registrydomainservices.com
realizmobi.com remontbiz.ru
realtytimes.com renecaovilla.online
r-e-f-e-r-e-r.com rennlist.com
reklama1.ru replica-watch.ru
remontgruzovik.ru respublica-otel.ru
remont-komputerov-notebook.ru ricorsogiustizia.org
rentaremotecomputer.com rollercoin.com
research.ifmo.ru
resultshub-a.akamaihd.net
rockprogblog.com
rogervivierforsale.com
royalads.net
royalcar-ufa.ru
royalvegascasino.com royalvegascasino.com
ruf777.com runofilms.ru
ruscoininvest.company salutmontreal.com
ruscopybook.com
sabaapress.com
sa-live.com
sammyweaver.com sammyweaver.com
sape.top samoiedo.it
savingsslider-a.akamaihd.net saneitconsulting.com
scanner-don.top sarf3omlat.com
scanner-irvin.top saugatuck.com
scanner-jess.top sawin.beth.webd.pl
school-diplomat.ru sayyoethe.blogspot.co.za
sdelai-prosto.ru scanmyphones.com
searchinquire.com scanner-olga.top
search.xtconnect.com scanspyware.net
seasonvar.ru
secretscook.ru
semprofile.com semprofile.com
seonetwizard.com service-core.ru
service.adtech.us seryeznie-znakomstva.ru
servingnotice.com sexiporno.net
sexkontakte-seite.com sex-tracker.com
sexpornotales.com
sextracker.com sextracker.com
sexxdate.net sexyali.com
sexytrend.ru sexy.babes.frontend-stack.top
sharebutton.org sfj-ror.no
shemale-sex.net share-buttons-for-free.com
shillyourcoins.com shoesonlinebuy.xyz
shinikiev.com.ua shopcheermakeup.info
shoppingjequiti.com.br sibdevice.ru
sibtest.ru
sildenafil-tadalafil.info
silverage.ru
similardeals.net similardeals.net
sindragosa.comxa.com sim-service.net
siteripz.net sitebeam.net
sklad-24.ru site.ru
skytraf.xyz sitevalued.com
sladkoevideo.com soc-proof.su
soc-econom-problems.ru
sodexo.com sodexo.com
space4update.pw songoo.wz.cz
sportbetfair.com soochi.co
sstroy44.ru spb.afora.ru
stackthatbucks.com spbchampionat.ru
stal-rulon.ru special-porn.com
star61.de speeddream.xyz
stariy-baku.com sribno.net
stefanbakosab.se stop-gepatit.te.ua
stevemonsen.com stretchingabuckblog.com
sticken.co strfls.com
strongholdsb.ru stroy-portal22.ru
strongsignal-a.akamaihd.net students-cheapskate.ml
sugarlyflex.pw sumo.com
suhanpacktech.com superkanpo.com
superlist.biz supermama.top
surffoundation.nl syvertsen-da.no
survival.betteroffers.review tarad.com
swinginwithme.ru taraz.xkaz.org
szamponrevita.pl tasteidea.com
tagil.zrus.org tattomedia.com
tanieaukcje.com.pl tdsing.ru
tds-advert002.info tedxrj.com
teastory.co templates.franklinfire.co
tecspb.ru
telesvoboda.ru
testingads.pro
thaisamkok.com
theallgirlarcade.com theallgirlarcade.com
thesmartsearch.net thebluenoodle.com
ticketsys.inetwd.com thecounter.com
theguardlan.com
timecrimea.ru
timhost.ru timhost.ru
tizanidineforopiatewithdrawal.blogspot.com
tizanidinehclsideeffects.blogspot.com
tizanidineonline.blogspot.com tizanidineonline.blogspot.com
tizanidineorflexeril.blogspot.com tizanidineorflexeril.blogspot.com
tizanidinepills.blogspot.com
tizanidineshowupondrugtest.blogspot.com
tizanidinewithdrawalsymptoms.blogspot.com tizanidinewithdrawalsymptoms.blogspot.com
topcar-krasnodar.ru topads.men
track2.shop topanasex.com
tracklead.net topappspro.com
tradgardspartner.se topmira.com
torrents.cd
torrents-tracker.com
tourcroatia.co.uk
toys.erolove.in
traffic2cash.org traffic2cash.org
trailer.cinemaflix.website traffic-club.info
trion.od.ua trafficmonetize.org
trkur.com trahic.ru
truebeauty.cc trainoffend.ml
tsan.net trumpetedextremes.com
ucsol.ru try-rx.com
undergroundcityphoto.com tsyndicate.com
unrealcommander.biz tuckpointingmasonrysystems.com
uprour.com tupper-shop.ru
usacasino.com tvnewsclips.info
us-america.ru typer.one
uvozdeckych.info tyumen.xrus.org
vancleefreplica.pw uamtrk.com
vektorpress.ru ua.tc
viagra-soft.ru uhodzalijami.ru
videochat.life underthesite.com
videochat.world unimodemhalfduplefw.pen.io
videosbox.ru unisexjewelry.org
vilingstore.net unrealcommander.com
vod.com.ua uptime-gamma.net
voluumtracker1.com url2image.com
vut.com.ru valoresito.com
vvon.co.uk valueclick.com
waysbetter.cn varbergsvind.se
webalan.ru v-doc.co
webshoppermac.com vedomstvo.net
webtherapy.ru via-energy-acquistare.com
wellcome2slovenia.ru viagroid.ru
wemarketing.se videokrik.net
whatistizanidine2mg.blogspot.com vizag.kharkov.ua
vltai.com
vmnmvzsmn.over-blog.com
vostoktrade.info
wait3sec.org
wallpapers-best.com
warningzscaler.heraeus.com
website-analytics.online
website-analyzer.info
website-speed-up.top
wfb.hatedriveapart.com
whereiskentoday.com whereiskentoday.com
wholesalejerseyscheapjerseys.us.com wholesalejerseyscheapjerseys.us.com
wildworld.site wholesalejerseysgaa.com
wordpresscore.com winterclassichockeyjerseys.com
worldlovers.ru wjgony.com
www.888.com wordkeyhelper.com
www.arenda-yeisk.ru wtsindia.in
wyniki-lista.pl wygraj-teraz.com
xclicks.net xbaboon.com
xgftnlrt.bloger.index.hr xblog.in
xn--80aodinpgi.xn--p1ai xedserver.com
xn----8sbarihbihxpxqgaf0g1e.xn--80adxhks xfire.com
xn--b1agm2d.net xlolitka.com
xn--d1aifoe0a9a.top xn--24-glceagatoq7c2a6ioc.xn--p1ai
xn----itbeirbjbi7bc6bh2d.xn--p1ai xn----7sbbahaq9bb5afgiqfliv4m.xn--p1ai
xn--80ahvj9e.xn--p1ai
xn--90acenikpebbdd4f6d.xn--p1ai
xportvusbdriver8i.snack.ws
xpresscare.ru xpresscare.ru
xtremeeagles.net
xtubeporno.net
xxx-cam.webcam xxx-cam.webcam
xxx-treker.ru yadro.ru
xzlive.com yeartwit.com
ynymnwbm.bloger.index.hr yebocasino.com
youporn-ru.com youbloodyripper.com
yourdesires.ru youradulthosting.com
yuarra.pluto.ro yourporngay.com
yunque.pluto.ro youthreaders.com
zarabotat-na-sajte.ru youtubologia.it
zerocash.msk.ru zaobao.com.sg
zeroredirect2.com zdesformula.ru
zhorapankratov7.blogspot.com zebradudka.com
zkjovpdgxivg.ga zeroredirect5.com
zscaler.net zeroredirect8.com
zvetki.ru zlatnajesen.com
zooggames.com
zrizvtrnpale.tk
zscalerone.net
zscalertwo.net

478
.dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
123kuma.com 0lovespells0.blogspot.com
7makemoneyonline.com 11pikachu.ru
adsref.men 202ch.com
akama.com 2kata.ru
akuhni.by 2pxg8bcf.top
alive-ua.com 40cg.com
allcredits.su 4rent.ru
allforminecraft.ru 98oi.ru
all-streaming-media.com abctoppictures.net
alyeskaresort.com advertisingtag.net
androids-store.com affrh2015.com
appearance-cool.com alfa-medosmotr.ru
artparquet.ru alloysteel.ru
autodo.info allpdfmags.net
aviav.ru.com android-vsem.org
ayeartoforget.com apioasisspacenet-a.akamaihd.net
azartmsl.com arclk.net
arquivo.pt
astrochicks.com
backlinkwatch.com
balans.shahterworld.org
banki76.ru banki76.ru
bannerads.de beget.tech
beachpics.com bestcalovebracelet.cn
beauty-bracelet.com bestcoin.cc
belstaffstore.online best-coupon-offer.com
bestchoice.cf bestimagecoollibrary.com
betune.onlinewebshop.net best-seo-software.xyz
bigcities.org bet-prognoz.com
biznesluxe.ru bharatdefencekavach.com
bjgugu.net.ua bigpenisguide.com
blog.f00kclan.de bitporno.sx
bonkers.name bjanshee.ru
boostmyppc.com bloggedporn.com
brateg.xyz bmsco.co
bum.com.ru bouda.kvalitne.cz
candytiner.com brianhenry.co
canoncdriverq3.pen.io bvlgariring.xyz
cartierlovebracelet.xyz candelluxsklep.pl
chastnoeporno.com carrauterie.be
cheatcode-lita12.rhcloud.com cartierlovestore.com
christianlouboutinreplica.win cartierreplica.top
christianlouboutinsaleonline.us ccjp.eu
cialischstgerts.com cheapbelstaff.online
cinemaflix.website clickcash.com
cjmc.info clipartnew.com
clickaider.com clknsee.com
clicksor.net cmd.kz
clksite.com co.lumb.co
coolbar.pro communisave.co.za
coolgamechannel.com compliance-viktor.top
creatives.adbetclickin.pink counter.yadro.ru
customchocolate.business-for-home.com crazyboost.pro
db.speedup.gdn crazyprotocol.com
deadlinkchecker.com crd.clan.su
dear-diary.ru customergrowthsystems.com
demenageur.com date-withme.com
design-ideas.info defenderxtactical.com
dktr.ru deplim.com
domination.ml diesel-parts28.ru
downloads-whatsapp.com dikqlyremy.info
download-wallpaper.net documentbase.net
doxyporno.com domain.webkeyit.com
dtnlyss.com dverimegapolis.ru
easyukraine.com dyshagi.ru
ekto.ee dyt.net
exlarseva.webblog.es elektrischezi.canalblog.com
ezigarettenshop2.myblog.de empirepoker.com
f00kclan.de englishgamer.com
family1st.ca enternet.ee
familyphysician.ru eropho.com
farm26.ru escortplius.com
fashionavenuegame.com ezigaretteshop.webs.com
fealq.com faptitans.com
fermersovet.ru fickblock18.com
ff30236ddef1465f88547e760973d70a.com findclan.org
flooringinstallation-edmonton.com findsexguide.com
flytourisme.org finstroy.net
free-video-tool.com franecki.net
frighteningremain.cf frcls.fr
front.to freetangodownload.com
fyxabomiw.ru fuckingawesome.com
galaxyflowers.ru
gameonasia.com
genetworx.com
germetiki.com.ua
getlaid-xxxhookupdirect.com getlaid-xxxhookupdirect.com
getridofstretchmarks.org getmyads24.com
getyourimage.club gilbertbanda.net
googglet.com gk170.ru
greatfind-a.akamaihd.net glopages.ru
grizzlysgrill.com gorabagrata.ru
heartofbeijing.blogspot.com gosarhivrt.ru
histock.info gotorussia.com
homemature.net gotwebsite1.com
home-task.com gratis-sexkontakte.com
host-tracker.com hanwei.us
hotel-mkad.ru hauleddes.com
heroz.fr
highstairs-a.akamaihd.net
homik.pw
hotblog.top
hplaserjetpdriver8y.pen.io
hubbble.com hubbble.com
ico.re iamsport.org
ideibiznesa2015.ru ido3.com
id-forex.com imagefinder.site
igadgetsworld.com inbabes.sexushost.com
ilovevitaly.xyz
i-midias.net.br
inboxdollars.com
inet-traffic.com
integritylandscapeservices.com integritylandscapeservices.com
iwanttodeliver.com intellego.info
iqoption.pro
istizanidineanopiate.blogspot.com
javidol.site javidol.site
jmat.cn jerseysbizwholesalecheap.com
karaganda.xkaz.org kam-dom.ru
kinocccp.net karadene.com
kinogonew.ru kihi.gdn
kiwi237au.tk lacapilla.info
kursy-ege.ru la-fa.ru
lacasamorett.com law-check-two.xyz
limads.men lifeinsurancekb.com
lisque.batcave.net linkbuddies.com
liveu.infoteka.hu livingcanarias.com
localflirtbuddies.com locatellicorretor.com.br
lollypopgaming.com macfix.life
lubetube.com mackeeper-center.club
madot.onlinewebshop.net managerpak204.weebly.com
magicplayer-s.acestream.net marketingvici.com
masserect.com marktforschung-stuttgart.com
mazda-roadsters.com me-ke.com
meltwater.com minet.club
member-quiz.com mirtorrent.net
mexicosleevegastrectomy.com mmgq.ru
mhtr.be monclercheap.xyz
micasainvest.com moncleronline.xyz
minyetki.ru moneymaster.ru
mobifunapp.weebly.com mosdverka.ru
monarchfind-a.akamaihd.net music7s.me
more-letom.ru mydownloadengine.com
morpicert.pw nardulan.com
mosrif.ru natali-forex.com
mototsikl.org nate.com
mrmoneymustache.com noclegonline.info
mrwhite.biz nudo.ca
musezone.ru nvssf.com
musicdaddy.net oconto.ru
musicspire.online offside2.5v.pl
mybinaryoptionsrobot.com okonich.com.ua
nailsimg.com onemactrckr.com
narosty.com onlineserialy.ru
nelc.edu.eg onstrapon.purplesphere.in
nextlnk12.com oranga.host.sk
normalegal.ru osnova3.ru
oakleyglassesonline.us osoznanie-narkotikam.net
offers.bycontext.com ovirus.ru
oil-td.ru partner-host.men
oneshotdate.com pc-test.net
onlainbesplatno.ru perosan.com
onlineku.com phelissota.xyz
ontargetseo.us pics-group.com
panouri-solare-acoperis.com
parlament.biz
picture-group.com
plastgranar.nu
playfortuna-play.ru playfortuna-play.ru
pliks.pl play.leadzupc.com
popugaychiki.com popugaychiki.com
popup.matchmaker.com pornoforadult.com
pornokajf.com pornzone.tv
powitania.pl printingpeach.com
pozdrawleniya.com projectforte.ru
prlog.ru prostitutki-rostova.org
pulseonclick.com prostitutki-yaroslavlya.org
pshare.biz
pussyspace.net pussyspace.net
putitin.me qld10000.net
quelle.ru razyboard.com
rcb101.ru remontbiz.ru
redirect.trafficreceiver.club renecaovilla.online
remont-ustanovka-tehniki.ru ritlweb.com
rennlist.com rniaeba.ga
responsive-test.net rockprogblog.com
rethinkwasteni.info roma-kukareku.livejournal.com
rootandroid.org ruscopybook.com
rus-pornuha.com sabizonline.com
sajatvelemeny.com saddiechoua.com
sandhillsonline.com sad-torg.com.ua
sanjosestartups.com saltspray.ru
sbornik-zakonov.ru sanatorrii.ru
sbwealthsolutions.ca sbf441.com
scanner-mary.top scanner-jess.top
scanspyware.net searchimage.co
scmor.ilxc.cc segol.tv
scrnet.biz.ua
sdelatmebel.ru
semaltmedia.com semaltmedia.com
shtaketniki.kz seminarykansas904.ml
site.ru sexphoto.site
smartpet.ru sexsearch.com
smokewithrabbits.com sex-sex-sex5.com
snowplanes.com sibvitr.ru
sonnikforme.ru silktide.com
souvenirua.com site-speed-checker.site
spbchampionat.ru sizeplus.work
slonechka.ru
spammen.de
spy-app.info
spymac.net spymac.net
starwars.wikia.com sribno.net
stauga.altervista.org stretchmate.net
stroymonolit.su students-cheapskate.ml
taaaak.com szucs.ru
talant-factory.ru thesmartsearch.net
thepokertimer.com topshef.ru
thewomenlife.com torrentgamer.net
tizanidine4mgprice.blogspot.com torrents.cd
tizanidine4mgtablets.blogspot.com torrent-to-magnet.com
tizanidinerestlesslegsyndrome.blogspot.com tozup.com
tizanidinewithdrawalsymptoms.blogspot.com traffic-club.info
tomatis.gospartner.com trafficjunky.net
tonerbox.kz traffictrade.life
totu.info tt-ipd.info
tracksz.co
trafficmania.com
triumf-realty.ru
trkdf.com
trustl.life
tsan.net
tuberkulezanet.ru
turizmus.us turizmus.us
twitlinks.com typer.one
uginekologa.com umg-stroy.ru
ultimatesetnewfreeallsoftupgradesystems.pw us-america.ru
ultramart.biz uzungil.com
unpredictable.ga validdomain.xyz
uprour.com v-doc.co
urdoot.win vegan-foods.us
vchulkah.net verymes.xyz
via-gra.webstarts.com via-energy-cumpara.com
viberdownload10.com videooko.weebly.com
videojam.tv vkontarkte.com
villacoloniale.com voloo.ru
visa-pasport.ru vseigru.one
vitalads.net webstatsdomain.org
vladimir.zrus.org wechatdownload10.com
vykup-avto-krasnodar.ru word-vorlagen.net
vysigy.su wygraj-skiny.win
wait3sec.org xblognetwork.com
warningwar.ru xcc24.pl
webads.co.nz xn--80abgj3a5acid6ghs.top
web.cvut.cz xn--80aebbcbcdemfkhba4byaehoejh8dza3v.xn--p1ai
wordpresscore.com xn--80aodinpgi.xn--p1ai
worldoffiles.ru xn----8sblgmbj1a1bk8l.xn----161-4vemb6cjl7anbaea3afninj.xn--p1ai
wtsindia.in xn----itbeirbjbi7bc6bh2d.xn--p1ai
xchangetrak.com xtremeeagles.net
xgames-04.com xtubeporno.net
x-mix.info xvideosbay.com
xn--80ab4aa2g.xn--p1ai yhit.press
xn----9sbubg3ambdfl1j.xn--p1ai zarabotok--doma.ru
xvideospornoru.com zeikopay.com
xxlargepop.com zeroredirect10.com
zaimite.ru zlatnajesen.com
zaloro.com zscalerone.net
zapatosenventa.info
zatjmuzu.info

172
.dev-tools/test_units/ratelimittest-beta.txt
View file

@ -5,93 +5,7 @@
<hr><center>nginx/1.16.1</center> <hr><center>nginx/1.16.1</center>
</body> </body>
</html> </html>
<html> ody>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.16.1</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.16.1</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.16.1</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.16.1</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.16.1</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.16.1</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.16.1</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.16.1</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.16.1</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.16.1</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.16.1</center>
</body>
</html>
<!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html><html> </html><html>
<head><title>503 Service Temporarily Unavailable</title></head> <head><title>503 Service Temporarily Unavailable</title></head>
<body> <body>
@ -484,6 +398,90 @@
<hr><center>nginx/1.16.1</center> <hr><center>nginx/1.16.1</center>
</body> </body>
</html> </html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.16.1</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.16.1</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.16.1</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.16.1</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.16.1</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.16.1</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.16.1</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.16.1</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.16.1</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.16.1</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.16.1</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.16.1</center>
</body>
</html>
<!DOCTYPE html> <!DOCTYPE html>
<html> <html>
<head> <head>

2
.dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
34.73.34.132 0; 35.196.158.85 0;
127.0.0.1 0; 127.0.0.1 0;

BIN
.latest_release/bots.d.tar.gz
View file

Binary file not shown.

BIN
.latest_release/conf.d.tar.gz
View file

Binary file not shown.

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2020.04.2048 #### Version: V4.2020.04.2049
#### Bad Referrers Blocked: [6831](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [6831](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [571](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [571](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2020.04.2048 #### Version: V4.2020.04.2049
#### Bad Referrers Blocked: [6831](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [6831](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [571](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [571](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -11,7 +11,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2020.04.2048 #### Version: V4.2020.04.2049
#### Bad Referrers Blocked: [6831](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [6831](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [571](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [571](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2652
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2020.04.2048 #### Version: V4.2020.04.2049
#### Bad Referrers Blocked: [6831](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [6831](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [571](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [571](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2656
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2656
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

2656
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2020.04.2048 ### Version: V4.2020.04.2049
### Updated: Thu Apr 16 22:34:28 SAST 2020 ### Updated: Sat Apr 18 22:35:52 SAST 2020
### Bad Bot Count: 571 ### Bad Bot Count: 571
################################################### ###################################################
### Version Information ## ### Version Information ##