vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-10 06:15:06 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2020.03.2031 [ci skip]

Browse source
This commit is contained in:
Travis 2020-03-31 22:33:48 +02:00
parent 20a9ffe9a7
commit ec87cf122f
52 changed files with 14498 additions and 14492 deletions
Download patch file Download diff file Expand all files Collapse all files

1492
.dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
.dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
34.74.253.255 1; 35.202.245.105 1;
127.0.0.1 1; 127.0.0.1 1;

2
.dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
34.74.253.255 0; 35.202.245.105 0;
127.0.0.1 0; 127.0.0.1 0;

1492
.dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
.dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
34.74.253.255 1; 35.202.245.105 1;
127.0.0.1 1; 127.0.0.1 1;

2
.dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
34.74.253.255 0; 35.202.245.105 0;
127.0.0.1 0; 127.0.0.1 0;

1492
.dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
.dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
34.74.253.255 1; 35.202.245.105 1;
127.0.0.1 1; 127.0.0.1 1;

2
.dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
34.74.253.255 0; 35.202.245.105 0;
127.0.0.1 0; 127.0.0.1 0;

1492
.dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

1492
.dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

1492
.dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
.dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
35.237.212.185 0; 34.66.200.49 0;

1492
.dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
.dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
34.73.65.1 1; 104.197.122.201 1;
127.0.0.1 1; 127.0.0.1 1;

2
.dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
34.73.65.1 0; 104.197.122.201 0;
127.0.0.1 0; 127.0.0.1 0;

1492
.dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
.dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
34.73.65.1 1; 104.197.122.201 1;
127.0.0.1 1; 127.0.0.1 1;

2
.dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
34.73.65.1 0; 104.197.122.201 0;
127.0.0.1 0; 127.0.0.1 0;

1492
.dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
.dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
34.73.65.1 1; 104.197.122.201 1;
127.0.0.1 1; 127.0.0.1 1;

2
.dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
34.73.65.1 0; 104.197.122.201 0;
127.0.0.1 0; 127.0.0.1 0;

1492
.dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

3
.dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,5 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
35.185.97.135 0; 34.66.25.221 0;
34.74.253.255 0;

1492
.dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

4
.dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,5 +45,5 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
35.185.97.135 0; 35.188.15.155 0;
34.74.253.255 0; 104.197.122.201 0;

1492
.dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

5
.dev-tools/test4_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,6 +45,5 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
35.237.212.185 0; 104.197.122.201 0;
35.237.8.208 0; 35.192.91.101 0;
34.74.253.255 0;

1492
.dev-tools/test4_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

6
.dev-tools/test5_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,6 +45,6 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
35.185.97.135 0; 34.66.50.208 0;
35.237.212.185 0; 35.192.10.37 0;
35.237.8.208 0; 35.188.15.155 0;

1492
.dev-tools/test5_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
.dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
34.74.253.255 1; 35.202.245.105 1;
127.0.0.1 1; 127.0.0.1 1;

20
.dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
AhrefsBot Aboundex
IndeedBot ASPSeek
LinqiaScrapeBot GrapeshotCrawler
Majestic-SEO Heritrix
Mojolicious Joomla
Pixray Net Vampire
RealDownload OnCrawl
Rogerbot Steeler
Snoopy Surfbot
Sqlmap True_Robot

284
.dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
360Spider
404checker 404checker
404enemy
80legs 80legs
Aboundex Aboundexbot
Acunetix Acunetix
ADmantX ADmantX
AIBOT AhrefsBot
AiHitBot AiHitBot
Aipbot Alligator
AllSubmitter
AlphaBot
Anarchie Anarchie
Apexoo Apexoo
archive.org_bot
arquivo.pt
ASPSeek ASPSeek
autoemailspider Asterias
AwarioRssBot AwarioSmartBot
BackDoorBot
backlink-check backlink-check
BackStreet BackStreet
BackWeb Bandit
Badass
BatchFTP BatchFTP
Battleztar Bazinga
BBBike BBBike
BetaBot
Bigfoot Bigfoot
Blackboard
Black Hole Black Hole
BLEXBot BLEXBot
Blow
Boardreader Boardreader
Bolt
Buddy Buddy
BuiltBotTough BuiltWith
Bullseye Bullseye
CATExplorador BuzzSumo
CazoodleBot
CheeseBot CheeseBot
CherryPicker Chlooe
CheTeam
Cloud mapping Cloud mapping
coccocbot-web
cognitiveseo cognitiveseo
Collector Collector
com.plumanalytics
CopyRightCheck CopyRightCheck
Craftbot Cosmos
crawler4j crawler.feedback
CrazyWebCrawler crawl.sogou.com
CSHttp Crescent
CrunchBot
Curious Curious
Custo DataCha0s
demandbase-bot DBLBot
Demon Demon
Deusu DIIbot
Digincore Dispatch
DigitalPebble DomainSigmaCrawler
Dirbuster
Disco
Discobot
DomainStatsBot DomainStatsBot
Dragonfly
DTS Agent
EasyDL EasyDL
ECCP/1.0 Ebingbong
eCatch
Ecxi Ecxi
evc-batch EirGrabber
Evil Express WebPictures
ExtLinksBot EyeNetIE
Extreme Picture Finder
FDM FDM
FHscan Fimap
Flunky Firefox/7.0
FlashGet
FrontPage FrontPage
Fyrebot GalaxyBot
Genieo Genieo
Getintent
GetRight GetRight
GetWeb
Gigabot Gigabot
Go-Ahead-Got-It G-i-g-a-b-o-t
Gotit Gotit
Go!Zilla GrapeFX
GrabNet GrapeshotCrawler
GridBot
GT::WWW
HaosouSpider HaosouSpider
Harvest Havij
Heritrix HEADMasterSEO
HTMLparser heritrix
Hloader
HTTP::Lite HTTP::Lite
Humanlinks
HybridBot
Iblog Iblog
IDBot IDBot
Id-search IlseBot
Image Fetch IndeedBot
Image Sucker Indy Library
InfoNaviRobot
InfoTekies
instabid instabid
Intelliseek Intelliseek
Internet Ninja InterGET
InternetSeer ips-agent
IRLbot IRLbot
JOC Web Spider IstellaBot
JamesBOT
JennyBot
JetCar
Jorgee Jorgee
JustView JustView
Jyxobot Jyxobot
Kinza
Kozmosbot
Larbin
LeechGet LeechGet
Likse Lftp
Linkdexbot LinkpadBot
LinkextractorPro LinksManager
LinkScan LinqiaMetadataDownloaderBot
LinqiaScrapeBot LinqiaRSSBot
Litemage_walker Litemage_walker
Lmspider
LNSpiderguy LNSpiderguy
Ltx71 Ltx71
LWP::Simple LWP::Simple
Magnet
Mag-Net Mag-Net
magpie-crawler
Majestic12 Majestic12
Majestic SEO Majestic SEO
Majestic-SEO Mata Hari
Mass Downloader
MeanPath Bot MeanPath Bot
Mediatoolkitbot
mediawords mediawords
MegaIndex.ru Mister PiX
MicroMessenger
Microsoft Data Access
MIIxpc
MJ12bot
Mojeek Mojeek
Morfeus Fucking Scanner Morfeus Fucking Scanner
Msrabot MQQBrowser
muhstik-scan Musobot
NetAnts NearSite
netEstate NE Crawler Needle
Nettrack Netcraft
NetMechanic
NetSpider
Net Vampire Net Vampire
NimbleCrawler Nibbler
Niki-bot
Nimbostratus Nimbostratus
Ninja Nmap
NPbot NPbot
Nutch Nutch
Octopus oBot
Offline Explorer OnCrawl
OpenLinkProfiler OpenLinkProfiler
Openvas Openvas
OPPO A33 OpenVAS
OrangeBot OrangeBot
OrangeSpider
OutclicksBot OutclicksBot
PageAnalyzer PageScorer
PageGrabber Panscient
Pandalytics Pavuk
PECL::HTTP pcBrowser
Picsearch PeoplePal
PictureFinder
Pimonster Pimonster
Pi-Monster Pi-Monster
PleaseCrawl Pixray
plumanalytics plumanalytics
Probethenet POE-Component-Client-HTTP
polaris version
ProWebWalker ProWebWalker
Pump
PxBroker
PyCurl
RankActive RankActive
RankingBot RankActiveLinkBot
RankFlex
RankingBot2 RankingBot2
Rankivabot
RealDownload
Reaper Reaper
RebelMouse RebelMouse
ReGet RedesScrapy
RepoMonkey Ripper
s1z.ru RSSingBot
SBIder SBIder
ScanAlert ScanAlert
Scanbot
scan.lol
ScoutJet
Scrapy Scrapy
SEOkicks SEOkicks
SEOkicks-Robot SEOlyticsCrawler
Seomoz
SEOprofiler SEOprofiler
seoscanners
SeoSiteCheckup SeoSiteCheckup
Shodan Shodan
Siphon Siphon
SISTRIX SISTRIX
Sitebeam Sitebeam
SiteExplorer Siteimprove
SiteLockSpider SiteLockSpider
SiteSnagger SlySearch
SiteSucker SmartDownload
Site Sucker
SMTBot
Snake
Snapbot Snapbot
Sociscraper
sogouspider sogouspider
Sogou web spider Sogou web spider
Sosospider
Sottopop
Spammen
sp_auditbot sp_auditbot
Spbot Spbot
Spinn3r Spinn3r
spyfu
Sqlmap Sqlmap
Sqworm
Steeler
Stripper Stripper
Sucuri
SuperHTTP
SurveyBot SurveyBot
Swiftbot Szukacz
sysscan T8Abot
TeleportPro Telesoft
Telesphorep Telesphoreo
TightTwatBot The Intraformant
Toweyabot TheNomad
Trendiction Toata
trendiction.de
True_Robot
Turingos Turingos
Turnitin
TurnitinBot
TwengaBot TwengaBot
Twice URLy Warning
Typhoeus URLy.Warning
Vagabondo
VB Project
VoidEYE VoidEYE
Voil
Wallpapers/3.0 Wallpapers/3.0
WallpapersHD WallpapersHD
WASALive-Bot
WBSearchBot
Webalta
WebAuto WebAuto
Web Auto
WebBandit WebBandit
WebCollage
Web Collage
WebCopier
Web Enhancer Web Enhancer
Web Fetch Web Fuck
WebFuck WebGo IS
WebImageCollector
WebmasterWorldForumBot
webmeup-crawler
WebPix WebPix
WebSauger Web Pix
Web Sauger Web Sauger
Webshag WebsiteExtractor
WebsiteQuester Website Quester
Webster
WebSucker WebSucker
Web Sucker
WebWhacker
WebZIP WebZIP
WeSEE WeSEE
Whatweb Whack
Widow WiseGuys Robot
WISENutbot
Wonderbot
Woobot
Wotbox Wotbox
WWW-Mechanize WPScan
WWW::Mechanize WWW-Collector-E
x09Mozilla WWWOFFLE
x22Mozilla Xaldon WebSpider
Xenu Xenu
xpymep1.exe
YoudaoBot
Zade Zade
Zermelo
Zitebot

304
.dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
360Spider 404enemy
80legs 80legs
Aboundex
Acunetix
ADmantX
AIBOT
AiHitBot AiHitBot
Alligator Alexibot
Anarchie Anarchie
Ankit arquivo-web-crawler
Apexoo
archive.org_bot
Aspeigel
ASPSeek ASPSeek
Attach AwarioSmartBot
AwarioRssBot Backlink-Ceck
backlink-check BackWeb
BacklinkCrawler BatchFTP
BackStreet BBBike
Bandit
Barkrowler
Battleztar Bazinga
BDCbot BDCbot
BDFetch BetaBot
Bigfoot Bigfoot
BlackWidow Bitacle
Bolt Black Hole
BlowFish
Boardreader
BuzzSumo BuzzSumo
CATExplorador Calculon
CazoodleBot
CCBot
Cegbfeieh
CheeseBot CheeseBot
Chlooe CheTeam
ChinaClaw
Claritybot Claritybot
Cliqzbot
Cloud mapping Cloud mapping
Cogentbot
cognitiveseo cognitiveseo
Collector Collector
Copier
CopyRightCheck
Copyscape Copyscape
Cosmos
Craftbot
crawler4j crawler4j
crawl.sogou.com CrazyWebCrawler
CSHttp CrunchBot
DatabaseDriverMysqli Curious
Custo
DataCha0s
DBLBot DBLBot
demandbase-bot
Deusu Deusu
Dotbot Devil
Digincore
DigitalPebble
DIIbot
Discobot
DomainAppender
Download Wonder Download Wonder
Dragonfly
Drip Drip
DSearch DTS Agent
EasyDL
Ebingbong Ebingbong
ECCP/1.0 ECCP/1.0
EirGrabber EMail Siphon
EMail Wolf Express WebPictures
Exabot
ExtLinksBot ExtLinksBot
Extractor Extractor
Extreme Picture Finder Extreme Picture Finder
EyeNetIE EyeNetIE
facebookscraper FemtosearchBot
FDM FHscan
Fimap
Firefox/7.0 Firefox/7.0
Flunky
Foobot
Freeuploader Freeuploader
FyberSpider FyberSpider
GalaxyBot
Genieo
GermCrawler GermCrawler
GetRight GetRight
GetWeb Go-Ahead-Got-It
Gigablast
Gigabot
G-i-g-a-b-o-t
Gotit Gotit
GoZilla
Go!Zilla
Grabber Grabber
GrabNet Grafula
GrapeshotCrawler GrapeshotCrawler
GridBot HaosouSpider
GT::WWW heritrix
Harvest
Havij
Heritrix
Hloader
HMView HMView
HTMLparser
HTTP::Lite
HTTrack HTTrack
Humanlinks
HybridBot HybridBot
IlseBot Iblog
IndeedBot Id-search
InfoNaviRobot Image Fetch
Image Sucker
Indy Library
InfoTekies InfoTekies
instabid
InternetSeer InternetSeer
internetVista monitor
ips-agent ips-agent
JamesBOT Iria
Iskanie
Jbrofuzz
JennyBot JennyBot
JetCar JetCar
Jetty JOC Web Spider
Joomla
Jorgee
JustView JustView
Jyxobot Keyword Density
Kozmosbot Kinza
LeechFTP Lanshanbot
LeechGet Larbin
LexiBot Libwhisker
Lftp
Lightspeedsystems Lightspeedsystems
LinkScan Likse
LinkextractorPro
LinkpadBot
LinkWalker LinkWalker
LinqiaRSSBot LinqiaRSSBot
LinqiaScrapeBot
Lipperhey
Litemage_walker Litemage_walker
Lmspider Lmspider
LNSpiderguy
lwp-request
LWP::Simple LWP::Simple
lwp-trivial
Majestic12
Majestic SEO Majestic SEO
Mass Downloader Mass Downloader
Mata Hari
MauiBot MauiBot
Mb2345Browser MeanPath Bot
Meanpathbot MegaIndex.ru
Mediatoolkitbot Metauri
mediawords MFC_Tear_Sample
MicroMessenger
Microsoft Data Access
Microsoft URL Control
MIDown tool MIDown tool
MIIxpc
Mister PiX
MJ12bot MJ12bot
Mojeek Mojeek
Mojolicious
Morfeus Fucking Scanner
MSFrontPage MSFrontPage
MSIECrawler
muhstik-scan
Name Intelligence
Navroad Navroad
Nessus Nessus
Netcraft Netcraft
NetSpider NetSpider
Nettrack NextGenSearchBot
Niki-bot Nibbler
NICErsPRO
Nikto Nikto
Ninja Nimbostratus
Nmap Nmap
NPbot
oBot oBot
Octopus Openvas
Offline Explorer
Openfind
OrangeBot OrangeBot
OutfoxBot OutclicksBot
PageAnalyzer Page Analyzer
PageGrabber PageGrabber
Panscient page scorer
pcBrowser Papa Foto
PECL::HTTP Pavuk
Picsearch PHPCrawl
Picscout
PictureFinder PictureFinder
Pimonster
Pi-Monster
Pixray
PleaseCrawl PleaseCrawl
Pockey Pockey
POE-Component-Client-HTTP
polaris version
ProPowerBot ProPowerBot
Pump RankActive
PyCurl
RankFlex
RankingBot RankingBot
Rankivabot RankingBot2
Reaper RankurBot
RealDownload
Recorder
RedesScrapy RedesScrapy
ReGet
RepoMonkey RepoMonkey
RocketCrawler Ripper
RSSingBot
s1z.ru s1z.ru
SalesIntelligent SalesIntelligent
Scanbot SBIder
scan.lol
Scrapy
Screaming
ScreenerBot ScreenerBot
SEOkicks SearchmetricsBot
SEOlyticsCrawler Semrush
SemrushBot
SEOkicks-Robot
SEOprofiler
seoscanners seoscanners
SeoSiteCheckup serpstatbot
sexsearcher sexsearcher
Shodan Siphon
Sitebeam SISTRIX
SiteExplorer SiteExplorer
Siteimprove
SiteSucker SiteSucker
Site Sucker
Sitevigil Sitevigil
SlySearch
SMTBot SMTBot
Snake Snake
Snoopy Snapbot
SocialRankIOBot
sogouspider
Sogou web spider Sogou web spider
Spammen Sosospider
Spanner
Spbot
Spinn3r
SputnikBot
Sqlmap Sqlmap
Sqworm Sucuri
Steeler SuperBot
Stripper
Sucker
Swiftbot Swiftbot
sysscan Szukacz
T0PHackTeam
T8Abot
Teleport
Telesoft Telesoft
Telesphoreo Telesphoreo
The Intraformant The Intraformant
TightTwatBot Toata
Tracemyfile
Trendictionbot Trendictionbot
trendiction.com
True_Robot True_Robot
Turingos
Turnitin Turnitin
Twice
Upflow Upflow
URLy Warning VeriCiteCrawler
Vagabondo WBSearchBot
VCI WebAuto
VidibleScraper WebCollage
Virusdie WebEnhancer
Voil Web Enhancer
Webalta Web Fetch
Web Auto WebFuck
WebCopier
WebGo IS
WebImageCollector
WebLeacher WebLeacher
webmeup-crawler WebmasterWorldForumBot
Webshag Web Pix
WebsiteQuester WebReaper
Website Quester WebSauger
Webster Web Sauger
WebStripper WebsiteExtractor
WebSucker WebSucker
Web Sucker Web Sucker
Whack WebWhacker
Who.is Bot WeSEE
Whacker
Widow
WiseGuys Robot
WISENutbot WISENutbot
Woobot Wonderbot
Wotbox x09Mozilla
WPScan
WWWOFFLE
x22Mozilla x22Mozilla
Xaldon WebSpider
Xaldon_WebSpider
Xenu Xenu
xpymep1.exe Zade
Zauba
zauba.io
Zermelo Zermelo
Zeus
ZmEu ZmEu
ZyBorg

20
.dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
aloofly.com alfa-medosmotr.ru
axbocz.net ci.ua
dayibiao.com e-collantes.com
fickluder69.com hostingclub.lk
kamorel.com istmira.ru
knogg.net kino-ecran.ru
online-hd.pl pihl.se
rangoman.date riders.ro
tizanidinehcl4mgisitanarcotic.blogspot.com tvnewsclips.info
tizanidineoral.blogspot.com vodkoved.ru

930
.dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
007angels.com 000free.us
0912701309f8ce.com 101lesbian.xyz
123cha.com 108shot.com
123locker.com 14b.info
1314dh.com 1bet.com
3th.co.in 21h2o.com
51unlim.ru 2728fb936f0.com
5tey7463.weebly.com 2daytrendingnews.com
888.com 2itech.ru
991mostfm.co.id 4kpics.rocks
aac500b7a15b2646968f6bd8c6305869d7.com 7ooo.ru
abbanreddy.com a14download.com
absolute-s.ru aa81bf391151884adfa3dd677e41f94be1.com
acc.eu.org academiacsmendoza.org
actulite.com acads.net
adclickservice.com adloads.net
addtoadd.men adultwebhosting.info
adexprts.com
adhome.biz
adrunnr.com
ads-cool.pro
adultmeetonline.info
advancedsoftwaresupport.com
advertex.info
adzerg.com adzerg.com
affordablewebsitesandmobileapps.com aerogo.com
agardomains.com alfa-medosmotr.ru
akita.kz algerianembassy.co.in
aktivator-windows10.blogspot.com
alif-ba-ta.com
alive-ua.com
all4wap.ru
allblogroll.com allblogroll.com
amateurlivechat.org allkrim.com
anapa-inns.ru allpdfmags.net
angel1777.kz allsilver925.co.il
apparel-offer.com alveris.ru
approvedlocal.co.za amigobulls.com
ap.senai.br android4fun.org
arcadepages.com angkortours.vn
arendovalka.xyz apimossnetinfo-a.akamaihd.net
artefakct.com apioasisspacenet-a.akamaihd.net
asia-forum.ru appmsr.org
asrv-a.akamaihd.net apptester.tk
aviav.ru.com apxeo.info
avkzarabotok.com arabseyes.com
babosas.com arcteryxsale.online
backgroundpictures.net arpelsreplica.xyz
bankmib.ru artparquet.ru
bannerads.de arvut.org
bannerspace.com asacopaco.tk
bard-real.com.ua asiengirls.net
beetpics.pw astrochicks.com
bestofupload.info ausergrubhof.info
bif-ru.info autobrennero.it
big-boards.info autorn.ru
avitocars.ru
azbukadiets.ru
balla-boo.se
bankcrediti.ru
bannerswap.com
basisches-wasser.net
beachtoday.ru
best-deals-products.com
betterhdporn.com
bezsporno.ru
bigcareer.info
big-cash.net big-cash.net
bildsuche.ru bird1.ru
bizcheapjerseyswholesalechina.com
bizfly.info bizfly.info
bjgugu.net.ua biznesluxe.ru
blackhatworth.com bjorkbacken.nu
blavia.00author.com blackle.com
blog.koorg.ru blagovest-med.ru
blogrankers.com blogsfunky672.weebly.com
bonky.biz blogs.rediff.com
bonzibuddi.com bluesalt.co
board.f00d.de
bolegapakistan.com
boo-arts.com
bookmark4you.com.biz
bosefux.esy.es
bouda.kvalitne.cz bouda.kvalitne.cz
brainboosting.club bpro1.top
brandehk.dk breget74.ru
brateg.xyz buchananshardware.com
brg8.com bugof.gq
budilneg.xyz buy-cheap-pills-order-online.com
buehne-fuer-menschenrechte.de buypuppies.ca
buigas.00it.com bvlgariring.xyz
buy-forum.ru cakemediahq.com.au
buynorxx.com call-of-duty.info
buyparajumpers.online calstaterealty.us
callmd5map.com cand.jp
candy-glam-hp.com carmuffler.net
capture-room.com carstrends2015.com
carrauterie.be cartujano-pre.de
cars-modification.net casablancamanor.co.za
carsplate.com cascadelink.org
cartierloveringreplica.xyz
cdncash.com cdncash.com
cfcl.co.uk cementaresearch.se
cfjump.com cete.ru
changde.58.com cheapmoncler.win
cheap-pills-norx.com
cheapsergiorossi.online
chiblackhawks-jerseys.com
chinaelitecheapjerseys.com chinaelitecheapjerseys.com
chocolateslim-original.com chocolateslim-en-espana.com
choosecuisine.com
christianlouboutinreplica.win christianlouboutinreplica.win
christianlouboutinsaleoutletonline.us cialgenisrx.com
cialis-samples.com cialischsrx.com
circlesl.com ciceros.co
cityadspix.com classicakuhni.ru
citysecurity.nu clevernt.com
clayvasedesigns.tk club-musics.ru
cleansearch.net colobit.biz
cmhomestayagency.com cookingmeat.ru
codq.info coolgamechannel.com
comeondog.info copblock.org
compliance-checker.info coslab.club
compliance-irvin.top cosmeticswomens-womensports.rhcloud.com
compliance-irvin.xyz counciltally.com
compliance-mary.top countercrazy.com
compliance-olga.top
comsysnet.com
cookielawblog.wordpress.com
coolbar.pro
counterbot.com
cowlmash.com cowlmash.com
cscwtalkto.site crackzplanet.com
culmimg.pw creditwell.ru
customergrowthsystems.com crest-poloski.ru
cypernhuset.se customcollegeessays.net
daretodonate.co cxpromote.com
darkages.info daptravel.com
davebestdeals.com datadepths.com
dbmkfhqk.bloger.index.hr daydream-studio.ru
ddsoldes.fr ddsoldes.fr
degerlund.net deniven.1bb.ru
deluxedumps.com depositfiles-porn.ga
deutschehobbyhuren.net destinationrealestate.com
dev33.dioniqlabb.se diarioaconcagua.com
dev78.dioniqlabb.se dickssportinggoods.com
devochki.top discovertreasure-a.akamaihd.net
dieswaene.com domaincdn.xyz
digital-video-processing.com donna7753191.ru
dimfour.com drugs-no-rx.info
dinosaurus.site dustyorate.com
domainanalyzing.xyz dvervmoskvu.ru
dostavimvdom.ru ege-russian.ru
dostavka-v-krym.com egovaleo.it
dostavka-v-ukrainu.ru ekaterinburg.xrus.org
driving.kiev.ua ekn-art.se
dyshagi.ru ekspresihati.info
e705.net election.interferencer.ru
earl-brown.info electricwheelchairsarea.com
earncash.com.ua eleimgo.pw
easycommerce.cf elektroniksigaraankara.info
elektir.ru elitedollars.com
elektrischezigarette1.onsugar.com elitesportsadvisor.com
elektrozigaretten1.postbit.com elstal.com.pl
energydiet24.ru elvenar.com
enews.tech eorogo.top
extlinks.com erectile.bid
ezigarettekaufen1.hpage.com ero-advertising.com
ezigarettenshop1.yolasite.com erotik-kostenlos.net
eshop4u.jp
etm-consult.de
extener.org
extremez.net
ezigarettenshop2.postbit.com
f00kclan.de
f0815.de f0815.de
facebook-mobile.xyz famix.xyz
facecup.top fanoboi.com
favornews.com fanpagerobot.com
fba-mexico.com fast-wordpress-start.com
fermersovet.ru fickblock18.com
fetroshok.ru filesdatabase.net
fickenbumsen.net filmetricsasia.com
filesvine.com fishingwholesale.us
flipper.top fiuxy.com
flooringinstallation-edmonton.com fiverr.com
flowersbazar.com florida-tourism.net
forex.osobye.ru footballfarrago.com
fortevidyoze.net fortevidyoze.net
fotosfotos.eu forums.toucharcade.com
foto-sisek.porngalleries.top foxinsocks.ru
franecki.net frameimage.org
freecamdollars.com freecamdollars.com
free-fbook-traffic.com
free-floating-buttons.com free-floating-buttons.com
freegamesplay.online free-laptop-reward.com
free-gluten.ru gael-s.ru
freetangodownload.com gambarkatabaru.com
fun-mobi.pl gelezki.com
galeria-zdjec.com genetworx.com
gallerylisting.com geoads.com
gamerextra.com getlaid-xxxhookupdirect.com
gamewrath.com glavprofit.ru
gaz-voshod.ru globetrotting-culture.ru
ge0ip.com glogow.pl
gearsadspromo.club goatse.ru
geilehausfrauen.net gogps.me
generalporn.org googleseo.com.tr
gentamicineyedrops.blogspot.com gribkovye-zabolevaniya.com
gigapeta.com
gigixo.com
global-ics.co.za
globalscam.ga
gloverid.site
goldpanningtools.com
goodwriterssales.com
googglet.com
googst2.ru
grtyi.com
gsbs.com.ua gsbs.com.ua
hackers-crackers.tk gsmtlf.ru
hannasolution.ru gwebtools.com.br
hchha.com gz2.bbsoldes.fr
hdimagelib.com hamptonoaks.ca
hitcpm.com hdhc.ru
hmmm.cz help.tpu.ru
homedecoguide.info heroz.fr
homedo.fabpage.com hexpilot.com
hoporno.com highland-homes.com
hostnow.men hildinghr.se
houdom.net home-task.com
houston-vikings.com hop.clickbank.net
ifmo.ru hostingclub.lk
imguramx.pw housekuba.org
incomekey.net hoztorg-opt.ru
infodocsportal.com https-legalrc.biz
infogame.name huhn.altervista.org
internet-apteka.ru icaseclub.ru
investyb.com ido3.com
iphantom.com ihc2015.info
it-max.com.ua ikritikimou.gr
iwantedmoney.com iloveitaly.ru
jackpotchances.com immobiliaremassaro.com
janerikholst.se impotentik.com
janettabridal.com incep.imagine-ex.co
javlibrary.cc inclk.com
jerseychinabizwholesale.com indetiske.ya.ru
jerseyswholesalechinalimited.com instakink.com
jjbabskoe.ru intelhdgraphicsgtdrive6w.metroblog.com
job.icivil.ir investingclub.ru
journeydownthescale.info investpamm.ru
jrpmakati.com investzalog.ru
juliadiets.com itag.pw
justbcause.com iweblist.info
justkillingti.me jasonpartington.com
kanimage.com javspace.net
kazan.xrus.org javstock.com
kazan.zrus.org justdating.online
katushka.net
kaz.kz kaz.kz
kerch.site kchaxton.com
kfon.eu keywordglobal.co.za
kino-filmi.com keywordsking.com
kinogolos.ru kidd.reunionwatch.com
kinomaniatv.pl kiinomaniak.pl
kiwi237au.tk kinopolet.net
klin3952.ru kino-rating.ru
kmd-pto.ru kit-opt.ru
konteiner24.com kolotiloff.ru
krasnodar-avtolombards.ru krasnodar-avtolombards.ru
ks1234.com krasnodar.xrus.org
kung-fu-ru.com kurwa.win
labplus.ru kutikomi.net
lanasshop.ru kvartir-remont.biz
laparfumotec.com kw21.org
lazy-z.com labelwater.se
linerdrilling.com lacapilla.info
lion.playtap.us lampokrat.ws
liveinternet.ru lecbter-relationships.ga
liver-chintai.org legalrc.biz
livingcanarias.com lernur.net
lkbennettstore.online letmacwork.world
locatellicorretor.com.br letsrepair.in
locimge.pw linkwithin.com
lombardfinder.ru lisque.batcave.net
lomb.co liveshoppersmac.com
lostaruban.com louboutinreplica.pw
lotto6888.com
lunamedia.co
lyngdalhudterapi.no lyngdalhudterapi.no
m3gadownload.pl lyrics.home-task.com
mahnwachen-helfen.info manimpotence.com
mastershef.club manuscript.su
maximpartnerspr.com marsgatan.com
mearns-tractors.co.uk massage-info.nl
medi-fitt.hu masturbate.co.uk
medizinreisen.de matematikus.info
megaapteka.ru mature.free-websites.com
mega-bony-2017.pl medicineseasybuy.com
mensandals.xyz meendo-free-traffic.ga
menstennisforums.com member-quiz.com
metalonly.info mjchamonix.org
metarip.ru mmoguider.ru
micasainvest.com modnie-futbolki.net
militarysale.pro moncleroutletonline.xyz
minecraft-rus.org moneymaster.ru
miniads.ca moneyzzz.ru
mlf.hordo.win more-letom.ru
monarhs.info mossmesi.com
monclercoats.xyz mostantikor.ru
moskva.nodup.ru moyakuhnia.ru
mrinsidesales.com mrmoneymustache.com
multgo.ru mrvideospornogratis.xxx
muschisexbilder.com muizre.ru
musicvidz.ru
musirc.com musirc.com
muz-tracker.net my-big-family.com
mvpicton.co.uk mydirtystuff.com
mydoctorok.ru
mydownlodablefiles.com
my-floor.in.ua my-floor.in.ua
myshopmatemac.com myonigroup.com
myyour.eu myseoconsultant.com
narutonaruto.ru nacap.ru
nate.com naj-filmy24.pl
naturalbreakthroughsresearch.com nalogovyykodeks.ru
negociosdasha.com narco24.me
neobux-bg.info naturalshair.site
netallergy.ru navalwiki.info
netvouz.com netcheckcdn.xyz
newtechspb.ru
nhl17coinsforps3.gratisblog.biz nhl17coinsforps3.gratisblog.biz
offf.info nicovideo.jp
of-ireland.info nlfjjunb5.ru
okayimage.com noumeda.com
okmusic.jp nowtorrents.com
onlinedomains.ru nudepatch.net
online-hit.info nudo.ca
nuit-artisanale.com
nuker.com
nvssf.com
obnal.org
ochistka-stokov.ru
oda.as
oddamzadarmo.eu
oecnhs.info
offtime.ru
onemactrckr.com
onescreen.cc
online-podarki.com online-podarki.com
onlineslotmaschine.com o-o-6-o-o.ru
onlyporno.ru orgasmus-virtual.com
ons-add.men orsonet.ru
onstrapon.purplesphere.in ovirus.ru
optikremont.ru
outshop.ru
paceform.com
page2rss.com page2rss.com
panamaforbeginners.com palvira.com.ua
par-fallen.ga paphoselectricianandplumber.com
partner-trustworthy.men
pavlodar.xkaz.org pavlodar.xkaz.org
pcboa.se pcads.ru
pcimforum.com pearlisland.ru
pensplan.com penisvergrotendepillennl.ovh
pepperstyle.ru pepperstyle.ru
pflexads.com pestomou.info
physfunc.ru pewit.pw
picsearch.com php-market.ru
picsforkeywordsuggestion.com picphotos.net
picswe.com picturesify.com
piulatte.cz picturesmania.com
playmsn.com piski.top
playtap.us plohaya-kreditnaya-istoriya.ru
pod-muzyku.club pobeiranie.pl
pontiacsolstice.info pogruztehnik.ru
popup-jdh.xyz popcash.net
porn555.com porngalleries.top
porndl.org pornoklad.net
pornodojd.ru potolokelekor.ru
portside.xyz powc.r.ca.d.sendibm2.com
poshiv-chehol.ru pozvonim.com
pp-budpostach.com.ua predmety.in.ua
pravoholding.ru privat-girl.net
pregnant.guru prize44.com
princeadvantagesales.com proekt-mos.ru
profitkode.com propranolol40mg.blogspot.com
pro-poly.ru prosmibank.ru
prostitutki-rostova.org prostitutki-belgoroda.org
pukaporn.com prostitutki-odessa.org
purchasepillsnorx.com pshare.biz
purplestats.com puserving.com
push-ad.com
py100.ru
qor360.com
quality-traffic.com quality-traffic.com
qwertty.net queerspace.com
randalljhoward.com quickbuck.com
ranking2017.ga quit-smoking.ga
qwarckoine.com
ranksays.com ranksays.com
rapidgator-porn.ga real-time-analytics.com
rebrand.ly realting-moscow.ru
refudiatethissarah.info rebuildermedical.com
remmling.de recipedays.com
remont-comp-pomosh.ru recordpage-a.akamaihd.net
respublica-otel.ru reelheroes.net
resultshub-a.akamaihd.net registratciya-v-moskve.ru
rewardpoll.com reyel1985.webnode.fr
reward-survey.net rfserial.net
rocketchange.ru rimedia.org
rollercoin.com rome2rio.com
roznica.com.ua rus-pornuha.com
s1z.ru rvtv.ru
sarf3omlat.com sajatvelemeny.com
savingsslider-a.akamaihd.net sammyweaver.com
sax-sex.com sankt-peterburg.nodup.ru
sbf441.com sbdl.no
scanmarine.info scanner-barak.top
scanner-jane.top sdi-pme.com
scanner-julia.top search.alot.com
scanner-mary.top search-error.com
scoopquest.com searchkut.com
sdsjweb.com search.pch.com
segol.tv seo-2-0.com
semprofile.com seoexperimenty.ru
seocdvig.ru seorankinglinks.com
seofied.com serdcenebolit.com
seo-prof1.xyz servethis.com
seorankinglinks.xyz sexkontakteao.info
service.adtech.fr
servicecenter.co.ua
sexflirtbook.com
sexkontakte-seite.com
sextracker.com
sexyteens.hol.es
sharebutton.to
shinikiev.com.ua
shoesonlinebuy.cn
shoppingjequiti.com.br shoppingjequiti.com.br
sildenafilcitratemed.com shopvilleroyboch.com.ua
similardeals.net silvercash.com
sivs.ru site.ru
skylta.com sk.golden-praga.ru
small-games.biz slowmac.tech
smichovbike.cz smsactivator.ru
social-search.me snegozaderzhatel.ru
soietvousmaime.fr snjack.info
solnplast.ru snworks.com
sonata-arctica.wz.cz social-buttons.com
socialbuttons.xyz
socialseet.ru
socialtrade.biz
soft-program.com
solmarket.by
sonnikforme.ru
soserfis.com
spabali.org
spasswelt.net
specialfinanceoffers.com specialfinanceoffers.com
speeddream.xyz speeddream.xyz
sport7777.net spidtest.org
staynplay.net spitfiremusic.com
steebook.com stefanbakosab.se
stmassage.ru stop-gepatit.te.ua
strangeduckfilms.com stpolice.com
studworks.org streha-metalko.si
superinterstitial.com stretchingabuckblog.com
superstarfloraluk.com susanholtphotography.com
surfbuyermac.com swinger-mobil.net
sweepstakes.rewardit.com symbaloo.com
tackletarts.co symphonyintegratedhealthcare.com
takeflyte.com szucs.ru
tanieaukcje.com.pl tetracsaudi.com
taqplayer.info thedownloadfromwarez.blogspot.com
testingads.pro thin.me.pn
theendivechronicles.com thruport.com
tizanidineandgabapentin.blogspot.com timeallnews.ru
tizanidinehydrochloride2mg.blogspot.com titan-cloud.life
tizanidinepain.blogspot.com titslove.yopoint.in
tizanidineusedfor.blogspot.com tizanidinefibromyalgia.blogspot.com
tjkckpytpnje.com tizanidinehcl4mgtablet.blogspot.com
torrents.cd tizanidineinfo.blogspot.com
torture.ml tizanidinezanaflex.blogspot.com
tradedeals.biz tobeyouday.win
traffic2cash.org tomatis.gospartner.com
trafficmania.com tourcroatia.co.uk
trafficmp.com toxicwap.com
trkdf.com tozup.com
trubywriting.com trainoffend.ml
try-rx.com
tsyndicate.com
tt-ipd.info tt-ipd.info
tuckpointingmasonrysystems.com
tula.howotorg.ru
tupper-posuda.ru
tvnewsclips.info tvnewsclips.info
tvorozhnaja-zapekanka-recept.ru tvteleport.ru
twiclub.in udsgame.online
uchil.net ugguk.online
udayavani.com undergroundcityphoto.com
um-razum.ru underthesite.com
upstore.me univerfiles.com
uptime-alpha.net unrealcommander.biz
uptime.com ustion.ru
usadacha.net vadimkravtcov.ru
vellings.info validccseller.com
venerologiya.com vbikse.com
viberdownload10.com vegan-foods.us
vladhistory.com vegascosmetics.ru
voditeltrezviy.ru videochat.bz
voprosotvet24.ru videochat.tv.br
vremya.eu vip2ch.com
vrotike.ru vipps.com.my
vut.com.ru vltai.com
vvon.co.uk vonradio.com
w3data.co vykup-avto-krasnodar.ru
wait3sec.org vykupavto-krasnodar.ru
wallpapersist.com wallpapersist.com
watchinf.com watsonrealtycorp.com
wdfdocando.com webadvance.club
webalan.ru web.cvut.cz
webextract.profound.net wemedinc.com
webjam.com wheelchairliftsarea.com
webmasterhome.cn wildnatureimages.com
webmasters.stackexchange.com wordpresscore.com
wellcome2slovenia.ru woweb.com.ua
whatzmyip.net wpthemedetector.co.uk
whosonmyserver.com wttavern.com
wingsoffury2.com
winner7777.net
witherrom55.eklablog.fr
womensterritory.ru
wufak.com wufak.com
x-diesel.org ww1943.ru
xjrul.com wzgyyq.com
xmladserver.com xclicks.net
xn-----6kcaabbafhu7cskl7akvongwpo7hvjj.xn--p1ai xcombear.ru
xn--80aebbcbcdemfkhba4byaehoejh8dza3v.xn--p1ai x-diesel.com
xn----dtbndd4ae7eub.top xn--24-glceagatoq7c2a6ioc.xn--p1ai
xtubeporno.net xn--80aodinpgi.xn--p1ai
xxart.ru xn----8sbdbjgb1ap7a9c4czbh.xn--p1acf
yougotanewdomain.com xn--b1ag5cfn.xn--p1ai
yunque.pluto.ro xn----itbkqkfiq.xn--p1ai
zarabotok--doma.ru xpresscare.ru
zeroredirect9.com youbrainboost.asia
zscaler.net youradexchange.com
zahvat.ru
zastroyka.org
zhuravlev.info
zigarettenonlinekaufen.tumblr.com
zocaparj.kz
zog.link
zojirushi-products.ru
zoogdinsney.com
zoomovies.org
zoompegs.com
zvooq.eu zvooq.eu
zzbroya.com.ua
zzlgxh.com

480
.dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
178evakuator178.ru 256bit.by
1adult.com 4istoshop.com
1j7740kd.website 5u.com
24-ak.ru aa9d046aab36af4ff182f097f840430d51.com
4kepics.com abiente.ru
absolute-s.ru absolutelyanalog.com
activepr.ru accessoires-mode.in
agardomains.com acc.eu.org
alert-fdm.xyz addbin.men
alice.it adpremium.org
alot.com ampower.me
amateurmatch.com ananumous.ru
anmysite.com apifasterlightin-a.akamaihd.net
apiqualitinknet-a.akamaihd.net apilinkswiftco-a.akamaihd.net
aramaicmedia.org appearance-cool.com
artparquet.ru atmovs.com
asseenontvonline.ru azazu.ru
avtochehli.by bablonow.ru
babieca.com barbourjackets.online
babyguns.ru
bala.getenjoyment.net
bannerconnect.net
bbsoldes.fr
beauty-bracelet.com
begalka.xyz begalka.xyz
bildsuche.ru beremenyashka.com
bingoporno.com bestserials.com
bio-optomarket.ru best-way.men
blockety.co bestwaystogetpaid.us
brandbucket.com bestwebsiteawards.com
bum.com.ru bg6s0.com
bvlgariring.xyz bio-market.kz
bytimedance.ru birzha-truda.eu
bzero1jewelry.net bjetjt.com
carsdined.org bloggedporn.com
cdn.walkme.com brainzpod.win
changde.58.com brus.city
check-host.net buttons-for-website.com
cicaki.net buyk.host.sk
clickcash.com candypeople.se
club-lukojl.ru canoncdriverq3.pen.io
coinsspb.com cenoval.ru
colehaanoutlet.store cineacademy.ru
compliance-andrew.xyz clicksor.com
compliance-checker-7.info clmforexeu.com
compliance-checker.info compliance-checker.info
compliance-ivan.xyz compliance-irvin.xyz
com-secure.download cookie-law-enforcement-ee.xyz
com-supportcenter.website covetnica.com
comsysnet.com craftinsta.ru
coolgramgoods.com crynet.cc
cpabegins.ru cubs-jerseys.us
customcollegeessays.net customsua.com.ua
cvety24.by cutalltheshit.com
d2jsp.org cwetochki.ru
defenderxtactical.com cyprusbuyproperties.com
dev33.dioniqlabb.se d0t.ru
digilander.libero.it dafatiri.com
dodlive.mil damedingel.ya.ru
downloadmefiranaratb1972.xpg.com.br daretodonate.co
dscaas.website date-withme.com
easyshoppermac.com davidovic.info
econom.co daymusam.com
edge.sharethis.com digitalfaq.com
eduserver.net digital-sale.su
elitedollars.com domaineaneblanc.com
elvel.com.ua droidlook.net
embedle.com earn-from-articles.com
empathica.com e-biznes.info
en.home-task.com edwinkonijn.com.au
es5.com ekn-art.se
event-tracking.com ekspresihati.info
exchangeit.gq elektir.ru
expresstoplivo.ru elvenmachine.com
ezigarettenkaufen1.pagina.gr energydiet24.ru
faracontrol.ir extstat.com
fashion-mk.net f012.de
favorcosmetics.com fantasticpixcool.com
fba-mexico.com farmingworm.com
fellowshipoftheminds.com filefilter.weebly.com
filmidivx.com finejewelryshop.ru
flash4fun.com flashahead.info
flowersbazar.com forex21.ru
foodcrafts.website freelotto.com
forum.doctissimo.fr freza-sverlo.ru
fotzen-ficken.com fusoradio.info
freewlan.info fz139.ttk.ru
freshsuperbloop.com gallery.rennlist.com
fungirlsgames.net gambarkataku.co
fx-brokers-review.com gay-file.com
gfaq.ru geilehausfrauen.net
gigixo.com gettpromos.com
girlsfuckdick.com gg-arena.ru
goroda-vsego-mira.ru gosreg.amchs.ru
greamimgo.pw g.starmoe.xyz
growmyfunds.ca
gyffu.com
habermetre.com habermetre.com
hdseriale.pl highspeed5.net
headpharmacy.com ifmo.ru
hermesbelts.xyz
hetmanship.xyz
histats.com
hiwibyh.bugs3.com
hotloans.ru
import-sales.com
inbabes.sexushost.com inbabes.sexushost.com
infobabki.ru inmate-locator.us
insta-add.pro investmac.com
interior-stickers.ru itag.pw
intim-uslugi.info javitas.info
islamtoday.co.za je7.us
juliadiets.com jose.mulinohouse.co
kaac.ru justprofit.xyz
kaliningrad.zrus.org kamagragelusa.net
kazrent.com kazinogames.lv
keywordteam.net keywordsking.com
laptoper.net kinoduh.ru
lawyersinfo.org kinohit1.ru
lflash.ru legalrc.biz
liffa.ru lignofix.ua
light.ifmo.ru lollypopgaming.com
lincolntheatre.com m0r0zk0-krava.ru
lineshops.biz magento-crew.net
linkbolic.com makemoneyonline.com
lisque.batcave.net makis.nu
lob.com.ru mamasuper.prom.ua
lolnex.us manimpotence.com
lonerangergames.com marcowebonyodziezowe.pl
marketingvici.com matb3aa.com
masthopehomes.com matchpal-a.akamaihd.net
maxthon.com maxthon.com
maxxtor.eu megaindex.ru
mb140.ru mesto-x.com
medizinreisen.de mex-annushka.ru
me-ke.com mexicotravelnet.com
microstatic.pl middlerush-a.akamaihd.net
mindeyegames.com millionare.com
mmog-play.ru mobsfun.net
morlat.altervista.org modenamebel.ru
moskva.nodup.ru monarhs.info
movies-in-theaters.net monclerjacketsoutlet.pw
mulberryoutletonlineeu.com my-aladin.com
nailsimg.com myfreecams.com
net-profits.xyz myperiod.club
normalegal.ru mzdish.site
nyfinance.ml narutonaruto.ru
office-windows.ru neobux-bg.info
oksrv.com nextrent-crimea.ru
online247.ml nfljerseyscheapchinabiz.com
onlyporno.ru ngps1.ru
ooomeru.ru notebook-pro.ru
openmultipleurl.com obnal.org
orion-code-access.net onemantrip.com
osnova3.ru oops-cinema.ru
otbelivanie-zubov.com orel-reshka.net
owohho.com panamaforbeginners.com
ozas.net pc-services.ru
panicatack.com peekyou.com
parvezmia.xyz pendelprognos.se
pewit.pw penisvergrotendepillennl.ovh
platesauto.com perso.wanadoo.es
play-movie.pl pierrehardysale.online
pornoforadult.com piluli.info
porno-raskazy.ru plohaya-kreditnaya-istoriya.ru
porno.simple-image.com.ua porndroids.com
poshiv-chehol.ru porno-play.net
productarium.com pornstartits.xblog.in
promodj.com porodasobak.net
pussysaga.com portadd.men
renecaovillasale.online posible.net
rentalcarnavi.info pravoholding.ru
risparmiocasa.bz.it prchecker.info
rixpix.ru predominant-invent.tk
rock-cafe.info privacyassistant.net
royalvegascasino.com prlog.ru
salutmontreal.com psa48.ru
sardinie.us pukaporn.com
searchaddis.com puzzleweb.ru
sell-fb-group-here.com rapevideosmovies.com
semalt.com rapidsites.pro
semaltmedia.com registry-clean-up.net
senger.atspace.co.uk reimageplus.com
remont-komputerov-notebook.ru
renecaovilla.online
research.ifmo.ru
russia-tao.ru
scanner-brian.top
scanner-jane.top
scanner-viktor.top
scat.porn
sdsjweb.com
searchengineranker.email
searchkut.com
security60-e.com
seoboxes.com seoboxes.com
sexcamamateurchat.com sexreliz.com
sex-dating.co sex-tracker.com
sex-pr.net sexuria.net
sfj-ror.no
shivafurnishings.com shivafurnishings.com
shmetall.com.ua
shopcheermakeup.info shopcheermakeup.info
shoplvlv.us
shopwme.ru shopwme.ru
sirpornogratis.xxx silktide.com
sitopreferito.it skanninge.se
skincrate.net slomm.ru
smadihome.com sockshare.net
small-game.com sotkal.lark.ru
smartpet.ru spb-plitka.ru
snowplanes.com speechfoodie.com
sobecjvuwa.com.ru stard.shop
socialbutton.xyz statistici.ro
sport-video-obzor.ru sugarkun.com
staynplay.net suggest-keywords.com
studiofaca.com svbur.ru
superkanpo.com symphonyintegratedhealthcare.com
talant-factory.ru tagil.zrus.org
tasteidea.com takeprofitsystem.com
tattomedia.com tako3.com
taximytishi.ru taqywu51.soup.io
telefonsexi.com teesdaleflyballclub.co.uk
thebestphotos.eu thebestphotos.eu
thesmartsearch.net thetattoohut.com
thetardistimes.ovh tizanidinehcl2mg.blogspot.com
tizanidineduringpregnancy.blogspot.com tizanidinehcl4mgisitanarcotic.blogspot.com
tizanidineformigraines.blogspot.com torrnada.ru
tizanidinehydrochloride4mgstreetvalue.blogspot.com tour-line.net
tizanidinepills.blogspot.com toxicwap.com
tizanidinewithdrawal.blogspot.com track-rankings.online
tomck.com trubywriting.com
toondinsey.com trustaffs.com
topquality.cf tsan.net
traffic2cash.org uac.net.au
trichizobswiv.agddns.net uchetunet.su
tubeline.biz uhodzalijami.ru
tupper-posuda.ru univerfiles.com
txxx.com unpredictable.ga
ukrup.com urlopener.blogspot.com.au
urlopener.com uytmaster.ru
us-america.ru valueclick.com
usiad.net vashsvet.com
ustion.ru vavilone.com
vesnatehno.ru videochat.cafe
viberdownload10.com videochat.ph
videochaty.ru videospornogratisx.net
vip-dom.in vigrx-original.ru
visionwell.com.cn vkontaktemusic.ru
viven.host.sk vriel.batcave.net
vykupavto-krasnodar.ru wstroika.ru
webadvance.club wufak.com
webjam.com x-mix.info
xn----ctbbcjd3dbsehgi.xn--p1ai xn--d1abj0abs9d.in.ua
xolodremont.ru yousense.info
xsion.net zaapplesales.blogspot.com
xtube.com zarajbuilders.com
xxx-cam.webcam zeg-distribution.com
xxxrus.org znakom.sibtest.ru
yaoguangdj.com znakomstva-moskva77.ru
zigarettenonlinekaufen.tumblr.com zocaparj.kz
znaturaloriginal.com zoogdinsney.com
zoodrawings.com zootravel.com
zoosexart.com zvetki.ru

23
.dev-tools/test_units/ratelimittest-beta.txt
View file

@ -1,12 +1,21 @@
<!DOCTYPE html>
<html> <html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html><html>
<head><title>503 Service Temporarily Unavailable</title></head> <head><title>503 Service Temporarily Unavailable</title></head>
<body> <body>
<center><h1>503 Service Temporarily Unavailable</h1></center> <center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.16.1</center> <hr><center>nginx/1.16.1</center>
</body> </body>
</html> </html>
ody> <html>
</html><html>
<head><title>503 Service Temporarily Unavailable</title></head> <head><title>503 Service Temporarily Unavailable</title></head>
<body> <body>
<center><h1>503 Service Temporarily Unavailable</h1></center> <center><h1>503 Service Temporarily Unavailable</h1></center>
@ -572,14 +581,4 @@ ody>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html> </html>

13
.dev-tools/test_units/ratelimittest-master.txt
View file

@ -1,12 +1,21 @@
<!DOCTYPE html>
<html> <html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html><html>
<head><title>503 Service Temporarily Unavailable</title></head> <head><title>503 Service Temporarily Unavailable</title></head>
<body> <body>
<center><h1>503 Service Temporarily Unavailable</h1></center> <center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.16.1</center> <hr><center>nginx/1.16.1</center>
</body> </body>
</html> </html>
ody> <html>
</html><html>
<head><title>503 Service Temporarily Unavailable</title></head> <head><title>503 Service Temporarily Unavailable</title></head>
<body> <body>
<center><h1>503 Service Temporarily Unavailable</h1></center> <center><h1>503 Service Temporarily Unavailable</h1></center>

2
.dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
34.74.253.255 0; 35.202.245.105 0;
127.0.0.1 0; 127.0.0.1 0;

BIN
.latest_release/bots.d.tar.gz
View file

Binary file not shown.

BIN
.latest_release/conf.d.tar.gz
View file

Binary file not shown.

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2020.03.2029 #### Version: V4.2020.03.2031
#### Bad Referrers Blocked: [6831](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [6831](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [571](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [571](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2020.03.2029 #### Version: V4.2020.03.2031
#### Bad Referrers Blocked: [6831](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [6831](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [571](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [571](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -11,7 +11,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2020.03.2029 #### Version: V4.2020.03.2031
#### Bad Referrers Blocked: [6831](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [6831](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [571](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [571](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

1488
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2020.03.2029 #### Version: V4.2020.03.2031
#### Bad Referrers Blocked: [6831](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [6831](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [571](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [571](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

1492
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

1492
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

1492
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2020.03.2029 ### Version: V4.2020.03.2031
### Updated: Sun Mar 29 22:22:24 SAST 2020 ### Updated: Tue Mar 31 22:24:17 SAST 2020
### Bad Bot Count: 571 ### Bad Bot Count: 571
################################################### ###################################################
### Version Information ## ### Version Information ##