vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-14 09:09:49 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2020.04.2048 [ci skip]

Browse source
This commit is contained in:
Travis 2020-04-16 22:43:45 +02:00
parent b5459cd691
commit 47ffdc3464
51 changed files with 8637 additions and 8635 deletions
Download patch file Download diff file Expand all files Collapse all files

836
.dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
.dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
104.154.113.151 1; 34.73.34.132 1;
127.0.0.1 1; 127.0.0.1 1;

2
.dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
104.154.113.151 0; 34.73.34.132 0;
127.0.0.1 0; 127.0.0.1 0;

836
.dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
.dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
104.154.113.151 1; 34.73.34.132 1;
127.0.0.1 1; 127.0.0.1 1;

2
.dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
104.154.113.151 0; 34.73.34.132 0;
127.0.0.1 0; 127.0.0.1 0;

836
.dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
.dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
104.154.113.151 1; 34.73.34.132 1;
127.0.0.1 1; 127.0.0.1 1;

2
.dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
104.154.113.151 0; 34.73.34.132 0;
127.0.0.1 0; 127.0.0.1 0;

836
.dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

836
.dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

836
.dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
.dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
34.66.178.120 0; 35.231.58.0 0;

836
.dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
.dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
34.68.144.114 1; 34.73.34.132 1;
127.0.0.1 1; 127.0.0.1 1;

2
.dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
34.68.144.114 0; 34.73.34.132 0;
127.0.0.1 0; 127.0.0.1 0;

836
.dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
.dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
34.68.144.114 1; 34.73.34.132 1;
127.0.0.1 1; 127.0.0.1 1;

2
.dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
34.68.144.114 0; 34.73.34.132 0;
127.0.0.1 0; 127.0.0.1 0;

836
.dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
.dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
34.68.144.114 1; 34.73.34.132 1;
127.0.0.1 1; 127.0.0.1 1;

2
.dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
34.68.144.114 0; 34.73.34.132 0;
127.0.0.1 0; 127.0.0.1 0;

836
.dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

4
.dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,5 +45,5 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
35.188.73.34 0; 34.73.34.132 0;
34.66.178.120 0; 35.231.58.0 0;

836
.dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

4
.dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,5 +45,5 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
104.198.131.58 0; 35.196.82.30 0;
35.188.73.34 0; 34.73.34.132 0;

836
.dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

4
.dev-tools/test4_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,5 +45,5 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
35.192.136.167 0; 35.196.82.30 0;
104.154.113.151 0; 34.73.34.132 0;

836
.dev-tools/test4_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

4
.dev-tools/test5_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,5 +45,5 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
104.154.113.151 0; 34.73.34.132 0;
34.66.178.120 0; 35.231.58.0 0;

836
.dev-tools/test5_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
.dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
104.154.113.151 1; 34.73.34.132 1;
127.0.0.1 1; 127.0.0.1 1;

20
.dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
Discobot Calculon
Fimap Chlooe
LeechFTP ips-agent
mediawords Msrabot
Mister PiX muhstik-scan
MJ12bot Netvibes
PeoplePal NPbot
Steeler OpenVAS
Trendictionbot OPPO A33
WeSEE Snapbot

278
.dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
360Spider 360Spider
80legs 404checker
Abonti
Aboundex Aboundex
Aboundexbot Aboundexbot
ADmantX Acunetix
AfD-Verbotsverfahren
AhrefsBot AhrefsBot
Aipbot
Alexibot Alexibot
AllSubmitter AllSubmitter
Anarchie Ankit
Apexoo
archive.org_bot archive.org_bot
arquivo-web-crawler
ASPSeek
Asterias
Attach Attach
Backlink-Ceck AwarioSmartBot
BacklinkCrawler BackDoorBot
backlink-check
BackStreet BackStreet
Bandit Badass
BatchFTP
BBBike BBBike
BDFetch
Bigfoot Bigfoot
Bitacle Bitacle
Blackboard
Black Hole
Blow Blow
BotALot Bolt
BunnySlippers Brandwatch
Bullseye
BuzzSumo BuzzSumo
CATExplorador CATExplorador
CCBot CazoodleBot
CheeseBot Cegbfeieh
CherryPicker CherryPicker
Chlooe Chlooe
Claritybot Claritybot
Cliqzbot Cliqzbot
Copier Cogentbot
crawl.sogou.com com.plumanalytics
Copyscape
crawler4j
crawler.feedback
Crescent
CrunchBot CrunchBot
CSHttp
Curious Curious
DataCha0s
DBLBot DBLBot
demandbase-bot
Demon
Devil Devil
Digincore Digincore
DigitalPebble DigitalPebble
DIIbot
Discobot Discobot
DittoSpyder Discoverybot
DnyzBot Dispatch
DomainStatsBot DomainCrawler
DomainSigmaCrawler
Dotbot Dotbot
Download Wonder
Dragonfly Dragonfly
DSearch DSearch
DTS Agent DTS Agent
eCatch eCatch
ECCP/1.0 EroCrawler
EirGrabber
evc-batch
Evil Evil
ExtLinksBot ExtractorPro
Extractor Extreme Picture Finder
EyeNetIE EyeNetIE
Ezooms Ezooms
FemtosearchBot FDM
FHscan FHscan
Fimap
FlashGet
Foobot
Fyrebot Fyrebot
GalaxyBot
Genieo Genieo
Gigablast GermCrawler
Getintent
G-i-g-a-b-o-t G-i-g-a-b-o-t
Go-Ahead-Got-It Gotit
GrabNet Go!Zilla
GrapeshotCrawler
GridBot
GT::WWW GT::WWW
HaosouSpider HaosouSpider
Harvest Harvest
heritrix
Heritrix Heritrix
HMView
HTTrack HTTrack
Humanlinks Id-search
HybridBot
IlseBot IlseBot
Image Sucker Image Sucker
IndeedBot IndeedBot
Indy Library InfoTekies
instabid
Internet Ninja
internetVista monitor internetVista monitor
ips-agent
Iria Iria
IRLbot IRLbot
JennyBot Iskanie
JamesBOT
JetCar
Jetty Jetty
JikeSpider JOC Web Spider
Joomla Joomla
Jorgee
JustView JustView
Jyxobot Kozmosbot
Lanshanbot
LeechGet LeechGet
LexiBot Libwhisker
LieBaoFast Lightspeedsystems
Likse Likse
Linkdexbot LinqiaScrapeBot
LinkextractorPro
LinqiaRSSBot
Lipperhey
Lipperhey Spider Lipperhey Spider
LWP::Simple lwp-trivial
Mag-Net
magpie-crawler
Mail.RU_Bot Mail.RU_Bot
Majestic12
Majestic SEO
Majestic-SEO Majestic-SEO
MarkMonitor MarkMonitor
MarkWatch MarkWatch
MauiBot Masscan
Mb2345Browser Mass Downloader
Meanpathbot
MeanPath Bot MeanPath Bot
Mediatoolkitbot Mediatoolkitbot
mediawords MegaIndex.ru
Metauri MFC_Tear_Sample
Microsoft URL Control MicroMessenger
MIDown tool Mister PiX
MJ12bot
Mojeek Mojeek
Morfeus Fucking Scanner Mojolicious
MSIECrawler Mr.4x3
MSFrontPage
muhstik-scan
Musobot
Name Intelligence
Nameprotect Nameprotect
NearSite Navroad
Needle Needle
NetZIP NetLyzer
NextGenSearchBot Net Vampire
Nibbler NICErsPRO
Niki-bot
Nikto
NimbleCrawler NimbleCrawler
Nmap Nutch
NPbot
oBot
Octopus
OnCrawl
OpenLinkProfiler OpenLinkProfiler
Openvas
OpenVAS OpenVAS
OrangeBot
OrangeSpider OrangeSpider
OutfoxBot
PageAnalyzer PageAnalyzer
Page Analyzer
page scorer
PageScorer
Pandalytics Pandalytics
Papa Foto
Pavuk Pavuk
Picscout pcBrowser
PeoplePal
PHPCrawl
Picsearch
PictureFinder
Pi-Monster Pi-Monster
Pixray PleaseCrawl
plumanalytics
Pockey
Probethenet Probethenet
ProPowerBot
Psbot Psbot
Pump Quick-Crawler
RankFlex
RankingBot RankingBot
Rankivabot RankingBot2
RealDownload RealDownload
RebelMouse RedesScrapy
Recorder ReGet
RepoMonkey
RocketCrawler
Rogerbot Rogerbot
RSSingBot
SalesIntelligent SalesIntelligent
SBIder ScanAlert
Scanbot
scan.lol
ScoutJet ScoutJet
Scrapy Screaming
ScreenerBot SearchmetricsBot
Searchestate
Semrush
SemrushBot SemrushBot
SEOkicks-Robot SEOkicks-Robot
SEOlyticsCrawler SEOlyticsCrawler
Seomoz
seoscanners
SeoSiteCheckup SeoSiteCheckup
serpstatbot
sexsearcher sexsearcher
Siphon SISTRIX
SiteExplorer
Siteimprove Siteimprove
SiteSnagger
SiteSucker
Site Sucker Site Sucker
SlySearch SMTBot
SmartDownload
Snake
Snapbot Snapbot
Snoopy
sogouspider sogouspider
Sogou web spider
Sottopop
SpaceBison SpaceBison
Spammen
SpankBot
Spanner
sp_auditbot sp_auditbot
spyfu Spbot
SputnikBot
Sqlmap Sqlmap
Sqlworm Sqlworm
Sqworm
Steeler
Stripper
Sucker Sucker
SuperBot SuperBot
SuperHTTP Surfbot
T0PHackTeam SurveyBot
T8Abot Swiftbot
tAkeOut sysscan
Teleport Szukacz
Telesphorep TeleportPro
The Intraformant Telesoft
Thumbor
TightTwatBot
Titan Titan
Toweyabot
Tracemyfile
Trendiction Trendiction
Trendictionbot UnisterBot
trendiction.de Upflow
Turnitin URLy.Warning
TurnitinBot Vacuum
Vagabondo Vagabondo
Virusdie Wallpapers/3.0
VoidEYE WASALive-Bot
Voil WebAuto
Voltron Web Auto
WBSearchBot WEBDAV
Webalta
WebCollage
WebEnhancer
WebFetch
Web Fetch
WebGo IS WebGo IS
WebLeacher
WebmasterWorldForumBot WebmasterWorldForumBot
WebPix webmeup-crawler
WebReaper WebReaper
WebSauger
Web Sauger Web Sauger
Webshag
WebsiteExtractor WebsiteExtractor
WeSEE Webster
WebStripper
WebSucker
Web Sucker
WebWhacker
Whack
Whacker Whacker
Whatweb Whatweb
WinHTTrack Wonderbot
Woobot Woobot
WWW-Collector-E
WWW-Mechanize
WWWOFFLE WWWOFFLE
x22Mozilla
Xaldon WebSpider Xaldon WebSpider
xpymep1.exe Xaldon_WebSpider
Zauba
zauba.io zauba.io
Zermelo Zermelo
Zeus Zeus
zgrab
Zitebot
ZumBot
ZyBorg ZyBorg

276
.dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
360Spider 360Spider
404checker
80legs 80legs
Abonti Acunetix
Aboundex
Aboundexbot
ADmantX ADmantX
AhrefsBot AhrefsBot
AIBOT AIBOT
AiHitBot
Aipbot Aipbot
Alexibot Alexibot
Alligator Alligator
Anarchie Anarchie
Ankit
archive.org_bot archive.org_bot
arquivo.pt arquivo.pt
arquivo-web-crawler
Aspiegel Aspiegel
ASPSeek Attach
Asterias AwarioSmartBot
autoemailspider
AwarioRssBot
Backlink-Ceck Backlink-Ceck
backlink-check BacklinkCrawler
BackStreet
BackWeb
Badass Badass
Bandit BBBike
BatchFTP
BDCbot BDCbot
BDFetch BDFetch
Black Hole BetaBot
Bitacle
BLEXBot
Blow Blow
BlowFish
Boardreader
Bolt Bolt
Brandwatch BotALot
Bullseye Brandprotect
BunnySlippers Buddy
BuzzSumo BuzzSumo
CATExplorador Calculon
CazoodleBot CCBot
CherryPicker CheeseBot
CheTeam CheTeam
Chlooe ChinaClaw
Cloud mapping coccocbot-web
Craftbot Craftbot
crawl.sogou.com crawl.sogou.com
Crescent Crescent
CrunchBot CrunchBot
CSHttp
Curious Curious
Custo Custo
DBLBot
demandbase-bot demandbase-bot
Demon Demon
Disco Deusu
Discobot Digincore
DIIbot
Dirbuster
Dispatch Dispatch
DnyzBot
DomainAppender DomainAppender
DomainCrawler DomainCrawler
DomainSigmaCrawler
DomainStatsBot DomainStatsBot
Dotbot Dotbot
Drip Drip
DTS Agent DSearch
eCatch eCatch
ECCP/1.0 EMail Siphon
Ecxi EroCrawler
EMail Wolf
Evil
Exabot Exabot
Express WebPictures
ExtLinksBot ExtLinksBot
Extractor ExtractorPro
Extreme Picture Finder
Ezooms Ezooms
FemtosearchBot facebookscraper
FHscan FDM
Firefox/7.0 Fimap
FlashGet
Freeuploader Freeuploader
FrontPage FyberSpider
GalaxyBot Gigablast
Genieo G-i-g-a-b-o-t
GermCrawler
GetWeb
Gigabot
Gotit Gotit
Go!Zilla GoZilla
Grabber
GrabNet GrabNet
Grafula
GrapeshotCrawler
GridBot
GT::WWW GT::WWW
Haansoft Harvest
Havij
HEADMasterSEO HEADMasterSEO
heritrix
Hloader Hloader
HTMLparser HTMLparser
HTTP::Lite Humanlinks
HybridBot
Iblog Iblog
IDBot Id-search
IlseBot Image Fetch
IndeedBot Image Sucker
InfoNaviRobot
InfoTekies
InternetSeer
internetVista monitor
IstellaBot IstellaBot
JamesBOT JamesBOT
Jbrofuzz Jbrofuzz
JennyBot
JetCar
Jetty Jetty
JOC Web Spider JOC Web Spider
Joomla Kenjin Spider
Jorgee Keyword Density
JustView
Kinza Kinza
Lanshanbot Lanshanbot
Larbin
LeechFTP
LeechGet
Lftp Lftp
LibWeb LieBaoFast
Libwhisker
Lightspeedsystems
Likse Likse
Linkdexbot Linkdexbot
LinkpadBot LinkScan
LinksManager
LinqiaMetadataDownloaderBot LinqiaMetadataDownloaderBot
LinqiaRSSBot LinqiaRSSBot
LinqiaScrapeBot LinqiaScrapeBot
Lipperhey
Litemage_walker
LWP::Simple
lwp-trivial lwp-trivial
Majestic12 Mail.RU_Bot
Majestic-SEO Majestic-SEO
MarkMonitor
Mata Hari
MauiBot MauiBot
Mb2345Browser
meanpathbot meanpathbot
Meanpathbot Meanpathbot
mediawords MFC_Tear_Sample
MegaIndex.ru MicroMessenger
Metauri Microsoft URL Control
Microsoft Data Access
MJ12bot
Mojeek
Morfeus Fucking Scanner Morfeus Fucking Scanner
MSIECrawler MSFrontPage
Msrabot Msrabot
Musobot Needle
NetSpider Netcraft
Nettrack NetZIP
Netvibes
NextGenSearchBot
Nibbler
Niki-bot Niki-bot
Nikto
NimbleCrawler NimbleCrawler
Octopus Ninja
Nutch
oBot
Offline Explorer Offline Explorer
Offline Navigator
OnCrawl
Openvas Openvas
OpenVAS OpenVAS
OPPO A33 OPPO A33
OrangeSpider OrangeSpider
OutfoxBot OutclicksBot
PageAnalyzer
Page Analyzer
PageGrabber PageGrabber
Pandalytics
Panscient Panscient
Papa Foto
pcBrowser pcBrowser
PECL::HTTP PHPCrawl
PeoplePal Picscout
Picsearch plumanalytics
Pimonster ProWebWalker
PleaseCrawl Psbot
Pockey PxBroker
Pump PyCurl
QueryN Metasearch QueryN Metasearch
Quick-Crawler
RankActive RankActive
RankActiveLinkBot RankFlex
RankingBot2 RankingBot
RankurBot RankurBot
RealDownload RealDownload
Reaper RedesScrapy
ReGet
Ripper
Rogerbot
RSSingBot
SalesIntelligent SalesIntelligent
SBIder SBIder
ScanAlert
Scanbot Scanbot
Scrapy ScoutJet
Searchestate
SearchmetricsBot SearchmetricsBot
SEOkicks SEOprofiler
SEOkicks-Robot SeoSiteCheckup
seoscanners SEOstats
serpstatbot
sexsearcher sexsearcher
Siphon Shodan
SISTRIX SISTRIX
Siteimprove
SiteSnagger SiteSnagger
SlySearch SiteSucker
SmartDownload Sitevigil
SocialRankIOBot SocialRankIOBot
Sociscraper Sociscraper
SpankBot Sogou web spider
Spanner Sosospider
Spbot
Spinn3r Spinn3r
spyfu SputnikBot
Sqlmap Sqlmap
Sqlworm
Sqworm Sqworm
Steeler Sucuri
Stripper
Surfbot Surfbot
SurveyBot Swiftbot
Suzuran
sysscan sysscan
tAkeOut Szukacz
TeleportPro T0PHackTeam
Telesoft TheNomad
Telesphoreo
Telesphorep
Thumbor Thumbor
TightTwatBot
Titan
Tracemyfile
Trendiction
trendiction.com
trendiction.de trendiction.de
Turnitin Turnitin
TurnitinBot Typhoeus
TwengaBot UnisterBot
URLy Warning URLy Warning
VB Project Vacuum
VidibleScraper VidibleScraper
Virusdie
VoidEYE
Voil Voil
Voltron WASALive-Bot
Wallpapers/3.0
WBSearchBot
Webalta
WebAuto
WebCollage
Web Collage
WebEnhancer
Web Enhancer Web Enhancer
WebFetch WebFetch
Web Fetch
WebFuck WebFuck
WebImageCollector Web Fuck
WebLeacher WebLeacher
WebmasterWorldForumBot WebmasterWorldForumBot
webmeup-crawler webmeup-crawler
WebReaper WebPix
Web Sauger Web Pix
Webshag Webshag
WebsiteQuester WebSucker
WebStripper
Web Sucker
WebWhacker WebWhacker
WebZIP Whacker
Who.is Bot WiseGuys Robot
WinHTTrack Wprecon
Woobot
WPScan
WWW-Collector-E WWW-Collector-E
WWWOFFLE
x22Mozilla x22Mozilla
Xaldon WebSpider
xpymep1.exe
Zade
Zauba Zauba
zgrab Zermelo
Zitebot
ZumBot ZumBot
ZyBorg

20
.dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
elvenar.com adpremium.org
gogps.me alot.com
j-times.ru darodar.com
kamagragelusa.net davebestdeals.com
karting196.ru eugenevaultstorage.com
nordvpn.com gaz-voshod.ru
onemactrckr.com liveinternet.ro
purplesphere.in metarip.ru
sky-mine.ru sandhillsonline.com
tnaionline.org via-energy-cumpara.com

932
.dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
01apple.com 0n-line.tv
14b.info 123kuma.com
1adult.com 1bet.com
1hwy.com 1xbet4you.com
1kinobig.ru 2728fb936f0.com
3dracergames.com 2drittel.de
3-letter-domains.net 2itech.ru
40cg.com 2pxg8bcf.top
4inn.ru 300richmond.co.nz
4webmasters.org 4replicawatch.net
66cpwgln.space
7a2rnuey1tw9ar.ru
7xc4n.com 7xc4n.com
883zy.com 7yue.org
91abcw.com aa8780bb28a1de4eb5bff33c28a218a930.com
9med.net aa9d046aab36af4ff182f097f840430d51.com
aa81bf391151884adfa3dd677e41f94be1.com aasoldes.fr
aac52006ec82a24e08b665f4db2b5013f7.com absolutelyanalog.com
academia-nsk.org actulite.com
accessoires-mode.in adexprts.com
adclickthru.net adtiger.tk
adsref.men adultgalls.com
advokateg.ru advocatemsk.ru
albamargroup.com adzerg.com
allblogroll.com afftrack001.com
alldezservice.kz aimayangzhi.com
alldownload.pw akuhni.by
allforminecraft.ru alevinefesleri.com
allsilver925.co.il alf-img.com
allwidewallpapers.com alive-ua.com
allesohnegirls.net
allfinweb.com
all-number.com
alloysteel.ru
all-streaming-media.com
alphaforum.ru
alt-servis.ru
ameblo.jp
amoi.tn amoi.tn
anal-acrobats.hol.es anal-acrobats.com
anatomiy.com an-donut.com
animal36.com andpolice.com
animal-drawings.com apiadanaknet-a.akamaihd.net
animalrank.com apioasisspacenet-a.akamaihd.net
anonymizeme.pro apishops.ru
apibetweenlinesn-a.akamaihd.net apparel-offer.com
apidiamondatanet-a.akamaihd.net appsecurityr.com
applyneedy.xyz arabseyes.com
architecturebest.com
arclk.net arclk.net
ardimobileinfo.ml ascat.porn
arendas.net ausergrubhof.info
artel116.ru autolombard-krasnodar.ru
asia-forum.ru autoseo-traffic.com
atmagroup.ru autovideobroadcast.com
autodo.info availit.weebly.com
awency.com aviav.eu
azartclub.org avkzarabotok.info
backgroundpictures.net avtolombard-krasnodar.ru
avtovolop.ru
azinoofficial777.ru
babyguns.ru
backlink4u.net backlink4u.net
baersaratov.ru banan.tv
banki76.ru beauty-bracelet.com
bannerads.de best-coupon-offer.com
barbourjackets.online bestempresas.es
bcmp.org bestofpicture.com
bdsmgalls.net bestssaker.com
beachfix.co binomo.com
begalka.xyz bio-japan.net
beget.tech bioscorp.ru
bestcoin.cc bitcoinremote.com
bestdooz.com bloggers.nl
bestofupload.info blogsfunky672.weebly.com
bestwebsitesawards.com bmsco.co
bigcareer.info bodybuilding-shop.biz
bigcities.org bonky.biz
bio-market.kz boom-celebs.com
bio.trade-jp.net
bizfly.info
bloggedporn.com
bloglag.com
boeuklad.com
bookmark4you.com
bpro1.top bpro1.top
braip.com.br brateg.xyz
brandedleadgeneration.com brianhenry.co
brk-rti.ru bristolhotel.com
btc4u.ru browserprotecter.com
buron.pw brus-vsem.ru
bus-offer.com bupropion-sr-150-mg.us
buy-cheap-online.info burkesales.com
buy-forum.ru business-suggested.tk
bvlgaribracelet.xyz buydissertation.net
cablecar.us buypanicdisorderpill.com
cakemediahq.com.au buytizanidineonline.blogspot.com
callstevens.com canrioloadm.gq
camdolls.com carfax.com.ua
candlewooddentalcentre.com.au carina-sy.de
carapics.com cartierlovebraceletreplica.xyz
cardsdumps.com cartierloveringreplica.xyz
carsplate.com cartierreplica.top
cartierbracelet.xyz cctva.tv
casinos4dummies.co.uk cete.ru
cenokos.ru chatroulette.life
cerev.info chatroulette.world
chatroulette.si cheapbarbour.online
cheapbelstaff.online cheapmoncler.pw
check-host.net cialischstgerts.com
checktext.org clickso.com
chidporn.com codq.info
chinaelitecheapjerseys.com coinsspb.com
chocolateslim-en-france.com com-cleaner.systems
chorus.terakeet.com compliance-alex.top
cindymatches.com compliance-donald.xyz
citysecurity.nu compliance-irvin.xyz
clash-clans.ru compliance-nelson.top
clickzzs.nl
clknsee.com
compliance-don.top
compliance-jack.top
compliance-john.top
compliance-margo.top
com-secure.download com-secure.download
conboy.us connectingsingles.com
conocer-sanabria.com copypaste.traderzplanet.in
contentlook.co covetnica.com
contentsexpress.com cpajunkies.com
counciltally.com cscwtalkto.site
creatives.adbetclickin.pink cs-passion.pl
crirussian.ru custodieva.ru
cyprusbuyproperties.com customsua.com.ua
dairyindia.in dailyrank.net
dandiyabeats.in dame-ns.kz
date-withme.com daneshetabiat.com
davebestdeals.com danschawbel.com
dayibiao.com delfin-aqua.com.ua
daymusam.com delitime.info
db.speedup.gdn deniven.1bb.ru
dellalimov.com dentalpearls.com.au
detalizaciya-tut.biz design-ideas.info
deutschland123.de directivepub.com
dichvuvesinhhanoi.com div.as
dikx.gdn divku.ru
dimkino.ru dnsrsearch.com
diusyawiga.tk dominateforex.ml
dostavimvdom.ru dostavka-v-ukrainu.ru
druzhininevgeniy63.blogspot.com drillsaw.ru
dyshagi.ru drivotracker.com
eachdayisagift.review dscaas.website
eaplay.ru earthmagic.info
ec-file.info e-avon.ru
ecommerce-seo.com econom.co
ednorxmed.com ekspertmed.com
eduinfosite.com elektroniksigaraankara.info
efnor-ac.com elektronischezigarettekaufen2.tumblr.com
ege-russian.ru elektrozigarette2.wordpressy.pl
ekto.ee elidelcream.weebly.com
electricwheelchairsarea.com empirepoker.com
electrik-avenue.com en.altezza.travel
elektronischezigarette2.mex.tl englate.com
elektrozigarettekaufen2.blogse.nl en.home-task.com
elite-sex-finders.com ereko.ru
elvenar.com eshop.md
enternet.ee evogarage.com
enthuse.computernetworksonline.com extremez.net
eshop4u.jp ezigarettekaufen2.blox.pl
espaceinventoristes.com ezigarettenshop2.postbit.com
essayservicewriting.org f012.de
euromasterclass.ru falopicm.pw
executehosting.com faracontrol.ir
extads.net fashion-mk.net
eyes-on-you.ga
eyessurgery.ru
f07.de
f5mtrack.com
fastcrawl.com
fatfasts-4tmz.com fatfasts-4tmz.com
fearcrow.com favoritemoney.ru
fellowshipoftheminds.com feargames.ru
fetroshok.ru fermersovet.ru
fickkontakte.org fickkontaktehobbyhuren.com
fillmewithhappiness.com fickluder69.com
findacheaplawyers.com filmidivx.com
finuse.com financehint.eu
flipper.top findthe.pet
formularz-konkurs.tk firesub.pl
fitnesspiks.com
flashahead.info
forex-indextop20.ru
fortwosmartcar.pw
forumprofi.de
forums.d2jsp.org
foxydeal.com
franch.info
franklinfire.co
frcls.fr frcls.fr
freemaintenancesysforpcandmac.top freecamdollars.com
froggytube.com free-video-tool.com
freshdz.com
frivgame250.com
fsalas.com fsalas.com
fun2cell.net funponsel.com
fun-mobi.pl fz139.ttk.ru
gagrasector.ru gallery.rennlist.com
gambarkataku.co gemara.com
gaytube.com genericviagrasildenafiled.net
gdebestkupit.ru genetworx.com
getmiro.com getdot.ru
gilsonchiro.xyz ghostvisitor.com
gk170.ru
global-ics.co.za global-ics.co.za
go2album.com gomusix.com
goodwinmetals.co googlemare.com
googlepositions.com gotomontenegro.net
googleseo.com.tr gotwebsite1.com
gwagka.com grizzlysgrill.com
gwebtools.com.br grupografico-pilar.com.ar
hamilton.ca gsmtlf.ru
guardlink.org
guge.io
guigyverpo.cf
hamptonoaks.ca hamptonoaks.ca
helpmymacfaster.trade handicapvansarea.com
hitsbox.info handsandlegs.ru
hiwibyh.bugs3.com hd-filmy.net
homeinns.com hdfreeporno.net
hothot.ru hdwallpapers-free.com
hscsscotland.com heatpower.ru
hut1.ru heroz.fr
hybrid.ru hmywwogw.bloger.index.hr
i4track.net hoporno.com
idc.com.ua hotloans.ru
idealtits.net ideashome.id
imagine-ex.co ilbe.club
i-midias.net.br imagefinder.site
indiakino.net imperia31.ru
interferencer.ru intellekt21.ru
investingclub.ru internet-apteka.ru
invest-pamm.ru investsuccess.org
iqbazar.ru investyb.com
isitpaleo.info iplusbit.blogspot.co.za
itch.io irkutsk.online-podarki.com
jacago.com irunfar.com
jackpotchances.com jagg.info
japan-bearings.ru javitas.info
javspace.net javxxx18.com
jeremyeaton.co jewelryandfiligree.com
jovencitas.gratis jmat.cn
karpun-iris.ru juliaworld.net
keywordhut.com kerch.site
kinopolet.net kmd-pto.ru
kinostorm.net konkursowo-24.pl
kladrus.ru konturkrasoty.ru
klikbonus.com
konoplisemena.com
kostenlos-sexvideos.com
kraljeva-sutjeska.com kraljeva-sutjeska.com
krasivoe-hd.net kupiproday.com.ua
krynica.info kupit-adenu.ru
kutikomi.net kuzinsp.ru
kw21.org kwzf.net
lafriore.ru lawyersinfo.org
larchik.net lider-zhaluzi.kiev.ua
larose.jb2c.me lifeinsurancekb.com
law-check-two.xyz light.ifmo.ru
lennatin.info likesdesign.com
lflash.ru littleberry.ru
lifebyleese.com longadventure.com
linerdrilling.com love-baby.cz
linkpulse.com m0r0zk0-krava.ru
linksharingt.com mailemedicinals.com
lion.playtap.us mamasuper.prom.ua
lirunet.ru markjaybeefractal.com
littlecity.ch maslenka.kz
lockerz.com
lostaruban.com
lowephotos.info
luciddiagnostics.in
mabdoola.blogspot.com
machicon-akihabara.info
macotool.com
mafa-free.com
magicalfind-a.akamaihd.net
magnetic-bracelets.ru
marblestyle.ru
martlinker.com
marwer.info
massage-info.nl massage-info.nl
maxxtor.eu masthopehomes.com
meddesk.ru mbiologi.ru
medicineseasybuy.com mebel-vstroika.ru
medmajor.ru meccadumps.net
mega-bony2017.pl medosmotr-ufa.ru
mere.host.sk meget.co.za
merryhouse.co.uk meltwater.com
mexicotravelnet.com militarysale.pro
michaelkorssaleoutletonline.net
minet.club
minharevisao.com minharevisao.com
minneapoliscopiers.com mister-shop.com
missclub.info moesen-ficken.com
mmgq.ru moi-glazki.ru
mnogabukaff.net
moivestiy.biz
mole.pluto.ro mole.pluto.ro
moncleroutletonline.xyz monclerjacketsoutlet.pw
more-letom.ru money-every-day.com
moscow.xrus.org moneyteam24.com
moviezbonkerssk.cf monthlywinners.com
mp3ringtone.info mototsikl.org
mrcsa.com.au mrinsidesales.com
mylida.org mriyadh.com
mymercy.info msfsaar.de
mysexpics.ru muschisexbilder.com
narkologiya-peterburg.ru musezone.su
netanalytics.xyz myghillie.info
net-radar.com myhealthcare.com
networkcheck.xyz mymobilemoneypages.com
newsperuse.com najaden.no
nalogovyykodeks.ru
naphukete.ru
needtosellmyhousefast.com
nero-us.com
netoil.no
nextconseil.com nextconseil.com
nfvsz.com nhl17coins.exblog.jp
nightvision746.weebly.com noclegonline.info
nikkiewart.ru no-fuel.org
noscrapleftbehind.co november-lax.com
nosecret.com.ua nrjmobile.fr
nucia.biz.ly nuker.com
nuup.info offtime.ru
oconto.ru okel.co
odoratus.net okmusic.jp
office2web.com olympescort.com
officedocuments.net onemactrckr.com
onlineporno.site online7777.com
onload.pw online-hd.pl
onthemarch.co onlywoman.org
optitrade24.com ownshop.win
orion-code-access.net partner-print.men
owohho.com
palocco.it
panouri-solare-acoperis.com
partner-trustworthy.men partner-trustworthy.men
pathwhelp.org pdns.download
pb-dv.ru phormchina.com
pc4download.co physfunc.ru
pechikamini.ru picswe.com
pewit.pw pictures-and-images.net
pictures-and-images.com pivka.xyz
pills24h.com pixshark.com
piratecams.com
pistonclasico.com
pizdeishn.com
pk-services.ru pk-services.ru
platezhka.net play.leadzupc.com
pliks.pl pochtovyi-index.ru
plohaya-kreditnaya-istoriya.ru polcin.de
pochemychka.net
pokemongooo.ml
polybuild.ru polybuild.ru
popcash.net popunder.net
pornodojd.ru porndl.org
pornokorol.com porno.simple-image.com.ua
pornonik.com portal-eu.ru
pornoreino.com portside.xyz
portnoff.od.ua potolokelekor.ru
printdirectforless.com pregnant.guru
priscilarodrigues.com.br presleycollectibles.com
prizestohandle.club
produkto.net produkto.net
proekt-gaz.ru proekt-mos.ru
prohoster.info prohoster.info
prom23.ru promoheads.com
prombudpostach.com.ua proposal-engine.com
pronekut.com prostitutki-tyumeni.org
pron.pro pro-tec.kz
proxyradar.com pts163.ru
quit-smoking.ga pukaporn.com
rainbowice.ru puzzleweb.ru
raisedseo.com q-moto.ru
randki-sex.com queerspace.com
radiodigital.co
rank-checker.online
rapidsites.pro
rarbg.to
razleton.com razleton.com
realizmobi.com
realtytimes.com
r-e-f-e-r-e-r.com r-e-f-e-r-e-r.com
regionshop.biz reklama1.ru
registrysweeper.com remontgruzovik.ru
remmling.de remont-komputerov-notebook.ru
remont-comp-pomosh.ru rentaremotecomputer.com
robertefuller.com research.ifmo.ru
ruspdd.com resultshub-a.akamaihd.net
russintv.fr rockprogblog.com
rus-teh.narod.ru rogervivierforsale.com
saletool.ru royalads.net
samoiedo.it royalcar-ufa.ru
sanatorrii.ru royalvegascasino.com
sanidumps.com ruf777.com
sbetodiodnye-lampy.ru ruscoininvest.company
scanner-elena.top ruscopybook.com
scanner-julia.top sabaapress.com
scansafe.net sa-live.com
scrapy.org sammyweaver.com
sc-specialhost.com sape.top
searchimpression.com savingsslider-a.akamaihd.net
searchinterneat-a.akamaihd.net scanner-don.top
seinterface.com scanner-irvin.top
seksotur.ru scanner-jess.top
seoanalyses.com school-diplomat.ru
sdelai-prosto.ru
searchinquire.com
search.xtconnect.com
seasonvar.ru
secretscook.ru
semprofile.com
seonetwizard.com seonetwizard.com
seoprofiler.com service.adtech.us
serdcenebolit.com servingnotice.com
sexcamamateurchat.com sexkontakte-seite.com
sex-watch.com sexpornotales.com
sexy-screen-savers.com sextracker.com
shakhtar-doneck.ru sexxdate.net
sharebutton.net sexytrend.ru
sharebutton.org
shemale-sex.net
shillyourcoins.com
shinikiev.com.ua shinikiev.com.ua
shoppytoolmac.com shoppingjequiti.com.br
shymkent.xkaz.org similardeals.net
silktide.com sindragosa.comxa.com
s-iwantyou.com siteripz.net
sklad-24.ru sklad-24.ru
slutloadlive.com skytraf.xyz
snegozaderzhatel.ru sladkoevideo.com
snjatie-geroinovoy-lomki.ru
snyatie-lomki-v-stacionare.ru
soc-econom-problems.ru soc-econom-problems.ru
socialbuttons.xyz sodexo.com
socialtrade.biz space4update.pw
social-vestnik.ru sportbetfair.com
soft-program.com sstroy44.ru
songplanet.ru stackthatbucks.com
sotkal.lark.ru stal-rulon.ru
souvenir.cc star61.de
specialfinanceoffers.com stariy-baku.com
spravka-medosmotr.ru stefanbakosab.se
standardchartered-forex.com stevemonsen.com
strangeduckfilms.com sticken.co
stroydetali.ru strongholdsb.ru
studiofaca.com strongsignal-a.akamaihd.net
success-seo.com sugarlyflex.pw
superinterstitial.com suhanpacktech.com
supermama.top superlist.biz
superstats.com surffoundation.nl
svetlotorg.ru survival.betteroffers.review
svetodiodoff.ru swinginwithme.ru
takeprofitsystem.com szamponrevita.pl
thedownloadfromwarez.blogspot.com tagil.zrus.org
thegioixekhach.com tanieaukcje.com.pl
thiegs.reco.ws tds-advert002.info
timetorelax.biz teastory.co
tizanidine4mgstreetprice.blogspot.com tecspb.ru
tizanidine4mgtablets.blogspot.com telesvoboda.ru
tizanidinedosageforsleep.blogspot.com testingads.pro
tizanidinemusclerelaxant.blogspot.com thaisamkok.com
theallgirlarcade.com
thesmartsearch.net
ticketsys.inetwd.com
timhost.ru
tizanidineforopiatewithdrawal.blogspot.com
tizanidinehclsideeffects.blogspot.com
tizanidineonline.blogspot.com
tizanidineorflexeril.blogspot.com
tizanidinepills.blogspot.com tizanidinepills.blogspot.com
tizanidinesideeffectsweightloss.blogspot.com tizanidineshowupondrugtest.blogspot.com
tizanidineusedfor.blogspot.com tizanidinewithdrawalsymptoms.blogspot.com
tizanidinewithdrawal.blogspot.com topcar-krasnodar.ru
tksn.ru track2.shop
tobeyouday.win tracklead.net
tomatis.gospartner.com tradgardspartner.se
top10-way.com traffic2cash.org
top-deal.com.pl trailer.cinemaflix.website
topquality.cf trion.od.ua
torrentred.games trkur.com
totu.info truebeauty.cc
tozup.com
track-rankings.online
trahic.ru
treasuretrack-a.akamaihd.net
tsan.net tsan.net
uggbootsoutletsale.us ucsol.ru
uginekologa.com undergroundcityphoto.com
unimodemhalfduplefw.pen.io unrealcommander.biz
uptime-alpha.net uprour.com
url2image.com usacasino.com
urlopener.com us-america.ru
usdx.us uvozdeckych.info
ussearche.cf vancleefreplica.pw
vashsvet.com vektorpress.ru
vekzdorov.ru viagra-soft.ru
viagra.pp.ua videochat.life
videochat.tv.br videochat.world
videogamesecrets.com videosbox.ru
videospornogratisx.net
videotuber.ru
vielporno.net
vilingstore.net vilingstore.net
vip-dom.in vod.com.ua
vseuznaem.com voluumtracker1.com
vucms.com vut.com.ru
vzlomtw.com vvon.co.uk
watchinf.com waysbetter.cn
waterpurifier.club webalan.ru
wdrake.com webshoppermac.com
webenlace.com.ar webtherapy.ru
webix.biz wellcome2slovenia.ru
webix.me
wemarketing.se wemarketing.se
windowssearch-exp.com whatistizanidine2mg.blogspot.com
woman-orgasm.ru whereiskentoday.com
word-vorlagen.net wholesalejerseyscheapjerseys.us.com
word-vorlagen.xyz wildworld.site
world-mmo.com wordpresscore.com
wormix-cheats.ru worldlovers.ru
wowas31.ucoz.ru
woweb.com.ua
ws.ampower.me
www.888.com www.888.com
xblognetwork.com www.arenda-yeisk.ru
xjlottery.com wyniki-lista.pl
xlovecam.com xclicks.net
xn--b1ag5cfn.xn--p1ai xgftnlrt.bloger.index.hr
xportvusbdriver8i.snack.ws xn--80aodinpgi.xn--p1ai
yellowproxy.net xn----8sbarihbihxpxqgaf0g1e.xn--80adxhks
yoluxuryevents.com xn--b1agm2d.net
zagadki.in.ua xn--d1aifoe0a9a.top
zaidia.xhost.ro xn----itbeirbjbi7bc6bh2d.xn--p1ai
za-music.mymobiplanet.com xpresscare.ru
zeg-distribution.com xxx-cam.webcam
zeleznobeton.ru xxx-treker.ru
xzlive.com
ynymnwbm.bloger.index.hr
youporn-ru.com
yourdesires.ru
yuarra.pluto.ro
yunque.pluto.ro
zarabotat-na-sajte.ru
zerocash.msk.ru zerocash.msk.ru
zeroredirect12.com zeroredirect2.com
zhorapankratov7.blogspot.com
zkjovpdgxivg.ga zkjovpdgxivg.ga
zlatnajesen.com zscaler.net
zoogdiesney.com zvetki.ru
zophim.me
zrus.org
zs2vm.top
zynax.ua

472
.dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
00it.com 123kuma.com
100searchengines.com 7makemoneyonline.com
12bet.com adsref.men
3xforum.ro akama.com
991mostfm.co.id akuhni.by
abwa.tk alive-ua.com
adtiger.tk allcredits.su
advocatemsk.ru allforminecraft.ru
advokat-grodno.by all-streaming-media.com
ageofclones.com alyeskaresort.com
ampower.me androids-store.com
anaksma.info appearance-cool.com
apiportalmorecom-a.akamaihd.net artparquet.ru
aproposde.com autodo.info
arquivo.pt aviav.ru.com
asdfg.pro ayeartoforget.com
asrvrep-a.akamaihd.net azartmsl.com
atelielembrancaqueencanta.com.br banki76.ru
autobudpostach.club bannerads.de
autovideobroadcast.com beachpics.com
avitocars.ru beauty-bracelet.com
avtointeres.ru belstaffstore.online
banan.tv bestchoice.cf
bestprofits-there.com betune.onlinewebshop.net
best-seo-solution.com bigcities.org
bfz.biz biznesluxe.ru
big-cash.net bjgugu.net.ua
bitcoinpile.com blog.f00kclan.de
bitnote.co bonkers.name
blog-hits.com boostmyppc.com
bluejays-jerseys.us brateg.xyz
bolezniorganov.ru bum.com.ru
bristolhotel.com candytiner.com
browsepulse-a.akamaihd.net canoncdriverq3.pen.io
btnativenav.com cartierlovebracelet.xyz
c1.onedmp.com chastnoeporno.com
callawaygolfoutlet.online cheatcode-lita12.rhcloud.com
candy-glam-hp.com christianlouboutinreplica.win
carsplate.com christianlouboutinsaleonline.us
cartierreplica.win cialischstgerts.com
chidporn.com cinemaflix.website
cialischsrx.com cjmc.info
cleanallvirus.com clickaider.com
compliance-jess.top clicksor.net
cookie-law-enforcement-ee.xyz clksite.com
coolgramgoods.com coolbar.pro
copypaste.traderzplanet.in coolgamechannel.com
coslab.club creatives.adbetclickin.pink
customcatchcan.com customchocolate.business-for-home.com
danashop.ru
datadepths.com
date-withme.com
dating-app.ru
db.speedup.gdn db.speedup.gdn
defenderxtactical.com deadlinkchecker.com
descargar-musica-gratis.net dear-diary.ru
demenageur.com
design-ideas.info design-ideas.info
detskie-zabavi.ru dktr.ru
detsky-nabytek.info domination.ml
deutschehobbyhuren.net downloads-whatsapp.com
dfwu1019.info download-wallpaper.net
domik-derevne.ru doxyporno.com
dostavka-v-ukrainu.ru dtnlyss.com
draniki.org easyukraine.com
druzhininevgeniy63.blogspot.com ekto.ee
dvrlists.com exlarseva.webblog.es
eandsgallery.com ezigarettenshop2.myblog.de
earl-brown.info f00kclan.de
e-collantes.com family1st.ca
efnor-ac.com familyphysician.ru
elektrischezigarette2.devhub.com farm26.ru
elmacho.xyz fashionavenuegame.com
eonpal.com fealq.com
eurosamodelki.ru fermersovet.ru
event-tracking.com ff30236ddef1465f88547e760973d70a.com
excitacao.com flooringinstallation-edmonton.com
expertblog.info flytourisme.org
exportshop.us free-video-tool.com
extstat.com
ez8motelseaworldsandiego.com
ezaz.info
faptitans.com
fastfixing.tech
faz99.com
filmi-v.online
fil.ru
findanysex.com
flipper.top
forpackningsutveckling.se
fotzen-ficken.com
free-today.com
freza-sverlo.ru
frighteningremain.cf frighteningremain.cf
ftns.ru front.to
fx-brokers-review.com fyxabomiw.ru
geoads.com getlaid-xxxhookupdirect.com
ghernnqr.skyrock.com getridofstretchmarks.org
gidonline.one getyourimage.club
gombita.info googglet.com
googlefeud.com greatfind-a.akamaihd.net
gopro-online.info grizzlysgrill.com
gox.com.ua heartofbeijing.blogspot.com
hcate.com histock.info
healgastro.com homemature.net
hentaiheroes.com home-task.com
hjaoopoa.top
hoste.octopis.com
host-tracker.com host-tracker.com
hotshoppymac.com hotel-mkad.ru
hoverboard360.nl hubbble.com
howmuchdoestizanidinecost.blogspot.com ico.re
hspline.com ideibiznesa2015.ru
humanelydrew.com id-forex.com
husky-shop.cz igadgetsworld.com
ilmexico.com ilovevitaly.xyz
iloveitaly.ru i-midias.net.br
imagine-ex.co inboxdollars.com
indiakino.net inet-traffic.com
intellego.info integritylandscapeservices.com
jrcigars.com iwanttodeliver.com
kakadu-interior.com.ua javidol.site
keywords-monitoring-success.com jmat.cn
keywordsuggest.org karaganda.xkaz.org
khafre.us kinocccp.net
kicknights.gq kinogonew.ru
kinohit1.ru kiwi237au.tk
kirov.zrus.org kursy-ege.ru
kollekcioner.ru lacasamorett.com
kw21.org limads.men
laserpen.club lisque.batcave.net
lashstudia.ru liveu.infoteka.hu
laxob.com localflirtbuddies.com
lexixxx.com lollypopgaming.com
lifeinsurancekb.com lubetube.com
livingcanarias.com madot.onlinewebshop.net
love-baby.cz magicplayer-s.acestream.net
lyrster.com masserect.com
macresource.co.uk mazda-roadsters.com
mediawhirl.net
medtherapy.ru
mega-bony-2017.pl
meltwater.com meltwater.com
mielec.pl member-quiz.com
missis.top mexicosleevegastrectomy.com
monclercoats.xyz mhtr.be
money-every-day.com micasainvest.com
mossmesi.com minyetki.ru
muizre.ru mobifunapp.weebly.com
monarchfind-a.akamaihd.net
more-letom.ru
morpicert.pw
mosrif.ru
mototsikl.org
mrmoneymustache.com
mrwhite.biz
musezone.ru
musicdaddy.net musicdaddy.net
mydeathspace.com musicspire.online
niroo.info mybinaryoptionsrobot.com
nofreezingmac.work nailsimg.com
notasprensa.info narosty.com
nottyu.xyz nelc.edu.eg
novosibirsk.xrus.org nextlnk12.com
oballergiya.ru normalegal.ru
offtopic.biz oakleyglassesonline.us
offers.bycontext.com
oil-td.ru
oneshotdate.com
onlainbesplatno.ru onlainbesplatno.ru
online-hit.info
onlineku.com onlineku.com
onlinewritingjobs17.blogspot.ru ontargetseo.us
openfrost.net panouri-solare-acoperis.com
optibuymac.com parlament.biz
paradontozanet.ru picture-group.com
pierrehardysale.online plastgranar.nu
pinstake.com playfortuna-play.ru
pipki.r.acdnpro.com pliks.pl
platesauto.com popugaychiki.com
pooleroadmedicalcentre.co.uk popup.matchmaker.com
powc.r.ca.d.sendibm2.com pornokajf.com
pp-budpostach.com.ua powitania.pl
prod2016.com pozdrawleniya.com
promgirldresses.xyz prlog.ru
prosperent.com pulseonclick.com
pst2017.onlinewebshop.net pussyspace.net
purplesphere.in
putitin.me putitin.me
qitt.ru quelle.ru
rangjued.com
ranksays.com
rcb101.ru rcb101.ru
respublica-otel.ru redirect.trafficreceiver.club
roma-kukareku.livejournal.com remont-ustanovka-tehniki.ru
s1z.ru rennlist.com
sabaapress.com responsive-test.net
scanner-alex.top rethinkwasteni.info
rootandroid.org
rus-pornuha.com
sajatvelemeny.com
sandhillsonline.com
sanjosestartups.com
sbornik-zakonov.ru
sbwealthsolutions.ca
scanner-mary.top
scanspyware.net scanspyware.net
searchimage.co scmor.ilxc.cc
searchwebknow-a.akamaihd.net scrnet.biz.ua
search.xtconnect.com sdelatmebel.ru
seoanalyses.com semaltmedia.com
seo-smm.kz shtaketniki.kz
service-core.ru site.ru
se-welding.ru smartpet.ru
sexs-foto.com smokewithrabbits.com
sexy.babes.frontend-stack.top snowplanes.com
sharebutton.org sonnikforme.ru
siteexpress.co.il souvenirua.com
site-speed-check.site spbchampionat.ru
solmarket.by spymac.net
special-porn.com starwars.wikia.com
sptslmtrafms.com stauga.altervista.org
spywarenuker.com stroymonolit.su
stardevine.com taaaak.com
startufa.ru talant-factory.ru
strigkaomsk.ru thepokertimer.com
styro.ru thewomenlife.com
tizanidinesleepaid.blogspot.com tizanidine4mgprice.blogspot.com
tn811.us tizanidine4mgtablets.blogspot.com
topanasex.com tizanidinerestlesslegsyndrome.blogspot.com
trichizobswiv.agddns.net tizanidinewithdrawalsymptoms.blogspot.com
trumpetedextremes.com tomatis.gospartner.com
tuckpointingmasonrysystems.com tonerbox.kz
tzritel.tk totu.info
tracksz.co
trafficmania.com
triumf-realty.ru
trkdf.com
trustl.life
tsan.net
tuberkulezanet.ru
turizmus.us
twitlinks.com
uginekologa.com uginekologa.com
undergroundcityphoto.com ultimatesetnewfreeallsoftupgradesystems.pw
urll.eu ultramart.biz
videokrik.net unpredictable.ga
viel.su uprour.com
urdoot.win
vchulkah.net
via-gra.webstarts.com
viberdownload10.com
videojam.tv
villacoloniale.com villacoloniale.com
viveresaniesnelli.it visa-pasport.ru
vpnmouse.com vitalads.net
vut.com.ru vladimir.zrus.org
vykup-avto-krasnodar.ru
vysigy.su vysigy.su
vzglyadriv.kg wait3sec.org
watracker.net warningwar.ru
webshoppermac.com webads.co.nz
websiteaccountant.de web.cvut.cz
wedding0venues.tk wordpresscore.com
whereiskentoday.com worldoffiles.ru
wholesalejerseysgaa.com wtsindia.in
workle.website xchangetrak.com
worldis.me xgames-04.com
xcc24.pl x-mix.info
x-diesel.com xn--80ab4aa2g.xn--p1ai
xn----7sbahjd3btneuw1joc.xn--p1ai xn----9sbubg3ambdfl1j.xn--p1ai
xn--oogle-wmc.com xvideospornoru.com
xxxnatelefon.ru xxlargepop.com
xxxtubesafari.com zaimite.ru
yeartwit.com zaloro.com
yoshkarola.zrus.org zapatosenventa.info
yoursearch.me zatjmuzu.info
youtuhe.com
yun56.co
zhacker.net
znakom.sibtest.ru
zolotoy-lis.ru
zona-aqua.ru
zoomovies.org
zverokruh-shop.cz

172
.dev-tools/test_units/ratelimittest-beta.txt
View file

@ -5,7 +5,93 @@
<hr><center>nginx/1.16.1</center> <hr><center>nginx/1.16.1</center>
</body> </body>
</html> </html>
ody> <html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.16.1</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.16.1</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.16.1</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.16.1</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.16.1</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.16.1</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.16.1</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.16.1</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.16.1</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.16.1</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.16.1</center>
</body>
</html>
<!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html><html> </html><html>
<head><title>503 Service Temporarily Unavailable</title></head> <head><title>503 Service Temporarily Unavailable</title></head>
<body> <body>
@ -398,90 +484,6 @@ ody>
<hr><center>nginx/1.16.1</center> <hr><center>nginx/1.16.1</center>
</body> </body>
</html> </html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.16.1</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.16.1</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.16.1</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.16.1</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.16.1</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.16.1</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.16.1</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.16.1</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.16.1</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.16.1</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.16.1</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.16.1</center>
</body>
</html>
<!DOCTYPE html> <!DOCTYPE html>
<html> <html>
<head> <head>

2
.dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
104.154.113.151 0; 34.73.34.132 0;
127.0.0.1 0; 127.0.0.1 0;

BIN
.latest_release/bots.d.tar.gz
View file

Binary file not shown.

BIN
.latest_release/conf.d.tar.gz
View file

Binary file not shown.

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2020.04.2047 #### Version: V4.2020.04.2048
#### Bad Referrers Blocked: [6831](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [6831](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [571](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [571](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2020.04.2047 #### Version: V4.2020.04.2048
#### Bad Referrers Blocked: [6831](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [6831](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [571](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [571](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -11,7 +11,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2020.04.2047 #### Version: V4.2020.04.2048
#### Bad Referrers Blocked: [6831](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [6831](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [571](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [571](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

832
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2020.04.2047 #### Version: V4.2020.04.2048
#### Bad Referrers Blocked: [6831](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [6831](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [571](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [571](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

836
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

836
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

836
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2020.04.2047 ### Version: V4.2020.04.2048
### Updated: Wed Apr 15 15:39:20 SAST 2020 ### Updated: Thu Apr 16 22:34:28 SAST 2020
### Bad Bot Count: 571 ### Bad Bot Count: 571
################################################### ###################################################
### Version Information ## ### Version Information ##