vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-04 11:40:22 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2019.10.1878 [ci skip]

Browse source
This commit is contained in:
Travis 2019-10-25 20:54:32 +02:00
parent 333dcd2bd6
commit 61af4296c0
52 changed files with 10134 additions and 10133 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

1008
.dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
.dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
35.193.14.140 1; 34.66.178.120 1;
127.0.0.1 1; 127.0.0.1 1;

2
.dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
35.193.14.140 0; 34.66.178.120 0;
127.0.0.1 0; 127.0.0.1 0;

1008
.dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
.dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
35.193.14.140 1; 34.66.178.120 1;
127.0.0.1 1; 127.0.0.1 1;

2
.dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
35.193.14.140 0; 34.66.178.120 0;
127.0.0.1 0; 127.0.0.1 0;

1008
.dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
.dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
35.193.14.140 1; 34.66.178.120 1;
127.0.0.1 1; 127.0.0.1 1;

2
.dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
35.193.14.140 0; 34.66.178.120 0;
127.0.0.1 0; 127.0.0.1 0;

1008
.dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

1008
.dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

1008
.dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
.dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
35.192.136.167 0; 34.66.178.120 0;

1008
.dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
.dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
34.66.178.120 1; 35.193.14.140 1;
127.0.0.1 1; 127.0.0.1 1;

2
.dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
34.66.178.120 0; 35.193.14.140 0;
127.0.0.1 0; 127.0.0.1 0;

1008
.dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
.dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
34.66.178.120 1; 35.193.14.140 1;
127.0.0.1 1; 127.0.0.1 1;

2
.dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
34.66.178.120 0; 35.193.14.140 0;
127.0.0.1 0; 127.0.0.1 0;

1008
.dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
.dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
34.66.178.120 1; 35.193.14.140 1;
127.0.0.1 1; 127.0.0.1 1;

2
.dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
34.66.178.120 0; 35.193.14.140 0;
127.0.0.1 0; 127.0.0.1 0;

1008
.dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
.dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,5 +45,5 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
35.188.73.34 0;
35.192.187.174 0; 35.192.187.174 0;
34.66.178.120 0;

1008
.dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
.dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,5 +45,5 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
35.188.73.34 0;
104.154.113.151 0; 104.154.113.151 0;
35.192.187.174 0;

1008
.dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

4
.dev-tools/test4_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,6 +45,6 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
104.154.113.151 0; 34.68.144.114 0;
35.192.136.167 0; 35.193.14.140 0;
35.192.187.174 0; 35.192.187.174 0;

1008
.dev-tools/test4_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

5
.dev-tools/test5_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,5 +45,6 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
34.66.178.120 0; 35.193.14.140 0;
104.154.113.151 0; 35.192.187.174 0;
34.68.144.114 0;

1008
.dev-tools/test5_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
.dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
35.193.14.140 1; 34.66.178.120 1;
127.0.0.1 1; 127.0.0.1 1;

20
.dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
BDCbot 80legs
Copier DSearch
Discoverybot Evil
FlashGet LinqiaScrapeBot
Netvibes MarkMonitor
NetZIP meanpathbot
trendiction.de Mr.4x3
WebEnhancer MSIECrawler
Woobot SEOkicks
ZumBot Typhoeus

290
.dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
360Spider
404checker
404enemy
80legs 80legs
Abonti
Aboundex Aboundex
Aboundexbot Aboundexbot
Acunetix Acunetix
AfD-Verbotsverfahren ADmantX
AhrefsBot Alexibot
AIBOT Alligator
AiHitBot AllSubmitter
Aipbot Apexoo
archive.org_bot
ASPSeek ASPSeek
Asterias Asterias
Attach AwarioRssBot
Backlink-Ceck AwarioSmartBot
BackDoorBot
BackStreet BackStreet
BackWeb
Barkrowler Barkrowler
Battleztar Bazinga Battleztar Bazinga
BBBike
BDCbot
BetaBot
Bigfoot
Blackboard
Black Hole Black Hole
Blow
BlowFish BlowFish
Brandprotect Boardreader
Bolt
Brandwatch
Buddy Buddy
BuiltBotTough BuiltWith
BunnySlippers
BuzzSumo
Calculon
CATExplorador CATExplorador
CazoodleBot
CCBot
CherryPicker
CheTeam
ChinaClaw ChinaClaw
Chlooe Chlooe
coccocbot-web coccocbot-web
cognitiveseo
Collector Collector
com.plumanalytics Copier
CopyRightCheck Copyscape
Cosmos Cosmos
Craftbot Craftbot
DatabaseDriverMysqli crawler4j
DataCha0s Crescent
CrunchBot
Curious
demandbase-bot
Deusu Deusu
Devil Devil
Digincore Digincore
DigitalPebble
DIIbot DIIbot
DittoSpyder Dirbuster
Discobot
Discoverybot
Dispatch
DnyzBot
DomainAppender
DomainSigmaCrawler
DomainStatsBot DomainStatsBot
Download Wonder Download Wonder
Drip Dragonfly
DSearch Ebingbong
eCatch eCatch
EMail Siphon EMail Siphon
EMail Wolf Evil
evc-batch
Exabot
Express WebPictures Express WebPictures
ExtLinksBot ExtLinksBot
Extractor Extractor
ExtractorPro
Ezooms Ezooms
facebookscraper
FDM FDM
FemtosearchBot FHscan
Firefox/7.0 Fimap
Flunky
Freeuploader Freeuploader
FyberSpider FrontPage
Fyrebot Fyrebot
Genieo
Getintent
GetRight
GetWeb GetWeb
Gotit Gigabot
Grabber Go!Zilla
GrabNet GrabNet
Grafula GridBot
GrapeshotCrawler
Haansoft Haansoft
Heritrix HaosouSpider
Havij
HEADMasterSEO
HMView HMView
HTTP::Lite HTMLparser
HTTrack Humanlinks
HybridBot HybridBot
Image Fetch Image Fetch
Indy Library Image Sucker
Intelliseek InfoTekies
InterGET instabid
Internet Ninja Internet Ninja
InternetSeer InternetSeer
ips-agent
Iria Iria
IRLbot IRLbot
Joomla IstellaBot
Jbrofuzz
JennyBot
JetCar
JustView
Jyxobot Jyxobot
Kenjin Spider
Kozmosbot
Lanshanbot Lanshanbot
LexiBot Larbin
Lftp
LibWeb LibWeb
Likse
LinkextractorPro LinkextractorPro
LinkpadBot LinksManager
LinqiaMetadataDownloaderBot
LinqiaRSSBot LinqiaRSSBot
Lipperhey LinqiaScrapeBot
Lipperhey Spider
Litemage_walker
Lmspider Lmspider
lwp-trivial LNSpiderguy
Magnet Ltx71
Mail.RU_Bot lwp-request
Majestic-SEO Mag-Net
magpie-crawler
Majestic12
MarkMonitor MarkMonitor
MarkWatch Mata Hari
meanpathbot
Meanpathbot
Mediatoolkitbot Mediatoolkitbot
mediawords
Metauri
MFC_Tear_Sample MFC_Tear_Sample
MIDown tool MJ12bot
Mister PiX Mojolicious
Morfeus Fucking Scanner
MSFrontPage MSFrontPage
MSIECrawler MSIECrawler
muhstik-scan Msrabot
Musobot
Name Intelligence
Nameprotect Nameprotect
Navroad Navroad
Needle NearSite
Nessus
NetAnts
netEstate NE Crawler netEstate NE Crawler
NetLyzer
NetMechanic NetMechanic
NetSpider Nettrack
Net Vampire
NetZIP
NextGenSearchBot
NICErsPRO
Niki-bot Niki-bot
Nikto NimbleCrawler
NPbot Ninja
Offline Explorer Offline Navigator
OnCrawl
Openfind Openfind
OpenLinkProfiler
Openvas Openvas
OpenVAS OpenVAS
OrangeSpider OrangeBot
Page Analyzer OutclicksBot
page scorer
PageScorer PageScorer
Pandalytics Pandalytics
Panscient Panscient
Pavuk Pavuk
PECL::HTTP PECL::HTTP
PeoplePal
Picsearch Picsearch
PictureFinder PictureFinder
Pimonster
Pixray Pixray
Probethenet PleaseCrawl
Pump Pockey
PyCurl POE-Component-Client-HTTP
QueryN Metasearch
RankActive RankActive
RankActiveLinkBot RankActiveLinkBot
RankingBot2 RankingBot
RankurBot
RealDownload RealDownload
RebelMouse Recorder
ReGet
Ripper Ripper
Rogerbot
RSSingBot RSSingBot
s1z.ru SalesIntelligent
SBIder SBIder
ScanAlert ScanAlert
scan.lol scan.lol
Scrapy ScoutJet
Screaming Screaming
Searchestate Searchestate
SearchmetricsBot Semrush
SEOkicks SemrushBot
SEOkicks-Robot SEOkicks-Robot
Seomoz
seoscanners
serpstatbot serpstatbot
Shodan Shodan
Siphon SiteLockSpider
Sitebeam SiteSucker
SiteExplorer
Siteimprove
Site Sucker
Sitevigil Sitevigil
SlySearch Snake
SmartDownload Sociscraper
SMTBot
Snoopy
SocialRankIOBot
sogouspider sogouspider
Sogou web spider
Sosospider Sosospider
Spammen SpaceBison
spyfu Spanner
Sqworm sp_auditbot
Steeler Spbot
Stripper Sqlmap
Sucker Sqlworm
Sucuri
SuperBot SuperBot
SuperHTTP Suzuran
Surfbot
Swiftbot Swiftbot
sysscan
Szukacz
T0PHackTeam T0PHackTeam
T8Abot tAkeOut
Telesoft TeleportPro
Telesphorep Telesphoreo
TheNomad TheNomad
TightTwatBot TightTwatBot
Titan Titan
Toata Toata
Toweyabot Tracemyfile
Trendictionbot Trendictionbot
trendiction.com True_Robot
Turingos Turingos
Turnitin
TwengaBot TwengaBot
UnisterBot Typhoeus
Vagabondo URLy.Warning
Virusdie Vacuum
Voltron VB Project
VCI
Wallpapers/3.0 Wallpapers/3.0
WASALive-Bot WBSearchBot
Webalta
WebAuto WebAuto
WebFetch Web Auto
Web Fetch WEBDAV
Web Fuck WebEnhancer
WebImageCollector WebmasterWorldForumBot
WebLeacher WebSauger
webmeup-crawler
WebPix
Web Pix
Web Sauger Web Sauger
WebsiteExtractor Webshag
WebsiteQuester Website Quester
Webster WebSucker
Web Sucker
WebWhacker
WebZIP WebZIP
WeSEE WeSEE
Who.is Bot Whack
Widow Whacker
Whatweb
WISENutbot WISENutbot
Wonderbot x22Mozilla
Woobot
Wprecon
WWW-Mechanize
Xaldon_WebSpider Xaldon_WebSpider
Xenu Xenu
zauba.io xpymep1.exe
Zeus Zade
Zitebot
ZumBot

278
.dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
360Spider
404checker 404checker
Aboundexbot AfD-Verbotsverfahren
Acunetix AhrefsBot
ADmantX
AIBOT AIBOT
AiHitBot Aipbot
AllSubmitter AlphaBot
Apexoo Anarchie
archive.org_bot archive.org_bot
arquivo-web-crawler arquivo-web-crawler
ASPSeek AwarioRssBot
Asterias BackDoorBot
Attach
Backlink-Ceck
backlink-check backlink-check
BackStreet
BackWeb
Bandit Bandit
BDFetch
BetaBot
Bigfoot Bigfoot
Black Hole Black Hole
BlackWidow
BLEXBot BLEXBot
Boardreader
Brandprotect Brandprotect
Brandwatch BuiltBotTough
BuiltWith BuiltWith
Bullseye
BunnySlippers BunnySlippers
Calculon
CATExplorador CATExplorador
CazoodleBot CherryPicker
ChinaClaw
Chlooe
Cloud mapping Cloud mapping
coccocbot-web Cogentbot
cognitiveseo cognitiveseo
Collector CopyRightCheck
com.plumanalytics
Copier
Copyscape Copyscape
Cosmos Cosmos
Craftbot crawler.feedback
DatabaseDriverMysqli crawl.sogou.com
CrazyWebCrawler
CSHttp
Curious
Custo
DataCha0s DataCha0s
DBLBot
demandbase-bot
Deusu Deusu
Devil
DIIbot DIIbot
Discoverybot Dirbuster
Discobot
DnyzBot DnyzBot
DomainAppender DomainAppender
DomainCrawler
DomainSigmaCrawler
DomainStatsBot DomainStatsBot
Dotbot Download Wonder
Dragonfly Dragonfly
DTS Agent Drip
DSearch
EasyDL EasyDL
Ebingbong
eCatch
ECCP/1.0 ECCP/1.0
EirGrabber EMail Siphon
EMail Wolf EMail Wolf
Evil evc-batch
Exabot Express WebPictures
ExtLinksBot EyeNetIE
ExtractorPro facebookscraper
FDM FHscan
FlashGet Fimap
Firefox/7.0
Flunky
Foobot Foobot
Freeuploader Freeuploader
FrontPage Fyrebot
GalaxyBot GalaxyBot
GermCrawler GermCrawler
GetRight GetRight
GetWeb
Gigablast Gigablast
Go-Ahead-Got-It Go-Ahead-Got-It
Go!Zilla Gotit
GoZilla
Grabber Grabber
Grafula GrabNet
GrapeFX
GridBot GridBot
Haansoft GT::WWW
Havij
HEADMasterSEO HEADMasterSEO
HTMLparser heritrix
Iblog HTTrack
IDBot Humanlinks
Id-search HybridBot
IlseBot IlseBot
Image Fetch
IndeedBot IndeedBot
InfoNaviRobot Indy Library
InfoTekies
Intelliseek
Internet Ninja Internet Ninja
IRLbot ips-agent
IstellaBot Iskanie
Jbrofuzz JetCar
JennyBot
Jetty
Joomla
Jorgee Jorgee
JustView Jyxobot
Kenjin Spider
Kozmosbot
Larbin
LeechGet
LibWeb
Lightspeedsystems Lightspeedsystems
Likse Linkdexbot
LinkextractorPro LinkextractorPro
LinqiaMetadataDownloaderBot LinkpadBot
LinkWalker
LinqiaRSSBot
LinqiaScrapeBot LinqiaScrapeBot
Litemage_walker Lipperhey
LNSpiderguy lwp-trivial
Ltx71
Magnet Magnet
Mag-Net Mail.RU_Bot
Majestic-SEO MarkMonitor
Masscan Mass Downloader
Mata Hari
meanpathbot meanpathbot
MeanPath Bot
Mediatoolkitbot
mediawords
MegaIndex.ru MegaIndex.ru
Metauri Metauri
MFC_Tear_Sample Microsoft Data Access
MIIxpc Microsoft URL Control
MJ12bot MIDown tool
Morfeus Fucking Scanner Mojeek
Mr.4x3 Mr.4x3
MSIECrawler MSFrontPage
Msrabot Nameprotect
Name Intelligence Nessus
NearSite
Needle
NetAnts
Netcraft Netcraft
NetMechanic NetLyzer
Nettrack NetSpider
NetZIP NetZIP
NextGenSearchBot
Nibbler
NICErsPRO NICErsPRO
Niki-bot Niki-bot
Nikto Nikto
NimbleCrawler NimbleCrawler
Nmap
Nutch Nutch
Octopus Offline Explorer
Offline Navigator Offline Navigator
Openfind OnCrawl
OpenLinkProfiler OrangeBot
Openvas OutclicksBot
OpenVAS
PageAnalyzer
Page Analyzer
PageGrabber PageGrabber
page scorer
PageScorer PageScorer
Pandalytics
Panscient
Pavuk Pavuk
pcBrowser
PECL::HTTP PECL::HTTP
PeoplePal PeoplePal
Picscout
Pimonster Pimonster
Pi-Monster
PleaseCrawl PleaseCrawl
Probethenet Pockey
POE-Component-Client-HTTP
ProPowerBot ProPowerBot
Pump
PxBroker PxBroker
PyCurl
QueryN Metasearch QueryN Metasearch
Quick-Crawler
RankActive RankActive
RankingBot
RankingBot2
Rankivabot
RealDownload RealDownload
Reaper
RebelMouse RebelMouse
Recorder Recorder
RedesScrapy
RepoMonkey RepoMonkey
Ripper Ripper
RocketCrawler
Rogerbot Rogerbot
s1z.ru s1z.ru
SalesIntelligent SalesIntelligent
SBIder SBIder
ScanAlert ScanAlert
Scanbot Scanbot
Scrapy ScreenerBot
Semrush
SemrushBot SemrushBot
SEOkicks SEOkicks-Robot
SEOlyticsCrawler
Seomoz Seomoz
SEOprofiler
seoscanners seoscanners
SeoSiteCheckup
SEOstats SEOstats
sexsearcher serpstatbot
SiteExplorer Shodan
SiteLockSpider SISTRIX
SiteSnagger Sitebeam
Siteimprove
SiteSucker SiteSucker
SMTBot Site Sucker
Snoopy SmartDownload
Sociscraper Sociscraper
Sogou web spider Sosospider
Spammen Sottopop
SpaceBison
SpankBot SpankBot
Spinn3r Spinn3r
Steeler SputnikBot
Sucker spyfu
Sqlmap
Stripper
Sucuri Sucuri
SuperBot SuperHTTP
SurveyBot SurveyBot
Swiftbot T8Abot
Szukacz
T0PHackTeam
tAkeOut tAkeOut
Telesphoreo TeleportPro
Telesphorep The Intraformant
Thumbor Thumbor
TightTwatBot Tracemyfile
Trendiction Turingos
trendiction.com
True_Robot
Turnitin Turnitin
TwengaBot TwengaBot
Twice
Typhoeus Typhoeus
UnisterBot
URLy.Warning
Vagabondo Vagabondo
VeriCiteCrawler VeriCiteCrawler
Wallpapers/3.0
WallpapersHD WallpapersHD
WBSearchBot WBSearchBot
WebAuto WebAuto
Web Auto Web Auto
WebBandit WebBandit
Web Collage WebCollage
WebCopier WebCopier
WebEnhancer
Web Enhancer
WebFetch
WebFuck WebFuck
WebmasterWorldForumBot WebGo IS
WebImageCollector
webmeup-crawler webmeup-crawler
Web Pix Web Sauger
WebSauger
WebsiteQuester WebsiteQuester
WebSucker Website Quester
WebStripper
Web Sucker Web Sucker
WebWhacker
WebZIP WebZIP
WeSEE Whack
Whacker
Whatweb
Who.is Bot Who.is Bot
Wonderbot WinHTTrack
WISENutbot
Woobot Woobot
WWW::Mechanize Wotbox
x22Mozilla Wprecon
WWW-Mechanize
x09Mozilla
Xaldon_WebSpider
xpymep1.exe
YoudaoBot YoudaoBot
Zade
Zermelo Zermelo
Zeus ZmEu
ZyBorg

20
.dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
0daymusic.org irunfar.com
a1security.com.ua istizanidineanarcoticdrug.blogspot.com
cleanallspyware.com okuos.com
domainsphoto.com rocketchange.ru
ilmexico.com searchlock.com
mantramusic.ru tizanidineoral.blogspot.com
net-radar.com vzlomfb.com
nextbackgroundcheck.gq wordpress-crew.net
siteonomy.com yaoguangdj.com
tvorozhnaja-zapekanka-recept.ru zryydi.com

918
.dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
1001watch.com.ua 00webcams.com
108shot.com 01apple.com
11pikachu.ru 0lovespells0.blogspot.com
1hwy.com 101raccoon.ru
1qingdao.com 123kuma.com
24-ak.ru 24-ak.ru
2pxg8bcf.top 24x7-server-support.site
2x2fan.ru 2728fb936f0.com
3rbseyes.com 5kstore.com
66cpwgln.space
6hopping.com
72-news.com
7a2rnuey1tw9ar.ru
7yue.org
991mostfm.co.id 991mostfm.co.id
a1security.com.ua aa8b68101d388c446389283820863176e7.com
absolute-s.ru above.com
adamoads.com academia-nsk.org
admanaerofoil.com adcash.com
adnotbad.com addblueoff.com.ua
adpremium.org addray.pro
adtiger.tk adelly.bg
aimayangzhi.com adman.se
aktobe.xkaz.org ads-cool.pro
all4wap.ru adssafeprotected.com
animebox.com.ua ads.tremorhub.com
anticrawler.org agecheckadult.com
apimegabrowsebiz-a.akamaihd.net ageofclones.com
apimountainbikei-a.akamaihd.net aihelen.net
alert-fdm.xyz
all4invest.ru
alphavisions.net
amateurlivechat.org
amateurmatch.com
am-se.com
apartmentratings.com
apelsinnik.website
apiqualitinknet-a.akamaihd.net apiqualitinknet-a.akamaihd.net
apispringsmartne-a.akamaihd.net ap.senai.br
appartement-stumm.at aquarium-pro.ru
applyneedy.xyz
arabseyes.com
aramaicmedia.org aramaicmedia.org
arclk.net arcadepages.com
arenda-avtoprokat-krasnodar.ru arendakvartir.kz
arquapetrarca.info arkartex.ru
ascat.porn artel116.ru
asdfz.pro artparquet.ru
asseenontvonline.ru arvut.org
auspolice.com asdfg.pro
autobrennero.it asiengirls.net
autotrends.today aussie-prizes.com
avtochehli.by auto-moto-elektronika.cz
axbocz.net aviapanda.ru
azartniy-bonus.com awaybird.ru
azbaseimages.net ayakino.net
azbukadiets.ru b2b-lounge.com
baikaleminer.com babespcs.com
banksrf.ru backgroundpictures.net
bannertesting.com bambi.ck.ua
begalka.xyz bannerconnect.net
bestsexyblog.com bcmp.org
bestssaker.com beclean-nn.ru
bezlimitko.xyz becuo.com
bfz.biz besttorrentknifta.weebly.com
biglistofwebsites.com bet-prognoz.com
bingo8888.com bif-ru.info
binomo.kz bingoporno.com
bio-japan.net bio.trade-jp.net
bird1.ru
bjanshee.ru
bjetjt.com
bjorkbacken.nu
blockworld.ru
blog.axant.it blog.axant.it
blogrankers.com bmsco.co
board.f00d.de bonux.nextview.ru
bonzbuddy.com bookmaker-bet.com
boo-arts.com breget74.ru
bookmark4you.com.biz brg8.com
brainzpod.win briomotor.co
braip.com.br brk-rti.ru
brianhenry.co bum.com.ru
bristolhotel.com bupropion-sr-150-mg.us
budpost.com.ua businescoop.men
bugof.gq camdenmemorials.com
bukleteg.xyz candypeople.se
buron.pw canrioloadm.gq
business-suggested.tk casinorewards.info
buybest1.biz cctva.tv
buyk.host.sk cellfun.mobi
buy-meds24.com cenokos.ru
byme.se centrdebut.ru
calc-for-credit.ru
callawaygolfstore.online
cannibalcheerleader.com
carabela.com.do
cartierlovestore.com
cayado.snn.gr
cdncash.org
c-english.ru
cerev.info
changde.58.com changde.58.com
chatseo.com chatroulette.si
cheapjerseysfootballshop.com cheapcigarettesc.info
cheapmoncler.pw checkpagerank.net
checkhit.com cialischstgerts.com
cherrypointplace.ca ciceros.co
christianlouboutinsaleoutletonline.us cindymatches.com
ciproandtizanidine.blogspot.com cmhomestayagency.com
circlesl.com codysbbq.com
clicksor.net coinsspb.com
cntravelre.com coldfilm.ru
cognitiveseo.com communisave.co.za
collegeessay19.blogspot.ru compliance-ivan.xyz
com-cleaner.systems concealthyself.com
compliance-ivan.top credit-respect.ru
compliance-jane.top crest-poloski.ru
compliance-walter.top culturevie.info
connectingsingles.com customergrowthsystems.com
cookie-law-enforcement-ff.xyz cypernhuset.se
copro.pw dame-ns.kz
cordstrap.cc data1.scopich.com
cpabegins.ru datract.com
crafthubs.com dayibiao.com
customboxes4less.com dbmkfhqk.bloger.index.hr
damasarenai.info db.speedup.gdn
dating-app.ru decenttools.com
deadlinkchecker.com dfwu1013.info
dealighted.com digest-project.ru
delayreferat.ru digitalfaq.com
deluxedumps.com
detskie-zabavi.ru
deutschland123.de
dieta-personalna.pl
digitalassetmanagement.site
discountbarbour.online discountbarbour.online
disruptingdinnerparties.com disruptingdinnerparties.com
dogoimage.com dms-sw.ru
dokumentalkino.net domashneeruporno.com
dolohen.com domoysshop.ru
dosug-lux.ru drugs-no-rx.info
doublepimp.com e2click.com
dyt.net e705.net
e-buyeasy.com earl-brown.info
ecommerce-seo.org ege-russian.ru
econom.co elektir.ru
educatemetv.com elektrischezigarette2.devhub.com
ekaterinburg.xrus.org elektrischezigaretten2.beeplog.com
ekosmetyki.net.pl elektrozigaretten1.tumblr.com
elektronischezi.livejournal.com elmacho.xyz
embedle.com
emediate.eu
emerson-rus.ru emerson-rus.ru
empathica.com eredijovon.com
energy-ua.com eropho.com
enthuse.computernetworksonline.com eshop4u.jp
eurosamodelki.ru etenininrade.ga
extener.org evogarage.com
exchangeit.gq
exchanges-bet.com
exlarseva.webblog.es
eyelike.com.ua
ezaz.info
ezigarettekaufen.myblog.de ezigarettekaufen.myblog.de
ezigarettenkaufen1.deviantart.com falllow.gq
fapgon.com fashion-mk.net
fetishinside.com feel-planet.com
fetlifeblog.com fetlifeblog.com
fetroshok.ru
fickkontakte.org
fidelityfunding.com fidelityfunding.com
filesclub.net finuse.com
filmci.pro fix-website-errors.com
flash4fun.com floridahuntingfishingadventures.com
flashlarevista.com forex-procto.ru
forex.osobye.ru foto-weinberger.at
fortevidyoze.net foxinsocks.ru
fortunejack.com foxweber.com
fortwosmartcar.pw franklinfire.co
franch.info frcls.fr
fr-bearings.ru freecamdollars.com
free-share-buttons.com freenom.link
frivgame250.com free-traffic.xyz
funnel.co.za galaxyflowers.ru
fym.com.ru gameplexcity.com
gamerextra.com gardene.ru
gamesprite.me gearcraft.us
garciniaxt.us geile-lelly.eu
gate5.co.za gemara.com
gayxperience.com gerhardhealer.com
gaz-voshod.ru
gepezz.info
germes-trans.com
get-free-social-traffic.com get-free-social-traffic.com
getridofstretchmarks.org getpopunder.com
gg-arena.ru ggiaro.com
gilbertbanda.net
girlspicsa.com girlspicsa.com
gktt.ru gnuetella.com
glastecfilms.com.my gorabagrata.ru
glicol.kz gorodservis.ru
goodwinmetals.co graphics8.info
gq-catalog.gq growmyfunds.ca
graphicwe.org g.starmoe.xyz
gwhwpxbw.bloger.index.hr hamptonoaks.ca
hanink.biz.ly happy.new.yeartwit.com
hdimagegallery.net hatedriveapart.com
healbio.ru hazardky.net
heartofpayne.xyz hdpixent.com
hermesbirkinhandbagoutlets.com helvetia.com.ua
historichometeam.com hidefiles.org
hledejvshopech.cz histats.com
homelygarden.com hmmm.cz
homik.pw hol.es
hoporno.com holidaypics.org
houdom.net hollywoodactress.info
host-protection.com
hothot.ru
hotshoppymac.com
houseofgaga.ru
houston-vikings.com houston-vikings.com
hoverboardforsaledirect.com
hoztorg-opt.ru hoztorg-opt.ru
htmlcorner.com hplaserjetpdriver8y.pen.io
hundejo.com hreade.com
hyiphunter.org iamsport.org
ictizanidinehcl4mg.blogspot.com ifirestarter.ru
ideawheel.com iloveitaly.ru
ihc2015.info images-free.net
iideaidekonkatu.info images-graphics-pics.com
ilbe.club imguramx.pw
imgata.com
incanto.in.ua incanto.in.ua
infowarcraft.ru
interior-stickers.ru
intim-uslugi.info intim-uslugi.info
investmac.com investpamm.ru
invitefashion.com inzn.ru
iqbazar.ru ip-guide.com
iqs.biz.ua istanbulit.com
iron-age.info ixora.pro
islamtoday.co.za izismile.com
javidol.site japan-bearings.ru
jerseywholesalebizchina.com jav-fetish.com
jikoman.info jjbabskoe.ru
journeydownthescale.info jus0wil.pp.ua
karusel-market.ru kaz.kz
kerei.ru keywordhouse.com
kerwinandcariza.com keywordsuggest.org
ketoanhanoi.info keywordsuggests.com
keywordblocks.com kino-key.info
kicknights.gq kleine-titten.biz
kinogonew.ru kol-energo.ru
kinohall.ru kollesa.ru
kinostorm.net konkursov.net
kmgamex.cf koral.se
konteiner24.com kostenlos-sexvideos.com
kosmetyki.tm.pl krassh.ru
kredit-blog.ru ku6.com
kriokomora.info kunstaktien.info
ks1234.com kurbappeal.info
kw21.org kvartir-remont.biz
laapp.com laexotic.com
labvis.host.sk landscaping.center
lacloop.info laptoper.net
lafriore.ru
laparfumotec.com
laserpen.club laserpen.club
lashstudia.ru lecbter-relationships.ga
laudit.ru ledis.top
lawyers.cafe lernur.net
leboard.ru letslowbefast.today
lightinghomes.net lida-ru.com
linkrr.com likesdesign.com
likesuccess.com
lion.conboy.us
ljusihus.se ljusihus.se
loadopia.com locustdesign.co
loftdigital.eu lomza.info
lombia.com louboutinreplica.xyz
lonely-mature.com m3gadownload.pl
lovi-moment.com.ua macfix.life
lunamedia.co mahnwachen-helfen.info
magazintiande.ru mantramusic.ru
managerpak204.weebly.com manualterap.roleforum.ru
master-muznachas.ru manve.info
marcoislandvacations.net
maxthon.com maxthon.com
mcnamaratech.com mebel-alait.ru
medanestesia.ru medanestesia.ru
megakino.net medicinacom.ru
mensandals.xyz medkletki.ru
microsearch.ru members.ghanaweb.com
mir-limuzinov.ru menstennisforums.com
missis.top mere.host.sk
mobioffertrck.com mesbuta.info
moivestiy.biz mesto-x.com
moncleronline.xyz micasainvest.com
moncleroutletonline.xyz microsoftportal.net
moneyzzz.ru mobilemedia.md
moomi-daeri.com mobile.ok.ru
moscow.xrus.org monclercoats.xyz
mp3ringtone.info monclerjacketsoutlet.pw
multgo.ru moneymaster.ru
musezone.su mosdverka.ru
mustwineblog.com moyakuhnia.ru
muznachas-service.ru mrbitsandbytes.com
myanyone.net mtmtv.info
mydirtystuff.com muizre.ru
mydownloadengine.com musflashtv.com
myonlinepayday.co mustat.com
nailsimg.com mwtpludn.review
mydownlodablefiles.com
mymobilemoneypages.com
myonigroup.com
mysexpics.ru
nacap.ru
naperehresti.info naperehresti.info
nardulan.com national-today-winning-winner.club
narkologiya-peterburg.ru naturalpharm.com.ua
narkologiya-voronezh.ru netanalytics.xyz
naturalbreakthroughsresearch.com nextbackgroundcheck.gq
naughtyconnect.com next-dentists.tk
nbsproject.ru niroo.info
networkcheck.xyz nottyu.xyz
nextrent-crimea.ru noumeda.com
nmrk.ru nrv.co.za
nowtorrents.com nucia.biz.ly
nrjmobile.fr nvformula.ru
nufaq.com okmusic.jp
oakleyglassesonline.us onlinemeetingnow.com
oda.as online-templatestore.com
offtopic.biz o-o-11-o-o.com
of-ireland.info open-odyssey.org
okeinfo.online optibuymac.com
ok-ua.info oren-cats.ru
onclickpredictiv.com ossmalta.com
onlainbesplatno.ru ovirus.ru
online-hd.pl partnersafe.men
onlineslotmaschine.com pavlodar.xkaz.org
ooomeru.ru pb-dv.ru
ozoz.it pcgroup.com.uy
page2rss.com pekori.to
peekyou.com petitions.whitehouse.gov
photo-clip.ru phobia.us
photosaga.info phpdevops.com
pic2fly.com picsforkeywordsuggestion.com
picscout.com pijoto.net
pigrafix.at piluli.info
playtap.us pisanieprac.info
pl.id-forex.com pixelrz.com
pokemongooo.ml pizda.lol
pokemon-go-play.online pk-pomosch.ru
popugaychiki.com pkr1hand.com
popup.matchmaker.com playfortuna-play.ru
pornofeuer.com poiskzakona.ru
porno-play.net popunder.net
pornosemki.info pornhub-forum.ga
porno-transsexuals.ru pornogratisdiario.com
porto.abuilder.net porno-video-chati.ru
poshiv-chehol.ru pornozhara.com
pozdravleniya-c.ru potoideas.us
pozdrawleniya.ru predmety.in.ua
pozvonim.com pricheskaonline.ru
priscilarodrigues.com.br priora-2.com
productarium.com privatamateure.com
produkto.net privat-girl.net
prohoster.info prizefestival.mobi
prom23.ru prizestohandle.club
pronekut.com profolan.pl
purchasepillsnorx.com progonrumarket.ru
projectforte.ru
promover.org
proprostatit.com
prosmibank.ru
purplestats.com
pussyfleet.com
pussysaga.com pussysaga.com
puzo2arbuza.ru pxhdwsm.com
py100.ru qualitymarketzone.com
qwertty.net quick-seeker.com
ragecash.com
rank-checker.online
rapidsites.pro rapidsites.pro
recinziireale.com rcb101.ru
reklama1.ru rcpmda.ikan1080.xyz
remorcicomerciale.ro realizmobi.com
rfid-locker.co recordpage-a.akamaihd.net
rimedia.org reklama-i-rabota.ru
remontgruzovik.ru
rentehno.ru
restorator-msk.ru
retailwith.com
rewardpoll.com
rfd-split.hr
ricorsogiustizia.org
rn-to-bsn.com rn-to-bsn.com
rock-cafe.info rogervivierforsale.com
rocketchange.ru rospromtest.ru
royalvegascasino.com rukino.org
rp9.ru rusoft-zone.ru
rubanners.com
ruscoininvest.company
russian-postindex.ru
sad-torg.com.ua
saecsa.co saecsa.co
samoiedo.it sajatvelemeny.com
saneyes.com
sanidumps.com
saratov.xrus.org saratov.xrus.org
saugatuck.com sa-rewards.co.za
savetubevideo.com satellite.maps.ilovevitaly.com
scanner-barak.top savefrom.com
scanner-ivan.top sbprabooks.com
scanner-jessica.top scanner-alex.top
searchmywindow-a.akamaihd.net scanner-mary.top
sei80.com searchencrypt.com
seksotur.ru searchlock.com
sell-fb-group-here.com seasaltwithfood.com
sendearnings.com semp.net
seonetwizard.com seofied.com
seo-traffic-ranking.info sergiorossistore.online
servicecenter.co.ua serpstat.com
serving.adbetclickin.pink service.adtech.us
servingnotice.com se-welding.ru
sexkontakteao.info sex-foto.pw
sextracker.be sharebutton.net
sex-tracker.com sherlock.se
sexytrend.ru shivafurnishings.com
sientalyric.co sientalyric.co
signx.info signx.info
sildenafil-tadalafil.info silverage.ru
silvercash.com simplepooltips.com
simple-image.com.ua s-iwantyou.com
sivs.ru sixcooler.de
soblaznu.net sledstvie-veli.net
socialmediasuggest.com slomm.ru
socialseet.ru socialbookmarksubmission.org
socialsignals24.com
sodexo.com sodexo.com
souvenirua.com soft-program.com
sovetogorod.ru sogimlecal.tk
stairliftstrue.com soheavyblog.com
sonnikforme.ru
space4updating.win
spitfiremusic.com
sprttrack.com
spymac.net
stard.shop stard.shop
starpages.net stariy-baku.com
stathat.com staynplay.net
statistici.ro steelmaster.lv
stop-gepatit.te.ua stockspmb.info
stroyplus.ru stoki.ru
suchenindeutschland.com streetfire.net
sudexpert66.ru stretchingabuckblog.com
sugarkun.com studiofmp.com
styro.ru
suggest-keywords.com
sukarame.net sukarame.net
superiends.org summerlinhomes411.info
surffoundation.nl sundrugstore.com
swagbucks.com svetlotorg.ru
tabakur77.com tabletkinaodchudzanie.com.pl
tagil.zrus.org tackletarts.co
talant-factory.ru tattooha.com
tanieaukcje.com.pl techart24.com
tedxrj.com tedxrj.com
template-kid.com thedownloadfreeonlinegames.blogspot.com
thaismartloan.com thepantonpractice.co.uk
threecolumnblogger.com tizanidinehydrochloride2mg.blogspot.com
thruport.com tooplay.com
timecrimea.ru tootoo.to
tizanidinevssoma.blogspot.com torrentdownloadhub.com
topkarkas.com truck-addzilla.life
topquality.cf truemfilelj.gq
torture.ml tsyndicate.com
touchmods.fr tula.mdverey.ru
toxicwap.com tvteleport.ru
tracksurf.daooda.com uac.net.au
tracksz.co
trafficmonetize.org
traffictrade.life
tripper.de
trubywriting.com
truck-rece.life
tula.howotorg.ru
tvoystartup.ru
tv-spoty.info
ua-company.ru ua-company.ru
ufa.xrus.org um-razum.ru
ultimatesetnewfreeallsoftupgradesystems.pw uptimechecker.com
umnovocaminho.com uptime.com
urlopener.com ussearche.cf
uvozdeckych.info v720hd.ru
varbergsvind.se vacuumscleaner.com
velobikestock.com valoresito.com
videochat.cafe vandrie-ict.nl
vavilone.com
velpanex.ru
versaut.xxx-cam.webcam
videochat.mx
videokrik.net videokrik.net
vipms.ru videospornogratisx.net
vitalads.net vkak.ru
vod.com.ua voluumtrk.com
vodkoved.ru voprosotvet24.ru
vonradio.com vtc.pw
voronezh.xrus.org
vvpg.ru
vzlom-na-zakaz.com vzlom-na-zakaz.com
vzlomsn.org w3data.co
warezaccess.com
warning.or.kr warning.or.kr
watch-movies.ru warningzscaler.heraeus.com
webads.co.nz waterefficiency.co
webadvance.club webpromotion.ae
web-betting.ru websiteaccountant.de
webcamdevochka.com webstatsdomain.org
webenlace.com.ar wesharepics.info
webextract.profound.net whengirlsgowild.com
weblo.com white-truck.life
webmasterhome.cn wholinkstome.com
wejdz-tu.pl wildworld.site
wesharepics.com wjgony.com
westsextube.com wonderfulflowers.biz
whatistizanidinehclusedfor.blogspot.com wordkeyhelper.com
whiteproduct.com worst-sites.online
wholesalejerseyscheapjerseys.us.com
whosonmyserver.com
wikes.20fr.com
win-spy.com
w-journal.ru
woodyguthrie.se
world-mmo.com
wpthemedetector.co.uk wpthemedetector.co.uk
wsgames.ru
wtsindia.in
xboxster.ru xboxster.ru
xmronta.com x-diesel.org
xn----7sbahjd3btneuw1joc.xn--p1ai xn----ctbbcjd3dbsehgi.xn--p1ai
xn--80ak6aa92e.com xn----itbeirbjbi7bc6bh2d.xn--p1ai
xn--90acenikpebbdd4f6d.xn--p1ai yaaknaa.info
xn----9sbebi2bvzr7h.xn--p1ai yellowstonevisitortours.com
xn--b1adccaf1bzj.xn--p1ai youbloodyripper.com
xn----ctbigni3aj4h.xn--p1ai youdao.com
xn--e1aggki3c.xn--80adxhks zahvat.ru
xn--hxazdsfy.blogspot.com zakonobosago.ru
xn----itbkqkfiq.xn--p1ai zarabotok--doma.ru
xtraffic.plus zeroredirect10.com
xxlargepop.com zeroredirect6.com
yougame.biz zeroredirect8.com
zambini.ru zhorapankratov7.blogspot.com
zeg-distribution.com znakomstvaonlain.ru
zerocash.msk.ru
zeroredirect11.com
zigarettenonlinekaufen2.drupalgardens.com
zionstar.net
zona-aqua.ru
zoolubimets.ru
zryydi.com
zvezdagedon.ru zvezdagedon.ru

484
.dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
000free.us 00author.com
0lovespells0.blogspot.com 300richmond.co.nz
2728fb936f0.com 9icmzvn6.website
2girls1cup-free.com a96527gi.beget.tech
2nt.ru adcash.com
3-letter-domains.net adelly.bg
3weekdiet.com adzerg.com
7a2rnuey1tw9ar.ru adzpower.com
7yue.org afftrack001.com
8jn.dating-app.ru akama.com
999webdesign.com akvamaster.dp.ua
aad1f4acb0a373420d9b0c4202d38d94fa.com allblogroll.com
activecampaign.dreamhosters.com allesohnegirls.net
advancedcleaner.com amazon-seo-service.com
alessandraleone.com analytics-ads.xyz
all4invest.ru andpolice.com
allcredits.su apccargo.com
alldownload.pw arvut.org
am-se.com autonew.biz
android-style.com aviapanda.ru
anniemation.com avitocars.ru
appsaurus.com avtochehli.by
arcadepages.com azartclub.org
arenda-avtoprokat-krasnodar.ru babieca.com
atley.eu.pn bagsonsale.online
atovh.local-finders.com bannerconnect.net
ausmepa.org.au bannertesting.com
australia-opening-times.com barnfurnituremart.com
autogrep.ru besthoro.ru
berdasovivan.ru bibys.com
big-cash.net bigcities.org
bizcheapjerseyswholesalechina.com bingoporno.com
blackle.com bio-japan.net
blog-hits.com biznesrealnost.ru
bloglag.com
board.f00d.de
boazpower.com
bonanza-fortune.men bonanza-fortune.men
bonzybuddy.com brains2.biz
brk-rti.ru brakehawk.com
budpost.com.ua browsepulse-a.akamaihd.net
buyclomidonlaine.com btc4u.ru
bzero1jewelry.net buron.pw
candytiner.com buy-loft.ru
carabela.com.do buzz-porno.info
cartierreplica.pw cand.jp
caulderwoodkennels.com casinorewards.info
checkm8.com cezartabac.ro
chinacheapelitejerseys.com
chocolateslim-original.com chocolateslim-original.com
cibpenonptib.flu.cc citizenclsdriveri7.pen.io
clipartnew.com cocyq.inwtrade.com
community.allhiphop.com colobit.biz
com-supportcenter.website compliance-alex.top
copblock.org compliance-elena.top
copro.pw compliance-julianna.top
cottageofgrace.com computernetworksonline.com
countercrazy.com concordexoticrentals.com
craftburg.ru customerpromos-a.akamaihd.net
crest3d.ru d2jsp.org
czat.wp.pl dailyrank.net
db.speedup.gdn descargar-musica-gratis.net
dgfitness.co dev.citetick.com
dms-sw.ru discountbarbour.online
dnepr-avtospar.com.ua dmmspy.com
doctissimo.fr domainsphoto.com
downloaddy.net doska-vsem.ru
downloadkakaotalk.com dostavka-v-krym.com
drugspowerstore.com dumpsmania24.com
earn-from-articles.com easytuningshop.ru
ege-essay.ru e-collantes.com
ege-russian.ru educontest.net
electro-prom.com elstal.com.pl
elektrischezigaretten1.blogse.nl etenininrade.ga
elektrozigaretten2.yn.lt excitacao.com
elkacentr.ru eyes-on-you.ga
engines-usa.com ezigarettenshop2.postbit.com
eralph.tk failingmarriege.blogspot.com
everflora.ru family1st.ca
everypony.ru faptitans.com
extremal-blog.com feeriaclub.ru
eyemagination.com fickluder69.com
ezofest.sk finejewelryshop.ru
f00kclan.de floridamhca.org
fbdownloader.com footbalive.org
femmesdenudees.com foto-telok.net
ferrotodo.com foxydeal.com
ff30236ddef1465f88547e760973d70a.com frcls.fr
finemanteam.com freecamdollars.com
flowersbazar.com freshsuperbloop.com
fm-upgrade.ru fullfileaccess.com
food.dtu.dk
formseo.com
fotosfotos.eu
free-social-buttons.xyz
freetangodownload.com
front.to
fxgallery.com fxgallery.com
generic-pills-online.com fz139.ttk.ru
genericviagrasildenafiled.net gagrasector.ru
gerhardhealer.com geileweiber.tk
gifspics.com generalporn.org
gnuetella.com genetworx.com
groupmoney.ru golden-praga.ru
gymi.name goodprotein.ru
haikuware.com growmyfunds.ca
hamacapty.com handicapbathtubarea.com
heartofbeijing.blogspot.com healing-dysplasia.ru
helpmymacfaster.trade hitmuzik.ru
housediz.com hotblognetwork.com
infobabki.ru hotblog.top
informatiecentro.be hotsocialz.com
iptool.xyz hully.altervista.org
isitpaleo.info i4track.net
istock-mebel.ru iccornacircri.cf
itis4you.com iloveitaly.ru
jerseywholesalebizchina.com ilovevitaly.com
kfon.eu incomekey.net
khafre.us iqs.biz.ua
konkursowo-24.pl jacago.com
koral.se job.icivil.ir
labafydjxa.su kino-fun.ru
ladov.ru kiprinform.com
law-check-nine.xyz klin3952.ru
lecbter-relationships.ga klumba55.ru
lizace.com knogg.net
loginduepunti.it krasivoe-hd.net
long-beach-air-conditioning.com krasnodar.zrus.org
lowephotos.info krassh.ru
magicplayer-s.acestream.net kwzf.net
matchpal-a.akamaihd.net larchik.net
max-eclat.men lifebyleese.com
mearns-tractors.co.uk limtu.ifmo.ru
mex-annushka.ru linkdebrideur.xyz
m-google.xyz locationdesaison.com
mjchamonix.org lomb.co
moesexy.com lomza.info
mojpregled.com m1media.net
moz.com macdamaged.tech
mriyadh.com masturbate.co.uk
musezone.ru maximilitary.ru
myanyone.net meccadumps.net
mediawhirl.net
microsearch.ru
morocco-nomad-excursions.com
mosrif.ru
multgo.ru
muznachas-service.ru
mydeathspace.com mydeathspace.com
netvouz.com myfreecams.com
newtechspb.ru mygameplus.com
nicefloor.co.uk myhitmp3.club
njkmznnb.ru mylesosibirsk.ru
noclegonline.info needtosellmyhousefast.com
novosti-hi-tech.ru net-radar.com
offside2.5v.pl nhl09.ru
of-ireland.info no-rx.info
ok-ua.info november-lax.com
onlythegames.com o.light.d0t.ru
o-o-6-o-o.ru online-hit.info
o-o-8-o-o.ru online-sbank.ru
ops.picscout.com ontargetseo.us
otbelivanie-zubov.com panouri-solare-acoperis.com
owohho.com
paradontozanet.ru
parajumpersoutlet.online parajumpersoutlet.online
partnerline.men pawli.eu
partner-print.men phelissota.xyz
pay2me.pl picsearch.com
pc-test.net piski.top
pelfind.me piter.xrus.org
perosan.com pivka.xyz
photostudiolightings.com pk-services.ru
picturesmania.com pl-vouchers.com
pihl.se polybuild.ru
poem-paying.gq popander.mobi
pomoc-drogowa.cba.pl portside.cc
poquoson.org praisong.net
pornzone.tv preg.marketingvici.com
portadd.men presleycollectibles.com
portal-eu.ru profit-opportunity.com
positive2b.ru prostitutki-astana.org
preparevideosafesystem4unow.space psoriasis-file.trade
priscilarodrigues.com.br razorweb-a.akamaihd.net
prizefestival.mobi reckonstat.info
projectforte.ru remontbiz.ru
prospekt-st.ru rentehno.ru
pulse33.ru rep-am.com
quick-seeker.com revistaindustria.com
rapidokbrain.com rospromtest.ru
realmonte.net sabizonline.com
refads.pro sakhboard.ru
remont-fridge-tv.ru savefrom.com
rewardit.com sbornik-zakonov.ru
rossanasaavedra.net scenicmissouri.us
ruspdd.com sc-specialhost.com
saecsa.co secret.xn--oogle-wmc.com
sanatorrii.ru seofirmreviewsus.info
scalerite.co.za sexystrippe.info
scanner-willy.top shemale-sex.net
semprofile.com shisha-swag.de
semrush.com sivs.ru
seoexperimenty.ru slkrm.ru
sextracker.com smartadserver.com
sex-watch.com spaceshipad.com
siteripz.net spravka-medosmotr.ru
slavia.info stpolice.com
smart-scripts.com stroicol.net
socas.pluto.ro stroyplus.ru
soft-terminal.ru sukarame.net
souvenir.cc surfbuyermac.com
space-worry.ml tasteidea.com
spidtest.org
srgwebmail.nl
starwars.wikia.com
strongsignal-a.akamaihd.net
stroydetali.ru
sukirgenk.dvrlists.com
svetodiodoff.ru
tam-gde-more.ru
tattoo33.ru tattoo33.ru
techart24.com tds-advert002.info
telefonsexsofort.tk thetardistimes.ovh
thaisamkok.com tizanidinepills.blogspot.com
titelhelden.eu toloka.hurtom.com
tizanidinehcl4mgtablet.blogspot.com tonerbox.kz
topcar-krasnodar.ru
tracksurf.daooda.com
traffic100.com traffic100.com
tvteleport.ru traffpartners.com
uasb.ru trahic.ru
ultimateclassicrock.com trichizobswiv.agddns.net
uptime-alpha.net trkdf.com
urlopener.blogspot.com.au trkur.com
utrolive.ru tubeline.biz
venta-prom.ru tvoystartup.ru
viagra-soft.ru uchil.net
video--production.com ugogo.info
vip2ch.com unpredictable.ga
vladhistory.com uptimechecker.com
vremya.eu uptime-gamma.net
wahicbefa31.soup.io usiad.net
watracker.net vegan-foods.us
webenlace.com.ar ventelnos.com
website-audit.com.ua vesnatehno.com
whipme.yopoint.in vip.51.la
worldmusicfests.com vipsiterip.org
x69ty.ru visa-pasport.ru
xitjw.info wallpapersdesk.info
xn--80aebbcbcdemfkhba4byaehoejh8dza3v.xn--p1ai watchdogs-2.ru
xn----8sbarihbihxpxqgaf0g1e.xn--80adxhks websites-reviews.com
xn--b1adccaf1bzj.xn--p1ai webtherapy.ru
xn--b1agm2d.net wemarketing.se
xn----ctbbcjd3dbsehgi.xn--p1ai wingsoffury2.com
xn--d1aifoe0a9a.top woweb.com.ua
xn--1-8sbcpb0bdm8k6a.xn--p1ai
xn-----7kceclhb4abre1b4a0ccl2fxch1a.xn--p1ai
xn----dtbndd4ae7eub.top xn----dtbndd4ae7eub.top
yaoguangdj.com zaim-pod-zalog-krasnodar.ru
yoshkarola.zrus.org zdesformula.ru
yourothersite.com zed21.net
zeroredirect1.com zeroredirect.com
znakom.sibtest.ru znakomstva-moskva77.ru
znaturaloriginal.com
zoogdiesney.com
zryydi.com
zvetki.ru

23
.dev-tools/test_units/ratelimittest-beta.txt
View file

@ -1,12 +1,21 @@
<!DOCTYPE html>
<html> <html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html><html>
<head><title>503 Service Temporarily Unavailable</title></head> <head><title>503 Service Temporarily Unavailable</title></head>
<body> <body>
<center><h1>503 Service Temporarily Unavailable</h1></center> <center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.16.1</center> <hr><center>nginx/1.16.1</center>
</body> </body>
</html> </html>
ody> <html>
</html><html>
<head><title>503 Service Temporarily Unavailable</title></head> <head><title>503 Service Temporarily Unavailable</title></head>
<body> <body>
<center><h1>503 Service Temporarily Unavailable</h1></center> <center><h1>503 Service Temporarily Unavailable</h1></center>
@ -572,14 +581,4 @@ ody>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html> </html>

29
.dev-tools/test_units/ratelimittest-master.txt
View file

@ -1,13 +1,11 @@
<!DOCTYPE html>
<html> <html>
<head> <head><title>503 Service Temporarily Unavailable</title></head>
<title>Welcome to NginX</title>
</head>
<body> <body>
<div align=center> <center><h1>503 Service Temporarily Unavailable</h1></center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <hr><center>nginx/1.16.1</center>
<p>This is merely used for testing !!!</p>
</body> </body>
</html>
ody>
</html><html> </html><html>
<head><title>503 Service Temporarily Unavailable</title></head> <head><title>503 Service Temporarily Unavailable</title></head>
<body> <body>
@ -484,13 +482,6 @@
<hr><center>nginx/1.16.1</center> <hr><center>nginx/1.16.1</center>
</body> </body>
</html> </html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.16.1</center>
</body>
</html>
<!DOCTYPE html> <!DOCTYPE html>
<html> <html>
<head> <head>
@ -581,4 +572,14 @@
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html> </html>

2
.dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
35.193.14.140 0; 34.66.178.120 0;
127.0.0.1 0; 127.0.0.1 0;

BIN
.latest_release/bots.d.tar.gz
View file

Binary file not shown.

BIN
.latest_release/conf.d.tar.gz
View file

Binary file not shown.

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2019.10.1877 #### Version: V4.2019.10.1878
#### Bad Referrers Blocked: [6782](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [6782](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [562](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [562](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [214](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [214](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2019.10.1877 #### Version: V4.2019.10.1878
#### Bad Referrers Blocked: [6782](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [6782](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [562](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [562](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [214](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [214](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

4
README.md
View file

@ -11,7 +11,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2019.10.1877 #### Version: V4.2019.10.1878
#### Bad Referrers Blocked: [6782](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [6782](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [562](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [562](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [214](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [214](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)
@ -30,7 +30,7 @@ _______________________
##### nginx version: nginx/1.10.x :heavy_check_mark: ##### nginx version: nginx/1.10.x :heavy_check_mark:
##### nginx version: nginx/1.16.1 :heavy_check_mark: ##### nginx version: nginx/1.16.1 :heavy_check_mark:
##### nginx version: nginx/1.15.8 :heavy_check_mark: ##### nginx version: nginx/1.15.8 :heavy_check_mark:
##### nginx version: nginx/1.17.4 :heavy_check_mark: ##### nginx version: nginx/1.17.5 :heavy_check_mark:
__________________________ __________________________
Not Using Nginx? See the [![Get the APACHE ULTIMATE BAD BOT BLOCKER](https://img.shields.io/badge/APACHE%20-%20ULTIMATE%20BAD%20BOT%20BLOCKER%20%E2%9B%94-blue.svg)](https://github.com/mitchellkrogza/apache-ultimate-bad-bot-blocker) Not Using Nginx? See the [![Get the APACHE ULTIMATE BAD BOT BLOCKER](https://img.shields.io/badge/APACHE%20-%20ULTIMATE%20BAD%20BOT%20BLOCKER%20%E2%9B%94-blue.svg)](https://github.com/mitchellkrogza/apache-ultimate-bad-bot-blocker)

1004
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2019.10.1877 #### Version: V4.2019.10.1878
#### Bad Referrers Blocked: [6782](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [6782](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [562](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [562](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [214](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [214](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

1008
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

1008
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

1008
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2019.10.1877 ### Version: V4.2019.10.1878
### Updated: Wed Oct 23 20:44:17 SAST 2019 ### Updated: Fri Oct 25 20:44:38 SAST 2019
### Bad Bot Count: 562 ### Bad Bot Count: 562
################################################### ###################################################
### Version Information ## ### Version Information ##