vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-06 12:40:17 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2020.03.2027 [ci skip]

Browse source
This commit is contained in:
Travis 2020-03-25 22:13:49 +02:00
parent 83b817ca96
commit 0d5966ce2a
52 changed files with 9952 additions and 9949 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

988
.dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
.dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
104.196.57.92 1; 104.154.120.187 1;
127.0.0.1 1; 127.0.0.1 1;

2
.dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
104.196.57.92 0; 104.154.120.187 0;
127.0.0.1 0; 127.0.0.1 0;

988
.dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
.dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
104.196.57.92 1; 104.154.120.187 1;
127.0.0.1 1; 127.0.0.1 1;

2
.dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
104.196.57.92 0; 104.154.120.187 0;
127.0.0.1 0; 127.0.0.1 0;

988
.dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
.dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
104.196.57.92 1; 104.154.120.187 1;
127.0.0.1 1; 127.0.0.1 1;

2
.dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
104.196.57.92 0; 104.154.120.187 0;
127.0.0.1 0; 127.0.0.1 0;

988
.dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

988
.dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

988
.dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
.dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
35.196.72.151 0; 35.202.145.110 0;

988
.dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
.dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
35.237.56.208 1; 35.193.7.13 1;
127.0.0.1 1; 127.0.0.1 1;

2
.dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
35.237.56.208 0; 35.193.7.13 0;
127.0.0.1 0; 127.0.0.1 0;

988
.dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
.dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
35.237.56.208 1; 35.193.7.13 1;
127.0.0.1 1; 127.0.0.1 1;

2
.dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
35.237.56.208 0; 35.193.7.13 0;
127.0.0.1 0; 127.0.0.1 0;

988
.dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
.dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
35.237.56.208 1; 35.193.7.13 1;
127.0.0.1 1; 127.0.0.1 1;

2
.dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
35.237.56.208 0; 35.193.7.13 0;
127.0.0.1 0; 127.0.0.1 0;

988
.dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

3
.dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,5 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
104.196.57.92 0; 35.193.7.13 0;
35.227.97.188 0;

988
.dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

3
.dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,5 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
35.237.56.208 0; 104.154.120.187 0;
35.184.226.236 0;

988
.dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

6
.dev-tools/test4_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,6 +45,6 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
35.196.72.151 0; 35.192.85.2 0;
35.237.56.208 0; 104.154.120.187 0;
34.74.79.111 0; 35.202.145.110 0;

988
.dev-tools/test4_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

5
.dev-tools/test5_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,5 +45,6 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
35.196.158.85 0; 35.192.85.2 0;
35.196.72.151 0; 104.154.120.187 0;
35.202.145.110 0;

988
.dev-tools/test5_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
.dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
104.196.57.92 1; 104.154.120.187 1;
127.0.0.1 1; 127.0.0.1 1;

18
.dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
BacklinkCrawler Alexibot
Badass DomainCrawler
MSFrontPage Internet Ninja
NimbleCrawler RankActiveLinkBot
Ninja SBIder
Scanbot Scanbot
SlySearch scan.lol
Suzuran URLy.Warning
Who.is Bot VeriCiteCrawler
WPScan WebImageCollector

274
.dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
360Spider
404checker 404checker
404enemy 404enemy
80legs Abonti
Aboundex
ADmantX ADmantX
AfD-Verbotsverfahren
AhrefsBot
AiHitBot
Aipbot Aipbot
Alexibot
AllSubmitter
arquivo.pt arquivo.pt
arquivo-web-crawler
Aspeigel
ASPSeek
Asterias
Attach
autoemailspider autoemailspider
AwarioRssBot
AwarioSmartBot AwarioSmartBot
BackDoorBot backlink-check
Badass BackStreet
Battleztar Bazinga BackWeb
BDCbot Barkrowler
BatchFTP
Blackboard Blackboard
Black Hole
BlackWidow BlackWidow
BLEXBot Blow
BlowFish Boardreader
Bolt Bolt
BotALot
Brandprotect Brandprotect
Brandwatch Brandwatch
BuiltBotTough
BuiltWith BuiltWith
Bullseye BuzzSumo
BunnySlippers
CATExplorador
CazoodleBot CazoodleBot
CCBot
Cegbfeieh Cegbfeieh
CheTeam CheTeam
ChinaClaw ChinaClaw
Claritybot Chlooe
Cliqzbot Cliqzbot
coccocbot-web Cogentbot
cognitiveseo cognitiveseo
Collector Collector
Copyscape Copier
CopyRightCheck
Cosmos Cosmos
CrazyWebCrawler CrazyWebCrawler
CrunchBot
CSHttp CSHttp
Curious Custo
DatabaseDriverMysqli Deusu
DBLBot DigitalPebble
demandbase-bot
Demon
Devil
Digincore
Dirbuster
Disco Disco
Dispatch Discobot
DittoSpyder Discoverybot
DnyzBot DnyzBot
DomainAppender
DomainStatsBot DomainStatsBot
Dotbot Dotbot
Download Wonder
Dragonfly Dragonfly
Drip Drip
DTS Agent
EasyDL
Ebingbong
EirGrabber EirGrabber
EMail Siphon EMail Wolf
EroCrawler
Evil Evil
Express WebPictures
ExtLinksBot
Extractor
ExtractorPro ExtractorPro
Extreme Picture Finder Extreme Picture Finder
EyeNetIE EyeNetIE
Ezooms Ezooms
facebookscraper facebookscraper
FHscan FDM
Firefox/7.0 Foobot
Flunky
Freeuploader
FrontPage FrontPage
Genieo
Getintent Getintent
GetRight GetRight
Gigablast GetWeb
Gotit Gigabot
GoZilla Go!Zilla
Grabber Grabber
Grafula GrapeFX
GrapeshotCrawler
GT::WWW
HEADMasterSEO HEADMasterSEO
Heritrix heritrix
Hloader HTMLparser
HTTP::Lite
HTTrack
HybridBot
Id-search Id-search
IlseBot Image Sucker
Image Fetch InfoNaviRobot
IndeedBot InterGET
Indy Library InternetSeer
instabid ips-agent
JennyBot Iria
Iskanie
Jbrofuzz
Joomla Joomla
JustView
Jyxobot Jyxobot
Keyword Density Kenjin Spider
Kinza
Kozmosbot
LeechFTP LeechFTP
LieBaoFast LeechGet
Likse Libwhisker
LinkextractorPro Linkdexbot
LinkScan LinkpadBot
LinkWalker LinqiaRSSBot
Lipperhey LinqiaScrapeBot
Lipperhey Spider Lipperhey Spider
Litemage_walker Litemage_walker
Ltx71 Lmspider
LNSpiderguy
lwp-request lwp-request
LWP::Simple LWP::Simple
lwp-trivial
Mag-Net Mag-Net
magpie-crawler magpie-crawler
Mail.RU_Bot Majestic12
Majestic-SEO
MarkMonitor
Mass Downloader Mass Downloader
MeanPath Bot Mata Hari
meanpathbot
mediawords mediawords
MegaIndex.ru MegaIndex.ru
MicroMessenger MicroMessenger
Microsoft Data Access
Microsoft URL Control Microsoft URL Control
MJ12bot MIIxpc
Mojeek Morfeus Fucking Scanner
MSIECrawler MQQBrowser
Msrabot MSFrontPage
muhstik-scan Musobot
Nameprotect Name Intelligence
Needle NetAnts
Netcraft
NetLyzer NetLyzer
NetSpider
Nettrack
Nibbler Nibbler
Niki-bot
Nikto Nikto
NimbleCrawler NimbleCrawler
Nmap Nmap
Nutch NPbot
Octopus OnCrawl
Offline Navigator OpenLinkProfiler
Openfind OrangeBot
OPPO A33
OrangeSpider OrangeSpider
OutclicksBot OutclicksBot
OutfoxBot
PageAnalyzer PageAnalyzer
Page Analyzer page scorer
PageScorer Pavuk
PeoplePal pcBrowser
Picscout Picscout
PictureFinder Picsearch
Pimonster
Pi-Monster
plumanalytics plumanalytics
POE-Component-Client-HTTP ProPowerBot
polaris version Psbot
ProWebWalker QueryN Metasearch
PxBroker
PyCurl
Quick-Crawler Quick-Crawler
RankActiveLinkBot RankActiveLinkBot
RankFlex RankFlex
RankingBot2 RankingBot
RankurBot RankurBot
RedesScrapy RealDownload
Recorder
ReGet ReGet
Rogerbot Ripper
RSSingBot SBIder
s1z.ru scan.lol
SalesIntelligent ScoutJet
Scanbot Screaming
ScreenerBot
Searchestate Searchestate
SearchmetricsBot Semrush
SemrushBot
SEOkicks-Robot
SEOlyticsCrawler SEOlyticsCrawler
SEOprofiler
seoscanners
SeoSiteCheckup SeoSiteCheckup
SEOstats
serpstatbot
sexsearcher sexsearcher
Shodan
SISTRIX SISTRIX
SiteExplorer
SiteSnagger SiteSnagger
SiteSucker Sitevigil
Site Sucker
SlySearch SlySearch
SmartDownload
SMTBot
Snake Snake
Snapbot SocialRankIOBot
Sogou web spider sogouspider
Sosospider
Sottopop
SpaceBison
SpankBot SpankBot
Spbot
Spinn3r
SputnikBot SputnikBot
Sqlmap
Sqworm Sqworm
Sucker Steeler
Suzuran Sucuri
Swiftbot SuperBot
SurveyBot
sysscan
Szukacz Szukacz
tAkeOut Teleport
Telesphoreo TeleportPro
Telesoft
TheNomad TheNomad
Thumbor TightTwatBot
Toata Tracemyfile
Trendiction Trendiction
Trendictionbot Trendictionbot
True_Robot
TwengaBot TwengaBot
Typhoeus Typhoeus
UnisterBot
Upflow Upflow
URLy.Warning URLy Warning
Vacuum
VB Project VB Project
VCI VCI
Virusdie Virusdie
VoidEYE
Voltron Voltron
Wallpapers/3.0 WallpapersHD
WBSearchBot WBSearchBot
Webalta
WebCollage WebCollage
WebCopier
WEBDAV WEBDAV
Web Enhancer
WebFetch
Web Fetch
WebFuck WebFuck
Web Fuck Web Fuck
WebLeacher WebGo IS
webmeup-crawler
WebReaper
Web Sauger Web Sauger
WebsiteExtractor
WebsiteQuester WebsiteQuester
Website Quester
Webster
WebSucker WebSucker
Web Sucker
WebWhacker WebWhacker
Whacker
Whatweb Whatweb
Who.is Bot
WinHTTrack WinHTTrack
WiseGuys Robot
Wonderbot Wonderbot
Woobot
Wotbox Wotbox
WPScan WPScan
WWW::Mechanize WWWOFFLE
x09Mozilla
x22Mozilla
Xaldon WebSpider Xaldon WebSpider
Xaldon_WebSpider Xaldon_WebSpider
Xenu Xenu
xpymep1.exe
YoudaoBot YoudaoBot
Zauba Zauba
zgrab
Zitebot
ZmEu ZmEu
ZumBot

270
.dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
404checker
404enemy 404enemy
Abonti Abonti
ADmantX
AIBOT
AiHitBot AiHitBot
Alexibot Alexibot
Alligator
AllSubmitter AllSubmitter
AlphaBot arquivo.pt
Anarchie
Apexoo
archive.org_bot
arquivo-web-crawler
Aspeigel Aspeigel
Asterias ASPSeek
Attach Attach
autoemailspider
AwarioSmartBot AwarioSmartBot
BackDoorBot BackDoorBot
Backlink-Ceck
backlink-check backlink-check
Barkrowler Barkrowler
BatchFTP BDCbot
BDFetch
BetaBot
Bitacle Bitacle
Blackboard Blackboard
Black Hole Black Hole
BlackWidow
BLEXBot BLEXBot
Boardreader Bolt
Buddy Bullseye
BuiltBotTough
BuiltWith
BunnySlippers BunnySlippers
BuzzSumo BuzzSumo
Calculon CheTeam
CazoodleBot
CCBot
Chlooe Chlooe
Claritybot Claritybot
Cliqzbot
coccocbot-web
cognitiveseo cognitiveseo
Collector
Copier Copier
CopyRightCheck CopyRightCheck
Copyscape Copyscape
crawler4j CrunchBot
crawl.sogou.com
Custo
DatabaseDriverMysqli DatabaseDriverMysqli
Devil DataCha0s
Digincore Dirbuster
DigitalPebble Disco
Discoverybot Discobot
Dispatch
DittoSpyder DittoSpyder
DnyzBot
DomainCrawler
DomainSigmaCrawler DomainSigmaCrawler
Dotbot Dragonfly
eCatch Drip
Ecxi Ecxi
EirGrabber
EMail Wolf
EroCrawler EroCrawler
evc-batch Exabot
Evil Express WebPictures
Extractor ExtractorPro
FDM Extreme Picture Finder
EyeNetIE
FemtosearchBot FemtosearchBot
Fimap FHscan
Flunky Firefox/7.0
FlashGet
Freeuploader Freeuploader
FyberSpider Getintent
Fyrebot GetRight
Genieo
GermCrawler
GetWeb
G-i-g-a-b-o-t
Gotit Gotit
Go!Zilla GoZilla
GrabNet Grafula
GrapeFX GT::WWW
GridBot Haansoft
HaosouSpider Harvest
Heritrix Heritrix
Hloader Hloader
HMView
HTTP::Lite
HTTrack HTTrack
Humanlinks HybridBot
Id-search IDBot
IlseBot
Image Fetch
Indy Library
InfoNaviRobot InfoNaviRobot
InfoTekies InfoTekies
instabid InterGET
Intelliseek
Internet Ninja Internet Ninja
Iria ips-agent
IRLbot IRLbot
Iskanie Iskanie
JamesBOT
Jetty
JikeSpider JikeSpider
Joomla
Jorgee
JustView JustView
Kenjin Spider
Kinza Kinza
Kozmosbot Kozmosbot
Larbin Lanshanbot
Lftp Lftp
LibWeb
Libwhisker Libwhisker
LinkextractorPro
LinkpadBot LinkpadBot
LinqiaMetadataDownloaderBot
Lipperhey Lipperhey
Lipperhey Spider Lipperhey Spider
Ltx71 Litemage_walker
Lmspider
lwp-request lwp-request
LWP::Simple LWP::Simple
lwp-trivial
Magnet Magnet
Mail.RU_Bot Mag-Net
MarkWatch Majestic SEO
Mata Hari Majestic-SEO
Mb2345Browser MarkMonitor
Masscan
MauiBot
meanpathbot meanpathbot
Meanpathbot MeanPath Bot
Mediatoolkitbot
mediawords mediawords
MegaIndex.ru
Metauri Metauri
MicroMessenger MicroMessenger
Microsoft Data Access Microsoft Data Access
MIDown tool Mister PiX
MJ12bot MJ12bot
Mojeek Mojeek
Mojolicious
Morfeus Fucking Scanner
Mr.4x3
MSFrontPage MSFrontPage
MSIECrawler MSIECrawler
muhstik-scan muhstik-scan
Navroad
NearSite NearSite
Nessus NetAnts
Netcraft Netcraft
NetLyzer
NetMechanic NetMechanic
NetSpider
Nettrack
Net Vampire Net Vampire
Netvibes
Nibbler Nibbler
NICErsPRO
Niki-bot Niki-bot
Nikto Nikto
NimbleCrawler NimbleCrawler
Nmap
NPbot
Nutch
oBot
Octopus Octopus
Offline Explorer Offline Navigator
Openvas Openfind
OPPO A33
OrangeSpider
OutclicksBot
OutfoxBot OutfoxBot
PageAnalyzer PageAnalyzer
Page Analyzer
PageGrabber
page scorer page scorer
Pavuk PageScorer
pcBrowser
PeoplePal PeoplePal
Pi-Monster PHPCrawl
Picscout
Picsearch
Pixray Pixray
plumanalytics PleaseCrawl
Pockey
POE-Component-Client-HTTP POE-Component-Client-HTTP
polaris version
Probethenet
ProPowerBot
Psbot Psbot
Pump PxBroker
QueryN Metasearch PyCurl
Quick-Crawler Quick-Crawler
RankActive RankFlex
Reaper Rankivabot
Ripper RebelMouse
RocketCrawler RedesScrapy
Rogerbot
s1z.ru
scan.lol scan.lol
ScoutJet
Screaming Screaming
SearchmetricsBot ScreenerBot
Searchestate
SemrushBot SemrushBot
SEOkicks-Robot SEOlyticsCrawler
Seomoz Seomoz
SEOprofiler
SeoSiteCheckup
serpstatbot serpstatbot
sexsearcher
Siphon Siphon
SISTRIX Sitebeam
Site Sucker SiteExplorer
Sitevigil Siteimprove
SiteLockSpider
SiteSnagger
SiteSucker
SlySearch SlySearch
SmartDownload
SMTBot SMTBot
Snake
Snapbot Snapbot
Snoopy
Sociscraper Sociscraper
SpaceBison
Spammen Spammen
SpankBot
Spanner
sp_auditbot
Spinn3r
spyfu spyfu
Sqlmap Sqlworm
Steeler
Stripper Stripper
SuperBot Surfbot
SurveyBot
Suzuran
sysscan
Szukacz Szukacz
T0PHackTeam
tAkeOut
Teleport Teleport
TeleportPro
Telesoft Telesoft
Telesphoreo
Telesphorep
TheNomad TheNomad
Thumbor Thumbor
TightTwatBot
Titan Titan
Toata Toata
Toweyabot Trendiction
Trendictionbot
trendiction.com
True_Robot True_Robot
Turingos Turingos
Turnitin URLy.Warning
TurnitinBot VB Project
VeriCiteCrawler VeriCiteCrawler
VidibleScraper
Voil Voil
WallpapersHD Voltron
Wallpapers/3.0
WBSearchBot WBSearchBot
Web Auto Webalta
WebBandit WebCollage
Web Collage WEBDAV
WebCopier WebFetch
WebEnhancer Web Fetch
Web Enhancer
Web Fuck Web Fuck
WebGo IS
WebImageCollector
WebLeacher
WebmasterWorldForumBot WebmasterWorldForumBot
webmeup-crawler webmeup-crawler
Web Pix WebReaper
Web Sauger
Webshag
WebsiteExtractor WebsiteExtractor
Webster WebsiteQuester
Website Quester
WebWhacker WebWhacker
WeSEE
Whacker Whacker
Whatweb Whatweb
Who.is Bot
Widow
WinHTTrack WinHTTrack
WISENutbot
Wonderbot Wonderbot
Wotbox
Wprecon
WPScan WPScan
WWW-Mechanize
x22Mozilla
Xaldon_WebSpider
Xenu
xpymep1.exe xpymep1.exe
YoudaoBot
Zade Zade
zauba.io Zeus
Zermelo ZumBot
zgrab ZyBorg

20
.dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
asscenihotosidea.blogspot.co.za agroeconom.kz
constantaservice.net arcteryxstore.online
dating-time-now.com call-of-duty.info
db.speedup.gdn freshsuperbloop.com
ec-file.info gok-kasten.net
inet-traffic.com pornonik.com
moscow-clining.ru seorankinglinks.com
myfreemp3.eu usadacha.net
vapomnoncri.tk webradiology.ru
yougetsignal.com xnxx699.com

932
.dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
03p.info 00go.com
0n-line.tv 1adult.com
101flag.ru
108shot.com
123any.com
123cha.com
178evakuator178.ru
1flag.co.za
1-free-share-buttons.com
24-ak.ru 24-ak.ru
28n2gl3wfyb0.ru 24videos.tv
45en.ru 2itech.ru
4inn.ru 3dracergames.com
7a2rnuey1tw9ar.ru 51.la
7fon.ru 66cpwgln.space
8si.ru 72-news.com
abctoppictures.net 7yue.org
adanih.com a96527gi.beget.tech
adcash.com aa08daf7e13b6345e09e92f771507fa5f4.com
adidas.frwebs.fr aarbur.com
aasoldes.fr
adman.se
adpremium.org adpremium.org
adtech.de adsland.men
adultfriendfinder.com adtech.us
adult-shop.com.ua adultnet.in
adzpower.com afslankpillen2017nl.eu
ageofclones.com akama.com
aksonural.ru aksonural.ru
alfa9.com alfa-img.com
alive-ua.com alf-img.com
all4invest.info aliexpresscashback.club
alldownload.pw allkrim.com
allknow.info allpdfmags.net
allmarketsnewdayli.gdn alt-servis.ru
allornamenti.com amateurlivechat.org
amazingninja.com
anaksma.info anaksma.info
appartement-stumm.at applicationg29.com
arabgirls.adultgalls.com apptester.tk
arraty.altervista.org arenanews.com.ua
as5000.com asiengirls.net
asmxsatadriverin.aircus.com asrvrep-a.akamaihd.net
asscenihotosidea.blogspot.com auto.rusvile.lt
audiofree.ru autoua.top
back.dog aviva-limoux.com
balkanfarma.org azartclub.org
balla-boo.se azazu.ru
battlecarnival.su b00kmarks.com
bausparen.bz.it babieca.com
beauby.ru bankcrediti.ru
beclean-nn.ru bank.uz
berlininsl.com bbtec.net
best-games.today beachfix.co
becuo.com
bedcapdealers.com
benchmarkcommunications.co.uk
bestdooz.com
bestofupload.info
bestplacetobuyeriacta.jw.lt bestplacetobuyeriacta.jw.lt
bestpornuha.com big-cash.net
bestpriceninja.com binaryoptionscops.info
bezlimitko.xyz bioscorp.ru
bkns.vn biznesluxe.ru
blog-hits.com bjetjt.com
blogig.org blogig.org
bmwhighperformers.com blogqpot.com
bochemit.com.ua bonky.biz
boc.kz bonzbuddy.com
boeuklad.com bookhome.info
boltalko.xyz bouda.kvalitne.cz
boobsimge.com bpro1.top
bookmark4you.com.biz bronzeaid-a.akamaihd.net
brg8.com budpost.com.ua
bristolhostel.com bugof.gq
brus-vsem.ru bupropion-sr-150-mg.us
buchananshardware.com
buketeg.xyz
burkesales.com burkesales.com
buy-cheap-online.info businescoop.men
buyk.host.sk buynorxx.com
buzzonclick.com buypanicdisorderpill.com
candytiner.com buyviagraa.blogspot.com
carina-sy.de bytimedance.ru
cartierring.xyz callcafe.info
cartiertrinity.xyz calstaterealty.us
cenokos.ru carapics.com
cenoval.ru carstrends2015.com
cercacamion.it cartierlovestore.com
chcu.net catalogs-parts.com
cheatcode-lita12.rhcloud.com cbozhe.com
chelnytruck.ru cezartabac.ro
chocolateslim-original.com chastnoeporno.com
cialis-samples.com cheapbarbour.online
cinemaflix.website cheapmoncler.pw
ci.ua cheapmoncler.win
clayvasedesigns.tk cheapsergiorossi.online
clickprotects.com check-this-out-now.online
clips.ua.ac.be chorus.terakeet.com
club-musics.ru cigarpass.com
codq.info cindymatches.com
comeondog.info citizenclsdriveri7.pen.io
compliance-alexa.top cleanallvirus.com
compliance-checker-7.info cmd.kz
compliance-mark.top cobaltpro.ru
concealthyself.com co.lumb.co
conciergegroup.org compiko.info
connectionstrenth.com compliance-george.xyz
contentlook.co cool-wedding.net
countbertwistdisp26.soup.io craftburg.ru
counterbot.com cubook.supernew.org
customerpromos-a.akamaihd.net customchocolate.business-for-home.com
cyse.tk customcollegeessays.net
czat.wp.pl custom-product-labels.com
dafatiri.com dafatiri.com
dataloading.net daneshetabiat.com
ddlmega.net dating-time-now.com
dealitright.click db.speedup.gdn
dinkolove.ya.ru dealighted.com
dividendo.ru decenttools.com
djekxa.ru dekoration.us
djstools.com dellalimov.com
dnepr-avtospar.com.ua den-noch24.ru
dogclothing.store descargar-musica-gratis.net
dominateforex.ml dev33.dioniqlabb.se
diarioaconcagua.com
dimfour.com
directrev.com
disruptingdinnerparties.com
dnsrsearch.com
docs4all.com
doctissimo.fr
doktoronline.no
domaincrawler.com
domoysshop.ru domoysshop.ru
donvito.unas.cz downloadeer.net
doyouknowtheword-flummox.ml drunkmoms.net
dprtb.com dumpsmania24.com
e-avon.ru edge.sharethis.com
educatemetv.com
ege-essay.ru
ekn-art.se
ekobata.ru
ekspertmed.com ekspertmed.com
elektrischezigarette1.blog.pl electronicadirect.com
elektrischezigarettekaufen2.cowblog.fr elektronischezigarettekaufen1.myblog.de
elvel.com.ua elidelcream.weebly.com
emailaccountlogin.co elkacentr.ru
emergencyneeds.org
englishgamer.com englishgamer.com
enhand.se erot.co
eshop4u.jp ertelecom.ru
eshop.md esnm.ru
espaceinventoristes.com exchanges-bet.com
essayassist.com extlinks.com
eu-cookie-law.blogspot.com extremepornos.net
eugenevaultstorage.com ezigarettenshop2.myblog.de
everypony.ru failingmarriege.blogspot.com
exdocsfiles.com faptitans.com
eyessurgery.ru fashion-stickers.ru
eywords-monitoring-your-success.com faz99.com
ezigarettekaufen1.hpage.com femdom.twiclub.in
ezigarettenshop1.yolasite.com financeloan.us
ezigarettenshop2.postbit.com findpics.pw
ezigaretteshop2.mywapblog.com fitnesspiks.com
factorynightclub.com flash4fun.com
fashionavenuegame.com florida-tourism.net
fashion-mk.net flowwwers.com
fil.ru focalink.com
findacheaplawyers.com forex.osobye.ru
findsexguide.com foto-basa.com
flavors.me franklinfire.co
fm-upgrade.ru free-share-buttons.blogspot.com
fodelsedagspresenter.nu free-social-buttons.com
forminecrafters.ru freeuploader.com
forum20.smailik.org freshberry.com.ua
fotoxxxru.com funnel.co.za
freelinkbuilding.website.tk futbolkisales.ru
freewareseek.com fxgallery.com
freshsuperbloop.com fym.com.ru
freza-sverlo.ru gallerylisting.com
funcrushgames.com gambarkataku.co
fun-mobi.pl gameprimary.com
funponsel.com geile-lelly.eu
galaxys6manual.info gemgrab-a.akamaihd.net
gallerily.com generousdeal-a.akamaihd.net
gaygalls.net gettpromos.com
gdzkurokam.ru gfaq.ru
gentamicineyedrops.blogspot.com gheus.altervista.org
germes-trans.com gigapeta.com
getyourimage.club
gigixo.com gigixo.com
girlgamerdaily.com girlsfuckdick.com
girlspicsa.com girls-ufa.ru
glall.ru glall.ru
goodnightjournal.com gne8.com
goosefishpost.bid go2album.com
gorodservis.ru go2mike.ru
gpms.org.my gogalleryawesome.com
gq-catalog.gq goldadpremium.com
grtyi.com goldenggames.com
gsasearchengineranker.site gosreg.amchs.ru
greenzaim.ru
growmyfunds.ca
gsasearchengineranker.space gsasearchengineranker.space
hatdc.org gsou.cf
hdimagelib.com guarrasdelporno.xxx
hdpixent.com guge.io
hdseriale.pl guod.me
health-medical-portal.info gwebtools.com.br
heartofbeijing.blogspot.com hanwei.us
hermesreplica.pw hasshe.com
hildinghr.se hayate.biz
himazin.info hd-film.pl
hitmuzik.ru hdwallpapers-free.com
hoholikik.club heatpower.ru
hostsshop.ru heroz.fr
host-tracker.com himgaws.pw
hoterika.com homedecoguide.info
hothor.se hoporno.com
housediz.com hostingclub.lk
howtoclean.club houdom.net
htmlcorner.com huhn.altervista.org
https-legalrc.biz hundejo.com
ilmen.net hyhj.info
ilo134uloh.com ictizanidinehcl4mg.blogspot.com
imgarit.pw images.gyffu.com
iminent.com imguramx.pw
incanto.in.ua i-midias.net.br
incest-ru.com imitex-plus.ru
inclk.com impresagaia.it
indetiske.ya.ru infoupdate.org
infodocsportal.com inmate-locator.us
infowarcraft.ru interior-stickers.ru
inspiring-desperate.tk invitefashion.com
investingclub.ru iomoio.net
invest-pamm.ru iopeninghours.co.uk
investpamm.ru isotoner.com
ipostroika.ru itsdp3.com
iron-age.info ivoiretechnocom.ci
islamtoday.co.za iweblist.info
iyasimasennka.com
j33x.com
jabimgo.pw
javatex.co.id javatex.co.id
je7.us javlibrary.cc
jeremyeaton.co
jerseysbizwholesalecheap.com jerseysbizwholesalecheap.com
jerseyschinabizwholesale.us
jerseyssportsshop.com jerseyssportsshop.com
jose.mulinohouse.co jewelryandfiligree.com
jurajskie.info johnrobertsoninc.com
justbcause.com jrpmakati.com
kaidalibor.de kazan.xrus.org
kamalsinha.com keywordhouse.com
karachev-city.ru kino2018.club
karpun-iris.ru kinoduh.ru
kerwinandcariza.com
keywesthideaways.co
kicknights.gq
kino-ecran.ru
kinohall.ru
kinohit1.ru
kit-opt.ru kit-opt.ru
knogg.net kndxbkdx.bloger.index.hr
kolotiloff.ru kochanelli.com
konpax.com kol-energo.ru
krasnodar.xrus.org kometars.xyz
kutikomi.net krasivye-devushki.net
kvartiry-remont.ucoz.ru krynica.info
kumuk.info
kunstaktien.info
kupiproday.com.ua
kupit-adenu.ru
ladsup.com ladsup.com
laparfumotec.com lanadelreyfans.us
lecbter-relationships.ga laxob.com
lesbian.xyz liffa.ru
letslowbefast.today livetsomudvekslingstudent.bloggersdelight.dk
life-instyle.com loadingpages.me
light.ifmo.ru locatellicorretor.com.br
lion.misba.us locksmith.jp
littlecity.ch lombia.co
littlesexdolls.com lost-alpha.ru
live-cam6.info lsex.xyz
livejasmin.com lubetube.com
lizace.com lumb.co
lkbennettoutlet.online machicon-akihabara.info
lollypopgaming.com mac-shield.com
longgreen.info mafcards.ru
lostfilm-online.ru marmitaco.cat
louboutinreplica.xyz martlinker.com
lowephotos.info max-p.men
lyngdalhudterapi.no m.b00kmarks.com
magazintiande.ru mbiologi.ru
magento-crew.net mecash.ru
mamasuper.prom.ua mediaoffers.click
mastershef.club medicinacom.ru
max-eclat.men megaindex.ru
medizinreisen.de metalonly.info
medmajor.ru mhtr.be
mexicosleevegastrectomy.com militarysale.pro
m-google.xyz moetomnenie.com
mielec.pl morlat.altervista.org
mindbox.co.za moroccosurfadventures.com
mir-business-24.ru most.gov.iq
mlvc4zzw.space mp3downloadhq.com
modabutik.ru mtmtv.info
moesexy.com mug-na-chas-moscow.ru
mojowhois.com musflashtv.com
moneymaster.ru muycerdas.xxx
more-letom.ru mybinaryoptionsrobot.com
movies-in-theaters.net mydirtyhobby.com
mozello.ru myiptest.com
mp3ringtone.info napalm51.nut.cc
msk.afora.ru nelc.edu.eg
myblogregistercm.tk nfljerseysforsalewholesaler.com
myseoconsultant.com no-fuel.org
nalogovyy-kodeks.ru nonameread45.live
narkologiya-penza.ru novgorod.xrus.org
nate.com nufaq.com
na-telefon.biz nuup.info
negociosdasha.com
newyorkhotelsmotels.info
nikitsyringedrivelg.pen.io
obsessionphrases.com obsessionphrases.com
odesproperty.com okayimage.com
odywpjtw.bloger.index.hr oklogistic.ru
offf.info ok.ru
onblastblog.online onefilms.net
one-gear.com onlineserialy.ru
onlinebay.ru o-o-8-o-o.ru
oops-cinema.ru ops.picscout.com
openmultipleurl.com orel-reshka.net
outclicks.net orsonet.ru
ownshop.cf osagonline.ru
oxotl.com osnova3.ru
paidonlinesites.com
pandroid.co
paperwritingservice17.blogspot.ru
partybunny.ru partybunny.ru
pathwhelp.org pcboa.se
perosan.com pearlisland.ru
photorepair.ru peekyou.com
picquery.com pekori.to
picture-group.com petrovka-online.com
pills24h.com pics-group.com
pintattoos.com pierrehardysale.online
pisanieprac.info pirateday.ru
pixell.club pk-services.ru
platinumdeals.gr plastgran.com
pokemongooo.ml platesauto.com
polybuild.ru poem-paying.gq
polcin.de
polytopesexempt.com
popcash.net popcash.net
pornoforadult.com pornoelita.info
pornotubs.com pornohd1080.online
prefersurvey.net pornosee.info
pretty-mart.com pornzone.tv
prizefestival.mobi portnoff.od.ua
prizesbook.online postclass.com
prlog.ru preventheadacheguide.info
productarium.com progress-upakovka.ru
produkto.net promalp-universal.ru
promgirldresses.xyz pro-poly.ru
pron.pro pro-tec.kz
pukaporn.com psvita.ru
raisedseo.com quality-traffic.com
rankingchart.de quebec-bin.com
registrationdomainsite.com quick-offer.com
replicaclub.ru quick-seeker.com
replica-watch.ru qwarckoine.com
responsinator.com rada.ru
restorator-msk.ru rangjued.com
rethinkwasteni.info reklama1.ru
rimedia.org remont-comp-pomosh.ru
rixpix.ru rfserial.net
rospromtest.ru ring4rhino.com
royalads.net robot-forex.biz
ruclicks.com rollercoin.com
salmonfishingsacramentoriver.com rootandroid.org
saneitconsulting.com rosbalt.com.ua
santechnik.jimdo.com ros-ctm.ru
sa-rewards.co.za rumamba.com
scanner-fred.top ruscoininvest.company
sdi-pme.com rustic-quiver.win
searchmywindow-a.akamaihd.net rvzr-a.akamaihd.net
see-your-website-here.com sack.net
segol.tv sanjosestartups.com
seoboxes.com sankt-peterburg.nodup.ru
seocheki.net sape.top
seoprofiler.com scanmarine.info
serptehnika.ru scanner-brian.top
servingnotice.com scanner-john.top
servisural.ru schlampen-treffen.com
searchinterneat-a.akamaihd.net
secretscook.ru
securesmrt-dt.com
semaltmedia.com
sendearnings.com
seoanalyses.com
seoheap.com
serdcenebolit.com
sexcamamateurchat.com
sexreliz.com
sexstream.pl sexstream.pl
sfd-chess.ru sexvporno.ru
sfj-ror.no sexxdate.net
shakhtar-doneck.ru sexyteens.hol.es
shmetall.com.ua shohanb.com
shopvilleroyboch.com.ua sim-service.net
sideeffectsoftizanidine.blogspot.com sitebeam.net
sisi-go.ru site-speed-check.site
site5.com sitevaluation.org
site.ru sivs.ru
sitevalued.com sixcooler.de
sk.golden-praga.ru skanninge.se
sklad-24.ru slowmacfaster.trade
skladvaz.ru smailik.org
skytraf.xyz snip.tw
smartadserver.com snworks.com
social-s-ggg.xyz soc-proof.su
sockshare.net
soda.media
softomix.com softomix.com
solicita.info sohoindia.net
solnplast.ru solitaire-game.ru
sonata-arctica.wz.cz sortthemesitesby.com
spacash.com soserfis.com
sprttrack.com space4updating.win
sps-shop.com spb-plitka.ru
srecorder.com
sr-rekneskap.no sr-rekneskap.no
staff.prairiesouth.ca stard.shop
stanthonyscatholicchurch.org sticken.co
startwp.org stickers-market.ru
stillmiracle.com stroiminsk.org
strigkaomsk.ru superiends.org
stroydetali.ru sygraem.com
sudexpert66.ru symbaloo.com
sugarlyflex.pw syndicate.fun
superfish.com taqplayer.info
superstats.com tastyfoodideas.com
surcentro.com tech4master.com
svarkagid.com telegraf.by
swimpool.ca tengohydar.tk
taaaak.com thaismartloan.com
taboola.com thegamerznetwork.com
tagil.zrus.org the-usa-games.blogspot.com
tam-gde-more.ru thexart.club
taqywu51.soup.io tizanidinehcl4mgtablet.blogspot.com
tedxrj.com tizanidinehydrochloride4mgstreetvalue.blogspot.com
telefonsexkostenlos.tk
telegramdownload10.com
templates.radiodigital.co
thedownloadfromwarez.blogspot.com
theendivechronicles.com
thegalerie.eu
thegolfclub.info
theporndude.com
theprofitsmaker.net
thin.me.pn
timdreby.com
timhost.ru
tivolibasket.it
tizanidinehcl2mg.blogspot.com
tizanidineoral.blogspot.com
tizanidineusedfor.blogspot.com tizanidineusedfor.blogspot.com
tizanidinevsvalium.blogspot.com tksn.ru
tizanidinewithdrawal.blogspot.com toloka.hurtom.com
tnctrx.com tonivedu.it
tracxn.com tootoo.to
trafficjunky.com topbestgames.com
topsiteminecraft.com
torontoplumbinggroup.com
trafficnetzwerk.de trafficnetzwerk.de
traffixer.com
traffmonster.info
trahic.ru
treasuretrack-a.akamaihd.net
trkur.com
tsstcorpcddvdwshbbdriverfb.aircus.com tsstcorpcddvdwshbbdriverfb.aircus.com
turbo-suslik.org tsyndicate.com
tvorozhnaja-zapekanka-recept.ru txxx.com
twinderbella.com uchetunet.su
twittrading.com udayavani.com
twojebook.pl uggsale.online
tx41tclega.ru
typer.one
umg-stroy.ru umg-stroy.ru
undergroundcityphoto.com univerfiles.com
uogonline.com unrealcommander.biz
vesnatehno.com ural-buldozer.ru
via-energy-cumpara.com usbggettwku.ga
via-gra.webstarts.com utiblog.fr
viberdownload10.com uzungil.com
videochaty.ru vabasa.inwtrade.com
videogamesecrets.com vashsvet.com
videospornogratisx.net vchulkah.net
vigrx-original.ru via-energy-order.com
vkgaleria.com video-chat.cn
vrnelectro.ru viel.su
wahicbefa31.soup.io viktoria-center.ru
wapsite.me vinsit.ru
watsonrealtycorp.com voluumtracker1.com
weblo.com vrotike.ru
webmasters.stackexchange.com vroze.com
vsexkontakte.net
wanker.us
wareseeker.com
wdrake.com
web.cvut.cz
websiteaccountant.de
website-analyzer.info
website-speed-checker.site website-speed-checker.site
websites-reviews.com websites-reviews.com
weddingdresses.xyz website-stealer.nufaq.com
weightatraining.com webstatsdomain.org
welcomeauto.ru welcomeauto.ru
wholesalejerseys-cheapest.com wesharepics.info
winwotgold.pl wjgony.com
worldoffiles.ru wnoz.de
wurr.voila.net woman-orgasm.ru
ww2awards.info womens-journal.net
wstroika.ru
www.arenda-yeisk.ru www.arenda-yeisk.ru
wyniki-lista.pl wygraj-teraz.com
x-diesel.biz xcombear.ru
xgftnlrt.bloger.index.hr xn-----6kcaabbafhu7cskl7akvongwpo7hvjj.xn--p1ai
xlolitka.com xn----7sbaphztdjeboffeiof6c.xn--p1ai
xn----7sbahjd3btneuw1joc.xn--p1ai xn----7sbho2agebbhlivy.xn--p1ai
xn--80aaagvmjabrs1aoc9luc.xn--p1ai xn--80aaafbn2bc2ahdfrfkln6l.xn--p1ai
xn--80ajjbdhgmudixfjc8c5a9df8b.xn--p1ai xn--80aafb2a.xn--p1ai
xn----9sbubg3ambdfl1j.xn--p1ai xn--80aeahghtf8ac5i.xn--p1ai
xn--hxazdsfy.blogspot.com xn----8sbhefaln6acifdaon5c6f4axh.xn--p1ai
xn--oogle-wmc.com xn----ctbigni3aj4h.xn--p1ai
xxxkaz.org xportvusbdriver8i.snack.ws
xz618.com xxx-treker.ru
yadro.ru xxxtube69.com
yellowads.men yaoguangdj.com
yhit.press yellocloud.be
youradulthosting.com yoluxuryevents.com
youjizz.vc
yourporngay.com yourporngay.com
you-shall-not-pass.is74.ru zacreditom.ru
zahvat.ru zigarettenonlinekaufen2.bloog.pl
zarajbuilders.com znakomstva-piter78.ru
zdesoboi.com znaniyapolza.ru
zero1.it zog.link
zeroredirect11.com
zeroredirect12.com
zigarettenonl.canalblog.com

478
.dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
0daymusic.org 0lovespells0.blogspot.com
3dracergames.com 12masterov.com
3weekdiet.com 4kepics.com
4senses.co 4senses.co
a96527gi.beget.tech 7makemoneyonline.com
aa14ab57a3339c4064bd9ae6fad7495b5f.com aa625d84f1587749c1ab011d6f269f7d64.com
aab94f698f36684c5a852a2ef272e031bb.com acgs.tk
acads.net adman.gr
adcash.com adultwebhosting.info
ads.gold adzpower.com
adultmeetonline.info afmuseum.com
air-edem.ru airlandsea.info
akuhni.by
akvamaster.dp.ua
alert-hgd.xyz
alessandraleone.com
aliexpresscashback.club aliexpresscashback.club
allwidewallpapers.com allnews.md
altamayoztourism.com
alta-realestate.com alta-realestate.com
amateurlivechat.org ananumous.ru
amazon-adsystem.com apidigidocketnet-a.akamaihd.net
amt-k.ru apiitsthirteende-a.akamaihd.net
anal-acrobats.hol.es appsaurus.com
anlimebel.kiev.ua arclk.net
anmysite.com
apiadanaknet-a.akamaihd.net
appartement-stumm.at
applyneedy.xyz
arcteryxsale.online
artdestshop.eu artdestshop.eu
auto-zapchasti.org aruplighting.com
avirasecureserver.com atley.eu.pn
azartmsl.com aviav.org
beachpics.com avtovolop.ru
bedcapdealers.com backlinkwatch.com
berrymall.ru baoxaydung.com.vn
bigames.online beatifullandscape.co
big-boards.info bestofupload.info
bimatoprost-careprost.com bestpornuha.com
bimatoprost-careprost.com.ua bestsexyblog.com
biznesluxe.ru bigpenisguide.com
bjanshee.ru biznesrealnost.ru
bonvillan.com bonzbuddy.com
buigas.00it.com cablecar.us
bum.com.ru carstrends2015.com
buqyxa.rincian.info cementaresearch.se
buzzurl.jp cheapcigarettesc.info
calvet.altervista.org cialgenisrx.com
candlewooddentalcentre.com.au clean-start.net
cardsdumps.com clickpapa.com
carloans.com com-secure.download
cartierbraceletsreplica.pw cookie-law-enforcement-hh.xyz
cartierreplica.win coolwallpapers4k.info
casablancamanor.co.za counter.bloke.com
cb.iphantom.com creams.makeforum.eu
c-english.ru dailyrank.net
centraletermice.us dataloading.net
cheapbarbour.online dev78.dioniqlabb.se
cheapmoncler.pw diffbot.com
chee-by.biz documentsite.net
classicakuhni.ru dominateforex.ml
cleanersoft.com
compliance-donald.xyz
compliance-jess.top
consorzioilmosaico.org
cosmetic.donna7753191.ru
craftburg.ru
cs-passion.pl
cubook.supernew.org
danashop.ru
dayibiao.com
decorationspcs.com
depositfiles-porn.ga
diesel-parts28.ru
dispo.de
dokumentalkino.net
domaineaneblanc.com
domainroam.win
dood.live dood.live
downtuptv.gq e-avon.ru
eachdayisagift.review ekaterinburg.xrus.org
easyukraine.com ekosmetyki.net.pl
efkt.jp elektrozigarette1.dreamwidth.org
erotische-geschichten-xxl.com elektrozigaretten1.tumblr.com
esnm.ru elvel.com.ua
evaashop.ru enge-fotzen.info
expresstoplivo.ru erotik0049.com
extremepornos.net exoclick.com
ezigarettekaufen2.blox.pl expertblog.info
f00kclan.de fantasticpixcool.com
fettefrauen.net ferretsoft.com
ff30236ddef1465f88547e760973d70a.com fidelityfunding.com
filkhbr.com filesmonster.porn
fil.ru finuse.com
fiverr.com flirt4free.com
flavors.me forum69.info
f-loaded.de fotzen-ficken.com
foodcrafts.website free-fb-traffic.com
forpostlock.ru frustrated-favorable.gq
freelifetimefuckbook.com fuel-gas.com
free-share-buttons.blogspot.com gamerscorps.com
gallerylisting.com gdzkurokam.ru
gateway.zscalertwo.net geckoandfly.com
gaytube.com getmiro.com
gearcraft.us gk-atlant.info
glavprofit.ru
globatur.ru globatur.ru
graphics8.info
greenidesign.co greenidesign.co
green-tea.tv
gsasearchengineranker.space
guge.io
gyffu.com gyffu.com
handicapvansarea.com hd-filmy.net
hausfrauensex18.com hem.passagen.se
hollywoodactress.info herehloadibs.cf
hostingclub.lk hesteel.pl
hoverboard360.se honyaku.yahoofs.jp
ilovevitaly.com hoterika.com
imagecoolpub.com hotxnights.info
incep.imagine-ex.co hyiphunter.org
increasewwwtraffic.info iminent.com
infospot.pt impisr.ru
instabid.tech inclk.com
interfucks.net incomekey.net
islamtoday.co.za indetiske.ya.ru
janavibekken.no int.search.mywebsearch.com
javatex.co.id int.search.tb.ask.com
javstock.com investsuccess.org
jerseysbizwholesalecheap.com iomoio.net
jumptap.com itronics.ca
kerwinandcariza.com jabimgo.pw
ketoanhanoi.info jikoman.info
kevblog.top kamen-e.ru
kino-rating.ru kerch.site
klin3952.ru kerei.ru
kountrylife.com keywordblocks.com
kozhniebolezni.com kidd.reunionwatch.com
law-check-eight.xyz kladrus.ru
lego4x4.ru kleine-titten.biz
lion.bolegapakistan.com kollesa.ru
lion.snapmap.us lacasamorett.com
lolnex.us languagecode.com
lomza.info larutti.ru
mabdoola.blogspot.com lazy-z.com
mailemedicinals.com letsart.ru
mall.uk linkbolic.com
marcowebonyodziezowe.pl linkdebrideur.xyz
max-eclat.men livejasmin.com
mbiologi.ru lyngdalhudterapi.no
malls.com
manipulyator-peterburg.ru
mcnamaratech.com
mebel-ekb.com
medicine-4u.org
medicineseasybuy.com medicineseasybuy.com
menetie.ru meetlocalchicks.com
menstennisforums.com minecraft-rus.org
more-letom.ru minet.club
moroccosurfadventures.com missclub.info
mustat.com moesonce.com
myiptest.com mountainstream.ms
mykings.pw moviezbonkerssk.cf
narkologiya-belgorod.ru musicas.baixar-musicas-gratis.com
neodownload.webcam mybinaryoptionsrobot.com
netfacet.net networkcheck.xyz
no-fuel.org new-apps.ru
nonews.co oballergiya.ru
normalegal.ru oddamzadarmo.eu
novgorod.xrus.org oklogistic.ru
officedocuments.net onlinedomains.ru
okmusic.jp onthemarch.co
oneclickfiles.com o-o-6-o-o.com
oneshotdate.com ooo-gotovie.ru
onlineporno.site openlibrary.org
onlinewritingjobs17.blogspot.ru oranga.host.sk
openmediasoft.com orion-v.com
ozas.net owathemes.com
pathwhelp.org paceform.com
pendelprognos.se papasdelivery.ru
pistonclasico.com partner-print.men
piulatte.cz pepperstyle.ru
poems.com.ua pirateday.ru
pons-presse.com popugaychiki.com
popcash.net porndairy.in
porn555.com pornzone.tv
pornogad.com pozdravleniya-c.ru
propranolol40mg.blogspot.com predominant-invent.tk
prostitutki-odessa.org privatamateure.com
pskcijdc.bloger.index.hr privatov-zapisi.ru
quality-traffic.com prize44.com
ranksignals.com prohoster.info
resultshub-a.akamaihd.net proprostatit.com
sashagreyblog.ga prostitutki-rostova.org
sbwealthsolutions.ca pssucai.info
scanner-nelson.top pts163.ru
sdi-pme.com queerspace.com
selectads.men r-control.ru
servicecenter.co.ua retailwith.com
serving.adbetclickin.pink rn-to-bsn.com
sextracker.de ru-dety.ru
sharpchallenge.com ruscoininvest.company
shohanb.com rvzr-a.akamaihd.net
sildenafilcitratemed.com saltspray.ru
sindragosa.comxa.com sanatorrii.ru
slowmacfaster.trade sbetodiodnye-lampy.ru
smartshoppymac.com searchencrypt.com
snip.to semaltmedia.com
snyatie-lomki-v-stacionare.ru seorankinglinks.com
soc-proof.su seo-traffic-ranking.info
spb-plitka.ru serptehnika.ru
splendorsearch-a.akamaihd.net servethis.com
streetfire.net simply.net
success-seo.com si-unique.com
taboola.com smadihome.com
tam-gde-more.ru smailik.org
techart24.com small-games.biz
textads.men smartbalanceworld.com
thecoral.com.br socialmonkee.com
thegioixekhach.com social-search.me
soft1.ru
songoo.wz.cz
soochi.co
souvenirua.com
soviet-portal.do.am
spasswelt.xyz
spinnerco.ca
spylog.com
sstroy44.ru
suggest-keywords.com
support.nopeas.sk
svetlotorg.ru
symphonyintegratedhealthcare.com
tanieaukcje.com.pl
tasteidea.com
tdsing.ru
teslathemes.com
tfxiq.com
thefotosgratis.eu
thetattoohut.com thetattoohut.com
timeallnews.ru timetorelax.biz
trafaret74.ru tjkckpytpnje.com
tramadolandtizanidine.blogspot.com toloka.hurtom.com
trudogolik.net topads.men
torontoplumbinggroup.com
tracksurf.daooda.com
traffic-club.info
trainoffend.ml
truebeauty.cc truebeauty.cc
tula.mdverey.ru truemfilelj.gq
uasb.ru twelvevisionspartyofcolorado.com
ua.tc uac.net.au
umg-stroy.ru uhod-za-sobakoj.ru
v-doc.co unmaroll.ya.ru
video--production.com upstore.me
video-woman.com uptime.com
viel.su uytmaster.ru
visitcambridge.org varbergsvind.se
viveresaniesnelli.it vduplo.ru
vseigru.one vekzdorov.ru
webextract.profound.net video-chat.cn
wejdz-tu.pl vietimgy.pw
whatsappdownload10.com vipps.com.my
wingsoffury2.com wallpaperstock.net
worldmusicfests.com webcamdevochka.com
wurr.voila.net westsextube.com
x-lime.net whereiskentoday.com
xmlinde.com wladimirpayen.com
xn-----6kccaibs5cb8afhjrfmix2n.xn--p1ai xitjw.info
xn-----7kceclhb4abre1b4a0ccl2fxch1a.xn--p1ai xn--80aeahghtf8ac5i.xn--p1ai
xn----7sbbagbq7bd5aheftfllo4m.xn--p1ai xuki.us
xn--80ahvj9e.xn--p1ai yougetsignal.com
xnxxandxvideos.com zahvat.ru
yoursearch.me za-music.mymobiplanet.com
yugk.net zdesoboi.com
zambini.ru znaniyapolza.ru
zeikopay.com zrizvtrnpale.tk
zigarettenonl.canalblog.com
zigzog.ru
znakomstva-piter78.ru
zojirushi-products.ru

29
.dev-tools/test_units/ratelimittest-beta.txt
View file

@ -1,13 +1,11 @@
<!DOCTYPE html>
<html> <html>
<head> <head><title>503 Service Temporarily Unavailable</title></head>
<title>Welcome to NginX</title>
</head>
<body> <body>
<div align=center> <center><h1>503 Service Temporarily Unavailable</h1></center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <hr><center>nginx/1.16.1</center>
<p>This is merely used for testing !!!</p>
</body> </body>
</html>
ody>
</html><html> </html><html>
<head><title>503 Service Temporarily Unavailable</title></head> <head><title>503 Service Temporarily Unavailable</title></head>
<body> <body>
@ -484,13 +482,6 @@
<hr><center>nginx/1.16.1</center> <hr><center>nginx/1.16.1</center>
</body> </body>
</html> </html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.16.1</center>
</body>
</html>
<!DOCTYPE html> <!DOCTYPE html>
<html> <html>
<head> <head>
@ -581,4 +572,14 @@
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html> </html>

29
.dev-tools/test_units/ratelimittest-master.txt
View file

@ -1,13 +1,11 @@
<!DOCTYPE html>
<html> <html>
<head> <head><title>503 Service Temporarily Unavailable</title></head>
<title>Welcome to NginX</title>
</head>
<body> <body>
<div align=center> <center><h1>503 Service Temporarily Unavailable</h1></center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <hr><center>nginx/1.16.1</center>
<p>This is merely used for testing !!!</p>
</body> </body>
</html>
ody>
</html><html> </html><html>
<head><title>503 Service Temporarily Unavailable</title></head> <head><title>503 Service Temporarily Unavailable</title></head>
<body> <body>
@ -484,13 +482,6 @@
<hr><center>nginx/1.16.1</center> <hr><center>nginx/1.16.1</center>
</body> </body>
</html> </html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.16.1</center>
</body>
</html>
<!DOCTYPE html> <!DOCTYPE html>
<html> <html>
<head> <head>
@ -581,4 +572,14 @@
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html> </html>

2
.dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
104.196.57.92 0; 104.154.120.187 0;
127.0.0.1 0; 127.0.0.1 0;

BIN
.latest_release/bots.d.tar.gz
View file

Binary file not shown.

BIN
.latest_release/conf.d.tar.gz
View file

Binary file not shown.

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2020.03.2026 #### Version: V4.2020.03.2027
#### Bad Referrers Blocked: [6831](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [6831](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [571](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [571](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2020.03.2026 #### Version: V4.2020.03.2027
#### Bad Referrers Blocked: [6831](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [6831](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [571](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [571](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -11,7 +11,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2020.03.2026 #### Version: V4.2020.03.2027
#### Bad Referrers Blocked: [6831](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [6831](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [571](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [571](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

984
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2020.03.2026 #### Version: V4.2020.03.2027
#### Bad Referrers Blocked: [6831](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [6831](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [571](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [571](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

988
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

988
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

988
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2020.03.2026 ### Version: V4.2020.03.2027
### Updated: Mon Mar 23 22:04:12 SAST 2020 ### Updated: Wed Mar 25 22:04:26 SAST 2020
### Bad Bot Count: 571 ### Bad Bot Count: 571
################################################### ###################################################
### Version Information ## ### Version Information ##