vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-04 11:40:22 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2021.11.2737 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2021-11-25 22:07:19 +00:00
parent 0d1c1dee09
commit 450048e61e
47 changed files with 76961 additions and 76954 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2021.11.2736 #### Version: V4.2021.11.2737
#### Bad Referrers Blocked: [7079](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7079](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [629](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [629](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2021.11.2736 #### Version: V4.2021.11.2737
#### Bad Referrers Blocked: [7079](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7079](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [629](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [629](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -11,7 +11,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2021.11.2736 #### Version: V4.2021.11.2737
#### Bad Referrers Blocked: [7079](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7079](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [629](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [629](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

9464
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2021.11.2736 #### Version: V4.2021.11.2737
#### Bad Referrers Blocked: [7079](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7079](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [629](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [629](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

9468
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

9468
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

9468
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

9468
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.184 1; 10.1.0.188 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.184 0; 10.1.0.188 0;
127.0.0.1 0; 127.0.0.1 0;

9468
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.184 1; 10.1.0.188 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.184 0; 10.1.0.188 0;
127.0.0.1 0; 127.0.0.1 0;

9468
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.184 1; 10.1.0.188 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.184 0; 10.1.0.188 0;
127.0.0.1 0; 127.0.0.1 0;

9468
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
2736 2737

9468
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

9468
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
52.183.65.246 0; 13.90.72.134 0;

9468
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.184 1; 10.1.0.188 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.184 0; 10.1.0.188 0;
127.0.0.1 0; 127.0.0.1 0;

9468
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.184 1; 10.1.0.188 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.184 0; 10.1.0.188 0;
127.0.0.1 0; 127.0.0.1 0;

9468
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.184 1; 10.1.0.188 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.184 0; 10.1.0.188 0;
127.0.0.1 0; 127.0.0.1 0;

9468
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
52.183.65.246 0; 13.90.72.134 0;

9468
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
52.183.65.246 0; 13.90.72.134 0;

9468
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.184 1; 10.1.0.188 1;
127.0.0.1 1; 127.0.0.1 1;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
Badass AfD-Verbotsverfahren
FyberSpider Alligator
IDBot DomainStatsBot
JamesBOT GetWeb
OrangeSpider Haansoft
ScrepyBot Kinza
Wallpapers/3.0 Linkbot
Who.is Bot MIDown tool
meanpathbot RSSingBot
seoscanners Teleport

304
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
01h4x.com
360Spider 360Spider
ADmantX ADmantX
AIBOT
ALittle Client ALittle Client
Aboundex
Acunetix Acunetix
AhrefsBot
Alexibot
AllSubmitter AllSubmitter
Alligator
AlphaBot AlphaBot
Anarchy99 Anarchie
Anthill Anarchy
Asterias Ankit
Attach BDCbot
AwarioRssBot BackWeb
Backlink-Ceck Backlink-Ceck
BacklinkCrawler Battleztar Bazinga
Badass BetaBot
BatchFTP Boardreader
BlackWidow Buck
Blackboard
Bolt
Brandprotect
Brandwatch
Buddy
BuiltBotTough
BuiltWith
Bullseye Bullseye
BunnySlippers
BuzzSumo
CATExplorador
CODE87
CSHttp CSHttp
Chlooe Calculon
Claritybot CazoodleBot
Cloud mapping Cegbfeieh
Cocolyzebot CensysInspect
Cogentbot CheTeam
CheeseBot
Copyscape Copyscape
Craftbot Cosmos
CrazyWebCrawler
Crescent Crescent
CrunchBot CrunchBot
Curious
Custo
DIIbot
DTS Agent DTS Agent
Devil Deusu
Digincore Digincore
Dirbuster Dirbuster
Disco
Discobot Discobot
Dispatch
DittoSpyder DittoSpyder
DomainSigmaCrawler DomCopBot
DomainAppender
Domains Project
Dotbot
Dragonfly Dragonfly
Drip
EMail Siphon EMail Siphon
Ebingbong EasyDL
Ecxi
EirGrabber
EroCrawler
Exabot
ExtLinksBot
ExtractorPro
Extreme Picture Finder
FDM FDM
Fimap Firefox/7.0
FlashGet
Foobot
Freeuploader Freeuploader
FrontPage GalaxyBot
Fuzz
Fyrebot
Genieo
Gigabot Gigabot
Go!Zilla Go!Zilla
Go-Ahead-Got-It GoZilla
Gotit GrabNet
Grabber
GrapeFX GrapeFX
GridBot GridBot
HEADMasterSEO
HMView
HTTrack HTTrack
Havij HaosouSpider
IDBTE4M Harvest
IDBot Hloader
IRLbot Humanlinks
Id-search Iblog
Image Fetch Image Fetch
Image Sucker
IndeedBot IndeedBot
Indy Library InfoNaviRobot
Internet Ninja
InternetSeer
JOC Web Spider
JamesBOT JamesBOT
Jbrofuzz JennyBot
JetCar JetCar
JustView Jetty
JikeSpider
Kenjin Spider Kenjin Spider
Kinza Kinza
LWP::Simple LNSpiderguy
Lanshanbot Leap
LexiBot Lftp
LibWeb LieBaoFast
Libwhisker
Lightspeedsystems
Likse
LinkScan
LinksManager
LinqiaRSSBot LinqiaRSSBot
Litemage_walker
MIIxpc MIIxpc
MSIECrawler MQQBrowser
MSFrontPage
MTRobot MTRobot
Magnet Mag-Net
Mail.RU_Bot
Majestic-SEO Majestic-SEO
MarkMonitor MarkWatch
Mass Downloader Mass Downloader
Masscan Masscan
Meanpathbot Microsoft URL Control
Metauri Minefield
Mister PiX
Mojeek Mojeek
Msrabot Morfeus Fucking Scanner
Nessus Mozlila
NetMechanic Musobot
Name Intelligence
NetZIP NetZIP
Netvibes NextGenSearchBot
Nibbler Nibbler
Niki-bot Niki-bot
Nimbostratus NimbleCrawler
Ninja
Nmap Nmap
Octopus Not
Openfind Nuclei
Nutch
Offline Navigator
Openvas Openvas
OrangeSpider OrangeBot
OutfoxBot
PECL::HTTP PECL::HTTP
PageAnalyzer PHPCrawl
PageThing.com PageThing.com
Pandalytics Pandalytics
Pavuk Pavuk
PeoplePal Pi-Monster
Petalbot
Piepmatz
Pimonster Pimonster
Pixray ProWebWalker
PleaseCrawl Probethenet
Pu_iN
Pump
PyCurl
QueryN Metasearch QueryN Metasearch
RSSingBot
RankActive RankActive
Rankivabot Reaper
RankurBot
Re-re
ReGet
RebelMouse
Recorder Recorder
RocketCrawler RedesScrapy
Ripper
Rogerbot
SEOkicks-Robot SEOkicks-Robot
SEOlyticsCrawler SEOlyticsCrawler
SalesIntelligent SEOprofiler
Scrapy SEOstats
Screaming Scanbot
ScrepyBot
SemanticJuice SemanticJuice
SemrushBot SeobilityBot
SentiBot Seomoz
Shodan
Siphon Siphon
SiteLockSpider Site Sucker
SiteSucker SiteCheckerBotCrawler
Sitebeam SiteSnagger
Sitevigil
SlySearch SlySearch
Sogou web spider Snapbot
Sosospider
Sottopop Sottopop
SpaceBison SpaceBison
SpankBot
Spanner Spanner
Spbot SputnikBot
Sqworm Sqworm
Steeler Stripper
Sucker
Sucuri Sucuri
SuperBot Surfbot
Swiftbot SurveyBot
Szukacz
T0PHackTeam
T8Abot T8Abot
Teleport
TeleportPro TeleportPro
Telesphorep
TheNomad
Thumbor
TightTwatBot TightTwatBot
Toata Titan
Trendictionbot
True_Robot True_Robot
Turingos Turingos
Turnitin
TurnitinBot
Twice Twice
Typhoeus Typhoeus
URLy.Warning URLy Warning
Upflow
VCI
Vagabondo Vagabondo
VelenPublicWebCrawler VoidEYE
VidibleScraper Voltron
WASALive-Bot WISENutbot
WBSearchBot WPScan
WWW-Mechanize WWW-Collector-E
WWW::Mechanize
Wallpapers
Wallpapers/3.0
WallpapersHD WallpapersHD
Web Fuck Web Auto
Web Sucker Web Collage
WebCopier Web Fetch
WebFuck Web Pix
Web Sauger
WebAuto
WebBandit
WebLeacher WebLeacher
WebReaper WebPix
WebSauger WebStripper
WebSucker WebSucker
WebWhacker WebWhacker
WebZIP
Webalta Webalta
Webshag Webshag
Website Quester
WebsiteExtractor
Whack Whack
Whatweb Whacker
Who.is Bot Who.is Bot
WinHTTrack Widow
WiseGuys Robot Wonderbot
Wotbox Wotbox
Zauba Xaldon WebSpider
Zermelo Xaldon_WebSpider
Zeus YoudaoBot
Zitebot Zade
ZoomBot
ZoominfoBot
ZumBot
ZyBorg ZyBorg
archive.org_bot adscanner
arquivo-web-crawler
autoemailspider autoemailspider
backlink-check backlink-check
check1.exe check1.exe
cognitiveseo com.plumanalytics
crawl.sogou.com
dataforseo.com dataforseo.com
domainsproject.org demandbase-bot
evc-batch eCatch
facebookscraper facebookscraper
heritrix heritrix
ips-agent
lwp-trivial lwp-trivial
mediawords
oBot
page scorer page scorer
pcBrowser pcBrowser
polaris version plumanalytics
probe-image-size
s1z.ru s1z.ru
satoristudio.net satoristudio.net
scalaj-http scalaj-http
seobility seocompany.store
seostar sexsearcher
sp_auditbot sitechecker.pro
spyfu sogouspider
sysscan
tAkeOut tAkeOut
trendiction.com
trendiction.de trendiction.de
ubermetrics-technologies.com ubermetrics-technologies.com
voyagerx.com
webmeup-crawler webmeup-crawler
webpros.com webpros.com
webprosbot
x22Mozilla x22Mozilla
xpymep1.exe

300
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
01h4x.com
360Spider
404enemy 404enemy
ADmantX 80legs
ALittle Client ALittle Client
Aboundexbot Abonti
Acunetix Acunetix
AhrefsBot AfD-Verbotsverfahren
AiHitBot AiHitBot
Alexibot AlphaBot
Anarchy Ankit
Apexoo Attach
Asterias
AwarioRssBot AwarioRssBot
BBBike AwarioSmartBot
BDCbot
BDFetch BDFetch
BackDoorBot BackDoorBot
BackStreet
BackWeb BackWeb
Badass BacklinkCrawler
Bandit Bandit
Barkrowler BatchFTP
BetaBot
Black Hole Black Hole
BlackWidow
Blackboard Blackboard
Blow
BlowFish BlowFish
Boardreader Boardreader
Brandprotect Bolt
Brandwatch Buddy
BuiltBotTough
BuiltWith
Bullseye
BunnySlippers BunnySlippers
CATExplorador CCBot
Calculon CensysInspect
CazoodleBot
Cegbfeieh
CheTeam
ChinaClaw ChinaClaw
Claritybot Claritybot
Cogentbot
Collector Collector
Craftbot Cosmos
Crawling at Home Project CrunchBot
DBLBot Curious
DIIbot Custo
Demon DTS Agent
DataCha0s
DatabaseDriverMysqli
Digincore
Dirbuster Dirbuster
Discoverybot Disco
DnBCrawler-Analytics DnBCrawler-Analytics
DnyzBot
DomCopBot DomCopBot
DomainStatsBot DomainAppender
DomainSigmaCrawler
Dotbot
Download Wonder Download Wonder
Dragonfly Dragonfly
Drip ECCP/1.0
EMail Siphon EMail Siphon
EMail Wolf Ecxi
EirGrabber EroCrawler
Exabot Exabot
Express WebPictures Extractor
Extreme Picture Finder
EyeNetIE
Ezooms
FDM FDM
FHscan FemtosearchBot
Fimap
FlashGet FlashGet
Foobot Flunky
Freeuploader FrontPage
Fuzz Fuzz
G-i-g-a-b-o-t Fyrebot
GT::WWW Genieo
GetWeb GermCrawler
Getintent
Gigabot Gigabot
GoZilla Grafula
GrapeshotCrawler
HEADMasterSEO HEADMasterSEO
HTTP::Lite HTTP::Lite
Haansoft
HaosouSpider
Harvest Harvest
Hloader Hloader
Humanlinks Humanlinks
IlseBot HybridBot
IRLbot
Intelliseek Intelliseek
InterGET Internet Ninja
IstellaBot IstellaBot
JikeSpider JOC Web Spider
JustView JamesBOT
JetCar
Jetty
Joomla
Keyword Density Keyword Density
Kinza
Kozmosbot Kozmosbot
Larbin Lanshanbot
Leap
LeechFTP LeechFTP
LeechGet
LibWeb LibWeb
Libwhisker Libwhisker
Linkdexbot LieBaoFast
Likse
LinkScan
LinkextractorPro LinkextractorPro
LinkpadBot
LinksManager
LinqiaRSSBot LinqiaRSSBot
Lipperhey LinqiaScrapeBot
Litemage_walker MIDown tool
Lmspider MSIECrawler
MQQBrowser Magnet
Mag-Net
Mail.RU_Bot Mail.RU_Bot
Majestic12
MarkWatch
Mass Downloader Mass Downloader
Masscan Mb2345Browser
MauiBot Moblie Safari
Mediatoolkitbot Mojolicious
MicroMessenger Morfeus Fucking Scanner
Mister PiX Msrabot
Mozlila
Mr.4x3
NICErsPRO NICErsPRO
NPbot Nameprotect
Navroad NearSite
NetAnts Needle
NetZIP NetLyzer
NetSpider
Netcraft
Nettrack Nettrack
Netvibes Niki-bot
NextGenSearchBot
NimbleCrawler NimbleCrawler
Offline Navigator Nimbostratus
Openvas Ninja
Nmap
OpenLinkProfiler
Openfind
OutclicksBot OutclicksBot
OutfoxBot
PHPCrawl PHPCrawl
Papa Foto Page Analyzer
PeoplePal
Pi-Monster Pi-Monster
Picsearch Picsearch
Pimonster PictureFinder
PleaseCrawl
Pockey Pockey
ProWebWalker ProWebWalker
Pu_iN Probethenet
Pump QueryN Metasearch
PxBroker RankActive
PyCurl
RSSingBot
RankActiveLinkBot RankActiveLinkBot
RankFlex
RankingBot
RankingBot2
Rankivabot Rankivabot
RankurBot RankurBot
Re-re
RealDownload
Reaper Reaper
RedesScrapy RedesScrapy
RocketCrawler RepoMonkey
Rogerbot Ripper
SEOkicks SEOkicks
SEOprofiler SEOprofiler
SalesIntelligent SalesIntelligent
Scanbot Scanbot
ScoutJet
Screaming Screaming
ScreenerBot Searchestate
ScrepyBot
SemrushBot SemrushBot
SentiBot SeoSiteCheckup
SeobilityBot SiteCheckerBotCrawler
SiteExplorer SiteLockSpider
SiteSnagger Sitevigil
SiteSucker SlySearch
Siteimprove Snoopy
SmartDownload Sogou web spider
Snapbot Sottopop
Spammen Spammen
SputnikBot SpankBot
Sqworm Spanner
Sucker Sqlworm
Stripper
Sucuri Sucuri
SuperHTTP SuperBot
Swiftbot Surfbot
T0PHackTeam SurveyBot
Telesphoreo Suzuran
The Intraformant Teleport
TeleportPro
Telesoft
TheNomad TheNomad
Thumbor Thumbor
Toata TightTwatBot
Tracemyfile Titan
Trendictionbot
Turingos Turingos
TurnitinBot TurnitinBot
TwengaBot TwengaBot
Typhoeus Twice
V-BOT URLy Warning
VCI Upflow
VelenPublicWebCrawler VB Project
Vacuum
VeriCiteCrawler VeriCiteCrawler
Voil Voil
Voltron WISENutbot
WWW-Collector-E WWW-Collector-E
WWWOFFLE Wallpapers/3.0
Wallpapers
WallpapersHD
WeSEE WeSEE
Web Fetch Web Fuck
Web Pix Web Pix
Web Sauger
Web Sucker Web Sucker
WebBandit WebImageCollector
WebLeacher WebLeacher
WebPix
WebStripper WebStripper
WebSucker WebSucker
WebmasterWorldForumBot WebZIP
Webalta
Website Quester
WebsiteExtractor
WebsiteQuester
Whack
Whacker Whacker
Whatweb
Widow Widow
WiseGuys Robot WinHTTrack
Woobot Wonderbot
Wotbox
Xaldon WebSpider
YoudaoBot YoudaoBot
Zade Zade
Zauba
Zermelo
Zitebot Zitebot
ZmEu adscanner
ZoominfoBot
ZumBot
archive.org_bot archive.org_bot
arquivo-web-crawler arquivo.pt
backlink-check autoemailspider
check1.exe check1.exe
clark-crawler clark-crawler
com.plumanalytics coccocbot-web
crawl.sogou.com crawl.sogou.com
crawler.feedback crawler4j
dataforseo.com dataforseo.com
domainsproject.org demandbase-bot
eCatch
evc-batch evc-batch
facebookscraper instabid
gopher
heritrix
internetVista monitor internetVista monitor
ips-agent magpie-crawler
lwp-trivial
mediawords
oBot oBot
page scorer plumanalytics
probe-image-size
ripz ripz
satoristudio.net s1z.ru
scalaj-http seobility
seocompany.store seocompany.store
sitechecker.pro sexsearcher
siteripz
sogouspider sogouspider
spyfu spyfu
voyagerx.com webmeup-crawler
webpros.com webpros.com
webprosbot
x09Mozilla x09Mozilla
x22Mozilla x22Mozilla
xpymep1.exe
zgrab

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
amateurmatch.com autotrends.today
buypillsorderonline.com candy-glam-hp.com
chocolateslim-original.com caulderwoodkennels.com
chuckguilford.com decorationspcs.com
kovesszucs.atw.hu flirt4free.com
mediawhirl.net ghazel.ru
mygameplus.com mydeathspace.com
rff-cfal.info rybalka-opt.ru
trkdf.com tilido.com
yuarra.pluto.ro wowcasinoonline.ooo

912
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
0lovespells0.blogspot.com 01apple.com
1-free-share-buttons.com 1-99seo.com
1688.com 10bet.com
1kinobig.ru 1qingdao.com
1webmaster.ml 2pxg8bcf.top
202ch.com 3xforum.ro
34.gs
4senses.co
4ur.click
4webmasters.org
5elementov.ru 5elementov.ru
7makemoneyonline.com 6128786.com
7zap.com 6hopping.com
91abcw.com 7ooo.ru
7search.com
991mostfm.co.id 991mostfm.co.id
aa8780bb28a1de4eb5bff33c28a218a930.com 9med.net
aasoldes.fr aab94f698f36684c5a852a2ef272e031bb.com
absugars.com accessoires-mode.in
adman.gr actionnooz.com
advocatemsk.ru adloads.net
agapovdg.ru adrunnr.com
akita.kz ads.gold
alert-jdh.xyz adsfresh.men
allornamenti.com adtech.fr
amospalla.es advancedsoftwaresupport.com
analytics-ads.xyz advertisingtag.net
anatomiy.com afslankpillen2017nl.eu
angel1777.kz alborzan.com
angkortours.vn alessandraleone.com
apibatbrowsecom-a.akamaihd.net alfa-img.com
apibetweenlinesn-a.akamaihd.net allcredits.su
allsilver925.co.il
aludecor.info
amateurlivechat.org
ampower.me
anaksma.info
andpolice.com
apilinkswiftco-a.akamaihd.net apilinkswiftco-a.akamaihd.net
apimegabrowsebiz-a.akamaihd.net apioasisspacenet-a.akamaihd.net
apioutoboxnet-a.akamaihd.net apisecretsaucebi-a.akamaihd.net
app-ready.xyz
appfastplay.com
apple.com-webbrowsing-security.science
appmsr.org appmsr.org
artefakct.com arendakvartir.kz
asrvvv-a.akamaihd.net arraty.altervista.org
atofilms.com artdestshop.eu
avtovolop.ru as5000.com
azartmix.com asdfz.pro
azartmsl.com atovh.local-finders.com
aviav.ru
avto-oligarh.ru
azazu.ru azazu.ru
b00kmarks.com azlex.uz
bablonow.ru
babyfactory.fr
back.dog
baersaratov.ru
bag77.ru bag77.ru
baksman.com
balois.worldbreak.com
bangla-chat-uk-paralud.ga bangla-chat-uk-paralud.ga
bannerbank.ru banki76.ru
bear.gotcher.us bedandbreakfast.com
beetpics.pw beget.tech
benchmarkcommunications.co.uk belinvestdom.by
best-way.men belstaffstore.online
bestchoice.cf bestadbid.com
bestdooz.com bestbuy.ca
bestdraws.com
bestempresas.es bestempresas.es
bestpornuha.com bestmouthwash.club
bigcities.org
biketank.ga
bimatoprost-careprost.com.ua bimatoprost-careprost.com.ua
bioinnovate.co biographiya.com
bioscorp.ru bioscorp.ru
blog.remote-computer.de bizcheapjerseyswholesalechina.com
bloggen.be biznesrealnost.ru
bloglag.com blackle.com
blogsfunky672.weebly.com blacktwhite.com
bluesalt.co blog.f00kclan.de
bmwhighperformers.com bloggers.nl
bolezniorganov.ru bookhome.info
bookmaker-bet.com brains2.biz
brainxs.us bristolhotel.com.ua
brg8.com brothers-smaller.ru
builtwith.com bugshoot.cn
business-suggested.tk buqayy0.livejournal.com
callawaygolfoutlet.online buyk.host.sk
callstevens.com buyparajumpers.online
cam-kontakte.org bwlx.prepedu.cn
canrioloadm.gq cah.io.community
carabela.com.do cakemediahq.com.au
carloans.com call-of-duty.info
cartierlovebraceletreplica.xyz candypeople.se
cartierreplica.pw carmuffler.net
castingbank.ru cartierreplica.xyz
cdnanalytics.xyz cctva.tv
cdncash.com cheapwebsitehoster.com
cenokos.ru check-this-out-now.online
cheap-pills-norx.com chimiver.info
cheapjerseysa.com chocolateslim-original.com
check-host.net christianlouboutinreplica.pw
chinajerseyswholesalecoupons.com chuckguilford.com
chocolateslim-en-france.com cialischsrx.com
chocoslim.pro cialiswithoutadoctor.net
christianlouboutinsaleonline.us circlesl.com
christianlouboutinsaleoutletonline.us claytransformations.info
cinemaflix.website clayvasedesigns.tk
clickpapa.com clickpapa.com
clicksor.com cntravelre.com
compliance-alexa.xyz com-cleaner.systems
compliance-donald.xyz cometorussia.net
compliance-olga.top compliance-george.top
computernetworksonline.com compliance-nelson.top
conboy.us comsysnet.com
coolgamechannel.com cookie-law-enforcement-aa.xyz
cordstrap.cc cookie-law-enforcement-ff.xyz
cornomase.win crd.clan.su
credit.co.ua creditnation.ru
culad.com crynet.cc
cupday.com
customerguru.in
cv.wallhade.co
darmebel.com.ua darmebel.com.ua
datadepths.com ddlmega.net
ddsoldes.fr decorazilla.com
delayreferat.ru delayreferat.ru
demian.kz dentalpearls.com.au
deniven.1bb.ru detalizaciya-tut.biz
deplim.com digital-sale.su
descargar-musica-gratis.net dildofotzen.net
design-ideas.info dimkino.ru
deutschland123.de
digitalassetmanagement.site
dimaka.info
discountliv.com
discovertreasure-a.akamaihd.net
dispo.de
distver.ru distver.ru
div.as dokumentalkino.net
dojki-hd.com domainanalyzing.xyz
dojki365.online domaincrawler.com
dostavka-v-krym.com doska-vsem.ru
download-walpaperhd.blogspot.com doxyporno.com
downloadme.life drev.biz
doyouknowtheword-flummox.ml dumpsmania24.com
dptaughtme.com dustyorate.com
drugs-no-rx.info dvrlists.com
druzhbany.ru easyshoppermac.com
dverimegapolis.ru ednorxmed.com
e-collantes.com elektir.ru
e-commerce-seo.com elektrischezigaretten1.blogse.nl
e2click.com elektrischezigaretten2.beeplog.com
e90post.com elidelcream.weebly.com
earl-brown.info energydiet-info.ru
easytuningshop.ru enthuse.computernetworksonline.com
eduinfosite.com epicbrogaming.com
efnor-ac.com eropornosex.ru
ekosmetyki.net.pl
elektronischezigarettekaufen2.tumblr.com
elektrozigarettekaufen1.devhub.com
erotikstories.ru erotikstories.ru
erotiktreff24.info etenininrade.ga
eshop.md exoclick.com
euromasterclass.ru
evening-dating-club.info
exchanges-bet.com
extstat.com
eyelike.com.ua eyelike.com.ua
ezaz.info facialporntube.com
f-online.de farm26.ru
facebook-mobile.xyz fashionindeed.ml
famix.xyz fatfasts-4tmz.com
faracontrol.ir filmfanatic.com
fba-mexico.com financehint.eu
fbdownloader.com financetip.eu
fettefrauen.net fivedwld.cf
finejewelryshop.ru flash4fun.com
flytourisme.org formulaantiuban.com
fortunejack.com
forum.doctissimo.fr forum.doctissimo.fr
fotosfotos.eu
fotoxxxru.com fotoxxxru.com
freecamdollars.com foxydeal.com
freegamesplay.online free-fb-traffic.com
freelotto.com free411games.com
freevpn.space freshberry.com.ua
froggytube.com frighteningremain.cf
front.to front.ru
fungamelands.com
funnymama.com
funtoonez.com
fym.com.ru fym.com.ru
gagrasector.ru gallerylisting.com
gate5.co.za game-top.su
ge0ip.net garciniaxt.us
generic-pills-online.com gardene.ru
getlamborghini.ga gazporno.com
gilsonchiro.xyz gembird.com
globatur.ru genericviagrasildenafiled.net
glopages.ru germes-trans.com
golaya.pw getpopunder.com
gombita.info girlspicsa.com
google-liar.ru glass-msk.ru
googlefeud.com glavprofit.ru
gratuitbaise.com goodly.pro
greatdealshop.com goodprotein.ru
gox.com.ua
grand-chlen.ru
gratuitxblcodes.com
greendream.com.ua greendream.com.ua
gsasearchengineranker.site greenidesign.co
guarrasdelporno.xxx grtyi.com
guitar-master.org gta-club.ru
hamacapty.com guge.io
harmonyglen.us hackers-crackers.tk
highland-homes.com help.tpu.ru
hildinghr.se helpmymacfaster.trade
homelygarden.com hexpilot.com
hoporno.com hkladys.com
hosting-tracker.com hmywwogw.bloger.index.hr
hotblog.top homegardenlova.com
hotchatdate.com hotel-mkad.ru
hotcore.info
hotxnights.info
house.sieraddns.com
housemilan.ru
howmuchdoestizanidinecost.blogspot.com
howopen.ru howopen.ru
humanelydrew.com https-legalrc.biz
hybrid.ru ilbe.club
ico.re iloveitaly.ru
iinstalll-fii1leis.jus0wil.pp.ua inboundlinks.win
ilovevitaly.ru intelhdgraphicsgtdrive6w.metroblog.com
importchinacoach-teach.com invest-pamm.ru
in-tandem.co investsuccess.org
infektsii.com io9.com
interfucks.net iqoption.com
investingclub.ru irkutsk.online-podarki.com
investyb.com iscblog.info
itservicesthatworkforyou.com istanbulit.com
ixora.pro ix20.ru
izismile.com iyasimasennka.com
jacago.com izhevsk.zrus.org
jolic2.com janettabridal.com
juliaworld.net javatex.co.id
junketjuice.blogspot.com javspace.net
kashubadesign.ru jerseyssportsshop.com
kaz.kz jestr.org
kazrent.com journalhome.com
kambasoft.com
keyword-suggestions.com
keywordsuggest.org keywordsuggest.org
kinoflux.net kidd.reunionwatch.com
kndxbkdx.bloger.index.hr klikbonus.com
kongoultry.net komputernaya-pomosh-moscow.ru
kongruan.com kountrylife.com
konkursowo-24.pl krafte.ru
konoplisemena.com kskjco.club
krasnodar.xrus.org kwzf.net
larose.jb2c.me labelwater.se
lesbian.xyz lacloop.info
letmacworkfaster.world ladsup.com
lflash.ru laexotic.com
lida-ru.com letslowbefast.site
lider-zhaluzi.kiev.ua linkarena.com
liky.co.ua linkbux.ru
limads.men lion.snapmap.us
locimge.pw livefixer.com
lolnex.us liveinternet.ro
lombardfinder.ru loadingpages.me
lonerangergames.com lodki-pvh.dp.ua
luckyshop.net.ua love-baby.cz
m292.info macdamaged.tech
mac-shield.com mafcards.ru
macdamaged.space maridan.com.ua
mafa-free.com medicine-4u.org
magiadinamibia.blogspot.com mejoresfotos.eu
magicdiet.gq metabar.ru
marketingvici.com mhtr.be
maslenka.kz michaelkorsoutlet.store
masthopehomes.com microsoftportal.net
matb3aa.com
mathgym.com.au
maximpartnerspr.com
medtherapy.ru
meltwater.com
member-quiz.com
michaelkorsoutletstore.net
mil-stak.com
minharevisao.com
minyetki.ru minyetki.ru
missis.top mmostrike.ru
mmgq.ru mobile-appster.ru
mobplayer.ru mockupui.com
modnie-futbolki.net moinozhki.com
moesexy.com moviezbonkerssk.cf
moi-glazki.ru mrvideospornogratis.xxx
moje-recenze.cz mug-na-chas-moscow.ru
monitorwebsitespeed.com my-bc.ru
mosdverka.ru my-big-family.com
moz.com mybackgroundlandscape.blogspot.com
mriyadh.com myperiod.club
multgo.ru myxdate.info
musirc.com narco24.me
muznachas-service.ru netoil.no
myphotopipe.com nhl17coinsforps3.gratisblog.biz
mzdish.site nibbler.silktide.com
narkologiya-belgorod.ru nippon-bearings.ru
narutonaruto.ru nofreezingmac.work
nerudlogistik.ru nordvpn.com
networkad.net notaria-desalas.com
newstraveller.ru o333o.com
newtechspb.ru obuv-kupit.ru
ningessaybe.me oda.as
niroo.info of-ireland.info
norththeface.store ofanda.com
nosecret.com.ua offer.camp
nuker.com ok-ua.info
oballergiya.ru one-gear.com
obesidadealgarve.com onlinemeetingnow.com
oddamzadarmo.eu onlineserialy.ru
odywpjtw.bloger.index.hr ooo-olni.ru
online-podarki.com ooomeru.ru
onload.pw openfrost.net
openmediasoft.com
openmultipleurl.com
orgasmatrix.com orgasmatrix.com
otbelivanie-zubov.com palvira.com.ua
p-business.ru panchro.xyz
panamaforbeginners.com park.above.com
pathwhelp.org partner-pop.men
pc-virus-d0l92j2.pw partners-ship.pro
pdn-4.com patol01.pw
perederni.net
perfectpracticeweb.com
petsblogroll.com
phrcialiled.com
picphotos.net picphotos.net
pictures-and-images.com picture-group.com
pictures-and-images.net piratecams.com
picturesify.com pix24x7.com
pinapchik.com
piulatte.cz
pivka.xyz
pixgood.com pixgood.com
pizza-imperia.com
pk-pomosch.ru
pk-services.ru pk-services.ru
pl-vouchers.com pl.id-forex.com
plastgran.com pogruztehnik.ru
playfortuna-play.ru pons-presse.com
ploenjitmedia.azurewebsites.net porno-dojki.net
plohaya-kreditnaya-istoriya.ru porno-raskazy.ru
pornoklad.ru pornoplen.com
pornosexrolik.com pornoslive.net
poshiv-chehol.ru pourvous.info
potolokelekor.ru pr-ten.de
priscilarodrigues.com.br preventheadacheguide.info
privacylocationforloc.com privacylocationforloc.com
privat-girl.net
privatov-zapisi.ru
prizefestival.mobi
prod2016.com prod2016.com
profitkode.com proekt-gaz.ru
profit-opportunity.com
progonrumarket.ru progonrumarket.ru
projefrio.com.br prosmibank.ru
prostitutki-novgoroda.org prostitutki-odessa.org
psa48.ru prostitutki-rostova.org
qcstrtvt.bloger.index.hr pshare.biz
quality-traffic.com pskcijdc.bloger.index.hr
qualitymarketzone.com pukaporn.com
quickloanbank.com putitin.me
rada.ru r-e-f-e-r-e-r.com
ranking2017.ga raschtextil.com.ua
rcb101.ru recipedays.ru
realtytimes.com reining.lovasszovetseg.hu
redirlock.com remont-mobile-phones.ru
regionshop.biz renecaovilla.online
remont-komputerov-notebook.ru renecaovillasale.online
remorcicomerciale.ro renhacklids.tk
rennlist.com resellerclub.com
restaurantlescampi.com
reward-survey.net reward-survey.net
roll123.com reyel1985.webnode.fr
rossanasaavedra.net robot-forex.biz
royalcar-ufa.ru rospromtest.ru
rukino.org royalads.net
ruscoininvest.company royalvegascasino.com
rusvideos.su rp9.ru
sakhboard.ru rrutw.com
sayyoethe.blogspot.co.za rubbed.us
sbtdesign.co.uk sampleletters.net
sc-specialhost.com santechnik.jimdo.com
scanner-alex.top satellite.maps.ilovevitaly.com
scanner-jessica.top scanmyphones.com
scoopquest.com scanner-john.top
scrapy.org scanner-margo.top
scripted.com search-goo.com
se-welding.ru search.xtconnect.com
search.1and1.com secretscook.ru
searchinterneat-a.akamaihd.net seobility.net
searchwebknow-a.akamaihd.net sergiorossistore.online
security60-e.com serpstat.com
seksvideoonlain.com sexpornotales.net
semxiu.com sherlock.se
seo-smm.kz ship-marvel.co.ua
seofirmreviewsus.info shopfishing.com.ua
service-core.ru shopsellcardsdumps.com
service.adtech.fr shopvilleroyboch.com.ua
sextracker.com sibtest.ru
sexy-screen-savers.com sisi-go.ru
sexystrippe.info site5.com
sheerseo.com siteaero.com
shop-electron.ru slavic-magic.ru
shtaketniki.ru
sibvitr.ru
sideeffectsoftizanidine.blogspot.com
siha.de
simplesite.com
sinestesia.host.sk
sisiynas.ru
sispe.com.br
skuteczna-dieta.co.pl
slayerlife.com
sluganarodu.ru sluganarodu.ru
snjatie-geroinovoy-lomki.ru
sobecjvuwa.com.ru sobecjvuwa.com.ru
socas.pluto.ro social-search.me
socialbookmarksubmission.org socialbutton.xyz
solitaire-game.ru sockshare.net
soochi.co soft-terminal.ru
spacash.com softlinesolutions.me
ssconstruction.co spywarespy.com
sstroy44.ru stairliftstrue.com
stariy-baku.com stariy-baku.com
stathat.com stathat.com
stats-public.grammarly.io statoutlook.info
sticken.co stillmiracle.com
stop-gepatit.te.ua stopnarco.ru
storehouse.ua strangeduckfilms.com
stpicks.com streamin.to
students-cheapskate.ml superiends.org
stuff-about-money.com superoboi.com.ua
superfish.com surflinksmedical.com
surgut.zrus.org svbur.ru
surintech.ac.th sygraem.com
survival.betteroffers.review takethatad.com
swagbucks.com talant-factory.ru
swinger-mobil.net tamada69.com
symbaloo.com teenbbw.yopoint.in
tacbelarus.ru teencastingporn.com
taqywu51.soup.io telefonsexkostenlos.tk
td-33.ru texbaza.by
teenporn18.net
telsis.com
templates.radiodigital.co
theendivechronicles.com theendivechronicles.com
theguardlan.com thegolfclub.info
thejournal.ru thfox.com
timer4web.com thiegs.reco.ws
titan-ads.life titan-ads.life
tizanidinehcl2mg.blogspot.com tizanidine4mgstreetprice.blogspot.com
tizanidinenarcotic.blogspot.com tizanidinehcl2mgsideeffects.blogspot.com
tizanidineshowupondrugtest.blogspot.com tizanidinerecreationaluse.blogspot.com
tizanidinerestlesslegsyndrome.blogspot.com
tizanidinesleepaid.blogspot.com tizanidinesleepaid.blogspot.com
tizanidinewithdrawalsymptoms.blogspot.com tk-assortiment.ru
tonerbox.kz tmm-kurs.ru
top-l2.com tn811.us
touchmods.fr top-study.work
traffic2money.com torrentdownloadhub.com
trafficjunky.com torrentgamer.net
traffictrade.life track.deriv.com
trustl.life track112.site
tuckpointingmasonrysystems.com tracklead.net
tupper-shop.ru trafficfactory.biz
turizm.bz trichizobswiv.agddns.net
twelvevisionspartyofcolorado.com triplepanda.xyz
u-cheats.ru truck-addzilla.life
unblocksit.es tula.mdverey.ru
unlimitdocs.net turbabitload.weebly.com
turbodsp.com
twincitiescarservice.com
twodollarshows.com
typer.one
tzritel.tk
udayavani.com
ufa.xrus.org
umekana.ru
uptime-delta.net
urldelivery.com urldelivery.com
usadacha.net usacasino.com
usbggettwku.ga
usdx.us
usswrite.com usswrite.com
ustion.ru uzporno.mobi
vapsy.com v24s.net
viagengrarx.com vabasa.inwtrade.com
viagraneggrx.com vancleefreplica.pw
videochat.bz varbergsvind.se
viel.su vedomstvo.net
vietimgy.pw veselokloun.ru
vk-mus.ru vesnatehno.ru
vltai.com via-gra.webstarts.com
wallpapersdesk.info video-woman.com
videojam.tv
virus-respirators.com
vksex.ru
vrotike.ru
vseuznaem.com
vzlomsn.org
vzlomtw.com
w7s.ru
wait3sec.org
wanker.us
waterefficiency.co
waysbetter.cn
webadvance.club webadvance.club
webinstantservice.com webpromotion.ae
wesharepics.site webradiology.ru
whengirlsgowild.com website-analyzer.info
whereverdesperate.gq website-audit.com.ua
wholesalejerseys-cheapest.com wejdz-tu.pl
withstandingheartwarming.com wemarketing.se
word-vorlagen.xyz wemedinc.com
woweb.com.ua westen-v.life
wsgames.ru westsextube.com
x-lime.com windowssearch-exp.com
x-musics.com wineration.com
xkaz.org wjgony.com
xn-----6kcaacnblni5c5bicdpcmficy.xn--p1ai worldhistory.biz
xn----8sbdbjgb1ap7a9c4czbh.xn--p1acf writersgroup580.web.fc2.com
xn--80aagddcgkbcqbad7amllnejg6dya.xn--p1ai wygraj-skiny.win
xn--b1agm2d.net xchat26.myfreecams.com
xnxx-n.com xev.ru
xnxxandxvideos.com xn----7sbahjd3btneuw1joc.xn--p1ai
xtrafficplus.com xn--80aaafbn2bc2ahdfrfkln6l.xn--p1ai
xxxtube69.com xn--80adaggc5bdhlfamsfdij4p7b.xn--p1ai
yaderenergy.ru xn--80ahvj9e.xn--p1ai
yellowads.men xnxx699.com
ynymnwbm.bloger.index.hr yaoguangdj.com
yoursearch.me yginekologa.com
yur-p.ru yopoint.in
za-music.mymobiplanet.com yugk.net
zakonobosago.ru zajm-zalog-krasnodar.ru
zarabotat-na-sajte.ru zaloadi.ru
zarepta.com zambini.ru
zeroredirect12.com zeroredirect.com
zog.link zetmaster.ru
znaturaloriginal.com
zojirushi-products.ru zojirushi-products.ru
zoodrawings.com
zoogdiesney.com zoogdiesney.com
zoomovies.org zoomovies.org
zoompegs.com
zootoplist.com
zscaler.net

488
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
00webcams.com 214jaluwobapef.cf
1000n1.ru 21h2o.com
9icmzvn6.website 3w24.com
adelly.bg 5tey7463.weebly.com
admatic.com.tr 5u.com
admitad.com 8558l.jobs.net
agreda.pluto.ro abbanreddy.com
agysya.ru adinterax.com
ahmedabadwebs.com adprotect.net
air-edem.ru adservme.com
adtiger.tk
affrh2015.com
albuteroli.com albuteroli.com
alice.it alfa9.com
android-systems.ru amazingninja.com
angigreene.com an-donut.com
angry-fermi-7633.arukascloud.io anal-acrobats.hol.es
anniemation.com arabseyes.com
artparquet.ru arendakvartir.kz
backuperwebcam.weebly.com artavenuegardenstudios.com
baoxaydung.com.vn atlasvkusov.ru
belinvestdom.by atofilms.com
best-coupon-offer.com auspolice.com
besthomemadepornsites.com autoplate.info
brainsandeggs.blogspot.com ayerbo.xhost.ro
bukleteg.xyz babespcs.com
buy-cheap-online.info bankofthewext.com
buybest1.biz beachdriveblog.com
buyclomidonlaine.com bestimagecoollibrary.com
buzz-porno.info bestserials.com
bwlx.prepedu.cn bestwebsiteawards.com
cactussoft.biz blackle.com
bloglag.com
bonzybuddy.com
bookmaker-bet.com
brandedleadgeneration.com
brewdom.ru
brothers-smaller.ru
buyk.host.sk
byme.se
cam-kontakte.org cam-kontakte.org
carsplate.com carabela.com.do
cartierreplica.xyz carfax.com.ua
cascadelink.org
caulderwoodkennels.com caulderwoodkennels.com
cb.iphantom.com chocolateslim-en-france.com
cdn.walkme.com chuckguilford.com
cdncash.com clean-virus-mac.com
cfjump.com cleanpcnow.com
charmstroy.info cntravelre.com
clickbanksites.info compliance-jessica.top
clicksotrk.com costablue.xyz
computernetworksonline.com cowblog.fr
conboy.us dalavia.ru
coolgamechannel.com ddpills.com
customboxes4less.com dealitright.click
dekoration.us den-noch24.ru
depositfiles-porn.ga dentalpearls.com.au
dogoimage.com div.as
dosugrostov.site domainanalyzing.xyz
drivotracker.com downloads-whatsapp.com
duplicashapp.com ekaterinburg.xrus.org
ege-russian.ru elektronischezigarettekaufen2.tumblr.com
egvar.net eloconcream.blogspot.com
elite-sex-finders.com erotag.com
emerson-rus.ru evaashop.ru
englate.com failingmarriege.blogspot.com
esopini.com fefo.gdn
extlinks.com fetroshok.ru
fashion-stickers.ru film-one.ru
fatfasts-4tmz.com foto-telok.net
filmania-x.ru fsakhalin.ru
filmbokep69.com fxund.us
foto-basa.com gallerylisting.com
freelifetimefuckbook.com gamevalue7.weebly.com
freeseedsonline.com gelezki.com
frighteningremain.cf gettpromos.com
fuckmill.com girlgamerdaily.com
fun2cell.net gktt.ru
get-free-social-traffic.com globalscam.ga
getoutofdebtfree.org googst2.ru
ghostvisitor.com gpms.org.my
googlemare.com greatidea.marketing
gov.yanao.ru guildebzh.info
green-tea.tv gwebtools.com
gribkovye-zabolevaniya.com hard-porn.mobi
groupmoney.ru hayate.biz
gsasearchengineranker.site helvetia.com.ua
guardlink.org hermesbracelets.xyz
gwhwpxbw.bloger.index.hr hexpilot.com
hdimagegallery.net hit-kino.ru
heliko.no homik.pw
hop.clickbank.net hostnow.men
hoterika.com hostsshop.ru
hoverboard360.de hotdl.in
hoverboard360.es housediz.com
htmlcorner.com hundejo.com
i4track.net i-midias.net.br
ihc2015.info ifirestarter.ru
ilmexico.com ilikevitaly.com
images-graphics-pics.com imgarcade.com
imguramx.pw imperiafilm.ru
insider.pro increasewwwtraffic.info
irkutsk.zrus.org iron-age.info
izoll.ru itis4you.com
jerseychinabizwholesale.com iwanttodeliver.com
jrcigars.com izismile.com
justkillingti.me jackwolfskinoutlet.online
ketoanhanoi.info jav-way.site
kino-filmi.com javcoast.com
kino-key.info jaxcube.info
kinohall.ru johnrobertsoninc.com
kinosed.net karpun-iris.ru
koral.se kino-ecran.ru
kupiproday.com.ua kinocccp.net
lionking-1994.blogspot.com kinomaniatv.pl
localmatchbook.com kinozapas.org
lonfon.xyz kollesa.ru
mail.allnews24.in kotaku.com
mainlinehobby.net kraljeva-sutjeska.com
makis.nu ktotut.net
manyresultshub-a.akamaihd.net kw21.org
la-fa.ru
lacloop.info
lexaprogeneric.link
lineavabit.it
linkrr.com
liran-locks.com
livefixer.com
liveinternet.ru
liveshoppersmac.com
lookingglassemb.com
louboutinreplica.xyz
magicdiet.gq
mamasuper.prom.ua
marcogrup.com marcogrup.com
marketingtechniques.info mazda-roadsters.com
marmitaco.cat mediaoffers.click
matpre.top megavolt.net.ua
mega-bony2017.pl memberty.com
michaelkorssaleoutletonline.net menstennisforums.com
middlerush-a.akamaihd.net mikozstop.com
midst.eu mobplayer.net
minyetki.ru moesexy.com
misterjtbarbers.com more-letom.ru
moivestiy.biz most.gov.iq
monclercoats.xyz mturkcontent.com
monclerjacketsoutlet.pw musicdaddy.net
mozello.ru myliveblog.ru
mrbojikobi4.biz myonigroup.com
msk-diplomat.com narkologiya-penza.ru
mypets.by news-readers.ru
myphotopipe.com nicefloor.co.uk
naperehresti.info niroo.info
narosty.com novatech.vn
naughtyconnect.com ok.ru
norththeface.store oklogistic.ru
nowtorrents.com
nucia.biz.ly
o-o-8-o-o.ru
obiavo.ru
odoratus.net
okroshki.ru
olympescort.com
one.net.in
onemantrip.com onemantrip.com
onlineserialy.ru onescreen.cc
onlinewritingjobs17.blogspot.ru online-zaymy.ru
ooo-olni.ru openmediasoft.com
optitrade24.com orhonit.com
panicatack.com ostroike.org
par-fallen.ga outshop.ru
paydayloanslocal.com pagesense.com
pinkduck.ga painting-planet.com
piratecams.com panchro.xyz
pixgood.com pdns.download
plastgranar.nu picturesmania.com
pochtovyi-index.ru pinwallpaper.xyz
popander.mobi playfortuna-play.ru
popugaychiki.com pornosexrolik.com
popup-jdh.xyz produkto.net
porndl.org proftests.net
porndroids.com pussyfleet.com
pornoforadult.com pussysaga.com
pornotubs.com quelle.ru
pr0fit-b0x.com rada.ru
privatefx.all4invest.info radiogambling.com
prointer.net.ua rainbowice.ru
projectforte.ru rankia.com
prospekt-st.ru registratciya-v-moskve.ru
queerspace.com reversing.cc
qwertty.net rightenergysolutions.com.au
ranksonic.org rockprogblog.com
raschtextil.com.ua scanner-alexa.top
remont-comp-pomosh.ru scanner-nelson.top
royal-betting.net schlampen-treffen.com
runofilms.ru seansonline24.pl
russia-today-video.ru seobility.net
saneyes.com seokicks.de
sarahmilne.top seoprofiler.com
saratov.xrus.org seorank.info
satellite.maps.ilovevitaly.com seorankinglinks.us
scalerite.co.za sexobzor.info
semp.net sexs-foto.top
seofirmreviewsus.info sexystrippe.info
sex-pr.net
shoesonlinebuy.xyz
shop.xz618.com shop.xz618.com
shoplvlv.us silvermature.net
shoppingmiracles.co.uk sinestesia.host.sk
shoppytoolmac.com srdrvp.com
shtaketniki.ru sribno.net
simon3.ru stackthatbucks.com
simple-image.com.ua stoki.ru
site5.com swimpool.ca
sizeplus.work symphonyintegratedhealthcare.com
skutecznetabletkinaporostwlosow.pl tabakur77.com
snworks.com telegraf.by
socialmonkee.com timdreby.com
softwaretrend.net tizanidineforopiatewithdrawal.blogspot.com
sovetogorod.ru token-lab.org
spin2016.cf top10registrycleaners.com
spinnerco.ca trafaret74.ru
srecorder.com trustedhealthtips.com
stroy-portal22.ru try-rx.com
stroydetali.ru tsyndicate.com
tako3.com u-cheats.ru
tecspb.ru ukr-lit.com
tedy.su urdoot.win
timeallnews.ru urzedowski.eu
titan-ads.life usbggettwku.ga
titan-cloud.life valoresito.com
titslove.yopoint.in videotuber.ru
tomatis.gospartner.com vsesubwaysurfers.com
topads.men vzlomsn.org
topcar-krasnodar.ru vzubah.com
tourcroatia.co.uk wallpaperstock.net
track112.site weblo.com
trafficjunky.com welck.octopis.com
tvorozhnaja-zapekanka-recept.ru wesharepics.site
uchetunet.su whatistizanidine2mg.blogspot.com
ukrup.com whatzmyip.net
urccvfmc.bloger.index.hr windowssearch-exp.com
validccseller.com winx-play.ru
vesnatehno.ru witclub.info
vgoloveboli.net wovis.site
viddyoze.com wurr.voila.net
vpnmouse.com xaijo.com
vremya.eu xingzi-vision.com
vsexkontakte.net xmnb.net
webix.biz xn-----6kcaabbafhu7cskl7akvongwpo7hvjj.xn--p1ai
website-speed-up.top xn----8sbdbjgb1ap7a9c4czbh.xn--p1acf
whatsappbot.flyland.ru xn--80aaaks3bbhabgbigamdr2h.xn--p1ai
wineitudes.wordpress.com xn--80aagddcgkbcqbad7amllnejg6dya.xn--p1ai
www.wohnkabinen-shop.de xxxguitars.com
x-porno.video you-shall-not-pass.is74.ru
xclicks.net youtuhe.com
xep.info yuweng.info
xgames-04.com zixizop.net.ru
xn-----7kcabaipgeakzcss7bjdqdwpfnhv.xn--p1ai zmoda.hostreo.com
xn--80ahvj9e.xn--p1ai zynax.ua
xn--c1acygb.xn--p1ai
xn--l1aengat.xn--p1ai
xsion.net
yhit.press
yur-p.ru
za-music.mymobiplanet.com
zaimite.ru
zeroredirect1.com
zeroredirect5.com
znakomstvaonlain.ru
zoogdinsney.com
zophim.me

335
dev-tools/test_units/ratelimittest-master.txt
View file

@ -8,170 +8,6 @@
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html>ml>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html><html> </html><html>
<head><title>503 Service Temporarily Unavailable</title></head> <head><title>503 Service Temporarily Unavailable</title></head>
<body> <body>
@ -494,6 +330,167 @@
<hr><center>nginx/1.18.0 (Ubuntu)</center> <hr><center>nginx/1.18.0 (Ubuntu)</center>
</body> </body>
</html> </html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<!DOCTYPE html> <!DOCTYPE html>
<html> <html>
<head> <head>
@ -584,4 +581,14 @@
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html> </html>

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.184 0; 10.1.0.188 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2021.11.2736 ### Version: V4.2021.11.2737
### Updated: Thu Nov 25 10:03:23 UTC 2021 ### Updated: Thu Nov 25 22:01:29 UTC 2021
### Bad Bot Count: 629 ### Bad Bot Count: 629
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2021.11.2736 ### Version: V4.2021.11.2737
### Updated: Thu Nov 25 10:03:23 UTC 2021 ### Updated: Thu Nov 25 22:01:29 UTC 2021
### Bad Bot Count: 629 ### Bad Bot Count: 629
################################################### ###################################################
### Version Information ## ### Version Information ##