vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-05 04:00:13 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2021.11.2720 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2021-11-17 10:09:26 +00:00
parent 275fd252fa
commit ae700e70b0
47 changed files with 65785 additions and 65778 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2021.11.2719 #### Version: V4.2021.11.2720
#### Bad Referrers Blocked: [7077](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7077](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [627](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [627](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2021.11.2719 #### Version: V4.2021.11.2720
#### Bad Referrers Blocked: [7077](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7077](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [627](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [627](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -11,7 +11,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2021.11.2719 #### Version: V4.2021.11.2720
#### Bad Referrers Blocked: [7077](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7077](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [627](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [627](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

8064
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2021.11.2719 #### Version: V4.2021.11.2720
#### Bad Referrers Blocked: [7077](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7077](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [627](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [627](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

8068
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

8068
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

8068
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

8068
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.76 1; 10.1.0.64 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.76 0; 10.1.0.64 0;
127.0.0.1 0; 127.0.0.1 0;

8068
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.76 1; 10.1.0.64 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.76 0; 10.1.0.64 0;
127.0.0.1 0; 127.0.0.1 0;

8068
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.76 1; 10.1.0.64 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.76 0; 10.1.0.64 0;
127.0.0.1 0; 127.0.0.1 0;

8068
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
2719 2720

8068
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

8068
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
52.142.59.40 0; 40.71.27.92 0;

8068
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.76 1; 10.1.0.64 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.76 0; 10.1.0.64 0;
127.0.0.1 0; 127.0.0.1 0;

8068
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.76 1; 10.1.0.64 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.76 0; 10.1.0.64 0;
127.0.0.1 0; 127.0.0.1 0;

8068
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.76 1; 10.1.0.64 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.76 0; 10.1.0.64 0;
127.0.0.1 0; 127.0.0.1 0;

8068
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
52.142.59.40 0; 40.71.27.92 0;

8068
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
52.142.59.40 0; 40.71.27.92 0;

8068
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.76 1; 10.1.0.64 1;
127.0.0.1 1; 127.0.0.1 1;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
CherryPicker BuzzSumo
JOC Web Spider CensysInspect
MarkMonitor EMail Siphon
MicroMessenger GermCrawler
Picscout GetRight
Psbot IlseBot
RankFlex Rogerbot
SEOkicks WASALive-Bot
Spammen mediawords
seobility sp_auditbot

322
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
01h4x.com 404enemy
80legs ADmantX
ALittle Client Aboundex
ASPSeek
Aboundexbot
Acunetix
AfD-Verbotsverfahren AfD-Verbotsverfahren
AhrefsBot AhrefsBot
AiHitBot AiHitBot
Aipbot
AlphaBot
Anarchie
Anarchy Anarchy
Anthill Apexoo
AwarioSmartBot AwarioRssBot
BBBike BLEXBot
BDFetch BackWeb
Badass
Barkrowler Barkrowler
Battleztar Bazinga BatchFTP
BetaBot BetaBot
Bigfoot Bitacle
Black Hole
BlackWidow BlackWidow
Blow Buck
Boardreader BuiltWith
BotALot Bullseye
Buddy BunnySlippers
BuiltBotTough BuzzSumo
CODE87 CCBot
CSHttp
Calculon Calculon
CazoodleBot Cegbfeieh
ChinaClaw Chlooe
Cliqzbot Cloud mapping
Cocolyzebot
Collector Collector
CopyRightCheck CopyRightCheck
Copyscape Craftbot
Crescent CrunchBot
Custo
DIIbot DIIbot
DSearch DTS Agent
DataCha0s Deusu
DatabaseDriverMysqli Disco
Demon Discoverybot
Devil Dispatch
DigitalPebble
Discobot
DomainAppender DomainAppender
DomainCrawler DomainCrawler
Dragonfly DomainSigmaCrawler
Drip Dotbot
ECCP/1.0 Download Wonder
EMail Wolf EMail Wolf
EasyDL
Ebingbong Ebingbong
Ecxi Ecxi
EirGrabber
EroCrawler EroCrawler
Evil Evil
Exabot
Express WebPictures Express WebPictures
ExtLinksBot ExtLinksBot
Extreme Picture Finder ExtractorPro
FDM Ezooms
FHscan Fimap
FemtosearchBot Firefox/7.0
FlashGet
Flunky Flunky
FyberSpider Freeuploader
Fyrebot
GalaxyBot GalaxyBot
GermCrawler Genieo
GetRight
GetWeb
Getintent Getintent
Grabber Gigabot
Grafula Go!Zilla
HMView GoZilla
Havij Gotit
Humanlinks GrabNet
IDBTE4M GrapeshotCrawler
GridBot
HEADMasterSEO
HTMLparser
Haansoft
Harvest
Heritrix
IRLbot IRLbot
Iblog
Id-search Id-search
Image Fetch IlseBot
IndeedBot Indy Library
InfoNaviRobot InfoNaviRobot
InfoTekies InfoTekies
Intelliseek
InterGET InterGET
Internet Ninja
InternetSeer InternetSeer
Iskanie Iskanie
JennyBot JennyBot
JetCar JetCar
Jetty
JikeSpider
Jorgee Jorgee
Jyxobot Keyword Density
Kenjin Spider
Kinza
Lanshanbot Lanshanbot
Leap
LeechFTP
LeechGet LeechGet
Lftp
LibWeb LibWeb
LinkScan Libwhisker
LinqiaMetadataDownloaderBot Lightspeedsystems
Lipperhey Linkdexbot
Lipperhey Spider LinkpadBot
MIDown tool LinksManager
LinqiaRSSBot
LinqiaScrapeBot
Litemage_walker
Lmspider
Ltx71
MFC_Tear_Sample
MIIxpc MIIxpc
MJ12bot
MQQBrowser
MSFrontPage MSFrontPage
MTRobot MTRobot
Mag-Net
Magnet Magnet
MarkWatch Mail.RU_Bot
Masscan Majestic-SEO
Mata Hari MarkMonitor
Meanpathbot Mb2345Browser
MeanPath Bot
Mediatoolkitbot Mediatoolkitbot
MegaIndex.ru
Metauri Metauri
MicroMessenger MicroMessenger
Microsoft Data Access Microsoft Data Access
Microsoft URL Control
Mister PiX Mister PiX
Moblie Safari Moblie Safari
Morfeus Fucking Scanner Morfeus Fucking Scanner
Mozlila NPbot
Mr.4x3
Name Intelligence
Nameprotect
NearSite NearSite
Nessus Net Vampire
NetSpider
Nettrack Nettrack
Netvibes
NextGenSearchBot
Niki-bot Niki-bot
NimbleCrawler NimbleCrawler
Ninja
Nuclei Nuclei
Octopus OnCrawl
Offline Navigator
OpenVAS OpenVAS
Openvas
OrangeBot OrangeBot
OrangeSpider OrangeSpider
OutclicksBot OutclicksBot
OutfoxBot
PHPCrawl
POE-Component-Client-HTTP POE-Component-Client-HTTP
PageScorer
PageThing.com
Pandalytics
Panscient Panscient
PeoplePal
Pi-Monster Pi-Monster
Picsearch Piepmatz
Psbot Pixray
Pump Pockey
PyCurl ProWebWalker
ReGet Probethenet
RealDownload Quick-Crawler
RSSingBot
RankActiveLinkBot
RankFlex
RankingBot2
Rankivabot
RankurBot
Re-re
RebelMouse RebelMouse
RepoMonkey SBIder
Ripper SEOkicks
RocketCrawler SEOprofiler
SMTBot SEOstats
ScoutJet Scanbot
Scrapy Scrapy
Screaming ScrepyBot
SentiBot SemanticJuice
Shodan SeobilityBot
Seomoz
Siphon
Site Sucker
SiteCheckerBotCrawler SiteCheckerBotCrawler
SiteLockSpider SiteSnagger
SiteSucker
SlySearch
Snake
Snapbot
SocialRankIOBot SocialRankIOBot
Sogou web spider Sottopop
Sosospider Spammen
SpaceBison SpankBot
Spanner
Spbot
Sqlmap Sqlmap
Stripper Steeler
Sucuri
SuperBot SuperBot
SuperHTTP
SurveyBot
Suzuran Suzuran
T0PHackTeam T0PHackTeam
Teleport T8Abot
TeleportPro
Telesoft Telesoft
Thumbor Telesphoreo
TheNomad
TightTwatBot
Toata Toata
Toweyabot
Tracemyfile Tracemyfile
Trendictionbot Trendiction
True_Robot
Turingos Turingos
Turnitin TurnitinBot
Upflow URLy Warning
VB Project UnisterBot
VCI V-BOT
Vagabondo
VelenPublicWebCrawler VelenPublicWebCrawler
VidibleScraper
VoidEYE VoidEYE
Voltron
WASALive-Bot WASALive-Bot
WEBDAV WPScan
WISENutbot WWW-Mechanize
WWWOFFLE
WallpapersHD WallpapersHD
WeSEE
Web Auto
Web Collage Web Collage
Web Fuck WebAuto
Web Sucker WebEnhancer
WebBandit WebFetch
WebFuck WebFuck
WebGo IS WebImageCollector
WebReaper WebLeacher
WebSucker
WebZIP WebZIP
Webshag Webalta
WebmasterWorldForumBot
Website Quester
WebsiteExtractor WebsiteExtractor
WebsiteQuester WebsiteQuester
Whack Webster
Whacker Whacker
Widow Who.is Bot
WiseGuys Robot Wotbox
Wprecon YoudaoBot
Zauba Zeus
Zermelo Zitebot
ZoominfoBot ZmEu
ZyBorg clark-crawler
arquivo.pt coccocbot-web
autoemailspider cognitiveseo
com.plumanalytics crawler.feedback
crawl.sogou.com
crawler4j
dataforseo.com dataforseo.com
eCatch demandbase-bot
facebookscraper
heritrix heritrix
internetVista monitor meanpathbot
lwp-request
magpie-crawler
oBot
page scorer page scorer
pcBrowser
plumanalytics plumanalytics
polaris version
probe-image-size probe-image-size
scalaj-http ripz
scan.lol s1z.ru
trendiction.de seobility
webmeup-crawler seoscanners
spyfu
tAkeOut
trendiction.com
voyagerx.com
webprosbot webprosbot
x09Mozilla
x22Mozilla x22Mozilla
zauba.io
zgrab zgrab

320
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
404enemy 360Spider
80legs
ADmantX ADmantX
ALittle Client
Abonti
Acunetix
AfD-Verbotsverfahren AfD-Verbotsverfahren
AhrefsBot
Alexibot Alexibot
Alligator AllSubmitter
Anarchy AlphaBot
Aspiegel Anarchie
Asterias Anarchy99
AwarioRssBot Anthill
Apexoo
AwarioSmartBot AwarioSmartBot
BLEXBot BLEXBot
BackDoorBot
BackStreet BackStreet
BackWeb BackWeb
Badass Backlink-Ceck
BacklinkCrawler
Barkrowler Barkrowler
BatchFTP BatchFTP
Battleztar Bazinga Battleztar Bazinga
BetaBot BetaBot
Bigfoot
Bitacle Bitacle
Black Hole Blackboard
Blow Blow
Bolt
BotALot
Brandprotect Brandprotect
Buck Buddy
Bullseye BuiltBotTough
BuiltWith
BuzzSumo
CATExplorador CATExplorador
CCBot
CODE87 CODE87
Calculon CSHttp
Cegbfeieh ChinaClaw
CensysInspect
CherryPicker
Chlooe Chlooe
Cliqzbot Claritybot
Cloud mapping
Cogentbot
Cosmos
Craftbot Craftbot
Crawling at Home Project Crawling at Home Project
CrazyWebCrawler
Curious Curious
Custo
CyotekWebCopy CyotekWebCopy
DIIbot DBLBot
DTS Agent DatabaseDriverMysqli
Devil Deusu
Digincore
Dirbuster
Disco Disco
Discoverybot Discoverybot
Dispatch
DittoSpyder DittoSpyder
DnBCrawler-Analytics
DnyzBot
DomainCrawler DomainCrawler
DomainStatsBot Dotbot
Download Wonder Dragonfly
EMail Siphon
EMail Wolf
EasyDL EasyDL
EirGrabber EirGrabber
EroCrawler EroCrawler
Express WebPictures Exabot
Extractor Extreme Picture Finder
FDM EyeNetIE
FHscan FemtosearchBot
Fimap
Firefox/7.0 Firefox/7.0
FlashGet FlashGet
Foobot
Freeuploader
FrontPage FrontPage
Fuzz
Fyrebot
GT::WWW
GalaxyBot GalaxyBot
GetRight
GetWeb
Getintent Getintent
Gigabot
GoZilla GoZilla
Gotit Gotit
Grabber Grabber
Grafula Grafula
GrapeshotCrawler GrapeFX
GridBot GridBot
HEADMasterSEO HEADMasterSEO
HMView HTMLparser
HTTrack
Haansoft
HaosouSpider HaosouSpider
Havij Harvest
Heritrix Heritrix
Iblog HybridBot
Image Fetch IDBTE4M
Iria IRLbot
IstellaBot IndeedBot
JOC Web Spider Intelliseek
JamesBOT InternetSeer
JennyBot Jorgee
JetCar
Jetty
JikeSpider
Joomla
Jyxobot Jyxobot
Kinza Kinza
LNSpiderguy Kozmosbot
Leap
LeechFTP LeechFTP
LeechGet
Lftp Lftp
LieBaoFast LieBaoFast
Lightspeedsystems
Likse
LinkScan LinkScan
LinkWalker LinkextractorPro
Linkbot LinkpadBot
Linkdexbot
LinqiaMetadataDownloaderBot
LinqiaScrapeBot LinqiaScrapeBot
Lipperhey
Lipperhey Spider
Lmspider
Ltx71
MFC_Tear_Sample MFC_Tear_Sample
MIDown tool
MQQBrowser
MSFrontPage MSFrontPage
Mag-Net
Magnet
Majestic SEO Majestic SEO
Mass Downloader Majestic-SEO
Mb2345Browser Majestic12
MarkWatch
Masscan
Mata Hari
MauiBot
MeanPath Bot MeanPath Bot
Metauri Meanpathbot
Moblie Safari Mediatoolkitbot
Mojeek MicroMessenger
Microsoft URL Control
Mister PiX
Mojolicious
Morfeus Fucking Scanner Morfeus Fucking Scanner
Mozlila
Msrabot
NICErsPRO NICErsPRO
NPbot NPbot
Name Intelligence Name Intelligence
NetAnts Needle
NetZIP
Netcraft
Nettrack Nettrack
NextGenSearchBot
NimbleCrawler
Nimbostratus Nimbostratus
Ninja Ninja
Nmap
Nuclei
Octopus Octopus
OrangeBot Openfind
OrangeSpider OutfoxBot
OutclicksBot PHPCrawl
PageGrabber PageAnalyzer
PageScorer
PageThing.com PageThing.com
PeoplePal Pandalytics
Picscout Papa Foto
ProPowerBot Petalbot
PictureFinder
Pixray
ProWebWalker ProWebWalker
Probethenet PxBroker
PyCurl
QueryN Metasearch QueryN Metasearch
RankActive RankActive
RankingBot RankActiveLinkBot
RankurBot RankFlex
Re-re RankingBot2
Reaper
RedesScrapy RedesScrapy
Rogerbot RepoMonkey
SBIder Ripper
RocketCrawler
SEOprofiler SEOprofiler
SEOstats ScanAlert
SMTBot Scanbot
ScoutJet ScoutJet
Semrush Scrapy
SeobilityBot Screaming
Seomoz ScrepyBot
Shodan SemanticJuice
Siphon SemrushBot
SiteCheckerBotCrawler SiteLockSpider
SiteSnagger SiteSucker
Siteimprove Siteimprove
SmartDownload Sitevigil
Snoopy SlySearch
Snake
SocialRankIOBot
Sosospider Sosospider
SpankBot SpaceBison
Sqworm Spanner
SurveyBot Spbot
Swiftbot SputnikBot
T0PHackTeam Sqlworm
T8Abot Stripper
Teleport SuperBot
SuperHTTP
Telesoft Telesoft
Telesphoreo Telesphoreo
The Intraformant Thumbor
TightTwatBot
Titan Titan
Toata
Toweyabot Toweyabot
Trendiction Tracemyfile
Trendictionbot UnisterBot
TwengaBot Upflow
V-BOT VB Project
VCI Vacuum
Vagabondo
VelenPublicWebCrawler VelenPublicWebCrawler
VeriCiteCrawler VeriCiteCrawler
Virusdie VidibleScraper
VoidEYE
Voil
Voltron Voltron
WASALive-Bot WASALive-Bot
WBSearchBot WEBDAV
WISENutbot WISENutbot
WWWOFFLE WPScan
Wallpapers/3.0 WWW-Collector-E
WallpapersHD WWW-Mechanize
Web Collage Wallpapers
Web Pix Web Fuck
WebCopier Web Sauger
WebEnhancer Web Sucker
WebFuck WebGo IS
WebImageCollector WebImageCollector
WebReaper WebLeacher
WebSauger WebSauger
Webshag WebStripper
Website Quester WebSucker
Whacker WebWhacker
Who.is Bot Webalta
WebsiteQuester
Webster
Widow
WinHTTrack
WiseGuys Robot WiseGuys Robot
Wotbox Woobot
Wprecon Wprecon
Xaldon WebSpider Xaldon WebSpider
Xenu Xenu
Zeus Zade
ZoominfoBot Zauba
check1.exe Zermelo
clark-crawler Zitebot
coccocbot-web adscanner
archive.org_bot
arquivo-web-crawler
autoemailspider
cognitiveseo
com.plumanalytics
dataforseo.com dataforseo.com
demandbase-bot domainsproject.org
facebookscraper eCatch
gopher evc-batch
instabid instabid
internetVista monitor isitwp.com
lwp-request lwp-request
magpie-crawler magpie-crawler
meanpathbot muhstik-scan
mediawords polaris version
pcBrowser probe-image-size
plumanalytics satoristudio.net
ripz
s1z.ru
scalaj-http scalaj-http
scan.lol seoscanners
seostar
serpstatbot
sitechecker.pro
trendiction.com
trendiction.de
voyagerx.com
webpros.com webpros.com
x09Mozilla

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
aibolita.com bscodecs.com
cand.jp check-host.net
dokfilms.net domaineaneblanc.com
fickkontakte.org fapgon.com
glogow.pl lacloop.info
goodnightjournal.com mp3s.club
musirc.com pic2fly.com
mycaf.it sbt-aqua.ru
scanner-elena.top webstatsdomain.org
uzporno.mobi xxxmania.top

904
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
007angels.com 000free.us
0daymusic.org 00it.com
100searchengines.com 2ads.co.uk
101billion.com 3-letter-domains.net
123cha.com 45en.ru
123locker.com 51unlim.ru
18ps.ru
1j7740kd.website
202ch.com
5u.com 5u.com
66cpwgln.space 6128786.com
76brighton.co.uk 83net.jp
883zy.com 999webdesign.com
888.com
98oi.ru
991mostfm.co.id
aab94f698f36684c5a852a2ef272e031bb.com aab94f698f36684c5a852a2ef272e031bb.com
abctoppictures.net aad1f4acb0a373420d9b0c4202d38d94fa.com
adbetclickin.pink activepr.ru
adsland.men adcash.com
adult-shop.com.ua addblueoff.com.ua
aghanyna.com adexprts.com
akita.kz adhome.biz
akusherok.ru adminshop.com
all-streaming-media.com adtology.com
adultwebhosting.info
adverster.com
adviceforum.info
agapovdg.ru
aibolita.com
alert-fdm.xyz
alevinefesleri.com
algerianembassy.co.in
alldezservice.kz alldezservice.kz
aludecor.info amateurmatch.com
alveris.ru amt-k.ru
amospalla.es android-vsem.org
angigreene.com apioasisspacenet-a.akamaihd.net
apidiamondatanet-a.akamaihd.net approvedlocal.co.za
apiwoodensealcom-a.akamaihd.net appsecurityr.com
aramaicmedia.org
arcadepages.com arcadepages.com
arenda-avtoprokat-krasnodar.ru arcadeplayhouse.com
arendakvartir.kz arpelsreplica.xyz
artavenuegardenstudios.com atmovs.com
artefakct.com auto-zapchasti.org
asociatia-tipografilor-transilvania.ro autobudpostach.club
aucoinhomes.com aviva-limoux.com
audiobangout.com b00kmarks.com
autochoixspinelli.com baditri.com
aviav.eu
avirasecureserver.com
avkzarabotok.info
avon-severozapad.ru
awaybird.ru
azbaseimages.net
badavit.com.ua
bag77.ru bag77.ru
bamo.xsl.pt bambi.ck.ua
bashtime.ru bankiem.pl
battlecarnival.su basedecor.ru
beachtoday.ru bcmp.org
becuo.com bear.gotcher.us
beremenyashka.com beauty-clinic.ru
berrymall.ru betterhdporn.com
bestdraws.com bfz.biz
bestssaker.com bidbuy.co.kr
bezcmexa.ru bigcareer.info
bitcoinpile.com bikini-image.com
bjanshee.ru blacktwhite.com
bjgugu.net.ua blog.f00kclan.de
blackhatworth.com blogrankers.com
bloggen.be bluesman.nu
bmsco.co bobinoz.com
boanonihaca.tk boeuklad.com
bonzbuddy.com boole.onlinewebshop.net
bonzybuddy.com break-the-chains.com
bookhome.info breastaugmentation.co.za
braintobe.win brianhenry.co
bukleteg.xyz bronzeaid-a.akamaihd.net
buy-meds24.com brus-vsem.ru
buzzsumo.com burger-tycoon.com
bycontext.com business-suggested.tk
cakesplus.com.au buyessaynow.biz
callstevens.com buynorxx.com
cand.jp buytizanidineonline.blogspot.com
candlehandmade.com call-of-duty.info
candy-glam-hp.com callawaygolfstore.online
cartierlovestore.com camdenmemorials.com
celejihad.info canrole.com
centraletermice.us cartierreplica.xyz
cfcl.co.uk cartierwatch.xyz
cheapcigarettesc.info certifywebsite.win
cheapjerseysap.com chatroulette.si
chinacheapelitejerseys.com chatroulette.video
christianlouboutinreplica.win cheapestjerseys-wholesale.com
ciceros.co christianlouboutinreplica.pw
ciekawinki.pl cialis-samples.com
cinemaflix.website cialisovercounteratwalmartusa.com
cicaki.net
circlesl.com
clickbanksites.info
club-samodelkin.ru
cobaltpro.ru cobaltpro.ru
codq.info
cognitiveseo.com cognitiveseo.com
com-onlinesupport.host com-cleaner.systems
commoncrawl.org com-supportcenter.website
companies-catalog.com cometorussia.net
compliance-ivan.xyz compliance-alex.xyz
compliance-jessica.top compliance-margo.top
compliance-julianna.top copro.pw
constantaservice.net cornomase.win
copblock.org credit.co.ua
counciltally.com customcatchcan.com
cracksplanet.com cutt.us
crest3d.ru dame-ns.kz
cscwtalkto.site data1.scopich.com
d0t.ru dataloading.net
damedingel.ya.ru dbmkfhqk.bloger.index.hr
daneshetabiat.com delayreferat.ru
data.vtc.pw delfin-aqua.com.ua
daydream-studio.ru
db.speedup.gdn
dealwifi.com
decoratinghomes.ga
defenderxtactical.com
delta-line.men delta-line.men
deniven.1bb.ru dfwu1019.info
detective01.ru dickssportinggoods.com
dignitasdata.se diegolopezcastan.com
diusyawiga.tk dieta-personalna.pl
djihispano.com digitalfaq.com
dmmspy.com dildofotzen.net
doctormakarova.ru divisioncore.com
dogbreedspicture.net divku.ru
dostavimvdom.ru dnsrsearch.com
doxysexy.com domainsatcost.com
dvd-famille.com dotmass.top
dynainbox.com dptaughtme.com
droidlook.net
druzhbany.ru
duawitchrarato.tk
dvrlists.com
earncash.com.ua earncash.com.ua
editmedios.com ecommerce-seo.org
ekspresihati.info educontest.net
eleimgo.pw eldiariodeguadalajara.com
elektrozigaretten1.webs.com elektrischeziga.livejournal.com
elektrozigaretten2.yn.lt encodable.com
elitepcgames.com enhand.se
enternet.ee erot.co
estibot.com erotag.com
europages.com.ru espaceinventoristes.com
exchanges-bet.com estelight.ru
exmasters.com eugenevaultstorage.com
expertblog.info euronis-free.com
extrabot.com euroskat.ru
extremez.net evaashop.ru
familienzahnaerzte.com evidencecleanergold.com
fashionindeed.ml excaliburfilms.com
femmesdenudees.com ezigarettekaufen2.yolasite.com
filmania-x.ru ezrvrentals.com
finejewelryshop.ru familyphysician.ru
fenoyl.batcave.net
figuringmoneyout.com
financeloan.us
firesub.pl
fishtauto.ru
fitfloponline.store
fiuxy.com fiuxy.com
flipper.top flashbannernow.com
floridamobilebillboards.com flex4launch.ru
footbalive.org flowwwers.com
formulaf1results.blogspot.com forumprofi.de
fortwosmartcar.pw frbizlist.com
forum.tvmir.org free-floating-buttons.com
foxinsocks.ru fullgirl.ru
franch.info funponsel.com
freakycheats.com fyl.com.ru
free-laptop-reward.com
freelotto.com
freewhatsappload.com
front.to
fun-mobi.pl
fun2cell.net
galeon.com galeon.com
gallery.rennlist.com gambarkatabaru.com
gamedayhouse.com
gay-file.com gay-file.com
generalporn.org generic-pills-online.com
gepezz.info getlamborghini.ga
getaclueamerica.com gg.zzyjxs.com
getmyads24.com
getoutofdebtfree.org
girlgamerdaily.com girlgamerdaily.com
girlspicsa.com gok-kasten.net
glall.ru
glass-msk.ru
globalsurfari.com
golden-praga.ru
goldpanningtools.com
good-mummy.ru
goodwinmetals.co goodwinmetals.co
gotomontenegro.net googglet.com
gsasearchengineranker.top gotcher.us
grand-chlen.ru
graphicwe.org
grtyi.com
gsasearchengineranker.xyz
gsasearchenginerankerhelp.com gsasearchenginerankerhelp.com
hackers-crackers.tk gsou.cf
hamptonoaks.ca guge.io
guildebzh.info
hacktougroup.ru
handicapvantoday.com
hannasolution.ru hannasolution.ru
hausfrauensex18.com havepussy.com
hayate.biz hawaiisurf.com
hd-filmy.net hd720kino.ru
hdimagelib.com hdpixent.com
hdseriale.pl
heartofpayne.xyz heartofpayne.xyz
hermesreplica.win hmmm.cz
hmywwogw.bloger.index.hr hotblognetwork.com
hobbyhuren-datenbank.com hotdl.in
hol.es hotel-mkad.ru
homelygarden.com hotgirlhdwallpaper.com
homemade.gq hothot.ru
honyaku.yahoofs.jp hotloans.ru
hoste.octopis.com houseofgaga.ru
hotblog.top howlongdoestizanidinestayinyoursystem.blogspot.com
hyiphunter.org hplaserjetpdriver8y.pen.io
i-hobot.ru htmlcorner.com
hut1.ru
iccornacircri.cf
ilbe.club ilbe.club
images-free.net imagecoolpub.com
imfamous.info images.gyffu.com
iminent.com imperia31.ru
imk.com.ua incomekey.net
immobiliaremassaro.com infogame.name
impresagaia.it inome.com.ua
incest-ru.com invest-pamm.ru
inet-traffic.com invitefashion.com
intelhdgraphicsgtdrive6w.metroblog.com io9.com
interferencer.ru iomoio.net
iplusbit.blogspot.co.za itronics.ca
iqbazar.ru izoll.ru
irkutsk.online-podarki.com jabimgo.pw
jerseychinabizwholesale.us jackpotchances.com
jimmychoosale.online javatex.co.id
justbcause.com jolic2.com
justkillingti.me jongose.ninja
justucalling32211123456789.tk kamorel.com
kabbalah-red-bracelets.com karaganda.xkaz.org
kareliatobacco.ru karting196.ru
kazan.xrus.org kazan.xrus.org
kellyonline.xyz keywordhut.com
keywordbasket.com keywords-monitoring-your-success.com
keywordglobal.co.za kidskunst.info
keywordhouse.com kino-filmi.com
keywordsking.com kino-rating.ru
kino-rf.ru
kinosed.net kinosed.net
komputers-best.ru knogg.net
koopilka.com konkursov.net
konpax.com
kosova.de kosova.de
kretpicf.pw krafte.ru
kriokomora.info ktotut.net
languagecode.com ladsblue.com
laptop-4-less.com lanadelreyfans.us
law-check-nine.xyz ldrtrack.com
lenpipet.ru lenvred.org
letto.by lezbiyanki.net
libertybilisim.com linerdrilling.com
lightinghomes.net localmatchbook.com
likesuccess.com locationdesaison.com
linkarena.com lodki-pvh.dp.ua
linkpulse.com lostfilm-online.ru
linkwithin.com lottospring.com
lion.bolegapakistan.com mac-shield.com
live-cam6.info mackeeper-land-672695126.us-east-1.elb.amazonaws.com
livefixer.com make-money-online.com
lkbennettstore.online malls.com
love-baby.cz mansparskats.com
lulea-auktionsverk.se manuscript.su
lutherstable.org marketland.ml
m1media.net maximilitary.ru
mahnwachen-helfen.info mensandals.xyz
map028.com michellblog.online
mcnamaratech.com microsearch.ru
medi-fitt.hu minneapoliscopiers.com
mediawhirl.net mir-business-24.ru
medicines-choice.com mockupui.com
meetingrainstorm.bid moesen-ficken.com
mexicosleevegastrectomy.com moi-glazki.ru
milblueprint.com monsterdivx.tv
mini-modus.ru mosdverka.ru
miniature.io multgo.ru
misswell.net music.utrolive.ru
mixed-wrestling.ru musicktab.com
moscow.online-podarki.com myfreecams.com
mostantikor.ru myfreetutorials.com
movies-in-theaters.net myprintscreen.com
mrwhite.biz nac-bearings.ru
mycaf.it nailsimg.com
mykings.pw
nalogovyykodeks.ru
nardulan.com
narkologiya-peterburg.ru narkologiya-peterburg.ru
national-today-winning-winner.club naturalshair.site
netvouz.com new-post.tk
newfilmsonline.ru newstudio.tv
newtechspb.ru nfljerseys.online
ngps1.ru nlfjjunb5.ru
niki-mlt.ru nottyu.xyz
nomuos.it nrv.co.za
nonews.co oballergiya.ru
nsatc.net obiavo.in
nudepatch.net oecnhs.info
o00.in okmedia.sk
obiavo.uz onlinemegax.com
obsessionphrases.com onstrapon.purplesphere.in
okuos.com oranga.host.sk
one-gear.com orgasmatrix.com
oneclickfiles.com osnova3.ru
oneshotdate.com otbelivanie-zubov.com
onlineku.com outclicks.net
onlineslotmaschine.com outpersonals.com
oops-cinema.ru ovirus.ru
outrageousdeal-a.akamaihd.net ozoz.it
paperwritingservice17.blogspot.ru p-business.ru
parajumpersstore.online painting-planet.com
partner-print.men paleohub.info
partybunny.ru parajumpersjakkesalgnorge.info
patterntrader-en.com partner-stop.men
pepperstyle.ru pastaleads.com
paydayonlinecom.com
pb-dv.ru
pc4download.co
percin.biz.ly percin.biz.ly
perl.dp.ua perfectplanned.com
perm-profnastil.ru perosan.com
perso.wanadoo.es perso.wanadoo.es
petrovka-online.com picturesboss.com
photo-clip.ru pirateday.ru
picphotos.net
pinkduck.ga
pivka.xyz
pizdeishn.com pizdeishn.com
pl-top.pl pl.id-forex.com
platesauto.com pogodnyyeavarii.gq
playfortuna-play.ru polcin.de
pliks.pl popup.matchmaker.com
pogosh.com pornhub-ru.com
pons-presse.com porno-raskazy.ru
porndairy.in porno-transsexuals.ru
pornhubforum.tk pornogad.com
pornoforadult.com pornotubs.com
pornoklad.ru
pornophoto.xyz
pornstartits.xblog.in pornstartits.xblog.in
poshiv-chehol.ru portside.cc
positive2b.ru powenlite24.ru
postclass.com
powc.r.ca.d.sendibm2.com
pozdravleniya-c.ru pozdravleniya-c.ru
pozdrawleniya.com princevc.com
pregnant.guru privacyassistant.net
printdirectforless.com privhosting.com
promgirldresses.xyz prodess.ru
pronekut.com
propranolol40mg.blogspot.com propranolol40mg.blogspot.com
prospekt-st.ru
prostitutki-almata.org
prostitutki-belgoroda.org prostitutki-belgoroda.org
prostitutki-tyumeni.org prostitutki-kharkova.org
prostitutki-yaroslavlya.org pukaporn.com
pskcijdc.bloger.index.hr pwwysydh.com
pussyspace.net qld10000.net
q-moto.ru quangcaons.com
quickloanbank.com queerspace.com
randki-sex.com radiogambling.com
ranksignals.com randalljhoward.com
rapidsites.pro ranksays.com
razorweb-a.akamaihd.net ranksonic.com
regdefense.com realtytimes.com
registratciya-v-moskve.ru rebrand.ly
remedyotc.com recordpage-a.akamaihd.net
remont-mobile-phones.ru registrationdomainsite.com
remont-ustanovka-tehniki.ru resultshub-a.akamaihd.net
rezeptiblud.ru richinvestmonitor.com
rockma.se rixpix.ru
rome2rio.com roma-kukareku.livejournal.com
rustic-quiver.win rospromtest.ru
saecsa.co royalvegascasino.com
sanidumps.com ruscopybook.com
sanjosestartups.com russian-postindex.ru
sbwealthsolutions.ca sabizonline.com
saddiechoua.com
sammlungfotos.online
saneitconsulting.com
santasgift.ml
sanyuprojects.com
scalerite.co.za scalerite.co.za
scanner-don.top scanner-fred.top
scanner-george.top scanner-jess.top
scanner-viktor.top scenarii-1-sentyabrya.uroki.org.ua
scansafe.net sdi-pme.com
scottbywater.com search-error.com
scripted.com
scrnet.biz.ua
search.pch.com
searchengineranker.email
searchmywindow-a.akamaihd.net
securesmrt-dt.com
seksotur.ru
seoheap.com seoheap.com
seonetwizard.com sexy-pings.com
servicecenter.co.ua shlyahten.ru
sex-tracker.de shoesonlinebuy.xyz
sexobzor.info shohanb.com
shoesonlinebuy.cn shopcheermakeup.info
shopwme.ru sibecoprom.ru
shymkent.xkaz.org sientalyric.co
signx.info simon3.ru
siha.de skincrate.net
sk.golden-praga.ru skladvaz.ru
slowmac.tech
snsdeainavi.info snsdeainavi.info
soc-econom-problems.ru snyatie-lomki-v-stacionare.ru
social-button.xyz socialbuttons.xyz
soietvousmaime.fr socialmediasuggest.com
soundfrost.org softomix.com
specialfinanceoffers.com spidtest.org
speedup-my.site sport-video-obzor.ru
spinnerco.ca spylog.com
sport7777.net star61.de
spravka-medosmotr.ru stillmiracle.com
spyfu.com stoki.ru
stard.shop
stats-public.grammarly.io
stauga.altervista.org
steamoff.net
store-rx.com
stroiminsk.org stroiminsk.org
strongholdsb.ru studentguide.ru
strongsignal-a.akamaihd.net subj.ukr-lit.com
success-seo.com supermodni.com.ua
sucsesofinspiration.com surflinksmedical.com
svbur.ru
tandvardshuset.net tandvardshuset.net
teencastingporn.com teguh.info
tengohydar.tk texbaza.by
textads.men the-torrent-tracker.blogspot.com
thedownloadfreeonlinegames.blogspot.com thebestweightlosspills.ovh
thecoolimages.net
thegameriders.com
thegolfclub.info thegolfclub.info
themeforest.net
thepokertimer.com thepokertimer.com
tizanidine4mgstreetprice.blogspot.com timdreby.com
tizanidineingredients.blogspot.com tivolibasket.it
tizanidinerecreationaluse.blogspot.com tizanidineduringpregnancy.blogspot.com
tizanidinevscyclobenzaprine.blogspot.com tizanidinehcl4mgtab.blogspot.com
tn811.us tizanidinehcl4mgtablet.blogspot.com
topanasex.com tizanidinehydrochloride4mgstreetvalue.blogspot.com
tozup.com tizanidinepills.blogspot.com
tizanidinesideeffectsweightloss.blogspot.com
tizanidinestreetprice.blogspot.com
tizanidineusedfor.blogspot.com
token-lab.org
tootoo.to
top-study.work
topappspro.com
toyota.7zap.com
track.deriv.com
trafaret74.ru trafaret74.ru
trafficgenius.xyz
trafficreceiver.club trafficreceiver.club
try-rx.com truck-addzilla.life
tube8.com tubo360.com
turizm.bz tuckermktg.com
tuckpointingmasonrysystems.com
tupper-posuda.ru
turvgori.ru turvgori.ru
tv-spoty.info tvand.ru
tzritel.tk tvnewsclips.info
uamtrk.com tytoona.com
uchebavchehii.ru uhdtv.website
uchil.net ukkelberg.no
uk-zheu20.ru unblocksit.es
ukrobstep.com unece.org
uogonline.com
uprour.com uprour.com
upstore.me urzedowski.eu
usacasino.com usacasino.com
usadacha.net vandrie-ict.nl
vapsy.com vclicks.net
veles.shop vduplo.ru
viagra-soft.ru vesnatehno.com
video-hollywood.ru via-energy-cumpara.com
videojam.tv vinsit.ru
videospornogratisx.net vintontech.info
vip-file.com viven.host.sk
vip2ch.com vmnmvzsmn.over-blog.com
virus-schutzmasken.de vodaodessa.com
visitcambridge.org volgograd.xrus.org
voloomoney.com vote-up.ru
vonradio.com vroze.com
voprosotvet24.ru vzlomtw.com
wallpapersist.com wallpapersdesk.info
walpaperlist.com wanker.us
wareseeker.com wareseeker.com
webix.me warningwar.ru
weblibrary.win wdfdocando.com
webradiology.ru webkeyit.com
webs.com webscouter.net
website-audit.com.ua weddingdresses.xyz
wejdz-tu.pl whengirlsgowild.com
welcomeauto.ru
wfb.hatedriveapart.com
whiteproduct.com whiteproduct.com
wieseversa.no wieseversa.no
wma-x.com wikes.20fr.com
woman-tampon.ru woman-tampon.ru
woodyguthrie.se womens-journal.net
wordpresscore.com wordkeyhelper.com
worldmusicfests.com worldinternetauthority.com
www.ehscloud.cn worldis.me
wowcasinoonline.ooo
www.jbetting.com
www.solartek.ru www.solartek.ru
x-diesel.biz x-musics.com
x-diesel.org x-true.info
x-mix.info xfluro.com
x-rates.ru xn-----6kcaacnblni5c5bicdpcmficy.xn--p1ai
xgftnlrt.bloger.index.hr xn----7sbbagbq7bd5aheftfllo4m.xn--p1ai
xmnb.net xn----8sblgmbj1a1bk8l.xn----161-4vemb6cjl7anbaea3afninj.xn--p1ai
xn------7cdbapdecfd4ak1bn0amjffj7afu3y.xn--p1ai xn--80aaagvmjabrs1aoc9luc.xn--p1ai
xn----7sbahjd3btneuw1joc.xn--p1ai xn--b1adccaf1bzj.xn--p1ai
xn----8sbhefaln6acifdaon5c6f4axh.xn--p1ai xn--c1acygb.xn--p1ai
xn----ctbbcjd3dbsehgi.xn--p1ai
xn--80ahdheogk5l.xn--p1ai
xn--d1abj0abs9d.in.ua xn--d1abj0abs9d.in.ua
yachts-cruise.info xtraffic.plus
yebocasino.co.za xxart.ru
ynymnwbm.bloger.index.hr yoopsie.com
yougotanewdomain.com youjizz.vc
youtoner.it your-bearings.com
yuarra.pluto.ro yourads.website
youtuhe.com
yurgorod.ru yurgorod.ru
zaapplesales.blogspot.com yuweng.info
zastenchivosti.net za-music.mymobiplanet.com
zdesformula.ru zarenica.net
zero1.it zigarettenonlinekaufen2.drupalgardens.com
zeroredirect.com zkjovpdgxivg.ga
zeroredirect10.com zoodrawings.com
zeroredirect7.com zs2vm.top
zophim.me
zreloeporno.tv
zx6.ru

478
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
123movies.love 123locker.com
1j7740kd.website 2pxg8bcf.top
404.mn 4kepics.com
7search.com 4webmasters.org
8jn.dating-app.ru
abcguru.xyz
absolute-s.ru absolute-s.ru
academiacsmendoza.org activepr.ru
acc.eu.org adexprts.com
actices.com adhome.biz
adf.ly
admitad.com
adtology.com
akuhni.by akuhni.by
albumsuper.info alkoravto.ru
alevinefesleri.com alldezservice.kz
alfa-img.com alldubai.biz
alltheviews.com anapa-inns.ru
alyeskaresort.com android-style.com
angel1777.kz animenime.ru
apccargo.com aosheng-tech.com
appfastplay.com apartment.ru
apple.com-cleaner.systems apishops.ru
arewater.com asscenihotosidea.blogspot.co.za
arquivo.pt aviva-limoux.com
asociatia-tipografilor-transilvania.ro avtoarenda.by
autovideobroadcast.com ayakino.net
ayodhya.co bagcionderlab.com
azarttoto.com bestdooz.com
b00kmarks.com bestdraws.com
bankofthewext.com bezsporno.ru
bestcurs.org bjetjt.com
bestwebsitesawards.com blackplanet.com
betterhdporn.com bpro1.top
betteroffers.review brendbutik.ru
beyan.host.sk brianhenry.co
big-boards.info bukleteg.xyz
bioinnovate.co buyviagraa.blogspot.com
bitcoinpile.com buzzzg.men
blog-hits.com cartierlove2u.com
blog.remote-computer.de cbb1smartlist12.click
brainsandeggs.blogspot.com christianlouboutinsaleoutletonline.us
buyclomidonlaine.com citetick.com
buyscabiescream.com citysecurity.nu
bvlgariring.xyz clarithromycin500mg.com
cactussoft.biz
call-of-duty.info
callcafe.info
carabela.com.do
carapics.com
cdn.walkme.com
cdnanalytics.xyz
cdncash.org
cfsrating.sonicwall.com
cherubinimobili.it
chocolateslim-en-espana.com
clickhype.com clickhype.com
coderstate.com collegeessay19.blogspot.ru
comissionka.net compliance-mark.top
compliance-checker.info computernetworksonline.com
connectionstrenth.com courtshipgift.com
cookie-law-enforcement-ff.xyz cs-passion.pl
cosmeticswomens-womensports.rhcloud.com cubs-jerseys.us
cpajunkies.com customcatchcan.com
darkages.info cvety24.by
dating-app.ru daooda.com
ddpills.com daretodonate.co
dignitasdata.se design-ideas.info
directrev.com detalizaciya-tut.biz
diy-handmade-ideas.com deutschehobbyhuren.net
dktr.ru deutschland123.de
doctormakarova.ru directivepub.com
dojki-hd.com djstools.com
drugs-no-rx.info docsportal.net
dyshagi.ru docstoc.com
earn-from-articles.com dojki365.online
ee77ee.com dokumentalkino.net
erotik0049.com domaincrawler.com
ertelecom.ru dwomlink.info
eupornstar.info e-biznes.info
everypony.ru ecxtracking.com
exoclick.com eduinfosite.com
f-loaded.de electro-prom.com
fakehandbags.xyz elektrischezigaretten2.beeplog.com
family1st.ca elektronischezigarette2.mex.tl
farmprofi.net enternet.ee
fashion-stickers.ru erotikchat-24.com
fatfasts-4tmz.com essaypro.com
fearcrow.com evidencecleanergold.com
financeloan.us ewebarticle.info
flashlarevista.com ezb.elvenmachine.com
forum20.smailik.org ezigarettenkaufen1.pagina.gr
free-share-buttons.blogspot.com fable.in.ua
free-social-buttons.xyz feorina.ru
gallerily.com fickenprivat.info
geileweiber.tk filerockstar298.weebly.com
firesub.pl
flirt4free.com
formulaf1results.blogspot.com
fototravel.eu
foxweber.com
freelinkbuilding.website.tk
freshsuperbloop.com
frivgame250.com
funnymama.com
funnypica.com
g.starmoe.xyz
gagrasector.ru
genericlowlatencyasiodriverhq.aircus.com
gepezz.info gepezz.info
germetiki.com.ua getridofstretchmarks.org
glavprofit.ru globalsurfari.com
gorabagrata.ru goldenggames.com
gorodservis.ru googglet.com
gsasearchengineranker.top gwebtools.com
guardlink.com gyffu.com
guitar-master.org hidemyass.com
gwhwpxbw.bloger.index.hr homik.pw
h2monline.com host-protection.com
handsandlegs.ru howlongdoestizanidinestayinyoursystem.blogspot.com
hd-film.pl hscsscotland.com
heliko.no hulfingtonpost.com
hem.passagen.se hunterboots.online
hesteel.pl incolors.club
hildinghr.se infogame.name
hplaserjetpdriver8y.pen.io int.search.tb.ask.com
hyipmanager.in invivo.hu
imk.com.ua iptool.xyz
infobanks.ru iqoption-bin.com
informatiecentro.be ispac.org
inzn.ru
iplogger.org
istizanidineanopiate.blogspot.com istizanidineanopiate.blogspot.com
itch.io ivanstroi.ru
izhevsk.xrus.org izhevsk.xrus.org
janerikholst.se jillepille.com
jasonpartington.com kaidalibor.de
jaxcube.info kam-dom.ru
jerseyssportsshop.com keywordbasket.com
jetsli.de klumba55.ru
karpun-iris.ru kmd-pto.ru
karting196.ru kupiproday.com.ua
keywordblocks.com kursy-ege.ru
kongruan.com lafriore.ru
ladsup.com lernur.net
lashstudia.ru lisque.batcave.net
ldrtrack.com livingroomdecor.info
life.biz.ua lonerangergames.com
linksharingt.com louboutinreplica.xyz
listiseltemournlan.gq lovasszovetseg.hu
littleberry.ru
loginduepunti.it
lonely-mature.com
luchshie-topcasino.ru luchshie-topcasino.ru
lunamedia.co makemoneyonline.com
luxmagazine.cf manipulyator-peterburg.ru
madot.onlinewebshop.net mastershef.club
makis.nu mearns-tractors.co.uk
marcowebonyodziezowe.pl medicines-choice.com
marmotstore.online michaelkorsoutletstore.net
miniads.ca
mnimmigrantrights.net
monclerboots.xyz
monclercheap.xyz
movies-in-theaters.net movies-in-theaters.net
mp3ritm.top mozello.ru
mrbojikobi4.biz mrmoneymustache.com
multgo.ru muz-baza.net
mydoctorok.ru mvpicton.co.uk
nacap.ru mysex21.com
nailsimg.com mywallpaper.top
narkologiya-belgorod.ru nakozhe.com
newhairstylesformen2014.com nakrutka.cc
nfljerseyscheapchinabiz.com nalogovyy-kodeks.ru
no-rx.info nastroyke.net
nvformula.ru negociosdasha.com
nhl17coinsforps3.gratisblog.biz
nonews.co
npoet.ru
nw-servis.ru nw-servis.ru
okroshki.ru oecnhs.info
onlinedomains.ru oklogistic.ru
openmultipleurl.com okonich.com.ua
oranga.host.sk omsk.xrus.org
pagesense.com oneclickfiles.com
paperwritingservice17.blogspot.ru oneminutesite.it
parajumpersstore.online oneshotdate.com
park.above.com online.ktc45.ru
pelfind.me onlinebay.ru
picquery.com onlineslotmaschine.com
picturesify.com oops-cinema.ru
picturesmania.com orion-code-access.net
platinumdeals.gr orsonet.ru
poem-paying.gq outclicks.net
poffet.net ownshop.win
pokerniydom.ru papasdelivery.ru
paradontozanet.ru
pattersonsweb.com
paydayonlinecom.com
pcimforum.com
pdns.download
peekyou.com
perosan.com
php-market.ru
plastgranar.nu
polcin.de
polybuild.ru
pooleroadmedicalcentre.co.uk
popugauka.ru popugauka.ru
pornokorol.com profitkode.com
pornophoto.xyz randalljhoward.com
portadd.men realnye-otzyvy.info
princeadvantagesales.com referencemoi.com
prodess.ru resant.ru
quick-offer.com rfserial.net
registrationdomainsite.com romhacking.ru
reining.lovasszovetseg.hu
remont-fridge-tv.ru
remont-komputerov-notebook.ru
ros-ctm.ru
royalads.net royalads.net
sandhillsonline.com ruex.org.ua
sarm.tk scanner-willy.top
seccioncontrabajo.com seminarykansas904.ml
sexstream.pl seozoom.it
slayerlife.com service-core.ru
souvenir.cc sexpornotales.com
space2019.top simply.net
space4update.pw sky-mine.ru
sribno.net socialbutton.xyz
stroydetali.ru socialmonkee.com
swinger-mobil.net spammen.de
swingerseiten.com sps-shop.com
tabletkinaodchudzanie.com.pl sstroy44.ru
tagil.zrus.org staticfs.host
titan-ads.life stats-public.grammarly.io
tizanidinehcl4mgisitanarcotic.blogspot.com storehouse.ua
tizanidineoral.blogspot.com stroilka.info
tizanidinevssoma.blogspot.com sudexpert66.ru
trafaret74.ru support.nopeas.sk
traffic-club.info takeflyte.com
traffic2money.com tattooreligion.ru
trafficnetzwerk.de theporndude.com
treasuretrack-a.akamaihd.net thewebsitetemplate.info
ttsq.fr tizanidineinteractions.blogspot.com
tuberkuleznik.ru topsy.com
tuckermktg.com topvidos.ru
turn-up-life.life torrent-newgames.com
u555u.info trafficjunky.com
undergroundcityphoto.com trahic.ru
uptimechecker.com tupper-shop.ru
urccvfmc.bloger.index.hr tytoona.com
valmetrundan.se ublaze.ru
via-energy-acquistare.com uchebavchehii.ru
via-energy-order.com udayavani.com
videos-for-your-business.com unitexindia.com
viel.su unrealcommander.org
vipps.com.my urengoy.pro
virus-schutzmasken.de valuado.com
vltai.com vchulkah.net
voronezh.xrus.org verymes.xyz
warningwar.ru viandpet.com
website-datenbank.de vitalads.net
wemarketing.se vriel.batcave.net
wheelchairliftsarea.com watchmyfb.pl
wildnatureimages.com webix.me
win-spy.com wholesalejerseysgaa.com
winterclassichockeyjerseys.com winx-play.ru
x-diesel.biz wnoz.de
xn----7sbho2agebbhlivy.xn--p1ai www.arenda-yeisk.ru
xn----ctbbcjd3dbsehgi.xn--p1ai wwwadultcheck.com
xn--80aaagvmjabrs1aoc9luc.xn--p1ai xboxster.ru
xn--d1abj0abs9d.in.ua xn----itbeirbjbi7bc6bh2d.xn--p1ai
xsion.net yellowstonesafaritours.com
xtubeporno.net yottos.com
yebocasino.co.za youandcredit.ru
zawyna.ua youporn-forum.ga
zigarettenonlinekaufen2.bloog.pl zarepta.com
znaniyapolza.ru

363
dev-tools/test_units/ratelimittest-beta.txt
View file

@ -8,184 +8,6 @@
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html>ml>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html><html> </html><html>
<head><title>503 Service Temporarily Unavailable</title></head> <head><title>503 Service Temporarily Unavailable</title></head>
<body> <body>
@ -494,6 +316,181 @@
<hr><center>nginx/1.18.0 (Ubuntu)</center> <hr><center>nginx/1.18.0 (Ubuntu)</center>
</body> </body>
</html> </html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<!DOCTYPE html> <!DOCTYPE html>
<html> <html>
<head> <head>
@ -584,4 +581,14 @@
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html> </html>

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.76 0; 10.1.0.64 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2021.11.2719 ### Version: V4.2021.11.2720
### Updated: Tue Nov 16 22:01:14 UTC 2021 ### Updated: Wed Nov 17 10:03:32 UTC 2021
### Bad Bot Count: 627 ### Bad Bot Count: 627
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2021.11.2719 ### Version: V4.2021.11.2720
### Updated: Tue Nov 16 22:01:14 UTC 2021 ### Updated: Wed Nov 17 10:03:32 UTC 2021
### Bad Bot Count: 627 ### Bad Bot Count: 627
################################################### ###################################################
### Version Information ## ### Version Information ##