vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-02 18:50:13 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2022.11.3478 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2022-11-18 10:09:34 +00:00
parent 5650a585b3
commit 2f73c32961
47 changed files with 94636 additions and 94643 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.11.3477 #### Version: V4.2022.11.3478
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.11.3477 #### Version: V4.2022.11.3478
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -14,7 +14,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2022.11.3477 #### Version: V4.2022.11.3478
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

11676
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2022.11.3477 #### Version: V4.2022.11.3478
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

11680
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

11680
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

11680
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

11680
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.42 1; 10.1.1.18 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.42 0; 10.1.1.18 0;
127.0.0.1 0; 127.0.0.1 0;

11680
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.42 1; 10.1.1.18 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.42 0; 10.1.1.18 0;
127.0.0.1 0; 127.0.0.1 0;

11680
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.42 1; 10.1.1.18 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.42 0; 10.1.1.18 0;
127.0.0.1 0; 127.0.0.1 0;

11680
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
3477 3478

11680
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

11680
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.225.158.37 0; 20.29.76.148 0;

11680
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.42 1; 10.1.1.18 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.42 0; 10.1.1.18 0;
127.0.0.1 0; 127.0.0.1 0;

11680
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.42 1; 10.1.1.18 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.42 0; 10.1.1.18 0;
127.0.0.1 0; 127.0.0.1 0;

11680
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.42 1; 10.1.1.18 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.42 0; 10.1.1.18 0;
127.0.0.1 0; 127.0.0.1 0;

11680
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.225.158.37 0; 20.29.76.148 0;

11680
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.225.158.37 0; 20.29.76.148 0;

11680
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.42 1; 10.1.1.18 1;
127.0.0.1 1; 127.0.0.1 1;

18
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
Bolt Craftbot
Buddy JustView
Fimap Lightspeedsystems
PictureFinder Navroad
Net Vampire
NetLyzer
Pixray Pixray
SEOstats ScanAlert
Shodan Seekport
SpankBot webmeup-crawler
VelenPublicWebCrawler
s1z.ru

296
dev-tools/test_units/random-bots-for-test.list
View file

@ -3,248 +3,248 @@
404checker 404checker
80legs 80legs
ADmantX ADmantX
AIBOT
ASPSeek
Abonti
Aboundexbot Aboundexbot
Acunetix
AfD-Verbotsverfahren
AhrefsBot AhrefsBot
AiHitBot
Aipbot Aipbot
AllSubmitter AllSubmitter
AlphaBot AlphaBot
Aspiegel Anarchie
Anarchy
Ankit
Anthill
Apexoo
Asterias Asterias
Atomseobot
Attach
AwarioRssBot AwarioRssBot
AwarioSmartBot
BBBike BBBike
BDFetch BackWeb
Bandit Backlink-Ceck
BacklinkCrawler
Battleztar Bazinga
BetaBot BetaBot
Bigfoot Bigfoot
Black Hole Black Hole
Blackboard BlackWidow
Blow
BotALot BotALot
Buck Buck
Buddy
BuiltBotTough
BuiltWith BuiltWith
BunnySlippers BunnySlippers
CATExplorador
CODE87 CODE87
Calculon CSHttp
Cegbfeieh CazoodleBot
CheTeam CherryPicker
ChinaClaw
Chlooe
Cliqzbot
Cloud mapping Cloud mapping
Collector
Craftbot Craftbot
Crawling at Home Project
Curious Curious
Custo
CyotekWebCopy CyotekWebCopy
DBLBot DBLBot
DIIbot DIIbot
DataCha0s DataCha0s
DatabaseDriverMysqli Deusu
Demon
Digincore Digincore
Disco Dirbuster
DittoSpyder DomCopBot
DomainAppender DomainAppender
DomainSigmaCrawler DomainCrawler
DomainStatsBot DomainStatsBot
Domains Project Domains Project
Download Wonder Dotbot
Dragonfly ECCP/1.0
EMail Siphon
EMail Wolf EMail Wolf
Ebingbong Express WebPictures
Ecxi
EirGrabber
EroCrawler
Evil
ExtLinksBot
Extractor
ExtractorPro ExtractorPro
Extreme Picture Finder FHscan
Flunky FemtosearchBot
G-i-g-a-b-o-t Firefox/7.0
Foobot
GT::WWW
GalaxyBot GalaxyBot
GetWeb Go!Zilla
Gigabot
Grabber
GrapeFX
GrapeshotCrawler GrapeshotCrawler
HEADMasterSEO HEADMasterSEO
HMView HMView
HTMLparser HTMLparser
HTTrack Haansoft
Harvest
Hloader Hloader
IRLbot IDBTE4M
Id-search IDBot
InfoTekies InfoTekies
Intelliseek Intelliseek
Internet Ninja
InternetSeer InternetSeer
Iskanie JennyBot
JOC Web Spider JetCar
Jbrofuzz Jetty
Joomla Jorgee
JustView
Kenjin Spider Kenjin Spider
Keybot Translation-Search-Machine Keybot Translation-Search-Machine
LNSpiderguy Keyword Density
Larbin Kinza
Lanshanbot
LeechGet
LexiBot LexiBot
LibWeb LibWeb
Libwhisker
LieBaoFast LieBaoFast
Lightspeedsystems Lightspeedsystems
LinkScan
LinkWalker LinkWalker
Linkbot LinkextractorPro
LinkpadBot LinkpadBot
LinksManager
LinqiaRSSBot LinqiaRSSBot
Lipperhey Lmspider
Litemage_walker Ltx71
MIDown tool MFC_Tear_Sample
MIIxpc MJ12bot
MQQBrowser
MSIECrawler
MTRobot MTRobot
Majestic SEO Magnet
Majestic12 MauiBot
Meanpathbot Mb2345Browser
MegaIndex.ru Metauri
MicroMessenger
Microsoft Data Access
Microsoft URL Control Microsoft URL Control
Minefield
Mister PiX Mister PiX
Mojolicious Mojeek
Mozlila
Mr.4x3 Mr.4x3
Msrabot
Musobot Musobot
NICErsPRO
Nameprotect
Navroad Navroad
NearSite
Nessus Nessus
Net Vampire Net Vampire
NetMechanic NetAnts
Netcraft Netcraft
Nettrack
Netvibes Netvibes
NextGenSearchBot NextGenSearchBot
NimbleCrawler
Nimbostratus Nimbostratus
Ninja Ninja
Nmap
Not
Nuclei Nuclei
Octopus Nutch
Offline Navigator OrangeSpider
OnCrawl
Openvas
OutclicksBot
PHPCrawl
POE-Component-Client-HTTP POE-Component-Client-HTTP
Page Analyzer Page Analyzer
PageAnalyzer PageAnalyzer
PageGrabber PageScorer
Pavuk
Pi-Monster Pi-Monster
Picscout
Picsearch Picsearch
PictureFinder
Piepmatz Piepmatz
Pixray Pimonster
Probethenet Pu_iN
Psbot Pump
QueryN Metasearch PyCurl
RankActive Rankivabot
RankActiveLinkBot
RankFlex
RankurBot
Re-re
ReGet
RealDownload RealDownload
RebelMouse RebelMouse
Rogerbot RocketCrawler
SEOprofiler SBIder
SEOlyticsCrawler
SISTRIX SISTRIX
SMTBot ScanAlert
SalesIntelligent ScoutJet
Scrapy Seekport
Screaming SemanticJuice
ScrepyBot SemrushBot
SearchmetricsBot Seomoz
SeoSiteCheckup Site Sucker
SiteSnagger
SiteSucker SiteSucker
Siteimprove Sitebeam
SlySearch SmartDownload
Snake Sociscraper
Sottopop Sogou web spider
SpaceBison Sosospider
SpankBot SpankBot
Stripper Spanner
Sucker Sqlworm
Steeler
SuperBot
SuperHTTP SuperHTTP
Szukacz TeleportPro
T0PHackTeam Telesphoreo
T8Abot
Telesoft
Telesphorep Telesphorep
The Intraformant TightTwatBot
TheNomad Titan
Toweyabot Tracemyfile
Trendictionbot Trendiction
Turnitin True_Robot
TurnitinBot TurnitinBot
TwengaBot Twice
Typhoeus Typhoeus
URLy Warning V-BOT
URLy.Warning VB Project
VCI
Vacuum Vacuum
Vagabondo Vagabondo
VeriCiteCrawler VelenPublicWebCrawler
VoidEYE VoidEYE
Voil WISENutbot
WWW-Collector-E WWW-Mechanize
WeSEE Web Collage
Web Fetch
Web Fuck Web Fuck
Web Sucker
WebBandit WebBandit
WebCollage WebCollage
WebCopier WebCopier
WebEnhancer WebEnhancer
WebGo IS WebFuck
WebReaper WebImageCollector
WebZIP WebSauger
WebmasterWorldForumBot WebSucker
Website Quester WebWhacker
WebsiteExtractor Webster
Whack
Whacker Whacker
Who.is Bot WinHTTrack
Wprecon Wonderbot
Woobot
Wotbox
Xaldon WebSpider Xaldon WebSpider
YoudaoBot YoudaoBot
Zade Zauba
Zermelo Zermelo
Zeus Zeus
Zitebot
ZmEu ZmEu
ZoomBot
ZoominfoBot ZoominfoBot
ZyBorg ZyBorg
archive.org_bot arquivo.pt
check1.exe autoemailspider
clark-crawler cah.io.community
coccocbot coccocbot
cognitiveseo
crawler4j crawler4j
dataforseo.com eCatch
demandbase-bot facebookscraper
domainsproject.org internetVista monitor
heritrix isitwp.com
ips-agent
iubenda-radar iubenda-radar
linkdexbot
lwp-request lwp-request
lwp-trivial polaris version
meanpathbot probe-image-size
mediawords s1z.ru
netEstate NE Crawler
pcBrowser
plumanalytics
satoristudio.net
scalaj-http scalaj-http
spyfu scan.lol
webmeup-crawler sexsearcher
x09Mozilla sitechecker.pro
x22Mozilla sogouspider
zauba.io sysscan
tAkeOut
webpros.com
xpymep1.exe

296
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
01h4x.com
ADmantX ADmantX
AIBOT
ALittle Client ALittle Client
Abonti Abonti
Aboundex
Aboundexbot Aboundexbot
AfD-Verbotsverfahren AhrefsBot
Alexibot Aipbot
AlphaBot
Anarchie
Anthill Anthill
Apexoo
Aspiegel
Asterias Asterias
Attach Attach
AwarioRssBot BDFetch
BDCbot
BLEXBot BLEXBot
BackDoorBot BackDoorBot
Bandit BatchFTP
Barkrowler
Bigfoot Bigfoot
Bitacle Blackboard
BlackWidow
Blow
BlowFish
Boardreader Boardreader
Brandwatch BotALot
Brandprotect
Buddy Buddy
Bullseye CCBot
BunnySlippers
CATExplorador
CODE87
CSHttp CSHttp
CensysInspect CensysInspect
CheTeam
CheeseBot
Cliqzbot Cliqzbot
Cloud mapping Cloud mapping
Cocolyzebot Cocolyzebot
Collector Cogentbot
CopyRightCheck
Copyscape Copyscape
Craftbot Craftbot
Crawling at Home Project Crawling at Home Project
Crescent
CrunchBot
Curious
CyotekWebCopy
DBLBot DBLBot
DIIbot
DSearch
DTS Agent DTS Agent
Digincore Demon
Deusu
DigitalPebble DigitalPebble
Dispatch Dirbuster
DittoSpyder Disco
DnyzBot DnBCrawler-Analytics
DomCopBot
DomainAppender DomainAppender
DomainCrawler DomainStatsBot
DomainSigmaCrawler Domains Project
Download Wonder Dragonfly
ECCP/1.0 Drip
EMail Siphon EMail Siphon
EMail Wolf EasyDL
Ebingbong Ebingbong
Ecxi
EirGrabber EirGrabber
EroCrawler Evil
Extractor
ExtractorPro ExtractorPro
EyeNetIE Extreme Picture Finder
Ezooms Ezooms
FHscan FDM
FemtosearchBot FemtosearchBot
Firefox/7.0 Firefox/7.0
Foobot
Fuzz
FyberSpider
GT::WWW
GalaxyBot
Getintent
Gigabot Gigabot
Go!Zilla Go!Zilla
Gotit
GrabNet GrabNet
Grabber GrapeshotCrawler
GrapeFX HTTP::Lite
GridBot
Haansoft Haansoft
HaosouSpider HaosouSpider
Harvest Hloader
Heritrix HonoluluBot
IRLbot Humanlinks
Iblog HybridBot
Id-search IDBot
Indy Library IlseBot
JOC Web Spider Image Fetch
Jbrofuzz IndeedBot
Joomla InfoNaviRobot
Jorgee Intelliseek
Jyxobot Internet Ninja
Kinza InternetSeer
Iria
Iskanie
IstellaBot
Kenjin Spider
Keyword Density
LNSpiderguy LNSpiderguy
LWP::Simple LWP::Simple
Lanshanbot Lanshanbot
Larbin LeechGet
Leap
LeechFTP
LexiBot LexiBot
Lftp Lftp
Libwhisker LibWeb
LieBaoFast
LinkScan
LinkWalker LinkWalker
Linkbot Linkbot
LinqiaMetadataDownloaderBot LinkextractorPro
LinqiaRSSBot
MJ12bot MJ12bot
MQQBrowser MQQBrowser
MSFrontPage
MSIECrawler MSIECrawler
MarkMonitor MTRobot
Mail.RU_Bot
Majestic-SEO
MarkWatch
Mass Downloader Mass Downloader
Masscan
Mb2345Browser
MeanPath Bot
Meanpathbot Meanpathbot
MicroMessenger
Microsoft Data Access
Microsoft URL Control Microsoft URL Control
Minefield Mister PiX
Mojolicious Mojolicious
MolokaiBot MolokaiBot
Mozlila
Msrabot Msrabot
Musobot Musobot
NPbot NICErsPRO
NearSite Name Intelligence
Net Vampire Nameprotect
NetAnts NetAnts
NetSpider
NetZIP NetZIP
Netvibes Netvibes
NextGenSearchBot Nibbler
Niki-bot Nikto
Nimbostratus
Ninja Ninja
Nmap Nmap
Nuclei
Nutch Nutch
Octopus
Offline Explorer
Offline Navigator
Openvas Openvas
PECL::HTTP OrangeSpider
POE-Component-Client-HTTP OutclicksBot
PHPCrawl
PageAnalyzer PageAnalyzer
PageScorer PageScorer
Petalbot PeoplePal
Picscout Picscout
PictureFinder Picsearch
ProWebWalker Piepmatz
ProPowerBot
Probethenet
Psbot Psbot
Pump
PxBroker PxBroker
QueryN Metasearch
RankingBot
RankingBot2 RankingBot2
RankurBot ReGet
Re-re RealDownload
SBIder Reaper
SEOkicks-Robot RepoMonkey
SEOlyticsCrawler SEOstats
SISTRIX
SMTBot SMTBot
ScanAlert
Scanbot Scanbot
ScreenerBot ScoutJet
Searchestate ScrepyBot
SearchmetricsBot Seekport
SemrushBot Semrush
SeoSiteCheckup SentiBot
Seomoz SiteLockSpider
SiteExplorer SiteSnagger
Siteimprove SlySearch
SmartDownload
Snake Snake
Snoopy
SocialRankIOBot SocialRankIOBot
Sociscraper Sociscraper
Sottopop Spanner
Spammen Spinn3r
SputnikBot Steeler
Sqworm Stripper
Sucker Sucker
Surfbot SuperBot
Suzuran T0PHackTeam
Teleport
TeleportPro TeleportPro
Thumbor
Titan Titan
Toweyabot Toweyabot
Trendictionbot Trendictionbot
Turnitin True_Robot
Twice V-BOT
Typhoeus VCI
UnisterBot
Upflow
VB Project
Vacuum
Vagabondo
VeriCiteCrawler VeriCiteCrawler
Virusdie Voltron
VoidEYE WEBDAV
WASALive-Bot WISENutbot
WBSearchBot
WWW-Collector-E WWW-Collector-E
WWW-Mechanize WWWOFFLE
WeSEE Wallpapers
WebAuto Wallpapers/3.0
Web Collage
Web Pix
WebBandit WebBandit
WebCollage WebCopier
WebEnhancer
WebFetch
WebFuck WebFuck
WebGo IS WebGo IS
WebPix WebReaper
Webalta WebSauger
WebStripper
WebSucker
WebWhacker
WebmasterWorldForumBot WebmasterWorldForumBot
Webshag Webshag
Website Quester Website Quester
WebsiteQuester Whatweb
Whacker Widow
WiseGuys Robot WiseGuys Robot
Wonderbot Wonderbot
Woobot Xaldon_WebSpider
Wprecon
YoudaoBot
Zade
Zermelo Zermelo
ZoominfoBot Zeus
adscanner ZmEu
archive.org_bot ZoomBot
arquivo-web-crawler
autoemailspider autoemailspider
cah.io.community cah.io.community
coccocbot clark-crawler
com.plumanalytics
crawler.feedback crawler.feedback
crawler4j
dataforseo.com dataforseo.com
domainsproject.org
eCatch eCatch
evc-batch evc-batch
heritrix gopher
instabid instabid
internetVista monitor internetVista monitor
linkdexbot lwp-request
magpie-crawler pcBrowser
mediawords
muhstik-scan
oBot
probe-image-size probe-image-size
ripz s1z.ru
satoristudio.net satoristudio.net
scan.lol scalaj-http
seobility seocompany.store
seoscanners seoscanners
serpstatbot seostar
sexsearcher
sitechecker.pro sitechecker.pro
sp_auditbot siteripz
spyfu
sysscan sysscan
trendiction.de trendiction.de
voyagerx.com webgains-bot
webmeup-crawler webmeup-crawler
webprosbot
x09Mozilla
zauba.io
zgrab

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
2pxg8bcf.top 2rich4bitches.com
betune.onlinewebshop.net 4webmasters.org
elektrischezi.canalblog.com chatroulette.online
flprog.com gaming-journal.com
job.icivil.ir poem-paying.gq
modnie-futbolki.net russintv.fr
obiavo.uz stuff-about-money.com
remorcicomerciale.ro svarbit.com
sk.golden-praga.ru vancleefreplica.pw
trafficmp.com whiteproduct.com

936
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
000free.us 08800.top
1-99seo.com 101lesbian.xyz
1001desert.com 1adult.com
1j7740kd.website 214jaluwobapef.cf
1xbet4you.com 5ws.dating-app.ru
2345.com 6hopping.com
2ads.co.uk 7xc4n.com
45en.ru aa8780bb28a1de4eb5bff33c28a218a930.com
4k-player.pl aarbur.com
4ur.click aaronabel.com
5u.com abbanreddy.com
7yue.org acgs.tk
888.com actionnooz.com
991mostfm.co.id ad-words.ru
9med.net adhome.biz
aa625d84f1587749c1ab011d6f269f7d64.com adtech.us
abcguru.xyz adult3dgames.com
actices.com adultactioncam.com
activecampaign.dreamhosters.com advertex.info
actulite.com advertisingtag.net
add-add.men advocatemsk.ru
adman.gr advokateg.xyz
admanaerofoil.com agadelha.com.br
adminshop.com alarmobninsk.ru
adzerg.com algarveglobal.com
albuteroli.com alldezservice.kz
alert-fjg.xyz allsilver925.co.il
alldownload.pw anabolics.shop
allesohnegirls.net anaseracresar.tk
analnoeporno.tv angry-fermi-7633.arukascloud.io
animaltoplist.com apidigidocketnet-a.akamaihd.net
apishops.ru apisecretsaucebi-a.akamaihd.net
apiwoodensealcom-a.akamaihd.net
approvedlocal.co.za approvedlocal.co.za
appsaurus.com arenanews.com.ua
architecturebest.com as5000.com
arclk.net asophoto.com
arendovalka.xyz asscenihotosidea.blogspot.com
artavenuegardenstudios.com asseenontv.ru
astana.xxxkaz.org atlant-auto.info
auto-zapchasti.org atovh.local-finders.com
autoplate.info auto-moto-elektronika.cz
autowebmarket.com.ua avramstroy.ru
aviav.ru azadnegar.com
avtoarenda.by azartmsl.com
avtovolop.ru b-styles.xyz
ayakino.net bala.getenjoyment.net
babs.com.ua balla-boo.se
backlinkwatch.com batanga.net
backuperwebcam.weebly.com beauty-clinic.ru
baixar-musicas-gratis.com becuo.com
balook.com bestkfiledxd.cf
bangla-chat-uk-paralud.ga bestsexyblog.com
bbsoldes.fr bezlimitko.xyz
bedcapdealers.com bidr.trellian.com
bestbuy.ca biketank.ga
bet365.com bio-market.kz
betterhdporn.com bitcoins-live.ru
bgviagrachrx.com blog.axant.it
bharatdefencekavach.com blog.f00kclan.de
bimmerpost.com
bird1.ru
bizcheapjerseyswholesalechina.com
bloggedporn.com
bloggen.be
blogporn.in blogporn.in
bmw-ark.ru boazpower.com
bobba.dzaba.com bobba.dzaba.com
bochemit.com.ua bookmark4you.com
bombla.org brandimensions.com
bongiornos.info
bookmaker-bet.com
browsepulse-a.akamaihd.net
btc4u.ru
buigas.00it.com
bus-offer.com
businesn.men
businesxxl.com businesxxl.com
buy-forum.ru buyessayonline19.blogspot.ru
buybest1.biz buypanicdisorderpill.com
buytizanidineonline.blogspot.com calvet.altervista.org
buzzurl.jp camdenmemorials.com
carsdined.org canacopegdl.com
censys.io cars-modification.net
centraletermice.us carsplate.com
centrdebut.ru cartierjusteunclou.xyz
cfcl.co.uk cartierlove.xyz
chatroulette.life cartierloveringreplica.xyz
cherrypointplace.ca cellfun.mobi
chocolateslim-en-espana.com chastnoeporno.com
chocolateslim-en-france.com cheapjerseysbizwholesale.us
christianlouboutinoutlet.win cheapmarmot.online
cialischsrx.com chlooe.com
cibpenonptib.flu.cc cialisndbrx.com
civilwartheater.com cindymatches.com
clayvasedesigns.tk cjs.com.ru
clean-virus-mac.com cleanersoft.com
coinsspb.com clickpapa.com
comeondog.info colobit.biz
compliance-jack.top companies-catalog.com
compliance-julianna.top compliance-checker.info
construmac.com.mx compliance-fred.xyz
contentsexpress.com compliance-olga.top
coolbar.pro compliance-viktor.top
covetnica.com compliance-willy.top
crd.clan.su coolwallpapers-hd.com
creditnation.ru copro.pw
coprofam.org
cosmetic.donna7753191.ru
costablue.xyz
counciltally.com
credit-respect.ru
crirussian.ru crirussian.ru
crynet.cc csgo4.win
culmimg.pw cutt.us
customcollegeessays.net cymbaltaandtizanidine.blogspot.com
customergrowthsystems.com cyse.tk
cv.wallhade.co dailyfinancefix.com
danschawbel.com danceuniverse.ru
darkbooks.org daooda.com
dawlenie.com darmebel.com.ua
daymusam.com dbmkfhqk.bloger.index.hr
deluxedumps.com deda-moroza-zakaz.ru
detalizaciya-tut.biz dolohen.com
devochki.top domcran.net
dfwu1013.info domik-derevne.ru
discovertreasure-a.akamaihd.net dominterior.org
diusyawiga.tk dosugrostov.site
dnsrsearch.com dotnetdotcom.org
doctissimo.fr download-walpaperhd.blogspot.com
domainanalyzing.xyz downloadkakaotalk.com
domaincrawler.com doxysexy.com
domznaniy.ru easync.io
doxyporno.com ecookna.com.ua
draniki.org ed-shop01.ru
drugspowerstore.com editors.choice6912650.hulfingtonpost.com
dumpsmania24.com edwinkonijn.com.au
duplicashapp.com electro-prom.com
dverimegapolis.ru elmacho.xyz
e-poker-2005.com elmifarhangi.com
ekobata.ru empis.magix.net
electronicadirect.com envaseslotusama.com
eleimgo.pw epngo.bz
elkacentr.ru essay-writing.work
energy-ua.com euromasterclass.ru
enge-fotzen.info excaliburfilms.com
enskedesquashclub.se eyes-on-you.ga
erotag.com ezigarettekaufen1.hpage.com
errorfixing.space ezigarettekaufen2.yolasite.com
ertelecom.ru fashion.stellaconstance.co
estelight.ru
evrotekhservis.ru
exlarseva.webblog.es
expertnaya-ocenka.ru
eyelike.com.ua
ezaz.info
falcon-images.blogspot.com
farmingworm.com
fashionindeed.ml fashionindeed.ml
favoritemoney.ru fast-torrent.ru
feel-planet.com felizporno.com
fefo.gdn fickblock18.com
fenoyl.batcave.net fickkontakte.org
fettefrauen.net fidelityfunding.com
filmetricsasia.com fillmewithhappiness.com
filunika.com.ru filmbokep69.com
financetip.eu
findclan.org findclan.org
fishtauto.ru fishingwholesale.us
fitness-video.net
fiverr.com fiverr.com
flagcounter.me flash4fun.com
flauntyoursite.com flipper.top
flirt4free.com flirt4free.com
floating-share-buttons.com forex-indextop20.ru
forexunion.net forminecrafters.ru
formseo.com
formulaantiuban.com
fortunejack.com fortunejack.com
forum20.smailik.org forum.doctissimo.fr
forum69.info forums.d2jsp.org
forumprofi.de foxinsocks.ru
foxjuegos.com free-deals.faith
free-fbook-traffic.com freshmac.space
free-stock-illustration.com frustrated-favorable.gq
freecamdollars.com funtoonez.com
freeuploader.ml fz139.ttk.ru
frequiry.com gameplexcity.com
fungirlsgames.net gavuer.ru
fxund.us gazobeton-p.com.ua
gambarkatabaru.com gdebestkupit.ru
gardene.ru genericlowlatencyasiodriverhq.aircus.com
gay-file.com gentamicineyedrops.blogspot.com
gaz-voshod.ru gepezz.info
geileweiber.tk get-free-social-traffic.com
gemara.com gk-atlant.info
generousdeal-a.akamaihd.net glall.ru
getlamborghini.ga
ghostvisitor.com
gilbertbanda.net
globetrotting-culture.ru
gloverid.site
go2jump.org
gok-kasten.net
golden-catalog.pro
goo.ne.jp
goodhousekeeping.com goodhousekeeping.com
gourcy.altervista.org goodprotein.ru
gov.yanao.ru goodwinmetals.co
greatdealshop.com gotomontenegro.net
greenshop.su greatidea.marketing
gribkovye-zabolevaniya.com greendream.com.ua
gsasearchengineranker.space gunsvicceadadebt.tk
gta-top.ru gyffu.com
guildebzh.info handicapbathtubarea.com
gwagka.com headpress.ru
gwhwpxbw.bloger.index.hr hebr.myddns-flir.com
habermetre.com herehloadibs.cf
hawaiielectriclight.com himazin.info
hd-filmy.net hiwibyh.bugs3.com
hdpixent.com hobild.net
helicalpile.us homemature.net
hermesbracelets.xyz howtoclean.club
heygidday.biz hoztorg-opt.ru
highland-homes.com https-legalrc.biz
histock.info huhn.altervista.org
historichometeam.com huimin764128.com
hol.es husky-shop.cz
hoverboard360.at i-service.kz
hoverboard360.se ie.57883.net
howmuchdoestizanidinecost.blogspot.com imagefinder.site
howopen.ru impotentik.com
iboss.com indianmedicaltourismshop.com
icaseclub.ru infektsii.com
id-forex.com internetproviderstucson.com
ihc2015.info investmac.com
ilbe.club iptool.xyz
ilovevitaly.ru
imgata.com
increasewwwtraffic.info
infobanks.ru
infogame.name
insomniagamingfestival.com
intellego.info
iomoio.net
ip-guide.com
iqs.biz.ua
islandminingsupply.wordpress.com islandminingsupply.wordpress.com
istizanidineanopiate.blogspot.com itis4you.com
istizanidinelikexanax.blogspot.com itrevolution.cf
jav-fetish.com ivanovo.zrus.org
jav-idol.com jav-way.site
jerseywholesalebizchina.com je7.us
jolic2.com jikoman.info
journeydownthescale.info jo24news.com
jpcycles.com johnnyhaley.top
kambasoft.com jrpmakati.com
karaganda.xkaz.org jurajskie.info
kfon.eu kadashihotel.com
kndxbkdx.bloger.index.hr kalandranis.gr
knowyournextmove.com kalb.ru
kol-energo.ru kamalsinha.com
konteiner24.com keki.info
ketrzyn.pl
keywordsdoctor.com
kinofak.net
kinogonew.ru
kinoplen.ru
kinopolet.net
kliksaya.com
kmd-pto.ru
koral.se
krassh.ru krassh.ru
kumuk.info labelwater.se
kurbappeal.info lacloop.info
kvartir-remont.biz larger.io
kw21.org lescinq.com
lafriore.ru letsrepair.in
languagecode.com lexaprogeneric.link
lawyers.cafe likesdesign.com
ledis.top lincolntheatre.com
letolove.ru
lineavabit.it
lineshops.biz lineshops.biz
linkbolic.com linkdebrideur.xyz
littlesexdolls.com linkpulse.com
liveinternet.ru locimge.pw
locationdesaison.com lomb.co
lostaruban.com louisvuittonoutletstore.net
louboutinreplica.xyz luchshie-topcasino.ru
magazin-pics.ru m1media.net
magicdiet.gq mac-shield.com
macnewtech.com
mactechinfo.info
mainlinehobby.net
manipulyator-peterburg.ru
manuscript.su
marblestyle.ru marblestyle.ru
max-eclat.men marcoislandvacations.net
maxthon.com martlinker.com
maxxtor.eu medictube.ru
medi-fitt.hu
mediaoffers.click
medmajor.ru
meduza-consult.ru meduza-consult.ru
mega-bony2017.pl mega-polis.biz.ua
mere.host.sk mensandals.xyz
mhtr.be mirmedinfo.ru
michellblog.online mmoguider.ru
migente.com mobile-appster.ru
miniature.io mojpregled.com
monclercheap.xyz morepoweronmac.trade
monclercoats.xyz moskva.nodup.ru
moneyteam24.com mountainstream.ms
monitorwebsitespeed.com mrbitsandbytes.com
mrcsa.com.au my-cash-bot.co
mrlmedia.net my-floor.in.ua
mvpicton.co.uk mydownloadengine.com
myftpupload.com myftpupload.com
myiptest.com mykings.pw
mylida.org mysex21.com
myliveblog.ru najaden.no
mywallpaper.top narkologiya-voronezh.ru
nalogovyykodeks.ru networkcheck.xyz
neodownload.webcam new-apps.ru
news-speaker.com nightvision746.weebly.com
nl.netlog.com nikhilbahl.com
nofreezingmac.click niroo.info
normalegal.ru nmrk.ru
nottyu.xyz northfacestore.online
nudejapan.net norththeface.store
ohmyrings.com novatech.vn
olympescort.com novosti-hi-tech.ru
onlinemegax.com nsatc.net
onstrapon.purplesphere.in nudo.ca
oops-cinema.ru oda.as
oranga.host.sk of-ireland.info
osnova3.ru oktube.ru
ostrovtaxi.ru omoikiri-japan.ru
outpersonals.com omsk.xrus.org
oynat.info oneminutesite.it
partnerline.men onlyporno.ru
peugeot-club.org onthemarch.co
oren-cats.ru
origin-my.ru
ororodnik.goodbb.ru
otbelivanie-zubov.com
oz-offers.com
ozoz.it
painting-planet.com
paleohub.info
pammik.ru
park.above.com
partner-stop.men
pc-services.ru
pdamods.ru
pendelprognos.se
phelissota.xyz
photorepair.ru photorepair.ru
piski.top picsfair.com
picture-group.com
picturesboss.com
pillscheap24h.com
pinup-casino1.ru
pix-hd.com
pix24x7.com pix24x7.com
playtap.us pk-services.ru
plohaya-kreditnaya-istoriya.ru playboyfiles.xblog.in
plugingeorgia.com plugingeorgia.com
poisk-zakona.ru
poligon.com
pontiacsolstice.info
popmarker.com popmarker.com
popserve.adscpm.net
porndl.org porndl.org
pornhub-forum.ga porno-dojki.net
pornoelita.info porno-transsexuals.ru
pornosexrolik.com pornofiljmi.com
pornosmola.info pornokajf.com
potolokelekor.ru pornpost.in
powenlite24.ru posible.net
preconnubial.usuby.site potoideas.us
pozvonim.com
predmety.in.ua predmety.in.ua
pregnant.guru prlog.ru
priceg.com producm.ru
privat-girl.net profitsport.club
profit-opportunity.com prointer.net.ua
promgirldresses.xyz
promoforum.ru promoforum.ru
prostitutki-tolyatti.org pussyfleet.com
proxyradar.com quizzitch.net
purplestats.com randalljhoward.com
rating-bestcasino.com rankings-analytics.com
rcpmda.ikan1080.xyz razvratnoe.org
recipedays.ru realting-moscow.ru
reklama-i-rabota.ru rebrand.ly
replica-watch.ru recipedays.com
responsinator.com refererx.com
retailwith.com remont-fridge-tv.ru
reyel1985.webnode.fr respublica-otel.ru
royalads.net reversing.cc
royalcar-ufa.ru rockingclicks.com
rrutw.com roll123.com
rusenvironmental.net rospromtest.ru
ru-mediaget.ru
runofilms.ru
russia-today-video.ru
russkoe-zdorovie.ru russkoe-zdorovie.ru
sabizonline.com rvtv.ru
saddiechoua.com ryetaw.com
samara.rosfirm.ru sa-rewards.co.za
saratov.xrus.org saneitconsulting.com
sarm.tk sanidumps.com
savememoney.co.za sarafangel.ru
savetubevideo.com sarf3omlat.com
sbricur.com sbdl.no
scanner-julia.top scalerite.co.za
score-ads.men scanner-elena.top
scrnet.biz.ua scanner-mary.top
sdelai-prosto.ru scanner-walter.top
seansonline24.pl se-welding.ru
searchtooknow-a.akamaihd.net search.alot.com
secretscook.ru securesmrt-dt.com
see-your-website-here.com
seeingmeerkat.com seeingmeerkat.com
semp.net seeresultshub-a.akamaihd.net
seo-tools-optimizing.com sex-foto.pw
seo18.su sexspornotub.com
seocheki.net sexstream.pl
seokicks.de
servethis.com
service-core.ru
sex.hotblog.top
sexad.net
sexobzor.info
sexy-pings.com
shama-rc.net shama-rc.net
shell-pmr.ru sheerseo.com
shoppytoolmac.com shtora66.ru
sibecoprom.ru signal03.ru
sibvitr.ru signoredom.com
simple-image.com.ua simplepooltips.com
smallseotools.com simplesite.com
smartpet.ru skladvaz.ru
snowplanes.com skutecznetabletkinaporostwlosow.pl
social-vestnik.ru small-games.biz
socialmediasuggest.com smartbalanceworld.com
sonata-arctica.wz.cz smsactivator.ru
sonnikforme.ru sodexo.com
soundfrost.org soheavyblog.com
spb-plitka.ru speeddream.xyz
spidtest.org spl63.fr
spylog.com
spymac.net spymac.net
srgwebmail.nl
stardevine.com
stjamesschool.info
stockquotes.wooeb.com stockquotes.wooeb.com
strana-solnca.ru stockspmb.info
superkanpo.com stoki.ru
symbaloo.com stop-gepatit.te.ua
szamponrevita.pl streetfooduncovered.com
tabakur77.com strfls.com
tabletkinaodchudzanie.com.pl strigkaomsk.ru
tattooha.com stroiminsk.com
teastory.co surffoundation.nl
templates.franklinfire.co survival.betteroffers.review
terraclicks.com suture.co
the-trader.net sweepstakes.rewardit.com
sygraem.com
tackletarts.co
talant-factory.ru
telefonsexsofort.tk
tengohydar.tk
thebluenoodle.com thebluenoodle.com
thegioixekhach.com thesmartsearch.net
theguardlan.com thetattoohut.com
timdreby.com tilido.com
titelhelden.eu titslove.yopoint.in
tizanidinedosage.blogspot.com tizanidinewithdrawalsymptoms.blogspot.com
tizanidinefibromyalgia.blogspot.com tmearegion26.com
tizanidinehclsideeffects.blogspot.com toxicwap.com
tizanidinehydrochloride4mgstreetvalue.blogspot.com tozup.com
tizanidinesideeffects.blogspot.com trkur.com
tizanidinestreetvalue.blogspot.com trudogolik.net
tkanorganizma.ru truebeauty.cc
tomck.com tsyndicate.com
top1-seo-service.com tupper-posuda.ru
torrentgamer.net turizmus.us
torrents-tracker.com turn-up-life.life
torrnada.ru typimga.pw
track-rankings.online tytoona.com
tradgardspartner.se uggbootsoutletsale.us
traffic-club.info unisexjewelry.org
truemfilelj.gq v-doc.co
trustaffs.com vadimkravtcov.ru
tuckpointingmasonrysystems.com validdomain.xyz
tversvet.ru vapeface.club
tx41tclega.ru vclicks.net
u555u.info veopornogratis.xxx
uac.net.au vertaform.com
ugguk.online
uhodzalijami.ru
ukrobstep.com
unece.org
unionmarkt.de
unitygame3d.com
ural-buldozer.ru
url-img.link
usiad.net
ussearche.cf
validccseller.com
velobikestock.com
viagraneggrx.com
video-woman.com
videotuber.ru
vinylvault.co.uk vinylvault.co.uk
vizitki.net vipsiterip.org
vkontarkte.com virtualbb.com
vod.com.ua voluumtracker1.com
voloo.ru voronezh.xrus.org
vriel.batcave.net
vrnelectro.ru vrnelectro.ru
vrotike.ru vseigry.fun
vzube.com vzlom-na-zakaz.com
wallpapers-best.com w7s.ru
wareseeker.com web-analytics.date
warningwar.ru webix.me
webextract.profound.net wechatdownload10.com
webs.com whiteelephantwellington.com
weburok.com wineration.com
westermarkanjou.se winner7777.net
wnoz.de wjgony.com
womama.ru womens-journal.net
wordpress-crew.net wordpresscore.com
worldoffiles.ru worldinternetauthority.com
wpthemedetector.co.uk wpsecurity.website
ws.ampower.me wygraj-skiny.win
www.jbetting.com xaijo.com
x-diesel.com xn-----6kcaabbafhu7cskl7akvongwpo7hvjj.xn--p1ai
x69ty.ru xn-----6kcaacnblni5c5bicdpcmficy.xn--p1ai
xbaboon.com xn----7sbaphztdjeboffeiof6c.xn--p1ai
xgftnlrt.bloger.index.hr xn----9sbubg3ambdfl1j.xn--p1ai
xlovecam.com xn----ctbigni3aj4h.xn--p1ai
xmronta.com xn--80aeahghtf8ac5i.xn--p1ai
xn----9sbebi2bvzr7h.xn--p1ai xtraffic.plus
xn--80aaaks3bbhabgbigamdr2h.xn--p1ai xtube.com
xn--hxazdsfy.blogspot.com xxxhdvideo.site
xnxx-n.com yadro.ru
xrus.org yatrk.xyz
yourtemplatefinder.com yellocloud.be
youtubedownload.org yougetsignal.com
zapatosenventa.info youjizz.vc
zastenchivosti.net yourporn.com
zawyna.ua yoursearch.me
zigarettenonlinekaufen2.bloog.pl youtube-downloader.savetubevideo.com
zigzog.ru yurgorod.ru
zoolubimets.ru zagadki.in.ua
zakonobosago.ru
zapiszto.pl
zarabiaj-dzis.pl
zdesoboi.com
zeroredirect12.com
zigarettenonlinekaufen1.blox.pl
zirondelli.it
znakomstvaonlain.ru
zs2vm.top
zscaler.net
zverokruh-shop.cz
zzbroya.com.ua

478
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
007angels.com 34.gs
0n-line.tv 7yue.org
100dollars-seo.com aaronabel.com
123cha.com acads.net
2728fb936f0.com adviceforum.info
2kata.ru alekseevec.ru
7minuteworkout.com alert.scansafe.net
8kisses.eu all4wap.ru
aa625d84f1587749c1ab011d6f269f7d64.com allnews.md
adserver-e7.com android-systems.ru
adultwebhosting.info angel1777.kz
advancedsoftwaresupport.com appsaurus.com
airlandsea.info
alarmobninsk.ru
alpinism.ru
altamayoztourism.com
angkortours.vn
apibrowsesmartne-a.akamaihd.net
apidiamondatanet-a.akamaihd.net
approved.su
apps-analytics.net
arclk.net arclk.net
arendovalka.xyz auspolice.com
ayeartoforget.com autotrends.today
ayodhya.co autoua.top
azartniy-bonus.com backgroundpictures.net
b-styles.xyz bbsoldes.fr
backlinkwatch.com berlininsl.com
bad-stars.net best-businessman.ru
bag77.ru bestmobilityscooterstoday.com
bannerads.de bestofupload.info
best-coupon-offer.com birzha-truda.eu
bestwrinklecreamnow.com bombla.org
bigcareer.info bonanza-fortune.men
biketank.ga boom-celebs.com
bingo8888.com brakehawk.com
bioinnovate.co brateg.xyz
bjgugu.net.ua btvn.ru
blackwitchcraft.ru bugshoot.cn
bluerobot.info bukleteg.xyz
bluesman.nu butstrap.space
brk-rti.ru candypeople.se
brus-vsem.ru censys.io
buron.pw certifywebsite.win
business-made-fun.com cfcl.co.uk
carfax.com.ua cfjump.com
chelyabinsk.xrus.org cjmc.info
chidporn.com cleanersoft.com
chocolateslim-u-srbiji.com clmforexeu.com
cialisovercounteratwalmartusa.com cmd.kz
cmhomestayagency.com cocyq.inwtrade.com
com-cleaner.systems compliance-donald.xyz
companies-catalog.com compliance-ivan.top
compliance-willy.top coolgamechannel.com
concealthyself.com corta.co
contentsexpress.com cranly.net
continent-e.tv cupday.com
coop-gamers.ru custodieva.ru
copyrightclaims.org dating-time-now.com
crirussian.ru davidovic.info
cscwtalkto.site db.speedup.gdn
danceuniverse.ru deadlinkchecker.com
detalizaciya-tut.biz discountbarbour.online
docstoc.com discountliv.com
dojki365.online divku.ru
dvervmoskvu.ru documentbase.net
e-poker-2005.com domaincdn.xyz
easync.io dosug-lux.ru
edudocs.net downloadme.life
elektrozigaretten1.postbit.com doxyporno.com
enge-fotzen.info draniki.org
etur.ru drillsaw.ru
extlinks.com ekspertmed.com
extremepornos.net elektrischezigarette1.blog.pl
falopicm.pw elvenmachine.com
fastfixing.tech escortplius.com
favorcosmetics.com essay-edu.biz
findthe.pet etotupo.ru
forms-mtm.ru everytalk.tv
forumprofi.de excaliburfilms.com
free-floating-buttons.com ezb.elvenmachine.com
free-today.com f0815.de
gallerylisting.com faptitans.com
gallictures.com farmprofi.net
gamevalue7.weebly.com fingerprintjs.com
geckoandfly.com firesub.pl
gembird.com fix-website-errors.com
geoads.com florida-tourism.net
getlaid-xxxhookupdirect.com foxinsocks.ru
glass-msk.ru freemaintenancesysforpcandmac.top
goblacked.com fuck-paid-share-buttons.xyz
gojiberriess.apishops.ru funponsel.com
games.kolossale.ru
gardene.ru
ge0ip.net
generalporn.org
get-free-traffic-now.com
gilsonchiro.xyz
glall.ru
global-ics.co.za
globalscam.ga
gomusix.com
gonextmedia.com
goodly.pro
gopro-online.info gopro-online.info
goroda-vsego-mira.ru graphid.com
greenzaim.ru greatzip.com
gsasearchengineranker.site gwhwpxbw.bloger.index.hr
guruofcasino.com heartofbeijing.blogspot.com
hdpixion.com hermesbracelets.xyz
herokuapp.com hermesreplica.pw
hotelcrocenzi.sm hollywoodactress.info
hyipmanager.in hostsshop.ru
in-tandem.co ie.57883.net
incolors.club ilovevitaly.com
infospot.pt infostatsvc.com
internet-apteka.ru invitefashion.com
irunfar.com iqs.biz.ua
it-max.com.ua
itbc.kiev.ua
ivanovo.zrus.org ivanovo.zrus.org
j-times.ru janerikholst.se
japan-bearings.ru johannesburgsingles.co.za
junglenet-a.akamaihd.net kazka.ru
kchaxton.com keywordbasket.com
khafre.us keywordblocks.com
kicknights.gq keywords-monitoring-success.com
kinofak.net konoplisemena.com
kladrus.ru kostenloser-sex.com
knowyournextmove.com landscapebackgrounds.blogspot.com
kountrylife.com laudit.ru
kustanay.kz law-check-seven.xyz
kvartiry-remont.ucoz.ru
landreferat.ru
le-clos-des-alouettes.com
leadwayau.com leadwayau.com
legalrc.biz lenvred.org
lexixxx.com
lidoradio.com lidoradio.com
lion.playtap.us linkwithin.com
liveinternet.ro longadventure.com
liver-chintai.org m1media.net
loadopia.com m292.info
locustdesign.co macotool.com
mediafresh.online makis.nu
medizinreisen.de mathgym.com.au
merryhouse.co.uk megavolt.net.ua
middlerush-a.akamaihd.net
mikrobiologies.ru mikrobiologies.ru
mil-stak.com monclercheap.xyz
missis.top
mmoguider.ru
moncleroutletonline.xyz moncleroutletonline.xyz
mrwhite.biz moroccosurfadventures.com
muabancantho.info muschisexbilder.com
muz-tracker.net mydownloadengine.com
mydirtystuff.com myfreetutorials.com
narkologiya-penza.ru
national-today-winning-winner.club
needtosellmyhousefast.com needtosellmyhousefast.com
nelc.edu.eg newsperuse.com
netpics.org nextlnk12.com
noclegonline.info nfljerseyscheapchinabiz.com
notfastfood.ru normalegal.ru
nottyu.xyz
november-lax.com
npoet.ru npoet.ru
obuv-kupit.ru ochistka-stokov.ru
ofanda.com ok-ua.info
oivcvx.website onclickpredictiv.com
orhonit.com oneclickfiles.com
perfectpracticeweb.com onemantrip.com
perso.wanadoo.es osnova3.ru
piccdata.com ozoz.it
pirateday.ru partner-high.men
piter.xrus.org pathwhelp.org
play-mp3.com pc-virus-d0l92j2.pw
pdn-4.com
pechikamini.ru
perederni.net
perm-profnastil.ru
picturesfrom.com
piluli.info
pizza-imperia.com
play-movie.pl
playboyfiles.xblog.in playboyfiles.xblog.in
popup-jdh.xyz ploenjitmedia.azurewebsites.net
porno-home365.com pod-muzyku.club
pornonik.com popads.net
pornotubexxx.name porndroids.com
printie.com pornhub-forum.ga
privatefx-in.ru printingpeach.com
prlog.ru privacyassistant.net
prokotov.com privetsochi.ru
pulse33.ru proekt-mos.ru
qitt.ru profolan.pl
qwarckoine.com prpops.com
rangjued.com pskcijdc.bloger.index.hr
reining.lovasszovetseg.hu puteshestvennik.com
rentalcarnavi.info questionmarque.ch
ric.info quit-smoking.ga
royal-betting.net rabotaetvse.ru
runstocks.com ranksonic.org
rus-teh.narod.ru realtytimes.com
ruspdd.com recipedays.ru
russia-tao.ru redirect.trafficreceiver.club
s8-nowy-wygraj.comli.com rus-pornuha.com
sadaholding.com russian-postindex.ru
sale-japan.com rvi.biz
sardinie.us satoristudio.net
savememoney.co.za sbornik-zakonov.ru
saveriopiazza.it sbricur.com
scrnet.biz.ua service.adtech.fr
seoanalyses.com sexs-foto.top
sexfreepornoxxx.com shitmovs.com
sexkontakte-seite.com shoppytoolmac.com
sexsearch.com shtaketniki.ru
sextracker.be site.ru
sixcooler.de sky-mine.ru
skypasss.com sobecjvuwa.com.ru
slonechka.ru social-fun.ru
sluganarodu.ru social-s-ggg.xyz
sophang8.com soft1.ru
sugarkun.com spin2016.cf
suggest-keywords.com sportbetfair.com
sugvant.ru strangeduckfilms.com
superoboi.com.ua supervesti.ru
surflinksmedical.com svarkagid.com
tattomedia.com taqywu51.soup.io
tds-advert002.info telesvoboda.ru
tedxrj.com
terrafootwear.us terrafootwear.us
textads.men the-usa-games.blogspot.com
titan-cloud.life thegolfclub.info
tizanidinecost.blogspot.com tizanidineandcipro.blogspot.com
tizanidinedosage.blogspot.com tizanidinehcl4mgtabinfo.blogspot.com
tnctrx.com top-karkas.ru
topvidos.ru trackmedia101.com
tvteleport.ru traderzplanet.in
unitygame3d.com trafficfactory.biz
vacances-voyages.info trahvid.com
vektorpress.ru traxdom.ru
vekzdorov.ru tsstcorpcddvdwshbbdriverfb.aircus.com
velpanex.ru tuberkuleznik.ru
video--production.com tula.howotorg.ru
videochat.world umaseh.com
videosbox.ru undergroundcityphoto.com
viel.su unece.org
vikistars.com unpredictable.ga
visa-pasport.ru ussearche.cf
vladimir.zrus.org viberdownload10.com
voltrknc1.com vielporno.net
vvpg.ru villakohlanta.nu
w-journal.ru viven.host.sk
w3javascript.com voluumtracker1.com
watch-movies.ru vroze.com
webcamdevochka.com winterclassichockeyjerseys.com
webs.com wowas31.ucoz.ru
westen-z.life xedserver.com
wovis.site xep.info
writersgroup580.web.fc2.com xmnb.net
www.event-tracking.com xn-----7kcabaipgeakzcss7bjdqdwpfnhv.xn--p1ai
xn-----6kcaabbafhu7cskl7akvongwpo7hvjj.xn--p1ai xn--80aikhbrhr.net
xn--d1abj0abs9d.in.ua xolodremont.ru
xn--q1a.xn--b1aube0e.xn--c1acygb.xn--p1ai yachts-cruise.info
xnxx-n.com yaoguangdj.com
xxxkaz.org youradexchange.com
xxxrus.org youradulthosting.com
xzlive.com youresponsive.com
yatrk.xyz zaimhelp.ru
yugk.net zmoda.hostreo.com
yunque.pluto.ro

307
dev-tools/test_units/ratelimittest-master.txt
View file

@ -8,6 +8,156 @@
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html>ml>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html><html> </html><html>
<head><title>503 Service Temporarily Unavailable</title></head> <head><title>503 Service Temporarily Unavailable</title></head>
<body> <body>
@ -344,153 +494,6 @@
<hr><center>nginx/1.18.0 (Ubuntu)</center> <hr><center>nginx/1.18.0 (Ubuntu)</center>
</body> </body>
</html> </html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<!DOCTYPE html> <!DOCTYPE html>
<html> <html>
<head> <head>
@ -581,14 +584,4 @@
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html> </html>

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.42 0; 10.1.1.18 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.11.3477 ### Version: V4.2022.11.3478
### Updated: Thu Nov 17 22:01:12 UTC 2022 ### Updated: Fri Nov 18 10:03:39 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.11.3477 ### Version: V4.2022.11.3478
### Updated: Thu Nov 17 22:01:12 UTC 2022 ### Updated: Fri Nov 18 10:03:39 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##