vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-05 04:00:13 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2022.08.3309 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2022-08-24 10:09:33 +00:00
parent 77d927d76c
commit d90e35cdc0
47 changed files with 94533 additions and 94540 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.08.3308 #### Version: V4.2022.08.3309
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.08.3308 #### Version: V4.2022.08.3309
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -14,7 +14,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2022.08.3308 #### Version: V4.2022.08.3309
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

11654
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2022.08.3308 #### Version: V4.2022.08.3309
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

11658
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

11658
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

11658
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

11658
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.64 1; 10.1.0.78 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.64 0; 10.1.0.78 0;
127.0.0.1 0; 127.0.0.1 0;

11658
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.64 1; 10.1.0.78 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.64 0; 10.1.0.78 0;
127.0.0.1 0; 127.0.0.1 0;

11658
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.64 1; 10.1.0.78 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.64 0; 10.1.0.78 0;
127.0.0.1 0; 127.0.0.1 0;

11658
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
3308 3309

11658
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

11658
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.110.48.119 0; 13.82.148.2 0;

11658
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.64 1; 10.1.0.78 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.64 0; 10.1.0.78 0;
127.0.0.1 0; 127.0.0.1 0;

11658
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.64 1; 10.1.0.78 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.64 0; 10.1.0.78 0;
127.0.0.1 0; 127.0.0.1 0;

11658
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.64 1; 10.1.0.78 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.64 0; 10.1.0.78 0;
127.0.0.1 0; 127.0.0.1 0;

11658
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.110.48.119 0; 13.82.148.2 0;

11658
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.110.48.119 0; 13.82.148.2 0;

11658
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.64 1; 10.1.0.78 1;
127.0.0.1 1; 127.0.0.1 1;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
Exabot Apexoo
Go-Ahead-Got-It Devil
Lanshanbot Microsoft Data Access
Majestic-SEO Mozlila
Name Intelligence OnCrawl
RankActive OutfoxBot
Recorder Upflow
SemanticJuice WebsiteExtractor
domainsproject.org Whatweb
meanpathbot internetVista monitor

320
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
01h4x.com 360Spider
404checker 404checker
404enemy 404enemy
ALittle Client
Abonti Abonti
Acunetix Acunetix
AfD-Verbotsverfahren
AhrefsBot AhrefsBot
AllSubmitter AiHitBot
Ankit Alligator
Atomseobot Anarchie
Attach Anarchy99
BDFetch Anthill
BLEXBot Apexoo
BackStreet AwarioRssBot
Badass AwarioSmartBot
Bandit BBBike
BackWeb
BacklinkCrawler
BatchFTP
BetaBot BetaBot
Bigfoot Black Hole
BlackWidow
Blackboard Blackboard
Blow BotALot
BlowFish
Brandprotect
Brandwatch Brandwatch
Buck Buck
Bullseye Bullseye
BunnySlippers
BuzzSumo
CATExplorador CATExplorador
CCBot Calculon
CazoodleBot CensysInspect
Cegbfeieh CheTeam
CherryPicker
Chlooe Chlooe
Citoid
Claritybot
Cliqzbot Cliqzbot
Cloud mapping
Cocolyzebot
Collector Collector
Copier CopyRightCheck
Craftbot Copyscape
Crawling at Home Project
CrazyWebCrawler CrazyWebCrawler
CrunchBot
Curious Curious
CyotekWebCopy Custo
DBLBot DIIbot
DataCha0s
Deusu Deusu
Dirbuster
Disco Disco
DomCopBot DomCopBot
DomainCrawler DomainCrawler
DomainSigmaCrawler DomainStatsBot
Domains Project EasyDL
Dotbot
Download Wonder
Dragonfly
EMail Siphon
EMail Wolf
Ecxi Ecxi
EirGrabber
EroCrawler EroCrawler
Evil Evil
Express WebPictures ExtLinksBot
Extractor
Extreme Picture Finder
FDM FDM
FHscan
Fimap
FlashGet FlashGet
Flunky Freeuploader
FrontPage Fyrebot
FyberSpider G-i-g-a-b-o-t
GetRight GT::WWW
Getintent GermCrawler
GoZilla Gigabot
Go-Ahead-Got-It
Grabber
HTMLparser HTMLparser
HTTrack
Harvest Harvest
Havij
Hloader Hloader
HonoluluBot HonoluluBot
IDBot Humanlinks
IRLbot HybridBot
Iblog
Id-search Id-search
Image Fetch Image Fetch
InfoNaviRobot InfoNaviRobot
Internet Ninja InfoTekies
Iskanie Iria
JOC Web Spider JOC Web Spider
JamesBOT
Jbrofuzz
JennyBot JennyBot
Jetty
JikeSpider JikeSpider
Joomla Jorgee
Keybot Translation-Search-Machine Keybot Translation-Search-Machine
LWP::Simple LWP::Simple
Lanshanbot Lanshanbot
Larbin
Leap
LexiBot
Lftp
LibWeb LibWeb
LieBaoFast
Lightspeedsystems
LinkScan
LinkWalker
Linkbot
LinkextractorPro LinkextractorPro
LinkpadBot LinksManager
LinqiaRSSBot Ltx71
LinqiaScrapeBot MFC_Tear_Sample
Litemage_walker
MIDown tool
MIIxpc MIIxpc
MQQBrowser MQQBrowser
MSFrontPage Mag-Net
MSIECrawler Magnet
Mail.RU_Bot
Majestic SEO
Majestic-SEO Majestic-SEO
Majestic12 Majestic12
MarkMonitor
Mass Downloader Mass Downloader
Masscan Masscan
Mb2345Browser Meanpathbot
Mediatoolkitbot
MegaIndex.ru
MicroMessenger
Mister PiX Mister PiX
Moblie Safari Moblie Safari
MolokaiBot MolokaiBot
Mozlila Morfeus Fucking Scanner
Musobot
NICErsPRO
NPbot
Nameprotect Nameprotect
NearSite Navroad
Needle Nessus
Net Vampire NetSpider
NetLyzer NetZIP
Netcraft Netcraft
Nikto Netvibes
NimbleCrawler NextGenSearchBot
Nimbostratus Nibbler
Ninja
Nmap Nmap
Nuclei Not
Nutch Nutch
Octopus
Offline Navigator Offline Navigator
OpenVAS OnCrawl
OrangeBot
OrangeSpider OrangeSpider
PHPCrawl OutclicksBot
Page Analyzer Page Analyzer
PageAnalyzer PageAnalyzer
Papa Foto Pandalytics
Panscient
Pavuk Pavuk
Petalbot PeoplePal
Pi-Monster Piepmatz
Picscout Pimonster
Picsearch PleaseCrawl
PictureFinder Psbot
Pockey Pu_iN
Probethenet Pump
PxBroker
PyCurl
Quick-Crawler
RankActive RankActive
RankFlex RankActiveLinkBot
RankingBot
RankurBot RankurBot
ReGet
RealDownload RealDownload
Reaper
Recorder Recorder
RepoMonkey RocketCrawler
SEOkicks Rogerbot
SBIder
SEOlyticsCrawler SEOlyticsCrawler
SEOprofiler
SMTBot
SalesIntelligent SalesIntelligent
Scanbot ScreenerBot
Screaming ScrepyBot
SeobilityBot Searchestate
Seomoz Seekport
SemanticJuice
Semrush
SemrushBot
Siphon Siphon
Site Sucker Site Sucker
SlySearch SiteCheckerBotCrawler
SocialRankIOBot SiteExplorer
SiteLockSpider
SiteSnagger
SiteSucker
Sitebeam
Snapbot
Sociscraper
Sosospider Sosospider
SpaceBison SpaceBison
Spammen
SpankBot
Spanner
Spbot Spbot
Sqlworm SputnikBot
Stripper Sqworm
Suzuran Sucker
Swiftbot SuperHTTP
Telesoft Surfbot
Telesphorep SurveyBot
TheNomad T0PHackTeam
TeleportPro
Telesphoreo
The Intraformant
Thumbor
TightTwatBot TightTwatBot
Toweyabot Tracemyfile
Turnitin Trendiction
TwengaBot Trendictionbot
URLy Warning True_Robot
Twice
Typhoeus
VB Project VB Project
VCI VCI
VelenPublicWebCrawler VelenPublicWebCrawler
VidibleScraper VeriCiteCrawler
Voil Voltron
WEBDAV WEBDAV
WPScan WISENutbot
WWW-Collector-E WWW-Collector-E
Wallpapers WWW-Mechanize
WWW::Mechanize
Wallpapers/3.0 Wallpapers/3.0
WeSEE WallpapersHD
Web Collage Web Auto
Web Enhancer Web Fetch
Web Pix Web Pix
WebBandit Web Sauger
WebEnhancer Web Sucker
WebFetch
WebFuck
WebGo IS
WebImageCollector WebImageCollector
WebZIP WebPix
WebmasterWorldForumBot WebSauger
Website Quester WebStripper
WebWhacker
WebsiteExtractor
Whacker
Whatweb
Who.is Bot
WinHTTrack
Wonderbot
Wprecon Wprecon
Xaldon WebSpider YoudaoBot
Zauba
Zeus Zeus
Zitebot Zitebot
ZoomBot ZoomBot
ZoominfoBot ZyBorg
archive.org_bot
arquivo-web-crawler
cah.io.community cah.io.community
check1.exe cognitiveseo
com.plumanalytics com.plumanalytics
crawler.feedback
dataforseo.com
eCatch eCatch
evc-batch internetVista monitor
gopher
heritrix
isitwp.com
iubenda-radar iubenda-radar
lwp-request linkdexbot
lwp-trivial mediawords
netEstate NE Crawler probe-image-size
oBot s1z.ru
pcBrowser serpstatbot
polaris version
ripz
seoscanners
seostar
sexsearcher sexsearcher
sitechecker.pro siteripz
spyfu
tAkeOut
trendiction.com
trendiction.de
ubermetrics-technologies.com
voyagerx.com voyagerx.com
webgains-bot webgains-bot
webpros.com
webprosbot webprosbot
x09Mozilla x22Mozilla
xpymep1.exe

326
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
01h4x.com 404enemy
80legs 80legs
ADmantX ADmantX
AIBOT
ALittle Client ALittle Client
ASPSeek ASPSeek
AfD-Verbotsverfahren AhrefsBot
Alligator
AlphaBot
Anarchy Anarchy
Anarchy99 Ankit
Anthill
Apexoo Apexoo
Aspiegel Asterias
Attach Atomseobot
BDCbot BBBike
BackDoorBot BackDoorBot
BacklinkCrawler BackStreet
Battleztar Bazinga Backlink-Ceck
Bigfoot Badass
Bitacle Barkrowler
Black Hole
BlackWidow
Blackboard Blackboard
Boardreader BlowFish
BotALot Bolt
BuiltBotTough Brandwatch
BuzzSumo Buck
Buddy
BuiltWith
CCBot
CSHttp CSHttp
Calculon CazoodleBot
CensysInspect CensysInspect
CheTeam ChinaClaw
Chlooe Cliqzbot
Cogentbot Cogentbot
Copyscape Collector
Cosmos Craftbot
Crescent Crawling at Home Project
CyotekWebCopy CrunchBot
DTS Agent Curious
Demon DataCha0s
Deusu
Digincore
DigitalPebble DigitalPebble
Disco Dispatch
DittoSpyder DnyzBot
DomCopBot DomCopBot
DomainSigmaCrawler Download Wonder
ECCP/1.0 Dragonfly
EMail Siphon
EMail Wolf EMail Wolf
Ebingbong EasyDL
Ecxi Evil
EirGrabber Express WebPictures
EroCrawler ExtLinksBot
Exabot Extractor
ExtractorPro
Extreme Picture Finder Extreme Picture Finder
Ezooms EyeNetIE
FDM FDM
Firefox/7.0 FHscan
FlashGet
Foobot Foobot
Fuzz Fuzz
Fyrebot FyberSpider
Genieo G-i-g-a-b-o-t
GetWeb
Getintent Getintent
Gigabot
Go!Zilla
Go-Ahead-Got-It Go-Ahead-Got-It
GrapeshotCrawler GoZilla
HTMLparser Gotit
HTTP::Lite Grafula
HEADMasterSEO
HTTrack HTTrack
Haansoft Harvest
HaosouSpider Heritrix
Havij HonoluluBot
Humanlinks
IDBot IDBot
Iblog Iblog
Id-search Id-search
IlseBot IlseBot
Image Fetch Image Fetch
Indy Library Intelliseek
InfoTekies InterGET
Internet Ninja InternetSeer
IstellaBot IstellaBot
JOC Web Spider JOC Web Spider
JikeSpider JennyBot
Joomla Jyxobot
JustView
Kenjin Spider Kenjin Spider
Keybot Translation-Search-Machine
Keyword Density Keyword Density
Kinza Kozmosbot
LNSpiderguy
LWP::Simple
Lanshanbot Lanshanbot
LeechFTP Lftp
LeechGet LieBaoFast
LexiBot
LibWeb
LinkScan LinkScan
LinkextractorPro LinkWalker
LinqiaRSSBot Linkbot
Lipperhey LinqiaMetadataDownloaderBot
Litemage_walker Lipperhey Spider
MIIxpc Lmspider
MJ12bot
MTRobot MTRobot
Mag-Net
Mail.RU_Bot
Majestic SEO Majestic SEO
Majestic-SEO Majestic-SEO
MarkMonitor
MarkWatch
Masscan Masscan
Mata Hari MauiBot
Meanpathbot Mb2345Browser
Metauri
MicroMessenger MicroMessenger
Microsoft Data Access Microsoft URL Control
Minefield
Moblie Safari Moblie Safari
MolokaiBot Mojeek
Mojolicious
Morfeus Fucking Scanner Morfeus Fucking Scanner
Musobot Mr.4x3
NICErsPRO Name Intelligence
Nameprotect
Navroad
NearSite
NetLyzer NetLyzer
NetMechanic NetMechanic
NetSpider
NetZIP NetZIP
Nettrack Netcraft
NextGenSearchBot Nikto
NimbleCrawler NimbleCrawler
Not Nuclei
Nutch
Octopus Octopus
Offline Explorer Offline Explorer
OpenLinkProfiler Openfind
Openvas OrangeBot
OrangeSpider PECL::HTTP
OutfoxBot
PHPCrawl
POE-Component-Client-HTTP
Page Analyzer
Page Analyzer Page Analyzer
PageThing.com PageThing.com
Pandalytics Pandalytics
Panscient Pavuk
PeoplePal
Pi-Monster Pi-Monster
Picscout Picsearch
PictureFinder Pimonster
Pixray Pockey
ProPowerBot ProPowerBot
Pump ProWebWalker
RankActiveLinkBot QueryN Metasearch
RankFlex Quick-Crawler
RankingBot2
RankurBot RankurBot
Re-re Re-re
ReGet Reaper
RealDownload
RebelMouse RebelMouse
Recorder SEOkicks
RepoMonkey SEOkicks-Robot
SBIder
SEOlyticsCrawler
SEOprofiler
SISTRIX
SMTBot SMTBot
Screaming
ScreenerBot
ScrepyBot
SearchmetricsBot
SemanticJuice SemanticJuice
Semrush
SemrushBot SemrushBot
Seomoz SentiBot
SiteLockSpider SeobilityBot
Sitebeam Site Sucker
SiteSucker
Siteimprove Siteimprove
Sitevigil Sitevigil
SlySearch
SmartDownload SmartDownload
Snapbot Snake
Snoopy SocialRankIOBot
Sottopop Sogou web spider
SpaceBison Sosospider
SpankBot SpankBot
Spanner SputnikBot
Spbot Sqlworm
Sqlmap Stripper
Sqworm Sucker
Steeler
Sucuri Sucuri
Surfbot SurveyBot
T8Abot Suzuran
TeleportPro Swiftbot
Teleport
Telesphorep Telesphorep
Thumbor
Titan Titan
Toata
Toweyabot Toweyabot
Tracemyfile
Trendiction Trendiction
True_Robot
Typhoeus
URLy Warning
Upflow
V-BOT
VB Project VB Project
Vagabondo VCI
Voil Voil
WPScan Voltron
Wallpapers WEBDAV
WWW-Collector-E
WWW-Mechanize
WWW::Mechanize
WWWOFFLE
WallpapersHD WallpapersHD
WeSEE WebBandit
Web Auto WebEnhancer
WebFetch
WebFuck WebFuck
Web Sucker WebLeacher
WebCollage
WebCopier
WebReaper
WebSauger WebSauger
WebStripper
WebSucker
WebWhacker WebWhacker
WebZIP
Webalta
WebmasterWorldForumBot WebmasterWorldForumBot
Webshag
Website Quester Website Quester
WebsiteExtractor WebsiteExtractor
Webster Whack
Whatweb Whatweb
Widow
WinHTTrack WinHTTrack
WiseGuys Robot
Wotbox Wotbox
Xaldon WebSpider Xaldon_WebSpider
YoudaoBot YoudaoBot
Zade
Zauba
Zermelo Zermelo
Zitebot
adscanner
autoemailspider
backlink-check backlink-check
cah.io.community cognitiveseo
check1.exe
clark-crawler
crawler4j crawler4j
demandbase-bot
domainsproject.org
gopher gopher
ips-agent instabid
isitwp.com internetVista monitor
iubenda-radar lwp-trivial
lwp-request meanpathbot
mediawords oBot
muhstik-scan
netEstate NE Crawler
page scorer page scorer
pcBrowser plumanalytics
polaris version probe-image-size
ripz s1z.ru
scalaj-http
scan.lol
seocompany.store seocompany.store
seoscanners
serpstatbot
sexsearcher
siteripz siteripz
sogouspider sogouspider
tAkeOut spyfu
trendiction.com sysscan
trendiction.de
ubermetrics-technologies.com ubermetrics-technologies.com
voyagerx.com x09Mozilla
webpros.com zauba.io
webprosbot
x22Mozilla
xpymep1.exe
zgrab

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
bnt-team.com artdeko.info
creditwell.ru autotop.com.ua
ege-essay.ru calc-for-credit.ru
freewebs.com christianlouboutinsaleoutletonline.us
leftofcentrist.com footbalive.org
razyboard.com sprttrack.com
slutloadlive.com tvand.ru
sundrugstore.com wovis.site
valmetrundan.se zeleznobeton.ru
xn-----7kceclhb4abre1b4a0ccl2fxch1a.xn--p1ai zolotoy-lis.ru

918
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
00it.com 0n-line.tv
01apple.com 123cha.com
0c47f8422d3f.com 14b.info
1webmaster.ml 1kinobig.ru
214jaluwobapef.cf 2345.com
2daytrendingnews.com 4istoshop.com
3dracergames.com 4kepics.com
3weekdiet.com 4kpics.rocks
45en.ru 51.la
4inn.ru 76brighton.co.uk
4rent.ru 7makemoneyonline.com
777-club.ru abcdeg.xyz
7wind.ru absugars.com
abctoppictures.net abtasty.com
abiente.ru acortarurl.es
above.com ad-words.ru
academiacsmendoza.org adconscious.com
acc.eu.org addray.pro
agadelha.com.br adman.gr
akama.com adserver-e7.com
alert-fdm.xyz adtology.com
alert-jdh.xyz adultnet.in
alevinefesleri.com adultwebhosting.info
advokateg.xyz
aerogo.com
agardomains.com
ageofclones.com
agreda.pluto.ro
ahhjf.com
aksonural.ru
alborzan.com
albumsuper.info
alf-img.com alf-img.com
alive-ua.com alice.it
all-number.com all4invest.ru
allfinweb.com allblogroll.com
allpdfmags.net alldownload.pw
aloofly.com allwidewallpapers.com
altamayoztourism.com amateurlivechat.org
anapa-inns.ru ameblo.top
apartmentratings.com amyfoxfitness.com
appearance-cool.com aosexkontakte.net
apccargo.com
apple.com-cleaner.systems apple.com-cleaner.systems
approved.su arcteryxstore.online
appsecurityr.com astana.xxxkaz.org
aquarium-pro.ru availit.weebly.com
arabgirls.adultgalls.com azartmsl.com
asociatia-tipografilor-transilvania.ro azbukadiets.ru
asseenontvonline.ru
autochoixspinelli.com
autonew.biz
autotrends.today
autovideobroadcast.com
aviav.co
avkzarabotok.info
avon-ukraine.com
azinoofficial777.ru
backiee.com backiee.com
bagcionderlab.com backlinkwatch.com
bala.getenjoyment.net baksman.com
baladur.ru bambi.ck.ua
bank.uz bankcrediti.ru
barnfurnituremart.com bannerconnect.net
battle.net bbsoldes.fr
battleforupdating.site bedandbreakfast.com
beauty-things.com beget.tech
beetpics.pw
berdasovivan.ru
berlininsl.com
bestadbid.com
bestcurs.org
bidbuy.co.kr bidbuy.co.kr
bif-ru.info binomo.kz
biocn.dx.am biocn.dx.am
bird1.ru
birzha-truda.eu
bizfly.info
bkns.vn bkns.vn
blackplanet.com blackcurranthumidifiers.site
blavia.00author.com boazpower.com
blockety.co boeuklad.com
blockworld.ru bolegapakistan.com
blog.axant.it
blog.f00kclan.de
blog.yam.com
bloggen.be
bluerobot.info
bmsco.co
boleznikogi.com
bonvillan.com bonvillan.com
bonzbuddy.com boole.onlinewebshop.net
bouda.kvalitne.cz bosman.pluto.ro
buntube.net brianhenry.co
buqyxa.rincian.info bristolhotel.com.ua
buy-forum.ru bronzeaid-a.akamaihd.net
buzzurl.jp burger-tycoon.com
bvlgariwallet.xyz bus-offer.com
canacopegdl.com buyclomidonlaine.com
candy-glam-hp.com buyessay3.blogspot.ru
cartierring.xyz cablecar.us
cbozhe.com calc-for-credit.ru
centre-indigo.org.ua candytiner.com
certifywebsite.win cardiosport.com.ua
cheapsergiorossi.online cardsdumps.com
carstrends2015.com
cartiertrinity.xyz
casablancamanor.co.za
ccjp.eu
cfacarrosserie74.com
chatroulette.life
chatroulette.world
cheap-pills-norx.com
cheapjerseysa.com
checkpagerank.net checkpagerank.net
chelyabinsk.xrus.org chocolateslim-en-espana.com
cialiswithoutadoctor.net chocolateslim-original.com
clean-virus-mac.com cialisovercounteratwalmartusa.com
cleanallvirus.com cibpenonptib.flu.cc
clickbanksites.info cl.s7.exct.net
clubfashionista.com click2pawn.com
coaching-netz.info clksite.com
colobit.biz club-musics.ru
com-cleaner.systems coinsspb.com
cometorussia.net commoncrawl.org
compliance-alexa.top communisave.co.za
compliance-andrew.xyz compliance-fred.top
compliance-george.xyz compliance-george.xyz
computernetworksonline.com compliance-john.top
coolwallpapers-hd.com compliance-walter.top
coprofam.org constantaservice.net
cosmeticswomens-womensports.rhcloud.com cookie-law-enforcement-ff.xyz
crafthubs.com cougfan.info
credit.co.ua counterbot.com
creditnation.ru courtshipgift.com
cubook.supernew.org
cubs-jerseys.us
culad.com culad.com
cypernhuset.se
czeshop.info czeshop.info
dafatiri.com d2jsp.org
daisye.top daretodonate.co
darkages.info darkages.info
dawlenie.com darmebel.com.ua
decoratinghomes.ga davebestdeals.com
deluxedumps.com dealighted.com
dev33.dioniqlabb.se destinationrealestate.com
dgfitness.co diamond-necklace.info
divisioncore.com diesel-parts28.ru
dlya-android.org diy-handmade-ideas.com
dodlive.mil dogbreedspicture.net
doska-vsem.ru domaincdn.xyz
draniki.org dominateforex.ml
easyukraine.com domznaniy.ru
ee77ee.com dood.live
ege-essay.ru drpornogratisx.xxx
elektir.ru drunkmoms.net
elektrischezigaretten1.blogse.nl e-c.al
elektronischezigarette2.mex.tl ecxtracking.com
elektronischezigarettekaufen1.myblog.de egovaleo.it
energydiet24.ru ekobata.ru
engines-usa.com eldiariodeguadalajara.com
essaypro.com elexies.info
estelight.ru elitedollars.com
eloconcream.blogspot.com
eropho.net
escortslet.net
eurosamodelki.ru eurosamodelki.ru
evaashop.ru evogarage.com
exct.net expdom.com
extstat.com eyelike.com.ua
ezigarettenshop2.myblog.de eyes-on-you.ga
ezrvrentals.com eyessurgery.ru
f-loaded.de ezigarettekaufen1.hpage.com
f07.de ezigarettenkaufen2.dreamwidth.org
facecup.top ezofest.sk
facialporntube.com fandlr.com
fashionavenuegame.com fanoboi.com
fast-torrent.ru fastcrawl.com
feargames.ru fbdownloader.com
fellowshipoftheminds.com fealq.com
femdom.twiclub.in
feorina.ru feorina.ru
filerockstar298.weebly.com filkhbr.com
filesdatabase.net findclan.org
filmfanatic.com findthe.pet
filmgo.ru fishtauto.ru
filunika.com.ru fitfloponline.store
foodcrafts.website fiuxy.com
forums.toucharcade.com fix-website-errors.com
free-share-buttons.com flashlarevista.com
free-today.com flirt4free.com
freelifetimefuckbook.com floating-share-buttons.com
freza-sverlo.ru forex-procto.ru
fuel-gas.com fortunejack.com
futbolkisales.ru foto-telok.net
galaxyflowers.ru freakycheats.com
galaxys6manual.info gallery.rennlist.com
gamerextra.com gallictures.com
genericlowlatencyasiodriverhq.aircus.com gameplexcity.com
girlgamerdaily.com gay.adultgalls.com
girlspicsa.com gazporno.com
go2jump.org ge0ip.com
golden-praga.ru getresponse.com
googlefeud.com gilbertbanda.net
googlepositions.com gomusix.com
gorodservis.ru goodly.pro
goodprotein.ru
googlemare.com
goosefishpost.bid
gourcy.altervista.org gourcy.altervista.org
gpms.org.my graphicwe.org
greatfind-a.akamaihd.net gribkovye-zabolevaniya.com
greatzip.com grizzlysgrill.com
growboxbl.ru gsasearchengineranker.site
gungamesz.com gsasearchengineranker.xyz
hdpixion.com gta-top.ru
hdwallpapers-free.com guge.io
hermesreplica.pw hamptonoaks.ca
hothor.se happy.new.yeartwit.com
hoverboard360.de heliko.no
i-service.kz hesteel.pl
images.gyffu.com hitcpm.com
imgarit.pw homedecorpicture.us
indo-export.ru hotelcrocenzi.sm
infoupdate.org howmuchdoestizanidinecost.blogspot.com
insta-add.pro hully.altervista.org
invitefashion.com hut1.ru
islandminingsupply.wordpress.com hyhj.info
ispac.org iblogpress.xyz
itservicesthatworkforyou.com imediadesk.com
iweblist.info in-tandem.co
jasonpartington.com inet-traffic.com
innodgfdriverhm.aircus.com
int.search.mywebsearch.com
investmac.com
istizanidinelikexanax.blogspot.com
javidol.site javidol.site
javspace.net jimmychoosale.online
jaxcube.info jose.mulinohouse.co
jmat.cn justprofit.xyz
johnrobertsoninc.com kamen-e.ru
joyceblog.top karting196.ru
juliadiets.com kfon.eu
kamagragelusa.net kinoflux.net
karaganda.xkaz.org kiwe-analytics.com
kazan.xrus.org kladrus.ru
kazka.ru knigonosha.net
keywordbasket.com kollesa.ru
kino-rating.ru kosmetyki.tm.pl
kinofak.net krasnodar.xrus.org
kinogolos.ru ktotut.net
kinostorm.net
kirov.zrus.org
kliksaya.com
koptims.tiu.ru
kozhniebolezni.com
krasnodar.ru
kurwa.win
kuzinsp.ru
kw21.org
labafydjxa.su
labelwater.se
lampokrat.ws lampokrat.ws
lashstudia.ru lankarns.com
law-check-seven.xyz lechtaczka.net
le-clos-des-alouettes.com ledpolice.ru
letmacwork.world letmacwork.world
letsart.ru letslowbefast.site
letslowbefast.today likrot.com
lezbiyanki.net liquimondo.com
lignofix.ua littlesexdolls.com
lincolntheatre.com
linkbuddies.com
littlesunraiser.com littlesunraiser.com
liverpool.gsofootball.com liumimgx.pw
livetsomudvekslingstudent.bloggersdelight.dk livingroomdecor.info
localflirtbuddies.com lkbennettoutlet.online
lombardfinder.ru locatellicorretor.com.br
longgreen.info lombia.com
lonfon.xyz
longlifelomilomi.info longlifelomilomi.info
lotto6888.com lordzfilmz.me
louisvuittonoutletstore.net lsex.xyz
lovi-moment.com.ua lulea-auktionsverk.se
luxmagazine.cf
m5home.ru m5home.ru
macresource.co.uk mac-shield.com
makenahartlin.com mafa-free.com
managerpak204.weebly.com mainlinehobby.net
marcogrup.com
markjaybeefractal.com markjaybeefractal.com
marmotstore.online master-muznachas.ru
mazda-roadsters.com mastershef.club
mearns-tractors.co.uk matpre.top
mcnamaratech.com
mebel-vstroika.ru
mebelcomplekt.ru mebelcomplekt.ru
meetlocalchicks.com medicovi.com
megaindex.ru meendo-free-traffic.ga
microsoftportal.net metabar.ru
mindeyegames.com methodsmarketing.com
minegam.com mini.7zap.com
misterjtbarbers.com mir-limuzinov.ru
mncrftpcs.com missvietnam.org
mobilemedia.md mmostrike.ru
monarchfind-a.akamaihd.net mobicover.com.ua
monclercoats.xyz mockupui.com
monclerjacketsoutlet.win monclercheap.xyz
monclervests.xyz
moneyzzz.ru
monitorwebsitespeed.com monitorwebsitespeed.com
montazhnic.ru
moonci.ru
moroccosurfadventures.com moroccosurfadventures.com
motherboard.vice.com mototsikl.org
mouselink.co musicpro.monster
mrinsidesales.com muzaporn.com
msfsaar.de mwtpludn.review
msk.afora.ru myftpupload.com
multgo.ru myxdate.info
musicktab.com nagdak.ru
mustat.com net-radar.com
muz-shoes.ru networkcheck.xyz
mybackgroundlandscape.blogspot.com newstaffadsshop.club
mycaf.it niroo.info
mycouponizemac.com njpalletremoval.com
mydeathspace.com nl.netlog.com
mydoctorok.ru nosecret.com.ua
mygameplus.ru notfastfood.ru
myphotopipe.com
nac-bearings.ru
naturalbreakthroughsresearch.com
nextrent-crimea.ru
nibbler.silktide.com
nicefloor.co.uk
nonameread45.live
nordvpn.com
noscrapleftbehind.co
november-lax.com
novgorod.xrus.org
npoet.ru npoet.ru
nucia.biz.ly
nudo.ca nudo.ca
oecnhs.info o-o-6-o-o.com
ok.ru obnal.org
okout.ru ochistka-stokov.ru
omsk.xrus.org okeinfo.online
ooomeru.ru omgtnc.com
openfrost.net onefilms.net
openlibrary.org onlinebay.ru
openstat.com onlinemegax.com
ozas.net onstrapon.purplesphere.in
paccohichetoti.ml openmultipleurl.com
paclitor.com optitrade24.com
page2rss.com owathemes.com
palvira.com.ua palvira.com.ua
partnerline.men paphoselectricianandplumber.com
pawli.eu par-fallen.ga
pcimforum.com penisvergrotendepillennl.ovh
pdn-4.com pic2fly.com
perederni.net piccdata.com
phobia.us piluli.info
photo.houseofgaga.ru pinapchik.com
pic-re.blogspot.com pinwallpaper.top
picswe.com
pintattoos.com
pixshark.com pixshark.com
pl.aasoldes.fr pk-pomosch.ru
playboyfiles.xblog.in ploenjitmedia.azurewebsites.net
playlott.com
pliks.pl
plusnetwork.com plusnetwork.com
podshipniki-nsk.ru podshipniki-ntn.ru
pogodnyyeavarii.gq poisk-zakona.ru
pogosh.com pojdelo.weebly.com
popup-fdm.xyz poptool.net
popup-jdh.xyz pornhubforum.tk
porno-chaman.info porno-play.net
porno-dojki.net porno-transsexuals.ru
pornokajf.com pornosmola.info
pornowarp.info pornoted.com
pornzone.tv pourvous.info
poshiv-chehol.ru praisong.net
predmety.in.ua preg.marketingvici.com
primedice.com printdirectforless.com
prize44.com prizefestival.mobi
produkto.net prlog.ru
promoheads.com productarium.com
prostitutki-novgoroda.org proekt-gaz.ru
pshare.biz professionaldieselcare.com
puteshestvennik.com promoforum.ru
putitin.me proprostatit.com
prostitutki-belgoroda.org
pst2017.onlinewebshop.net
ptr.ruvds.com
purplesphere.in
py100.ru
pyrodesigns.com.au
quickloanbank.com
qwesa.ru
radiogambling.com
ragecash.com ragecash.com
rainbowice.ru razyboard.com
raisedseo.com rebuildermedical.com
rankexperience.com recipedays.com
rcb101.ru
rcpmda.ikan1080.xyz
redirect.trafficreceiver.club
redirectingat.com redirectingat.com
registry-clean-up.net reklamuss.ru
registrysweeper.com
reklama-i-rabota.ru
relatodelpresente.com.ar
remmling.de remmling.de
remont-komputerov-notebook.ru remont-mobile-phones.ru
resant.ru renecaovilla.online
reversing.cc rentalcarnavi.info
reward-survey.net responsinator.com
reyel1985.webnode.fr restaurantlescampi.com
rezeptiblud.ru resultshub-a.akamaihd.net
ribieiendom.no ricorsogiustizia.org
richinvestmonitor.com riders.ro
rightenergysolutions.com.au rightenergysolutions.com.au
running-line.ru ringporno.com
rusoft-zone.ru rock-cafe.info
rubanners.com
runofilms.ru
russia-tao.ru
saecsa.co saecsa.co
saltspray.ru
sammlungfotos.online sammlungfotos.online
sashagreyblog.ga sc-specialhost.com
scalerite.co.za scalerite.co.za
scanhub.ru scanner-ivan.top
scanner-elena.top scansafe.net
scanner-olga.top scripted.com
scenarii-1-sentyabrya.uroki.org.ua sdi-pme.com
screentoolkit.com sdrescher.net
seeingmeerkat.com search.alot.com
seemoreresultshu-a.akamaihd.net search.xtconnect.com
seeresultshub-a.akamaihd.net searchimage.co
selectads.men semxiu.com
seo-prof1.xyz seo-platform.com
sexkvartal.com seobility.net
sexs-foto.top seoholding.com
sherlock.se seoprofiler.com
shillyourcoins.com sevendays.com.ua
shitmovs.com sexfreepornoxxx.com
shopcheermakeup.info sexkontakteao.info
shopfishing.com.ua sexpartygirls.net
signoredom.com sexs-foto.com
silvermature.net sexsearch.com
sledstvie-veli.net shitting.pro
slonechka.ru simply.net
smartshoppymac.com sims-sims.ru
social-search.me simul.co
solitaire-game.ru sky-mine.ru
sonnikforme.ru slim.sellany.ru
sophang8.com slimcdn.com
sports-supplements.us social-vestnik.ru
sribno.net socialsignals24.com
startwp.org sockshares.tv
strana-solnca.ru soietvousmaime.fr
stroy-portal22.ru solnplast.ru
strv.se soviet-portal.do.am
spinnerco.ca
sportbetfair.com
start.myplaycity.com
storehouse.ua
streetfire.net
strfls.com
stroimajor.ru
sugvant.ru
summerlinhomes411.info
suralink.com suralink.com
surfbuyermac.com svarbit.com
swinger-mobil.net szucs.ru
swsociety.se talant-factory.ru
tackletarts.co tech4master.com
tedxrj.com telsis.com
thaisamkok.com thecoolimages.net
thefds.net thewomenlife.com
theplacetoupdating.pw time-japan.ru
theporndude.com tizanidine4mgprice.blogspot.com
thesmartsearch.net tizanidine4mgstreetvalue.blogspot.com
tiens2010.ru tizanidinedrugtest.blogspot.com
tizanidinehydrochloride4mgstreetvalue.blogspot.com tizanidineformigraines.blogspot.com
tizanidinezanaflex.blogspot.com tizanidinehcl4mgtablet.blogspot.com
tobeyouday.win tizanidineingredients.blogspot.com
tootoo.to tizanidineoral.blogspot.com
topcasinoratings.ru tizanidinepills.blogspot.com
topclickguru.com tizanidinevssoma.blogspot.com
topsiteminecraft.com tmearegion26.com
torrents.cd top1-seo-service.com
trafficmania.com topkarkas.com
tri-slona.org torrnada.ru
trkdf.com track2.shop
trustaffs.com traderzplanet.in
try-rx.com trafficjunky.com
tuckermktg.com trafficmp.com
tvand.ru traffique.net
tvory.predmety.in.ua trahic.ru
twiclub.in tuberkulezanet.ru
txxx.com tula.mdverey.ru
udayavani.com turbo-suslik.org
ukr-lit.com turkeyreport.tk
ukrtvir.com.ua uhod-za-sobakoj.ru
unmaroll.ya.ru umg-stroy.ru
upproar.com unblocksit.es
uptime-alpha.net unisexjewelry.org
uptime.com unrealcommander.biz
usswrite.com uprour.com
urldelivery.com
urll.eu
uzporno.mobi
vacuumcleanerguru.com vacuumcleanerguru.com
valmetrundan.se validccseller.com
veles.shop valoresito.com
vellings.info vapomnoncri.tk
versaut.xxx-cam.webcam versaut.xxx-cam.webcam
veselokloun.ru via-energy-cumpara.com
vids18.site viagraneggrx.com
vinylvault.co.uk videojam.tv
vita.com.hr videonsk.com
vk-mus.ru virtuagirl.com
vladimir.xrus.org visionwell.com.cn
wait3sec.org viteonlusarezzo.it
wardreapptokone.tk vltai.com
vod.com.ua
voluumtrk.com
vtcdns.com
web-betting.ru web-betting.ru
website-speed-checker.site webcamdevochka.com
website-speed-up.site webix.biz
whosonmyserver.com webmasterhome.cn
wineitudes.wordpress.com webradiology.ru
witherrom55.eklablog.fr webshoppermac.com
wleuaprpxuvr.ga website-speed-check.site
woman-tampon.ru weburok.com
worldtraveler.world wemedinc.com
woweb.com.ua whipme.yopoint.in
wrz0iuebwhp5fg.freeddns.com woodyguthrie.se
ws.ampower.me wordkeyhelper.com
www.888.com wowcasinoonline.ooo
xbaboon.com writersgroup580.web.fc2.com
xerox-douglas.cf www.get-free-traffic-now.com
xn----itbeirbjbi7bc6bh2d.xn--p1ai www.jbetting.com
xn--80adaggc5bdhlfamsfdij4p7b.xn--p1ai x69ty.ru
xn--c1acygb.xn--p1ai xchangetrak.com
xn--oogle-wmc.com xedserver.com
yhit.press xgftnlrt.bloger.index.hr
yopoint.in xn-----7kceclhb4abre1b4a0ccl2fxch1a.xn--p1ai
yottos.com xn--80aafb2a.xn--p1ai
youresponsive.com yellowfootprints.com
zazagames.org yourserverisdown.com
zebradudka.com ytmnd.com
zeroredirect9.com zajm-pod-zalog-nedvizhimosti.ru
zetmaster.ru zambini.ru
zone-kev717.info zapiszto.pl
zoolubimets.ru zawyna.ua
zootravel.com zeroredirect6.com
zrus.org zionstar.net
zygophyceous.womanstars.site zlatnajesen.com
zoomovies.org

486
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
1001watch.com.ua 000free.us
2itech.ru 101flag.ru
6hopping.com 2728fb936f0.com
activecampaign.dreamhosters.com 2drittel.de
addblueoff.com.ua 2x2fan.ru
ads.gold 3rbseyes.com
afslankpillen2017nl.eu 404.mn
45en.ru
9med.net
aaronabel.com
abovetherivernc.com
acunetix-referrer.com
ad-words.ru
adult-shop.com.ua
advertisingtag.net
agysya.ru
ahhjf.com
aktivator-windows10.blogspot.com
all4invest.info
allbizne.co.ua
allboard.xobor.de
aloofly.com aloofly.com
alphacarolinas.com
alveris.ru alveris.ru
anmysite.com apiadanaknet-a.akamaihd.net
approved.su bamo.xsl.pt
aproposde.com bang-hotties.com
asrv-a.akamaihd.net bannerspace.com
aucoinhomes.com big-cash.net
avek.ru bin-brokers.com
ayeartoforget.com blackwitchcraft.ru
backlinkwatch.com blockety.co
bagsonsale.online blogig.org
benchmarkcommunications.co.uk bluesalt.co
best-businessman.ru bonanza-fortune.men
best-way.men bookmark4you.com
bestpornuha.com brainboosting.club
betonka.pro btnativenav.com
bjorkbacken.nu bvlgariring.xyz
blpmovies.com callawaygolfstore.online
boc.kz cartierlove2u.xyz
boo-arts.com cdn.walkme.com
burger-imperia.com centrumcoachingu.com
burkesales.com cheap-trusted-backlinks.com
buyviagraa.blogspot.com cinemaflix.website
camdolls.com cmhomestayagency.com
candcstuccoandstone.com cognitiveseo.com
candiceloves.us collegerentals.com
ccbill.com com-cleaner.systems
cfsrating.sonicwall.com com-onlinesupport.site
cheapestjerseys-wholesale.com com-secure.download
check-host.net compliance-brian.top
chimiver.info compliance-ivan.xyz
chocoslim.pro cornerstone-countertops.com
cienum.fr courtshipgift.com
cleanersoft.com cscwtalkto.site
coindirect.io danashop.ru
colehaanoutlet.store dangphoto.trade
compliance-jane.top davebestdeals.com
consorzioilmosaico.org dawlenie.com
customchocolate.business-for-home.com daymusam.com
customerpromos-a.akamaihd.net depositfiles-porn.ga
cymbaltaandtizanidine.blogspot.com digitalfaq.com
cyse.tk dipstar.org
dailyrank.net dms-sw.ru
detskie-zabavi.ru domain2008.com
directrev.com domaincheck.io
doctissimo.fr
dojki-hd.com
dokfilms.net
donna7753191.ru
dosugrostov.site dosugrostov.site
downloadmefiranaratb1972.xpg.com.br downvids.net
ekto.ee earl-brown.info
electricwheelchairsarea.com ec-file.info
elektrozigarette1.dreamwidth.org ednorxmed.com
elektrozigaretten2.yn.lt electro-prom.com
elexies.info elidelcream.weebly.com
enbersoft.com elitepcgames.com
enews.tech empirepoker.com
eupornstar.info eywords-monitoring-your-success.com
euronis-free.com f012.de
evehemming.blogspot.com.au fanrto.com
excitacion.info fapgon.com
eyelike.com.ua fearcrow.com
ezaz.info feel-planet.com
fix-website-errors.com femmesdenudees.com
flauntyoursite.com filerockstar298.weebly.com
free-deals.faith filmbokep69.com
fugarif.ga filunika.com.ru
fungamelands.com findanysex.com
fungirlsgames.net findclan.org
gamedayhouse.com flipper.top
gentamicineyedrops.blogspot.com forum20.smailik.org
get-free-traffic-now.com foto-sisek.porngalleries.top
globetrotting-culture.ru foxydeal.com
glopages.ru fsakhalin.ru
go2album.com g33.org
goodnightjournal.com gabeshop.ru
gettpromos.com
gg.zzyjxs.com
girlporn.ru
girlspicsa.com
goldenggames.com
good-mummy.ru
goodwinmetals.co goodwinmetals.co
graphics8.info googlsucks.com
greenidesign.co gratuitbaise.com
gsasearchenginerankerhelp.com growboxbl.ru
hacktougroup.ru growshop.es
hd-film.pl handicapvantoday.com
himazin.info hatedriveapart.com
hol.es hdwallpapers-free.com
holidaypics.org heartofbeijing.blogspot.com
horoshieokna.com hmmm.cz
hscsscotland.com hoholikik.club
import-sales.com hostingclub.lk
inmate-locator.us hotxnights.info
interferencer.ru hoverboard360.se
investyb.com id-forex.com
ispac.org imagerydatabase.com
javlibrary.cc imagez.co
jetsli.de imicrovision.com
joessmogtestonly.com impotentik.com
journalhome.com infowarcraft.ru
karusel-market.ru innoslicon.com
ketoanhanoi.info inome.com.ua
keywordsuggest.org invivo.hu
kinohall.ru ip-guide.com
kit-opt.ru iplogger.org
klejonka.info istock-mebel.ru
kletkimehan.ru j33x.com
kollesa.ru jav-idol.com
komputers-best.ru javrip.net
konkursov.net jennyfire.ru
kovesszucs.atw.hu jerseyschinabizwholesale.us
kriokomora.info johnrobertsoninc.com
kustanay.kz keywordhouse.com
lacave.ntic.fr kidskunst.info
legionalpha.com kino-rating.ru
lennatin.info kinocccp.net
lifeinsurancekb.com kiwi237au.tk
lunchrock.co layola.biz.tc
maglid.ru legalrc.biz
massage-info.nl letsrepair.in
mediawhirl.net li-er.ru
medicinacom.ru likesdesign.com
mesbuta.info lincolntheatre.com
metaxalonevstizanidine.blogspot.com louboutinbooties.xyz
missvietnam.org louboutinreplica.pw
mnogabukaff.net lsp-awak-perikanan.com
morpicert.pw luckyshop.net.ua
most.gov.iq m4ever.net
mrmoneymustache.com malwareremovalcenter.com
mulberryoutletonlineeu.com maridan.com.ua
musicdaddy.net michellblog.online
musicktab.com mixtapetorrent.com
musicpro.monster mnimmigrantrights.net
muztops.ru mobilemedia.md
mydoctorok.ru morf.snn.gr
mydownlodablefiles.com morocco-nomad-excursions.com
mysex21.com mountainstream.ms
na15.ru moviezbonkerssk.cf
nastroyke.net
natali-forex.com
networkad.net networkad.net
newsperuse.com newfilmsonline.ru
nhl17coinsforps3.gratisblog.biz omsk.xrus.org
notebook-pro.ru onescreen.cc
noumeda.com onlinemegax.com
november-lax.com orenburg-gsm.ru
okmusic.jp osnova3.ru
oneminutesite.it patol01.pw
online-x.ru paydayloanslocal.com
online7777.com photorepair.ru
ooo-gotovie.ru photostudiolightings.com
parlament.biz piratecams.com
perfectplanned.com powc.r.ca.d.sendibm2.com
piulatte.cz prizefestival.mobi
playtap.us pronorm.fr
pobeiranie.pl pts163.ru
poiskzakona.ru quangcaons.com
popup-hgd.xyz redhotfreebies.co.uk
pornodojd.ru reklamuss.ru
pornofiljmi.com relatodelpresente.com.ar
pospr.waw.pl remontgruzovik.ru
prostitutki-rostova.org research.ifmo.ru
pst2017.onlinewebshop.net respublica-otel.ru
puserving.com rozalli.com
rainbowice.ru roznica.com.ua
remontvsamare.su ruscopybook.com
remybutler.fr rustic-quiver.win
repeatlogo.co.uk sammlungfotos.online
reversing.cc sanatorrii.ru
ringporno.com
rockprogblog.com
sabaapress.com
savingsslider-a.akamaihd.net
scanner-ivan.top scanner-ivan.top
scanner-margo.top scanner-viktor.top
sexad.net search.1and1.com
sexy-screen-savers.com searchlock.com
shemale-sex.net seksvideoonlain.com
shlyahten.ru seorankinglinks.us
si-unique.com sergiorossistore.online
sientalyric.co sexs-foto.com
sirpornogratis.xxx sexspornotub.com
sitiz.club sexvporno.ru
skytraf.xyz sexy.babes.frontend-stack.top
sloopyjoes.com signx.info
soc-econom-problems.ru site-auditor.online
social-buttons.xyz soblaznu.net
space2019.top sonata-arctica.wz.cz
specialfinanceoffers.com soviet-portal.do.am
spywarenuker.com space4updating.win
star61.de special-porn.com
stockquotes.wooeb.com sukarame.net
strana-solnca.ru surflinksmedical.com
stroydetali.ru syndicate.fun
studworks.org
stuff-about-money.com
supermesta.ru
superoboi.com.ua
superstats.com
sweepstakes.rewardit.com
sygraem.com
tacbibirfa.tk
tamada69.com tamada69.com
tattoo33.ru tds-advert005.info
template-kid.com teastory.co
thegolfclub.info thebitcoincode.com
tizanidinehydrochloride4mgstreetvalue.blogspot.com thin.me.pn
tizanidineoral.blogspot.com threecolumnblogger.com
tomatis.gospartner.com tizanidineforopiatewithdrawal.blogspot.com
toondinsey.com tizanidinestreetvalue.blogspot.com
top-deal.com.pl tizanidinevscyclobenzaprine.blogspot.com
topappspro.com tksn.ru
toproadrunner5.info topdownloads.ru
torrentgamer.net torrents.cd
tracklead.net traderzplanet.in
traffmonster.info treasuretrack-a.akamaihd.net
truemfilelj.gq tv-spoty.info
ttrraacckkrr.com tvory.predmety.in.ua
tube8.com ultramart.biz
tuberkulezanet.ru umnovocaminho.com
tuberkuleznik.ru venerologiya.com
ustion.ru video-woman.com
uzporno.mobi vigrx-original.ru
valkiria-tk.ru visa-china.ru
veles.shop vkontarkte.com
vezuviy.su wallpaperaccess.com
videos-for-your-business.com wedding-salon.net
vmnmvzsmn.over-blog.com weddingdresses.xyz
warezkeeper.com woman-tampon.ru
webnode.me workle.website
wemarketing.se writingservices17.blogspot.ru
wheelchairliftsarea.com ww1943.ru
wholesalejerseysgaa.com x-true.info
wpthemedetector.co.uk xn----8sblgmbj1a1bk8l.xn----161-4vemb6cjl7anbaea3afninj.xn--p1ai
xjlottery.com xn----9sbubg3ambdfl1j.xn--p1ai
xn----7sbbahaq9bb5afgiqfliv4m.xn--p1ai xn--1-8sbcpb0bdm8k6a.xn--p1ai
xn--80ab4aa2g.xn--p1ai xn--80adaggc5bdhlfamsfdij4p7b.xn--p1ai
xn--80ajbshivpvn2i.xn--p1ai xn--d1acah0c.xn--p1ai
yadro.ru xolodremont.ru
youporn-forum.ga xwatt.ru
yoursearch.me xzlive.com
youtubedownload.org yourporngay.com
yuweng.info zakazvzloma.com
zajm-zalog-krasnodar.ru zhorapankratov7.blogspot.com
zarenica.net

405
dev-tools/test_units/ratelimittest-master.txt
View file

@ -8,6 +8,205 @@
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html>ml>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html><html> </html><html>
<head><title>503 Service Temporarily Unavailable</title></head> <head><title>503 Service Temporarily Unavailable</title></head>
<body> <body>
@ -295,202 +494,6 @@
<hr><center>nginx/1.18.0 (Ubuntu)</center> <hr><center>nginx/1.18.0 (Ubuntu)</center>
</body> </body>
</html> </html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<!DOCTYPE html> <!DOCTYPE html>
<html> <html>
<head> <head>
@ -581,14 +584,4 @@
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html> </html>

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.64 0; 10.1.0.78 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.08.3308 ### Version: V4.2022.08.3309
### Updated: Tue Aug 23 22:01:08 UTC 2022 ### Updated: Wed Aug 24 10:03:42 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.08.3308 ### Version: V4.2022.08.3309
### Updated: Tue Aug 23 22:01:08 UTC 2022 ### Updated: Wed Aug 24 10:03:42 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##