vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-03 19:20:16 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2022.12.3511 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2022-12-08 22:09:53 +00:00
parent f57bec5523
commit cde37804a7
48 changed files with 1255 additions and 161230 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.12.3510 #### Version: V4.2022.12.3511
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.12.3510 #### Version: V4.2022.12.3511
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -14,7 +14,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2022.12.3510 #### Version: V4.2022.12.3511
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

10000
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2022.12.3510 #### Version: V4.2022.12.3511
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

10005
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

10005
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

10005
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

10005
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.12 1; 10.1.0.18 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.12 0; 10.1.0.18 0;
127.0.0.1 0; 127.0.0.1 0;

10005
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.12 1; 10.1.0.18 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.12 0; 10.1.0.18 0;
127.0.0.1 0; 127.0.0.1 0;

10005
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.12 1; 10.1.0.18 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.12 0; 10.1.0.18 0;
127.0.0.1 0; 127.0.0.1 0;

10005
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
3510 3511

10005
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

10005
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
52.142.50.160 0; 20.228.137.4 0;

10005
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.12 1; 10.1.0.18 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.12 0; 10.1.0.18 0;
127.0.0.1 0; 127.0.0.1 0;

10005
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.12 1; 10.1.0.18 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.12 0; 10.1.0.18 0;
127.0.0.1 0; 127.0.0.1 0;

10005
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.12 1; 10.1.0.18 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.12 0; 10.1.0.18 0;
127.0.0.1 0; 127.0.0.1 0;

10005
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
52.142.50.160 0; 20.228.137.4 0;

10005
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
52.142.50.160 0; 20.228.137.4 0;

10005
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.12 1; 10.1.0.18 1;
127.0.0.1 1; 127.0.0.1 1;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
BLEXBot Copyscape
Calculon Go!Zilla
Dragonfly Intelliseek
HTMLparser RankingBot
Id-search Recorder
Lightspeedsystems SalesIntelligent
PictureFinder Sucker
Snoopy Voltron
SuperBot Webster
cah.io.community instabid

316
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
360Spider 404checker
ASPSeek
Abonti
Aboundexbot Aboundexbot
AfD-Verbotsverfahren AfD-Verbotsverfahren
AiHitBot AiHitBot
Aipbot
Alexibot Alexibot
AllSubmitter
Alligator Alligator
AlphaBot AlphaBot
Anarchie Anarchie
Anarchy99
Ankit
Anthill Anthill
Apexoo Apexoo
Atomseobot Aspiegel
Asterias
Attach
BBBike BBBike
BDFetch BLEXBot
BackDoorBot BackStreet
BackWeb BackWeb
Backlink-Ceck Backlink-Ceck
Blow Badass
Battleztar Bazinga
BetaBot
Bitacle
BlowFish BlowFish
Boardreader
Bolt Bolt
Brandprotect Brandprotect
Brandwatch Brandwatch
Buck
Buddy Buddy
BuiltBotTough
BuiltWith
Bullseye
CATExplorador CATExplorador
CCBot CODE87
Calculon Calculon
CazoodleBot CazoodleBot
CensysInspect
CheeseBot
Chlooe Chlooe
Cocolyzebot Claritybot
Cloud mapping
Cogentbot Cogentbot
Collector Collector
Copier Copier
CopyRightCheck Copyscape
Cosmos
Craftbot
Crawling at Home Project
CrazyWebCrawler CrazyWebCrawler
CrunchBot Crescent
DatabaseDriverMysqli Custo
CyotekWebCopy
DataCha0s
Demon Demon
Dirbuster DigitalPebble
Disco Disco
Discobot Discoverybot
DnBCrawler-Analytics
DnyzBot DnyzBot
DomCopBot DomCopBot
Download Wonder DomainSigmaCrawler
DomainStatsBot
Dragonfly Dragonfly
EMail Wolf Drip
EirGrabber Ecxi
Exabot EroCrawler
Express WebPictures ExtLinksBot
Extractor
ExtractorPro ExtractorPro
FHscan Extreme Picture Finder
FemtosearchBot FemtosearchBot
Fimap Flunky
Firefox/7.0 Fuzz
Freeuploader
FyberSpider
G-i-g-a-b-o-t
GT::WWW
GermCrawler GermCrawler
GetWeb GetRight
Getintent Getintent
Gigabot Gigabot
GoZilla Go!Zilla
Gotit GrabNet
Grabber
GrapeFX GrapeFX
GrapeshotCrawler
HEADMasterSEO HEADMasterSEO
HTMLparser Harvest
HTTrack Havij
Heritrix Heritrix
Humanlinks
HybridBot
IDBot IDBot
IRLbot
IlseBot IlseBot
Image Sucker Image Fetch
IndeedBot IndeedBot
Indy Library Indy Library
Intelliseek
InterGET
Internet Ninja Internet Ninja
InternetSeer InternetSeer
Iria Iria
JOC Web Spider IstellaBot
JennyBot JennyBot
Joomla JetCar
Jyxobot Jorgee
Keybot Translation-Search-Machine Kinza
LWP::Simple
LeechFTP LeechFTP
Lftp LeechGet
LibWeb LibWeb
Lightspeedsystems LieBaoFast
Likse LinkextractorPro
LinkScan
LinkWalker
LinkpadBot
LinksManager LinksManager
LinqiaMetadataDownloaderBot LinqiaRSSBot
Lmspider MFC_Tear_Sample
MSFrontPage MJ12bot
Majestic SEO MSIECrawler
Majestic12 Mail.RU_Bot
MauiBot MarkMonitor
MarkWatch
Mass Downloader
MeanPath Bot
Meanpathbot Meanpathbot
Metauri Mediatoolkitbot
MegaIndex.ru
MicroMessenger MicroMessenger
Microsoft Data Access Microsoft Data Access
Moblie Safari Mister PiX
Mojeek
Mojolicious Mojolicious
MolokaiBot
Mozlila
Msrabot
NICErsPRO NICErsPRO
Name Intelligence
Nameprotect Nameprotect
Netvibes Needle
Niki-bot Net Vampire
Ninja NetMechanic
Octopus NetSpider
Offline Explorer Netcraft
Offline Navigator Nettrack
NextGenSearchBot
Nibbler
NimbleCrawler
Nuclei
OnCrawl OnCrawl
Openfind
OrangeBot
OrangeSpider OrangeSpider
OutclicksBot PECL::HTTP
OutfoxBot PHPCrawl
POE-Component-Client-HTTP
Page Analyzer Page Analyzer
Pavuk PageAnalyzer
Petalbot PageScorer
PageThing.com
Pi-Monster Pi-Monster
Picscout Picscout
ProPowerBot PleaseCrawl
Probethenet ProWebWalker
Psbot RankActive
Pump
RankingBot
Rankivabot Rankivabot
Re-re RedesScrapy
ReGet
RealDownload
RebelMouse
Recorder
Rogerbot
SEOkicks SEOkicks
SEOkicks-Robot SEOkicks-Robot
SEOprofiler SEOlyticsCrawler
SalesIntelligent SISTRIX
SMTBot
ScoutJet ScoutJet
Scrapy Scrapy
Screaming Screaming
ScreenerBot ScrepyBot
Searchestate Seekport
SearchmetricsBot Semrush
SemanticJuice SeobilityBot
SemrushBot Seomoz
SentiBot
Shodan
Siphon Siphon
Site Sucker
SiteCheckerBotCrawler
SiteLockSpider SiteLockSpider
SiteSnagger SiteSucker
SmartDownload
Snapbot Snapbot
Snoopy Sogou web spider
Sociscraper Spbot
Sosospider SputnikBot
SpaceBison Sqlmap
Spinn3r
Sqlworm Sqlworm
Sqworm
Sucker
Sucuri Sucuri
SuperBot SuperBot
Surfbot SuperHTTP
Swiftbot Szukacz
Teleport T0PHackTeam
TeleportPro TeleportPro
Telesphorep Telesphorep
The Intraformant TheNomad
Toata Thumbor
Toweyabot Titan
True_Robot Tracemyfile
Trendiction
Turnitin
TwengaBot
Twice Twice
Typhoeus Typhoeus
URLy Warning UnisterBot
URLy.Warning V-BOT
Upflow VB Project
VCI VelenPublicWebCrawler
VeriCiteCrawler Virusdie
VidibleScraper VoidEYE
Voltron Voil
WASALive-Bot
WBSearchBot
WEBDAV WEBDAV
WPScan WWW-Collector-E
WWWOFFLE
Wallpapers Wallpapers
WallpapersHD WallpapersHD
WeSEE Web Auto
Web Collage Web Fetch
Web Enhancer WebImageCollector
Web Sauger
Web Sucker
WebBandit
WebCopier
WebFuck
WebPix WebPix
WebReaper WebReaper
WebWhacker WebStripper
WebsiteExtractor WebSucker
Whatweb Webalta
WebmasterWorldForumBot
Whack
Whacker
Who.is Bot
WinHTTrack
WiseGuys Robot
Wonderbot
Woobot Woobot
Wotbox Wprecon
Zade Xenu
ZumBot YoudaoBot
archive.org_bot Zauba
autoemailspider Zeus
check1.exe ZyBorg
adscanner
backlink-check
clark-crawler
crawl.sogou.com crawl.sogou.com
domainsproject.org crawler.feedback
facebookscraper evc-batch
gopher gopher
heritrix
internetVista monitor internetVista monitor
ips-agent isitwp.com
linkdexbot iubenda-radar
lwp-request lwp-request
lwp-trivial
meanpathbot meanpathbot
mediawords muhstik-scan
netEstate NE Crawler
oBot oBot
page scorer page scorer
plumanalytics plumanalytics
polaris version
probe-image-size
ripz
satoristudio.net satoristudio.net
scan.lol seocompany.store
seobility seostar
serpstatbot serpstatbot
sitechecker.pro sexsearcher
siteripz sogouspider
trendiction.com spyfu
voyagerx.com tAkeOut
webmeup-crawler webpros.com
x22Mozilla zauba.io

286
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,143 +1,149 @@
01h4x.com
360Spider 360Spider
404checker 404enemy
ALittle Client ADmantX
Abonti ASPSeek
Aboundex
Aboundexbot Aboundexbot
AfD-Verbotsverfahren AiHitBot
Alexibot
AllSubmitter AllSubmitter
Alligator
AlphaBot
Anarchie
Anarchy Anarchy
Anarchy99 Anarchy99
Aspiegel Anthill
Apexoo
Asterias Asterias
Atomseobot BBBike
Attach BLEXBot
BDFetch
BackDoorBot BackDoorBot
Badass BetaBot
Bandit BlackWidow
Barkrowler BlowFish
Battleztar Bazinga
Blackboard
BotALot
Brandwatch Brandwatch
BuiltBotTough Buddy
BunnySlippers BuiltWith
CSHttp Bullseye
BuzzSumo
CODE87
Calculon Calculon
Chlooe Cegbfeieh
Collector CensysInspect
Cosmos CheeseBot
CrazyWebCrawler Citoid
Crescent Copyscape
CrunchBot Craftbot
Custo Crawling at Home Project
Curious
CyotekWebCopy CyotekWebCopy
DBLBot
DTS Agent DTS Agent
Discobot Discobot
DomCopBot Discoverybot
DomainAppender
DomainCrawler DomainCrawler
DomainSigmaCrawler Domains Project
Dotbot
Download Wonder
Dragonfly
EMail Wolf
Ebingbong Ebingbong
EirGrabber
EroCrawler
Exabot
ExtLinksBot ExtLinksBot
Extreme Picture Finder Extractor
ExtractorPro
EyeNetIE EyeNetIE
Ezooms Ezooms
FemtosearchBot FDM
FlashGet GermCrawler
Freeuploader
G-i-g-a-b-o-t
GetRight GetRight
Go!Zilla Go!Zilla
GrabNet Go-Ahead-Got-It
GrapeFX GoZilla
HEADMasterSEO Grafula
GrapeshotCrawler
HTTP::Lite
HaosouSpider HaosouSpider
Havij Havij
Hloader Hloader
Humanlinks IDBTE4M
HybridBot IDBot
IlseBot IRLbot
Iblog
Id-search
Image Fetch
Image Sucker Image Sucker
InfoNaviRobot
InfoTekies
Intelliseek
InterGET
Internet Ninja Internet Ninja
Iskanie InternetSeer
IstellaBot IstellaBot
JOC Web Spider JOC Web Spider
Jbrofuzz
JennyBot JennyBot
JetCar JikeSpider
Keybot Translation-Search-Machine Jorgee
JustView
Kenjin Spider
Kozmosbot Kozmosbot
Larbin Lanshanbot
LeechFTP LeechFTP
Lftp Libwhisker
LieBaoFast LieBaoFast
Lightspeedsystems
LinkScan
LinkWalker LinkWalker
Linkbot
LinkpadBot LinkpadBot
LinksManager
LinqiaRSSBot LinqiaRSSBot
LinqiaScrapeBot Lipperhey Spider
Lipperhey
Litemage_walker
Lmspider
Ltx71 Ltx71
MIDown tool MSFrontPage
MJ12bot
MSIECrawler
MTRobot
Mag-Net Mag-Net
Magnet
Majestic-SEO
MarkMonitor MarkMonitor
Mass Downloader Masscan
Mata Hari
MauiBot MauiBot
Mb2345Browser
MeanPath Bot MeanPath Bot
Meanpathbot
Mediatoolkitbot Mediatoolkitbot
MicroMessenger MicroMessenger
Microsoft URL Control Minefield
Mister PiX
Moblie Safari
Mojeek Mojeek
Mojolicious
MolokaiBot MolokaiBot
Mr.4x3 Morfeus Fucking Scanner
Mozlila
Musobot
NICErsPRO NICErsPRO
NPbot
Name Intelligence Name Intelligence
Nameprotect Nameprotect
Navroad
Needle Needle
NetMechanic Nessus
Netcraft NetLyzer
Nettrack Netvibes
Nibbler Nibbler
Nikto NimbleCrawler
Nimbostratus Not
Ninja
Nuclei Nuclei
Nutch
Octopus Octopus
Offline Explorer Offline Explorer
Offline Navigator OnCrawl
OpenLinkProfiler
OpenVAS OpenVAS
Openvas OrangeSpider
OutclicksBot OutclicksBot
PECL::HTTP OutfoxBot
PHPCrawl
POE-Component-Client-HTTP
PageAnalyzer PageAnalyzer
PageThing.com PageThing.com
Pandalytics Pandalytics
Panscient Papa Foto
Pavuk Pi-Monster
Petalbot
Pockey Pockey
ProPowerBot Probethenet
PyCurl Psbot
Pump
RankActive
RankingBot RankingBot
RankurBot RankurBot
Re-re Re-re
@ -145,106 +151,100 @@ ReGet
RealDownload RealDownload
Reaper Reaper
RedesScrapy RedesScrapy
RepoMonkey Rogerbot
SEOkicks SBIder
SEOkicks-Robot SEOlyticsCrawler
SEOstats SalesIntelligent
SMTBot Screaming
ScreenerBot ScrepyBot
SemanticJuice SemanticJuice
Semrush
SemrushBot
SentiBot
SeoSiteCheckup SeoSiteCheckup
Seomoz Seomoz
Siphon Shodan
SiteLockSpider SiteCheckerBotCrawler
SiteExplorer
SiteSnagger SiteSnagger
SiteSucker
Sitebeam Sitebeam
SlySearch SlySearch
SmartDownload
Snake Snake
Sogou web spider Snoopy
Spammen Sociscraper
SpankBot Sosospider
Sottopop
Spinn3r Spinn3r
SputnikBot
Sqlworm Sqlworm
Sqworm
Sucker
SuperHTTP SuperHTTP
Surfbot
Swiftbot Swiftbot
T0PHackTeam T0PHackTeam
Teleport Teleport
TeleportPro TeleportPro
Trendiction The Intraformant
Turingos TightTwatBot
Toata
Toweyabot
Trendictionbot
True_Robot
Turnitin Turnitin
TurnitinBot Twice
URLy.Warning URLy.Warning
Upflow Upflow
Vacuum
Vagabondo
VeriCiteCrawler VeriCiteCrawler
Virusdie Virusdie
Voltron
WWW-Collector-E
WWW::Mechanize
Wallpapers Wallpapers
WallpapersHD WallpapersHD
WeSEE
Web Auto Web Auto
Web Pix Web Collage
Web Sauger Web Enhancer
Web Sucker
WebAuto
WebCopier
Web Fuck Web Fuck
WebCopier
WebEnhancer
WebFuck
WebImageCollector
WebReaper WebReaper
WebStripper WebStripper
WebSucker
WebWhacker
WebZIP
WebmasterWorldForumBot WebmasterWorldForumBot
Webshag
WebsiteExtractor
WebsiteQuester WebsiteQuester
WebsiteQuester
Webster
Whack Whack
Whacker WiseGuys Robot
WinHTTrack
Wonderbot
Wotbox Wotbox
Wprecon Xenu
Zade
Zauba
Zermelo
Zeus Zeus
Zitebot
ZmEu ZmEu
ZoominfoBot ZumBot
adscanner
archive.org_bot archive.org_bot
arquivo-web-crawler arquivo-web-crawler
arquivo.pt arquivo.pt
autoemailspider cah.io.community
backlink-check crawl.sogou.com
check1.exe crawler.feedback
clark-crawler dataforseo.com
com.plumanalytics demandbase-bot
crawler4j isitwp.com
facebookscraper lwp-request
heritrix
internetVista monitor
magpie-crawler magpie-crawler
meanpathbot muhstik-scan
oBot pcBrowser
page scorer
probe-image-size
scalaj-http scalaj-http
seobility seobility
seocompany.store
seoscanners seoscanners
seostar seostar
sitechecker.pro sexsearcher
siteripz
sogouspider sogouspider
sp_auditbot
tAkeOut
trendiction.de trendiction.de
webgains-bot voyagerx.com
webpros.com webpros.com
x22Mozilla webprosbot
zauba.io zauba.io
zgrab zgrab

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
5forex.ru downloaddy.net
adverster.com earl-brown.info
awaybird.ru filmgo.ru
cellfun.mobi gate5.co.za
dev33.dioniqlabb.se hollywoodactress.info
locatellicorretor.com.br laptoper.net
mompussy.net osoznanie-narkotikam.net
sribno.net tmtrck.com
u555u.info wholesalejerseys-cheapest.com
zebramart.ru xn--lifehacer-1rb.com

938
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
00it.com 100searchengines.com
1008.su 101lesbian.xyz
1314dh.com
178evakuator178.ru
1hwy.com 1hwy.com
1qingdao.com 4ureyesonly.com
20pascals.nl 6128786.com
2728fb936f0.com 8558l.jobs.net
404.mn 991mostfm.co.id
51.la academiacsmendoza.org
57883.net adhome.biz
7xc4n.com admanaerofoil.com
8gold.com admatic.com.tr
a.frcls.fr adsref.men
aac52006ec82a24e08b665f4db2b5013f7.com adultgalls.com
aad1f4acb0a373420d9b0c4202d38d94fa.com advancedcleaner.com
aanapa.ru adverster.com
absugars.com advokateg.ru
acortarurl.es adzpower.com
adexprts.com aihelen.net
adrunnr.com akita.kz
adviceforum.info ald2014.org
advokat-grodno.by alif-ba-ta.com
aksonural.ru all4invest.ru
alert-jdh.xyz all4wap.ru
alessandraleone.com
allbizne.co.ua allbizne.co.ua
allornamenti.com allforminecraft.ru
alloysteel.ru
allstatesugarbowl.org allstatesugarbowl.org
alveris.ru alphahoverboards.com
amateurgalls.com amoi.tn
amazingpic.net animal-drawings.com
amazon-seo-service.com animal36.com
anabolics.shop apidigidocketnet-a.akamaihd.net
anal-acrobats.hol.es artefakct.com
androids-store.com atelielembrancaqueencanta.com.br
animali.deagostinipassion.it audiofree.ru
apiwebwebgetcom-a.akamaihd.net auspolice.com
apps-analytics.net australia-opening-times.com
apptester.tk auto-zapchasti.org
aproposde.com auto.rusvile.lt
arcadeplayhouse.com autoloans.com
ardimobileinfo.ml aviav.co
arenda-avtoprokat-krasnodar.ru avtovolop.ru
arius.tech backiee.com
artavenuegardenstudios.com backuperwebcam.weebly.com
asiengirls.net bagsonsale.online
automobile-spec.com
autoseo-traffic.com
aviapanda.ru
avon-ukraine.com
ayakino.net
babyfactory.fr
baikaleminer.com
baixar-musicas-gratis.com baixar-musicas-gratis.com
balans.shahterworld.org baksman.com
bambi.ck.ua bannerswap.com
banki76.ru bbtec.net
bankofthewext.com berdasovivan.ru
baoxaydung.com.vn best-mam.ru
best-deals-products.com bet-prognoz.com
bestofupload.info bet365.com
bigcareer.info biketank.ga
billiard-classic.com.ua bikini-image.com
bimatoprost-careprost.com binomo.kz
bin-brokers.com bitcoinpile.com
blackcurranthumidifiers.site bitporno.sx
blackplanet.com bizcheapjerseyswholesalechina.com
blackwitchcraft.ru blobar.org
blog.koreadaily.com blog.axant.it
book-bets.com bluerobot.info
bosman.pluto.ro bmwhighperformers.com
brimstonehillfortress.org bongacams.com
buchananshardware.com boobsimge.com
bus-offer.com bouda.kvalitne.cz
butstrap.space brainsandeggs.blogspot.com
buy-forum.ru brandbucket.com
buzzonclick.com brandimensions.com
cah.io.community bravegirlsclub.com
brewdom.ru
brothers-smaller.ru
businesxxl.com
buttons-for-website.com
buyviagraa.blogspot.com
c-gainsbourg.com
cacheimages.com
call-of-duty.info
callejondelpozo.es callejondelpozo.es
candycrushshop.com calstaterealty.us
capsderfudd.tk capture-room.com
carfax.com.ua cardsharp1.ru
cartierbracelet.xyz carrauterie.be
cartierlovebraceletreplica.xyz cartierreplica.top
cezartabac.ro casablancamanor.co.za
cheapmarmot.online caveavins.fr
chuckguilford.com cdn.walkme.com
ciceros.co cdncash.com
citetick.com centre-indigo.org.ua
civilwartheater.com cercacamion.it
claytransformations.info checkm8.com
cleanallvirus.com chee-by.biz
clodo.ru cherubinimobili.it
clubfashionista.com chiptuninger.com
cmhomestayagency.com christianlouboutinreplica.pw
cocolyze.com clickpapa.com
com-onlinesupport.site clippingphotoindia.com
compliance-barak.top clips.ua.ac.be
compliance-jess.top cocyq.inwtrade.com
compliance-jessica.top collegeessay19.blogspot.ru
compliance-walt.top comissionka.net
cookie-law-enforcement-aa.xyz commoncrawl.org
cookie-law-enforcement-ff.xyz compliance-andrew.top
craftinsta.ru compliance-donald.xyz
credit-respect.ru contentsexpress.com
custom-electric-guitar.com coolwallpapers4k.info
cyclobenzaprinevstizanidine.blogspot.com coop-gamers.ru
cypernhuset.se counter.yadro.ru
dairyindia.in crackguru.tk
damasarenai.info crest-poloski.ru
daretodonate.co cwetochki.ru
darmebel.com.ua czat.wp.pl
ddpills.com dailyrank.net
deadlinkchecker.com date-withme.com
delitime.info datract.com
deshevo-nedorogo.ru de.zapmeta.com
dimaka.info dealitright.click
decorationspcs.com
demenageur.com
detoxmed24.ru
dimfour.com dimfour.com
dividendo.ru discovertreasure-a.akamaihd.net
divku.ru dkvorota.ru
djonwatch.ru dnepr-avtospar.com.ua
dojki365.online docs4all.com
domik-derevne.ru domcran.net
download-walpaperhd.blogspot.com domznaniy.ru
downloads-whatsapp.com donna7753191.ru
dvervmoskvu.ru dostavimvdom.ru
dwomlink.info downloaddy.net
eager-nash.188-93-233-196.plesk.page downloader12.ru
earncash.com.ua downtuptv.gq
ednorxmed.com drillsaw.ru
eduinfosite.com drupa.com
eets.net dvd-famille.com
ekspresihati.info dvr.biz.ua
elektronischezigarettekaufen2.tumblr.com e-kwiaciarz.pl
elitesportsadvisor.com earl-brown.info
emediate.eu editmedios.com
energydiet-info.ru emerson-rus.ru
enge-fotzen.info eng-lyrics.com
eredijovon.com enthuse.computernetworksonline.com
erotische-geschichten-xxl.com etotupo.ru
errorfixing.space everypony.ru
euromasterclass.ru expolicenciaslatam.co
event-tracking.com expresstoplivo.ru
ezigarettenshop2.postbit.com extener.org
faracontrol.ir extlabs.io
fatmaelgarny.com ez8motelseaworldsandiego.com
fdzone.org ezb.elvenmachine.com
fenoyl.batcave.net ezigarettekaufen.myblog.de
fickblock18.com ezigarettenkaufen1.pagina.gr
filkhbr.com ezigarettenshop1.yolasite.com
findacheaplawyers.com fable.in.ua
fitnesspiks.com farm26.ru
fivedwld.cf fashionindeed.ml
faz99.com
financetip.eu
findsexguide.com
flirt4free.com
flytourisme.org flytourisme.org
forums.toucharcade.com foodgid.net
foto-telok.net footballfarrago.com
foto-weinberger.at forex-procto.ru
frbizlist.com forexgb.ru
free-fbook-traffic.com forexunion.net
free-share-buttons.top foxtechfpv.com
free411games.com free-floating-buttons.com
freevpn.space freejabs.com
frivgame250.com freemaintenancesysforpcandmac.top
front.ru freenom.link
front.to freeuploader.com
fuckbuddybestgilf.info
fungamelands.com fungamelands.com
funnel.co.za girls-ufa.ru
fyl.com.ru global-ics.co.za
g7m.pl goforexvps.com
gameprimary.com golmau.host.sk
gamerextra.com green-tea.tv
gamevalue7.weebly.com greendream.com.ua
gate5.co.za gwebtools.com.br
gdcentre.ru gz2.bbsoldes.fr
gembird.com handsandlegs.ru
gerhardhealer.com hausfrauensex18.com
getoutofdebtfree.org hdhc.ru
ggiaro.com
gigapeta.com
gigixo.com
gilbertbanda.net
girlsfuckdick.com
globetrotting-culture.ru
gogalleryawesome.com
gogps.me
good-mummy.ru
goosefishpost.bid
gopro-online.info
goroda-vsego-mira.ru
gosarhivrt.ru
greatidea.marketing
guidefs.ru
guod.me
gymi.name
habermetre.com
handicapvansarea.com
handicapvantoday.com
hanwei.us
hasfun.com
hatdc.org
hdpixent.com hdpixent.com
hdwalls.xyz help.tpu.ru
health-medical-portal.info hermesreplica.win
heartofpayne.xyz hobild.net
hexpilot.com hoholikik.club
heygidday.biz hostcritique.com
high-speed1.net hosting-tracker.com
himazin.info hostingclub.lk
hitmuzik.ru hotenergy.ru
hjaoopoa.top
homemature.net
hostnow.men
hotchatdate.com
hotshoppymac.com
hotxnights.info hotxnights.info
houston-vikings.com howmuchdoestizanidinecost.blogspot.com
howopen.ru hulfingtonpost.com
hscsscotland.com humbmosquina.tk
id-forex.com i-service.kz
ilte.info idc.com.ua
imediadesk.com iklysha.ml
incanto.in.ua imagecoolpub.com
incep.imagine-ex.co images-free.net
infobanks.ru imagine-ex.co
imperia31.ru
impisr.edunsk.ru
indiasourcemart.in
inome.com.ua inome.com.ua
int.search.mywebsearch.com insider.pro
invest-pamm.ru insurple.com
iplogger.org investingclub.ru
ipornox.xxx istanbulit.com
iradiology.ru istizanidinelikexanax.blogspot.com
ispac.org istmira.ru
istizanidineanarcoticdrug.blogspot.com istock-mebel.ru
itbc.kiev.ua itbc.kiev.ua
izhevsk.xrus.org itronics.ca
jabimgo.pw itservicesthatworkforyou.com
jacago.com james13prix.info
jagg.info javatex.co.id
javrip.net job.icivil.ir
javstock.com kambasoft.com
jerseyswholesalechinalimited.com kamen-e.ru
jimmychoosale.online keyhantercume.com
journalhome.com keywesthideaways.co
justbcause.com keywordhouse.com
justdating.online keywordsking.com
karaganda.xkaz.org kino-rating.ru
kazka.ru kinomaniatv.pl
kchaxton.com kinopolet.net
kerei.ru kladrus.ru
keywordsdoctor.com klumba55.ru
kichenaid.ru knogg.net
knowsitall.info kongoultry.net
knowyournextmove.com kredit-blog.ru
komputernaya-pomosh-moscow.ru kutikomi.net
konica.kz lafourmiliaire.com
kovesszucs.atw.hu lampokrat.ws
la-fa.ru landoftracking.com
languagecode.com laptop-4-less.com
lashstudia.ru
laulini.soclog.se laulini.soclog.se
legalrc.biz legionalpha.com
lego4x4.ru lemon-ade.site
lenpipet.ru
letmacwork.world
lflash.ru lflash.ru
life-instyle.com liffa.ru
life.biz.ua
lifebyleese.com
lifehacĸer.com
lightinghomes.net
limads.men limads.men
linkredirect.biz liumimgx.pw
lionking-1994.blogspot.com live-cam6.info
liveu.infoteka.hu livefixer.com
livingcanarias.com livejasmin.com
ljusihus.se lmrauction.com
locationdesaison.com lomb.co
lombardfinder.ru lombia.co
long-beach-air-conditioning.com lostfilm-online.ru
lovelycraftyhome.com
mac-shield.com
machicon-ueno.info machicon-ueno.info
mafcards.ru manipulyator-peterburg.ru
magda-gadalka.ru mantramusic.ru
magicalfind-a.akamaihd.net masterseek.com
mamasuper.prom.ua masturbate.co.uk
marketland.ml matchpal-a.akamaihd.net
marmotstore.online mebel-alait.ru
marwer.info
max-p.men
medmajor.ru
megahdporno.net megahdporno.net
mere.host.sk meget.co.za
message-warning.net member-quiz.com
merryhouse.co.uk
mesto-x.com mesto-x.com
mhi-systems.ru metascephe.com
mielec.pl
mil-stak.com
millionare.com
mini-modus.ru
miniature.io miniature.io
misslike.ru mixtapetorrent.com
missvietnam.org mixx.com
mistr-x.org mnogolok.info
mjchamonix.org money-every-day.com
mnimmigrantrights.net monitorwebsitespeed.com
mobot.site montredemarque.nl
moi-glazki.ru movies-in-theaters.net
monclerjacketsoutlet.win mrcsa.com.au
moncleroutletonline.xyz mrpornogratis.xxx
more-letom.ru msk-diplomat.com
morocco-nomad-excursions.com muabancantho.info
mountainstream.ms muschisexbilder.com
mp3films.ru my-aladin.com
mrbitsandbytes.com mybinaryoptionsrobot.com
mturkcontent.com myfreetutorials.com
muizre.ru myperiod.club
myanyone.net na15.ru
mydirtyhobby.com needtosellmyhousefast.com
mywallpaper.top
na-telefon.biz
netanalytics.xyz
netvouz.com
newstraveller.ru newstraveller.ru
nextlnk12.com nippon-bearings.ru
nhl17coinsforps3.gratisblog.biz nonews.co
nicovideo.jp norththeface.store
nofreezingmac.work nudejapan.net
nootrino.com
nuker.com
o-dachnik.ru o-dachnik.ru
oakridgemo.com o-o-8-o-o.com
obuv-kupit.ru ok-ua.info
offers.bycontext.com
okeinfo.online okeinfo.online
oklogistic.ru okroshki.ru
onblastblog.online old-rock.com
one-gear.com onlinedomains.ru
online-sbank.ru onlineporno.site
onload.pw onload.pw
onlyporno.ru ooomeru.ru
openstat.com open-odyssey.org
orgasmus-virtual.com osagonline.ru
outclicks.net outrageousdeal-a.akamaihd.net
p-business.ru oxotl.com
paclitor.com ozoz.it
parlament.biz paintingplanet.ru
partner-print.men paleohub.info
pcads.ru paydayonlinecom.com
penisvergrotendepillennl.ovh
perfectplanned.com
perm.xrus.org perm.xrus.org
pharmacyincity.com perso.wanadoo.es
pirateday.ru pinsdaddy.com
pizdopletka.club plastgranar.nu
pizza-imperia.com plastjulgranar.se
pizza-tycoon.com popander.mobi
playboyfiles.xblog.in popserve.adscpm.net
poffet.net pornofeuer.com
polska-poezja.com pornzone.tv
poppen-nw.net potolokelekor.ru
pornoslive.net pourvous.info
pornoted.com preconnubial.usuby.site
porodasobak.net prefersurvey.net
portal-eu.ru privacyassistant.net
pr0fit-b0x.com prlog.ru
pravoholding.ru promoheads.com
professionalwritingservices15.blogspot.ru prostitutki-yaroslavlya.org
profitfx.online pshare.biz
prostitutki-almata.org purplesphere.in
ptr.ruvds.com quelle.ru
pts163.ru quickloanbank.com
qexyfu.bugs3.com rainbowice.ru
razorweb-a.akamaihd.net raisedseo.com
reklamuss.ru ranksays.com
relax.ru rankscanner.com
rennlist.com ranksonic.info
retreatia.com raschtextil.com.ua
riders.ro rasteniya-vs-zombi.ru
rniaeba.ga real-time-analytics.com
robotixix.com reining.lovasszovetseg.hu
roll123.com reklama1.ru
roma-kukareku.livejournal.com renecaovillasale.online
romhacking.ru replicalouboutin.xyz
royal-betting.net rfserial.net
royalads.net ric.info
ruscopybook.com ringporno.com
russia-tao.ru rique.host.sk
s8-nowy-wygraj.comli.com russia-today-video.ru
saecsa.co rybalka-opt.ru
saletool.ru sabaapress.com
saddiechoua.com
salut-camp.ru
saneitconsulting.com saneitconsulting.com
sardinie.us satoristudio.net
saveindex.xyz scanner-jane.top
saveriopiazza.it scanner-jessica.top
sayyoethe.blogspot.co.za scripted.com
sbwealthsolutions.ca searchimage.co
scanner-george.top searchmywindow-a.akamaihd.net
searchinquire.com seksvideoonlain.com
seccioncontrabajo.com selectads.men
semaltmedia.com seo-smm.kz
semp.net seoexperimenty.ru
seorank.info seojokes.net
sevenstars7.com seoprofiler.com
sexpornotales.com seorankinglinks.us
sfd-chess.ru seryeznie-znakomstva.ru
shoplvlv.us sethrollins.net
shopwme.ru sex-tracker.com
siteexpress.co.il sexuria.net
sitevaluation.com sherlock.se
slomm.ru shtaketniki.kz
smartadserver.com shtaketniki.ru
snow.nvr163.com shtora66.ru
snyatie-lomki-v-stacionare.ru sisiynas.ru
social-search.me sk.golden-praga.ru
sodexo.com slimcdn.com
space4updating.win social-s-ggg.xyz
speedup-my.site soheavyblog.com
startwp.org solmarket.by
staynplay.net sophang8.com
steelmaster.lv soundfrost.org
sterva.cc souvenir.cc
sticken.co speechfoodie.com
stjamesschool.info spitfiremusic.com
stockquotes.wooeb.com spywarenuker.com
store-rx.com srgwebmail.nl
stpolice.com stackthatbucks.com
strana-solnca.ru stairliftstrue.com
surcentro.com stanthonyscatholicchurch.org
swimpool.ca stop-gepatit.te.ua
szamponrevita.pl streamin.to
tecspb.ru stretchingabuckblog.com
telefonsex-ohne0900.net stroiminsk.org
tengohydar.tk strongsignal-a.akamaihd.net
thenews-today.info sundrugstore.com
theprofitsmaker.net superkanpo.com
thetoiletpaper.com swinon.site
thfox.com tako3.com
tilido.com technopellet.gr
titan-cloud.life tedy.su
tizanidine4mgtablets.blogspot.com teencastingporn.com
tizanidineandgabapentin.blogspot.com teenfuck.tv
tizanidineforopiatewithdrawal.blogspot.com tehngr.ru
tgtclick.com
thebluenoodle.com
thecounter.com
thedownloadfreeonlinegames.blogspot.com
thefotosgratis.eu
theguardlan.com
thiegs.reco.ws
timer4web.com
timetorelax.biz
tizanidine4mgstreetprice.blogspot.com
tizanidine4mgstreetvalue.blogspot.com
tizanidinecost.blogspot.com
tizanidinedosage.blogspot.com
tizanidineoral.blogspot.com
tizanidinesideeffects.blogspot.com
tizanidinesideeffectsweightloss.blogspot.com
tizanidinevsvalium.blogspot.com tizanidinevsvalium.blogspot.com
tnaionline.org tomatis.gospartner.com
tomck.com torrents.life
tooplay.com torrnada.ru
top10-way.com tracksurf.daooda.com
toproadrunner5.info traderzplanet.in
tpu.ru
track.deriv.com
track2.shop
tracklead.net
tracxn.com
traffic100.com traffic100.com
trafficnetzwerk.de trubywriting.com
traffique.net tubeoffline.com
ttsq.fr turizmus.us
u-cheats.ru twittrading.com
unacittaconte.org typer.one
unionmarkt.de u17795.netangels.ru
usbggettwku.ga uchil.net
utrolive.ru ucsol.ru
uzporno.mobi umg-stroy.ru
vadimkravtcov.ru unimodemhalfduplefw.pen.io
vegan-foods.us unmaroll.ya.ru
vepad.com url-extractor.xyz
veselokloun.ru us-america.ru
viagra-soft.ru vacuumscleaner.com
videochat.world validccseller.com
vinylvault.co.uk varbergsvind.se
vipromoffers.com verymes.xyz
visa-pasport.ru vesnatehno.com
vizitki.net videokrik.net
voprosotvet24.ru videotuber.ru
vysigy.su vikistars.com
vzlom-na-zakaz.com vipms.ru
wallpapersist.com virtuagirl.com
web-analytics.date visitcambridge.org
westum.se vizag.kharkov.ua
whatsappdownload10.com vkonche.com
whereiskentoday.com vkontarkte.com
wholinkstome.com voditeltrezviy.ru
wildnatureimages.com vonradio.com
word-vorlagen.xyz wareseeker.com
wordpresscore.com warning.or.kr
x-diesel.info watsonrealtycorp.com
x-lime.net webix.biz
x-musics.com website-analytics.online
weightatraining.com
whatzmyip.net
wholesalejerseychinaoutlet.com
woman-orgasm.ru
works.if.ua
worldoffiles.ru
worldtraveler.world
writingservices17.blogspot.ru
wrz0iuebwhp5fg.freeddns.com
wufak.com
x69ty.ru x69ty.ru
xjlottery.com xmlinde.com
xn-----6kcaacnblni5c5bicdpcmficy.xn--p1ai
xn-----6kccaibs5cb8afhjrfmix2n.xn--p1ai
xn----7sbbahaq9bb5afgiqfliv4m.xn--p1ai xn----7sbbahaq9bb5afgiqfliv4m.xn--p1ai
xportvusbdriver8i.snack.ws xn--80aaafbn2bc2ahdfrfkln6l.xn--p1ai
xvideosbay.com xn--80aagddcgkbcqbad7amllnejg6dya.xn--p1ai
yadro.ru xn--80aikhbrhr.net
ynymnwbm.bloger.index.hr xn--h1aakne2ba.xn--p1ai
youghbould.wordpress.com xn--q1a.xn--b1aube0e.xn--c1acygb.xn--p1ai
youjizz.vc xnxxandxvideos.com
yourads.website xpresscare.ru
youradulthosting.com xvideosporn.biz
youresponsive.com yourothersite.com
youtube-downloader.savetubevideo.com zaimite.ru
yubikk.info zajm-zalog-krasnodar.ru
zastroyka.org zawyna.ua
znaturaloriginal.com zeroredirect.com
zone-kev717.info
zoompegs.com zoompegs.com
zverokruh-shop.cz zverokruh-shop.cz
zvezdagedon.ru
zynax.ua

484
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
03p.info 03p.info
1001watch.com.ua 24-ak.ru
2015god.org 7ooo.ru
273-fz.ru 8558l.jobs.net
7a2rnuey1tw9ar.ru abcdeg.xyz
aaa38852e886ac4af1a3cff9b47cab6272.com activepr.ru
acunetix-referrer.com add-add.men
adidas.frwebs.fr adman.gr
adminshop.com adultmeetonline.info
adservme.com advertisingtag.net
advancedsoftwaresupport.com alekseevec.ru
adzerg.com alert-hgd.xyz
affrh2015.com
allpdfmags.net
alpinism.ru
amazon-adsystem.com
amazon-seo-service.com amazon-seo-service.com
animenime.ru ampower.me
apiluckyleapnet-a.akamaihd.net amung.us
apioutoboxnet-a.akamaihd.net apiholdingmypage-a.akamaihd.net
arabseyes.com arcadeplayhouse.com
artdestshop.eu arclk.net
autobrennero.it artpicso.com
autonew.biz atdedinotuho.tk
ayakino.net atlasvkusov.ru
azartmix.com avtocredit-legko.ru
azarttoto.com ayeartoforget.com
azbukafree.com back.dog
azte.ch bangla-chat-uk-paralud.ga
babyfactory.fr bannerconnect.net
bankiem.pl berlininsl.com
bannerpower.com bestcoin.cc
bbtec.net bestdraws.com
beachfix.co bjorkbacken.nu
bedandbreakfast.com bluejays-jerseys.us
bestmobilityscooterstoday.com bmwhighperformers.com
betwinservice.com boleznikogi.com
bif-ru.info bonux.nextview.ru
biznesschat.net brainzpod.win
blog-hits.com btc4u.ru
braindaily.xyz buehne-fuer-menschenrechte.de
bukleteg.xyz bum.com.ru
bumskontakte.org bumascloset.com
carsplate.com buybest1.biz
cbcseward.com cactussoft.biz
cdncash.org cand.jp
cezartabac.ro candiceloves.us
cheap-trusted-backlinks.com candycrushshop.com
christianlouboutinreplica.win cenokos.ru
clarithromycin500mg.com cete.ru
club-lukojl.ru cfcl.co.uk
compliance-jane.top cheapbarbour.online
construmac.com.mx christianlouboutinsaleonline.us
cookingmeat.ru ciceros.co
copenergo.ru clmforexeu.com
cosmeticswomens-womensports.rhcloud.com coldfilm.ru
cpajunkies.com compliance-don.top
craftburg.ru compliance-john.top
customboxes4less.com compliance-walter.top
dangphoto.trade cool-wedding.net
dayibiao.com covetnica.com
deniven.1bb.ru crackzplanet.com
diminishedvalueoforegon.com cranly.net
directrev.com crynet.cc
distver.ru customcollegeessays.net
dokumentalkino.net de.zapmeta.com
drugs-no-rx.info deluxedumps.com
eduserver.net derevesendeco.com
edwinkonijn.com.au detoxmed24.ru
ekto.ee dev33.dioniqlabb.se
elektrozigarette2.wordpressy.pl dfwu1013.info
enge-fotzen.info digital-video-processing.com
evening-dating-club.info docsportal.net
ezigarettekaufen1.hpage.com download-of-the-warez.blogspot.com
falllow.gq dstroy.su
fatfasts-4tmz.com e705.net
findthe.pet electrik-avenue.com
fitnesspiks.com elektrischezigarette2.onsugar.com
floridamobilebillboards.com elmifarhangi.com
flytourisme.org ezigaretteshop2.mywapblog.com
freshsuperbloop.com f07.de
friendflnder.com f0815.de
fun2cell.net famix.xyz
fusoradio.info filmfanatic.com
gael-s.ru franklinfire.co
gateway.zscalertwo.net free-deals.faith
geile-lelly.eu free-fb-traffic.com
ghazel.ru ge0ip.com
gk-atlant.info ge0ip.net
gorodservis.ru gelezki.com
gox.com.ua girls-ufa.ru
gribokstop.com gratuitbaise.com
handicapbathtubarea.com handicapbathtubarea.com
handicapvansarea.com hem.passagen.se
hausfrauensex18.com herehloadibs.cf
hawaiielectriclight.com hermesbirkinhandbagoutlets.com
histats.com homegardenlova.com
hledejvshopech.cz hotblog.top
homik.pw hotcore.info
hoztorg-opt.ru hut1.ru
ideashome.id iamsport.org
iframe-toloka.com ideawheel.com
ilovevitaly.com ideoworld.org
infodocsportal.com impotentik.com
instabid.tech infowarcraft.ru
intellego.info
isitpaleo.info
istripper.com istripper.com
jav-fetish.com iwantmyfreecash.com
jikoman.info jav-fetish.site
javlibrary.cc
javspace.net
jimmychoosale.online jimmychoosale.online
jyrxd.com joyceblog.top
kerei.ru kareliatobacco.ru
ketoanhanoi.info kartiniresto.com
keyhantercume.com kashubadesign.ru
kihi.gdn kazka.ru
kiinomaniak.pl kino-rf.ru
kinogonew.ru
kiskinhouse.com
kliksaya.com
koopilka.com koopilka.com
koronirealestate.gr
kotaku.com kotaku.com
ldrtrack.com kovrenok.ru
lexiangwan.com ku6.com
lisque.batcave.net kumuk.info
littlecity.ch kw21.org
live-sexcam.tk labplus.ru
lolnex.us lakomka.com.ua
lonely-mature.com lenvred.org
mafa-free.com lesbian.xyz
magazintiande.ru letolove.ru
mbiologi.ru lider-zhaluzi.kiev.ua
megagrabber.ru lonerangergames.com
methodsmarketing.com magazin-pics.ru
mexicotravelnet.com magento-crew.net
millionare.com mainhp.net
misterjtbarbers.com master-muznachas.ru
mobot.site matrixalchemy.com
mobsfun.net medicineseasybuy.com
mozello.ru meetlocalchicks.com
mrpornogratis.xxx mobplayer.ru
mxgetcode.com mobstarr.com
mybackgroundlandscape.blogspot.com moi-glazki.ru
namenectar.com moje-recenze.cz
narkologiya-peterburg.ru monetizer.com-01.site
natali-forex.com mouselink.co
nodding-passion.tk moz.com
nzfilecloud.weebly.com muz-shoes.ru
obiavo.by mwtpludn.review
obiavo.ru mydirtyhobby.com
ohmyrings.com mydoctorok.ru
orion-v.com mysex21.com
palvira.com.ua narkologiya-belgorod.ru
patol01.pw naturalshair.site
piccshare.com new7ob.com
plaff-go.ru obnal.org
popugaychiki.com of-ireland.info
pornotubexxx.name ofanda.com
pospr.waw.pl okuos.com
pozdrawleniya.ru omoikiri-japan.ru
prlog.ru onetravelguides.com
promalp-universal.ru onstrapon.purplesphere.in
quelle.ru openfrost.com
quickbuck.com oynat.info
rapidgator-porn.ga page2rss.com
registrationdomainsite.com pandroid.co
reimageplus.com partners-ship.pro
remmling.de phelissota.xyz
remorcicomerciale.ro poisk-zakona.ru
rixpix.ru popunder.ru
rogervivierforsale.com porndl.org
rubanners.com porndroids.com
s-forum.biz pornokajf.com
s-iwantyou.com pornoklad.net
sarf3omlat.com pornozhara.com
searchaddis.com projefrio.com.br
see-your-website-here.com prokotov.com
seorankinglinks.us pshare.biz
sexpornotales.com qld10000.net
sexs-foto.top quality-traffic.com
sfd-chess.ru queerspace.com
shopfishing.com.ua quick-seeker.com
sigmund-freud.co.uk raavidesigns.com
siteaero.com rebelmouse.com
sitechecker.pro remontvsamare.su
siteimprove.com resant.ru
sitiz.club rimedia.org
roll123.com
rosbalt.com.ua
rusexy.xyz
sa-rewards.co.za
scanner-jess.top
searchtooknow-a.akamaihd.net
sel-hoz.com
serving.adbetclickin.pink
sexkontakteao.info
sexpornotales.net
sexvporno.ru
sharebutton.net
shopvilleroyboch.com.ua
signx.info
site3.free-share-buttons.com
sitevaluation.com
sitopreferito.it
sky-mine.ru sky-mine.ru
skytraf.xyz social-s-hhh.xyz
slavia.info sockshares.tv
soaksoak.ru softwaretrend.net
space4updating.win solmarket.by
stats-public.grammarly.io soserfis.com
stretchmate.net stop-zavisimost.com
stroiminsk.com stromerrealty.com
studiofmp.com talant-factory.ru
sundrugstore.com thaisamkok.com
superstarfloraluk.com the-usa-games.blogspot.com
survival.betteroffers.review tizanidine4mgprice.blogspot.com
technopellet.gr tizanidinehcl4mgisitanarcotic.blogspot.com
teenbbw.yopoint.in tizanidinehclsideeffects.blogspot.com
telefonsexkostenlos.tk tizanidineingredients.blogspot.com
theallgirlarcade.com tizanidinestreetprice.blogspot.com
theendivechronicles.com tizanidinevssoma.blogspot.com
thegamerznetwork.com tourismvictoria.com
theplacetoupdating.pw tv-spoty.info
theporndude.com ultimateclassicrock.com
thesmartsearch.net v720hd.ru
tizanidinedosageforsleep.blogspot.com viberdownload10.com
tizanidineonline.blogspot.com videochaty.ru
top10-way.com vzlomtw.com
topanasex.com watchmyfb.pl
topappspro.com waysbetter.cn
topflownews.com webalan.ru
topmira.com weboptimizes.com
tovaroboom.vast.ru weburlopener.com
trafficnetzwerk.de westsextube.com
traxdom.ru word-vorlagen.net
trkur.com worldtraveler.world
twincitiescarservice.com wrz0iuebwhp5fg.freeddns.com
ultimatesetnewfreeallsoftupgradesystems.pw www.bookmaker-bets.com
ultramart.biz x-diesel.com
umaseh.com x69ty.ru
umg-stroy.ru xgftnlrt.bloger.index.hr
url-img.link xn----8sblgmbj1a1bk8l.xn----161-4vemb6cjl7anbaea3afninj.xn--p1ai
vacuumcleanerguru.com xn----ctbbcjd3dbsehgi.xn--p1ai
vbtracker.net xn----itbeirbjbi7bc6bh2d.xn--p1ai
vedomstvo.net xn--80aafb2a.xn--p1ai
versaut.xxx-cam.webcam xn--80ahvj9e.xn--p1ai
vesnatehno.com xn--e1aggki3c.xn--80adxhks
viel.su yginekologa.com
vipsiterip.org yuarra.pluto.ro
wdfdocando.com yun56.co
webcamtalk.net zajm-pod-zalog-nedvizhimosti.ru
webradiology.ru zeroredirect2.com
weclipart.com zetmaster.ru
wedding0venues.tk zryydi.com
wesharepics.info zscaler.net
whereverdesperate.gq zygophyceous.womanstars.site
wholesalecheapjerseysfree.com
winner7777.net
wladimirpayen.com
xn--80ajbshivpvn2i.xn--p1ai
xn--h1aakne2ba.xn--p1ai
xtube.com
yourads.website
yurgorod.ru
z-master.ru
zeikopay.com
zigarettenonlinekaufen1.bloog.pl

171
dev-tools/test_units/ratelimittest-beta.txt
View file

@ -8,6 +8,93 @@
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html>ml>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html><html> </html><html>
<head><title>503 Service Temporarily Unavailable</title></head> <head><title>503 Service Temporarily Unavailable</title></head>
<body> <body>
@ -407,90 +494,6 @@
<hr><center>nginx/1.18.0 (Ubuntu)</center> <hr><center>nginx/1.18.0 (Ubuntu)</center>
</body> </body>
</html> </html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<!DOCTYPE html> <!DOCTYPE html>
<html> <html>
<head> <head>

125
dev-tools/test_units/ratelimittest-master.txt
View file

@ -8,65 +8,6 @@
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html>ml>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html><html> </html><html>
<head><title>503 Service Temporarily Unavailable</title></head> <head><title>503 Service Temporarily Unavailable</title></head>
<body> <body>
@ -494,6 +435,62 @@
<hr><center>nginx/1.18.0 (Ubuntu)</center> <hr><center>nginx/1.18.0 (Ubuntu)</center>
</body> </body>
</html> </html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<!DOCTYPE html> <!DOCTYPE html>
<html> <html>
<head> <head>
@ -584,4 +581,14 @@
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html> </html>

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.12 0; 10.1.0.18 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.12.3510 ### Version: V4.2022.12.3511
### Updated: Thu Dec 8 10:14:14 UTC 2022 ### Updated: Thu Dec 8 22:04:01 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.12.3510 ### Version: V4.2022.12.3511
### Updated: Thu Dec 8 10:14:14 UTC 2022 ### Updated: Thu Dec 8 22:04:01 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##