vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-04 19:50:17 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2023.02.3575 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2023-02-11 22:07:11 +00:00
parent 8e4fdd8ceb
commit 1f2b194fa5
47 changed files with 136780 additions and 136773 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2023.02.3574 #### Version: V4.2023.02.3575
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2023.02.3574 #### Version: V4.2023.02.3575
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -14,7 +14,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2023.02.3574 #### Version: V4.2023.02.3575
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

16928
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2023.02.3574 #### Version: V4.2023.02.3575
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

16932
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

16932
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

16932
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

16932
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.36 1; 10.1.0.114 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.36 0; 10.1.0.114 0;
127.0.0.1 0; 127.0.0.1 0;

16932
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.36 1; 10.1.0.114 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.36 0; 10.1.0.114 0;
127.0.0.1 0; 127.0.0.1 0;

16932
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.36 1; 10.1.0.114 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.36 0; 10.1.0.114 0;
127.0.0.1 0; 127.0.0.1 0;

16932
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
3574 3575

16932
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

16932
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
40.84.170.1 0; 172.177.150.113 0;

16932
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.36 1; 10.1.0.114 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.36 0; 10.1.0.114 0;
127.0.0.1 0; 127.0.0.1 0;

16932
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.36 1; 10.1.0.114 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.36 0; 10.1.0.114 0;
127.0.0.1 0; 127.0.0.1 0;

16932
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.36 1; 10.1.0.114 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.36 0; 10.1.0.114 0;
127.0.0.1 0; 127.0.0.1 0;

16932
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
40.84.170.1 0; 172.177.150.113 0;

16932
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
40.84.170.1 0; 172.177.150.113 0;

16932
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.36 1; 10.1.0.114 1;
127.0.0.1 1; 127.0.0.1 1;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
Calculon Dragonfly
ChinaClaw Heritrix
JetCar Lightspeedsystems
LexiBot MQQBrowser
Lipperhey RebelMouse
Majestic12 Scanbot
RankActiveLinkBot Sitevigil
SemanticJuice Sociscraper
Xenu Web Sauger
sogouspider WebFuck

284
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
360Spider 360Spider
80legs 404checker
ALittle Client 404enemy
ASPSeek ADmantX
Abonti Abonti
Aboundexbot Aboundex
Acunetix Acunetix
AhrefsBot AfD-Verbotsverfahren
Aipbot AiHitBot
Alexibot
Alligator Alligator
AlphaBot Anarchy99
Ankit
Anthill Anthill
Aspiegel
Asterias Asterias
Atomseobot Attach
BacklinkCrawler Backlink-Ceck
Badass Badass
Bandit BatchFTP
Bitacle BetaBot
Blackboard Black Hole
Blow Blow
Boardreader BotALot
Buck Brandprotect
BuiltBotTough Buddy
BunnySlippers BuiltWith
BuzzSumo BuzzSumo
CODE87
CSHttp
Calculon Calculon
CazoodleBot Cloud mapping
CherryPicker
Chlooe
Cliqzbot
Cocolyzebot Cocolyzebot
Copier Cogentbot
Collector
CopyRightCheck CopyRightCheck
CyotekWebCopy Copyscape
DSearch Cosmos
DTS Agent CrazyWebCrawler
DataCha0s Crescent
Devil DIIbot
Demon
Deusu
Digincore Digincore
Disco
Dispatch
DittoSpyder DittoSpyder
DnBCrawler-Analytics
DnyzBot
DomCopBot DomCopBot
DomainAppender Download Wonder
DomainCrawler
DomainSigmaCrawler
ECCP/1.0 ECCP/1.0
EasyDL EMail Wolf
Ecxi
Exabot Exabot
Extractor Express WebPictures
EyeNetIE
Ezooms
FDM
Fimap Fimap
Firefox/7.0
FlashGet FlashGet
Foobot Foobot
Freeuploader Freeuploader
FrontPage
FyberSpider FyberSpider
G-i-g-a-b-o-t
GermCrawler GermCrawler
GetRight
GetWeb
Gigabot Gigabot
Go-Ahead-Got-It Go!Zilla
GoZilla GoZilla
GrapeFX GrapeshotCrawler
GridBot HTMLparser
HMView
HaosouSpider
Harvest
Havij
HybridBot HybridBot
IDBot
IRLbot
Iblog Iblog
Id-search Id-search
Image Fetch Image Fetch
InfoNaviRobot InterGET
Internet Ninja
InternetSeer InternetSeer
Iria JOC Web Spider
IstellaBot
Jbrofuzz Jbrofuzz
JikeSpider
JustView JustView
Kenjin Spider
Keyword Density Keyword Density
Kinza LNSpiderguy
Lanshanbot
LeechFTP LeechFTP
LibWeb LeechGet
LieBaoFast Libwhisker
LinkScan LinkScan
Linkbot Linkbot
LinkextractorPro LinkextractorPro
LinkpadBot LinqiaMetadataDownloaderBot
LinqiaRSSBot LinqiaRSSBot
Litemage_walker LinqiaScrapeBot
Lmspider Lipperhey
Lipperhey Spider
MIIxpc
MJ12bot
MQQBrowser MQQBrowser
MSFrontPage MSIECrawler
Mag-Net MTRobot
Mail.RU_Bot Majestic SEO
Majestic-SEO Majestic12
MarkMonitor Mass Downloader
MarkWatch
MauiBot MauiBot
Mb2345Browser
MeanPath Bot MeanPath Bot
Meanpathbot Meanpathbot
MegaIndex.ru MegaIndex.ru
MicroMessenger MicroMessenger
Microsoft Data Access Minefield
Microsoft URL Control
Mister PiX Mister PiX
Mojeek
Morfeus Fucking Scanner
Mr.4x3
Musobot
NICErsPRO NICErsPRO
Nameprotect NearSite
Nessus Needle
NetAnts NetAnts
NetLyzer
NetZIP NetZIP
NextGenSearchBot Netcraft
Nibbler Nikto
Nimbostratus Nimbostratus
Ninja OrangeBot
Nmap
Nuclei
Nutch
OpenVAS
Openvas
OrangeSpider
OutfoxBot OutfoxBot
PECL::HTTP POE-Component-Client-HTTP
PHPCrawl Page Analyzer
PageGrabber
PageScorer
PageThing.com
Pandalytics Pandalytics
Panscient Panscient
Papa Foto Papa Foto
Pavuk Pavuk
Picscout PeoplePal
Petalbot
Pi-Monster
Picsearch Picsearch
PictureFinder PictureFinder
Piepmatz Piepmatz
Pimonster
Pockey
ProWebWalker ProWebWalker
Probethenet Probethenet
Pu_iN
PyCurl
QueryN Metasearch
Quick-Crawler Quick-Crawler
RSSingBot
RankActive RankActive
RankActiveLinkBot RankActiveLinkBot
RankingBot
RankingBot2 RankingBot2
Re-re
RealDownload RealDownload
Reaper Reaper
RebelMouse RebelMouse
Recorder
RedesScrapy RedesScrapy
Rogerbot Ripper
SISTRIX RocketCrawler
SalesIntelligent SBIder
SEOkicks
SEOkicks-Robot
SEOlyticsCrawler
ScanAlert
Scanbot Scanbot
Screaming Scrapy
ScreenerBot SemanticJuice
ScrepyBot Semrush
Seekport SemrushBot
SeoSiteCheckup
Shodan Shodan
Siphon Siphon
SiteCheckerBotCrawler
SiteLockSpider SiteLockSpider
SiteSnagger SiteSnagger
Sitebeam Sitevigil
Snapbot SlySearch
SocialRankIOBot Snoopy
Sociscraper Sociscraper
Sosospider
Sottopop Sottopop
Spammen SpaceBison
Sucker Spanner
Spinn3r
SputnikBot
Sqlmap
Sqworm
Stripper
Sucuri Sucuri
SuperBot
SuperHTTP SuperHTTP
Surfbot SurveyBot
Suzuran T0PHackTeam
T8Abot
Teleport
Telesphoreo Telesphoreo
Toweyabot TheNomad
TightTwatBot
Tracemyfile Tracemyfile
Trendiction True_Robot
Trendictionbot TwengaBot
Turingos Typhoeus
URLy Warning
URLy.Warning URLy.Warning
VB Project UnisterBot
VeriCiteCrawler VCI
VidibleScraper Vagabondo
Virusdie
VoidEYE VoidEYE
Voil WWW-Collector-E
Voltron WWWOFFLE
Web Enhancer Wallpapers
WeSEE
Web Fetch
Web Pix
Web Sauger Web Sauger
WebAuto
WebBandit
WebCollage WebCollage
WebEnhancer WebEnhancer
WebGo IS WebGo IS
WebImageCollector
WebLeacher
WebReaper WebReaper
WebSauger
WebStripper WebStripper
WebWhacker WebSucker
WebZIP WebZIP
Webshag Webalta
WebmasterWorldForumBot
Website Quester Website Quester
WebsiteQuester WebsiteQuester
Whack Whack
WinHTTrack Whacker
Wprecon Wprecon
Zauba Xaldon WebSpider
Xenu
ZumBot
ZyBorg
adscanner adscanner
autoemailspider arquivo-web-crawler
com.plumanalytics arquivo.pt
crawler.feedback backlink-check
crawler4j crawler4j
dataforseo.com
evc-batch
facebookscraper facebookscraper
gopher internetVista monitor
instabid
isitwp.com isitwp.com
linkdexbot
lwp-request lwp-request
lwp-trivial
magpie-crawler magpie-crawler
meanpathbot
muhstik-scan muhstik-scan
oBot page scorer
pcBrowser
plumanalytics plumanalytics
polaris version
ripz ripz
satoristudio.net
scalaj-http scalaj-http
scan.lol scan.lol
seobility
seocompany.store seocompany.store
seoscanners
seostar
sitechecker.pro sitechecker.pro
siteripz
spyfu spyfu
ubermetrics-technologies.com trendiction.com
webpros.com webpros.com
x09Mozilla
x22Mozilla x22Mozilla
xpymep1.exe xpymep1.exe
zauba.io
zgrab

308
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
360Spider
404checker
80legs
ADmantX
AIBOT
ASPSeek
Abonti Abonti
Aboundex AfD-Verbotsverfahren
Aboundexbot
Acunetix
AhrefsBot AhrefsBot
AiHitBot Anarchie
Aipbot
AlphaBot
Anarchy
Anarchy99 Anarchy99
Anthill Anthill
Apexoo Apexoo
Aspiegel Aspiegel
AwarioRssBot Atomseobot
Attach
BBBike
BLEXBot BLEXBot
BackDoorBot
BacklinkCrawler BacklinkCrawler
Barkrowler
BatchFTP BatchFTP
BetaBot Battleztar Bazinga
Bigfoot Blackboard
Blow Blow
BlowFish BlowFish
Bolt Boardreader
BotALot Buck
BuiltBotTough BuiltBotTough
BunnySlippers
CATExplorador
CCBot CCBot
CODE87 CODE87
Chlooe CazoodleBot
Cliqzbot CheeseBot
Cloud mapping ChinaClaw
Cocolyzebot
Cogentbot Cogentbot
Cosmos Collector
Crawling at Home Project CrazyWebCrawler
Crescent Crescent
CrunchBot
Curious Curious
DTS Agent
Demon Demon
Digincore Digincore
DigitalPebble
Discoverybot Discoverybot
Dispatch
DnBCrawler-Analytics
DomCopBot
DomainAppender
DomainCrawler DomainCrawler
Drip DomainSigmaCrawler
DomainStatsBot
Domains Project
EMail Siphon EMail Siphon
Ebingbong
Ecxi Ecxi
EirGrabber Exabot
EroCrawler Express WebPictures
Evil Ezooms
ExtractorPro FHscan
Fimap
Firefox/7.0 Firefox/7.0
FlashGet
Flunky Flunky
Foobot Foobot
Fuzz Fuzz
FyberSpider
GT::WWW GT::WWW
Genieo Genieo
GetRight
GetWeb GetWeb
Getintent Gigabot
GoZilla Go!Zilla
Gotit Gotit
GrabNet
Grabber Grabber
Grafula
GridBot
HEADMasterSEO HEADMasterSEO
HTMLparser
HTTP::Lite
HTTrack
Haansoft Haansoft
HaosouSpider Harvest
Heritrix Humanlinks
Hloader
HybridBot HybridBot
IDBTE4M IndeedBot
IRLbot InfoTekies
Iblog Internet Ninja
Image Fetch Iria
Image Sucker IstellaBot
Indy Library JOC Web Spider
InterGET Jbrofuzz
InternetSeer JennyBot
Joomla Joomla
JustView JustView
Kenjin Spider Kenjin Spider
Keybot Translation-Search-Machine LNSpiderguy
Keyword Density Larbin
Kinza
Lanshanbot
Leap
Lftp Lftp
LieBaoFast Lightspeedsystems
LinksManager Likse
LinqiaRSSBot LinkWalker
Lipperhey Linkbot
MIIxpc LinkpadBot
Lipperhey Spider
Ltx71
MFC_Tear_Sample
MJ12bot MJ12bot
MSFrontPage MTRobot
MSIECrawler
Mag-Net Mag-Net
Magnet Magnet
Majestic SEO Mail.RU_Bot
Majestic12 Majestic12
MarkWatch
Masscan Masscan
Meanpathbot MauiBot
Metauri Mediatoolkitbot
Microsoft Data Access
Moblie Safari
Mojeek
Mozlila Mozlila
NICErsPRO NICErsPRO
NPbot
Nameprotect
NearSite NearSite
Nessus
Net Vampire Net Vampire
NetAnts NetMechanic
NetLyzer NetSpider
NetZIP NetZIP
Netcraft Niki-bot
Nibbler
NimbleCrawler NimbleCrawler
Nmap Nimbostratus
Ninja
Nuclei
Offline Explorer
OnCrawl OnCrawl
Openfind OpenLinkProfiler
Openvas Openvas
OrangeBot OrangeBot
OutclicksBot
OutfoxBot OutfoxBot
PECL::HTTP PECL::HTTP
PHPCrawl POE-Component-Client-HTTP
Page Analyzer Page Analyzer
PageAnalyzer
PageGrabber PageGrabber
PageScorer PageThing.com
Pandalytics Pandalytics
Pavuk Pavuk
PeoplePal PeoplePal
Pi-Monster
Picscout Picscout
PleaseCrawl Piepmatz
Pockey Pockey
Psbot Psbot
Pu_iN
Pump
RankActive
RankFlex RankFlex
Rankivabot
RankurBot
Re-re
ReGet ReGet
Recorder RepoMonkey
RedesScrapy Rogerbot
SBIder SEOkicks-Robot
SEOprofiler
SalesIntelligent
ScanAlert ScanAlert
ScoutJet Scanbot
Semrush Scrapy
SemrushBot ScreenerBot
SeobilityBot ScrepyBot
Seomoz SearchmetricsBot
Shodan Seekport
Siphon SemanticJuice
SiteExplorer Site Sucker
SiteSnagger SiteLockSpider
SiteSucker Sitevigil
Siteimprove Snake
SlySearch
SmartDownload
Snapbot Snapbot
Sociscraper Sociscraper
Sosospider Sogou web spider
SpaceBison
Spammen Spammen
SpankBot
Spinn3r
SputnikBot SputnikBot
Sqworm Sqlmap
Steeler
Stripper
Sucker
Sucuri Sucuri
Surfbot Surfbot
SurveyBot SurveyBot
Suzuran Swiftbot
Szukacz Teleport
T0PHackTeam
T8Abot
TeleportPro TeleportPro
Telesoft Telesoft
Telesphoreo Telesphorep
The Intraformant The Intraformant
TightTwatBot Toata
Toweyabot Toweyabot
Turingos Tracemyfile
TurnitinBot True_Robot
Twice TwengaBot
Typhoeus Typhoeus
URLy.Warning UnisterBot
Upflow Vacuum
Vagabondo VidibleScraper
VelenPublicWebCrawler VoidEYE
WASALive-Bot WBSearchBot
WEBDAV WISENutbot
WPScan WPScan
WWW-Collector-E WWW-Collector-E
WWW::Mechanize WWW-Mechanize
Wallpapers
Wallpapers/3.0
WallpapersHD WallpapersHD
WeSEE
Web Auto
Web Enhancer Web Enhancer
Web Pix Web Fetch
WebCopier Web Sucker
WebCollage
WebEnhancer WebEnhancer
WebFetch
WebFuck WebFuck
WebImageCollector WebPix
WebReaper
WebSauger
WebStripper
WebSucker
WebWhacker WebWhacker
Webalta WebsiteExtractor
Webshag WinHTTrack
Whacker WiseGuys Robot
Whatweb Xaldon WebSpider
Widow Zade
Wprecon Zauba
Zeus Zeus
Zitebot
ZmEu ZmEu
ZoomBot arquivo-web-crawler
ZumBot arquivo.pt
archive.org_bot autoemailspider
coccocbot backlink-check
cognitiveseo clark-crawler
crawler4j crawler4j
eCatch dataforseo.com
facebookscraper
gopher
heritrix
instabid instabid
magpie-crawler isitwp.com
netEstate NE Crawler iubenda-radar
oBot linkdexbot
lwp-request
lwp-trivial
mediawords
pcBrowser pcBrowser
plumanalytics plumanalytics
polaris version
probe-image-size probe-image-size
satoristudio.net s1z.ru
scan.lol scalaj-http
seobility seocompany.store
seostar
serpstatbot serpstatbot
sitechecker.pro sexsearcher
sogouspider sogouspider
sp_auditbot tAkeOut
spyfu
trendiction.com
voyagerx.com
webgains-bot webgains-bot
webmeup-crawler x09Mozilla
webpros.com xpymep1.exe
webprosbot
zauba.io zauba.io
zgrab

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
benchmarkcommunications.co.uk 1stat.ru
intermesh.net buchananshardware.com
mebeldekor.com.ua counterbot.com
prostitutki-belgoroda.org fable.in.ua
rent2spb.ru gsasearchengineranker.site
scanner-irvin.top lostaruban.com
searchimpression.com sispe.com.br
support.nopeas.sk tattooreligion.ru
yellocloud.be tizanidineusedfor.blogspot.com
zytpirwai.net tour-line.net

948
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
007angels.com
00author.com
01apple.com 01apple.com
0912701309f8ce.com 1hwy.com
1008.su 1webmaster.ml
13tabs.com 21h2o.com
178evakuator178.ru 2x2fan.ru
1stat.ru
40cg.com
4kpics.rocks
4kplayer.pl 4kplayer.pl
4ur.click 4webmasters.org
5000-cotydzien.com 5kstore.com
98oi.ru 5ws.dating-app.ru
aa08daf7e13b6345e09e92f771507fa5f4.com 6hopping.com
aa9bd78f328a6a41279d0fad0a88df1901.com 83net.jp
absolute-s.ru a.frcls.fr
actices.com aa81bf391151884adfa3dd677e41f94be1.com
addtoadd.men abovetherivernc.com
adexprts.com actionnooz.com
advancedsoftwaresupport.com adsland.men
adsloads.com
adultfullhd.com
adultwebhosting.info
adzpower.com
aerogo.com
agreda.pluto.ro
airmaxshoes-2016.com airmaxshoes-2016.com
ald2014.org all4wap.ru
allforminecraft.ru allblogroll.com
allnews.md allcredits.su
alyeskaresort.com allsilver925.co.il
amt-k.ru alphahoverboards.com
android-vsem.org alphavisions.net
angry-fermi-7633.arukascloud.io amyfoxfitness.com
anime.dougasouko.com android4fun.org
animebox.com.ua animalrank.com
apessay.com apiallgeniusinfo-a.akamaihd.net
apiadanaknet-a.akamaihd.net apibatbrowsecom-a.akamaihd.net
apibetweenlinesn-a.akamaihd.net apibetweenlinesn-a.akamaihd.net
apiportalmorecom-a.akamaihd.net apiportalmorecom-a.akamaihd.net
appleid-verification.com arenanews.com.ua
arendovalka.xyz
arkkivoltti.net
arquapetrarca.info arquapetrarca.info
artdeko.info artavenuegardenstudios.com
artdestshop.eu atdedinotuho.tk
arvut.org audiofree.ru
asmxsatadriverin.aircus.com autodo.info
asscenihotosidea.blogspot.co.za autotrends.today
autoblogger24.info aversis.net
avtoarenda.by azartniy-bonus.com
azartclub.org azazu.ru
azarttoto.com azlex.uz
balkanfarma.ru babespcs.com
backgroundpictures.net
baixar-musicas-gratis.com
balla-boo.se balla-boo.se
bankmib.ru bbtec.net
bannerbank.ru beachtoday.ru
bannertesting.com
batanga.net
battleforupdating.site
bedandbreakfast.com bedandbreakfast.com
beget.tech belsetirehafi.tk
berlininsl.com berrymall.ru
bestbuy.ca best-mam.ru
bestcurs.org best-seo-software.xyz
bestpriceninja.com besthomemadepornsites.com
blackplanet.com bestmarriages.com
blobar.org bestofferswalkmydogouteveryday.gq
blogporn.in beyan.host.sk
bluerobot.info bezcmexa.ru
bnt-team.com bgviagrachrx.com
bonzbuddy.com bio-japan.net
bio-optomarket.ru
biteg.xyz
blacktwhite.com
boleznikogi.com
bookhome.info bookhome.info
boostmyppc.com braindaily.xyz
brainsandeggs.blogspot.com
brainxs.us brainxs.us
brainzpod.win
break-the-chains.com
breastaugmentation.co.za
brewdom.ru brewdom.ru
buyfriend.ru brianhenry.co
cakemediahq.com.au briomotor.co
camdenmemorials.com brokergid.ru
candelluxsklep.pl browsepulse-a.akamaihd.net
canvas.gloverid.site budpost.com.ua
cgi2.nintendo.co.jp bupropion-sr-150-mg.us
checkhit.com business-suggested.tk
cherubinimobili.it buyhoverboard.com
chimiver.info calcularpagerank.com
cindymatches.com callcafe.info
cinemaenergy-hd.ru candlehandmade.com
cjs.com.ru carfax.com.ua
cleanersoft.com carsdined.org
clmforexeu.com carsplate.com
carstrends2015.com
casite-513049.cloudaccess.net
ccjp.eu
cenoval.ru
cfacarrosserie74.com
chatroulette.video
chatroulette.world
cheapestjerseysonwholesale.com
chidporn.com
chinaelitecheapjerseys.com
chocolateslim-original.com
cialgenisrx.com
cialiswithoutadoctor.net
circlesl.com
clash-clans.ru
clickhype.com
clksite.com
club-musics.ru club-musics.ru
coaching-netz.info coldfilm.ru
comeondog.info compliance-brian.top
compliance-alex.xyz compliance-george.xyz
compliance-donald.xyz compliance-julia.top
compliance-fred.top compliance-mary.top
compliance-irvin.xyz compliance-viktor.top
compliance-jack.top connectingsingles.com
compliance-julianna.top coolingoods.com
compliance-olga.top cottageofgrace.com
coolbar.pro counter.yadro.ru
coolyarddecorations.com country-chic.ru
cornomase.win crafthubs.com
cosmetic.donna7753191.ru custodieva.ru
costablue.xyz custom-electric-guitar.com
countercrazy.com dafatiri.com
cracksplanet.com dame-ns.kz
credit-online.ws darkages.info
cscwtalkto.site darodar.com
csgo4.win dbmkfhqk.bloger.index.hr
cubs-jerseys.us demian.kz
d-black.bz dengi-pod-zalog-nedvizhimosti.ru
dailyrank.net design-ideas.info
data1.scopich.com detective01.ru
ddospanel.com dfiles.me
deda-moroza-zakaz.ru digest-project.ru
delfin-aqua.com.ua
deluxedumps.com
den-noch24.ru
deniven.1bb.ru
deutschland123.de
diffbot.com
digitalfaq.com
dikqlyremy.info
dinosaurus.site
discountbarbour.online discountbarbour.online
divisioncore.com divku.ru
dogclothing.store docstoc.com
doktoronline.no domaincheck.io
dokumentalkino.net dostavimvdom.ru
domainanalyzing.xyz download-of-the-warez.blogspot.com
domaincrawler.com downloaddy.net
donna7753191.ru dpihatinh.gov.vn
dood.live drivotracker.com
dorratex.tn dvr.biz.ua
dostavka-v-ukrainu.ru dwomlink.info
dprtb.com ec-file.info
dptaughtme.com election.interferencer.ru
driving.kiev.ua elektrischezigarette2.onsugar.com
druzhininevgeniy63.blogspot.com elektrischezigarettekaufen2.cowblog.fr
earn-from-articles.com elektrozigaretten2.yn.lt
earncash.com.ua elidelcream.weebly.com
eduserver.net empis.magix.net
elektrischezigarette1.blog.pl en.home-task.com
elektrischezigaretten1.blogse.nl engines-usa.com
elektrozigarettekaufen2.blogse.nl erotikchat-24.com
eloconcream.blogspot.com escortslet.net
elstal.com.pl euromasterclass.ru
envaseslotusama.com exchanges-bet.com
erot.co exhibitionplus.eu
escortplius.com exonline.info
essayassist.com expertnaya-ocenka.ru
europeanwatches.ru f0815.de
exlarseva.webblog.es faithe.top
ezigarettekaufen2.blox.pl falllow.gq
ezigaretteshop.webs.com feorina.ru
f07.de fetroshok.ru
f1nder.org fickblock18.com
fable.in.ua filefilter.weebly.com
falopicm.pw filmetricsasia.com
fanoboi.com financepoints.eu
fanpagerobot.com findsexguide.com
fealq.com findthe.pet
feel-planet.com firstdrugmall.ru
ferrotodo.com flytourisme.org
fighrofacciufreesig.ga formulaf1results.blogspot.com
filesclub.net fotoxxxru.com
filmgo.ru fr.netlog.com
finuse.com frankofficial.ru
fishtauto.ru free-share-buttons.top
fitfloponline.store freecamdollars.com
forodvd.com frvo.alptandem.ru
free-share-buttons.blogspot.com fuck-paid-share-buttons.xyz
free-video-tool.com gamedayhouse.com
freevpn.space gameplexcity.com
fres-news.com games.kolossale.ru
fugarif.ga gearcraft.us
gabeshop.ru geileweiber.tk
galeon.com generousdeal-a.akamaihd.net
galeria-zdjec.com gkvector.ru
gambarkatabaru.com glall.ru
gameonasia.com gombita.info
gdcentre.ru googleseo.com.tr
ge0ip.com
get-seo-domain.com
getlamborghini.ga
getpopunder.com
girlporn.ru
gk170.ru
glopages.ru
gne8.com
googlefeud.com
googlemare.com
googst2.ru googst2.ru
gourcy.altervista.org gourcy.altervista.org
greatdealshop.com gpms.org.my
groupmoney.ru grand-chlen.ru
gsbs.com.ua greenidesign.co
guarrasdelporno.xxx gsasearchenginerankerdiscount.com
guod.me gsmlab.pl
gyffu.com gsmtlf.ru
hanwei.us guidefs.ru
happy.new.yeartwit.com handicapvantoday.com
hawaiisurf.com hao123.com
hd-filmy.net hchha.com
herokuapp.com healthcarestore.info
heygidday.biz hkladys.com
hollywoodactress.info homeandhealth.ru
homeart.space homemade.gq
homemature.net honyaku.yahoofs.jp
homik.pw hotxnights.info
hotenergy.ru houseofgaga.ru
hotgirlhdwallpaper.com humanorightswatch.org
howlongdoestizanidinestayinyoursystem.blogspot.com humbmosquina.tk
howmuchdoestizanidinecost.blogspot.com icaseclub.ru
howtowhitenteethfast.xyz imagerydatabase.com
huimin764128.com imk.com.ua
hystersister.com inclk.com
iblogpress.xyz indetiske.ya.ru
id-forex.com indo-export.ru
ie.57883.net infogame.name
iframe-toloka.com insurple.com
ikritikimou.gr investzalog.ru
imadedinner.net isotoner.com
imfamous.info isoveti.ru
imgarit.pw ispac.org
incomekey.net javcoast.com
inome.com.ua javxxx18.com
insomniagamingfestival.com jimmychoosale.online
instakink.com jjbabskoe.ru
interior-stickers.ru jmat.cn
internetartfair.com johnrobertsoninc.com
intimshop-fantasy.ru jovencitas.gratis
irkutsk.zrus.org jrcigars.com
iyasimasennka.com kazan.xrus.org
jo24news.com kazrent.com
joingames.org keki.info
journeydownthescale.info kino-fun.ru
jrpmakati.com kino2018.club
justkillingti.me klitimg.pw
justucalling32211123456789.tk klumba55.ru
kakadu-interior.com.ua kmd-pto.ru
kam-dom.ru knigonosha.net
kanimage.com kollesa.ru
keenoutlet.online
kerwinandcariza.com
kevblog.top
keywordteam.net
kino-rf.ru
kiprinform.com
kladrus.ru
kochanelli.com
konpax.com
koopilka.com
koptims.tiu.ru koptims.tiu.ru
krasnodar-avtolombards.ru kumuk.info
larutti.ru kursy-ege.ru
law-check-eight.xyz kutikomi.net
ldrtrack.com kvartir-remont.biz
kvartira-sutochno.com
labafydjxa.su
lalalove.ru
laptop-4-less.com
le-clos-des-alouettes.com
lerporn.info
letolove.ru
letsrepair.in letsrepair.in
liky.co.ua light.ifmo.ru
linkarena.com linkwithin.com
live-cam6.info liran-locks.com
livefixer.com littlesunraiser.com
livejasmin.com localflirtbuddies.com
livetsomudvekslingstudent.bloggersdelight.dk lollypopgaming.com
locksmith.jp lonerangergames.com
lomb.co lonfon.xyz
long-beach-air-conditioning.com lostaruban.com
lumb.co love-baby.cz
m-google.xyz lovi-moment.com.ua
lrac.info
lsp-awak-perikanan.com
m4ever.net
mactechinfo.info mactechinfo.info
makemoneyonline.com magicalfind-a.akamaihd.net
maglid.ru
makis.nu
manifestation.betteroffers.review
maslenka.kz
master-muznachas.ru master-muznachas.ru
mebeldekor.com.ua matchpal-a.akamaihd.net
mediaoffers.click mearns-tractors.co.uk
medmajor.ru medispainstitute.com.au
mere.host.sk mensandals.xyz
mesbuta.info metascephe.com
mindbox.co.za michaelkorsoutlet.store
minecraft-neo.ru mindeyegames.com
misswell.net mirmedinfo.ru
mixx.com
mjchamonix.org
mnogabukaff.net mnogabukaff.net
modenamebel.ru money-every-day.com
moesexy.com moonci.ru
monarhs.info most-kerch.org
monclerboots.xyz
monclerjacketsoutlet.pw
moneymaster.ru
moneytop.ru
monsterdivx.com
moroccosurfadventures.com
morpicert.pw
moscow-clining.ru
moscow.xrus.org
moviemail-online.co.uk moviemail-online.co.uk
mtmtv.info movpod.in
musicspire.online mp3films.ru
muznachas-service.ru msk-diplomat.com
myhealthcare.com musezone.ru
myxdate.info muycerdas.xxx
neodownload.webcam mwtpludn.review
netanalytics.xyz mydeathspace.com
newstraveller.ru mypets.by
nextbackgroundcheck.gq naperehresti.info
nhl17coinsforps3.gratisblog.biz narkologiya-belgorod.ru
ningessaybe.me narosty.com
nrv.co.za neobux-bg.info
o-dachnik.ru newhairstylesformen2014.com
obiavo.by newtechspb.ru
obsessionphrases.com ngps1.ru
odywpjtw.bloger.index.hr normalegal.ru
of-ireland.info notasprensa.info
offer.wpsecurity.website nufaq.com
okout.ru nvssf.com
onlineku.com o-o-11-o-o.com
onlineslotmaschine.com offergroup.info
onlyforemont.ru oivcvx.website
onlythegames.com okeinfo.online
osagonline.ru onblastblog.online
otbelivanie-zubov.com one.net.in
ownshop.cf onescreen.cc
pacificair.com online-podarki.com
pc-virus-d0l92j2.pw online7777.com
pertlocogasilk.tk openlibrary.org
photochki.com openstat.com
picscout.com optibuymac.com
picswe.com oren-cats.ru
picturesfrom.com orsonet.ru
pinkduck.ga ovirus.ru
pirateday.ru paccohichetoti.ml
pix24x7.com panchro.xyz
plaff-go.ru pandroid.co
platezhka.net partner-high.men
playboyfiles.xblog.in parvezmia.xyz
pobeiranie.pl pb-dv.ru
pogruztehnik.ru penisvergrotendepillennl.ovh
poiskzakona.ru pewit.pw
pokemongooo.ml photorepair.ru
popads.net pic-re.blogspot.com
pornobrazzers.biz pic2fly.com
pornoklad.ru placid-rounded-coast.glitch.me
pornoplen.com ploenjitmedia.azurewebsites.net
potolokelekor.ru popup.matchmaker.com
preg.marketingvici.com pornofiljmi.com
pregnant.guru pornoinn.com
printie.com portnoff.od.ua
privatefx.all4invest.info posible.net
produkto.net pospr.waw.pl
pronekut.com pro-poly.ru
pst2017.onlinewebshop.net profolan.pl
purplestats.com pxhdwsm.com
qwesa.ru py100.ru
qcstrtvt.bloger.index.hr
queerspace.com
ragecash.com
rarbg.to rarbg.to
rasteniya-vs-zombi.ru rating-bestcasino.com
ratemodels.net real-time-analytics.com
recipedays.com realmonte.net
recordpage-a.akamaihd.net realtytimes.com
redirlock.com redbottomheels.xyz
refads.pro regionshop.biz
registry-cleaner.net rentehno.ru
reklama-i-rabota.ru responsive-test.net
remont-ustanovka-tehniki.ru reversing.cc
renecaovilla.online rfserial.net
resellerclub.com rootandroid.org
riralmolamsaca.tk rossanasaavedra.net
robot-forex.biz ru-mediaget.ru
rocketchange.ru russia-tao.ru
rukino.org russkie-gorki.ru
running-line.ru sa-live.com
rus-teh.narod.ru sad-torg.com.ua
ruspdd.com sakhboard.ru
rusprostitute.com saletool.ru
rusvideos.su saltspray.ru
rvtv.ru sammyweaver.com
sack.net sanidumps.com
sammlungfotos.online saratov.xrus.org
saugatuck.com sarf3omlat.com
sbornik-zakonov.ru savefrom.com
sc-specialhost.com sbt-aqua.ru
scanner-alex.top
scanner-brian.top
scanner-irvin.top
scanner-jack.top
scanner-mark.top
scanner-viktor.top scanner-viktor.top
search.pch.com scanspyware.net
seeingmeerkat.com scenicmissouri.us
seeresultshub-a.akamaihd.net sdsjweb.com
sei80.com searchengineranker.email
sendearnings.com securityallianceservices.com
seojokes.net seminarygeorgia59.ga
seomarketings.online service.adtech.fr
sexsearch.com sexpornotales.com
sheerseo.com sexspornotub.com
shodanhq.com shmetall.com.ua
shohanb.com shtora66.ru
shtaketniki.ru site-speed-check.site
shymkent.xkaz.org sms2x2.ru
silverage.ru smsactivator.ru
silvercash.com snegozaderzhatel.ru
sitechecker.pro snow.nvr163.com
sizeplus.work social-s-iii.xyz
sklad-24.ru songplanet.ru
slim.sellany.ru soochi.co
slowmacfaster.trade spaceshipad.com
smartbalanceworld.com spidtest.space
snowplanes.com spravka-medosmotr.ru
social-fun.ru stariy-baku.com
socialseet.ru stockspmb.info
sockshare.net stopnarco.ru
sodexo.com
solicita.info
solitaire-game.ru
spacash.com
spb-plitka.ru
sstroy44.ru
stackthatbucks.com
standardchartered-forex.com
stop-zavisimost.com
stpolice.com stpolice.com
streamin.to strangeduckfilms.com
subj.ukr-lit.com studentguide.ru
sucsesofinspiration.com stuff-about-money.com
svensk-poesi.com sunflowerdrawingpaintings.blogspot.com
svtrd.com superinterstitial.com
tabletkinaodchudzanie.com.pl surffoundation.nl
tds-advert002.info suture.co
teastory.co tacbelarus.ru
tedxrj.com tarad.com
templates.radiodigital.co td-l-market.ru
terrafootwear.us thaisamkok.com
thebitcoincode.com the-trader.net
thecoolimages.net thedownloadfreeonlinegames.blogspot.com
thefarmergame.com thefds.net
thiegs.reco.ws theporndude.com
titangel-vietnam.com thetardistimes.ovh
thetoiletpaper.com
thin.me.pn
tiandeural.ru
timeallnews.ru
timecrimea.ru
titan-ads.life
tizanidinedruginteractions.blogspot.com tizanidinedruginteractions.blogspot.com
tizanidinehcl2mg.blogspot.com tizanidineorflexeril.blogspot.com
tizanidinehcl4mgtabinfo.blogspot.com tizanidineshowupondrugtest.blogspot.com
tizanidineusedfor.blogspot.com tizanidinestreetprice.blogspot.com
tooplay.com token-lab.org
toproadrunner5.info toloka.hurtom.com
torrents-tracker.com tootoo.to
top-l2.com
top10-online-games.com
tour-line.net
trackmedia101.com
trafficmonetize.org trafficmonetize.org
traffmonster.info traffictrade.life
tsstcorpcddvdwshbbdriverfb.aircus.com traffixer.com
tubeline.biz traffpartners.com
tubo360.com trk-4.net
turizmus.us truck-addzilla.life
u17795.netangels.ru truck-land.life
uginekologa.com trucri.me
ugogo.info tupper-posuda.ru
uhod-za-sobakoj.ru ua-company.ru
uhodzalijami.ru ucoz.ru
ukrtextbook.com underthesite.com
umityangin.net url-img.link
uptime-alpha.net velpanex.ru
uptime-gamma.net viagraneggrx.com
urzedowski.eu video--production.com
vabasa.inwtrade.com video-chat.cn
valkiria-tk.ru videochat.ph
vbtracker.net videochaty.ru
veerotech.com videtubs.pl
vekzdorov.ru vinsit.ru
vertaform.com vip-parfumeria.ru
viberdownload10.com vipsexfinders.com
video-hollywood.ru visa-pasport.ru
videochat.life vladimir.zrus.org
vip.51.la vodaodessa.com
visitcambridge.org vrotike.ru
vk-mus.ru web.cvut.cz
vkak.ru webextract.profound.net
vseigry.fun website-analyzer.info
wallpapersdesk.info wemarketing.se
wareseeker.com whatsappbot.flyland.ru
waycash.net whereiskentoday.com
wdrake.com wholesalecheapjerseysfree.com
webalan.ru worldmusicfests.com
website-datenbank.de www.souvenirua.com
website-stealer.nufaq.com x-lime.com
websiteexplorer.info x-musics.com
websitevaluebot.com xchat26.myfreecams.com
weburok.com xkaz.org
whatistizanidine2mg.blogspot.com xn----ctbbcjd3dbsehgi.xn--p1ai
wholesalejerseysgaa.com xn--80aaaks3bbhabgbigamdr2h.xn--p1ai
win-spy.com xn--80abgj3a5acid6ghs.top
x-true.info xn--e1afanlbnfckd7c3d.xn--p1ai
xn-----6kccaibs5cb8afhjrfmix2n.xn--p1ai xnxxandxvideos.com
xn----7sbaaabaei0cc8aj5bj0bncejx.xn--p1ai xrus.org
xn----8sbdbjgb1ap7a9c4czbh.xn--p1acf xxxmania.top
xn----9sbubg3ambdfl1j.xn--p1ai yeartwit.com
xn----itbeirbjbi7bc6bh2d.xn--p1ai yebocasino.co.za
xuki.us yubikk.info
xxxasianporn.net yugk.net
y8games-free.com za-fun-offer.com
yaoguangdj.com zahvat.ru
yes-com.com zaimite.ru
yoopsie.com zaloro.com
yoshkarola.zrus.org zeroredirect2.com
zeroredirect12.com zhorapankratov7.blogspot.com
zeroredirect7.com zocaparj.kz
zhongwenlink.com zoogdiesney.com
znakom.sibtest.ru zvooq.eu
zs2vm.top
zvuker.net

482
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
10bet.com 00go.com
4replicawatch.net 1314dh.com
5elementov.ru 1xbet4you.com
actulite.com 24x7-server-support.site
adidas.frwebs.fr 4inn.ru
agapovdg.ru abcdeg.xyz
ageofclones.com addray.pro
alif-ba-ta.com adpremium.org
allforminecraft.ru advertisingtag.net
alphacarolinas.com akita.kz
alphavisions.net allnews.md
alveris.ru
anal-acrobats.com anal-acrobats.com
analytics-ads.xyz
anniemation.com
anonymousfox.co
apibetweenlinesn-a.akamaihd.net
apiwoodensealcom-a.akamaihd.net apiwoodensealcom-a.akamaihd.net
asrvrep-a.akamaihd.net arenda-avtoprokat-krasnodar.ru
autonew.biz arquivo.pt
avtolombard-krasnodar.ru ascat.porn
banksrf.ru asrv-a.akamaihd.net
berdasovivan.ru asscenihotosidea.blogspot.com
best-businessman.ru atmagroup.ru
bestadbid.com audiofree.ru
bget.ru auto-zapchasti.org
biglistofwebsites.com avtovolop.ru
bin-brokers.com awency.com
bizfly.info azartmix.com
blog-hits.com bablonow.ru
blog.f00kclan.de banki76.ru
blue-square.biz beclean-nn.ru
bocoarchives.org bensbargains.net
bonky.biz bestmarriages.com
browsepulse-a.akamaihd.net bestmouthwash.club
brus-vsem.ru bestofferswalkmydogouteveryday.gq
bryansk.zrus.org big-boards.info
buron.pw blogs.rediff.com
bolezniorganov.ru
burn-fat.ga
businescoop.men
business-made-fun.com
buyfriend.ru
buypanicdisorderpill.com buypanicdisorderpill.com
buytizanidineonlinenoprescription.blogspot.com bwlx.prepedu.cn
capture-room.com bycontext.com
casinorewards.info canrioloadm.gq
cbox.ws canrole.com
cdncash.com cardul.ru
ceotrk.com cartierlove2u.xyz
cheapmoncler.pw ccjp.eu
clean-start.net chatroulette.online
cleanallvirus.com cheapjerseysa.com
compliance-alexa.top chorus.terakeet.com
compliance-andrew.xyz clickbank.net
compliance-george.xyz clipartnew.com
consorzioilmosaico.org cognitiveseo.com
continent-e.tv compliance-elena.top
cornomase.win compliance-irvin.top
crazyboost.pro coolwallpapers-hd.com
customcatchcan.com copypaste.traderzplanet.in
customchocolate.business-for-home.com cornerstone-countertops.com
dealitright.click counciltally.com
delayreferat.ru country-chic.ru
detskie-konstruktory.ru crackguru.tk
deutschehobbyhuren.net creditnation.ru
dev-seo.blog cscwtalkto.site
dmmspy.com czat.wp.pl
dms-sw.ru dailyfinancefix.com
dogsrun.net dairyindia.in
druzhininevgeniy63.blogspot.com design-lands.ru
e-kwiaciarz.pl detective01.ru
eachdayisagift.review dipstar.org
easyshoppermac.com e-poker-2005.com
ecxtracking.com earncash.com.ua
enge-fotzen.info earthmagic.info
essay-writing.work ecommerce-seo.com
eupornstar.info elektrozigaretten1.postbit.com
europages.com.ru exoneration-project.us
evogarage.com expolicenciaslatam.co
expertblog.info ezigarettekaufen1.hpage.com
ezigaretteshop2.mywapblog.com ezigarettekaufen2.yolasite.com
f00kclan.de ezigaretteshop.webs.com
fidelityfunding.com fashion-mk.net
figuringmoneyout.com filkhbr.com
flagcounter.me filmgo.ru
footballfarrago.com folowsite.com
forums.toucharcade.com forums.d2jsp.org
free-laptop-reward.com free411games.com
frequiry.com freejabs.com
fungirlsgames.net freevpn.space
funnymama.com fullfileaccess.com
fx-brokers-review.com gallery.rennlist.com
galaxys6manual.info galleryawesome.com
gateway.zscalerone.net gamesprite.me
gateway.zscalertwo.net gazobeton-p.com.ua
gcup.ru getpopunder.com
gdebestkupit.ru glasof.es
ge0ip.org glcomputers.ru
gktt.ru goldenggames.com
golfresa.lucania.se golfresa.lucania.se
graphics8.info goodhousekeeping.com
gratuitxblcodes.com heliko.no
greatdealshop.com hobbyhuren-datenbank.com
guarrasdelporno.xxx homeinns.com
hahashka.ru honyaku.yahoofs.jp
hd-film.pl host-tracker.com
healthcarestore.info hotcore.info
hetmanship.xyz hustoon.over-blog.com
heygidday.biz iamsport.org
hitmuzik.ru ideashome.id
hostsshop.ru
hotenergy.ru
hotkeys.com
iblogpress.xyz
imgata.com
incep.imagine-ex.co
indo-export.ru indo-export.ru
infektsii.com inmate-locator.us
inspiring-desperate.tk intermesh.net
internet-apteka.ru invivo.hu
investingclub.ru ipchicken.com
invitefashion.com iyasimasennka.com
itis4you.com kaac.ru
jav-fetish.com keki.info
jwcialislrt.com kirov.zrus.org
kaidalibor.de kit-opt.ru
ketrzyn.pl kovrenok.ru
keywordspay.com kuzinsp.ru
kino2018.club law-check-nine.xyz
kleine-titten.biz lemon-ade.site
klejonka.info linkbuddies.com
klitimg.pw lombia.com
ledis.top lsp-awak-perikanan.com
linkdebrideur.xyz m-google.xyz
live-sexcam.tk m.b00kmarks.com
mackeeper-center.club m1media.net
macrotek.ru magda-gadalka.ru
marblestyle.ru massage-info.nl
megavolt.net.ua megakino.net
metabar.ru meget.co.za
mikozstop.com michellblog.online
mini.7zap.com microsoftportal.net
mobplayer.net microstatic.pl
minecraft-neo.ru
minneapoliscopiers.com
mir-betting.ru
mirzonru.net
mistr-x.org
mobstarr.com mobstarr.com
moje-recenze.cz mturkcontent.com
mojpregled.com musicktab.com
mompussy.net musirc.com
monsterdivx.tv mustat.com
moomi-daeri.com myxdate.info
mostantikor.ru nalogovyykodeks.ru
mulberryoutletonlineeu.com notfastfood.ru
mycouponizemac.com novodigs.com
na-telefon.biz nowtorrents.com
nardulan.com nuit-artisanale.com
netfacet.net nzfilecloud.weebly.com
next-dentists.tk offergroup.info
nfljerseys.online okonich.com.ua
nisuturnetdgu.tk ooomeru.ru
obiavo.net paleohub.info
ofanda.com pastaleads.com
origin-my.ru pcboa.se
ourville.info phelissota.xyz
outrageousdeal-a.akamaihd.net photorepair.ru
panchro.xyz photosaga.info
perfection-pleasure.ru picturesify.com
picture-group.com pinwallpaper.top
pladform.ru piulatte.cz
poisk-zakona.ru pokemon-go-play.online
pooleroadmedicalcentre.co.uk pp-budpostach.com.ua
pornolook.net privacyassistant.net
pozdrawleniya.ru prizestohandle.club
priscilarodrigues.com.br projefrio.com.br
produkto.net pron.pro
profit-opportunity.com pufip.com
pronekut.com purplestats.com
pulseonclick.com reyel1985.webnode.fr
puserving.com
r-e-f-e-r-e-r.com
razleton.com
rcb101.ru
rebuildermedical.com
redhotfreebies.co.uk
refads.pro
robotixix.com
rocketchange.ru rocketchange.ru
russkie-gorki.ru salmonfishingsacramentoriver.com
rusvideos.su sanjosestartups.com
se-welding.ru sarf3omlat.com
service.adtech.us savingsslider-a.akamaihd.net
simul.co scanhub.ru
slkrm.ru scanner-nelson.top
sockshare.net scanspyware.net
soft-program.com scottbywater.com
soserfis.com securityallianceservices.com
spy-app.info shodanhq.com
stair.registrydomainservices.com shoppingjequiti.com.br
stauga.altervista.org snip.tw
store-rx.com special-porn.com
streha-metalko.si spyfu.com
styro.ru stackthatbucks.com
sudexpert66.ru statistici.ro
sugarkun.com stoki.ru
surintech.ac.th storehouse.ua
svbur.ru strangeduckfilms.com
tattomedia.com strigkaomsk.ru
tattoo33.ru studworks.org
tattooreligion.ru summerlinhomes411.info
tds-advert005.info supermodni.com.ua
tedy.su terraclicks.com
thegalerie.eu testingads.pro
thegameriders.com texbaza.by
thecoral.com.br
thepokertimer.com thepokertimer.com
tizanidineandgabapentin.blogspot.com time-japan.ru
tizanidinedruginteractions.blogspot.com titan-cloud.life
tizanidinehcl2mg.blogspot.com tizanidinenarcotic.blogspot.com
tizanidineingredients.blogspot.com tksn.ru
tn811.us topads.men
tnctrx.com torture.ml
tootoo.to tt-ipd.info
topflownews.com turkeyreport.tk
torrents-tracker.com turvgori.ru
tovaroboom.vast.ru twittruth.com
truemfilelj.gq twodollarshows.com
turizm.bz uchebavchehii.ru
ukrobstep.com ugogo.info
usiad.net ukkala.xyz
validccseller.com univerfiles.com
varikozdok.ru validdomain.xyz
valmetrundan.se
vchulkax.com vchulkax.com
venerologiya.com veopornogratis.xxx
viagra-soft.ru vepad.com
videtubs.pl vezuviy.su
vipromoffers.com viagroid.ru
vkak.ru videojam.tv
vzubah.com virus-respirators.com
wanker.us vkmusics.ru
warezkeeper.com vtcdns.com
web-analytics.date watchinf.com
whatsappbot.flyland.ru wedding-salon.net
wholesalecheapjerseysfree.com wedding0venues.tk
wordpresscore.com wejdz-tu.pl
worldmusicfests.com wineration.com
wstroika.ru womama.ru
wurr.voila.net worldtraveler.world
www.jbetting.com www.wohnkabinen-shop.de
xaylapdiendanang.com xn--80ahvj9e.xn--p1ai
xn--80aagddcgkbcqbad7amllnejg6dya.xn--p1ai xsion.net
xn--h1aakne2ba.xn--p1ai xtrafficplus.com
xnxx699.com xzlive.com
xxart.ru yadro.ru
xxx-cam.webcam zarabiaj-dzis.pl
xz618.com zastroyka.org
yourmovies.pl zebradudka.com
youthreaders.com zeroredirect7.com
zakonobosago.ru zoogdiesney.com
zaloro.com zoogdisany.com
zastenchivosti.net
zeroredirect12.com
zygophyceous.womanstars.site

531
dev-tools/test_units/ratelimittest-beta.txt
View file

@ -8,268 +8,6 @@
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html>ml>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html><html> </html><html>
<head><title>503 Service Temporarily Unavailable</title></head> <head><title>503 Service Temporarily Unavailable</title></head>
<body> <body>
@ -494,6 +232,265 @@
<hr><center>nginx/1.18.0 (Ubuntu)</center> <hr><center>nginx/1.18.0 (Ubuntu)</center>
</body> </body>
</html> </html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<!DOCTYPE html> <!DOCTYPE html>
<html> <html>
<head> <head>
@ -584,4 +581,14 @@
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html> </html>

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.36 0; 10.1.0.114 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2023.02.3574 ### Version: V4.2023.02.3575
### Updated: Sat Feb 11 10:03:22 UTC 2023 ### Updated: Sat Feb 11 22:01:17 UTC 2023
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2023.02.3574 ### Version: V4.2023.02.3575
### Updated: Sat Feb 11 10:03:22 UTC 2023 ### Updated: Sat Feb 11 22:01:17 UTC 2023
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##