vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-03 19:20:16 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2022.08.3285 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2022-08-12 10:09:41 +00:00
parent c1979cd4f5
commit 74e97fa06f
47 changed files with 90728 additions and 90738 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.08.3284 #### Version: V4.2022.08.3285
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.08.3284 #### Version: V4.2022.08.3285
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -14,7 +14,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2022.08.3284 #### Version: V4.2022.08.3285
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

11206
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2022.08.3284 #### Version: V4.2022.08.3285
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

11210
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

11210
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

11210
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

11210
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.178 1; 10.1.0.47 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.178 0; 10.1.0.47 0;
127.0.0.1 0; 127.0.0.1 0;

11210
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.178 1; 10.1.0.47 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.178 0; 10.1.0.47 0;
127.0.0.1 0; 127.0.0.1 0;

11210
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.178 1; 10.1.0.47 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.178 0; 10.1.0.47 0;
127.0.0.1 0; 127.0.0.1 0;

11210
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
3284 3285

11210
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

11210
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.253.177.163 0; 13.89.247.89 0;

11210
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.178 1; 10.1.0.47 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.178 0; 10.1.0.47 0;
127.0.0.1 0; 127.0.0.1 0;

11210
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.178 1; 10.1.0.47 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.178 0; 10.1.0.47 0;
127.0.0.1 0; 127.0.0.1 0;

11210
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.178 1; 10.1.0.47 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.178 0; 10.1.0.47 0;
127.0.0.1 0; 127.0.0.1 0;

11210
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.253.177.163 0; 13.89.247.89 0;

11210
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.253.177.163 0; 13.89.247.89 0;

11210
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.178 1; 10.1.0.47 1;
127.0.0.1 1; 127.0.0.1 1;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
Atomseobot Collector
Fuzz EMail Wolf
Not IstellaBot
RSSingBot Lftp
SBIder Needle
SiteExplorer Netvibes
Voltron Psbot
Web Pix VoidEYE
domainsproject.org Zitebot
probe-image-size pcBrowser

300
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
01h4x.com 01h4x.com
AIBOT ADmantX
Abonti Alligator
Aboundex Anarchy
Acunetix
AfD-Verbotsverfahren
AllSubmitter
AlphaBot
Ankit
Asterias Asterias
Atomseobot Atomseobot
AwarioRssBot
AwarioSmartBot AwarioSmartBot
BBBike
BDFetch
BackDoorBot BackDoorBot
Backlink-Ceck BackWeb
Bandit Bandit
Barkrowler BatchFTP
BetaBot BetaBot
Bigfoot
Bitacle Bitacle
Black Hole
Blow Blow
Boardreader Boardreader
BotALot BotALot
Brandprotect
Brandwatch Brandwatch
Buck BunnySlippers
Bullseye
BuzzSumo
CATExplorador
CCBot CCBot
CODE87
CSHttp
Calculon Calculon
CazoodleBot Cegbfeieh
CensysInspect
CheeseBot
CherryPicker CherryPicker
ChinaClaw
Chlooe Chlooe
Citoid
Cliqzbot Cliqzbot
Cloud mapping
Cogentbot Cogentbot
Collector
Copier
CopyRightCheck
Copyscape
Cosmos
Craftbot Craftbot
CrazyWebCrawler CrazyWebCrawler
CrunchBot Curious
Custo
CyotekWebCopy CyotekWebCopy
DBLBot DatabaseDriverMysqli
DTS Agent Dirbuster
Demon
Devil
Digincore
Disco
Discobot
DittoSpyder DittoSpyder
DnyzBot
DomainAppender
DomainStatsBot DomainStatsBot
Dotbot Domains Project
Download Wonder Download Wonder
Drip Drip
Ebingbong EMail Siphon
EroCrawler EasyDL
Evil
Exabot Exabot
Express WebPictures
Extractor
ExtractorPro ExtractorPro
EyeNetIE EyeNetIE
Ezooms FemtosearchBot
Fimap Flunky
Foobot
FrontPage
G-i-g-a-b-o-t G-i-g-a-b-o-t
GermCrawler GT::WWW
GalaxyBot
GetRight
Getintent Getintent
Gigabot
Go!Zilla Go!Zilla
Go-Ahead-Got-It Go-Ahead-Got-It
GoZilla
Gotit
GrabNet GrabNet
HTMLparser GrapeshotCrawler
GridBot
HEADMasterSEO
HMView
HTTP::Lite HTTP::Lite
HTTrack HTTrack
Haansoft
Hloader Hloader
HonoluluBot HonoluluBot
HybridBot HybridBot
Image Sucker IDBTE4M
IndeedBot Id-search
Indy Library InfoTekies
Intelliseek
InterGET InterGET
Internet Ninja
InternetSeer InternetSeer
Iskanie
JOC Web Spider JOC Web Spider
JennyBot Jbrofuzz
Jetty JetCar
Jorgee JikeSpider
Joomla
JustView JustView
Jyxobot Keybot Translation-Search-Machine
Kozmosbot Keyword Density
LWP::Simple Lanshanbot
Leap Larbin
LeechFTP LeechFTP
LeechGet
LexiBot LexiBot
Lftp Lftp
LibWeb
Libwhisker Libwhisker
LinkScan Likse
Linkbot
LinkextractorPro LinkextractorPro
LinkpadBot
LinqiaScrapeBot LinqiaScrapeBot
Lmspider Lipperhey
MJ12bot Litemage_walker
MIDown tool
MQQBrowser MQQBrowser
MSIECrawler MSFrontPage
Mag-Net Mail.RU_Bot
Majestic-SEO MarkWatch
MarkMonitor Mass Downloader
Mata Hari MeanPath Bot
Meanpathbot Meanpathbot
MegaIndex.ru Microsoft URL Control
MicroMessenger
Minefield Minefield
Mojolicious Mister PiX
MolokaiBot MolokaiBot
Mozlila Msrabot
NICErsPRO NPbot
Nameprotect Nameprotect
NearSite NearSite
Needle
Nessus
Net Vampire Net Vampire
NetAnts NetAnts
NetLyzer
NetMechanic
NetZIP
Netvibes
NextGenSearchBot
Nibbler Nibbler
Niki-bot Niki-bot
Nimbostratus Ninja
Nmap
Not Not
Nutch
Octopus Octopus
Offline Explorer
Offline Navigator Offline Navigator
OpenLinkProfiler OpenVAS
Openfind OrangeBot
OrangeSpider OrangeSpider
OutfoxBot PECL::HTTP
PHPCrawl
POE-Component-Client-HTTP
PageGrabber PageGrabber
PageScorer PageThing.com
Panscient Pandalytics
Papa Foto
Pavuk Pavuk
Picscout Picscout
Picsearch Picsearch
Piepmatz PyCurl
PxBroker RankActive
QueryN Metasearch RankingBot
Rankivabot RankingBot2
Re-re RankurBot
ReGet
RealDownload RealDownload
SISTRIX RedesScrapy
ScanAlert Ripper
ScoutJet SEOlyticsCrawler
Screaming SEOstats
ScrepyBot SalesIntelligent
ScreenerBot
Seekport Seekport
SemrushBot Semrush
SentiBot Seomoz
Shodan
Site Sucker
SiteExplorer SiteExplorer
SiteLockSpider Sitebeam
SiteSnagger Siteimprove
SiteSucker Sitevigil
Snake SlySearch
Snapbot Snoopy
SocialRankIOBot
Sociscraper
Sogou web spider Sogou web spider
SpaceBison Sottopop
Spammen
SpankBot SpankBot
Spinn3r Spanner
Sqlworm Sqworm
Stripper
Sucker Sucker
Surfbot SuperHTTP
SurveyBot SurveyBot
Suzuran Teleport
Swiftbot
T0PHackTeam
T8Abot
TeleportPro TeleportPro
Telesoft Telesoft
Telesphoreo Telesphoreo
The Intraformant Toata
Thumbor True_Robot
TightTwatBot TwengaBot
Toweyabot
Trendiction
UnisterBot UnisterBot
Upflow Vacuum
V-BOT
Vagabondo Vagabondo
WASALive-Bot VeriCiteCrawler
WWW-Collector-E WBSearchBot
WPScan
WWW-Mechanize
WWW::Mechanize WWW::Mechanize
Wallpapers Wallpapers
WallpapersHD WallpapersHD
Web Enhancer WeSEE
Web Sucker Web Collage
Web Fetch
Web Pix
Web Sauger
WebBandit WebBandit
WebCollage
WebCopier
WebEnhancer
WebFetch WebFetch
WebGo IS WebLeacher
WebImageCollector WebSauger
WebPix
WebSucker WebSucker
WebZIP Webshag
WebsiteExtractor WebsiteExtractor
WebsiteQuester WebsiteQuester
Whack
Whacker Whacker
Whatweb Whatweb
Widow WinHTTrack
Wonderbot WiseGuys Robot
Wprecon Wotbox
Xenu
Zermelo
Zeus
Zitebot Zitebot
ZumBot ZyBorg
archive.org_bot arquivo.pt
autoemailspider autoemailspider
clark-crawler cah.io.community
cognitiveseo
com.plumanalytics
crawl.sogou.com crawl.sogou.com
dataforseo.com
domainsproject.org
eCatch eCatch
evc-batch facebookscraper
gopher heritrix
instabid
ips-agent
iubenda-radar iubenda-radar
linkdexbot linkdexbot
lwp-request lwp-request
lwp-trivial netEstate NE Crawler
magpie-crawler
mediawords
page scorer page scorer
probe-image-size plumanalytics
s1z.ru ripz
satoristudio.net scalaj-http
seobility seobility
sitechecker.pro seostar
sysscan serpstatbot
trendiction.com spyfu
voyagerx.com trendiction.de
ubermetrics-technologies.com
webgains-bot webgains-bot
webmeup-crawler
webpros.com webpros.com
webprosbot
x09Mozilla x09Mozilla
x22Mozilla zgrab
zauba.io

292
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
360Spider 01h4x.com
80legs 404enemy
ADmantX ADmantX
AIBOT
ALittle Client ALittle Client
Aboundex ASPSeek
Acunetix
AhrefsBot
AiHitBot AiHitBot
Aipbot
Alexibot Alexibot
AllSubmitter AllSubmitter
AlphaBot AlphaBot
Anarchie Anarchie
Anarchy99
Ankit Ankit
Aspiegel Apexoo
Asterias Asterias
Atomseobot
Attach Attach
AwarioRssBot AwarioRssBot
AwarioSmartBot BDFetch
BBBike
BackStreet BackStreet
BackWeb BackWeb
BacklinkCrawler BacklinkCrawler
Bandit
Barkrowler Barkrowler
BatchFTP BatchFTP
Battleztar Bazinga Battleztar Bazinga
BetaBot Bitacle
Black Hole
Boardreader
Brandprotect
Brandwatch
Buck Buck
BuiltWith
BunnySlippers BunnySlippers
BuzzSumo
CATExplorador
CCBot CCBot
CODE87 Cegbfeieh
CSHttp
CazoodleBot
CensysInspect CensysInspect
ChinaClaw ChinaClaw
Citoid
Claritybot
Cloud mapping Cloud mapping
Cosmos Cocolyzebot
CrazyWebCrawler Cogentbot
CopyRightCheck
Copyscape
Craftbot
Curious
Custo Custo
CyotekWebCopy
DBLBot
DTS Agent
DataCha0s
Deusu Deusu
Digincore
DigitalPebble
Dirbuster Dirbuster
Disco
Discoverybot
Dispatch
DnBCrawler-Analytics DnBCrawler-Analytics
DnyzBot DomCopBot
DomainCrawler Domains Project
DomainStatsBot
Dotbot
Download Wonder
Dragonfly Dragonfly
Drip Drip
ECCP/1.0
EMail Siphon EMail Siphon
EMail Wolf
EasyDL
Ecxi Ecxi
Evil EirGrabber
Extreme Picture Finder Extreme Picture Finder
EyeNetIE
FemtosearchBot FemtosearchBot
Fimap Firefox/7.0
Flunky
Foobot Foobot
Freeuploader
FyberSpider FyberSpider
Fyrebot
G-i-g-a-b-o-t G-i-g-a-b-o-t
GT::WWW
Genieo Genieo
GermCrawler GermCrawler
GetRight
Gigabot
Go!Zilla Go!Zilla
Go-Ahead-Got-It
GoZilla
GrapeshotCrawler
GridBot
HEADMasterSEO HEADMasterSEO
HMView
Haansoft Haansoft
Harvest Harvest
Hloader Hloader
Humanlinks IRLbot
Id-search Id-search
IlseBot
Image Fetch
Indy Library Indy Library
InterGET InfoNaviRobot
Iskanie InternetSeer
Iria
IstellaBot IstellaBot
JOC Web Spider JamesBOT
JetCar JennyBot
JikeSpider JikeSpider
Kenjin Spider Jorgee
Jyxobot
Keyword Density
LNSpiderguy LNSpiderguy
Lanshanbot Leap
Larbin LeechGet
LibWeb Libwhisker
LieBaoFast Lightspeedsystems
Likse LinkWalker
LinkScan LinkextractorPro
LinkpadBot
Lipperhey Lipperhey
Lipperhey Spider Lipperhey Spider
Litemage_walker MFC_Tear_Sample
Lmspider
MIIxpc
MQQBrowser MQQBrowser
MSFrontPage
MSIECrawler
MTRobot MTRobot
Magnet Mail.RU_Bot
Majestic SEO Majestic-SEO
MarkWatch MarkWatch
Mass Downloader
Masscan Masscan
Metauri Mata Hari
MicroMessenger MauiBot
Mb2345Browser
Meanpathbot
Mediatoolkitbot
Microsoft URL Control Microsoft URL Control
Mister PiX
Moblie Safari Moblie Safari
Mojolicious Morfeus Fucking Scanner
Nameprotect Msrabot
Navroad Musobot
NetSpider NPbot
Net Vampire
NetMechanic
Netcraft Netcraft
Nettrack Nimbostratus
Netvibes Not
NextGenSearchBot
Nikto
NimbleCrawler
Ninja
Nuclei Nuclei
Nutch
Octopus Octopus
Offline Navigator
OpenLinkProfiler
OpenVAS OpenVAS
Openfind
Openvas
OrangeBot OrangeBot
OrangeSpider OrangeSpider
OutfoxBot
PECL::HTTP
POE-Component-Client-HTTP
Page Analyzer
PageAnalyzer
PageGrabber PageGrabber
PageScorer PageThing.com
Pandalytics Papa Foto
Petalbot
Pi-Monster
Picsearch Picsearch
Pimonster Piepmatz
Pixray ProPowerBot
PleaseCrawl
ProWebWalker ProWebWalker
PxBroker PxBroker
QueryN Metasearch QueryN Metasearch
Quick-Crawler RankingBot
RSSingBot Rankivabot
RankActive RealDownload
RankActiveLinkBot RocketCrawler
Ripper SBIder
SEOkicks-Robot SEOstats
SEOprofiler
SISTRIX
SMTBot
SalesIntelligent SalesIntelligent
ScanAlert
ScoutJet ScoutJet
Scrapy Screaming
Searchestate ScreenerBot
ScrepyBot
SemanticJuice SemanticJuice
SeoSiteCheckup Semrush
Shodan Seomoz
SiteExplorer Siphon
Site Sucker
SiteLockSpider SiteLockSpider
SiteSnagger
SiteSucker SiteSucker
Siteimprove SlySearch
Sitevigil
Snapbot
Snoopy Snoopy
Sociscraper
Sosospider Sosospider
Sottopop
SpaceBison SpaceBison
Spammen Spammen
Spanner
Spbot Spbot
SputnikBot
Sqlmap Sqlmap
Sqlworm
Sqworm
Stripper Stripper
Sucuri Sucuri
SuperBot SuperBot
Surfbot SurveyBot
Suzuran Suzuran
T8Abot Swiftbot
TeleportPro
Telesoft
Telesphoreo Telesphoreo
Telesphorep Telesphorep
The Intraformant TheNomad
Toata Thumbor
Tracemyfile Tracemyfile
True_Robot Twice
URLy Warning Typhoeus
UnisterBot UnisterBot
Upflow Vagabondo
VB Project
VelenPublicWebCrawler
VeriCiteCrawler VeriCiteCrawler
VidibleScraper VidibleScraper
VoidEYE
Voil
Voltron Voltron
WASALive-Bot
WBSearchBot WBSearchBot
WEBDAV
WPScan WPScan
WWW-Collector-E WWW-Collector-E
WWW::Mechanize WWW-Mechanize
WWWOFFLE
Wallpapers
WallpapersHD WallpapersHD
WeSEE Web Fetch
Web Auto Web Fuck
Web Collage Web Sauger
Web Sucker Web Sucker
WebBandit WebBandit
WebFetch
WebReaper WebReaper
WebSucker WebSauger
WebStripper
WebWhacker
Webalta Webalta
WebmasterWorldForumBot WebmasterWorldForumBot
Webshag WebsiteExtractor
Who.is Bot WebsiteQuester
Woobot Whack
Xaldon_WebSpider Whatweb
WinHTTrack
Wotbox
Zade
Zauba Zauba
Zeus Zermelo
Zitebot ZmEu
ZoomBot ZoomBot
archive.org_bot ZumBot
coccocbot adscanner
arquivo.pt
autoemailspider
cah.io.community
cognitiveseo cognitiveseo
crawl.sogou.com domainsproject.org
crawler.feedback instabid
eCatch lwp-request
facebookscraper muhstik-scan
iubenda-radar
magpie-crawler
netEstate NE Crawler
page scorer page scorer
probe-image-size
s1z.ru
seobility seobility
serpstatbot seocompany.store
seoscanners
seostar
sexsearcher
sitechecker.pro sitechecker.pro
spyfu sogouspider
sysscan sp_auditbot
trendiction.com voyagerx.com
webgains-bot x22Mozilla
webmeup-crawler zgrab
x09Mozilla
zauba.io

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
buyessay3.blogspot.ru android-style.com
counciltally.com auto.rusvile.lt
investmac.com buyviagraa.blogspot.com
louboutinreplica.xyz callawaygolfstore.online
magnetic-bracelets.ru gosarhivrt.ru
pornoted.com keywordsuggest.org
romhacking.ru meteostate.com
secret.xn--oogle-wmc.com painting-planet.com
simple-image.com.ua pc-test.net
students-cheapskate.ml steebook.com

930
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
03p.info 000free.us
0c47f8422d3f.com 03e.info
1000n1.ru 101lesbian.xyz
123movies.love 12u.info
13tabs.com 1webmaster.ml
178evakuator178.ru 2girls1cup-free.com
1kinobig.ru 3dracergames.com
214jaluwobapef.cf 4kepics.com
256bit.by 66cpwgln.space
273-fz.ru 8kisses.eu
4ur.click aa625d84f1587749c1ab011d6f269f7d64.com
7ooo.ru aa8b68101d388c446389283820863176e7.com
999webdesign.com academiacsmendoza.org
aa81bf391151884adfa3dd677e41f94be1.com actionnooz.com
abtasty.com add-add.men
accessoires-mode.in ads-cool.pro
acmebtn.ml adult-shop.com.ua
actices.com adviceforum.info
adhome.biz alive-ua.com
adloads.com alldubai.biz
adman.se allsilver925.co.il
admanaerofoil.com alpinism.ru
adrunnr.com ampower.me
adsref.men androids-store.com
adult3dgames.com apartamentwroclaw.eu
adultnet.in apartmentratings.com
advancedcleaner.com apiallgeniusinfo-a.akamaihd.net
alborzan.com apple.com-cleaner.systems
alert-fjg.xyz arabseyes.com
alfa-medosmotr.ru aramaicmedia.org
alif-ba-ta.com aruplighting.com
all4invest.info asacopaco.tk
allknow.info asrvvv-a.akamaihd.net
amazon-adsystem.com asseenontvonline.ru
anal-acrobats.hol.es aussie-prizes.com
angigreene.com ayodhya.co
angry-fermi-7633.arukascloud.io azbukadiets.ru
animalrank.com babosas.com
ap.senai.br baixar-musicas-gratis.com
apibatbrowsecom-a.akamaihd.net bayareaaeroclub.org
apiportalmorecom-a.akamaihd.net beremenyashka.com
appfixing.space bestchoice.cf
appiq.mobi
approved.su
apxeo.info
arewater.com
artel116.ru
asrvrep-a.akamaihd.net
aviav.eu
avkzarabotok.info
ayerbo.xhost.ro
b00kmarks.com
babs.com.ua
backgroundpictures.net
bag77.ru
bala.getenjoyment.net
balitouroffice.com
bannerads.de
barnfurnituremart.com
bcmp.org
bedcapdealers.com
best-games.today
best-mam.ru
bestcalovebracelet.cn
bestdooz.com
besthoro.ru
bestimagecoollibrary.com
bestkfiledxd.cf
bestprofits-there.com
bezsporno.ru bezsporno.ru
bigames.online bg6s0.com
binomo.kz bif-ru.info
biteg.xyz bigcareer.info
binaryoptionscops.info
binomo.com
bioscorp.ru
bitcoin-ua.top
bitporno.sx bitporno.sx
bkgr.se bizfly.info
bloggen.be bjanshee.ru
blogig.org blogporn.in
bluesman.nu bluesalt.co
boeuklad.com bmw.afora.ru
boltalko.xyz boltalko.xyz
bongiornos.info bonux.nextview.ru
brainsandeggs.blogspot.com brandehk.dk
cactussoft.biz break-the-chains.com
calcularpagerank.com btvn.ru
cartierlove.xyz buyhoverboard.com
buytizanidineonlinenoprescription.blogspot.com
candiceloves.us
canzoni.ru
carstrends2015.com
cartierreplica.pw
cartierreplica.top cartierreplica.top
cascadelink.org cartierreplica.xyz
cezartabac.ro cartierring.xyz
cheapjerseysap.com celebsopics.com
checkm8.com changde.58.com
chinacheapelitejerseys.com cheapjerseysbizwholesale.us
chinajerseyswholesalecoupons.com cheapmoncler.pw
chocolateslim-en-espana.com checkhit.com
christianlouboutinoutlet.win chee-by.biz
citetick.com chimiver.info
clickhype.com cicaki.net
colehaanoutlet.store cineacademy.ru
colobit.biz clicksor.com
com-onlinesupport.site clicksotrk.com
compiko.info clips.ua.ac.be
compliance-john.top club-samodelkin.ru
continent-e.tv cmhomestayagency.com
converse.ddsoldes.fr codq.info
copenergo.ru cometorussia.net
counter.bloke.com compliance-alexa.xyz
cpajunkies.com compliance-don.top
cs-passion.pl compliance-mary.top
customcatchcan.com coop-gamers.ru
crazyprotocol.com
custodieva.ru
customerpromos-a.akamaihd.net
cutalltheshit.com cutalltheshit.com
cxpromote.com cxpromote.com
dalavia.ru cypernhuset.se
dandiyabeats.in datadepths.com
ddpills.com dcj-nn.ru
dear-diary.ru dear-diary.ru
dentalpearls.com.au defenderxtactical.com
diesel-parts28.ru deutschehobbyhuren.net
dispo.de diamond-necklace.info
docstoc.com diminishedvalueoforegon.com
dojki365.online discountbarbour.online
download-walpaperhd.blogspot.com discovertreasurenow.com
drpornogratisx.xxx diusyawiga.tk
drugspowerstore.com divisioncore.com
e-commerce-seo.com divku.ru
eaplay.ru dnsrsearch.com
earthmagic.info domainroam.win
elektrischeziga.livejournal.com domcran.net
elektronischezigarettekaufen1.myblog.de e705.net
elektrozigaretten1.tumblr.com eachdayisagift.review
elvenmachine.com easytuningshop.ru
englishdictionaryfree.com ege-russian.ru
erotiktreff24.info eldiariodeguadalajara.com
eurosamodelki.ru electrik-avenue.com
ezrvrentals.com electro-prom.com
family1st.ca elektrozigarettekaufen2.blogse.nl
fearcrow.com elitesportsadvisor.com
eropho.net
erotische-geschichten-xxl.com
escortplius.com
esfchat.tk
etur.ru
everypony.ru
evidencecleanergold.com
exmasters.com
expertblog.info
expolicenciaslatam.co
expresstoplivo.ru
ez8motelseaworldsandiego.com
ezigarettenshop2.myblog.de
facialporntube.com
fantasticpixcool.com
fatfasts-4tmz.com
feeriaclub.ru
femmesdenudees.com femmesdenudees.com
fertilitetsradgivningen.se figuringmoneyout.com
filesdatabase.net filesvine.com
findpik.com filmidivx.com
finejewelryshop.ru firstsiteguide.com
finstroy.net fitfloponline.store
fiuxy.com fiverr.com
fivedwld.cf foto-telok.net
floating-share-buttons.com foto-weinberger.at
flooringinstallation-edmonton.com foxinsocks.ru
floridahuntingfishingadventures.com foxweber.com
floridamhca.org fr-bearings.ru
flprog.com frameimage.org
foodcrafts.website free-fbook-traffic.com
forexgb.ru free-floating-buttons.com
fototravel.eu freeuploader.ml
free411games.com freewhatsappload.com
freenode.info friendflnder.com
fres-news.com froggytube.com
freshsuperbloop.com fsalas.com
game-top.su fungamelands.com
gaytube.com funnel.co.za
ge0ip.org fxtips.ru
gemgrab-a.akamaihd.net gardene.ru
gerhardhealer.com gay.adultgalls.com
gg.zzyjxs.com gaygalls.net
gogalleryawesome.com gelezki.com
gojiberriess.apishops.ru genericlowlatencyasiodriverhq.aircus.com
googst2.ru gheus.altervista.org
gosarhivrt.ru gifspics.com
gratuitxblcodes.com gilsonchiro.xyz
greatzip.com given2.com
guiadeserraazul.com gktt.ru
hanink.biz.ly glcomputers.ru
hard-porn.mobi goatse.ru
gobongo.info
googlefeud.com
googlepositions.com
guardlink.org
guildebzh.info
guod.me
gyffu.com
harmonyglen.us
hasshe.com
hazardky.net
hchha.com
hdapp1008-a.akamaihd.net hdapp1008-a.akamaihd.net
healmytrauma.info hdimagelib.com
healthcarestore.info high-speed1.net
heatpower.ru hikesearch.net
heliko.no histats.com
hobbyhuren-datenbank.com
hobbyhuren24.net
holidaypics.org holidaypics.org
homedo.fabpage.com hoporno.com
host-protection.com hotcore.info
house.sieraddns.com house.sieraddns.com
housemilan.ru
houseofgaga.ru houseofgaga.ru
hustoon.over-blog.com hspline.com
hyiphunter.org huhn.altervista.org
ideoworld.org humbmosquina.tk
ilo134uloh.com i-service.kz
ilte.info ilbe.club
imagefinder.site ilmexico.com
imicrovision.com imabase.com
images-graphics-pics.com
immigrational.info
import-sales.com
indetiske.ya.ru
indiakino.net indiakino.net
integritylandscapeservices.com indiasourcemart.in
interesnie-faktu.ru informatiecentro.be
iomoio.net intellekt21.ru
ipornox.xxx inzn.ru
jacago.com isitwp.com
javitas.info iusstf.org
javspace.net jennyfire.ru
jeremyeaton.co jetsli.de
jo24news.com jjbabskoe.ru
jobmarket.com.ua jpcycles.com
jose.mulinohouse.co jrpmakati.com
justucalling32211123456789.tk kalandranis.gr
kamalsinha.com kambasoft.com
kasino-money.pw kamen-e.ru
keenoutlet.online keenoutlet.online
kerch.site kerch.site
kerwinandcariza.com kinogonew.ru
ketrzyn.pl kndxbkdx.bloger.index.hr
keyword-suggestions.com konica.kz
keywordhouse.com labvis.host.sk
khafre.us lanadelreyfans.us
kino-rf.ru lanasshop.ru
kinoflux.net landmania.ru
klin3952.ru lapitec.eu
kosova.de layola.biz.tc
lampokrat.ws lezbiyanki.net
lankarns.com lider-zhaluzi.kiev.ua
laudit.ru linkbolic.com
laulini.soclog.se linkredirect.biz
lawyersinfo.org lombia.com
leboard.ru luciddiagnostics.in
life-instyle.com lutherstable.org
life.biz.ua mahnwachen-helfen.info
likesuccess.com marketingvici.com
lion.misba.us masterseek.com
lisque.batcave.net masturbate.co.uk
live-sexcam.tk mature.free-websites.com
livingroomdecor.info maximilitary.ru
lonfon.xyz mb140.ru
lovi-moment.com.ua mbiologi.ru
lubetube.com medi-fitt.hu
luxmagazine.cf mediawhirl.net
machicon-akihabara.info meetingrainstorm.bid
madot.onlinewebshop.net meetlocalchicks.com
malls.com mega-polis.biz.ua
manifestation.betteroffers.review megaindex.ru
marblestyle.ru members.ghanaweb.com
marketland.ml meteocast.net
marmotstore.online mhtr.be
mathgym.com.au
mebel-alait.ru
mebel-ekb.com
meble-bogart.info
medkletki.ru
meet-flirt-dating.com
mega-bony2017.pl
memberty.com
metafilter.com
meteostate.com
michaelkorsoutlet.store michaelkorsoutlet.store
michaelkorsoutletstore.net microsearch.ru
michaelkorssaleoutletonline.net milblueprint.com
mikozstop.com militarysale.pro
mindbox.co.za mobifunapp.weebly.com
mmog-play.ru mobot.site
moesonce.com mobstarr.com
mompussy.net moncleroutletonline.win
monarhs.info moneyviking-a.akamaihd.net
monclerboots.xyz moz.com
monetizationking.net mrbojikobi4.biz
monitorwebsitespeed.com muz-baza.net
morefastermac.trade mycouponizemac.com
morf.snn.gr
morpicert.pw
moscow-region.ru
mp3films.ru
muizre.ru
mvpicton.co.uk
my-aladin.com
mydirtystuff.com
mydownlodablefiles.com
myprintscreen.com
nac-bearings.ru
nacap.ru nacap.ru
nalogovyykodeks.ru nalogovyykodeks.ru
naperehresti.info napalm51.nut.cc
nash-krym.info naturalbreakthroughsresearch.com
naturalshair.site neobux-bg.info
negociosdasha.com nikhilbahl.com
nero-us.com nikkiewart.ru
netcheckcdn.xyz nina.az
new-post.tk nl.netlog.com
nicovideo.jp northfacestore.online
nisuturnetdgu.tk notaria-desalas.com
nsatc.net noumeda.com
nufaq.com o-o-8-o-o.com
obiavo.su obiavo.su
obnal.org
obsessionphrases.com obsessionphrases.com
oconto.ru oddamzadarmo.eu
onlinebay.ru oil-td.ru
onload.pw omoikiri-japan.ru
onlyporno.ru onlinetvseries.me
openmultipleurl.com oralsexfilme.net
orel-reshka.net orion-code-access.net
orgasmatrix.com ourville.info
orion-v.com outclicks.net
ororodnik.goodbb.ru owathemes.com
ostrovtaxi.ru paparazzistudios.com.au
ourtherapy.ru paphoselectricianandplumber.com
paintingplanet.ru park.above.com
panchro.co.uk parlament.biz
petrovka-online.com pavlodar.xkaz.org
photochki.com pelfind.me
photorepair.ru perl.dp.ua
phrcialiled.com pics-group.com
picanalyzer.data-ox.com pillscheap24h.com
pictures-and-images.com pinkduck.ga
picurams.pw
plaff-go.ru
platezhka.net platezhka.net
play-movie.pl podshipniki-ntn.ru
ploenjitmedia.azurewebsites.net
pobeiranie.pl
pontiacsolstice.info pontiacsolstice.info
pornmania.pl popmarker.com
pornophoto.xyz popserve.adscpm.net
pozvonim.com porn555.com
preparevideosafesystem4unow.space porno-dojki.net
pornokorol.com
portadd.men
posible.net
pourvous.info
pr-ten.de
printdirectforless.com
priora-2.com priora-2.com
privatamateure.com privatbank46.ru
privetsochi.ru
privhosting.com privhosting.com
projefrio.com.br prlog.ru
prokotov.com prohoster.info
promodj.com promgirldresses.xyz
promover.org psa48.ru
prostitutki-belgoroda.org ptr.ruvds.com
proxyelite.biz pussyfleet.com
putitin.me putitin.me
rada.ru quit-smoking.ga
ranksays.com rabotaetvse.ru
ranksonic.info radiodigital.co
rcpmda.ikan1080.xyz rankscanner.com
redhotfreebies.co.uk recipedays.com
registratciya-v-moskve.ru reelheroes.net
ribieiendom.no reeyanaturopathy.com
riders.ro remmling.de
royalcar-ufa.ru remont-comp-pomosh.ru
rozalli.com remontvsamare.su
rubanners.com revistaindustria.com
rukino.org reward-survey.net
runstocks.com rimedia.org
rvzr-a.akamaihd.net royalvegascasino.com
sabizonline.com rp9.ru
sammyweaver.com rus-teh.narod.ru
rusexy.xyz
russian-postindex.ru
s1z.ru
sadaholding.com
saletool.ru
samo-soznanie.ru
samolet.fr samolet.fr
scanner-alex.top saratov.xrus.org
scanner-jack.top scanner-donald.top
scanner-john.top scanner-george.top
scanner-nelson.top scanner-mark.top
scrnet.biz.ua scopich.com
sdelatmebel.ru semalt.com
searchaddis.com seoprofiler.com
searchimpression.com seorussian.ru
securesmrt-dt.com serdcenebolit.com
seksotur.ru sex-dating.co
seofied.com sexfreepornoxxx.com
serw.clicksor.com sexvporno.ru
sexobzor.info shivafurnishings.com
sexuria.net
sexyali.com
sexystrippe.info
shareyards.com
shlyahten.ru
shoesonlinebuy.cn
shoesonlinebuy.xyz shoesonlinebuy.xyz
shop.xz618.com shopfishing.com.ua
sierraapps.com shopperifymac.com
silverage.ru shopwme.ru
silvermature.net shtaketniki.kz
sim-service.net sibdevice.ru
simpoed.ufop.br silktide.com
sindragosa.comxa.com simplesite.com
site-speed-check.site sisi-go.ru
sklad-24.ru site-speed-checker.site
skytraf.xyz sizeplus.work
sledstvie-veli.net slavic-magic.ru
smartbalanceworld.com smichovbike.cz
sneakyboy.com social-search.me
songoo.wz.cz softonicads.com
soochi.co sotechco.co
sovinsteel.ru sotkal.lark.ru
spabali.org spinazdrav.ru
spacash.com sps-shop.com
space4update.pw squidoo.com
speechfoodie.com staynplay.net
sports-supplements.us stroimajor.ru
spymac.net stroymonolit.su
srdrvp.com svensk-poesi.com
stardevine.com svetodiodoff.ru
stariy-baku.com sweepstakes.rewardit.com
startufa.ru swiped.su
steame.ru t-bygg.com
stroilka.info tabletkinaodchudzanie.com.pl
stroiminsk.com taqywu51.soup.io
stroy-portal22.ru tattooha.com
styro.ru
sudexpert66.ru
sugvant.ru
sukarame.net
sukirgenk.dvrlists.com
summerlinhomes411.info
sumo.com
superlist.biz
superstarfloraluk.com
superstats.com
svarkagid.com
tacbelarus.ru
tackletarts.co
tanieaukcje.com.pl
tarad.com
tasteidea.com
tattoo33.ru
td-l-market.ru
tds-advert005.info
teastory.co
tecnoteakviareggio.it tecnoteakviareggio.it
tecspb.ru telefonsexsofort.tk
tedy.su templates.franklinfire.co
telefonsexi.com templates.radiodigital.co
telemetryverification.net thebestweightlosspills.ovh
thegioixekhach.com thedownloadfromwarez.blogspot.com
timecrimea.ru theguardlan.com
titelhelden.eu tiandeural.ru
tizanidineandhydrocodone.blogspot.com
tizanidinehcl2mgsideeffects.blogspot.com
tizanidinehcl4mgtab.blogspot.com tizanidinehcl4mgtab.blogspot.com
tizanidinestreetvalue.blogspot.com tk-assortiment.ru
tjkckpytpnje.com tkanorganizma.ru
top250movies.ru toon-families.com
topsiteminecraft.com top-karkas.ru
torrent-newgames.com topsy.com
torrnada.ru tracksz.co
tpu.ru traffic100.com
track2.shop trafficreceiver.club
trahic.ru
trainoffend.ml trainoffend.ml
trkur.com trichizobswiv.agddns.net
trumpetedextremes.com truck-land.life
trustl.life truck-rece.life
tsan.net tryrating.com
turbo-suslik.org ttrraacckkrr.com
tvteleport.ru tupper-posuda.ru
twinderbella.com turizm.bz
txxx.com tv-spoty.info
uchetunet.su ukrup.com
uchil.net um-razum.ru
ukrtvir.com.ua unimodemhalfduplefw.pen.io
unrealcommander.com unisexjewelry.org
uvozdeckych.info unitygame3d.com
vacuumscleaner.com uprour.com
vapeface.club uptime-as.net
veles.shop userequip.com
via-energy-order.com vektorpress.ru
viddyoze.com veselokloun.ru
vip.51.la vesnatehno.com
vip2ch.com viagra.pp.ua
voluumtracker1.com viandpet.com
vote-up.ru videochat.life
vpnhowto.info viel.su
vuclip.com vielporno.net
wareseeker.com vip-parfumeria.ru
visa-pasport.ru
vkmusics.ru
vmnmvzsmn.over-blog.com
vrnelectro.ru
vvpg.ru
vzubah.com
walkme.com
wallpaperstock.net
warningwar.ru warningwar.ru
watch-movies.ru
watchmygf.net watchmygf.net
webcamtalk.net watsonrealtycorp.com
website-analyzer.info web-analytics.date
website-speed-up.top webix.me
webradiology.ru
webs.com
webscouter.net
website-analytics.online
website-audit.com.ua
websiteexplorer.info
webstatsdomain.org
weburlopener.com
weekes.biz.tc
wellcome2slovenia.ru wellcome2slovenia.ru
weprik.ru wfb.hatedriveapart.com
wesharepics.com whereverdesperate.gq
wheelchairliftsarea.com wholesalenfljerseys.us.com
whengirlsgowild.com williamrobsonproperty.com
white-truck.life witclub.info
whiteelephantwellington.com wordkeyhelper.com
winx-play.ru worldis.me
wleuaprpxuvr.ga worldmusicfests.com
wnoz.de www.888.com
worldinternetauthority.com www.ehscloud.cn
x-musics.com www.get-free-traffic-now.com
x-rates.ru wygraj-teraz.com
xn----7sbbahaq9bb5afgiqfliv4m.xn--p1ai x-mix.info
xn----itbkqkfiq.xn--p1ai xblog.in
xn--b1agm2d.net xingzi-vision.com
xjlottery.com
xlolitka.com
xn------7cdbapdecfd4ak1bn0amjffj7afu3y.xn--p1ai
xn--80aaafbn2bc2ahdfrfkln6l.xn--p1ai
xn--80aebbcbcdemfkhba4byaehoejh8dza3v.xn--p1ai
xn--e1aggki3c.xn--80adxhks xn--e1aggki3c.xn--80adxhks
xn--h1ahbi.com.ua xn--h1ahbi.com.ua
xxart.ru xportvusbdriver8i.snack.ws
youdesigner.kz xuki.us
yougetsignal.com yourtemplatefinder.com
youporn-ru.com yuarra.pluto.ro
yourads.website za-music.mymobiplanet.com
yugk.net zakon-ob-obrazovanii.ru
zajm-zalog-krasnodar.ru zapatosenventa.info
zerocash.msk.ru zastenchivosti.net
zeroredirect2.com zastroyka.org
zhongwenlink.com zebradudka.com
zolotoy-lis.ru zebramart.ru
zoompegs.com zigarettenonlinekaufen2.bloog.pl
zootoplist.com zixizop.net.ru
zootravel.com zocaparj.kz
zreloeporno.tv zoodrawings.com
zrizvtrnpale.tk zoominfo.com
zscalerone.net

486
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
72-news.com 03p.info
7wind.ru 1688.com
7zap.com 1hwy.com
4inn.ru
5000-cotydzien.com
883zy.com 883zy.com
above.com agardomains.com
abovetherivernc.com agroeconom.kz
abtasty.com aimayangzhi.com
abusora.com alfa9.com
acgs.tk angigreene.com
addray.pro ayodhya.co
adviceforum.info barbourjackets.online
alibestsale.com beauby.ru
aliexpresscashback.club beauty-b0x.pl
all-streaming-media.com best-deals-products.com
amung.us best-seo-solution.com
ananumous.ru bestadbid.com
anmysite.com bgviagrachrx.com
aosexkontakte.net bio-japan.net
apiholdingmypage-a.akamaihd.net
apper.de
asiavirtualsolutions.com
asseenontvonline.ru
atlant-auto.info
autodo.info
aversis.net
bala.getenjoyment.net
balla-boo.se
bayareaaeroclub.org
bbsoldes.fr
bbtec.net
belstaffstore.online
best-seo-software.xyz
bestfortraders.com
bestmobilityscooterstoday.com
bioca.org bioca.org
birzha-truda.eu bizlist.com.de
bizfly.info blogig.org
bosefux.esy.es blue-square.biz
brandedleadgeneration.com bluejays-jerseys.us
buzzonclick.com bocoarchives.org
bvlgaribracelet.xyz buyessay3.blogspot.ru
cannibalcheerleader.com callcafe.info
cardsdumps.com callmd5map.com
carmuffler.net camel-beach.com
casablancamanor.co.za capacitacionyaprendizaje.com
caulderwoodkennels.com cascadelink.org
cayado.snn.gr casinopinup-wins.com
ccbill.com changde.58.com
charmstroy.info cigarpass.com
check-host.net citizenclsdriveri7.pen.io
children-learningreading.info cleanallspyware.com
cibpenonptib.flu.cc cleanallvirus.com
clickcash.com companies-catalog.com
clippingphotoindia.com compliance-elena.xyz
com-onlinesupport.host
compliance-checker-7.info
compliance-irvin.top compliance-irvin.top
consorzioilmosaico.org cookie-law-enforcement-hh.xyz
coop-gamers.ru coolbar.pro
craftinsta.ru cougfan.info
daretodonate.co counter.bloke.com
deadlinkchecker.com credit.co.ua
deda-moroza-zakaz.ru cyclobenzaprinevstizanidine.blogspot.com
detalizaciya-tut.biz cyse.tk
diesel-parts28.ru danceuniverse.ru
dieta-personalna.pl date-withme.com
downloader12.ru davebestdeals.com
doxyporno.com dinosaurus.site
dpihatinh.gov.vn discovertreasure-a.akamaihd.net
drivotracker.com documentsite.net
drugspowerstore.com dood.live
e-buyeasy.com dotnetdotcom.org
ecommerce-seo.com doublepimp.com
editors.choice6912650.hulfingtonpost.com doyouknowtheword-flummox.ml
enbersoft.com druzhbany.ru
eredijovon.com eandsgallery.com
everytalk.tv eaplay.ru
excitacion.info ekto.ee
executehosting.com elektrischeziga.livejournal.com
exlarseva.webblog.es elektrischezigarettekaufen2.cowblog.fr
ez8motelseaworldsandiego.com elektronischezi.livejournal.com
ezaz.info elektrozigaretten2.yn.lt
ezigarettenkaufen1.pagina.gr eonpal.com
farm26.ru es5.com
filmci.pro european-torches.ru
foodgid.net everflora.ru
forex.osobye.ru fanoboi.com
foxweber.com faz99.com
ftns.ru fickblock18.com
fuck-paid-share-buttons.xyz filmetricsasia.com
funtoonez.com finuse.com
galeria-zdjec.com fitnesspiks.com
gamerextra.com footballfarrago.com
gamerscorps.com forex-procto.ru
gidonline.one fortevidyoze.net
girlgamerdaily.com freewlan.info
gok-kasten.net geilehausfrauen.net
golaya.pw getmiro.com
googlsucks.com globalsurfari.com
gpms.org.my goo.ne.jp
gratis-sexkontakte.com gratis-sexkontakte.com
greenshop.su gsmtlf.ru
gsou.cf gta-club.ru
hackers-crackers.tk gtopstats.com
haveinc.xyz guardlink.org
historichometeam.com hasfun.com
housekuba.org healmytrauma.info
igrovyeavtomaty777.ru hermesbelts.xyz
indiakino.net hetmanship.xyz
internet-apteka.ru hmywwogw.bloger.index.hr
kakablog.net hobbyhuren24.net
kamalsinha.com hollywoodactress.info
kazrent.com homik.pw
kerch.site humanorightswatch.org
kerwinandcariza.com i-service.kz
kicknights.gq ikearugs.xyz
knowyournextmove.com iloveitaly.ru
koversite.info images-graphics-pics.com
kovrenok.ru indianmedicaltourismshop.com
larose.jb2c.me interesnie-faktu.ru
laxdrills.com istmira.ru
leboard.ru itch.io
letsrepair.in japan-bearings.ru
letto.by jerseysbizwholesalecheap.com
lion.playtap.us johannesburgsingles.co.za
lunamedia.co junketjuice.blogspot.com
m292.info jyrxd.com
macfix.life keyhantercume.com
magda-gadalka.ru keywords-monitoring-success.com
masturbate.co.uk kinky-fetishes.com
matematikus.info komp-pomosch.ru
maxthon.com kredit-pod-zalog-krasnodar.ru
med-zdorovie.com.ua kvartir-remont.biz
medosmotr-ufa.ru lakomka.com.ua
meet-flirt-dating.com landmania.ru
micasainvest.com laptop-4-less.com
mjchamonix.org lasvegaslockandsafe.com
mobile-appster.ru lider-zhaluzi.kiev.ua
moz.com lidoradio.com
musicpro.monster lightinghomes.net
muz-tracker.net live-cam6.info
mygameplus.ru lkbennettstore.online
myra.top lookingglassemb.com
negral.pluto.ro macdamaged.space
no-fuel.org mafa-free.com
nowtorrents.com master-muznachas.ru
nuit-artisanale.com mazda-roadsters.com
oil-td.ru meddesk.ru
one-gear.com member-quiz.com
onlyforemont.ru merryhouse.co.uk
optibuymac.com mirzonru.net
orel-reshka.net mobicover.com.ua
oren-cats.ru monetizationking.net
orsonet.ru moneymaster.ru
panchro.xyz moneytop.ru
parajumpersstore.online more-letom.ru
partner-cdn.men most-kerch.org
partnerworkroom.men mouselink.co
pastaleads.com muycerdas.xxx
patol01.pw muz-shoes.ru
pdfprof.com muzaporn.com
pearlisland.ru mwtpludn.review
pechikamini.ru mydownloadengine.com
pertlocogasilk.tk o-o-8-o-o.com
phpdevops.com oballergiya.ru
podshipniki-nsk.ru onlinadverts.com
poligon.com ooo-olni.ru
polimga.pw ostroike.org
popunder.net perederni.net
presleycollectibles.com piratecams.com
prizeestates.cricket pixelrz.com
puteshestvennik.com pizdeishn.com
qexyfu.bugs3.com pizza-tycoon.com
raschtextil.com.ua podshipniki-ntn.ru
reelheroes.net pogosh.com
resellerclub.com pornoslive.net
restaurantlescampi.com pozdrawleniya.ru
rique.host.sk pravoholding.ru
roll123.com pricheski-video.com
ruex.org.ua privhosting.com
search-error.com proprostatit.com
shijian.ac.cn psa48.ru
shop.xz618.com q-moto.ru
shoppingmiracles.co.uk radiodigital.co
shtaketniki.ru rankia.com
sigmund-freud.co.uk recordpage-a.akamaihd.net
signal03.ru remontvsamare.su
siha.de remybutler.fr
silvercash.com rent2spb.ru
simple-share-buttons.com reyel1985.webnode.fr
simplepooltips.com rimedia.org
slowmac.tech ros-ctm.ru
slutloadlive.com running-line.ru
socialmadesimple.com rus-pornuha.com
souvenir.cc saitevpatorii.com
sport7777.net sanyuprojects.com
startufa.ru scanner-willy.top
sticken.co se-welding.ru
stjamesschool.info securesmrt-dt.com
stop-gepatit.te.ua seolab.top
stpolice.com seonetwizard.com
strana-krasoty.ru sex-sex-sex5.com
stroydetali.ru sexblog.pw
studiokamyk.com.pl shmetall.com.ua
supers.com.ua shtora66.ru
swiped.su slim.sellany.ru
syndicate.fun small-games.biz
td-33.ru social-s-iii.xyz
teletype.in socialbutton.xyz
thebluenoodle.com socialmediasuggest.com
thecoolimages.net soserfis.com
theguardlan.com statoutlook.info
theheroes.ru stretchmate.net
theporndude.com styro.ru
titslove.yopoint.in subj.ukr-lit.com
tnaionline.org sureone.pro
traffic100.com szamponrevita.pl
trion.od.ua tabakur77.com
truebeauty.cc tampabaywatch.org
tattomedia.com
teguh.info
templates.radiodigital.co
terrafootwear.us
tfxiq.com
thefds.net
timecrimea.ru
tizanidine6mg.blogspot.com
tkanorganizma.ru
tksn.ru
top-deal.com.pl
traffic-club.info
trafficgenius.xyz
turbo-suslik.org
twincitiescarservice.com
udsgame.online udsgame.online
uhod-za-sobakoj.ru uhdtv.website
umityangin.net underthesite.com
vadimkravtcov.ru unimodemhalfduplefw.pen.io
vandrie-ict.nl unlimitdocs.net
varikoz24.com uptimebot.net
viktoria-center.ru url-extractor.xyz
vitoriacabos.com url2image.com
vizitki.net vacances-voyages.info
webjam.com veopornogratis.xxx
viagengrarx.com
videochat.world
vip-dom.in
voluumtrk.com
website-speed-up.site website-speed-up.site
website-stealer.nufaq.com wesharepics.info
wholesalejerseyscheapjerseys.us.com works.if.ua
womens-journal.net worldtraveler.world
worst-sites.online xn-----7kcabaipgeakzcss7bjdqdwpfnhv.xn--p1ai
wpsecurity.website xn--80aikhbrhr.net
ww2awards.info xn--d1aifoe0a9a.top
xgames-04.com xtubeporno.net
xlolitka.com xxlargepop.com
xn-----6kccaibs5cb8afhjrfmix2n.xn--p1ai yeartwit.com
xn----7sbaaabaei0cc8aj5bj0bncejx.xn--p1ai ynymnwbm.bloger.index.hr
xn--1-8sbcpb0bdm8k6a.xn--p1ai zahvat.ru
xtraffic.plus zajm-pod-zalog-nedvizhimosti.ru
xvideosporn.biz
yachts-cruise.info
yellocloud.be
yoursearch.me
zeg-distribution.com zeg-distribution.com
zeleznobeton.ru zeroredirect10.com
zetmaster.ru zoogdinsney.com
zvuker.net zoominfo.com
zygophyceous.womanstars.site

10
dev-tools/test_units/ratelimittest-master.txt
View file

@ -581,14 +581,4 @@
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html> </html>

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.178 0; 10.1.0.47 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.08.3284 ### Version: V4.2022.08.3285
### Updated: Thu Aug 11 22:01:27 UTC 2022 ### Updated: Fri Aug 12 10:03:48 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.08.3284 ### Version: V4.2022.08.3285
### Updated: Thu Aug 11 22:01:27 UTC 2022 ### Updated: Fri Aug 12 10:03:48 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##