vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-05 04:00:13 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2022.11.3485 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2022-11-22 10:09:27 +00:00
parent 30a51861d7
commit bb6ce93672
48 changed files with 93282 additions and 93282 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.11.3484 #### Version: V4.2022.11.3485
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.11.3484 #### Version: V4.2022.11.3485
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -14,7 +14,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2022.11.3484 #### Version: V4.2022.11.3485
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

11524
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2022.11.3484 #### Version: V4.2022.11.3485
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

11528
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

11528
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

11528
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

11528
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.29 1; 10.1.0.65 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.29 0; 10.1.0.65 0;
127.0.0.1 0; 127.0.0.1 0;

11528
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.29 1; 10.1.0.65 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.29 0; 10.1.0.65 0;
127.0.0.1 0; 127.0.0.1 0;

11528
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.29 1; 10.1.0.65 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.29 0; 10.1.0.65 0;
127.0.0.1 0; 127.0.0.1 0;

11528
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
3484 3485

11528
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

11528
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.228.81.243 0; 20.59.118.153 0;

11528
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.29 1; 10.1.0.65 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.29 0; 10.1.0.65 0;
127.0.0.1 0; 127.0.0.1 0;

11528
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.29 1; 10.1.0.65 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.29 0; 10.1.0.65 0;
127.0.0.1 0; 127.0.0.1 0;

11528
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.29 1; 10.1.0.65 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.29 0; 10.1.0.65 0;
127.0.0.1 0; 127.0.0.1 0;

11528
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.228.81.243 0; 20.59.118.153 0;

11528
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.228.81.243 0; 20.59.118.153 0;

11528
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.29 1; 10.1.0.65 1;
127.0.0.1 1; 127.0.0.1 1;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
AllSubmitter BackStreet
BetaBot Bolt
Claritybot Dotbot
DBLBot Iblog
Image Fetch Offline Navigator
Minefield SalesIntelligent
ScanAlert SemrushBot
ZyBorg Sqlmap
trendiction.de Webalta
x09Mozilla voyagerx.com

308
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
360Spider 01h4x.com
404enemy
ADmantX ADmantX
Aboundexbot ASPSeek
Acunetix
AfD-Verbotsverfahren
AiHitBot AiHitBot
Aipbot Aipbot
AllSubmitter
Alligator Alligator
AlphaBot Aspiegel
Anarchy99 Asterias
Atomseobot AwarioRssBot
Attach
BDFetch
BackWeb
BacklinkCrawler
Bandit Bandit
BetaBot BetaBot
Bigfoot
Bitacle Bitacle
Blow
Boardreader Boardreader
Buddy Bolt
BuiltWith BuiltWith
Bullseye BuzzSumo
BunnySlippers
Calculon Calculon
Cegbfeieh
CensysInspect CensysInspect
CheTeam
CherryPicker
Citoid
Claritybot
Cliqzbot
Cocolyzebot Cocolyzebot
Collector
Copier
CopyRightCheck CopyRightCheck
Copyscape Copyscape
Cosmos CrunchBot
CrazyWebCrawler DBLBot
Curious DSearch
CyotekWebCopy DTS Agent
DIIbot Demon
DatabaseDriverMysqli
Devil
DigitalPebble
Disco Disco
Discoverybot Discobot
DittoSpyder
DnBCrawler-Analytics DnBCrawler-Analytics
DnyzBot DomainSigmaCrawler
Domains Project
Download Wonder
ECCP/1.0
EMail Siphon
EMail Wolf EMail Wolf
EasyDL
Ebingbong Ebingbong
Ecxi Ecxi
EirGrabber Evil
EroCrawler
Exabot
Express WebPictures Express WebPictures
Extractor
ExtractorPro ExtractorPro
Extreme Picture Finder EyeNetIE
Fimap Ezooms
Firefox/7.0 FHscan
Flunky
Foobot Foobot
FrontPage Freeuploader
G-i-g-a-b-o-t Fuzz
GalaxyBot FyberSpider
Genieo
GermCrawler GermCrawler
Gigabot GetWeb
Go-Ahead-Got-It Go!Zilla
Gotit
GrabNet
GrapeshotCrawler GrapeshotCrawler
HMView GridBot
HTTrack HEADMasterSEO
HTMLparser
Haansoft Haansoft
HaosouSpider HaosouSpider
Hloader Harvest
Havij
Heritrix
IDBTE4M IDBTE4M
IDBot
Iblog Iblog
IlseBot IlseBot
Image Sucker
IndeedBot
Indy Library Indy Library
InfoNaviRobot
InfoTekies
Intelliseek Intelliseek
InternetSeer
Iria Iria
Iskanie Iskanie
IstellaBot IstellaBot
JennyBot JOC Web Spider
JamesBOT
Jbrofuzz
JetCar
Jetty Jetty
JikeSpider Jorgee
Joomla
JustView
Kenjin Spider
Kinza Kinza
Kozmosbot Kozmosbot
LNSpiderguy LWP::Simple
Lanshanbot
Larbin
LeechFTP LeechFTP
LeechGet
LexiBot
Lftp Lftp
Libwhisker
Likse
LinkWalker
Linkbot
LinkextractorPro
LinkpadBot
LinqiaMetadataDownloaderBot LinqiaMetadataDownloaderBot
LinqiaRSSBot Litemage_walker
MFC_Tear_Sample MFC_Tear_Sample
MIIxpc
MJ12bot
MQQBrowser MQQBrowser
MSFrontPage
MTRobot MTRobot
Mag-Net Majestic12
Majestic SEO
Majestic-SEO
MarkMonitor MarkMonitor
MarkWatch MarkWatch
Mass Downloader
Masscan
Mata Hari
MauiBot
Mediatoolkitbot
MegaIndex.ru MegaIndex.ru
Metauri
Microsoft Data Access
Microsoft URL Control Microsoft URL Control
Moblie Safari
Mojolicious Mojolicious
MolokaiBot
Mozlila Mozlila
Musobot Msrabot
NICErsPRO
NPbot NPbot
Name Intelligence Navroad
NearSite Needle
Nessus
Net Vampire Net Vampire
NetAnts
NetLyzer
NetMechanic NetMechanic
Nettrack
Netvibes
NextGenSearchBot
Nibbler
Nikto Nikto
Ninja NimbleCrawler
Nutch Nimbostratus
Octopus Not
OnCrawl
OpenLinkProfiler OpenLinkProfiler
OpenVAS OrangeBot
OrangeSpider
OutclicksBot
PECL::HTTP
POE-Component-Client-HTTP
Page Analyzer
PageAnalyzer PageAnalyzer
PageGrabber PageScorer
PeoplePal Papa Foto
Piepmatz Petalbot
Pimonster Picsearch
Pockey Pixray
ProPowerBot ProPowerBot
Probethenet ProWebWalker
Pu_iN Pump
PxBroker
PyCurl
QueryN Metasearch QueryN Metasearch
RSSingBot RSSingBot
RankActiveLinkBot RankActiveLinkBot
RankingBot RankFlex
Rankivabot
RankurBot RankurBot
Re-re Re-re
Ripper Recorder
Rogerbot RepoMonkey
SEOlyticsCrawler RocketCrawler
ScoutJet SEOprofiler
Scrapy SISTRIX
Screaming ScanAlert
ScreenerBot Scanbot
Seekport Searchestate
Semrush SearchmetricsBot
SemanticJuice
SentiBot SentiBot
SeoSiteCheckup SeoSiteCheckup
Seomoz
Site Sucker
SiteCheckerBotCrawler
SiteExplorer
SiteLockSpider SiteLockSpider
Sitebeam SiteSucker
Siteimprove
Sitevigil Sitevigil
SlySearch
Snake Snake
Snapbot
Sociscraper Sociscraper
Sogou web spider Sogou web spider
SpankBot SpaceBison
Spanner
Spbot
Spinn3r
SputnikBot
Sqlworm Sqlworm
Steeler
Stripper
Sucker Sucker
SuperBot Sucuri
SuperHTTP Surfbot
Suzuran Swiftbot
Teleport Telesoft
The Intraformant Telesphoreo
Thumbor TheNomad
Tracemyfile Toata
Turnitin TwengaBot
TurnitinBot URLy.Warning
Typhoeus UnisterBot
VeriCiteCrawler Vacuum
VidibleScraper VidibleScraper
VoidEYE VoidEYE
Voil WISENutbot
WWW-Collector-E WPScan
Wallpapers WWW::Mechanize
WallpapersHD WWWOFFLE
Wallpapers/3.0
WeSEE WeSEE
Web Enhancer Web Enhancer
Web Pix WebFetch
WebCopier
WebFuck WebFuck
WebImageCollector WebGo IS
WebLeacher WebLeacher
WebSucker
WebWhacker WebWhacker
WebZIP
Webshag
Website Quester Website Quester
WebsiteExtractor WebsiteExtractor
WebsiteQuester Who.is Bot
Webster Wonderbot
Whack Wotbox
Whacker
Widow
Xaldon WebSpider Xaldon WebSpider
Xaldon_WebSpider
Xenu
Zade Zade
Zauba
Zitebot Zitebot
ZoominfoBot ZmEu
ZumBot
ZyBorg ZyBorg
archive.org_bot
arquivo-web-crawler
arquivo.pt arquivo.pt
check1.exe cah.io.community
cognitiveseo clark-crawler
com.plumanalytics coccocbot
crawl.sogou.com
crawler.feedback crawler.feedback
crawler4j
dataforseo.com dataforseo.com
evc-batch gopher
internetVista monitor heritrix
ips-agent iubenda-radar
isitwp.com lwp-request
netEstate NE Crawler meanpathbot
pcBrowser muhstik-scan
oBot
page scorer
polaris version polaris version
ripz
s1z.ru s1z.ru
scalaj-http scalaj-http
scan.lol seocompany.store
seoscanners
seostar seostar
serpstatbot
sitechecker.pro
siteripz siteripz
sogouspider sogouspider
sp_auditbot
spyfu
sysscan
tAkeOut tAkeOut
ubermetrics-technologies.com ubermetrics-technologies.com
voyagerx.com
webmeup-crawler webmeup-crawler
webprosbot x09Mozilla
xpymep1.exe xpymep1.exe

300
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
01h4x.com
360Spider
80legs 80legs
ADmantX ADmantX
AIBOT AIBOT
ALittle Client Aboundexbot
ASPSeek
Aboundex
AhrefsBot AhrefsBot
AiHitBot AiHitBot
Aipbot Aipbot
AllSubmitter Alligator
Anarchie
Anarchy99 Anarchy99
Aspiegel Ankit
Asterias Anthill
Atomseobot
Attach Attach
AwarioRssBot
AwarioSmartBot AwarioSmartBot
BBBike
BLEXBot BLEXBot
Backlink-Ceck BackStreet
BackWeb
Bandit
BatchFTP
Battleztar Bazinga
Bigfoot Bigfoot
BlackWidow Black Hole
Blackboard
Blow Blow
Boardreader Boardreader
Bolt Bolt
Brandprotect Brandprotect
BuiltWith BuiltWith
CATExplorador BunnySlippers
CSHttp BuzzSumo
Calculon CCBot
CazoodleBot
Cegbfeieh Cegbfeieh
CheTeam
ChinaClaw
Chlooe Chlooe
Cliqzbot
Cloud mapping
Cogentbot Cogentbot
Cosmos Copier
CrazyWebCrawler CrunchBot
Curious Custo
DBLBot CyotekWebCopy
DIIbot DTS Agent
DSearch DatabaseDriverMysqli
Demon Demon
Deusu Deusu
Devil
Digincore Digincore
DigitalPebble
Dirbuster Dirbuster
Disco Discoverybot
Dispatch
DittoSpyder DittoSpyder
DomCopBot DnBCrawler-Analytics
DomainSigmaCrawler
DomainStatsBot DomainStatsBot
Domains Project Domains Project
Drip Drip
EMail Siphon
EasyDL
Ebingbong Ebingbong
EroCrawler Ecxi
Exabot Exabot
Extractor ExtLinksBot
EyeNetIE Extreme Picture Finder
Ezooms
FDM FDM
FHscan
Fimap
FlashGet FlashGet
Foobot Flunky
Freeuploader FrontPage
Fuzz FyberSpider
Fyrebot
GT::WWW GT::WWW
Genieo Genieo
GermCrawler
GetRight GetRight
Getintent Getintent
Gigabot
Go!Zilla Go!Zilla
Go-Ahead-Got-It
GrabNet GrabNet
Grabber Grafula
GrapeFX
GridBot GridBot
HEADMasterSEO HEADMasterSEO
HMView Humanlinks
HTMLparser IDBTE4M
HonoluluBot
HybridBot
Iblog Iblog
Id-search Id-search
IlseBot IlseBot
Image Sucker Indy Library
IndeedBot
InfoTekies InfoTekies
InterGET InterGET
Internet Ninja Internet Ninja
InternetSeer Iria
Iskanie
IstellaBot IstellaBot
Jetty JOC Web Spider
JikeSpider Jbrofuzz
JennyBot
Jorgee Jorgee
Keybot Translation-Search-Machine Kenjin Spider
Kozmosbot Keyword Density
LNSpiderguy LWP::Simple
LexiBot LeechFTP
Lightspeedsystems Lftp
Libwhisker
LieBaoFast
Likse
LinkScan
Linkbot
LinkpadBot
LinqiaMetadataDownloaderBot
LinqiaRSSBot LinqiaRSSBot
Lipperhey Spider Lipperhey Spider
Litemage_walker
Lmspider Lmspider
MJ12bot Majestic SEO
MQQBrowser
MSFrontPage
MarkMonitor
MarkWatch MarkWatch
MauiBot Mass Downloader
Mb2345Browser Mb2345Browser
Meanpathbot Meanpathbot
Mediatoolkitbot Mediatoolkitbot
Metauri MegaIndex.ru
Mozlila MicroMessenger
Mr.4x3 Microsoft URL Control
Name Intelligence Minefield
Nameprotect Mister PiX
Moblie Safari
Mojeek
MolokaiBot
Musobot
Navroad
NearSite
Needle
Net Vampire
NetLyzer NetLyzer
NimbleCrawler NetMechanic
Nimbostratus NetZIP
Netcraft
Niki-bot
Nuclei Nuclei
Nutch Nutch
Octopus OpenLinkProfiler
Offline Explorer OpenVAS
Offline Navigator OutclicksBot
PECL::HTTP
POE-Component-Client-HTTP POE-Component-Client-HTTP
Page Analyzer PageAnalyzer
Petalbot Pandalytics
Papa Foto
Pavuk
PeoplePal
Pi-Monster
Picscout
Picsearch
Piepmatz
Pimonster Pimonster
Pixray Pockey
PleaseCrawl
ProPowerBot ProPowerBot
Psbot Pu_iN
PxBroker PxBroker
Quick-Crawler PyCurl
RSSingBot RSSingBot
RankActiveLinkBot RankActive
Rankivabot RankFlex
RealDownload RebelMouse
Reaper
Recorder
RedesScrapy RedesScrapy
RepoMonkey Ripper
SEOkicks RocketCrawler
SEOlyticsCrawler Rogerbot
SEOkicks-Robot
SEOprofiler SEOprofiler
SISTRIX SISTRIX
SalesIntelligent ScoutJet
ScanAlert Scrapy
Scanbot
Screaming
ScreenerBot ScreenerBot
ScrepyBot ScrepyBot
SearchmetricsBot Searchestate
Seekport Seekport
SeoSiteCheckup SemrushBot
Shodan Seomoz
Site Sucker Siphon
SiteExplorer SiteExplorer
SiteSucker SiteSucker
Sitebeam
Siteimprove
Sitevigil Sitevigil
SmartDownload SlySearch
Snoopy Sosospider
Spammen Spammen
Spinn3r Spanner
Sqlworm SputnikBot
Sqworm
Steeler Steeler
SuperHTTP Stripper
Sucuri
Surfbot
SurveyBot SurveyBot
Swiftbot
Szukacz Szukacz
T8Abot Telesoft
TeleportPro
Telesphorep
The Intraformant The Intraformant
TheNomad
Thumbor Thumbor
TightTwatBot URLy Warning
Toweyabot VCI
Trendictionbot Vacuum
Turnitin
TurnitinBot
Typhoeus
Vagabondo
VeriCiteCrawler
Virusdie
VoidEYE
Voltron Voltron
WISENutbot WEBDAV
WPScan
WWW-Collector-E
WWW-Mechanize
WWW::Mechanize
WeSEE WeSEE
Web Auto Web Auto
Web Enhancer
Web Fetch Web Fetch
Web Sauger WebAuto
Web Sucker WebCollage
WebCopier
WebEnhancer WebEnhancer
WebFetch
WebGo IS WebGo IS
WebPix WebLeacher
WebReaper
WebSucker WebSucker
WebWhacker WebZIP
Webalta WebmasterWorldForumBot
WiseGuys Robot WebsiteQuester
Webster
Whatweb
Wonderbot Wonderbot
Wotbox
Xaldon WebSpider
Xenu Xenu
ZoomBot Zauba
archive.org_bot ZoominfoBot
arquivo-web-crawler ZumBot
backlink-check adscanner
cah.io.community arquivo.pt
check1.exe
clark-crawler clark-crawler
coccocbot
cognitiveseo
com.plumanalytics com.plumanalytics
crawler.feedback crawler.feedback
crawler4j crawler4j
demandbase-bot demandbase-bot
facebookscraper
gopher gopher
heritrix heritrix
instabid
internetVista monitor internetVista monitor
iubenda-radar magpie-crawler
linkdexbot netEstate NE Crawler
lwp-trivial oBot
meanpathbot
pcBrowser pcBrowser
polaris version probe-image-size
seobility ripz
seostar s1z.ru
siteripz serpstatbot
sogouspider sitechecker.pro
sp_auditbot sp_auditbot
spyfu spyfu
tAkeOut sysscan
trendiction.com trendiction.de
ubermetrics-technologies.com ubermetrics-technologies.com
voyagerx.com webgains-bot
webmeup-crawler webmeup-crawler
x09Mozilla x09Mozilla
x22Mozilla
zauba.io

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
allblogroll.com 45en.ru
automatic-seo.com dscaas.website
biteg.xyz free-stock-illustration.com
brainboostingsupplements.org mebelcomplekt.ru
freewebs.com mecash.ru
mhi-systems.ru prostitutki-odessa.org
prosmibank.ru repeatlogo.co.uk
rocis.site simul.co
sosdepotdebilan.com skanninge.se
superlist.biz xn----7sbaphztdjeboffeiof6c.xn--p1ai

920
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
000free.us 10bet.com
00it.com 13tabs.com
1000n1.ru 202ch.com
1001desert.com 214jaluwobapef.cf
11pikachu.ru 2345.com
12u.info 24x7-server-support.site
1688.com
256bit.by 256bit.by
2kata.ru 2drittel.de
5000-cotydzien.com 2girls1cup-free.com
5ws.dating-app.ru 34.gs
a.frcls.fr 4pp13.com
aa81bf391151884adfa3dd677e41f94be1.com 888.com
aab94f698f36684c5a852a2ef272e031bb.com aab94f698f36684c5a852a2ef272e031bb.com
acheterviagrafr24.com abovetherivernc.com
acortarurl.es actionnooz.com
acunetix-referrer.com adrenalin-stk.ru
adimmix.com adrunnr.com
admatic.com.tr adventureparkcostarica.com
adobereader-free.ru agardomains.com
adultnet.in agecheckadult.com
advokateg.xyz agroeconom.kz
affrh2015.com ahhjf.com
agysya.ru aimayangzhi.com
albamargroup.com
ald2014.org
alibestsale.com alibestsale.com
alt-servis.ru allpdfmags.net
aludecor.info alphacarolinas.com
ample-awards-today.us ameblo.top
android-style.com amospalla.es
angkortours.vn anal-acrobats.hol.es
anlimebel.kiev.ua ananumous.ru
ap.senai.br animalia-life.club
apple.com-cleaner.systems animalrank.com
approvedlocal.co.za apibrowsesmartne-a.akamaihd.net
arcadeplayhouse.com apidiamondatanet-a.akamaihd.net
arraty.altervista.org apilinkswiftco-a.akamaihd.net
asdfg.pro apioutoboxnet-a.akamaihd.net
atmovs.com apisecretsaucebi-a.akamaihd.net
audiobangout.com appfastplay.com
autonew.biz apptester.tk
aviav.eu arabseyes.com
avtovolop.ru arendatora.ru
azarttoto.com artparquet.ru
asseenontv.ru
atdedinotuho.tk
auto-moto-elektronika.cz
auto.rusvile.lt
automobile-spec.com
aviapanda.ru
avkzarabotok.info
avon-ukraine.com
avtocredit-legko.ru
azbukadiets.ru
azinoofficial777.ru azinoofficial777.ru
baltgem.com b00kmarks.com
bank.uz bagsonsale.online
bannerads.de bala.getenjoyment.net
baoxaydung.com.vn balois.worldbreak.com
bazaronline24.ru bangla-chat-uk-paralud.ga
bear.gotcher.us beta.hotkeys.com
beget.tech betonka.pro
besthomemadepornsites.com billiard-classic.com.ua
beyan.host.sk bioca.org
bfz.biz biocn.dx.am
biglistofwebsites.com bitcoinpile.com
bimatoprost-careprost.com bizfly.info
bingo8888.com biznesrealnost.ru
bitnote.co blackplanet.com
bjgugu.net.ua blog.koorg.ru
blackbabesporn.com bluejays-jerseys.us
blackcurranthumidifiers.site bobba.dzaba.com
blockworld.ru boobsimge.com
bmw.afora.ru bosman.pluto.ro
boleznikogi.com brandedleadgeneration.com
bracketsmackdown.com brendbutik.ru
brainboosting.club
brains2.biz
brainxs.us
browsepulse-a.akamaihd.net browsepulse-a.akamaihd.net
btnativenav.com
buehne-fuer-menschenrechte.de
bumble.cheapwebsitehoster.com bumble.cheapwebsitehoster.com
burger-imperia.com burkesales.com
buyantiviralwp.com buscarfoto.com
buyclomidonlaine.com buy-meds24.com
bvlgaribracelet.xyz buzzurl.jp
californianews.cf bzero1jewelry.net
canacopegdl.com c-gainsbourg.com
candy-glam-hp.com candlewooddentalcentre.com.au
capacitacionyaprendizaje.com carrauterie.be
capsderfudd.tk carstrends2015.com
carson.getenjoyment.net cartierlove2u.com
cbb1smartlist12.click cbcseward.com
cementaresearch.se cgi2.nintendo.co.jp
censys.io chcu.net
cerev.info chiptuninger.com
chatroulette.life chocolateslim-original.com
cheap-trusted-backlinks.com choosecuisine.com
cheapmarmot.online cialiswithoutadoctor.net
check-host.net cienum.fr
children-learningreading.info cigarpass.com
chinaelitecheapjerseys.com cinemaflix.website
chocolateslim-en-espana.com cleanersoft.com
cindymatches.com clickbanksites.info
citetick.com clksite.com
citysecurity.nu cmhomestayagency.com
clickpapa.com cobaltpro.ru
clickprotects.com coldfilm.ru
clicksotrk.com compliance-don.xyz
cocolyze.com
coderstate.com
codysbbq.com
collegeessay19.blogspot.ru
comissionka.net
companies-catalog.com
compliance-alexa.xyz
compliance-fred.top compliance-fred.top
compliance-mark.top compliance-george.top
coop-gamers.ru compliance-george.xyz
cottageofgrace.com compliance-margo.top
compliance-nelson.top
coolyarddecorations.com
corta.co
counter.yadro.ru counter.yadro.ru
cranly.net counterbot.com
credit-online.ws creditmoney.com.ua
creditnation.ru crynet.cc
cubook.supernew.org cupday.com
culad.com custodieva.ru
customboxes4less.com
cutalltheshit.com cutalltheshit.com
cymbaltaandtizanidine.blogspot.com cvety24.by
dalavia.ru czat.wp.pl
dangphoto.trade data-ox.com
daooda.com dayibiao.com
darodar.com db.speedup.gdn
data1.scopich.com dealighted.com
datsun-do.com den-noch24.ru
ddospanel.com deplim.com
degerlund.net design-lands.ru
delitime.info detskie-zabavi.ru
design-ideas.info djstools.com
digital-sale.su dmmspy.com
digitalfaq.com domain.webkeyit.com
dignitasdata.se drugspowerstore.com
dms-sw.ru
dnsrsearch.com
downloadeer.net
dprtb.com
druzhininevgeniy63.blogspot.com druzhininevgeniy63.blogspot.com
dynainbox.com dtnlyss.com
e2click.com eaplay.ru
electrik-avenue.com earthmagic.info
eleimgo.pw easyshoppermac.com
elektrischezigaretten1.blogse.nl ecommerce-seo.org
emergencyneeds.org edge.sharethis.com
eng-lyrics.com editmedios.com
erotag.com efkt.jp
esnm.ru ege-russian.ru
etm-consult.de ekobata.ru
exchangeit.gq election.interferencer.ru
extremez.net elektrischezigarette2.onsugar.com
ezigarettenshop1.yolasite.com elektronischezigarette2.mex.tl
f-loaded.de elektrozigaretten1.tumblr.com
farmingworm.com elkacentr.ru
fatmaelgarny.com elmifarhangi.com
feel-planet.com elvel.com.ua
fenoyl.batcave.net erotik-kostenlos.net
feorina.ru essaypro.com
fermersovet.ru eu-cookie-law.blogspot.com
filunika.com.ru extads.net
fitness-video.net extener.org
fix-website-errors.com f012.de
flashahead.info famix.xyz
folowsite.com fatfasts-4tmz.com
fototravel.eu fefo.gdn
free-share-buttons.blogspot.com ferieboligkbh.dk
free411games.com filefilter.weebly.com
freenode.info firma-legion.ru
freesitetest.com fivedwld.cf
fugarif.ga flavors.me
fym.com.ru flooringinstallation-edmonton.com
galeria-zdjec.com fordsonmajbor.cf
gambarxkata.co forum-engineering.ru
gavuer.ru foto-basa.com
gazoblok.net.ua fr-bearings.ru
generic-pills-online.com franecki.net
gerhardhealer.com franklinfire.co
free-social-buttons.com
free-today.com
freeseedsonline.com
freeuploader.ml
funnypica.com
gamezblox.com
gdzkurokam.ru
get-free-traffic-now.com get-free-traffic-now.com
get-your-social-buttons.info girlgamerdaily.com
getyourimage.club globalscam.ga
ggiaro.com gomusix.com
gobongo.info
golfresa.lucania.se
goodprotein.ru
goosefishpost.bid goosefishpost.bid
gov.yanao.ru gorodservis.ru
gratuitxblcodes.com gratuitbaise.com
guardlink.com gsasearchenginerankerhelp.com
gymi.name gungamesz.com
habermetre.com h2monline.com
hausfrauensex18.com hamilton.ca
hdapp1008-a.akamaihd.net hatdc.org
heliko.no headpharmacy.com
help.tpu.ru hexpilot.com
hikesearch.net heygidday.biz
hitcpm.com himgaws.pw
hoholikik.club hopeonthestreet.co.uk
hol.es house.sieraddns.com
homedecorpicture.us hoverboard360.at
houdom.net hulfingtonpost.com
hoverboardforsaledirect.com hunthillfarmtrust.org
hvd-store.com hyipmanager.in
ilo134uloh.com ico.re
imagefinder.site idealtits.net
images-free.net ideoworld.org
imperia31.ru igru-xbox.net
importchinacoach-teach.com ilovevitaly.ru
impotentik.com imicrovision.com
impresagaia.it infogame.name
infazavr.ru intimshop-fantasy.ru
infektsii.com invitefashion.com
int.search.mywebsearch.com invivo.hu
intelhdgraphicsgtdrive6w.metroblog.com iqupdatetmz.win
investingclub.ru iskalko.ru
iqs.biz.ua
isitpaleo.info
isitwp.com
istizanidineanopiate.blogspot.com
it-max.com.ua it-max.com.ua
ivearchenceinflu.cf itservicesthatworkforyou.com
jackwolfskinoutlet.online janettabridal.com
javxxx18.com javcoast.com
joessmogtestonly.com javlibrary.cc
jovencitas.gratis johannesburgsingles.co.za
justucalling32211123456789.tk journeydownthescale.info
kareliatobacco.ru jwss.cc
keki.info kinky-fetishes.com
kevblog.top kino-rf.ru
keywords-monitoring-success.com kinozapas.org
keywordspay.com
keywordsuggest.org
kino-ecran.ru
kinoflux.net
kiskinhouse.com kiskinhouse.com
kiwe-analytics.com kit-opt.ru
kmd-pto.ru koopilka.com
kndxbkdx.bloger.index.hr kovrenok.ru
koleso24.com.ua
kongoultry.net
kosova.de
kovesszucs.atw.hu
krasnodar.ru krasnodar.ru
kupiproday.com.ua lacloop.info
landinez.co
larger.io larger.io
laudit.ru life-instyle.com
lawyersinfo.org lignofix.ua
letslowbefast.today likrot.com
lider-zhaluzi.kiev.ua littleberry.ru
lion.misba.us littlesexdolls.com
lsex.xyz localmatchbook.com
locatellicorretor.com.br
luckyshop.net.ua luckyshop.net.ua
m5home.ru macdamaged.space
mac-shield.com macfix.life
mactechinfo.info mail.allnews24.in
maju.bluesalt.co make-money-online.com
manimpotence.com makemoneyonline.com
manualterap.roleforum.ru manyresultshub-a.akamaihd.net
map028.com mapquestz.us
markjaybeefractal.com marcogrup.com
mebel-vstroika.ru mebel-ekb.com
meble-bogart.info
medanestesia.ru medanestesia.ru
medkletki.ru mediawhirl.net
medkritika.ru medictube.ru
meet-flirt-dating.com meduza-consult.ru
mega-bony-2017.pl mega-bony-2017.pl
megaindex.ru mega-bony2017.pl
metafilter.com members.ghanaweb.com
mexicosleevegastrectomy.com mirzonru.net
misswell.net mlvc4zzw.space
mnimmigrantrights.net mobioffertrck.com
mnogabukaff.net mojaocena.com
modabutik.ru mokrayakiska.com
moivestiy.biz moncleroutletonline.pw
moje-recenze.cz moneymaster.ru
moneyteam24.com
monthlywinners.com
morepoweronmac.trade morepoweronmac.trade
morf.snn.gr moscow-clining.ru
moscow.online-podarki.com moscow.online-podarki.com
most.gov.iq mrbitsandbytes.com
motherboard.vice.com musezone.su
mrcsa.com.au musicstock.me
muizre.ru muzaporn.com
musezone.ru my-bc.ru
music7s.me my-cash-bot.co
myblogregistercm.tk mydownlodablefiles.com
myindospace.com mykings.pw
mylida.org myra.top
mypets.by
mysexpics.ru
myshopmatemac.com myshopmatemac.com
naturtreenspicerx.pw nacap.ru
newfilmsonline.ru nailsimg.com
nicovideo.jp najaden.no
nippon-bearings.ru narkologiya-penza.ru
nisuturnetdgu.tk national-today-winning-winner.club
noclegonline.info naturalshair.site
nrv.co.za negociosdasha.com
nudepatch.net negral.pluto.ro
nuker.com networkcheck.xyz
o-o-11-o-o.com new7ob.com
o-o-8-o-o.ru nfvsz.com
obiavo.kz obiavo.by
ochistka-stokov.ru obnal.org
odywpjtw.bloger.index.hr
ofanda.com ofanda.com
okayimage.com oklogistic.ru
olympescort.com
omoikiri-japan.ru
one-gear.com one-gear.com
oneshotdate.com oneclickfiles.com
online-x.ru online-hd.pl
onlineporno.site online-sbank.ru
onlineserialy.ru onlinebay.ru
onlyforemont.ru onlyforemont.ru
opinionreelle.com open-odyssey.org
origin-my.ru openmediasoft.com
otbelivanie-zubov.com optikremont.ru
p-business.ru orhonit.com
pavlodar.xkaz.org ostrovtaxi.ru
pc-services.ru paphoselectricianandplumber.com
paradontozanet.ru
parvezmia.xyz
pay2me.pl
pcimforum.com pcimforum.com
pdns.download pdns.cz
pechikamini.ru peekyou.com
pelfind.me pewit.pw
pendelprognos.se
pepperstyle.ru
pigrafix.at pigrafix.at
pila.pl pihl.se
pinkduck.ga pillscheap24h.com
pinsdaddy.com pix-hd.com
pl.aasoldes.fr pl-vouchers.com
pl.id-forex.com platesauto.com
placid-rounded-coast.glitch.me pliks.pl
pladform.ru ploenjitmedia.azurewebsites.net
pobeiranie.pl plohaya-kreditnaya-istoriya.ru
popcash.net plusnetwork.com
pornhive.org poligon.com
pornophoto.xyz poppen-nw.net
portside.cc poquoson.org
porn555.com
pornhub-ru.com
pornosee.info
potolokelekor.ru
preparevideosafesystem4unow.space
presleycollectibles.com presleycollectibles.com
princevc.com priscilarodrigues.com.br
prizesbook.online privacyassistant.net
promoheads.com privatamateure.com
prostitutki-astana.org privatefx.all4invest.info
professionaldieselcare.com
proftests.net
prohoster.info
prpops.com prpops.com
psa48.ru pshare.biz
pushdata.sendpulse.com puteshestvennik.com
qld10000.net py100.ru
q-moto.ru
quebec-bin.com
r-control.ru
rabot.host.sk
raisedseo.com
ranksays.com ranksays.com
razyboard.com ranksonic.info
recipedays.ru rebuildermedical.com
redhotfreebies.co.uk regdefense.com
remont-komputerov-notebook.ru registratciya-v-moskve.ru
remorcicomerciale.ro remontvsamare.su
rentaremotecomputer.com
replicaclub.ru
resultshub-a.akamaihd.net resultshub-a.akamaihd.net
rff-cfal.info rewardpoll.com
rixpix.ru reyel1985.webnode.fr
rocis.site rezeptiblud.ru
rockprogblog.com ribieiendom.no
rubbed.us rimedia.org
russkie-gorki.ru risparmiocasa.bz.it
saddiechoua.com roll123.com
samo-soznanie.ru royal-investments.net
santechnik.jimdo.com roznica.com.ua
sawin.beth.webd.pl rus-teh.narod.ru
sbprabooks.com russia-tao.ru
scanner-brian.top rvtv.ru
scanner-john.top sa-rewards.co.za
searchencrypt.com sabizonline.com
searchkut.com saitevpatorii.com
semalt.com satoristudio.net
semprofile.com saugatuck.com
semrush.com scenarii-1-sentyabrya.uroki.org.ua
seokicks.de searchimage.co
sexpornotales.net searchinquire.com
sextracker.be searchinterneat-a.akamaihd.net
shiksabd.com secret.xn--oogle-wmc.com
shohanb.com secretscook.ru
shop.acim.org see-your-website-here.com
shopcheermakeup.info seemoreresultshu-a.akamaihd.net
shopwme.ru seeresultshub-a.akamaihd.net
sibecoprom.ru segol.tv
sibtest.ru selectads.men
simon3.ru seoprofiler.com
skytraf.xyz sex-tracker.com
slujbauborki.ru sex.hotblog.top
smadihome.com sexgalleries.top
smartadserver.com sexspornotub.com
snworks.com sexy-screen-savers.com
social-button.xyz ship-marvel.co.ua
socialsignals24.com shoplvlv.us
soheavyblog.com si-unique.com
sonata-arctica.wz.cz siha.de
site3.free-share-buttons.com
siteaero.com
skutecznetabletkinaporostwlosow.pl
skylta.com
skypasss.com
sloopyjoes.com
smstraf.ru
snegozaderzhatel.ru
socialmediasuggest.com
sodexo.com
soft-program.com
softxaker.ru
sogimlecal.tk
sohoindia.net
solmarket.by
souvenirua.com souvenirua.com
soviet-portal.do.am special-porn.com
space-worry.ml strfls.com
spinnerco.ca studiofmp.com
spravka130.ru subj.ukr-lit.com
spy-app.info suggest-keywords.com
spymac.net sundrugstore.com
stoki.ru superiends.org
stopnarco.ru thebluffs.com
stretchmate.net theendivechronicles.com
studworks.org theguardlan.com
sugvant.ru titan-cloud.life
superoboi.com.ua tizanidineduringpregnancy.blogspot.com
supers.com.ua tizanidineformigraines.blogspot.com
surgut.zrus.org tizanidinehcl2mgsideeffects.blogspot.com
svbur.ru tizanidinerestlesslegsyndrome.blogspot.com
sweepstakes.rewardit.com tizanidinestreetvalue.blogspot.com
swinginwithme.ru tizanidineusedfor.blogspot.com
t3chtonic.com tjkckpytpnje.com
tabletkinaodchudzanie.com.pl tkanorganizma.ru
tagil.zrus.org tn811.us
tarad.com topcar-krasnodar.ru
tattooreligion.ru topdownloads.ru
taxi-v-eisk.ru topshef.ru
teenbbw.yopoint.in torrentgamer.net
telefonsexkostenlos.tk
thecoral.com.br
tizanidineforopiatewithdrawal.blogspot.com
top-karkas.ru
torrnada.ru torrnada.ru
totu.us totu.info
tourcroatia.co.uk tracksz.co
traffic2cash.org traffic100.com
trafficreceiver.club trafficjunky.com
tri-slona.org trichizobswiv.agddns.net
trk-4.net trubywriting.com
truck-addzilla.life tube8.com
truck-land.life
truebeauty.cc
tubeline.biz
tuckermktg.com tuckermktg.com
turbo-suslik.org tv-spoty.info
twittrading.com tvoystartup.ru
tx41tclega.ru typimga.pw
tyumen.xrus.org
uggbootsoutletsale.us
uginekologa.com uginekologa.com
undergroundcityphoto.com uhodzalijami.ru
ukkala.xyz
umekana.ru
umityangin.net
unmaroll.ya.ru unmaroll.ya.ru
unpredictable.ga upupa.net
valoresito.com utiblog.fr
venerologiya.com valmetrundan.se
verymes.xyz valueclick.com
vesnatehno.ru vasileostrovsky-rayon.ru
videospornogratisx.net vedomstvo.net
velpanex.ru
viberdownload10.com
video-chat.in
videochat.ph
vigrx-original.ru vigrx-original.ru
vinsit.ru vip-file.com
vinylvault.co.uk vitanail.ru
vip-parfumeria.ru vodkoved.ru
viteonlusarezzo.it voltrknc1.com
viveresaniesnelli.it voluumtrk.com
vkak.ru
vladimir.xrus.org
vsesubwaysurfers.com
vvpg.ru
vzglyadriv.kg vzglyadriv.kg
vzlomfb.com w3data.co
wahicbefa31.soup.io wanker.us
watchdogs-2.ru watchmyfb.pl
watsonrealtycorp.com weburlopener.com
webkeyit.com winwotgold.pl
website-stealer.nufaq.com woweb.com.ua
weightatraining.com x-porno.video
win-spy.com xblog.in
wineitudes.wordpress.com xcc24.pl
witherrom55.eklablog.fr xdoza.com
wjgony.com xfluro.com
wma-x.com xingzi-vision.com
woodyguthrie.se xn-----6kccaibs5cb8afhjrfmix2n.xn--p1ai
word-vorlagen.xyz
www.ehscloud.cn
www.souvenirua.com
xbaboon.com
xchangetrak.com
xitjw.info
xn----7sbifcamovvfggw9d.xn--p1ai xn----7sbifcamovvfggw9d.xn--p1ai
xn----8sbarihbihxpxqgaf0g1e.xn--80adxhks xn--e1aggki3c.xn--80adxhks
xn----ctbbcjd3dbsehgi.xn--p1ai xn--h1ahbi.com.ua
xn--80atua3d.xn--p1ai xn--hxazdsfy.blogspot.com
xportvusbdriver8i.snack.ws xvideospornoru.com
xtraffic.plus yebocasino.co.za
xtrafficplus.com yellowproxy.net
xtube.com
yellowfootprints.com
yogamatsexpert.com yogamatsexpert.com
yoopsie.com youtube-downloader.savetubevideo.com
youjizz.com yubikk.info
youradexchange.com zakon-ob-obrazovanii.ru
youtoner.it zarajbuilders.com
yur-p.ru zeleznobeton.ru
zahvat.ru zetgie.com.pl
zebradudka.com zixizop.net.ru
zero1.it zootoplist.com
zerocash.msk.ru zrus.org
zhacker.net zvuker.net
zoogdinsney.com zx6.ru
zscaler.net
zverokruh-shop.cz

480
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
0daymusic.org 00webcams.com
1001watch.com.ua 101lesbian.xyz
108shot.com 2rich4bitches.com
1pamm.ru
2015god.org
21h2o.com
2x2fan.ru 2x2fan.ru
3th.co.in 5kstore.com
3w24.com a.pr-cy.ru
5ws.dating-app.ru actulite.com
8xv8.com adrunnr.com
ads-cool.pro ads-cool.pro
advokateg.xyz aibolita.com
aludecor.info alfabot.xyz
amigobulls.com allboard.xobor.de
anaksma.info alot.com
apessay.com alt-servis.ru
apidiamondatanet-a.akamaihd.net alta-realestate.com
apiitsthirteende-a.akamaihd.net am-se.com
arabsexxxtube.com amateurlivechat.org
arcadepages.com animalrank.com
arendatora.ru api.stathat.com
apifasterlightin-a.akamaihd.net
arkkivoltti.net
ausergrubhof.info
autoblogger24.info autoblogger24.info
autotop.com.ua awaybird.ru
azartclub.org ayakino.net
bcmp.org bannertesting.com
beclean-nn.ru begalka.xyz
bget.ru bestpriceninja.com
bidr.trellian.com bibys.com
bingo8888.com big-boards.info
blacktwhite.com bigcities.org
blogig.org bimatoprost-careprost.com
blogqpot.com binomo.com
bluejays-jerseys.us buqayy0.livejournal.com
bluesman.nu burkesales.com
brains2.biz cah.io.community
buyfriend.ru camdolls.com
buytizanidineonline.blogspot.com candlewooddentalcentre.com.au
bycontext.com cartierlovestore.xyz
calcularpagerank.com cartierreplica.win
candlehandmade.com cartierring.xyz
carabela.com.do casinopinup-wins.com
carmuffler.net cheapestjerseys-wholesale.com
cartechnic.ru cheapestjerseysonwholesale.com
cartierbracelet.xyz christianlouboutinreplica.win
cartierjusteunclou.xyz classiquebijoux.ru
children-learningreading.info claytransformations.info
chinajerseyswholesalecoupons.com co.lumb.co
clips.ua.ac.be coinsspb.com
codq.info collegerentals.com
compliance-donald.xyz com-cleaner.systems
compliance-josh.top companies-catalog.com
coolgramgoods.com consorzioilmosaico.org
covid-schutzmasken.de cookielawblog.wordpress.com
credit-online.ws coolwallpapers-hd.com
darkbooks.org corta.co
db.speedup.gdn country-chic.ru
ddospanel.com creditmoney.com.ua
detskie-konstruktory.ru creditnation.ru
discovertreasure-a.akamaihd.net date-withme.com
documentsite.net dayibiao.com
downloads-whatsapp.com deplim.com
drunkmoms.net dev33.dioniqlabb.se
dtnlyss.com drhomes.biz
dumuelave.xyz driving.kiev.ua
dwomlink.info drivotracker.com
dynainbox.com eachdayisagift.review
dyshagi.ru ecommerce-seo.org
eas-seo.com eleimgo.pw
eduserver.net elektrischezigarette1.blog.pl
ekosmetyki.net.pl elektrischezigaretten1.blogse.nl
elektrischezi.canalblog.com espaceinventoristes.com
en.home-task.com exchangeit.gq
energydiet-info.ru ezofest.sk
errorfixing.space f1nder.org
eu-cookie-law.blogspot.com fakehandbags.xyz
exci.ru filmfanatic.com
farmingworm.com finejewelryshop.ru
fashion-stickers.ru flashbannernow.com
felizporno.com forex.osobye.ru
firma-legion.ru forms-mtm.ru
firstdrugmall.ru forsex.info
floridahuntingfishingadventures.com fr.netlog.com
footbalive.org freejabs.com
foto-telok.net freenode.info
frankofficial.ru freevpn.space
freemaintenancesysforpcandmac.top fym.com.ru
frequiry.com gate5.co.za
fuck-paid-share-buttons.xyz gay-file.com
geoads.com gaz-voshod.ru
gg.zzyjxs.com gazporno.com
ge0ip.com
geckoandfly.com
gigapeta.com gigapeta.com
goldadpremium.com glall.ru
goroda-vsego-mira.ru global-ics.co.za
gunsvicceadadebt.tk goforexvps.com
guod.me gpirate.com
hamacapty.com gratuitbaise.com
headpress.ru gratuitxblcodes.com
healbio.ru gsasearchengineranker.top
hesteel.pl gsasearchenginerankerhelp.com
highstairs-a.akamaihd.net gta-top.ru
historichometeam.com gyffu.com
hit-men.men hao123.com
hitsbox.info hazardky.net
hkladys.com hcate.com
hmmm.cz hdfreeporno.net
howtowhitenteethfast.xyz healgastro.com
ikritikimou.gr hybrid.ru
imagine-ex.co ictizanidinehcl4mg.blogspot.com
import-sales.com ideoworld.org
interfucks.net ido3.com
internet-apteka.ru ie.57883.net
investyb.com imagui.eu
ipornox.xxx immobiliaremassaro.com
jerseyschinabizwholesale.us importchinacoach-teach.com
jobmarket.com.ua indiakino.net
justbcause.com io9.com
kanimage.com jerseysbizwholesalecheap.com
kino-key.info jwss.cc
kinoflux.net kashubadesign.ru
koronirealestate.gr kometars.xyz
kurwa.win konkursowo-24.pl
lescinq.com kredit-blog.ru
linkbolic.com labplus.ru
maju.bluesalt.co laparfumotec.com
mansiondelrio.co leboard.ru
mararoom.ru lider-zhaluzi.kiev.ua
mathgym.com.au liumimgx.pw
mebeldekor.com.ua live-sexcam.tk
med-zdorovie.com.ua liverpool.gsofootball.com
mega-polis.biz.ua lostaruban.com
mesto-x.com marketland.ml
mexicosleevegastrectomy.com medmajor.ru
mobilemedia.md members.ghanaweb.com
monthlywinners.com metabar.ru
moomi-daeri.com mini.7zap.com
mototsikl.org mjchamonix.org
mundoaberrante.com mmofreegames.online
music7s.me moesexy.com
myblogregistercm.tk moneytop.ru
myphotopipe.com morpicert.pw
mysex21.com muizre.ru
narkologiya-orel.ru myplaycity.com
net-profits.xyz nalogovyykodeks.ru
nfljerseyscheapchinabiz.com nardulan.com
nosecret.com.ua natali-forex.com
noumeda.com naturalpharm.com.ua
november-lax.com needtosellmyhousefast.com
nucia.biz.ly networkcheck.xyz
ofanda.com newstraveller.ru
offer.camp
okout.ru okout.ru
old-rock.com online-templatestore.com
onclickpredictiv.com onlyporno.ru
onetravelguides.com onlythegames.com
onlinemeetingnow.com parajumpersjakkesalgnorge.info
ooo-olni.ru pcgroup.com.uy
ops.picscout.com pdns.download
orsonet.ru perm-profnastil.ru
paradontozanet.ru photo.houseofgaga.ru
partners-ship.pro
perfectpracticeweb.com
petitions.whitehouse.gov
picture-group.com
pizza-imperia.com pizza-imperia.com
pl-top.pl
pl.id-forex.com pl.id-forex.com
pod-muzyku.club platesauto.com
porndl.org ploenjitmedia.azurewebsites.net
porndroids.com pogosh.com
pornoblood.com polska-poezja.com
pornogratisdiario.com pornhubforum.tk
pornohub.me porno-video-chati.ru
pornstartits.xblog.in presleycollectibles.com
powitania.pl prizeestates.cricket
prchecker.info prom23.ru
prizestohandle.club pronorm.fr
producm.ru putevka24.ru
prostitutki-kharkova.org qpypcx.com
qld10000.net qwesa.ru
rabot.host.sk ranksignals.com
ragecash.com ratemodels.net
rcb101.ru razorweb-a.akamaihd.net
reeyanaturopathy.com rcpmda.ikan1080.xyz
regdefense.com recinziireale.com
registrydomainservices.com
reklama-i-rabota.ru
rentalcarnavi.info rentalcarnavi.info
rentehno.ru rewardit.com
research.ifmo.ru rubanners.com
rogervivierforsale.com sajatvelemeny.com
rospromtest.ru samoiedo.it
rvi.biz sanyuprojects.com
scanmyphones.com sarahmilne.top
scanner-fred.top sbprabooks.com
scanner-jess.top screentoolkit.com
scanspyware.net seokicks.de
sdelatmebel.ru simplesite.com
seorussian.ru simply.net
sexytrend.ru sitevalued.com
shoppingmiracles.co.uk sladkoevideo.com
shtaketniki.ru slayerlife.com
sicfor.bcu.cc slim.sellany.ru
signx.info softomix.net
simul.co statustroll.com
siteonomy.com stauga.altervista.org
slutloadlive.com stefanbakosab.se
smichovbike.cz sucsesofinspiration.com
snworks.com sumo.com
sockshare.net szucs.ru
speechfoodie.com takeflyte.com
srdrvp.com teenforporn.com
srgwebmail.nl teguh.info
steebook.com telesvoboda.ru
strana-solnca.ru thefarmergame.com
strongsignal-a.akamaihd.net tizanidineandhydrocodone.blogspot.com
sukirgenk.dvrlists.com tizanidinedruginteractions.blogspot.com
supermodni.com.ua tizanidineduringpregnancy.blogspot.com
teesdaleflyballclub.co.uk tizanidineformigraines.blogspot.com
telefonsexi.com tjkckpytpnje.com
tfxiq.com tootoo.to
tizanidine4mgprice.blogspot.com top-l2.com
tk-assortiment.ru topquality.cf
tnctrx.com
topappspro.com
topvidos.ru topvidos.ru
tour-line.net torture.ml
tourismvictoria.com trichizobswiv.agddns.net
trafficgenius.xyz triplepanda.xyz
turkeyreport.tk trubywriting.com
ukrtextbook.com truebeauty.cc
urlopener.com universals.com.ua
vacances-voyages.info uptimebot.net
videojam.tv via-energy-acquistare.com
visionwell.com.cn vitanail.ru
vroze.com viveresaniesnelli.it
webradiology.ru voloo.ru
whiteelephantwellington.com voluumtracker1.com
wineitudes.wordpress.com vrotike.ru
www.event-tracking.com wcb.su
wiosenny-bon-1500.pl
worldtraveler.world
wowas31.ucoz.ru
wttavern.com
www.solartek.ru
wygraj-teraz.com wygraj-teraz.com
wzgyyq.com x-diesel.com
xblog.in xblognetwork.com
xcombear.ru xn----7sbaphztdjeboffeiof6c.xn--p1ai
xn--24-glceagatoq7c2a6ioc.xn--p1ai xn----itbeirbjbi7bc6bh2d.xn--p1ai
xn--80ahvj9e.xn--p1ai xn--80ak6aa92e.com
xuki.us xtraffic.plus
xxart.ru xxxkaz.org
xxxasianporn.net yourporn.com
yoursearch.me
youtuhe.com
zeroredirect11.com
zeroredirect8.com
zetgie.com.pl

10
dev-tools/test_units/ratelimittest-beta.txt
View file

@ -581,14 +581,4 @@
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html> </html>

10
dev-tools/test_units/ratelimittest-master.txt
View file

@ -581,4 +581,14 @@
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html> </html>

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.29 0; 10.1.0.65 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.11.3484 ### Version: V4.2022.11.3485
### Updated: Mon Nov 21 22:01:15 UTC 2022 ### Updated: Tue Nov 22 10:03:34 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.11.3484 ### Version: V4.2022.11.3485
### Updated: Mon Nov 21 22:01:15 UTC 2022 ### Updated: Tue Nov 22 10:03:34 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##