vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-10 15:34:24 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2022.12.3530 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2022-12-28 22:07:16 +00:00
parent fa47575937
commit f624004136
46 changed files with 89284 additions and 89284 deletions
Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.12.3529 #### Version: V4.2022.12.3530
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.12.3529 #### Version: V4.2022.12.3530
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -14,7 +14,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2022.12.3529 #### Version: V4.2022.12.3530
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

11026
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2022.12.3529 #### Version: V4.2022.12.3530
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

11030
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

11030
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

11030
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

11030
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.123 1; 10.1.0.115 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.123 0; 10.1.0.115 0;
127.0.0.1 0; 127.0.0.1 0;

11030
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.123 1; 10.1.0.115 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.123 0; 10.1.0.115 0;
127.0.0.1 0; 127.0.0.1 0;

11030
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.123 1; 10.1.0.115 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.123 0; 10.1.0.115 0;
127.0.0.1 0; 127.0.0.1 0;

11030
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
3529 3530

11030
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

11030
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
13.64.213.130 0; 104.45.204.82 0;

11030
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.123 1; 10.1.0.115 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.123 0; 10.1.0.115 0;
127.0.0.1 0; 127.0.0.1 0;

11030
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.123 1; 10.1.0.115 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.123 0; 10.1.0.115 0;
127.0.0.1 0; 127.0.0.1 0;

11030
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.123 1; 10.1.0.115 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.123 0; 10.1.0.115 0;
127.0.0.1 0; 127.0.0.1 0;

11030
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
13.64.213.130 0; 104.45.204.82 0;

11030
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
13.64.213.130 0; 104.45.204.82 0;

11030
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.123 1; 10.1.0.115 1;
127.0.0.1 1; 127.0.0.1 1;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
AiHitBot Getintent
Cocolyzebot LinkextractorPro
Internet Ninja MarkMonitor
MJ12bot Morfeus Fucking Scanner
Offline Explorer Nutch
Re-re Scrapy
Sucker ScreenerBot
Toweyabot Turingos
WebCopier WEBDAV
check1.exe Woobot

284
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
01h4x.com
404enemy 404enemy
80legs
ADmantX ADmantX
AIBOT
ALittle Client ALittle Client
Abonti ASPSeek
Aboundex
Aboundexbot Aboundexbot
Acunetix AhrefsBot
AfD-Verbotsverfahren
Aipbot
AllSubmitter AllSubmitter
AlphaBot Alligator
Anarchy Anarchie
Aspiegel
Atomseobot Atomseobot
Attach AwarioRssBot
AwarioSmartBot AwarioSmartBot
BBBike
BDFetch BDFetch
Backlink-Ceck BackStreet
Bandit BackWeb
Blackboard BacklinkCrawler
Boardreader Battleztar Bazinga
BetaBot
Black Hole
Blow
Bolt
Brandwatch
BuiltBotTough BuiltBotTough
BunnySlippers BuiltWith
CATExplorador BuzzSumo
CCBot CherryPicker
CODE87 ChinaClaw
Calculon Chlooe
CheeseBot Cogentbot
Citoid Collector
Cliqzbot
Copier
CopyRightCheck
Copyscape
Cosmos
Craftbot
Crawling at Home Project Crawling at Home Project
Crescent CrazyWebCrawler
Custo Custo
DBLBot
DIIbot DIIbot
DSearch Devil
DTS Agent
DatabaseDriverMysqli
DigitalPebble DigitalPebble
Discobot Dirbuster
Disco
Dispatch
DittoSpyder DittoSpyder
DnBCrawler-Analytics DomainCrawler
DomCopBot
Dragonfly Dragonfly
EasyDL Drip
Ebingbong
EirGrabber EirGrabber
Evil EroCrawler
Express WebPictures Extractor
ExtractorPro ExtractorPro
Extreme Picture Finder FHscan
Fimap
Firefox/7.0 Firefox/7.0
Freeuploader Flunky
G-i-g-a-b-o-t Foobot
GalaxyBot Genieo
GermCrawler
GetRight
GetWeb GetWeb
Go-Ahead-Got-It Go!Zilla
Grabber Grabber
Grafula Grafula
GrapeFX GrapeFX
HMView GridBot
HTTrack HTTrack
Harvest Haansoft
HaosouSpider
Havij Havij
Heritrix
Hloader
HonoluluBot HonoluluBot
Humanlinks
IDBTE4M IDBTE4M
IDBot
IRLbot IRLbot
Iblog
Id-search
IlseBot IlseBot
IndeedBot IndeedBot
Indy Library
InfoNaviRobot InfoNaviRobot
Intelliseek Intelliseek
Iria InternetSeer
IstellaBot
JOC Web Spider JOC Web Spider
JamesBOT JamesBOT
JikeSpider
Joomla
JustView JustView
LeechFTP Larbin
LeechGet Lightspeedsystems
LinkScan Likse
LinkWalker LinkWalker
LinkextractorPro Linkbot
LinqiaMetadataDownloaderBot LinkpadBot
Litemage_walker LinksManager
LinqiaScrapeBot
Lipperhey
Ltx71
MFC_Tear_Sample
MIIxpc
MJ12bot MJ12bot
MQQBrowser MSFrontPage
MSIECrawler MSIECrawler
Mag-Net Mag-Net
Mail.RU_Bot
Majestic SEO Majestic SEO
Majestic-SEO Majestic12
MarkMonitor
MarkWatch
Mass Downloader Mass Downloader
MauiBot Mb2345Browser
MeanPath Bot Meanpathbot
Mediatoolkitbot Metauri
MegaIndex.ru Microsoft Data Access
MicroMessenger
Microsoft URL Control
Mister PiX
Moblie Safari
Mojeek Mojeek
Mojolicious
MolokaiBot
Morfeus Fucking Scanner Morfeus Fucking Scanner
Mozlila Mozlila
Musobot Musobot
NPbot NICErsPRO
NearSite NetMechanic
NetAnts NetZIP
NetLyzer
NetSpider
Netcraft Netcraft
Nettrack Nettrack
Nibbler
Niki-bot Niki-bot
Offline Explorer Nikto
Ninja
Nmap
Nutch
Offline Navigator Offline Navigator
OnCrawl
OpenLinkProfiler OpenLinkProfiler
OpenVAS
Openfind
Openvas Openvas
OrangeBot PECL::HTTP
PHPCrawl
POE-Component-Client-HTTP POE-Component-Client-HTTP
PageAnalyzer
PageGrabber PageGrabber
PageScorer
PageThing.com
Pandalytics Pandalytics
Panscient Papa Foto
Pavuk Pavuk
Petalbot Pimonster
Picsearch
PictureFinder
Pixray Pixray
PleaseCrawl PleaseCrawl
ProWebWalker ProWebWalker
Probethenet
Psbot Psbot
Pump Pump
QueryN Metasearch
Quick-Crawler
RSSingBot RSSingBot
RankActive
RankActiveLinkBot RankActiveLinkBot
Rankivabot RankurBot
Re-re
ReGet
RealDownload
Recorder Recorder
RedesScrapy RepoMonkey
SBIder RocketCrawler
SEOkicks
SEOlyticsCrawler
SEOprofiler
SISTRIX SISTRIX
ScanAlert ScanAlert
Scanbot Scanbot
Screaming Scrapy
ScrepyBot
SearchmetricsBot SearchmetricsBot
Seekport
SemanticJuice SemanticJuice
Semrush
SemrushBot
SentiBot SentiBot
SeoSiteCheckup
Seomoz
Siphon
SiteExplorer SiteExplorer
Sitebeam SiteLockSpider
Siteimprove Siteimprove
Sitevigil Sitevigil
Snake Snake
Snapbot Snapbot
Snoopy Snoopy
SocialRankIOBot SocialRankIOBot
Sociscraper
Sogou web spider Sogou web spider
Sottopop
Spammen
Spbot
Spinn3r Spinn3r
Sqlmap Sqlworm
Sqworm
Stripper Stripper
Suzuran Sucker
SuperBot
SurveyBot
Swiftbot Swiftbot
T8Abot T0PHackTeam
Teleport
TeleportPro TeleportPro
Telesoft
Telesphoreo
Telesphorep Telesphorep
Turingos The Intraformant
TurnitinBot TightTwatBot
Trendiction
Trendictionbot
Typhoeus
URLy Warning URLy Warning
URLy.Warning
V-BOT V-BOT
VB Project Vacuum
Vagabondo
VelenPublicWebCrawler VelenPublicWebCrawler
Virusdie WISENutbot
Voil
Voltron
WASALive-Bot
WPScan WPScan
WWW-Collector-E WallpapersHD
WWW::Mechanize
WWWOFFLE
WeSEE WeSEE
Web Fetch Web Collage
WebBandit
Web Enhancer Web Enhancer
WebFetch WebAuto
WebLeacher WebCopier
WebSucker WebImageCollector
WebSauger
Webalta
WebmasterWorldForumBot
Website Quester Website Quester
Whacker WiseGuys Robot
WinHTTrack
Wonderbot Wonderbot
Wprecon
Xaldon WebSpider Xaldon WebSpider
Xaldon_WebSpider
Xenu Xenu
YoudaoBot Zeus
Zade ZmEu
Zauba
ZoomBot
ZoominfoBot ZoominfoBot
ZumBot adscanner
ZyBorg archive.org_bot
arquivo.pt
cah.io.community cah.io.community
check1.exe cognitiveseo
com.plumanalytics com.plumanalytics
crawler.feedback crawler.feedback
crawler4j crawler4j
demandbase-bot
domainsproject.org domainsproject.org
heritrix eCatch
instabid
internetVista monitor internetVista monitor
ips-agent ips-agent
isitwp.com lwp-request
linkdexbot
lwp-trivial lwp-trivial
meanpathbot magpie-crawler
oBot
page scorer page scorer
pcBrowser plumanalytics
polaris version polaris version
ripz ripz
satoristudio.net s1z.ru
scan.lol scan.lol
seobility seoscanners
seostar
serpstatbot serpstatbot
sitechecker.pro
spyfu spyfu
ubermetrics-technologies.com tAkeOut
webprosbot voyagerx.com
zauba.io zauba.io
zgrab zgrab

306
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
01h4x.com 01h4x.com
360Spider
404checker
404enemy 404enemy
ADmantX AIBOT
Aboundexbot ALittle Client
AhrefsBot Aboundex
AiHitBot AfD-Verbotsverfahren
Alexibot Alligator
AllSubmitter Ankit
Anarchy Anthill
Asterias Attach
Atomseobot
AwarioRssBot
AwarioSmartBot
BDCbot
BLEXBot BLEXBot
BackStreet BackStreet
Barkrowler Backlink-Ceck
Battleztar Bazinga Badass
Bigfoot Bandit
Blow Black Hole
BlowFish Brandprotect
BuiltWith Brandwatch
Bullseye Buck
Buddy
BuiltBotTough
BunnySlippers BunnySlippers
BuzzSumo BuzzSumo
CATExplorador CSHttp
CCBot CensysInspect
Calculon CheTeam
Cegbfeieh
CheeseBot CheeseBot
Citoid Chlooe
Claritybot
Cliqzbot Cliqzbot
Cloud mapping
Cocolyzebot
Cogentbot Cogentbot
Collector Collector
Copier Copyscape
Craftbot
CrazyWebCrawler CrazyWebCrawler
CrunchBot
Curious Curious
DBLBot DataCha0s
DIIbot DatabaseDriverMysqli
DSearch
Demon Demon
Devil
Disco
Discobot Discobot
Discoverybot DnBCrawler-Analytics
DnyzBot DnyzBot
DomainCrawler
DomainSigmaCrawler DomainSigmaCrawler
Dotbot
Download Wonder Download Wonder
Drip Drip
EMail Siphon
EasyDL EasyDL
EirGrabber EroCrawler
Evil Evil
Express WebPictures
ExtLinksBot ExtLinksBot
Extractor Extreme Picture Finder
ExtractorPro Fimap
FDM FlashGet
Flunky Foobot
FyberSpider FrontPage
G-i-g-a-b-o-t Fuzz
Fyrebot
GalaxyBot
Genieo Genieo
GetRight
GetWeb GetWeb
Go!Zilla Getintent
GoZilla GoZilla
Grabber Gotit
Grafula
GrapeFX
GrapeshotCrawler
GridBot GridBot
HEADMasterSEO
HTMLparser HTMLparser
HTTP::Lite HTTP::Lite
HTTrack
Haansoft Haansoft
Heritrix Harvest
Hloader Havij
HonoluluBot
Humanlinks Humanlinks
HybridBot
IDBTE4M
IlseBot IlseBot
Image Fetch Image Fetch
Image Sucker
IndeedBot IndeedBot
InfoTekies
Intelliseek Intelliseek
InterGET
Internet Ninja
InternetSeer
Iskanie
IstellaBot
JOC Web Spider
JamesBOT JamesBOT
Jbrofuzz Jbrofuzz
JennyBot JennyBot
Joomla
Jorgee
JustView JustView
Jyxobot
Kinza Kinza
Kozmosbot
LNSpiderguy LNSpiderguy
LWP::Simple Lanshanbot
Leap Larbin
LeechGet Libwhisker
LibWeb
LieBaoFast
Lightspeedsystems Lightspeedsystems
Likse
LinkWalker LinkWalker
LinkextractorPro LinkextractorPro
LinkpadBot
LinksManager LinksManager
LinqiaMetadataDownloaderBot
LinqiaRSSBot LinqiaRSSBot
LinqiaScrapeBot
Lipperhey
Lipperhey Spider
Lmspider Lmspider
MFC_Tear_Sample
MIDown tool
MJ12bot MJ12bot
Mail.RU_Bot MSIECrawler
Magnet
Majestic SEO Majestic SEO
Majestic-SEO Majestic12
MarkMonitor
Mass Downloader Mass Downloader
Masscan Masscan
MauiBot
MeanPath Bot
Metauri Metauri
Microsoft URL Control Microsoft URL Control
Moblie Safari Minefield
Mr.4x3 Mojolicious
NPbot Morfeus Fucking Scanner
Navroad Mozlila
Net Vampire NICErsPRO
Name Intelligence
Nameprotect
NearSite
Nessus
NetAnts
NetLyzer
NetMechanic
NetZIP NetZIP
Netcraft Netcraft
NextGenSearchBot Nettrack
Not Nikto
Octopus NimbleCrawler
Offline Explorer Ninja
Offline Navigator Nmap
OpenVAS
Openfind Openfind
OrangeBot Openvas
PHPCrawl
POE-Component-Client-HTTP
Page Analyzer Page Analyzer
PageScorer PageGrabber
PageThing.com
Papa Foto Papa Foto
Pavuk
Petalbot Petalbot
Pi-Monster Pockey
Picscout ProPowerBot
Piepmatz
Pixray
Probethenet Probethenet
Psbot
Pu_iN Pu_iN
PxBroker
PyCurl PyCurl
QueryN Metasearch QueryN Metasearch
RSSingBot RankingBot
RankActiveLinkBot
Rankivabot Rankivabot
RealDownload ReGet
Recorder RepoMonkey
Rogerbot Ripper
SEOkicks-Robot RocketCrawler
SEOkicks
SEOlyticsCrawler
SEOprofiler SEOprofiler
SISTRIX SISTRIX
SalesIntelligent ScanAlert
Scrapy Scanbot
Screaming
ScreenerBot
ScrepyBot
Searchestate Searchestate
Seekport
SemanticJuice SemanticJuice
Semrush Semrush
SeoSiteCheckup SentiBot
Siphon SeobilityBot
SiteSnagger
SiteSucker SiteSucker
Sitebeam Siteimprove
SmartDownload SlySearch
Sociscraper
Sogou web spider Sogou web spider
Sosospider
Sottopop
SpaceBison
Spammen Spammen
Spanner
SputnikBot SputnikBot
Sqworm
Stripper Stripper
SuperBot Surfbot
SuperHTTP
SurveyBot SurveyBot
Suzuran
T0PHackTeam T0PHackTeam
T8Abot
Telesphoreo Telesphoreo
Telesphorep Telesphorep
TightTwatBot
Titan Titan
Toata Twice
Tracemyfile
Trendiction
Trendictionbot
True_Robot
Turnitin
TwengaBot
Typhoeus
URLy Warning URLy Warning
UnisterBot
Upflow
V-BOT
VB Project
VCI VCI
Vagabondo Vacuum
VeriCiteCrawler
VidibleScraper
Voltron
WEBDAV WEBDAV
WISENutbot WPScan
WWWOFFLE WWW-Collector-E
WeSEE WWW::Mechanize
WebBandit Wallpapers
WebFuck Web Auto
Web Pix
Web Sucker Web Sucker
WebImageCollector
WebLeacher
WebSauger
WebWhacker WebWhacker
WebZIP Webster
Webalta
WebmasterWorldForumBot
Webshag
WebsiteExtractor
Whack Whack
Whatweb
Who.is Bot Who.is Bot
WinHTTrack Widow
WiseGuys Robot Wonderbot
Woobot YoudaoBot
Wprecon Zeus
Xaldon_WebSpider
Zauba
Zitebot Zitebot
ZmEu ZumBot
ZoominfoBot
ZyBorg
archive.org_bot
arquivo-web-crawler arquivo-web-crawler
backlink-check backlink-check
cah.io.community check1.exe
coccocbot coccocbot
com.plumanalytics crawl.sogou.com
crawler.feedback eCatch
crawler4j gopher
demandbase-bot heritrix
isitwp.com iubenda-radar
linkdexbot linkdexbot
lwp-trivial lwp-trivial
mediawords magpie-crawler
oBot polaris version
probe-image-size
ripz
s1z.ru s1z.ru
satoristudio.net satoristudio.net
seobility scalaj-http
seocompany.store seocompany.store
seoscanners
seostar seostar
serpstatbot sexsearcher
spyfu
sysscan sysscan
tAkeOut tAkeOut
trendiction.com trendiction.com
webgains-bot voyagerx.com
xpymep1.exe webmeup-crawler
zauba.io
zgrab

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
atelielembrancaqueencanta.com.br 1001desert.com
bloggen.be alienwheels.de
compliance-checker.info bdsmgalls.net
dtnlyss.com handsandlegs.ru
interfucks.net mir-business-24.ru
mysexpics.ru onlineku.com
resant.ru positive2b.ru
vacances-voyages.info taqplayer.info
wholesalejerseysgaa.com verymes.xyz
xn--80ab4aa2g.xn--p1ai vip-file.com

926
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
0daymusic.org 08800.top
10bet.com 101flag.ru
20pascals.nl 1314dh.com
24x7-server-support.site 14b.info
2rich4bitches.com 1688.com
3th.co.in 1webmaster.ml
45en.ru
4kpics.rocks 4kpics.rocks
4webmasters.org 5tey7463.weebly.com
5forex.ru 72-news.com
7makemoneyonline.com 8gold.com
9med.net 8jn.dating-app.ru
a14download.com
aa625d84f1587749c1ab011d6f269f7d64.com
aa8b68101d388c446389283820863176e7.com
aa9d046aab36af4ff182f097f840430d51.com
aab94f698f36684c5a852a2ef272e031bb.com
aac500b7a15b2646968f6bd8c6305869d7.com aac500b7a15b2646968f6bd8c6305869d7.com
aasoldes.fr adminshop.com
abovetherivernc.com admitad.com
admatic.com.tr adprotect.net
adsfresh.men adservme.com
adult3dgames.com adultfriendfinder.com
agardomains.com adverster.com
albamargroup.com aero2.ru
alert-fdm.xyz algarveglobal.com
alf-img.com all4invest.ru
aliexpresscashback.club alloysteel.ru
allornamenti.com ameblo.jp
allsilver925.co.il animaltoplist.com
andpolice.com anonymizeme.pro
angel1777.kz apiitsthirteende-a.akamaihd.net
anonymous-redirect.com apple.com-webbrowsing-security.science
anti-virus-removal.info appmsr.org
apimegabrowsebiz-a.akamaihd.net appsaurus.com
apimountainbikei-a.akamaihd.net arcadeplayhouse.com
apiportalmorecom-a.akamaihd.net arquapetrarca.info
apiwebwebgetcom-a.akamaihd.net artdeko.info
appleid-verification.com arvut.org
architecturebest.com as5000.com
arenda-avtoprokat-krasnodar.ru atmagroup.ru
arendatora.ru autotrends.today
artel116.ru aviapanda.ru
asiavirtualsolutions.com aviav.org
asrv-a.akamoihd.net bag77.ru
atlant-auto.info bagcionderlab.com
atleticpharm.org baikaleminer.com
auto4style.ru barnfurnituremart.com
autowebmarket.com.ua bausparen.bz.it
avkzarabotok.info bdsmgalls.net
ayanaspa.com beetpics.pw
babespcs.com bestssaker.com
bala.getenjoyment.net bimatoprost-careprost.com
balkanfarma.ru bimmerpost.com
bazaronline24.ru bitcoinremote.com
bensbargains.net bjgugu.net.ua
beremenyashka.com bkns.vn
best-deals-products.com blog.axant.it
bestmarriages.com bloggers.nl
bestpriceninja.com bobba.dzaba.com
bestwebsiteawards.com boc.kz
bet365.com bocoarchives.org
biketank.ga boo-arts.com
blacktwhite.com bpro1.top
blackwitchcraft.ru bradleylive.xyz
blogporn.in builtwith.com
blogrankers.com
brains2.biz
brainsandeggs.blogspot.com
bristolhotel.com
budpost.com.ua
bukleteg.xyz bukleteg.xyz
bumascloset.com bumble.cheapwebsitehoster.com
bumskontakte.org bus-offer.com
buqyxa.rincian.info butstrap.space
burger-tycoon.com buttons-for-your-website.com
business-made-fun.com
buyfriend.ru
buynorxx.com
buytizanidineonlinenoprescription.blogspot.com buytizanidineonlinenoprescription.blogspot.com
buzz-porno.info buyviagraa.blogspot.com
canacopegdl.com cartierlove.xyz
candlehandmade.com catalogs-parts.com
candytiner.com cementaresearch.se
cannibalcheerleader.com cenoval.ru
carabela.com.do certifywebsite.win
carloans.com cezartabac.ro
carstrends2015.com cgi2.nintendo.co.jp
cartierlovebracelet.xyz cherubinimobili.it
cbox.ws chorus.terakeet.com
celejihad.info clayvasedesigns.tk
cenokos.ru cleanpcnow.com
centrumcoachingu.com clevernt.com
cheap-pills-norx.com clickbank.net
cheapmoncler.pw co.lumb.co
checkpagerank.net codq.info
chinajerseyswholesalecoupons.com coin-hive.com
cicaki.net coinsspb.com
clickbanksites.info colobit.biz
clicksor.net compliance-brian.xyz
clothesforcash.com compliance-don.xyz
club-lukojl.ru compliance-ivan.xyz
club-samodelkin.ru compliance-julia.top
coderstate.com compliance-mark.top
com-onlinesupport.site compliance-walt.top
cometorussia.net confib.ifmo.ru
compliance-irvin.top construmac.com.mx
cookie-law-enforcement-ff.xyz coolingoods.com
copyrightclaims.org coslab.club
cosmetic.donna7753191.ru crest3d.ru
courtshipgift.com cwetochki.ru
crynet.cc cyclobenzaprinevstizanidine.blogspot.com
customerguru.in cyse.tk
cymbaltaandtizanidine.blogspot.com delayreferat.ru
d-black.bz deluxedumps.com
dailyfinancefix.com demon-tweeks.com
day-news.info design-ideas.info
descargar-musica-gratis.net detki-opt.ru
detskie-zabavi.ru
deutschland123.de
digilander.libero.it
digitalassetmanagement.site digitalassetmanagement.site
doctissimo.fr diminishedvalueoforegon.com
documentbase.net div.as
domain2008.com divku.ru
domaineaneblanc.com documentsite.net
domznaniy.ru dogsrun.net
dood.live dostavka-v-krym.com
doublepimp.com dostavka-v-ukrainu.ru
download-wallpaper.net dotnetdotcom.org
druzhbany.ru drunkenstepfather.com
e-avon.ru drupa.com
earl-brown.info dwomlink.info
eas-seo.com ee77ee.com
efkt.jp eets.net
elektrischeziga.livejournal.com eksprognoz.ru
elektrozigaretten1.webs.com elektrischezi.canalblog.com
eluxer.net elektrischezigarette1.blog.pl
emergencyneeds.org elektronischezigarette2.mex.tl
emerson-rus.ru eropho.net
erotag.com
es5.com
escortplius.com escortplius.com
eu-cookie-law.blogspot.com essay-writing.work
evrotekhservis.ru eupornstar.info
ewebarticle.info extstat.com
exchangeit.gq eyes-on-you.ga
exoneration-project.us eyessurgery.ru
expertblog.info ezigaretteshop2.mywapblog.com
extlinks.com f5mtrack.com
faithe.top famix.xyz
falcoware.com fashionavenuegame.com
falllow.gq fast-torrent.ru
farmprofi.net favorcosmetics.com
fashion-mk.net feargames.ru
fastcrawl.com fellowshipoftheminds.com
faz99.com fickkontakte.org
fearcrow.com fickkontaktehobbyhuren.com
filmfanatic.com fidelityfunding.com
finansov.info filunika.com.ru
fishingwholesale.us find1friend.com
fivedwld.cf findclan.org
fiverr.com flashbannernow.com
flashlarevista.com flashlarevista.com
forex-indextop20.ru floating-share-buttons.com
free-share-buttons.blogspot.com folowsite.com
free411games.com forex21.ru
freenom.link frankofficial.ru
freetangodownload.com free-social-buttons.xyz
fsakhalin.ru free-stock-illustration.com
fuckmill.com freshwallpapers.info
fun-mobi.pl front.ru
fym.com.ru frustrated-favorable.gq
fz139.ttk.ru fz139.ttk.ru
gabeshop.ru
gael-s.ru
galaxy-family.ru
galaxys6manual.info
gallictures.com gallictures.com
gamblingnerd.com gameonasia.com
gamebackyard.com gaming-journal.com
getmiro.com gay-site.store
gk170.ru gaz-voshod.ru
glall.ru geckoandfly.com
glcomputers.ru geilehausfrauen.net
gogalleryawesome.com gembird.com
golmau.host.sk gemgrab-a.akamaihd.net
gopro-online.info getmyads24.com
gpirate.com gg-arena.ru
gsmtlf.ru ghernnqr.skyrock.com
guardlink.org golfresa.lucania.se
guge.io gopixdatabase.com
gratuitbaise.com
greamimgo.pw
greatidea.marketing
guildebzh.info
guitar-master.org
gwagka.com
gyffu.com gyffu.com
hermesreplica.win handicapbathtubarea.com
hifidesign.ru hd-filmy.net
homegardenlova.com hentaiheroes.com
homeinns.com herehloadibs.cf
hoporno.com hermesbelts.xyz
hostsshop.ru hermesbirkinhandbagoutlets.com
heygidday.biz
holidaypics.org
homemade.gq
hotblog.top
hotxnights.info
hoverboard360.at
hoverboard360.de hoverboard360.de
howtoclean.club hoverboard360.es
huhn.altervista.org hoverboardforsaledirect.com
huimin764128.com i-midias.net.br
hunterboots.online ibb.com.ua
iamsport.org ifirestarter.ru
igru-xbox.net iinstalll-fii1leis.jus0wil.pp.ua
ilbe.club ilovevitaly.xyz
ilmen.net ilte.info
imperiafilm.ru imagine-ex.co
inboxdollars.com imguramx.pw
indiakino.net inmate-locator.us
indianmedicaltourismshop.com interfucks.net
infostatsvc.com invest-pamm.ru
infowarcraft.ru
instabid.tech
integritylandscapeservices.com
intellekt21.ru
invitefashion.com
io9.com io9.com
itag.pw ip-guide.com
itrevolution.cf isistaylorporn.info
izhevsk.xrus.org iusstf.org
jackpotchances.com japfm.com
jerseyschinabizwholesale.us jerseysbizwholesalecheap.com
jerseywholesalechinabiz.com jerseywholesalebizchina.com
jetsli.de jjbabskoe.ru
johnnyhaley.top joessmogtestonly.com
joy-penguin.com johannesburgsingles.co.za
justkillingti.me junglenet-a.akamaihd.net
kalandranis.gr kasino-money.pw
kalb.ru
kerch.site kerch.site
kerei.ru kidskunst.info
keyword-suggestions.com kinogonew.ru
keywordsking.com kinohall.ru
kichenaid.ru koleso24.com.ua
kino2018.club konpax.com
kinostorm.net konturkrasoty.ru
kinotorka.ru krafte.ru
kmgamex.cf kreativperlen.ch
kosynka-games.ru ku6.com
krasula.pp.ua lacave.ntic.fr
kskjco.club lacloop.info
kumuk.info ladsblue.com
lacasamorett.com laptop-4-less.com
laserpen.club larose.jb2c.me
laxob.com laulini.soclog.se
lernur.net ledpolice.ru
letmacwork.world lego4x4.ru
letmacworkfaster.site
letmacworkfaster.world letmacworkfaster.world
lietaer.com lflash.ru
lineshops.biz lider-zhaluzi.kiev.ua
lightinghomes.net
likesdesign.com
lineavabit.it
linerdrilling.com
linkarena.com
linkdebrideur.xyz
linkredirect.biz linkredirect.biz
lion.misba.us lionking-1994.blogspot.com
liver-chintai.org louboutinreplica.xyz
lubetube.com m1media.net
lyngdalhudterapi.no m3gadownload.pl
m.b00kmarks.com magicdiet.gq
m4ever.net makedo.ru
magiadinamibia.blogspot.com master-muznachas.ru
maglid.ru mearns-tractors.co.uk
manipulyator-peterburg.ru
mantramusic.ru
mararoom.ru
marinetraffic.com
masturbate.co.uk
meccadumps.net
med-zdorovie.com.ua
meddesk.ru
medicine-4u.org
medkletki.ru medkletki.ru
medmajor.ru megaapteka.ru
medosmotr-ufa.ru
megaindex.ru
megakino.net
mejoresfotos.eu
menetie.ru menetie.ru
metafilter.com mhi-systems.ru
mexicosleevegastrectomy.com minecraft-rus.org
michaelkorssaleoutletonline.net mirzonru.net
mobioffertrck.com missis.top
mobsfun.net mixtapetorrent.com
moesen-ficken.com mixx.com
mmgq.ru
mnimmigrantrights.net
moetomnenie.com
mojowhois.com
mojpreskumanie.com mojpreskumanie.com
moncleronline.xyz mompussy.net
monetizationking.net morf.snn.gr
moneyzzz.ru moroccosurfadventures.com
moskva.nodup.ru moscow.xrus.org
mountainstream.ms mosdverka.ru
moviezbonkerssk.cf
mp3ringtone.info mp3ringtone.info
mrpornogratis.xxx msfsaar.de
mybinaryoptionsrobot.com mulberryoutletonlineeu.com
mypornfree.ru mundoaberrante.com
mvpicton.co.uk
mycaf.it
mydoctorok.ru
mysexpics.ru
myyour.eu myyour.eu
nakrutka.cc mzdish.site
namecrumilchlet.tk na15.ru
naval.jislaaik.com najaden.no
navalwiki.info networkad.net
nbsproject.ru
netanalytics.xyz
netvouz.com
newfilmsonline.ru newfilmsonline.ru
news-speaker.com news-speaker.com
next-dentists.tk newstaffadsshop.club
nootrino.com nikitsyringedrivelg.pen.io
o-o-6-o-o.com nofreezingmac.click
o-o-8-o-o.com nw-servis.ru
odesproperty.com o00.in
odywpjtw.bloger.index.hr obiavo.com
offtopic.biz oda.as
oil-td.ru onemactrckr.com
one.net.in onlinemeetingnow.com
oneshotdate.com
online-templatestore.com
online-zaymy.ru
onlinemegax.com
onlineporno.site
open-odyssey.org
oren-cats.ru oren-cats.ru
ourville.info ourville.info
oynat.info oyster-green.com
oz-offers.com panicatack.com
parajumpersoutlet.online parajumpersstore.online
paramountmarble.co.uk paramountmarble.co.uk
parlament.biz percin.biz.ly
partner-host.men perm-profnastil.ru
partner-stop.men petsblogroll.com
paydayloanslocal.com
pearlisland.ru
pestomou.info
pewit.pw pewit.pw
php-market.ru picturesfrom.com
picanalyzer.data-ox.com pigrafix.at
picturesboss.com pills24h.com
piluli.info
pintattoos.com pintattoos.com
pix-hd.com pinup-casino1.ru
pizda.lol pipki.r.acdnpro.com
pizdopletka.club pirateday.ru
pl.id-forex.com playtap.us
plastgranar.nu ploenjitmedia.azurewebsites.net
pons-presse.com pochtovyi-index.ru
pornoinn.com pooleroadmedicalcentre.co.uk
pornotubexxx.name popander.mobi
pornowarp.info porn555.com
portnoff.od.ua pornokorol.com
privacylocationforloc.com pornophoto.xyz
privatefx-in.ru portside.cc
profitwithalex.info posible.net
ptr.ruvds.com postclass.com
pussyspace.net preg.marketingvici.com
quangcaons.com preparevideosafesystem4unow.site
quelle.ru pricheskaonline.ru
rada.ru prizestohandle.club
ranksonic.info prostitutki-odessa.org
rapidokbrain.com proxyradar.com
realizmobi.com qpypcx.com
reining.lovasszovetseg.hu quickbuck.com
responsinator.com rank-checker.online
riralmolamsaca.tk rankia.com
robotixix.com ranksonic.com
rogervivierforsale.com rapevideosmovies.com
rasteniya-vs-zombi.ru
rczhan.com
rednise.com
referencemoi.com
remont-fridge-tv.ru
rentalcarnavi.info
resant.ru
restorator-msk.ru
retreatia.com
ribieiendom.no
robertefuller.com
rospromtest.ru
rp9.ru rp9.ru
ru-mediaget.ru rrutw.com
samoiedo.it rumamba.com
sankt-peterburg.nodup.ru running-line.ru
saratov.xrus.org runtnc.net
saveriopiazza.it rus-teh.narod.ru
sbf441.com ruscoininvest.company
scanner-irvin.top ruscopybook.com
schoolfiles.net rusenvironmental.net
scripted.com rusprostitute.com
sdelatmebel.ru russia-tao.ru
se.bnt-team.com russian-postindex.ru
seeresultshub-a.akamaihd.net sack.net
seksvideoonlain.com sarm.tk
sel-hoz.com sashagreyblog.ga
semxiu.com scanner-brian.top
seo18.su scanner-josh.top
seogadget.ru scat.porn
seoheap.com schlampen-treffen.com
seorankinglinks.com searchinquire.com
seorankinglinks.xyz securesmrt-dt.com
sexuria.net security60-e.com
sherlock.se selectads.men
shitmovs.com seocheki.net
site-speed-check.site seofied.com
siteripz.net sergiorossistore.online
sitiz.club servisural.ru
sk.golden-praga.ru sex-sex-sex5.com
skutecznetabletkinaporostwlosow.pl sexs-foto.top
skyway24.ru sexspornotub.com
slavic-magic.ru sexstream.pl
slomm.ru shemalegalls.blogporn.in
slowmac.tech sideeffectsoftizanidine.blogspot.com
smokewithrabbits.com simple-share-buttons.com
social-button.xyz sindragosa.comxa.com
sirpornogratis.xxx
sixcooler.de
skytraf.xyz
snegozaderzhatel.ru
snomer1.ru
snowplanes.com
social-buttons.com social-buttons.com
sotechco.co social-vestnik.ru
specialfinanceoffers.com solitaire-game.ru
spitfiremusic.com solmarket.by
spl63.fr sovetogorod.ru
sprttrack.com spammen.de
startwp.org spasswelt.net
stats-collector.org spidtest.org
staynplay.net spylog.com
stevemonsen.com squidoo.com
stockspmb.info stockquotes.wooeb.com
stroy-portal22.ru strangeduckfilms.com
stroymonolit.su suhanpacktech.com
stuff-about-money.com sundrugstore.com
sugvant.ru supernew.org
supermesta.ru szamponrevita.pl
symbaloo.com taraz.xkaz.org
t3chtonic.com teencastingporn.com
tecnoteakviareggio.it telemetryverification.net
testbotprocessor44.com the-trader.net
thegamerznetwork.com thecoolimages.net
thruport.com thepokertimer.com
timhost.ru tizanidineshowupondrugtest.blogspot.com
tizanidinestreetvalue.blogspot.com tizanidinesideeffectsweightloss.blogspot.com
tizanidinevscyclobenzaprine.blogspot.com
tizanidinezanaflex.blogspot.com
tmm-kurs.ru tmm-kurs.ru
tobeyouday.win topappspro.com
torrents.life torrnada.ru
tourismvictoria.com traffic2money.com
toursmaps.com trafficjunky.com
tracxn.com trafficnetzwerk.de
turbo-suslik.org traffique.net
turizm.bz traxdom.ru
twojebook.pl tripper.de
tyumen.xrus.org trkur.com
u-cheats.ru truck-land.life
uamtrk.com tuckermktg.com
udsgame.online turn-up-life.life
umnovocaminho.com tvoystartup.ru
uptime-as.net twittruth.com
ussearche.cf twodollarshows.com
ustion.ru ua.tc
utiblog.fr ukrobstep.com
uvozdeckych.info ukrtextbook.com
vacuumscleaner.com umityangin.net
uogonline.com
upproar.com
usswrite.com
vapomnoncri.tk
vashsvet.com
vbikse.com
vclicks.net
veerotech.com veerotech.com
veopornogratis.xxx vegascosmetics.ru
video-chat.in veselokloun.ru
vilingstore.net vgoloveboli.net
vip-file.com via-gra.webstarts.com
vipps.com.my vip.51.la
vkontarkte.com vipromoffers.com
volgograd.xrus.org virtualbb.com
voloslove.ru vk-mus.ru
vostoktrade.info vostoktrade.info
vzglyadriv.kg webadvance.club
wallpaperaccess.com webix.biz
wallpapersist.com weblibrary.win
warezkeeper.com website-speed-checker.site
webcamdevochka.com
webextract.profound.net
website-speed-check.site
websiteaccountant.de websiteaccountant.de
webstatsdomain.org
westvilletowingservices.co.za westvilletowingservices.co.za
whereiskentoday.com whipme.yopoint.in
whiteproduct.com woodyguthrie.se
winterclassichockeyjerseys.com wormix-cheats.ru
wleuaprpxuvr.ga wpthemedetector.co.uk
wnhjavlhezp.gq www.kabbalah-red-bracelets.com
womama.ru www.labves.ru
womensterritory.ru x-diesel.biz
worldtraveler.world x-musics.com
wsgames.ru x-stars.ru
wufak.com xaylapdiendanang.com
www.solartek.ru xbaboon.com
xchangetrak.com xcc24.pl
xgftnlrt.bloger.index.hr
xmlinde.com
xn-----6kccaibs5cb8afhjrfmix2n.xn--p1ai
xn----8sblgmbj1a1bk8l.xn----161-4vemb6cjl7anbaea3afninj.xn--p1ai xn----8sblgmbj1a1bk8l.xn----161-4vemb6cjl7anbaea3afninj.xn--p1ai
xn----ctbbcjd3dbsehgi.xn--p1ai xn--1-8sbcpb0bdm8k6a.xn--p1ai
xn--80ajbshivpvn2i.xn--p1ai
xnxx-n.com
xnxx699.com xnxx699.com
xsion.net xnxxandxvideos.com
xtubeporno.net xolodremont.ru
yadro.ru xxx-treker.ru
yatrk.xyz xxxrus.org
yebocasino.co.za yaaknaa.info
yellowproxy.net yellowstonesafaritours.com
youresponsive.com yoshkarola.zrus.org
yourothersite.com yottos.com
yourporn.com youghbould.wordpress.com
yourporngay.com yoursite.com
youthreaders.com yourtemplatefinder.com
youtube-downloader.savetubevideo.com
youtuhe.com youtuhe.com
yugo-star.ru ypmuseum.ru
zakazfutbolki.com zaim-pod-zalog-krasnodar.ru
zakazvzloma.com zajm-pod-zalog-nedvizhimosti.ru
zaloro.com zastenchivosti.net
zastroyka.org zeleznobeton.ru
zeroredirect11.com zeroredirect5.com
zeroredirect2.com zetmaster.ru
zeroredirect7.com zrizvtrnpale.tk
zhacker.net zskdla.site
zhongwenlink.com
zirondelli.it
zophim.me
zrelaya.pw

480
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
1-free-share-buttons.com 01apple.com
11235813.webzdarma.cz 03e.info
14b.info 1stat.ru
1bet.com 57883.net
1j7740kd.website 7wind.ru
273-fz.ru aasoldes.fr
4kepics.com acc.eu.org
adman.gr adclickservice.com
adnotbad.com adloads.net
adultfriendfinder.com adtiger.tk
advokat-grodno.by agapovdg.ru
ahmedabadwebs.com allesohnegirls.net
air-edem.ru androids-store.com
albuteroli.com apishops.ru
algerianembassy.co.in artel116.ru
allboard.xobor.de as5000.com
amigobulls.com astrochicks.com
animebox.com.ua atlant-auto.info
anniemation.com aviav.eu
apartmentratings.com avon-ukraine.com
apiallgeniusinfo-a.akamaihd.net avtovolop.ru
appfastplay.com azazu.ru
arenda-yeisk.ru azlex.uz
arendas.net banksrf.ru
awency.com beauby.ru
bankiem.pl benchmarkcommunications.co.uk
beatifullandscape.co bildsuche.ru
bestfortraders.com bizfly.info
bestofferswalkmydogouteveryday.gq blogporn.in
besttorrentknifta.weebly.com boleznikogi.com
big-boards.info bookmark4you.com.biz
blackcurranthumidifiers.site bronzeaid-a.akamaihd.net
bloke.com buyantiviralwp.com
cactussoft.biz buzz-porno.info
cars-modification.net callawaygolfstore.online
carstrends2015.com carina-sy.de
cbb1smartlist12.click cartierlove2u.xyz
centrumcoachingu.com cashonads.com
cfcl.co.uk cdncash.org
cheap-trusted-backlinks.com chatroulette.world
cheapmarmot.online
cheapmoncler.pw
cheapwebsitehoster.com
chelyabinsk.xrus.org chelyabinsk.xrus.org
ciekawinki.pl connectingsingles.com
clothesforcash.com crackguru.tk
club-samodelkin.ru crest3d.ru
clubfashionista.com customerpromos-a.akamaihd.net
compliance-andrew.top damasarenai.info
compliance-jane.top datract.com
compliance-olga.top ddsoldes.fr
copblock.org delfin-aqua.com.ua
cosmetic.donna7753191.ru dengi-pod-zalog-nedvizhimosti.ru
cubs-jerseys.us
cutt.us
decenttools.com
dinosaurus.site dinosaurus.site
doctissimo.fr dogsrun.net
domainanalyzing.xyz dojki365.online
doska-vsem.ru doxyporno.com
drivotracker.com droidlook.net
ednorxmed.com dvr.biz.ua
elektrozigarette2.webs.com dyshagi.ru
e-avon.ru
electricwheelchairsarea.com
elektir.ru
elektrischezigarette2.onsugar.com
elektrozigarette2.wordpressy.pl
elektrozigaretten1.webs.com elektrozigaretten1.webs.com
embedle.com elvenmachine.com
erectile.bid etur.ru
erotikchat-24.com euromasterclass.ru
essayservicewriting.org extlabs.io
evrotekhservis.ru ezigarettenshop1.yolasite.com
f1nder.org falopicm.pw
falllow.gq farm26.ru
familyphysician.ru femdom.twiclub.in
findpik.com ferretsoft.com
freejabs.com fickkontaktehobbyhuren.com
fsalas.com findthe.pet
funponsel.com flooringinstallation-edmonton.com
gearsadspromo.club floridamhca.org
gentamicineyedrops.blogspot.com fok.nl
freeuploader.com
fres-news.com
gay-file.com
getlamborghini.ga getlamborghini.ga
getresponse.com glcomputers.ru
globatur.ru hahashka.ru
gopro-online.info hanink.biz.ly
graphicwe.org harmonyglen.us
growmyfunds.ca hatedriveapart.com
hdwallpapers-free.com hccoder.info
hdxnxxtube.mobi hdseriale.pl
hem.passagen.se
hermesbirkinhandbagoutlets.com
hifidesign.ru hifidesign.ru
homedecorpicture.us highland-homes.com
hotchatdate.com historichometeam.com
howmuchdoestizanidinecost.blogspot.com honyaku.yahoofs.jp
hully.altervista.org hoporno.com
idc.com.ua hybrid.ru
ie.57883.net hydropump.su
imitex-plus.ru idealtits.net
insider.pro incolors.club
islamtoday.co.za infogame.name
itbc.kiev.ua investyb.com
jav-fetish.com ipornox.xxx
justkillingti.me itag.pw
kasino-money.pw itsdp3.com
koronirealestate.gr javspace.net
krasnodar-avtolombards.ru jetsli.de
ku6.com jyvopys.com
lashstudia.ru kamen-e.ru
karting196.ru
kihi.gdn
kinozapas.com
kmd-pto.ru
kumuk.info
kvartira-sutochno.com
labvis.host.sk
law-check-nine.xyz law-check-nine.xyz
law-check-seven.xyz linkarena.com
laxdrills.com linkredirect.biz
lerporn.info lisque.batcave.net
letto.by livetsomudvekslingstudent.bloggersdelight.dk
linksharingt.com luckyday.world
liverpool.gsofootball.com m4ever.net
liveu.infoteka.hu mackeeper-center.club
locustdesign.co mainlinehobby.net
lollypopgaming.com mall.uk
lubetube.com meet-flirt-dating.com
mabdoola.blogspot.com mensandals.xyz
manuscript.su minharevisao.com
manve.info mobicover.com.ua
maranbrinfo.com.br moinozhki.com
masserect.com moje-recenze.cz
medicine-4u.org moscow-clining.ru
metalonly.info mosdverka.ru
metaxalonevstizanidine.blogspot.com movpod.in
missvietnam.org mrcsa.com.au
monclerboots.xyz muabancantho.info
monclerjacketsoutlet.win muizre.ru
morefastermac.trade mustat.com
moscow-region.ru muztops.ru
musicas.baixar-musicas-gratis.com myiptest.com
myanyone.net nalogovyykodeks.ru
myfreecams.com narkologiya-voronezh.ru
narkologiya-orel.ru novgorod.xrus.org
needtosellmyhousefast.com nullrefer.com
negral.pluto.ro nuup.info
netoil.no oakridgemo.com
nevansk.ru online.ktc45.ru
nextconseil.com onlineku.com
nl.netlog.com origin-my.ru
oda.as ororodnik.goodbb.ru
ok.ru osnova3.ru
oklogistic.ru outpersonals.com
omgtnc.com ozoz.it
oneshotdate.com palocco.it
ooomeru.ru partner-cdn.men
orgasmatrix.com pay2me.pl
oynat.info perederni.net
papasdelivery.ru peugeot-club.org
parvezmia.xyz photosaga.info
pechikamini.ru pic-re.blogspot.com
perfectpracticeweb.com pila.pl
picsearch.com pix-hd.com
pizdopletka.club pkr1hand.com
pl-top.pl pl-vouchers.com
platesauto.com pod-muzyku.club
pliks.pl pornhub-forum.ga
podshipniki-nsk.ru pornogad.com
poem-paying.gq pornoinn.com
poiskzakona.ru pornonik.com
pony-business.com pozdrawleniya.ru
popup-jdh.xyz privat-girl.net
porndairy.in prodvigator.ua
portadd.men qexyfu.bugs3.com
prizesbook.online queerspace.com
prostitutki-odessa.org r-control.ru
qcstrtvt.bloger.index.hr raisedseo.com
qpypcx.com redirect.trafficreceiver.club
rabotaetvse.ru refererx.com
rankings-analytics.com remont-komputerov-notebook.ru
remmling.de rep-am.com
remorcicomerciale.ro rightenergysolutions.com.au
restorator-msk.ru robot-forex.biz
rialp.getenjoyment.net russia-today-video.ru
russia-tao.ru ryetaw.com
saddiechoua.com safe-app.net
scanmarine.info saveriopiazza.it
scanner-jack.top sbf441.com
scanner-jessica.top sbricur.com
scanner-julia.top sbwealthsolutions.ca
sdrescher.net seolab.top
search.pch.com sex-foto.pw
seksvideoonlain.com sexspornotub.com
sell-fb-group-here.com shakhtar-doneck.ru
seonetwizard.com sitechecker.pro
serpstat.com socialtrade.biz
sexpartygirls.net srdrvp.com
sexy-pings.com srgwebmail.nl
sheerseo.com sribno.net
shiksabd.com stackthatbucks.com
sibtest.ru studiofaca.com
sisi-go.ru studiokamyk.com.pl
socialmonkee.com swinginwithme.ru
soda.media technika-remont.ru
sonata-arctica.wz.cz
sortthemesitesby.com
stanthonyscatholicchurch.org
starpages.net
starwars.wikia.com
stmassage.ru
stroy-portal22.ru
suchenindeutschland.com
supermesta.ru
susanholtphotography.com
teenforporn.com teenforporn.com
teenfuck.tv templates.franklinfire.co
thewebsitetemplate.info theallgirlarcade.com
tiens2010.ru thefds.net
theheroes.ru
titangel-vietnam.com titangel-vietnam.com
tizanidinedosage.blogspot.com tizanidine4mg.blogspot.com
tmm-kurs.ru tizanidineinfo.blogspot.com
todohr.com tizanidineshowupondrugtest.blogspot.com
toondinsey.com toon-families.com
top1-seo-service.com top1-seo-service.com
topappspro.com topdownloads.ru
track.deriv.com track112.site
trafficcentr.xyz trahvid.com
trafficjunky.net turist-strani.ru
try-rx.com uhod-za-sobakoj.ru
tubo360.com uptime-alpha.net
ultimatesetnewfreeallsoftupgradesystems.pw uptime.com
undergroundcityphoto.com urccvfmc.bloger.index.hr
url2image.com vegascosmetics.ru
urzedowski.eu video-camer.com
usadacha.net video-chat.in
utrolive.ru videochat.bz
video-chat.cn vigrx-original.ru
videtubs.pl
villakohlanta.nu
vk-mus.ru vk-mus.ru
voronezh.xrus.org vkgaleria.com
vrnelectro.ru voltrknc1.com
walpaperlist.com webads.co.nz
webix.me webmonetizer.net
westum.se webs.com
wingsofrefuge.net webshoppermac.com
xjrul.com whereiskentoday.com
xn--80adaggc5bdhlfamsfdij4p7b.xn--p1ai win-spy.com
xn--90acenikpebbdd4f6d.xn--p1ai wowcasinoonline.ooo
xn--b1addnj3cah.xn--p1ai www.jbetting.com
xxxdatinglocal.us www.solartek.ru
xxxrus.org x-diesel.org
xzlive.com xcombear.ru
yaminecraft.ru xmlinde.com
yoshkarola.zrus.org xmnb.net
youporn-ru.com xolodremont.ru
your-bearings.com xxart.ru
zapiszto.pl y8games-free.com
zarabotat-na-sajte.ru yougame.biz
zawyna.ua youjizz.com
youresponsive.com
zeroredirect2.com
zigzog.ru
zreloeporno.tv

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.123 0; 10.1.0.115 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.12.3529 ### Version: V4.2022.12.3530
### Updated: Tue Dec 27 22:01:23 UTC 2022 ### Updated: Wed Dec 28 22:01:15 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.12.3529 ### Version: V4.2022.12.3530
### Updated: Tue Dec 27 22:01:23 UTC 2022 ### Updated: Wed Dec 28 22:01:15 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##