vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-03 02:59:57 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2022.04.3043 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2022-04-14 10:09:09 +00:00
parent e5668418a9
commit 254b573282
46 changed files with 95327 additions and 95327 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.04.3042 #### Version: V4.2022.04.3043
#### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.04.3042 #### Version: V4.2022.04.3043
#### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -14,7 +14,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2022.04.3042 #### Version: V4.2022.04.3043
#### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

11780
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2022.04.3042 #### Version: V4.2022.04.3043
#### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

11784
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

11784
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

11784
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

11784
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.38 1; 10.1.0.91 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.38 0; 10.1.0.91 0;
127.0.0.1 0; 127.0.0.1 0;

11784
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.38 1; 10.1.0.91 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.38 0; 10.1.0.91 0;
127.0.0.1 0; 127.0.0.1 0;

11784
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.38 1; 10.1.0.91 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.38 0; 10.1.0.91 0;
127.0.0.1 0; 127.0.0.1 0;

11784
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
3042 3043

11784
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

11784
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
40.83.249.7 0; 13.91.54.148 0;

11784
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.38 1; 10.1.0.91 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.38 0; 10.1.0.91 0;
127.0.0.1 0; 127.0.0.1 0;

11784
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.38 1; 10.1.0.91 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.38 0; 10.1.0.91 0;
127.0.0.1 0; 127.0.0.1 0;

11784
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.38 1; 10.1.0.91 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.38 0; 10.1.0.91 0;
127.0.0.1 0; 127.0.0.1 0;

11784
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
40.83.249.7 0; 13.91.54.148 0;

11784
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
40.83.249.7 0; 13.91.54.148 0;

11784
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.38 1; 10.1.0.91 1;
127.0.0.1 1; 127.0.0.1 1;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
Anarchy 360Spider
BlowFish Anarchy99
Id-search CheeseBot
MTRobot Evil
Mail.RU_Bot Mozlila
Masscan OpenLinkProfiler
Petalbot RepoMonkey
Tracemyfile Snoopy
Webshag Suzuran
Who.is Bot WASALive-Bot

300
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
01h4x.com 01h4x.com
360Spider 404enemy
80legs
AIBOT AIBOT
Abonti Aboundexbot
Aboundex
Acunetix Acunetix
AllSubmitter Ankit
Alligator
Anarchie
Anarchy99
Anthill Anthill
Apexoo Apexoo
Aspiegel Atomseobot
Attach AwarioSmartBot
BDCbot
BLEXBot BLEXBot
BackDoorBot BackStreet
Backlink-Ceck Backlink-Ceck
Badass Badass
Bandit BatchFTP
Barkrowler Battleztar Bazinga
Bigfoot Black Hole
Bitacle
Blackboard Blackboard
BlowFish Boardreader
BotALot Bolt
BuiltBotTough Brandprotect
BunnySlippers Buck
BuzzSumo
CCBot CCBot
CODE87 CODE87
Cegbfeieh CazoodleBot
CheTeam CherryPicker
CheeseBot
Chlooe Chlooe
Cloud mapping Claritybot
Cogentbot Collector
Copier Cosmos
Copyscape Crescent
Crawling at Home Project DatabaseDriverMysqli
CrunchBot Digincore
DBLBot
DIIbot
Demon
DigitalPebble DigitalPebble
Disco Discobot
DnyzBot
DomCopBot
DomainCrawler DomainCrawler
DomainSigmaCrawler DomainStatsBot
Domains Project
Dotbot Dotbot
Download Wonder
ECCP/1.0 ECCP/1.0
Ebingbong EMail Siphon
Ecxi Ecxi
EirGrabber
EroCrawler EroCrawler
Express WebPictures Evil
Extractor ExtLinksBot
EyeNetIE Extreme Picture Finder
Foobot FDM
FHscan
FemtosearchBot
FlashGet
Freeuploader
FrontPage
Fuzz Fuzz
FyberSpider FyberSpider
Fyrebot Fyrebot
Genieo GT::WWW
GetRight GalaxyBot
GermCrawler
GetWeb
Gigabot Gigabot
Go-Ahead-Got-It Go-Ahead-Got-It
GoZilla Gotit
Grafula
GrapeFX GrapeFX
HTMLparser HEADMasterSEO
HTTP::Lite HTTP::Lite
HTTrack
Haansoft
Havij
Hloader Hloader
HonoluluBot HonoluluBot
IDBTE4M Humanlinks
IDBot
IRLbot
Iblog
Id-search Id-search
IlseBot
Image Sucker Image Sucker
InfoTekies IndeedBot
InfoNaviRobot
InterGET
Internet Ninja Internet Ninja
InternetSeer InternetSeer
Iria
IstellaBot
JOC Web Spider
JamesBOT
JikeSpider
Joomla Joomla
Jorgee
JustView JustView
Jyxobot Keybot Translation-Search-Machine
Keyword Density Keyword Density
Kozmosbot Kozmosbot
Lanshanbot Lftp
LeechGet LinkScan
LexiBot LinkpadBot
LibWeb
LinksManager LinksManager
LinqiaRSSBot LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Lipperhey Lipperhey
Lipperhey Spider
Lmspider Lmspider
MJ12bot MIDown tool
MIIxpc
MQQBrowser MQQBrowser
Magnet MSIECrawler
Mail.RU_Bot
Majestic12 Majestic12
Mass Downloader MarkWatch
Metauri Masscan
Microsoft URL Control MauiBot
Minefield Mister PiX
Moblie Safari Mojolicious
Mozlila
Msrabot Msrabot
Musobot Musobot
NICErsPRO Navroad
NearSite Nessus
NetAnts Net Vampire
NetLyzer NetZIP
NetSpider Nettrack
Netvibes
NextGenSearchBot NextGenSearchBot
Nibbler Niki-bot
Nikto
NimbleCrawler
Nimbostratus Nimbostratus
Ninja Nmap
Not
Nuclei
Nutch
Offline Navigator
OpenVAS OpenVAS
OrangeBot Openvas
PECL::HTTP
PHPCrawl PHPCrawl
Page Analyzer POE-Component-Client-HTTP
PageAnalyzer PictureFinder
PageGrabber
Panscient
Pimonster
Pixray
PleaseCrawl PleaseCrawl
Pockey
ProPowerBot ProPowerBot
ProWebWalker ProWebWalker
Probethenet
Psbot
Pu_iN Pu_iN
Pump
PxBroker
PyCurl PyCurl
QueryN Metasearch Quick-Crawler
RSSingBot RSSingBot
RankActiveLinkBot RankActiveLinkBot
RankFlex RankingBot2
Rankivabot Rankivabot
RankurBot
Re-re Re-re
Reaper
RebelMouse RebelMouse
Recorder
RedesScrapy RedesScrapy
SBIder SBIder
SEOkicks SEOkicks
SEOlyticsCrawler SEOkicks-Robot
SMTBot SEOstats
SalesIntelligent SISTRIX
ScanAlert
ScoutJet
ScrepyBot ScrepyBot
Seekport Seekport
SemrushBot SemanticJuice
SentiBot Shodan
Siphon Siphon
SiteCheckerBotCrawler
SiteLockSpider SiteLockSpider
Sitevigil SiteSnagger
Sitebeam
Siteimprove
SmartDownload
Snake Snake
Snoopy
SocialRankIOBot SocialRankIOBot
SpankBot
Spbot
Spinn3r Spinn3r
Sqlmap
Sqworm Sqworm
Sucuri Sucuri
Surfbot
SurveyBot SurveyBot
Suzuran
Szukacz Szukacz
Telesphoreo T8Abot
The Intraformant Telesphorep
Thumbor
Titan Titan
Toweyabot Twice
Trendiction
Trendictionbot
TurnitinBot
Typhoeus Typhoeus
URLy.Warning Upflow
UnisterBot V-BOT
VB Project VB Project
VelenPublicWebCrawler VCI
VeriCiteCrawler
VidibleScraper VidibleScraper
Voil
Voltron
WBSearchBot
WEBDAV WEBDAV
WWW-Collector-E WISENutbot
WPScan
WWW-Mechanize WWW-Mechanize
WWW::Mechanize WWW::Mechanize
Wallpapers WeSEE
WallpapersHD Web Auto
Web Enhancer
Web Fetch Web Fetch
Web Sucker Web Pix
WebAuto WebAuto
WebBandit WebBandit
WebCollage
WebEnhancer WebEnhancer
WebFuck WebFetch
WebSucker WebGo IS
WebLeacher
WebPix
WebReaper
WebSauger
Webalta Webalta
WebmasterWorldForumBot Webshag
Website Quester
Webster Webster
Whacker Whack
Whatweb Whatweb
Widow
WinHTTrack WinHTTrack
Wonderbot WiseGuys Robot
Xaldon WebSpider Wprecon
Xaldon_WebSpider Xaldon_WebSpider
Xenu YoudaoBot
Zauba Zauba
Zermelo Zermelo
Zeus ZoomBot
ZoominfoBot
ZumBot ZumBot
arquivo-web-crawler
arquivo.pt
autoemailspider autoemailspider
coccocbot backlink-check
cah.io.community
check1.exe
cognitiveseo cognitiveseo
com.plumanalytics
crawler4j
dataforseo.com dataforseo.com
domainsproject.org
evc-batch evc-batch
gopher gopher
heritrix instabid
iubenda-radar ips-agent
lwp-request linkdexbot
lwp-trivial
magpie-crawler magpie-crawler
meanpathbot mediawords
oBot oBot
page scorer
pcBrowser
polaris version
probe-image-size
ripz
s1z.ru s1z.ru
scan.lol scalaj-http
seobility
seocompany.store
seoscanners seoscanners
seostar sexsearcher
serpstatbot
siteripz siteripz
sp_auditbot trendiction.com
ubermetrics-technologies.com trendiction.de
voyagerx.com webmeup-crawler
webprosbot
x09Mozilla x09Mozilla
x22Mozilla
zauba.io
zgrab

294
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
01h4x.com 01h4x.com
360Spider 360Spider
404checker 404checker
404enemy AIBOT
80legs
ADmantX
ALittle Client
Aboundex Aboundex
Aboundexbot AfD-Verbotsverfahren
Acunetix AiHitBot
Aipbot Alexibot
AllSubmitter AllSubmitter
Alligator Alligator
AlphaBot
Ankit Ankit
Anthill Apexoo
Asterias Attach
AwarioRssBot BDCbot
BackWeb BLEXBot
Backlink-Ceck
Badass
Bandit Bandit
BatchFTP Barkrowler
Bigfoot Battleztar Bazinga
BetaBot
Bitacle Bitacle
Blackboard Black Hole
Blow BlackWidow
BlowFish BlowFish
BuiltWith Boardreader
CODE87 Buck
CSHttp Bullseye
Calculon BuzzSumo
CCBot
CazoodleBot CazoodleBot
CensysInspect Cegbfeieh
CheTeam CheeseBot
CherryPicker
Chlooe Chlooe
Citoid Citoid
Cloud mapping Cliqzbot
Cogentbot
Collector Collector
Cosmos
Craftbot
Crawling at Home Project Crawling at Home Project
CrunchBot CrunchBot
Demon Custo
DBLBot
DTS Agent
Deusu Deusu
Digincore
Dirbuster Dirbuster
Disco Disco
Discobot Discoverybot
Dispatch
DnBCrawler-Analytics DnBCrawler-Analytics
DomainAppender DnyzBot
DomainSigmaCrawler DomCopBot
DomainStatsBot DomainStatsBot
Drip Domains Project
ECCP/1.0 Dotbot
EasyDL Dragonfly
EMail Siphon
EMail Wolf
Ebingbong Ebingbong
ExtLinksBot Evil
Extractor Exabot
Firefox/7.0 Firefox/7.0
Flunky FlashGet
Foobot Foobot
Freeuploader Freeuploader
Fuzz FrontPage
GT::WWW
GetRight
Getintent
Go!Zilla Go!Zilla
Go-Ahead-Got-It Go-Ahead-Got-It
GoZilla GrabNet
Grabber Grafula
GridBot GridBot
HEADMasterSEO HTTrack
HMView
Haansoft Haansoft
HaosouSpider HaosouSpider
Havij
HybridBot HybridBot
Iblog IDBot
Image Fetch IRLbot
IndeedBot Indy Library
InfoNaviRobot InfoNaviRobot
Iskanie Intelliseek
Internet Ninja
InternetSeer
IstellaBot IstellaBot
JamesBOT JamesBOT
Joomla JennyBot
Jorgee JikeSpider
JustView JustView
Jyxobot LNSpiderguy
Kozmosbot Leap
Lanshanbot
LeechFTP
LexiBot
Lftp
LibWeb
LieBaoFast
Likse Likse
LinkScan
LinkWalker
LinkextractorPro
LinkpadBot
LinqiaMetadataDownloaderBot
LinqiaRSSBot LinqiaRSSBot
LinqiaScrapeBot Lipperhey
Lipperhey Spider Lipperhey Spider
Lmspider
Ltx71 Ltx71
MIDown tool
MJ12bot MJ12bot
MSFrontPage MSIECrawler
Magnet
Mail.RU_Bot
Majestic SEO Majestic SEO
MarkWatch Majestic-SEO
Mass Downloader Mass Downloader
Masscan
Mb2345Browser Mb2345Browser
Meanpathbot
Mediatoolkitbot
MegaIndex.ru
Metauri Metauri
Mister PiX MicroMessenger
Moblie Safari Microsoft Data Access
Microsoft URL Control
Minefield
Mojeek Mojeek
MolokaiBot Mojolicious
Msrabot Morfeus Fucking Scanner
Mozlila
Mr.4x3
NPbot NPbot
Name Intelligence Name Intelligence
Nameprotect
Navroad Navroad
NearSite Needle
Net Vampire NetLyzer
NetAnts NetSpider
NetMechanic Niki-bot
NetZIP
Netcraft
NextGenSearchBot
Nikto Nikto
NimbleCrawler NimbleCrawler
Ninja
Not
Nuclei
Octopus Octopus
Offline Explorer Offline Explorer
Openfind OpenLinkProfiler
Page Analyzer OpenVAS
OrangeSpider
PageGrabber
PageThing.com
Pavuk Pavuk
Petalbot Pi-Monster
Picscout
PictureFinder
Piepmatz
Pimonster Pimonster
Pixray Pixray
PleaseCrawl PleaseCrawl
Pockey Pockey
Quick-Crawler Psbot
RankActive Pu_iN
RankActiveLinkBot Pump
RankingBot2 RSSingBot
RankingBot
Rankivabot Rankivabot
RankurBot
Re-re Re-re
ReGet ReGet
Recorder RebelMouse
RedesScrapy RedesScrapy
Ripper RepoMonkey
SBIder
SEOkicks SEOkicks
SEOkicks-Robot SEOlyticsCrawler
SEOprofiler SEOstats
SalesIntelligent SISTRIX
SMTBot
Scanbot Scanbot
ScoutJet
ScreenerBot ScreenerBot
SemanticJuice
Semrush Semrush
SeoSiteCheckup SemrushBot
SeobilityBot
Siphon Siphon
SiteCheckerBotCrawler SiteCheckerBotCrawler
SiteExplorer SiteLockSpider
SiteSucker SiteSucker
Sitebeam Sitebeam
Sitevigil
SmartDownload SmartDownload
Sogou web spider Snapbot
Sosospider Snoopy
Spbot SocialRankIOBot
Spinn3r SpaceBison
Sqworm SpankBot
Steeler
Sucuri
SuperBot SuperBot
SurveyBot SurveyBot
Swiftbot Teleport
Szukacz
Telesoft Telesoft
Telesphoreo Telesphoreo
Thumbor Thumbor
Tracemyfile Titan
Trendiction Trendictionbot
True_Robot True_Robot
Turingos
TurnitinBot
TwengaBot TwengaBot
URLy.Warning URLy.Warning
UnisterBot UnisterBot
Upflow V-BOT
VB Project VCI
VelenPublicWebCrawler
VeriCiteCrawler
Voil Voil
WASALive-Bot Voltron
WISENutbot
WPScan WPScan
WWW-Collector-E
WWW-Mechanize
WWWOFFLE
Wallpapers/3.0 Wallpapers/3.0
WallpapersHD
Web Fuck Web Fuck
Web Pix Web Sauger
WebCollage Web Sucker
WebEnhancer WebCopier
WebFetch WebFuck
WebGo IS
WebImageCollector WebImageCollector
WebPix WebPix
WebReaper WebReaper
WebSauger
WebStripper
WebSucker WebSucker
WebWhacker
WebZIP WebZIP
WebmasterWorldForumBot
Webshag Webshag
WebsiteExtractor WebsiteExtractor
Webster WebsiteQuester
Whacker Whacker
Whatweb Who.is Bot
WinHTTrack Widow
WiseGuys Robot WiseGuys Robot
Wonderbot Wonderbot
Woobot Woobot
Wotbox Xaldon_WebSpider
Xaldon WebSpider
Xenu Xenu
Zade YoudaoBot
Zauba
Zermelo
Zeus
ZmEu
ZyBorg
arquivo.pt
cah.io.community cah.io.community
cognitiveseo coccocbot
com.plumanalytics
crawl.sogou.com
demandbase-bot
domainsproject.org
eCatch eCatch
instabid gopher
ips-agent ips-agent
lwp-request isitwp.com
meanpathbot meanpathbot
mediawords plumanalytics
muhstik-scan
netEstate NE Crawler
page scorer
polaris version polaris version
probe-image-size satoristudio.net
scalaj-http seocompany.store
seoscanners
seostar seostar
serpstatbot
sitechecker.pro sitechecker.pro
siteripz siteripz
sp_auditbot spyfu
trendiction.de sysscan
zgrab webgains-bot
x09Mozilla
xpymep1.exe

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
baksman.com dirtpics.pw
bioscorp.ru discovertreasure-a.akamaihd.net
cartierlovebraceletreplica.xyz pornoinn.com
kndxbkdx.bloger.index.hr proekt-gaz.ru
netvouz.com shtaketniki.ru
nudejapan.net skanninge.se
oakleyglassesonline.us thegioixekhach.com
ranksignals.com vbabule.net
thelottosecrets.com voloo.ru
truemfilelj.gq vzlomfb.com

938
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
00webcams.com 0lovespells0.blogspot.com
0daymusic.org 1kdailyprofit.me
100dollars-seo.com 202ch.com
12u.info
13tabs.com
1flag.co.za
1kinobig.ru
2020iscoming.info
256bit.by
28n2gl3wfyb0.ru 28n2gl3wfyb0.ru
2ads.co.uk 2nt.ru
2kata.ru 3w24.com
4senses.co 4replicawatch.net
5u.com 5ws.dating-app.ru
7xc4n.com 6hopping.com
91abcw.com 7fon.ru
aaronabel.com 888.com
aa08daf7e13b6345e09e92f771507fa5f4.com
aa8b68101d388c446389283820863176e7.com
aad1f4acb0a373420d9b0c4202d38d94fa.com
academiacsmendoza.org
acheterviagrafr24.com acheterviagrafr24.com
adclickservice.com acortarurl.es
adexprts.com ad-words.ru
adman.se adanih.com
admatic.com.tr adobereader-free.ru
adrenalin-stk.ru adprotect.net
adtology.com adservme.com
adultmeetonline.info advocatemsk.ru
advokat-grodno.by adzpower.com
aghanyna.com aero2.ru
agysya.ru aerogo.com
ahmedabadwebs.com ahrefs.com
aktivator-windows10.blogspot.com air-edem.ru
alekseevec.ru albuteroli.com
all4invest.info alert.scansafe.net
allmarketsnewdayli.gdn allmarketsnewdayli.gdn
alyeskaresort.com aloofly.com
amanda-porn.ga alphaforum.ru
amospalla.es amateurgalls.com
ameblo.top
analytics-ads.xyz
androids-store.com
animenime.ru animenime.ru
arcadeplayhouse.com apiappenableinfo-a.akamaihd.net
artparquet.ru apper.de
asiavirtualsolutions.com apple.com-cleaner.systems
asiengirls.net
asscenihotosidea.blogspot.co.za asscenihotosidea.blogspot.co.za
audiofree.ru asseenontvonline.ru
australia-opening-times.com atley.eu.pn
autonew.biz atmovs.com
availit.weebly.com autoblogger24.info
avek.ru autobudpostach.club
azartmix.com aversis.net
azartniy-bonus.com aviapanda.ru
azbukafree.com avkzarabotok.info
babespcs.com avon-severozapad.ru
backgroundpictures.net azartclub.org
baladur.ru azlex.uz
balitouroffice.com baixar-musicas-gratis.com
bangla-chat-uk-paralud.ga balla-boo.se
banki76.ru baltgem.com
battlecarnival.su bank.uz
battleforupdating.site bannerpower.com
becuo.com barbourjackets.online
berdasovivan.ru batanga.net
bestkfiledxd.cf bazaronline24.ru
bestssaker.com bedcapdealers.com
bestwrinklecreamnow.com belsetirehafi.tk
betterhdporn.com bestcurs.org
bidbuy.co.kr besthomemadepornsites.com
biographiya.com besthoro.ru
biznesrealnost.ru bestmouthwash.club
bkns.vn bif-ru.info
blagovest-med.ru bimmerpost.com
blavia.00author.com bitcoin-ua.top
bluesman.nu bitcoins-live.ru
bodybuilding-shop.biz bitnote.co
browsepulse-a.akamaihd.net blackplanet.com
brus.city blackwitchcraft.ru
btc4u.ru bloggen.be
blogporn.in
boazpower.com
bobinoz.com
boltalko.xyz
bonzybuddy.com
boo-arts.com
buchananshardware.com
bus-offer.com
businesxxl.com businesxxl.com
buyk.host.sk buyclomidonlaine.com
calstaterealty.us buyparajumpers.online
camdolls.com buyscabiescream.com
candypeople.se buzzsumo.com
carfax.com.ua carina-sy.de
carson.getenjoyment.net carrauterie.be
cartierlove2u.com cartierreplica.pw
cashkitten-a.akamaihd.net casablancamanor.co.za
casinorewards.info castingbank.ru
cdncash.org cdn.walkme.com
chocolateslim-original.com cheapjerseysfootballshop.com
chuckguilford.com check-host.net
cialisovercounteratwalmartusa.com children-learningreading.info
ciekawinki.pl chlooe.com
claytransformations.info choice-credit.ru
clothesforcash.com clickbank.net
club-musics.ru clicksor.com
coin-hive.com clmforexeu.com
collegeessay19.blogspot.ru coderstate.com
com-onlinesupport.host coindirect.io
com-supportcenter.website collegerentals.com
comeondog.info compliance-alexa.xyz
compliance-irvin.xyz compliance-don.xyz
compliance-ivan.top compliance-fred.top
comsysnet.com compliance-george.top
compliance-julia.top
conboy.us conboy.us
contentlook.co concealthyself.com
cookie-law-enforcement-aa.xyz concordexoticrentals.com
coprofam.org coolbar.pro
cornerstone-countertops.com copblock.org
corta.co copypaste.traderzplanet.in
costablue.xyz cowblog.fr
country-chic.ru credit.co.ua
covid-schutzmasken.de cupday.com
credit-online.ws customboxes4less.com
cryptoswap.biz customerguru.in
cxpromote.com cvety24.by
darkages.info dailyrank.net
dekorkeramik.ru dailystrength.org
deluxedumps.com dangphoto.trade
dentfidemountpreach.tk datadepths.com
design-lands.ru dellalimov.com
destinationrealestate.com demian.kz
deutschland123.de dieswaene.com
dev78.dioniqlabb.se dikqlyremy.info
dfwu1013.info disruptingdinnerparties.com
discountliv.com dkvorota.ru
djekxa.ru domashneeruporno.com
docstoc.com domznaniy.ru
dostavimvdom.ru downloadmefiranaratb1972.xpg.com.br
dosug-lux.ru dumuelave.xyz
dynainbox.com e-c.al
e-buyeasy.com earl-brown.info
e705.net
e90post.com
earncash.com.ua earncash.com.ua
easyukraine.com
ebonyporn.site ebonyporn.site
ecookna.com.ua ednorxmed.com
edudocs.net ege-essay.ru
edwinkonijn.com.au egvar.net
ekobata.ru elektronischezigarettekaufen1.myblog.de
electrik-avenue.com empathica.com
elektrischezigarette1.onsugar.com
elektrischezigarette2.devhub.com
elexies.info
englate.com
enthuse.computernetworksonline.com
eorogo.top eorogo.top
ero-advertising.com eurosamodelki.ru
erotikchat-24.com evehemming.blogspot.com.au
estelight.ru eywords-monitoring-your-success.com
exoclick.com f00kclan.de
facebook-mobile.xyz fakehandbags.xyz
failingmarriege.blogspot.com falllow.gq
feel-planet.com famix.xyz
femdom.twiclub.in favornews.com
fetroshok.ru faz99.com
fickenbumsen.net fellowshipoftheminds.com
fickenprivat.info feorina.ru
figuringmoneyout.com filesdatabase.net
filerockstar298.weebly.com findacheaplawyers.com
filmi-v.online finemanteam.com
financeloan.us finuse.com
financetip.eu flex4launch.ru
firesub.pl flipper.top
flagcounter.me floridamhca.org
flavors.me fok.nl
formularz-konkurs.tk forexgb.ru
forum20.smailik.org forum69.info
foto-sisek.porngalleries.top forumprofi.de
foto-weinberger.at free-video-tool.com
fr-bearings.ru free411games.com
free-deals.faith fuckbuddybestgilf.info
freewhatsappload.com fxgallery.com
fres-news.com fym.com.ru
freshsuperbloop.com galaxys6manual.info
freza-sverlo.ru
funnel.co.za
fxtips.ru
gamebackyard.com gamebackyard.com
gameprimary.com
getlamborghini.ga getlamborghini.ga
getridofstretchmarks.org getresponse.com
girlgamerdaily.com gk170.ru
girlsatgames.ru go2jump.org
glass-msk.ru gobongo.info
go2mike.ru googlepositions.com
goatse.ru gratuitxblcodes.com
goforexvps.com
gok-kasten.net
goldpanningtools.com
goo.ne.jp
gorodservis.ru
gotorussia.com
greamimgo.pw greamimgo.pw
greatgrace.ru growshop.es
gribokstop.com guarrasdelporno.xxx
growboxbl.ru hacktougroup.ru
guiadeserraazul.com hdimagelib.com
guigyverpo.cf hdwalls.xyz
gwebtools.com healmytrauma.info
handicapvantoday.com health-medical-portal.info
headpharmacy.com
heartofpayne.xyz
heatpower.ru
helicalpile.us
help.tpu.ru
hermesreplica.win
high-speed1.net high-speed1.net
hitcpm.com highstairs-a.akamaihd.net
home-task.com hitmuzik.ru
hornymatches.com hobbyhuren-datenbank.com
hotenergy.ru homelygarden.com
hotshoppymac.com homemature.net
housediz.com hop.clickbank.net
houseofgaga.ru hut1.ru
husky-shop.cz hyipmanager.in
ico.re id-forex.com
ifmo.ru idealtits.net
ikearugs.xyz ideibiznesa2015.ru
ilte.info ilovevitaly.com
imicrovision.com imagefinder.site
impisr.edunsk.ru imagui.eu
importchinacoach-teach.com inbabes.sexushost.com
indiasourcemart.in intellektmedia.at
infobabki.ru
infodocsportal.com
investzalog.ru investzalog.ru
isitwp.com ipornox.xxx
istripper.com iqupdatetmz.win
iweblist.info istanbulit.com
j33x.com istizanidineanopiate.blogspot.com
jav-fetish.site istmira.ru
jimmychoosale.online javrip.net
jjbabskoe.ru jovencitas.gratis
joessmogtestonly.com justprofit.xyz
junglenet-a.akamaihd.net justucalling32211123456789.tk
justbcause.com jyrxd.com
justkillingti.me kambasoft.com
ketoanhanoi.info karadene.com
keywordglobal.co.za keki.info
kidskunst.info kevblog.top
kino-filmi.com kimcurlrvsms.com
kinogonew.ru kinky-fetishes.com
kinohit1.ru kinozapas.com
kletkimehan.ru kndxbkdx.bloger.index.hr
kopihijau.info kochanelli.com
koptims.tiu.ru komp-pomosch.ru
koversite.info koopilka.com
krafte.ru kostenlos-sexvideos.com
kvartir-remont.biz kostenloser-sex.com
lanasshop.ru kotaku.com
landscaping.center krasnodar.xrus.org
languagecode.com kustanay.kz
lapolis.it kvartira-sutochno.com
larger.io kw21.org
laserpen.club laapp.com
lescinq.com labplus.ru
letmacworkfaster.world lalalove.ru
letolove.ru lampokrat.ws
letslowbefast.today larchik.net
lawyersinfo.org
lennatin.info
lenpipet.ru
lernur.net
lifebyleese.com lifebyleese.com
lifehacĸer.com lineshops.biz
likrot.com liupis.com
linkpulse.com lombia.com
lion.misba.us lomza.info
listiseltemournlan.gq lonfon.xyz
m0r0zk0-krava.ru lunchrock.co
m292.info m3gadownload.pl
machicon-akihabara.info mabdoola.blogspot.com
macotool.com makedo.ru
mafa-free.com mantramusic.ru
matpre.top marinetraffic.com
marketland.ml
markjaybeefractal.com
marsgatan.com
maximpartnerspr.com maximpartnerspr.com
meddesk.ru mazda-roadsters.com
meltwater.com med-zdorovie.com.ua
microstatic.pl medi-fitt.hu
middlerush-a.akamaihd.net mediaoffers.click
mil-stak.com medicineseasybuy.com
minet.club michaelkorssaleoutletonline.net
misslike.ru minharevisao.com
moesexy.com mister-shop.com
moncleroutletonline.pw mmostrike.ru
moncleroutletonline.win mnimmigrantrights.net
moscow-clining.ru mnogolok.info
moviemail-online.co.uk mobplayer.ru
mp3ringtone.info mobsfun.net
moesen-ficken.com
monarhs.info
monclerjacketsoutlet.pw
montredemarque.nl
morf.snn.gr
moroccosurfadventures.com
mosrif.ru
movies-in-theaters.net
moyakuhnia.ru
mrpornogratis.xxx mrpornogratis.xxx
mturkcontent.com musezone.su
muabancantho.info mvpicton.co.uk
music7s.me mydirtystuff.com
mzdish.site myfreecams.com
na15.ru myhitmp3.club
nagdak.ru myindospace.com
narkologiya-peterburg.ru myliveblog.ru
naturalshair.site narkologiya-belgorod.ru
negociosdasha.com nelc.edu.eg
newsperuse.com networkad.net
newyorkhotelsmotels.info new7ob.com
nhl17coinsforps3.gratisblog.biz
niroo.info niroo.info
njpalletremoval.com nvssf.com
nl.netlog.com o-o-6-o-o.com
nodding-passion.tk o.light.d0t.ru
nomuos.it obnal.org
nonameread45.live obsessionphrases.com
notfastfood.ru ofanda.com
novatech.vn offers.bycontext.com
nuker.com okuos.com
obiavo.net omoikiri-japan.ru
offf.info onlainbesplatno.ru
okmusic.jp online-sbank.ru
old-rock.com online247.ml
onetravelguides.com onlineporno.site
ooomeru.ru orel-reshka.net
open-odyssey.org orgasmus-virtual.com
oranga.host.sk orion-code-access.net
osagonline.ru orion-v.com
ostrovtaxi.ru ovirus.ru
owohho.com owohho.com
palocco.it paceform.com
pandroid.co paclitor.com
partners-ship.pro park.above.com
pcboa.se parlament.biz
pdfprof.com partnerworkroom.men
pepperstyle.ru pavlodar.xkaz.org
percin.biz.ly pechikamini.ru
perfectplanned.com pekori.to
phormchina.com phelissota.xyz
photokitchendesign.com
phrcialiled.com
picphotos.net
pihl.se pihl.se
pix24x7.com pinstake.com
pliks.pl plastjulgranar.se
poiskzakona.ru
pokemon-go-play.online
polimga.pw polimga.pw
polska-poezja.com polytopesexempt.com
popander.mobi popmarker.com
porndroids.com porn-w.org
porno-dojki.net pornhive.org
porno-video-chati.ru
pornohd1080.online pornohd1080.online
pornosexrolik.com pornoklad.net
powenlite24.ru potoideas.us
pozvonim.com prefersurvey.net
prchecker.info pro-poly.ru
printdirectforless.com pronorm.fr
productarium.com proposal-engine.com
proekt-gaz.ru propranolol40mg.blogspot.com
progonrumarket.ru putitin.me
pskcijdc.bloger.index.hr py100.ru
pst2017.onlinewebshop.net pyrodesigns.com.au
quality-traffic.com qexyfu.bugs3.com
quangcaons.com qwarckoine.com
quickcashlimited.com qwesa.ru
r-control.ru r-control.ru
rabotaetvse.ru rapidgator-porn.ga
rada.ru razorweb-a.akamaihd.net
randalljhoward.com rcb101.ru
rank-checker.online realitykings.com
rankia.com recipedays.com
realizmobi.com refudiatethissarah.info
rebrand.ly registrationdomainsite.com
redirectingat.com renecaovillasale.online
ritlweb.com replica-watch.ru
rniaeba.ga revistaindustria.com
rome2rio.com riders.ro
royal-betting.net rique.host.sk
runtnc.net robertefuller.com
saitevpatorii.com roleforum.ru
salutmontreal.com roznica.com.ua
sammlungfotos.online runofilms.ru
sampleletters.net ruscopybook.com
scanner-jessica.top rutor.group
scanner-mary.top rvzr-a.akamaihd.net
scanner-walt.top s1z.ru
scopich.com samoiedo.it
searchinquire.com sanatorrii.ru
secret.xn--oogle-wmc.com saneyes.com
securityallianceservices.com savememoney.co.za
seorankinglinks.us sbornik-zakonov.ru
sexobzor.info scanner-ivan.top
sexstream.pl scanner-nelson.top
sexyteens.hol.es scrapy.org
sharebutton.to scrnet.biz.ua
shariki-zuma-lines.ru sdi-pme.com
shivafurnishings.com searchencrypt.com
shopcheermakeup.info searchkut.com
silvercash.com searchwebknow-a.akamaihd.net
simplesite.com seminarygeorgia59.ga
sims-sims.ru sendearnings.com
seo-2-0.com
seo-traffic-ranking.info
seocheckupx.com
serpstat.com
serw.clicksor.com
shoesonlinebuy.xyz
shoppingjequiti.com.br
sibdevice.ru
sim-service.net
skladvaz.ru skladvaz.ru
smokewithrabbits.com smartpet.ru
snts.shell-pmr.ru snip.tw
softonicads.com social-s-iii.xyz
solinf.co socialsignals24.com
solnplast.ru spasswelt.net
sotkal.lark.ru spb.afora.ru
souvenir.cc sstroy44.ru
specialfinanceoffers.com stair.registrydomainservices.com
squidoo.com startwp.org
srgwebmail.nl steame.ru
steelmaster.lv streetfooduncovered.com
stpolice.com stroilka.info
stroicol.net stroiminsk.org
stroimajor.ru studentguide.ru
stroyplus.ru sudexpert66.ru
students-cheapskate.ml superkanpo.com
stuff-about-money.com supermesta.ru
success-seo.com
suhanpacktech.com
sukirgenk.dvrlists.com
superlist.biz
survival.betteroffers.review survival.betteroffers.review
svarkagid.com syndicate.fun
szucs.ru takeflyte.com
takeprofitsystem.com tampabaywatch.org
td-l-market.ru tattomedia.com
teenbbw.yopoint.in tds-advert005.info
telefonsexsofort.tk telesvoboda.ru
terraclicks.com tengohydar.tk
thebluenoodle.com tfxiq.com
thepornsex.org thefarmergame.com
theprofitsmaker.net thefds.net
thetardistimes.ovh thegameriders.com
thexart.club thegamerznetwork.com
timecrimea.ru timeallnews.ru
timetorelax.biz titan-cloud.life
tizanidine4mg.blogspot.com tizanidineduringpregnancy.blogspot.com
tizanidinedrugtest.blogspot.com tizanidineforopiatewithdrawal.blogspot.com
tizanidinehcl4mgisitanarcotic.blogspot.com tizanidinestreetvalue.blogspot.com
tizanidineinteractions.blogspot.com tk-assortiment.ru
tizanidinesideeffects.blogspot.com topcasinoratings.ru
tkanorganizma.ru
toondinsey.com
topcar-krasnodar.ru
topdownloads.ru
topvidos.ru topvidos.ru
toursmaps.com torrent-newgames.com
totu.info
track2.shop track2.shop
trailer.cinemaflix.website tracxn.com
traffmonster.info
trion.od.ua trion.od.ua
ttrraacckkrr.com triumf-realty.ru
tube8.com try-rx.com
tuckpointingmasonrysystems.com tsstcorpcddvdwshbbdriverfb.aircus.com
tupper-shop.ru turbodsp.com
turizmus.us tvory.predmety.in.ua
tzritel.tk twu.com.ua
u17795.netangels.ru txxx.com
umg-stroy.ru uasb.ru
urlopener.com ukrtextbook.com
usswrite.com underthesite.com
uzporno.mobi univerfiles.com
v-doc.co unrealcommander.org
valkiria-tk.ru uprour.com
varbergsvind.se url-img.link
vbabule.net ustion.ru
verymes.xyz versaut.xxx-cam.webcam
via-energy-order.com vertaform.com
via-gra.webstarts.com vesnatehno.com
viagengrarx.com videochat.life
videochaty.ru villacoloniale.com
vilingstore.net virtuagirl.com
vitalads.net visionwell.com.cn
viveresaniesnelli.it
vk-mus.ru
vkgaleria.com
vkontarkte.com
vltai.com vltai.com
voltrknc1.com vuclip.com
webads.co.nz walkme.com
weblibrary.win watchdogs-2.ru
webpromotion.ae waterpurifier.club
webs.com waycash.net
weddingdresses.xyz web.cvut.cz
weprik.ru webstatsdomain.org
whiteelephantwellington.com wemarketing.se
williamrobsonproperty.com whatsappdownload10.com
winner7777.net wholesalejerseys-cheapest.com
witclub.info wonderfulflowers.biz
wordpress-crew.net
worldtraveler.world worldtraveler.world
wurr.voila.net wosik-dach.service-for-web.de
xboxster.ru wstroika.ru
xmnb.net ww2awards.info
xn--80aeahghtf8ac5i.xn--p1ai www.labves.ru
xn--80aebbcbcdemfkhba4byaehoejh8dza3v.xn--p1ai www.solartek.ru
xn--d1abj0abs9d.in.ua x69ty.ru
xnxx-n.com xcc24.pl
xnxx699.com xchangetrak.com
xrus.org xmladserver.com
xsion.net xn--80ajbshivpvn2i.xn--p1ai
xuki.us xxart.ru
xwatt.ru yhit.press
xxxtube69.com youjizz.vc
yaoguangdj.com youradexchange.com
yebocasino.com youtubologia.it
yes-com.com yurgorod.ru
youtubedownload.org zapiszto.pl
ytmnd.com zebradudka.com
zarabotat-na-sajte.ru zeroredirect6.com
zarenica.net zhorapankratov7.blogspot.com
zazagames.org zoogdiesney.com
zeroredirect5.com zs2vm.top
zeroredirect9.com
zolotoy-lis.ru
zoogdisany.com
zryydi.com

490
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
11pikachu.ru 1001desert.com
108shot.com
123movies.love
12u.info 12u.info
1688.com 1314dh.com
2345.com 14b.info
2daytrendingnews.com 1hwy.com
888.com 3xforum.ro
999webdesign.com abcguru.xyz
aa8780bb28a1de4eb5bff33c28a218a930.com adclickthru.net
aa9bd78f328a6a41279d0fad0a88df1901.com adult3dgames.com
acmebtn.ml adventureparkcostarica.com
ad-words.ru agecheckadult.com
adamoads.com ahhjf.com
adobereader-free.ru aksonural.ru
adverster.com alert-hgd.xyz
agapovdg.ru anapa-inns.ru
akvamaster.dp.ua android-vsem.org
alert-fjg.xyz apibrowsesmartne-a.akamaihd.net
alphacarolinas.com avon-ukraine.com
amazingninja.com bannerpower.com
anonymizeme.pro besthoro.ru
anti-virus-removal.info bingoporno.com
arclk.net bio.trade-jp.net
arendas.net blogs.rediff.com
asophoto.com bonkers.name
atley.eu.pn braintobe.win
atmovs.com brillianty.info
avto-oligarh.ru bristolhotel.com.ua
avtoarenda.by buy-forum.ru
awency.com buypuppies.ca
ayakino.net buzz-porno.info
baersaratov.ru
baladur.ru
banki76.ru
bannerads.de
beauby.ru
bestkfiledxd.cf
bestprofits-there.com
blackwitchcraft.ru
blobar.org
blogrankers.com
bonux.nextview.ru
boobsimge.com
bookmaker-bet.com
braindaily.xyz
buron.pw
businescoop.men
buyviagraa.blogspot.com
buzzsumo.com buzzsumo.com
c-english.ru c1.onedmp.com
calc-for-credit.ru carabela.com.do
camel-beach.com cardsharp1.ru
canvas.gloverid.site carsdined.org
carloans.com carstrends2015.com
cartierlove2u.com cartierlovestore.xyz
casablancamanor.co.za casite-513049.cloudaccess.net
cashkitten-a.akamaihd.net cheatcode-lita12.rhcloud.com
chatroulette.world cherubinimobili.it
cialischsrx.com chocolateslim-u-srbiji.com
cityadspix.com club-lukojl.ru
cntravelre.com com-secure.download
com-onlinesupport.host compiko.info
communisave.co.za compliance-fred.top
community.allhiphop.com compliance-ivan.top
compliance-don.xyz coop-gamers.ru
cv.wallhade.co cpajunkies.com
deanmoore.ie crazyprotocol.com
delitime.info creams.makeforum.eu
demian.kz crest-poloski.ru
detoxmed24.ru dalavia.ru
dimkino.ru data-mining.tk
dinosaurus.site ddlmega.net
dmmspy.com ddospanel.com
draniki.org deda-moroza-zakaz.ru
dumpsmania24.com dgfitness.co
e90post.com dollartree.info
ebonyporn.site download-of-the-warez.blogspot.com
ecommerce-seo.org downloaddy.net
elektronischezigarette2.mex.tl downloads-whatsapp.com
elektrozigaretten1.postbit.com elmacho.xyz
elvenar.com essay-edu.biz
eng-lyrics.com essayassist.com
esfchat.tk etotupo.ru
euronis-free.com farmprofi.net
falcon-images.blogspot.com fashionavenuegame.com
fellowshipoftheminds.com fordsonmajbor.cf
fickenprivat.info free-fb-traffic.com
fighrofacciufreesig.ga free-stock-illustration.com
filunika.com.ru freshmac.space
finejewelryshop.ru g.starmoe.xyz
flowersbazar.com galeon.com
flprog.com game-top.su
food.dtu.dk gameplexcity.com
forensicpsychiatry.ru gdebestkupit.ru
forum20.smailik.org getprismatic.com
fotzen-ficken.com gratuitbaise.com
free-share-buttons.blogspot.com greamimgo.pw
fun-mobi.pl groupmoney.ru
gabeshop.ru guardlink.org
gambarkataku.co guidefs.ru
gambarxkata.co healmytrauma.info
gamezblox.com historichometeam.com
gg-arena.ru hkladys.com
glall.ru hotsocialz.com
goforexvps.com houston-vikings.com
goodwinmetals.co hully.altervista.org
googlepositions.com humanelydrew.com
green-tea.tv hyipmanager.in
grizzlysgrill.com iblogpress.xyz
gsasearchengineranker.pw icaseclub.ru
gsbs.com.ua ilte.info
gta-top.ru imabase.com
handicapvantoday.com imagefinder.site
hchha.com imagerydatabase.com
hdimagegallery.net
hmmm.cz
holidaypics.org
hptwaakw.blog.fc2.com
imadedinner.net
imgata.com
immobiliaremassaro.com
impisr.edunsk.ru
import-sales.com import-sales.com
innodgfdriverhm.aircus.com infogame.name
integritylandscapeservices.com iqoption-bin.com
japan-bearings.ru isoveti.ru
javxxx18.com itag.pw
keywords-monitoring-success.com itservicesthatworkforyou.com
kino-rf.ru jamiembrown.com
kosmetyki.tm.pl javrip.net
kunstaktien.info jolic2.com
lakomka.com.ua kadashihotel.com
letolove.ru karusel-market.ru
letsart.ru keywordspay.com
light.ifmo.ru kinozapas.org
linkwithin.com kiwe-analytics.com
liveu.infoteka.hu kosova.de
louboutinreplica.pw krassh.ru
lovasszovetseg.hu lacapilla.info
m292.info larchik.net
macnewtech.com laxob.com
magnetpress.sk letsrepair.in
makenahartlin.com liffa.ru
manifestyourmillion.com linerdrilling.com
medicinacom.ru lizace.com
medicovi.com lockerz.com
member-quiz.com louboutinbooties.xyz
microsoftportal.net magazintiande.ru
monsterdivx.com manuscript.su
moviezbonkerssk.cf mcadamssupplyco.com
msk-diplomat.com mcnamaratech.com
muznachas-service.ru mearns-tractors.co.uk
needtosellmyhousefast.com merryhouse.co.uk
netoil.no milblueprint.com
nikitabuch.com mini-modus.ru
nisuturnetdgu.tk mister-shop.com
nottyu.xyz mnogabukaff.net
noumeda.com monclerjacketsoutlet.pw
o-o-6-o-o.ru moyaterapiya.ru
oakridgemo.com myhydros.org
ofanda.com narkologiya-penza.ru
panouri-solare-acoperis.com nfljerseyscheapbiz.us
paradontozanet.ru nikhilbahl.com
pendelprognos.se nw-servis.ru
perederni.net oakleyglassesonline.us
picphotos.net offf.info
pijoto.net onclkads.com
pl-vouchers.com onlineslotmaschine.com
ploenjitmedia.azurewebsites.net open-odyssey.org
pobeiranie.pl ovirus.ru
porn-w.org owathemes.com
pornoklad.net ownshop.win
pornpost.in panchro.xyz
potolokelekor.ru pawli.eu
prchecker.info pelfind.me
productarium.com pewit.pw
proftests.net piccshare.com
quickbuck.com pixshark.com
plastgranar.nu
pliks.pl
polimga.pw
popcash.net
porno-transsexuals.ru
pornoxxx.com.mx
portside.xyz
prefersurvey.net
pregnant.guru
privatbank46.ru
profitwithalex.info
prostitutki-tyumeni.org
pussysaga.com
pxhdwsm.com
quelle.ru
ranksonic.info ranksonic.info
recordpage-a.akamaihd.net rapidokbrain.com
registratciya-v-moskve.ru realnye-otzyvy.info
registrationdomainsite.com research.ifmo.ru
rennlist.com reward-survey.net
resant.ru romhacking.ru
restorator-msk.ru samolet.fr
rukino.org sanyuprojects.com
sabaapress.com sayyoethe.blogspot.co.za
sarafangel.ru sbetodiodnye-lampy.ru
schlampen-treffen.com school-diplomat.ru
scopich.com searchaddis.com
scripted.com seksvideoonlain.com
sel-hoz.com serdcenebolit.com
semxiu.com serviporno.com
seo-prof1.xyz sex-tracker.de
seoboxes.com sex-znakomstva.online
seotoolsagency.com sexkvartal.com
sex-dating.co shell-pmr.ru
sexflirtbook.com shitmovs.com
sexpornotales.net shymkent.xkaz.org
sexytrend.ru sicfor.bcu.cc
sharpchallenge.com sims-sims.ru
shohanb.com site3.free-share-buttons.com
silvercash.com slavic-magic.ru
site-speed-check.site smstraf.ru
snegozaderzhatel.ru social-s-iii.xyz
social-button.xyz sogimlecal.tk
strongholdsb.ru soserfis.com
supers.com.ua space4update.pw
svolze.com specialfinanceoffers.com
swimpool.ca spylog.com
tattooha.com spywarenuker.com
tds-advert002.info staticfs.host
techart24.com streamin.to
thelottosecrets.com stroilka.info
theplacetoupdating.pw the-torrent-tracker.blogspot.com
titelhelden.eu thejournal.ru
trafficcentr.xyz thewomenlife.com
tramadolandtizanidine.blogspot.com thin.me.pn
trkdf.com tmtrck.com
turist-strani.ru topcasinoratings.ru
tv-spoty.info topsy.com
u-cheats.ru tuberkuleznik.ru
u17795.netangels.ru uchebavchehii.ru
ukkelberg.no urll.eu
unrealcommander.com valuado.com
url-img.link
uroki.net
valueclick.com valueclick.com
vclicks.net veselokloun.ru
videochat.tv.br vesnatehno.com
viktoria-center.ru vezuviy.su
vilingstore.net videochat.bz
vkak.ru videochat.ph
vzlomtw.com viveresaniesnelli.it
wallpaperaccess.com vksaver-all.ru
watchinf.com vladimir.xrus.org
weblibrary.win wareseeker.com
webradiology.ru warezkeeper.com
webtherapy.ru weightatraining.com
wleuaprpxuvr.ga wesharepics.com
wpsecurity.website westsextube.com
xn--80aebbcbcdemfkhba4byaehoejh8dza3v.xn--p1ai worldlovers.ru
xn--80ajjbdhgmudixfjc8c5a9df8b.xn--p1ai wstroika.ru
xportvusbdriver8i.snack.ws x-diesel.biz
yellowstonevisitortours.com xfire.com
yourserverisdown.com xgftnlrt.bloger.index.hr
zaimhelp.ru xn----7sbaphztdjeboffeiof6c.xn--p1ai
zaimite.ru xn--80aaaks3bbhabgbigamdr2h.xn--p1ai
zawyna.ua xn--80aodinpgi.xn--p1ai
zophim.me xn--b1agm2d.net
zscalerone.net xxlargepop.com
xxxmania.top
yginekologa.com
youraticles.pl
yourothersite.com
yoursearch.me
youtubologia.it
zajm-zalog-krasnodar.ru
zebramart.ru
zeroredirect6.com
zs2vm.top

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.38 0; 10.1.0.91 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.04.3042 ### Version: V4.2022.04.3043
### Updated: Wed Apr 13 22:01:24 UTC 2022 ### Updated: Thu Apr 14 10:03:27 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.04.3042 ### Version: V4.2022.04.3043
### Updated: Wed Apr 13 22:01:24 UTC 2022 ### Updated: Thu Apr 14 10:03:27 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##