vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-10 15:34:24 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2022.04.3042 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2022-04-13 22:07:04 +00:00
parent e4f0365daf
commit e5668418a9
46 changed files with 94934 additions and 94934 deletions
Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.04.3041 #### Version: V4.2022.04.3042
#### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.04.3041 #### Version: V4.2022.04.3042
#### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -14,7 +14,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2022.04.3041 #### Version: V4.2022.04.3042
#### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

11730
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2022.04.3041 #### Version: V4.2022.04.3042
#### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

11734
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

11734
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

11734
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

11734
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.160 1; 10.1.0.38 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.160 0; 10.1.0.38 0;
127.0.0.1 0; 127.0.0.1 0;

11734
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.160 1; 10.1.0.38 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.160 0; 10.1.0.38 0;
127.0.0.1 0; 127.0.0.1 0;

11734
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.160 1; 10.1.0.38 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.160 0; 10.1.0.38 0;
127.0.0.1 0; 127.0.0.1 0;

11734
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
3041 3042

11734
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

11734
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
40.77.5.123 0; 40.83.249.7 0;

11734
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.160 1; 10.1.0.38 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.160 0; 10.1.0.38 0;
127.0.0.1 0; 127.0.0.1 0;

11734
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.160 1; 10.1.0.38 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.160 0; 10.1.0.38 0;
127.0.0.1 0; 127.0.0.1 0;

11734
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.160 1; 10.1.0.38 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.160 0; 10.1.0.38 0;
127.0.0.1 0; 127.0.0.1 0;

11734
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
40.77.5.123 0; 40.83.249.7 0;

11734
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
40.77.5.123 0; 40.83.249.7 0;

11734
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.160 1; 10.1.0.38 1;
127.0.0.1 1; 127.0.0.1 1;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
Apexoo Anarchy
CheTeam BlowFish
ECCP/1.0 Id-search
IstellaBot MTRobot
Lightspeedsystems Mail.RU_Bot
Majestic12 Masscan
Navroad Petalbot
PHPCrawl Tracemyfile
check1.exe Webshag
facebookscraper Who.is Bot

316
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
01h4x.com
360Spider 360Spider
404checker
404enemy
80legs 80legs
AIBOT
Abonti Abonti
AhrefsBot Aboundex
AiHitBot Acunetix
Aipbot AllSubmitter
Alligator Alligator
Ankit Anarchie
Anarchy99
Anthill
Apexoo Apexoo
Aspiegel Aspiegel
Asterias Attach
Atomseobot BLEXBot
AwarioSmartBot
BDCbot
BDFetch
BackDoorBot BackDoorBot
BatchFTP Backlink-Ceck
Badass
Bandit
Barkrowler
Bigfoot Bigfoot
Bitacle
Blackboard Blackboard
Brandprotect BlowFish
Buddy BotALot
BuiltBotTough BuiltBotTough
BunnySlippers BunnySlippers
CATExplorador CCBot
CazoodleBot CODE87
Cegbfeieh Cegbfeieh
CensysInspect
CheTeam CheTeam
CherryPicker CheeseBot
ChinaClaw Chlooe
Citoid Cloud mapping
Claritybot Cogentbot
Cliqzbot Copier
Copyscape Copyscape
Cosmos Crawling at Home Project
Craftbot CrunchBot
CrazyWebCrawler DBLBot
CyotekWebCopy DIIbot
DSearch Demon
DTS Agent DigitalPebble
Devil Disco
Discobot DnyzBot
DomCopBot DomCopBot
DomainAppender DomainCrawler
DomainStatsBot DomainSigmaCrawler
Domains Project
Dotbot Dotbot
Drip
ECCP/1.0 ECCP/1.0
EMail Wolf
Ebingbong Ebingbong
Ecxi Ecxi
EirGrabber EroCrawler
Express WebPictures
Extractor Extractor
ExtractorPro EyeNetIE
Extreme Picture Finder
Ezooms
FDM
FHscan
FemtosearchBot
Firefox/7.0
FlashGet
Foobot Foobot
Fuzz
FyberSpider
Fyrebot Fyrebot
GT::WWW Genieo
GalaxyBot GetRight
GermCrawler Gigabot
Go!Zilla
Go-Ahead-Got-It Go-Ahead-Got-It
GoZilla GoZilla
GrabNet Grafula
GrapeFX GrapeFX
GridBot HTMLparser
HEADMasterSEO HTTP::Lite
HMView
HTTrack HTTrack
Haansoft
Havij Havij
Heritrix Hloader
HonoluluBot HonoluluBot
Humanlinks
IDBTE4M IDBTE4M
IRLbot Id-search
Iblog Image Sucker
Image Fetch InfoTekies
InterGET Internet Ninja
JamesBOT InternetSeer
JetCar
JikeSpider
Joomla Joomla
Jorgee Jorgee
Kinza JustView
Jyxobot
Keyword Density
Kozmosbot Kozmosbot
LNSpiderguy Lanshanbot
LWP::Simple LeechGet
Larbin
LeechFTP
LexiBot LexiBot
LinkScan LibWeb
LinkextractorPro
LinksManager LinksManager
LinqiaMetadataDownloaderBot
LinqiaRSSBot LinqiaRSSBot
Litemage_walker Lipperhey
Ltx71 Lmspider
MIDown tool
MJ12bot MJ12bot
Majestic SEO MQQBrowser
Magnet
Majestic12 Majestic12
MauiBot Mass Downloader
MeanPath Bot Metauri
Mediatoolkitbot Microsoft URL Control
Microsoft Data Access
Minefield Minefield
Mojolicious Moblie Safari
MolokaiBot
Mozlila Mozlila
Msrabot Msrabot
Nameprotect Musobot
NICErsPRO
NearSite NearSite
Net Vampire NetAnts
NetLyzer NetLyzer
NetMechanic NetSpider
Netvibes
NextGenSearchBot NextGenSearchBot
Nibbler
Nikto
NimbleCrawler
Nimbostratus Nimbostratus
Ninja Ninja
Nmap OpenVAS
Not
Nuclei
Offline Explorer
Offline Navigator
OrangeBot OrangeBot
OutclicksBot
PECL::HTTP PECL::HTTP
PHPCrawl
Page Analyzer
PageAnalyzer PageAnalyzer
PageGrabber PageGrabber
Pandalytics Panscient
Papa Foto Pimonster
Picsearch
PictureFinder
Pixray Pixray
PleaseCrawl
ProPowerBot
ProWebWalker ProWebWalker
Probethenet Probethenet
Psbot Psbot
Pu_iN Pu_iN
Quick-Crawler Pump
PxBroker
PyCurl
QueryN Metasearch
RSSingBot
RankActiveLinkBot
RankFlex
Rankivabot
RankurBot
Re-re Re-re
ReGet
RealDownload
Reaper Reaper
Recorder RebelMouse
RocketCrawler RedesScrapy
SBIder SBIder
SEOstats SEOkicks
SISTRIX SEOlyticsCrawler
ScanAlert SMTBot
Scanbot SalesIntelligent
ScoutJet ScrepyBot
Scrapy Seekport
Searchestate
SearchmetricsBot
SemrushBot SemrushBot
SeoSiteCheckup SentiBot
SeobilityBot Siphon
Shodan
Site Sucker
SiteExplorer
SiteLockSpider SiteLockSpider
SiteSucker Sitevigil
SlySearch
Snake Snake
Snapbot Snoopy
SocialRankIOBot SocialRankIOBot
Sosospider SpankBot
SpaceBison Spbot
Spammen
Spanner
Spinn3r Spinn3r
SputnikBot Sqlmap
Sqlworm Sqworm
Sucuri Sucuri
Surfbot Surfbot
T0PHackTeam SurveyBot
TeleportPro Szukacz
Telesphoreo
The Intraformant The Intraformant
TheNomad
TightTwatBot
Titan Titan
Toata Toweyabot
Trendiction Trendiction
Trendictionbot Trendictionbot
Turingos TurnitinBot
Turnitin Typhoeus
Twice
URLy Warning
URLy.Warning URLy.Warning
UnisterBot UnisterBot
Upflow VB Project
VoidEYE VelenPublicWebCrawler
VeriCiteCrawler
VidibleScraper
Voil Voil
WASALive-Bot Voltron
WPScan WBSearchBot
Wallpapers/3.0 WEBDAV
Web Fuck WWW-Collector-E
Web Pix WWW-Mechanize
Web Sauger WWW::Mechanize
Wallpapers
WallpapersHD
Web Enhancer
Web Fetch
Web Sucker
WebAuto
WebBandit WebBandit
WebCollage WebCollage
WebFetch WebEnhancer
WebGo IS WebFuck
WebLeacher WebSucker
WebPix Webalta
WebStripper WebmasterWorldForumBot
WebWhacker Webster
WebZIP Whacker
Wprecon Whatweb
WinHTTrack
Wonderbot
Xaldon WebSpider Xaldon WebSpider
Xaldon_WebSpider
Xenu Xenu
Zauba Zauba
ZoominfoBot Zermelo
archive.org_bot Zeus
ZumBot
arquivo-web-crawler
arquivo.pt arquivo.pt
autoemailspider autoemailspider
check1.exe coccocbot
crawl.sogou.com cognitiveseo
demandbase-bot com.plumanalytics
crawler4j
dataforseo.com
domainsproject.org
evc-batch evc-batch
facebookscraper gopher
heritrix heritrix
instabid iubenda-radar
ips-agent
isitwp.com
lwp-request lwp-request
lwp-trivial lwp-trivial
magpie-crawler magpie-crawler
meanpathbot meanpathbot
plumanalytics oBot
s1z.ru
scan.lol scan.lol
seobility
seocompany.store
seoscanners seoscanners
seostar seostar
serpstatbot serpstatbot
siteripz siteripz
spyfu sp_auditbot
ubermetrics-technologies.com ubermetrics-technologies.com
webmeup-crawler voyagerx.com
webprosbot
x09Mozilla
x22Mozilla x22Mozilla
zauba.io zauba.io
zgrab

300
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
01h4x.com 01h4x.com
360Spider 360Spider
404checker
404enemy 404enemy
80legs
ADmantX
ALittle Client
Aboundex Aboundex
Aboundexbot Aboundexbot
AfD-Verbotsverfahren Acunetix
AiHitBot
Aipbot Aipbot
AllSubmitter AllSubmitter
AlphaBot Alligator
Anarchie Ankit
Anarchy Anthill
Apexoo Asterias
Aspiegel AwarioRssBot
Atomseobot BackWeb
Attach
AwarioSmartBot
BackStreet
Backlink-Ceck Backlink-Ceck
BacklinkCrawler Badass
Barkrowler Bandit
BatchFTP BatchFTP
Battleztar Bazinga Bigfoot
BetaBot Bitacle
Black Hole Blackboard
Boardreader Blow
Bolt BlowFish
Buck BuiltWith
Bullseye CODE87
BuzzSumo
CSHttp CSHttp
Calculon
CazoodleBot CazoodleBot
Cegbfeieh
CensysInspect CensysInspect
CheTeam CheTeam
CheeseBot Chlooe
CherryPicker Citoid
ChinaClaw Cloud mapping
Cocolyzebot Cogentbot
Collector
Cosmos Cosmos
Craftbot Craftbot
Crawling at Home Project
CrunchBot CrunchBot
Custo Demon
DBLBot Deusu
DataCha0s Digincore
DatabaseDriverMysqli Dirbuster
DigitalPebble Disco
DnyzBot Discobot
DomCopBot Dispatch
DnBCrawler-Analytics
DomainAppender DomainAppender
DomainSigmaCrawler
DomainStatsBot DomainStatsBot
EMail Siphon Drip
ECCP/1.0
EasyDL
Ebingbong Ebingbong
Exabot ExtLinksBot
Ezooms Extractor
FHscan
Fimap
Firefox/7.0 Firefox/7.0
Flunky Flunky
Foobot
Freeuploader Freeuploader
Fuzz Fuzz
FyberSpider GT::WWW
Fyrebot GetRight
GalaxyBot Getintent
GermCrawler Go!Zilla
GetWeb
Go-Ahead-Got-It Go-Ahead-Got-It
GoZilla GoZilla
Gotit
GrabNet
Grabber Grabber
Grafula GridBot
HEADMasterSEO HEADMasterSEO
HTMLparser HMView
Haansoft Haansoft
HaosouSpider HaosouSpider
Hloader Havij
Humanlinks HybridBot
IDBot Iblog
IRLbot
Image Fetch Image Fetch
Image Sucker IndeedBot
Indy Library InfoNaviRobot
Intelliseek
Iskanie Iskanie
Jbrofuzz IstellaBot
JikeSpider JamesBOT
Joomla Joomla
Jorgee Jorgee
JustView
Jyxobot Jyxobot
Keyword Density Kozmosbot
Lanshanbot Lanshanbot
LeechFTP LeechFTP
LeechGet LexiBot
Libwhisker Lftp
LibWeb
LieBaoFast
Likse Likse
LinkScan LinqiaRSSBot
Linkbot
LinksManager
LinqiaMetadataDownloaderBot
LinqiaScrapeBot LinqiaScrapeBot
Lipperhey
Lipperhey Spider Lipperhey Spider
Litemage_walker
Ltx71 Ltx71
MIIxpc MJ12bot
MSIECrawler MSFrontPage
Majestic-SEO Majestic SEO
MarkWatch
Mass Downloader Mass Downloader
Mata Hari Masscan
MauiBot
Mb2345Browser Mb2345Browser
MeanPath Bot
Mediatoolkitbot
Metauri Metauri
MicroMessenger Mister PiX
Microsoft Data Access
Moblie Safari Moblie Safari
Mojeek Mojeek
MolokaiBot MolokaiBot
Mr.4x3 Msrabot
NPbot
Name Intelligence
Nameprotect Nameprotect
Navroad Navroad
NetLyzer NearSite
Net Vampire
NetAnts
NetMechanic NetMechanic
NetSpider NetZIP
Netcraft
NextGenSearchBot NextGenSearchBot
Niki-bot Nikto
NimbleCrawler
Ninja
Not
Nuclei Nuclei
OnCrawl Octopus
OpenLinkProfiler Offline Explorer
OpenVAS Openfind
Openvas Page Analyzer
OrangeBot
OrangeSpider
PageAnalyzer
PageGrabber
PageThing.com
Pandalytics
Papa Foto
Pavuk Pavuk
PeoplePal
Petalbot Petalbot
Pimonster
Pixray
PleaseCrawl PleaseCrawl
Pockey Pockey
Probethenet
Quick-Crawler Quick-Crawler
RankActive
RankActiveLinkBot RankActiveLinkBot
RankFlex
RankingBot
RankingBot2 RankingBot2
RealDownload Rankivabot
Re-re
ReGet
Recorder
RedesScrapy
Ripper Ripper
RocketCrawler
SBIder SBIder
SEOkicks
SEOkicks-Robot
SEOprofiler SEOprofiler
SISTRIX
SalesIntelligent SalesIntelligent
ScanAlert
Scanbot Scanbot
ScoutJet ScoutJet
Searchestate ScreenerBot
SearchmetricsBot Semrush
Seekport
SemanticJuice
SemrushBot
SeoSiteCheckup SeoSiteCheckup
Siphon Siphon
SiteCheckerBotCrawler
SiteExplorer SiteExplorer
SiteLockSpider SiteSucker
SiteSnagger
Sitebeam Sitebeam
SpankBot SmartDownload
Sogou web spider
Sosospider
Spbot Spbot
Spinn3r Spinn3r
SputnikBot Sqworm
Sqlmap
Stripper
Sucuri
SuperBot SuperBot
SurveyBot
Swiftbot Swiftbot
Szukacz Szukacz
T0PHackTeam Telesoft
TeleportPro
Telesphoreo Telesphoreo
The Intraformant Thumbor
TheNomad Tracemyfile
TightTwatBot
Trendiction Trendiction
Trendictionbot True_Robot
Turingos Turingos
Turnitin TurnitinBot
TwengaBot TwengaBot
URLy.Warning
UnisterBot UnisterBot
VoidEYE Upflow
VB Project
VelenPublicWebCrawler
VeriCiteCrawler
Voil
WASALive-Bot WASALive-Bot
WPScan
WWW-Collector-E
WWW-Mechanize
WWWOFFLE WWWOFFLE
Wallpapers/3.0 Wallpapers/3.0
Web Collage WallpapersHD
Web Fetch Web Fuck
Web Sauger Web Pix
WebAuto
WebBandit
WebCollage WebCollage
WebEnhancer
WebFetch WebFetch
WebFuck
WebImageCollector WebImageCollector
WebLeacher
WebPix WebPix
WebReaper WebReaper
WebSauger WebSauger
WebStripper
WebSucker
WebWhacker
WebZIP
WebmasterWorldForumBot
Webshag
WebsiteExtractor WebsiteExtractor
Webster Webster
Whacker Whacker
Widow Whatweb
Wprecon WinHTTrack
WiseGuys Robot
Wonderbot
Woobot
Wotbox
Xaldon WebSpider Xaldon WebSpider
Xenu Xenu
Zade Zade
Zauba cah.io.community
Zermelo cognitiveseo
Zitebot com.plumanalytics
ZmEu crawl.sogou.com
ZoominfoBot demandbase-bot
ZumBot domainsproject.org
adscanner
archive.org_bot
autoemailspider
coccocbot
crawler4j
dataforseo.com
eCatch eCatch
evc-batch
facebookscraper
gopher
heritrix
instabid instabid
ips-agent ips-agent
isitwp.com lwp-request
meanpathbot
mediawords mediawords
muhstik-scan
netEstate NE Crawler
page scorer page scorer
pcBrowser polaris version
plumanalytics probe-image-size
ripz scalaj-http
satoristudio.net
seostar seostar
sitechecker.pro sitechecker.pro
webgains-bot siteripz
webmeup-crawler sp_auditbot
webprosbot trendiction.de
zgrab

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
automobile-spec.com baksman.com
comeondog.info bioscorp.ru
googst2.ru cartierlovebraceletreplica.xyz
hledejvshopech.cz kndxbkdx.bloger.index.hr
longgreen.info netvouz.com
printdirectforless.com nudejapan.net
raschtextil.com.ua oakleyglassesonline.us
spacash.com ranksignals.com
vitalads.net thelottosecrets.com
ws.ampower.me truemfilelj.gq

934
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
01apple.com 00webcams.com
1001watch.com.ua 0daymusic.org
14b.info 100dollars-seo.com
1bet.com 12u.info
2girls1cup-free.com 13tabs.com
4istoshop.com 1flag.co.za
7search.com 1kinobig.ru
8gold.com 2020iscoming.info
98oi.ru 256bit.by
991mostfm.co.id 28n2gl3wfyb0.ru
aab94f698f36684c5a852a2ef272e031bb.com 2ads.co.uk
abctoppictures.net 2kata.ru
absolute-s.ru 4senses.co
abwa.tk 5u.com
accessoires-mode.in 7xc4n.com
91abcw.com
aaronabel.com
acheterviagrafr24.com acheterviagrafr24.com
actionnooz.com adclickservice.com
adf.ly adexprts.com
adimmix.com adman.se
admitad.com admatic.com.tr
adserver-e7.com adrenalin-stk.ru
adult3dgames.com adtology.com
adzpower.com adultmeetonline.info
alfapro.ru advokat-grodno.by
aghanyna.com
agysya.ru
ahmedabadwebs.com
aktivator-windows10.blogspot.com
alekseevec.ru
all4invest.info all4invest.info
allesohnegirls.net allmarketsnewdayli.gdn
allnews24.in alyeskaresort.com
alloysteel.ru amanda-porn.ga
analnoeporno.tv amospalla.es
anapa-inns.ru animenime.ru
anniemation.com arcadeplayhouse.com
apioasisspacenet-a.akamaihd.net artparquet.ru
arkkivoltti.net asiavirtualsolutions.com
artdeko.info asscenihotosidea.blogspot.co.za
artefakct.com audiofree.ru
arvut.org australia-opening-times.com
as5000.com autonew.biz
asrvrep-a.akamaihd.net availit.weebly.com
atley.eu.pn avek.ru
ausergrubhof.info azartmix.com
automatic-seo.com azartniy-bonus.com
automobile-spec.com azbukafree.com
avon-severozapad.ru babespcs.com
azartmsl.com backgroundpictures.net
b2b-lounge.com baladur.ru
babosas.com balitouroffice.com
bankofthewext.com bangla-chat-uk-paralud.ga
beachfix.co banki76.ru
beclean-nn.ru battlecarnival.su
best-deals-products.com battleforupdating.site
bestofupload.info becuo.com
bezlimitko.xyz berdasovivan.ru
bget.ru bestkfiledxd.cf
bikini-image.com bestssaker.com
bestwrinklecreamnow.com
betterhdporn.com
bidbuy.co.kr
biographiya.com
biznesrealnost.ru
bkns.vn bkns.vn
blackle.com
blacktwhite.com
blagovest-med.ru blagovest-med.ru
bmsco.co blavia.00author.com
boazpower.com bluesman.nu
bobba.dzaba.com bodybuilding-shop.biz
bolitgorlo.net browsepulse-a.akamaihd.net
bonvillan.com brus.city
book-bets.com btc4u.ru
braindaily.xyz businesxxl.com
brandedleadgeneration.com buyk.host.sk
break-the-chains.com calstaterealty.us
bristolhotel.com camdolls.com
btnativenav.com candypeople.se
buron.pw
bus-offer.com
business-suggested.tk
buybest1.biz
buypillsorderonline.com
c1.onedmp.com
californianews.cf
callstevens.com
cand.jp
candycrushshop.com
candytiner.com
carfax.com.ua carfax.com.ua
cartierreplica.xyz carson.getenjoyment.net
cbb1smartlist12.click cartierlove2u.com
cellfun.mobi cashkitten-a.akamaihd.net
certifywebsite.win casinorewards.info
cfcl.co.uk cdncash.org
chatroulette.online
cheapmoncler.win
chinaelitecheapjerseys.com
chocolateslim-original.com chocolateslim-original.com
cjmc.info chuckguilford.com
clean-start.net cialisovercounteratwalmartusa.com
cleanmypc.com ciekawinki.pl
clickbanksites.info claytransformations.info
clippingphotoindia.com clothesforcash.com
clknsee.com club-musics.ru
clmforexeu.com coin-hive.com
cmhomestayagency.com collegeessay19.blogspot.ru
coderstate.com com-onlinesupport.host
coldfilm.ru com-supportcenter.website
colehaanoutlet.store comeondog.info
community.allhiphop.com compliance-irvin.xyz
compliance-jack.top compliance-ivan.top
conocer-sanabria.com comsysnet.com
cool-wedding.net conboy.us
contentlook.co
cookie-law-enforcement-aa.xyz
coprofam.org coprofam.org
copyrightclaims.org cornerstone-countertops.com
counciltally.com corta.co
crafthubs.com costablue.xyz
crazyprotocol.com country-chic.ru
cutalltheshit.com covid-schutzmasken.de
cyclobenzaprinevstizanidine.blogspot.com credit-online.ws
dalavia.ru cryptoswap.biz
dangphoto.trade cxpromote.com
daooda.com darkages.info
dealitright.click dekorkeramik.ru
demon-tweeks.com deluxedumps.com
dentfidemountpreach.tk dentfidemountpreach.tk
derevesendeco.com design-lands.ru
detective01.ru destinationrealestate.com
deutschehobbyhuren.net deutschland123.de
dgfitness.co dev78.dioniqlabb.se
dimaka.info dfwu1013.info
dirtpics.pw discountliv.com
dispo.de djekxa.ru
diy-handmade-ideas.com docstoc.com
doctissimo.fr dostavimvdom.ru
dogsrun.net dosug-lux.ru
dokumentalkino.net dynainbox.com
drugspowerstore.com e-buyeasy.com
dverimegapolis.ru e705.net
dvrlists.com e90post.com
ecxtracking.com earncash.com.ua
ekosmetyki.net.pl ebonyporn.site
eldiariodeguadalajara.com ecookna.com.ua
electro-prom.com edudocs.net
elektrischezigarette1.blog.pl edwinkonijn.com.au
elektronischezigarette2.mex.tl ekobata.ru
elektrozigarettekaufen2.blogse.nl electrik-avenue.com
empirepoker.com elektrischezigarette1.onsugar.com
eng-lyrics.com elektrischezigarette2.devhub.com
engines-usa.com elexies.info
erotische-geschichten-xxl.com englate.com
escortslet.net enthuse.computernetworksonline.com
eugenevaultstorage.com eorogo.top
evehemming.blogspot.com.au ero-advertising.com
everypony.ru erotikchat-24.com
exmasters.com estelight.ru
expolicenciaslatam.co exoclick.com
ezigarettenkaufen1.pagina.gr facebook-mobile.xyz
factorynightclub.com failingmarriege.blogspot.com
faithe.top feel-planet.com
favorcosmetics.com femdom.twiclub.in
favornews.com fetroshok.ru
faz99.com fickenbumsen.net
fickkontaktehobbyhuren.com fickenprivat.info
film-one.ru figuringmoneyout.com
finstroy.net filerockstar298.weebly.com
fitnesspiks.com filmi-v.online
flowwwers.com financeloan.us
foodcrafts.website financetip.eu
forex.osobye.ru firesub.pl
forexgb.ru flagcounter.me
forms-mtm.ru flavors.me
formulaf1results.blogspot.com formularz-konkurs.tk
fortwosmartcar.pw forum20.smailik.org
forums.toucharcade.com foto-sisek.porngalleries.top
forzeronly.com foto-weinberger.at
frankofficial.ru fr-bearings.ru
free-floating-buttons.com free-deals.faith
freemags.cc freewhatsappload.com
freenom.link fres-news.com
freesitetest.com freshsuperbloop.com
freetangodownload.com freza-sverlo.ru
fuck-paid-share-buttons.xyz funnel.co.za
fuel-gas.com fxtips.ru
fungamelands.com gamebackyard.com
g33.org getlamborghini.ga
game-top.su getridofstretchmarks.org
gameplexcity.com
gameprimary.com
gate5.co.za
gaypornmovie.net
gdzkurokam.ru
gilbertbanda.net
girlgamerdaily.com girlgamerdaily.com
glavtral.ru girlsatgames.ru
globetrotting-culture.ru glass-msk.ru
gopixdatabase.com go2mike.ru
growmyfunds.ca goatse.ru
grtyi.com goforexvps.com
gsasearchengineranker.pw gok-kasten.net
goldpanningtools.com
goo.ne.jp
gorodservis.ru
gotorussia.com
greamimgo.pw
greatgrace.ru
gribokstop.com
growboxbl.ru
guiadeserraazul.com
guigyverpo.cf
gwebtools.com gwebtools.com
harmonyglen.us handicapvantoday.com
havepussy.com headpharmacy.com
hd-film.pl heartofpayne.xyz
helvetia.com.ua heatpower.ru
hotxnights.info helicalpile.us
housekuba.org help.tpu.ru
howlongdoestizanidinestayinyoursystem.blogspot.com hermesreplica.win
howtoclean.club high-speed1.net
humanorightswatch.org hitcpm.com
ideoworld.org home-task.com
ihtec2019.org hornymatches.com
imagecoolpub.com hotenergy.ru
images-free.net hotshoppymac.com
imagui.eu housediz.com
inboundlinks.win houseofgaga.ru
indetiske.ya.ru husky-shop.cz
ico.re
ifmo.ru
ikearugs.xyz
ilte.info
imicrovision.com
impisr.edunsk.ru
importchinacoach-teach.com
indiasourcemart.in
infobabki.ru infobabki.ru
infodocsportal.com infodocsportal.com
infospot.pt investzalog.ru
interior-stickers.ru isitwp.com
intermesh.net
iplogger.org
ipostroika.ru
istripper.com istripper.com
iwantmyfreecash.com iweblist.info
j33x.com j33x.com
janettabridal.com jav-fetish.site
javstock.com jimmychoosale.online
jongose.ninja jjbabskoe.ru
journalhome.com joessmogtestonly.com
junglenet-a.akamaihd.net junglenet-a.akamaihd.net
jus0wil.pp.ua justbcause.com
kakadu-interior.com.ua justkillingti.me
karaganda.xkaz.org
kerwinandcariza.com
ketoanhanoi.info ketoanhanoi.info
keywordspay.com keywordglobal.co.za
keywordteam.net kidskunst.info
kidd.reunionwatch.com kino-filmi.com
klikbonus.com kinogonew.ru
kometars.xyz kinohit1.ru
kursy-ege.ru kletkimehan.ru
labplus.ru kopihijau.info
landreferat.ru koptims.tiu.ru
law-check-two.xyz koversite.info
ldrtrack.com krafte.ru
lernur.net kvartir-remont.biz
letslowbefast.site lanasshop.ru
lezbiyanki.net landscaping.center
liffa.ru languagecode.com
linkwithin.com lapolis.it
larger.io
laserpen.club
lescinq.com
letmacworkfaster.world
letolove.ru
letslowbefast.today
lifebyleese.com
lifehacĸer.com
likrot.com
linkpulse.com
lion.misba.us
listiseltemournlan.gq listiseltemournlan.gq
lovasszovetseg.hu m0r0zk0-krava.ru
lutherstable.org m292.info
m.b00kmarks.com machicon-akihabara.info
macfix.life macotool.com
madot.onlinewebshop.net mafa-free.com
maranbrinfo.com.br matpre.top
marktforschung-stuttgart.com maximpartnerspr.com
meduza-consult.ru meddesk.ru
meetlocalchicks.com meltwater.com
memberty.com microstatic.pl
metarip.ru middlerush-a.akamaihd.net
mezaruk.info mil-stak.com
mhtr.be minet.club
microsearch.ru misslike.ru
microsoftportal.net moesexy.com
migente.com moncleroutletonline.pw
mixed-wrestling.ru moncleroutletonline.win
mlf.hordo.win moscow-clining.ru
mmstat.com moviemail-online.co.uk
morepoweronmac.trade mp3ringtone.info
multgo.ru mrpornogratis.xxx
mural.co mturkcontent.com
mxgetcode.com muabancantho.info
mycouponizemac.com music7s.me
myfreemp3.eu mzdish.site
myhydros.org na15.ru
myplaycity.com nagdak.ru
naj-filmy24.pl narkologiya-peterburg.ru
naturalbreakthroughsresearch.com naturalshair.site
nevansk.ru negociosdasha.com
newsperuse.com
newyorkhotelsmotels.info newyorkhotelsmotels.info
nikkiewart.ru niroo.info
njpalletremoval.com njpalletremoval.com
nordvpn.com nl.netlog.com
novodigs.com nodding-passion.tk
o-o-11-o-o.com nomuos.it
oakleyglassesonline.us nonameread45.live
oballergiya.ru notfastfood.ru
offer.wpsecurity.website novatech.vn
oil-td.ru nuker.com
okout.ru obiavo.net
one-gear.com offf.info
onemactrckr.com okmusic.jp
openfrost.com old-rock.com
orion-code-access.net onetravelguides.com
paleohub.info ooomeru.ru
parajumpersjakkesalgnorge.info open-odyssey.org
parajumpersoutlet.online oranga.host.sk
park.above.com osagonline.ru
parlament.biz ostrovtaxi.ru
partnerads.men owohho.com
pcads.ru palocco.it
pdamods.ru pandroid.co
perl.dp.ua partners-ship.pro
php-market.ru pcboa.se
picturesify.com pdfprof.com
pirateday.ru pepperstyle.ru
pixell.club percin.biz.ly
pizdeishn.com perfectplanned.com
pl-vouchers.com phormchina.com
platinumdeals.gr photokitchendesign.com
poems.com.ua phrcialiled.com
pokemon-go-play.online picphotos.net
pomoc-drogowa.cba.pl pihl.se
pix24x7.com
pliks.pl
polimga.pw
polska-poezja.com
popander.mobi popander.mobi
popup-jdh.xyz porndroids.com
pornhub-forum.ga
porno-dojki.net porno-dojki.net
pornogratisdiario.com pornohd1080.online
pornohub.me pornosexrolik.com
powenlite24.ru powenlite24.ru
pozvonim.com
prchecker.info
printdirectforless.com printdirectforless.com
privacylocationforloc.com productarium.com
privetsochi.ru proekt-gaz.ru
prizestohandle.club progonrumarket.ru
prosmibank.ru pskcijdc.bloger.index.hr
prostitutki-rostova.org pst2017.onlinewebshop.net
prpops.com quality-traffic.com
purchasepillsnorx.com quangcaons.com
push-ad.com quickcashlimited.com
pushdata.sendpulse.com r-control.ru
pussyfleet.com rabotaetvse.ru
quelle.ru rada.ru
quickbuck.com randalljhoward.com
quizzitch.net rank-checker.online
rasteniya-vs-zombi.ru rankia.com
rczhan.com realizmobi.com
recipedays.com rebrand.ly
redirectme.net redirectingat.com
reklamuss.ru ritlweb.com
remont-mobile-phones.ru rniaeba.ga
remontgruzovik.ru rome2rio.com
renecaovillasale.online royal-betting.net
rewardit.com runtnc.net
rfd-split.hr saitevpatorii.com
rialp.getenjoyment.net salutmontreal.com
richinvestmonitor.com sammlungfotos.online
ringtonepartner.com sampleletters.net
roma-kukareku.livejournal.com scanner-jessica.top
rossanasaavedra.net scanner-mary.top
rucrypt.com scanner-walt.top
rusprostitute.com scopich.com
russkie-gorki.ru searchinquire.com
s-iwantyou.com secret.xn--oogle-wmc.com
safe-app.net securityallianceservices.com
santasgift.ml seorankinglinks.us
sax-sex.com sexobzor.info
sbprabooks.com sexstream.pl
scanner-barak.top sexyteens.hol.es
scanner-don.top sharebutton.to
screentoolkit.com shariki-zuma-lines.ru
se-welding.ru shivafurnishings.com
se.bnt-team.com shopcheermakeup.info
search-goo.com
searchinterneat-a.akamaihd.net
secretscook.ru
seofied.com
seolab.top
service-core.ru
servingnotice.com
sexpornotales.net
sexsaoy.com
sextracker.be
sfd-chess.ru
shell-pmr.ru
shitmovs.com
shtaketniki.kz
shymkent.xkaz.org
signoredom.com
silvercash.com silvercash.com
simple-image.com.ua simplesite.com
simply.net sims-sims.ru
sitebeam.net skladvaz.ru
sitechecker.pro smokewithrabbits.com
sitopreferito.it snts.shell-pmr.ru
sixcooler.de softonicads.com
smichovbike.cz solinf.co
social-buttons.xyz solnplast.ru
space4update.pw sotkal.lark.ru
spamnuker.com souvenir.cc
spb-plitka.ru specialfinanceoffers.com
spb.afora.ru squidoo.com
spinnerco.ca srgwebmail.nl
sports-supplements.us steelmaster.lv
strag-invest.ru stpolice.com
styro.ru stroicol.net
suggest-keywords.com stroimajor.ru
superfish.com stroyplus.ru
supers.com.ua students-cheapskate.ml
susanholtphotography.com stuff-about-money.com
swagbucks.com success-seo.com
technopellet.gr suhanpacktech.com
tecnoteakviareggio.it sukirgenk.dvrlists.com
telefonsexi.com superlist.biz
themestotal.com survival.betteroffers.review
thetoiletpaper.com svarkagid.com
time-japan.ru szucs.ru
titangel-vietnam.com takeprofitsystem.com
tizanidine4mgprice.blogspot.com td-l-market.ru
tizanidinedosage.blogspot.com teenbbw.yopoint.in
tizanidineingredients.blogspot.com telefonsexsofort.tk
tizanidineoral.blogspot.com terraclicks.com
tizanidinevsvalium.blogspot.com thebluenoodle.com
tizanidinewithdrawal.blogspot.com thepornsex.org
tksn.ru theprofitsmaker.net
tmearegion26.com thetardistimes.ovh
token-lab.org thexart.club
toon-families.com timecrimea.ru
timetorelax.biz
tizanidine4mg.blogspot.com
tizanidinedrugtest.blogspot.com
tizanidinehcl4mgisitanarcotic.blogspot.com
tizanidineinteractions.blogspot.com
tizanidinesideeffects.blogspot.com
tkanorganizma.ru
toondinsey.com toondinsey.com
topads.men topcar-krasnodar.ru
topcasinoratings.ru topdownloads.ru
tourcroatia.co.uk topvidos.ru
track-rankings.online toursmaps.com
traffic2cash.org track2.shop
traffic2money.com
trafficgenius.xyz
trailer.cinemaflix.website trailer.cinemaflix.website
trk-4.net trion.od.ua
trkdf.com ttrraacckkrr.com
trucri.me tube8.com
tuckpointingmasonrysystems.com
tupper-shop.ru
turizmus.us
tzritel.tk tzritel.tk
uchebavchehii.ru u17795.netangels.ru
ucsol.ru umg-stroy.ru
uggsale.online urlopener.com
uhodzalijami.ru usswrite.com
ukkelberg.no uzporno.mobi
ukrtvory.in.ua v-doc.co
urlopener.blogspot.com.au valkiria-tk.ru
utiblog.fr varbergsvind.se
utrolive.ru vbabule.net
vavilone.com verymes.xyz
video-camer.com via-energy-order.com
video-production.com via-gra.webstarts.com
videochat.life viagengrarx.com
vikistars.com videochaty.ru
vinsit.ru vilingstore.net
vladimir.xrus.org vitalads.net
volgograd.xrus.org viveresaniesnelli.it
vk-mus.ru
vkgaleria.com
vkontarkte.com
vltai.com
voltrknc1.com voltrknc1.com
vostoktrade.info webads.co.nz
vvpg.ru weblibrary.win
vzube.com webpromotion.ae
wahicbefa31.soup.io webs.com
webcamdevochka.com weddingdresses.xyz
webkeyit.com weprik.ru
website-speed-up.site whiteelephantwellington.com
website-speed-up.top williamrobsonproperty.com
weburok.com winner7777.net
weclipart.com witclub.info
weekes.biz.tc wordpress-crew.net
westen-v.life
westermarkanjou.se
whatsupinfoley.com
whatzmyip.net
whengirlsgowild.com
white-truck.life
wholinkstome.com
wiosenny-bon-1500.pl
witherrom55.eklablog.fr
woman-h.ru
wonderfulflowers.biz
wordpresscore.com
worldtraveler.world worldtraveler.world
ww2awards.info wurr.voila.net
www.888.com xboxster.ru
www.jbetting.com xmnb.net
www.kabbalah-red-bracelets.com xn--80aeahghtf8ac5i.xn--p1ai
www.labves.ru xn--80aebbcbcdemfkhba4byaehoejh8dza3v.xn--p1ai
x-diesel.com
x-porno.video
xkaz.org
xn-----6kcaacnblni5c5bicdpcmficy.xn--p1ai
xn----7sbifcamovvfggw9d.xn--p1ai
xn----8sbarihbihxpxqgaf0g1e.xn--80adxhks
xn--1-8sbcpb0bdm8k6a.xn--p1ai
xn--80aikhbrhr.net
xn--80atua3d.xn--p1ai
xn--d1abj0abs9d.in.ua xn--d1abj0abs9d.in.ua
xn--d1aifoe0a9a.top xnxx-n.com
xnxx699.com xnxx699.com
xsfetish.org xrus.org
xsion.net xsion.net
xxxrus.org xuki.us
yeartwit.com xwatt.ru
yebocasino.co.za xxxtube69.com
yourothersite.com yaoguangdj.com
yebocasino.com
yes-com.com
youtubedownload.org
ytmnd.com ytmnd.com
z-master.ru zarabotat-na-sajte.ru
zajm-zalog-krasnodar.ru zarenica.net
zakazvzloma.com zazagames.org
zapiszto.pl zeroredirect5.com
zeroredirect12.com zeroredirect9.com
zona-aqua.ru zolotoy-lis.ru
zoompegs.com zoogdisany.com
zscaler.net zryydi.com

486
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
12masterov.com 11pikachu.ru
18ps.ru 12u.info
3dracergames.com 1688.com
8jn.dating-app.ru 2345.com
98oi.ru 2daytrendingnews.com
aad1f4acb0a373420d9b0c4202d38d94fa.com 888.com
abusora.com 999webdesign.com
addray.pro aa8780bb28a1de4eb5bff33c28a218a930.com
adman.se aa9bd78f328a6a41279d0fad0a88df1901.com
adprotect.net acmebtn.ml
adsland.men ad-words.ru
adsloads.com adamoads.com
agardomains.com adobereader-free.ru
aktivator-windows10.blogspot.com adverster.com
allsilver925.co.il agapovdg.ru
altamayoztourism.com akvamaster.dp.ua
android-vsem.org alert-fjg.xyz
angkortours.vn alphacarolinas.com
apilinkswiftco-a.akamaihd.net amazingninja.com
asscenihotosidea.blogspot.co.za anonymizeme.pro
atleticpharm.org anti-virus-removal.info
autoplate.info arclk.net
arendas.net
asophoto.com
atley.eu.pn
atmovs.com
avto-oligarh.ru
avtoarenda.by avtoarenda.by
avtolombard-krasnodar.ru awency.com
axbocz.net ayakino.net
babs.com.ua baersaratov.ru
bankmib.ru baladur.ru
bannerbank.ru banki76.ru
bcmp.org bannerads.de
bestmouthwash.club beauby.ru
betteroffers.review bestkfiledxd.cf
bidbuy.co.kr bestprofits-there.com
bigcareer.info blackwitchcraft.ru
bizlist.com.de blobar.org
brainzpod.win blogrankers.com
buydissertation.net bonux.nextview.ru
buzzzg.men boobsimge.com
camsex.xxx-cam.webcam bookmaker-bet.com
capacitacionyaprendizaje.com braindaily.xyz
carapics.com buron.pw
cartierloveringreplica.xyz businescoop.men
cartierreplica.top buyviagraa.blogspot.com
cayado.snn.gr buzzsumo.com
chcu.net c-english.ru
clickhype.com calc-for-credit.ru
clicksotrk.com camel-beach.com
cmhomestayagency.com canvas.gloverid.site
cocyq.inwtrade.com carloans.com
coldfilm.ru cartierlove2u.com
casablancamanor.co.za
cashkitten-a.akamaihd.net
chatroulette.world
cialischsrx.com
cityadspix.com
cntravelre.com
com-onlinesupport.host
communisave.co.za communisave.co.za
compliance-john.top community.allhiphop.com
compliance-walter.top compliance-don.xyz
constantaservice.net cv.wallhade.co
cookie-law-enforcement-ff.xyz deanmoore.ie
cookie-law-enforcement-hh.xyz delitime.info
cosmeticswomens-womensports.rhcloud.com demian.kz
czeshop.info detoxmed24.ru
dawlenie.com
deadlinkchecker.com
dear-diary.ru
degerlund.net
detskie-zabavi.ru
dichvuvesinhhanoi.com
dimkino.ru dimkino.ru
divatraffic.com dinosaurus.site
domainsatcost.com dmmspy.com
dprtb.com draniki.org
drhomes.biz dumpsmania24.com
ec-file.info e90post.com
ecommerce-seo.com ebonyporn.site
elektroniksigaraankara.info ecommerce-seo.org
essayservicewriting.org elektronischezigarette2.mex.tl
extads.net elektrozigaretten1.postbit.com
fandlr.com elvenar.com
fanpagerobot.com eng-lyrics.com
fba-mexico.com esfchat.tk
fealq.com euronis-free.com
fenoyl.batcave.net falcon-images.blogspot.com
film-one.ru fellowshipoftheminds.com
financehint.eu fickenprivat.info
foxydeal.com fighrofacciufreesig.ga
freshberry.com.ua filunika.com.ru
finejewelryshop.ru
flowersbazar.com
flprog.com
food.dtu.dk
forensicpsychiatry.ru
forum20.smailik.org
fotzen-ficken.com
free-share-buttons.blogspot.com
fun-mobi.pl fun-mobi.pl
galaxy-family.ru gabeshop.ru
gallictures.com gambarkataku.co
gamedayhouse.com gambarxkata.co
geilehausfrauen.net gamezblox.com
genetworx.com gg-arena.ru
gigapeta.com glall.ru
gogalleryawesome.com goforexvps.com
goodwinmetals.co goodwinmetals.co
gunsvicceadadebt.tk googlepositions.com
hd-filmy.net green-tea.tv
histats.com grizzlysgrill.com
hobild.net gsasearchengineranker.pw
hotelcrocenzi.sm gsbs.com.ua
houtings.xyz gta-top.ru
hunterboots.online handicapvantoday.com
iflycapetown.co.za hchha.com
imagez.co hdimagegallery.net
imfamous.info hmmm.cz
invitefashion.com holidaypics.org
iqbazar.ru hptwaakw.blog.fc2.com
irkutsk.zrus.org imadedinner.net
james13prix.info imgata.com
javatex.co.id immobiliaremassaro.com
je7.us impisr.edunsk.ru
jo24news.com import-sales.com
kamagragelusa.net innodgfdriverhm.aircus.com
kiinomaniak.pl integritylandscapeservices.com
kinoplen.ru japan-bearings.ru
kinostorm.net javxxx18.com
kletkimehan.ru keywords-monitoring-success.com
kliksaya.com kino-rf.ru
kol-energo.ru kosmetyki.tm.pl
kozhniebolezni.com kunstaktien.info
kumuk.info lakomka.com.ua
laapp.com letolove.ru
law-check-seven.xyz letsart.ru
laxdrills.com light.ifmo.ru
leboard.ru linkwithin.com
link.ac liveu.infoteka.hu
littlecity.ch louboutinreplica.pw
livingroomdecor.info lovasszovetseg.hu
lkbennettoutlet.online m292.info
loadingpages.me macnewtech.com
lyrics.home-task.com magnetpress.sk
m5home.ru makenahartlin.com
manipulyator-peterburg.ru manifestyourmillion.com
mansparskats.com medicinacom.ru
maximilitary.ru medicovi.com
medi-fitt.hu member-quiz.com
medkletki.ru microsoftportal.net
mesbuta.info monsterdivx.com
metaxalonevstizanidine.blogspot.com moviezbonkerssk.cf
mikozstop.com msk-diplomat.com
mindbox.co.za muznachas-service.ru
minecraft-rus.org needtosellmyhousefast.com
mini-modus.ru netoil.no
mobilierland.com nikitabuch.com
mojowhois.com nisuturnetdgu.tk
monitorwebsitespeed.com nottyu.xyz
mundoaberrante.com noumeda.com
mustwineblog.com o-o-6-o-o.ru
mxgetcode.com oakridgemo.com
myfreetutorials.com ofanda.com
naj-filmy24.pl panouri-solare-acoperis.com
negociosdasha.com paradontozanet.ru
nhl17coins.exblog.jp pendelprognos.se
nikkiewart.ru perederni.net
noclegonline.info picphotos.net
nonameread45.live pijoto.net
o00.in pl-vouchers.com
obiavo.ru ploenjitmedia.azurewebsites.net
ooo-olni.ru pobeiranie.pl
orion-code-access.net porn-w.org
orsonet.ru pornoklad.net
parajumpersoutlet.online pornpost.in
partner-pop.men potolokelekor.ru
platezhka.net prchecker.info
pornhive.org productarium.com
pregnant.guru proftests.net
privat-girl.net quickbuck.com
professionaldieselcare.com ranksonic.info
progonrumarket.ru recordpage-a.akamaihd.net
projectforte.ru registratciya-v-moskve.ru
pronorm.fr registrationdomainsite.com
rcb101.ru rennlist.com
remorcicomerciale.ro resant.ru
resultshub-a.akamaihd.net restorator-msk.ru
retreatia.com rukino.org
rialp.getenjoyment.net
robot-forex.biz
rusoft-zone.ru
rustic-quiver.win
sabaapress.com sabaapress.com
sad-torg.com.ua sarafangel.ru
safe-app.net schlampen-treffen.com
sarahmilne.top scopich.com
sardinie.us scripted.com
scanner-ivan.top sel-hoz.com
scanner-olga.top semxiu.com
scanner-walt.top seo-prof1.xyz
scanspyware.net seoboxes.com
search.xtconnect.com seotoolsagency.com
searchengineranker.email sex-dating.co
searchimpression.com sexflirtbook.com
seorussian.ru sexpornotales.net
sexad.net sexytrend.ru
sexblog.pw sharpchallenge.com
sexxdate.net shohanb.com
shemale-sex.net silvercash.com
shtaketniki.ru site-speed-check.site
signal03.ru snegozaderzhatel.ru
simul.co social-button.xyz
sisiynas.ru strongholdsb.ru
skylta.com supers.com.ua
sluganarodu.ru svolze.com
smsactivator.ru swimpool.ca
snomer1.ru tattooha.com
soundfrost.org tds-advert002.info
souvenir.cc techart24.com
spbchampionat.ru thelottosecrets.com
speeddream.xyz theplacetoupdating.pw
spinazdrav.ru titelhelden.eu
stackthatbucks.com trafficcentr.xyz
stretchmate.net tramadolandtizanidine.blogspot.com
svarkagid.com trkdf.com
sweepstakes.rewardit.com turist-strani.ru
t-bygg.com tv-spoty.info
taxi-v-eisk.ru u-cheats.ru
telegramdownload10.com u17795.netangels.ru
threecolumnblogger.com ukkelberg.no
tiandeural.ru unrealcommander.com
tksn.ru url-img.link
toonfamilies.net uroki.net
tootoo.to valueclick.com
topsiteminecraft.com vclicks.net
traderzplanet.in videochat.tv.br
tuckermktg.com viktoria-center.ru
twittrading.com vilingstore.net
udayavani.com vkak.ru
ugogo.info vzlomtw.com
umityangin.net wallpaperaccess.com
uogonline.com watchinf.com
uptimebot.net weblibrary.win
usadacha.net webradiology.ru
usbggettwku.ga
ustion.ru
vapomnoncri.tk
viandpet.com
video-hollywood.ru
videochat.world
w3javascript.com
warning.or.kr
weblo.com
webtherapy.ru webtherapy.ru
while.cheapwebsitehoster.com wleuaprpxuvr.ga
white-truck.life wpsecurity.website
www.wohnkabinen-shop.de xn--80aebbcbcdemfkhba4byaehoejh8dza3v.xn--p1ai
x-true.info xn--80ajjbdhgmudixfjc8c5a9df8b.xn--p1ai
xn--80abgj3a5acid6ghs.top xportvusbdriver8i.snack.ws
xn--c1acygb.xn--p1ai yellowstonevisitortours.com
xtubeporno.net yourserverisdown.com
yellowproxy.net zaimhelp.ru
your-bearings.com zaimite.ru
yourads.website zawyna.ua
zeroredirect11.com zophim.me
zeroredirect12.com zscalerone.net
zvooq.eu

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.160 0; 10.1.0.38 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.04.3041 ### Version: V4.2022.04.3042
### Updated: Wed Apr 13 10:03:37 UTC 2022 ### Updated: Wed Apr 13 22:01:24 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.04.3041 ### Version: V4.2022.04.3042
### Updated: Wed Apr 13 10:03:37 UTC 2022 ### Updated: Wed Apr 13 22:01:24 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##