vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-09 13:55:41 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2021.08.2502 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2021-08-04 22:07:25 +00:00
parent 090766d7db
commit 7910eb5a01
46 changed files with 84747 additions and 84747 deletions
Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2021.08.2501 #### Version: V4.2021.08.2502
#### Bad Referrers Blocked: [7074](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7074](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [618](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [618](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2021.08.2501 #### Version: V4.2021.08.2502
#### Bad Referrers Blocked: [7074](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7074](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [618](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [618](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -11,7 +11,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2021.08.2501 #### Version: V4.2021.08.2502
#### Bad Referrers Blocked: [7074](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7074](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [618](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [618](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

10458
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2021.08.2501 #### Version: V4.2021.08.2502
#### Bad Referrers Blocked: [7074](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7074](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [618](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [618](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

10462
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

10462
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

10462
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

10462
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.48 1; 10.1.0.8 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.48 0; 10.1.0.8 0;
127.0.0.1 0; 127.0.0.1 0;

10462
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.48 1; 10.1.0.8 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.48 0; 10.1.0.8 0;
127.0.0.1 0; 127.0.0.1 0;

10462
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.48 1; 10.1.0.8 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.48 0; 10.1.0.8 0;
127.0.0.1 0; 127.0.0.1 0;

10462
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
2501 2502

10462
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

10462
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
13.66.254.88 0; 52.158.243.245 0;

10462
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.48 1; 10.1.0.8 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.48 0; 10.1.0.8 0;
127.0.0.1 0; 127.0.0.1 0;

10462
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.48 1; 10.1.0.8 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.48 0; 10.1.0.8 0;
127.0.0.1 0; 127.0.0.1 0;

10462
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.48 1; 10.1.0.8 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.48 0; 10.1.0.8 0;
127.0.0.1 0; 127.0.0.1 0;

10462
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
13.66.254.88 0; 52.158.243.245 0;

10462
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
13.66.254.88 0; 52.158.243.245 0;

10462
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.48 1; 10.1.0.8 1;
127.0.0.1 1; 127.0.0.1 1;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
Claritybot Backlink-Ceck
DSearch Calculon
Genieo HTTP::Lite
Havij InfoTekies
LeechFTP Iskanie
LibWeb LinkextractorPro
Musobot Nettrack
Web Fetch RealDownload
meanpathbot SlySearch
webmeup-crawler Who.is Bot

294
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
01h4x.com 360Spider
404enemy 404enemy
ADmantX ADmantX
AIBOT AhrefsBot
ALittle Client
Acunetix
AfD-Verbotsverfahren
Alexibot
Alligator Alligator
Anarchie AlphaBot
Anarchy Anarchy
Ankit
Aspiegel
Attach
AwarioRssBot AwarioRssBot
BBBike
BDCbot BDCbot
BDFetch
BLEXBot BLEXBot
BackStreet BackWeb
Backlink-Ceck BacklinkCrawler
Badass Bandit
Barkrowler
Battleztar Bazinga
BetaBot BetaBot
Bitacle Black Hole
Blow BlackWidow
Bolt BlowFish
Brandprotect Brandprotect
Buddy Brandwatch
Bullseye Buck
BunnySlippers CATExplorador
CSHttp CODE87
CazoodleBot
Cegbfeieh Cegbfeieh
CheeseBot
CherryPicker CherryPicker
Claritybot Claritybot
Cliqzbot
Cocolyzebot
Cogentbot
Collector
CopyRightCheck CopyRightCheck
Copyscape Copyscape
Cosmos Cosmos
Craftbot Craftbot
CrazyWebCrawler CrazyWebCrawler
Crescent Crescent
Curious Custo
CyotekWebCopy CyotekWebCopy
DBLBot
DSearch
DTS Agent DTS Agent
DataCha0s
Demon
Deusu Deusu
DigitalPebble Digincore
Dispatch Dirbuster
DomainAppender Discobot
Discoverybot
DomCopBot
DomainCrawler
DomainSigmaCrawler DomainSigmaCrawler
DomainStatsBot DomainStatsBot
Domains Project Domains Project
Download Wonder Dotbot
Dragonfly Dragonfly
Drip
EMail Siphon
EMail Wolf
EasyDL
Ecxi Ecxi
ExtLinksBot Express WebPictures
EyeNetIE Extractor
FDM ExtractorPro
FHscan
Fimap
Firefox/7.0 Firefox/7.0
FlashGet FlashGet
Freeuploader Fuzz
FrontPage FyberSpider
GT::WWW G-i-g-a-b-o-t
GalaxyBot
Genieo
GermCrawler GermCrawler
GetWeb
Gigablast Gigablast
Gigabot
Go-Ahead-Got-It
GoZilla GoZilla
Gotit GrabNet
Grabber Grabber
Grafula GrapeFX
HMView
HTMLparser
HTTrack HTTrack
Harvest Harvest
Hloader
Humanlinks Humanlinks
Id-search IlseBot
Internet Ninja Image Fetch
Image Sucker
InfoTekies
Intelliseek
InterGET
IstellaBot
JOC Web Spider
JamesBOT JamesBOT
JennyBot
JetCar
Joomla
Keyword Density Keyword Density
Kinza
Kozmosbot Kozmosbot
LWP::Simple
Lanshanbot
Larbin
Leap Leap
LeechFTP LeechFTP
LeechGet LeechGet
LexiBot
Lftp Lftp
Libwhisker Lightspeedsystems
Linkdexbot LinkextractorPro
LinkpadBot
LinksManager LinksManager
LinqiaMetadataDownloaderBot
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey
Lipperhey Spider Lipperhey Spider
Ltx71
MFC_Tear_Sample MFC_Tear_Sample
MIDown tool
MIIxpc
MQQBrowser MQQBrowser
MTRobot MSFrontPage
Mag-Net Mag-Net
Mail.RU_Bot
Majestic-SEO
MarkWatch MarkWatch
Mass Downloader Masscan
Mediatoolkitbot Mata Hari
Mb2345Browser
Meanpathbot
MegaIndex.ru MegaIndex.ru
Metauri Microsoft URL Control
Moblie Safari
Mojeek Mojeek
Mojolicious Morfeus Fucking Scanner
Mozlila Nameprotect
Mr.4x3
Musobot
NPbot
NearSite NearSite
Nessus
Net Vampire
NetAnts NetAnts
NetMechanic
NetSpider NetSpider
Netcraft NetZIP
Netvibes Nettrack
NimbleCrawler Niki-bot
Nikto
Nimbostratus
Ninja
Nmap
Nuclei Nuclei
Nutch Octopus
Offline Navigator Offline Navigator
OpenLinkProfiler
OpenVAS OpenVAS
Openvas Openvas
OutfoxBot OutclicksBot
Page Analyzer
PageAnalyzer PageAnalyzer
PageGrabber
PageScorer PageScorer
Panscient Panscient
Papa Foto PeoplePal
Pavuk Petalbot
Pi-Monster Pi-Monster
Picscout Picscout
Picsearch
PictureFinder PictureFinder
Piepmatz Pixray
Probethenet ProWebWalker
Psbot
Pu_iN
PyCurl PyCurl
QueryN Metasearch QueryN Metasearch
Quick-Crawler RankActive
RSSingBot RankFlex
RankingBot
RankingBot2 RankingBot2
Rankivabot
RankurBot
Re-re Re-re
ReGet
Reaper Reaper
RebelMouse RepoMonkey
Ripper Ripper
SEOlyticsCrawler RocketCrawler
Rogerbot
SEOprofiler SEOprofiler
SEOstats
SMTBot SMTBot
Scanbot SalesIntelligent
Scrapy ScoutJet
Screaming Searchestate
Semrush Semrush
Shodan SemrushBot
SiteCheckerBotCrawler Siphon
Site Sucker
SiteLockSpider SiteLockSpider
SiteSnagger Sitebeam
SiteSucker
Siteimprove
SlySearch
SmartDownload SmartDownload
Snapbot SocialRankIOBot
Snoopy Sociscraper
Sogou web spider Spammen
Spanner SpankBot
Spbot Spbot
Sucker Steeler
SuperBot Surfbot
Suzuran Suzuran
T0PHackTeam Swiftbot
T8Abot Telesoft
Telesphoreo Telesphoreo
Telesphorep Telesphorep
TheNomad Titan
TightTwatBot
Toweyabot Toweyabot
Tracemyfile Tracemyfile
Turnitin Trendictionbot
TwengaBot
Typhoeus
URLy Warning URLy Warning
UnisterBot UnisterBot
V-BOT
VCI VCI
Vacuum
Vagabondo Vagabondo
VeriCiteCrawler VeriCiteCrawler
Virusdie VidibleScraper
VoidEYE Voltron
WEBDAV WBSearchBot
WWW-Mechanize WISENutbot
Wallpapers/3.0 WWW-Collector-E
Web Collage Wallpapers
Web Sauger WeSEE
WebAuto WebImageCollector
WebCopier
WebEnhancer
WebFetch
WebLeacher
WebReaper
WebStripper WebStripper
WebSucker WebSucker
WebZIP WebZIP
WebmasterWorldForumBot WebsiteExtractor
Webster Webster
Whatweb Whacker
Who.is Bot Who.is Bot
WiseGuys Robot WinHTTrack
Wonderbot
Woobot
Wotbox Wotbox
Wprecon Wprecon
Xaldon WebSpider
Xenu
YoudaoBot YoudaoBot
Zade
Zauba Zauba
Zermelo Zitebot
backlink-check ZoomBot
ZoominfoBot
ZumBot
arquivo-web-crawler
check1.exe check1.exe
cognitiveseo
crawl.sogou.com
crawler.feedback crawler.feedback
heritrix crawler4j
lwp-request domainsproject.org
lwp-trivial instabid
magpie-crawler internetVista monitor
muhstik-scan
netEstate NE Crawler
oBot oBot
pcBrowser
plumanalytics plumanalytics
polaris version polaris version
probe-image-size probe-image-size
satoristudio.net ripz
scan.lol s1z.ru
seobility scalaj-http
sexsearcher siteripz
sogouspider sp_auditbot
spyfu
tAkeOut tAkeOut
trendiction.com trendiction.com
ubermetrics-technologies.com
x09Mozilla
x22Mozilla
xpymep1.exe
zauba.io zauba.io
zgrab

300
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
01h4x.com 01h4x.com
360Spider
404checker 404checker
404enemy 404enemy
AIBOT AIBOT
Abonti
Aboundexbot Aboundexbot
AfD-Verbotsverfahren AfD-Verbotsverfahren
AhrefsBot AhrefsBot
AiHitBot
AllSubmitter
Alligator Alligator
AlphaBot AlphaBot
Ankit Anarchie
Anarchy99
Anthill
Asterias Asterias
Attach
AwarioRssBot
BDCbot
BLEXBot
BackStreet
Backlink-Ceck
Badass
Barkrowler Barkrowler
BatchFTP Battleztar Bazinga
Bitacle Bigfoot
Black Hole Black Hole
Blackboard Blow
BlowFish BlowFish
Bolt
BotALot BotALot
Brandprotect
BuiltBotTough BuiltBotTough
Bullseye BuiltWith
BunnySlippers
BuzzSumo BuzzSumo
CODE87 CATExplorador
Calculon CSHttp
Cegbfeieh
CensysInspect
CheeseBot CheeseBot
ChinaClaw CherryPicker
Chlooe
Claritybot
Cliqzbot Cliqzbot
Cloud mapping
Cocolyzebot Cocolyzebot
Collector Collector
Copier
Copyscape
Cosmos Cosmos
Craftbot Craftbot
CrazyWebCrawler
CrunchBot
Curious Curious
DataCha0s CyotekWebCopy
DatabaseDriverMysqli DSearch
DTS Agent
Deusu Deusu
DigitalPebble DigitalPebble
Dirbuster Dirbuster
Discobot
Discoverybot
Dispatch Dispatch
DittoSpyder DnyzBot
DomCopBot DomainAppender
Dotbot Dotbot
EMail Siphon EMail Siphon
EMail Wolf EMail Wolf
EasyDL
Ebingbong Ebingbong
Ezooms Ecxi
FDM EroCrawler
FHscan Evil
ExtLinksBot
Extreme Picture Finder
Firefox/7.0 Firefox/7.0
FlashGet Foobot
Fyrebot Freeuploader
GermCrawler FrontPage
G-i-g-a-b-o-t
GT::WWW
GalaxyBot
Genieo
GetRight
GetWeb
Gigablast
Go-Ahead-Got-It Go-Ahead-Got-It
GoZilla Grafula
Gotit
GrabNet
GrapeFX
GridBot
HEADMasterSEO HEADMasterSEO
HMView
HTMLparser HTMLparser
HTTrack HTTP::Lite
Haansoft HaosouSpider
Havij Harvest
Hloader Heritrix
IDBTE4M IDBTE4M
IlseBot IDBot
Image Fetch Id-search
Image Sucker InfoNaviRobot
Indy Library
InfoTekies InfoTekies
Intelliseek
InterGET InterGET
Internet Ninja Internet Ninja
Iria InternetSeer
Iskanie
IstellaBot
Jbrofuzz Jbrofuzz
JetCar JetCar
Jetty
Jorgee Jorgee
Jyxobot Kenjin Spider
Kinza
Lanshanbot
Larbin
LeechFTP LeechFTP
LieBaoFast LeechGet
LexiBot
LibWeb
Lightspeedsystems
Likse
LinkScan
LinkWalker LinkWalker
LinkpadBot Linkdexbot
MJ12bot LinqiaRSSBot
LinqiaScrapeBot
Lipperhey Spider
Litemage_walker
Lmspider
MFC_Tear_Sample
MQQBrowser
MTRobot MTRobot
Magnet
Majestic SEO Majestic SEO
Majestic-SEO Majestic-SEO
MeanPath Bot MarkMonitor
MarkWatch
Mass Downloader
Mata Hari
MauiBot
Mb2345Browser
Meanpathbot Meanpathbot
Mediatoolkitbot Mediatoolkitbot
Microsoft Data Access Metauri
Microsoft URL Control Moblie Safari
Mister PiX
Mojeek
Morfeus Fucking Scanner Morfeus Fucking Scanner
Mr.4x3
Msrabot Msrabot
Musobot NearSite
NPbot Net Vampire
Nessus NetMechanic
NetAnts NetZIP
Ninja NimbleCrawler
Nmap
Nutch
Octopus Octopus
Offline Explorer OpenLinkProfiler
OpenVAS OpenVAS
Openfind Openvas
OrangeSpider OrangeSpider
OutclicksBot OutclicksBot
PageAnalyzer OutfoxBot
Pandalytics POE-Component-Client-HTTP
PageScorer
PageThing.com
Papa Foto Papa Foto
Pi-Monster Pavuk
Picscout Picscout
Picsearch Picsearch
PictureFinder PictureFinder
Pimonster PleaseCrawl
Pockey
ProPowerBot
ProWebWalker ProWebWalker
Probethenet Pu_iN
Psbot Pump
PxBroker Quick-Crawler
RSSingBot RSSingBot
RankActive
RankActiveLinkBot RankActiveLinkBot
RankingBot RankingBot
RankingBot2 Rankivabot
RankurBot
RealDownload
Reaper Reaper
RocketCrawler Recorder
Rogerbot
SBIder SBIder
SEOlyticsCrawler SEOprofiler
SEOstats ScoutJet
SISTRIX Scrapy
SalesIntelligent ScreenerBot
Screaming SeoSiteCheckup
ScrepyBot
SemrushBot
SentiBot
SeobilityBot SeobilityBot
Seomoz Site Sucker
SiteLockSpider SiteExplorer
SiteSnagger
SiteSucker SiteSucker
Sitebeam SlySearch
Snake Snapbot
Snoopy Snoopy
SocialRankIOBot
Sociscraper
Sosospider
Sottopop Sottopop
SpaceBison Spanner
Spammen Sqlmap
SpankBot Sqworm
Spinn3r Steeler
SputnikBot
Stripper Stripper
Sucker SuperBot
Surfbot Swiftbot
Suzuran T0PHackTeam
Szukacz T8Abot
Teleport Teleport
TeleportPro TeleportPro
Telesphorep The Intraformant
TightTwatBot Thumbor
Tracemyfile
Trendictionbot
Turnitin Turnitin
TwengaBot
Twice Twice
Typhoeus Typhoeus
URLy Warning VeriCiteCrawler
Upflow VidibleScraper
Voil Virusdie
Voltron Voltron
WBSearchBot
WWW::Mechanize WWW::Mechanize
Wallpapers/3.0
WallpapersHD WallpapersHD
Web Collage WeSEE
Web Auto
Web Enhancer Web Enhancer
Web Fetch
Web Fuck
Web Pix Web Pix
Web Sauger
Web Sucker
WebAuto WebAuto
WebCollage WebCopier
WebFetch WebFetch
WebGo IS WebStripper
WebImageCollector WebWhacker
WebPix WebmasterWorldForumBot
WebSauger Webster
Webalta Whatweb
WebsiteExtractor
WebsiteQuester
Who.is Bot
Widow
WiseGuys Robot
Woobot Woobot
Wotbox Wprecon
Xaldon WebSpider Xaldon WebSpider
Xaldon_WebSpider Xaldon_WebSpider
YoudaoBot Zeus
Zauba Zitebot
ZoomBot ZmEu
ZoominfoBot ZoominfoBot
ZumBot ZumBot
ZyBorg archive.org_bot
arquivo-web-crawler autoemailspider
backlink-check check1.exe
crawl.sogou.com coccocbot-web
cognitiveseo
crawler4j crawler4j
demandbase-bot domainsproject.org
eCatch eCatch
facebookscraper facebookscraper
gopher
heritrix
instabid
ips-agent
isitwp.com isitwp.com
lwp-request
lwp-trivial
mediawords mediawords
netEstate NE Crawler netEstate NE Crawler
page scorer page scorer
pcBrowser
polaris version polaris version
probe-image-size
ripz
satoristudio.net
scalaj-http scalaj-http
scan.lol scan.lol
seoscanners seoscanners
seostar seostar
sitechecker.pro sysscan
sogouspider trendiction.com
spyfu voyagerx.com
ubermetrics-technologies.com
x09Mozilla x09Mozilla
x22Mozilla
zgrab

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
dotnetdotcom.org buypuppies.ca
fxtips.ru contextualyield.com
kuzinsp.ru hoterika.com
lostaruban.com hplaserjetpdriver8y.pen.io
mister-shop.com iamsport.org
muycerdas.xxx imgarit.pw
socialmediasuggest.com mail.allnews24.in
speechfoodie.com py100.ru
uptime.com quebec-bin.com
xn--80ahvj9e.xn--p1ai womama.ru

938
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
03p.info 1000n1.ru
101billion.com 101raccoon.ru
18ps.ru 123locker.com
1xbet4you.com 2daytrendingnews.com
2345.com 2kata.ru
3w24.com 2pxg8bcf.top
4k-player.pl 2x2fan.ru
5tey7463.weebly.com 5elementov.ru
5u.com 5i2.net
883zy.com 888.com
a1security.com.ua aa8b68101d388c446389283820863176e7.com
aa14ab57a3339c4064bd9ae6fad7495b5f.com
aaa38852e886ac4af1a3cff9b47cab6272.com aaa38852e886ac4af1a3cff9b47cab6272.com
abcdefh.xyz aac52006ec82a24e08b665f4db2b5013f7.com
abwa.tk adbetclickin.pink
adconscious.com adobereader-free.ru
adloads.com adtech.us
ads-seo.men adtiger.tk
adtech.fr affiliate-fr.com
alekseevec.ru affrh2015.com
alert-fjg.xyz agecheckadult.com
airlandsea.info
aktivator-windows10.blogspot.com
alienwheels.de alienwheels.de
alpharma.net alive-ua.com
am-se.com allsilver925.co.il
ameblo.top amanda-porn.ga
api.stathat.com amateurlivechat.org
app-ready.xyz amazon-seo-service.com
artdeko.info anmysite.com
asscenihotosidea.blogspot.co.za aosheng-tech.com
asseenontvonline.ru arabgirls.adultgalls.com
autobrennero.it arenda-avtoprokat-krasnodar.ru
autolombard-krasnodar.ru asrvvv-a.akamaihd.net
avitocars.ru auspolice.com
avon-novosib.ru autoblogger24.info
azte.ch autoseo-traffic.com
b2b-lounge.com azbukafree.com
baksman.com babieca.com
batanga.net backlink4u.net
bbtec.net bag77.ru
bedcapdealers.com bagcionderlab.com
begalka.xyz bang-hotties.com
berdasovivan.ru bannerbank.ru
billiard-classic.com.ua basisches-wasser.net
bimmerpost.com battle.net
binaryoptionscops.info bdsmgalls.net
bioinnovate.co beachfix.co
bizru.info beauty-b0x.pl
beauty-clinic.ru
berlininsl.com
berrymall.ru
best-deals-products.com
best-games.today
bestempresas.es
bestfortraders.com
bestimagecoollibrary.com
bestssaker.com
besttorrentknifta.weebly.com
bestwebsitesawards.com
beta.hotkeys.com
betwinservice.com
bezlimitko.xyz
big-boards.info
bigpictures.club
bio-optomarket.ru
blackle.com
blog.f00kclan.de
blog.koreadaily.com blog.koreadaily.com
blpmovies.com boc.kz
bmw-ark.ru boltalko.xyz
bolegapakistan.com
bombla.org
bonzibuddi.com
bosefux.esy.es bosefux.esy.es
brainzpod.win bosman.pluto.ro
brg8.com brateg.xyz
bristolhotel.com breget74.ru
brothers-smaller.ru btc4u.ru
brus.city btvn.ru
bukleteg.xyz budpost.com.ua
buqayy0.livejournal.com
burger-tycoon.com
businescoop.men businescoop.men
buytizanidineonlinenoprescription.blogspot.com businesn.men
bvlgariwallet.xyz buyscabiescream.com
callejondelpozo.es buzzurl.jp
canyougethighofftizanidine.blogspot.com calcularpagerank.com
canzoni.ru californianews.cf
cardsharp1.ru camdolls.com
carson.getenjoyment.net canrole.com
cartierbraceletsreplica.pw carsplate.com
cdn.walkme.com castingbank.ru
centrumcoachingu.com celebsopics.com
cheapbarbour.online cellfun.mobi
cheapestjerseysonwholesale.com chatroulette.online
chlooe.com cheap-trusted-backlinks.com
cjs.com.ru cheapcigarettesc.info
classiquebijoux.ru cheapjerseysap.com
clickcash.com cheapsergiorossi.online
clicksotrk.com checkhit.com
compliance-elena.top chinaelitecheapjerseys.com
compliance-ivan.xyz chorus.terakeet.com
cookie-law-enforcement-aa.xyz ciproandtizanidine.blogspot.com
cookie-law-enforcement-hh.xyz clickso.com
coolbar.pro com-cleaner.systems
coolwallpapers4k.info comissionka.net
coolyarddecorations.com compliance-alexa.top
compliance-don.xyz
compliance-elena.xyz
compliance-fred.top
cookie-law-enforcement-ff.xyz
copypaste.traderzplanet.in copypaste.traderzplanet.in
craftburg.ru coslab.club
credit-online.ws counter.bloke.com
creditmoney.com.ua cracksplanet.com
cutt.us crynet.cc
cwetochki.ru cubs-jerseys.us
dame-ns.kz custodieva.ru
danashop.ru dairyindia.in
darkages.info danceuniverse.ru
dating-time-now.com day-news.info
davidovic.info dealitright.click
dayibiao.com decorazilla.com
demon-tweeks.com degerlund.net
detalizaciya-tut.biz dekorkeramik.ru
dktr.ru delitime.info
dogoimage.com demenageur.com
domain2008.com dentalpearls.com.au
downloader12.ru detective01.ru
doxysexy.com dev78.dioniqlabb.se
drev.biz digitalassetmanagement.site
drillsaw.ru digitalfaq.com
droidlook.net dirtpics.pw
drugs-no-rx.info disruptingdinnerparties.com
dstroy.su docstoc.com
duawitchrarato.tk dojki-hd.com
dumuelave.xyz downloaddy.net
e705.net dpihatinh.gov.vn
earl-brown.info duplicashapp.com
efnor-ac.com earncash.com.ua
ekosmetyki.net.pl earthmagic.info
electrik-avenue.com ebonyporn.site
ebooknovel.club
ecommerce-seo.org
ednorxmed.com
educontest.net
ekn-art.se
elektrischezi.canalblog.com
elektrischezigarette1.blog.pl elektrischezigarette1.blog.pl
elektrischezigaretten2.beeplog.com elektrischezigaretten1.blogse.nl
elektronischezi.livejournal.com elektrozigarette1.dreamwidth.org
elektrozigarette2.wordpressy.pl elvel.com.ua
elektrozigaretten1.tumblr.com elvenar.com
elektrozigaretten1.webs.com emergencyneeds.org
emediate.eu encodable.com
enhand.se englishdictionaryfree.com
eropornosex.ru eropho.com
erotiktreff24.info ertelecom.ru
escortplius.com
eshop.md eshop.md
eshop4u.jp essay-writing.work
espaceinventoristes.com eupornstar.info
essaypro.com everflora.ru
evrotekhservis.ru everypony.ru
exlarseva.webblog.es evogarage.com
expolicenciaslatam.co ezigarettenshop1.yolasite.com
eywords-monitoring-your-success.com ezigarettenshop2.postbit.com
ezigarettekaufen1.hpage.com ezrvrentals.com
ezigarettekaufen2.blox.pl f00kclan.de
ezigarettenkaufen1.deviantart.com facecup.top
f5mtrack.com
face.hostingx.eu
factorynightclub.com
falopicm.pw
fanrto.com
farm26.ru farm26.ru
favoritemoney.ru farmprofi.net
femdom.twiclub.in fba-mexico.com
feorina.ru fearcrow.com
fetroshok.ru fettefrauen.net
findsexguide.com filerockstar298.weebly.com
flagcounter.me filmania-x.ru
fortunejack.com filunika.com.ru
financepoints.eu
fireads.men
firstsiteguide.com
flirt4free.com
floridahuntingfishingadventures.com
fodelsedagspresenter.nu
foodgid.net
footballfarrago.com
forensicpsychiatry.ru
fotopop.club fotopop.club
franch.info franch.info
franklinfire.co freakycheats.com
free411games.com free-share-buttons.top
freshmac.space freelotto.com
frvo.alptandem.ru frighteningremain.cf
fuckbuddybestgilf.info fsakhalin.ru
geileweiber.tk fsalas.com
genericlowlatencyasiodriverhq.aircus.com fuck-paid-share-buttons.xyz
geoads.com fuel-gas.com
getlaid-xxxhookupdirect.com futbolkisales.ru
getoutofdebtfree.org fym.com.ru
gettpromos.com game-top.su
gg.zzyjxs.com gay-site.store
gloverid.site gaypornmovie.net
gnuetella.com gazoblok.net.ua
goldpanningtools.com ge0ip.com
googlemare.com geilehausfrauen.net
gopro-online.info genericviagrasildenafiled.net
graphid.com gerhardhealer.com
greamimgo.pw getmiro.com
green-tea.tv ghernnqr.skyrock.com
gheus.altervista.org
goatse.ru
goodly.pro
googlefeud.com
gopixdatabase.com
gosreg.amchs.ru
gsasearchengineranker.site
gsbs.com.ua gsbs.com.ua
gta-top.ru gunsvicceadadebt.tk
guardlink.org hdapp1008-a.akamaihd.net
h2monline.com hifidesign.ru
havepussy.com hjaoopoa.top
hd720kino.ru hotblog.top
healing-dysplasia.ru howtowhitenteethfast.xyz
heartofpayne.xyz hreade.com
heatpower.ru https-legalrc.biz
hermesreplica.win ilikevitaly.com
hikesearch.net imagefinder.site
histats.com imagerydatabase.com
hostnow.men img.wallpaperstock.net
hotelcrocenzi.sm
hotenergy.ru
hothor.se
hotsocialz.com
houseofrose.com
htmlcorner.com
humanelydrew.com
hvd-store.com
id-forex.com
ideibiznesa2015.ru
igru-xbox.net
ilmexico.com
ilte.info
imagui.eu
iminent.com
imitex-plus.ru imitex-plus.ru
indianmedicaltourismshop.com impotentik.com
inet-traffic.com inbabes.sexushost.com
infazavr.ru infazavr.ru
infokonkurs.ru
interesnie-faktu.ru
interferencer.ru interferencer.ru
investpamm.ru iopeninghours.co.uk
invitefashion.com iron-age.info
iplogger.org istizanidineacontrolledsubstance.blogspot.com
ipostroika.ru istizanidineanarcoticdrug.blogspot.com
iscblog.info itrevolution.cf
istizanidineanopiate.blogspot.com itronics.ca
itservicesthatworkforyou.com itsdp3.com
iweblist.info iweblist.info
jackpotchances.com japfm.com
javitas.info javatex.co.id
jennyfire.ru jerseyschinabizwholesale.us
jmat.cn jjbabskoe.ru
joingames.org juliadiets.com
kandidos.com juliaworld.net
karachev-city.ru jumptap.com
keenoutlet.online kaidalibor.de
keyhantercume.com kalandranis.gr
keyword-suggestions.com kamagragelusa.net
keywordblocks.com kasino-money.pw
keywordhut.com kazan.xrus.org
keywords-monitoring-your-success.com kenaba.su
kinomaniatv.pl kerei.ru
kladrus.ru kevblog.top
kmd-pto.ru kino-rf.ru
knigonosha.net kinogolos.ru
kol-energo.ru kiwe-analytics.com
kolotiloff.ru klin3952.ru
kongoultry.net krasnodar.xrus.org
kongruan.com krassh.ru
koral.se lerporn.info
kosova.de letsrepair.in
kraljeva-sutjeska.com lezbiyanki.net
kskjco.club limtu.ifmo.ru
kurbappeal.info linkbolic.com
ladov.ru linkbux.ru
landscaping.center lion.bolegapakistan.com
lecbter-relationships.ga lion.snapmap.us
libertybilisim.com liupis.com
lider-zhaluzi.kiev.ua liveinternet.ro
lidoradio.com
lightinghomes.net
liran-locks.com
lirunet.ru
littlesunraiser.com
liveinternet.ru
livejasmin.com
lockerz.com
locustdesign.co
lodki-pvh.dp.ua
lollypopgaming.com
lomb.co lomb.co
longadventure.com lost-alpha.ru
love-baby.cz louboutinbooties.xyz
lovelycraftyhome.com louboutinreplica.pw
lowephotos.info lyrics.home-task.com
lulea-auktionsverk.se mainhp.net
mabdoola.blogspot.com makedo.ru
make-money-online.com makemoneyonline.com
marsgatan.com mantramusic.ru
master-muznachas.ru mapquestz.us
matematikus.info marketingvici.com
mature.free-websites.com mathgym.com.au
meble-bogart.info maxthon.com
medicineseasybuy.com mb140.ru
meget.co.za meendo-free-traffic.ga
member-quiz.com meetlocalchicks.com
mexicosleevegastrectomy.com methodsmarketing.com
mexicotravelnet.com midst.eu
mhtr.be
mielec.pl mielec.pl
militarysale.pro migente.com
minecraft-rus.org minharevisao.com
misterjtbarbers.com mirtorrent.net
mlvc4zzw.space mixx.com
mmgq.ru mmog-play.ru
mnogabukaff.net
mobile-appster.ru
mobilierland.com mobilierland.com
mokrayakiska.com mockupui.com
monclerjacketsoutlet.pw monclerboots.xyz
morpicert.pw most-kerch.org
moskva.nodup.ru moviezbonkerssk.cf
most.gov.iq mrbojikobi4.biz
mowser.com mriyadh.com
mp3films.ru msk-diplomat.com
mrbitsandbytes.com mttwtrack.com
mrpornogratis.xxx mundoaberrante.com
muschisexbilder.com mydownlodablefiles.com
musezone.ru myhitmp3.club
music.utrolive.ru
mustat.com
muznachas-service.ru
myliveblog.ru myliveblog.ru
mypets.by myseoconsultant.com
myxdate.info mysex21.com
naperehresti.info myyour.eu
narutonaruto.ru nailsimg.com
neodownload.webcam namenectar.com
new-apps.ru naval.jislaaik.com
nextlnk12.com neks.info
nfvsz.com netfacet.net
no-fuel.org no-rx.info
obiavo.ru noclegonline.info
offer.camp nofreezingmac.work
oksrv.com nonews.co
online-sbank.ru nottyu.xyz
onlinedomains.ru noumeda.com
onlyporno.ru nw-servis.ru
onstrapon.purplesphere.in odesproperty.com
oops-cinema.ru odoratus.net
openfrost.com offtime.ru
osagonline.ru oil-td.ru
ossmalta.com okmedia.sk
paidonlinesites.com onko-24.com
palocco.it online-zaymy.ru
parajumpersoutlet.online onlywoman.org
onthemarch.co
openfrost.net
ostroike.org
partner-host.men partner-host.men
partnerworkroom.men partnersafe.men
paydayloanslocal.com pc-services.ru
pc4download.co perso.wanadoo.es
pdns.cz pestomou.info
phpdevops.com physfunc.ru
phuketscreen.com pic-re.blogspot.com
picturesmania.com picsearch.com
pihl.se pinkduck.ga
pizda.lol pinup-casino1.ru
pk-pomosch.ru pirateday.ru
pony-business.com piulatte.cz
porn-w.org plastgranar.nu
pornoplen.com playtap.us
pornosee.info poisk-zakona.ru
potoideas.us polska-poezja.com
pozdrawleniya.ru popugauka.ru
pornhive.org
porno-raskazy.ru
pornosok.ru
powenlite24.ru
pravoholding.ru pravoholding.ru
proprostatit.com preventheadacheguide.info
proxyelite.biz privatefx.all4invest.info
putitin.me profit-opportunity.com
qwesa.ru pron.pro
radiodigital.co pronekut.com
raisedseo.com prostitutki-tyumeni.org
randki-sex.com purchasepillsnorx.com
ranksonic.com purplestats.com
rasteniya-vs-zombi.ru pwwysydh.com
rating-casino2021.ru qwertty.net
real-time-analytics.com realitykings.com
realizmobi.com realizmobi.com
reckonstat.info realtytimes.com
reimageplus.com redhotfreebies.co.uk
relax.ru referencemoi.com
remont-fridge-tv.ru refudiatethissarah.info
remont-mobile-phones.ru registrationdomainsite.com
remontbiz.ru registry-clean-up.net
renecaovilla.online renewablewealth.com
rentaremotecomputer.com replica-watch.ru
replicaclub.ru responsinator.com
restorator-msk.ru rewardpoll.com
ribieiendom.no rimedia.org
ricorsogiustizia.org rocketchange.ru
roll123.com romhacking.ru
rosbalt.com.ua running-line.ru
rospromtest.ru runtnc.net
runstocks.com rus-pornuha.com
russkoe-zdorovie.ru ruscoininvest.company
sa-rewards.co.za ruspdd.com
sadaholding.com sajatvelemeny.com
sampleletters.net saveindex.xyz
sc-specialhost.com sbdl.no
scanner-andrew.top sbetodiodnye-lampy.ru
score-ads.men scanner-willy.top
sdsjweb.com searchinterneat-a.akamaihd.net
searchkut.com
searchlock.com searchlock.com
secret.xn--oogle-wmc.com securesmrt-dt.com
see-your-website-here.com segol.tv
seksvideoonlain.com seinterface.com
senger.atspace.co.uk seorussian.ru
seoprofiler.com serialsway.ucoz.ru
servethis.com serptehnika.ru
service-core.ru sex-znakomstva.online
serviporno.com sexad.net
seryeznie-znakomstva.ru sexuria.net
sexblog.pw sharebutton.net
shitmovs.com sharebutton.org
shoesonlinebuy.cn shinikiev.com.ua
shohanb.com shisha-swag.de
shopfishing.com.ua shmetall.com.ua
shoplvlv.us skatestick.bid
sibvitr.ru skuteczna-dieta.co.pl
sierraapps.com smartbalanceworld.com
signx.info snowplanes.com
silvermature.net social-vestnik.ru
sims-sims.ru socialbookmarksubmission.org
sispe.com.br soda.media
siteripz.net softomix.com
skyway24.ru softtor.com
slavia.info
slonechka.ru
sluganarodu.ru
social-button.xyz
social-buttons.xyz
social-s-hhh.xyz
socialseet.ru
sockshare.net
soietvousmaime.fr soietvousmaime.fr
songplanet.ru spaceshipad.com
space-worry.ml spb.ru
specialfinanceoffers.com spidtest.org
spin2016.cf spidtest.space
staff.prairiesouth.ca stefanbakosab.se
stairliftsarea.com strongholdsb.ru
stardevine.com taraz.xkaz.org
stariy-baku.com taximytishi.ru
stjamesschool.info theautoprofit.ml
stmassage.ru thedownloadfreeonlinegames.blogspot.com
store-rx.com thegolfclub.info
stuff-about-money.com tizanidineandgabapentin.blogspot.com
superoboi.com.ua tizanidinedrugtest.blogspot.com
swimpool.ca tizanidinehcl2mgtablet.blogspot.com
symbaloo.com tizanidinehcl4mgisitanarcotic.blogspot.com
talant-factory.ru tizanidinehcl4mgtab.blogspot.com
tasteidea.com tizanidinehcl4mgtabinfo.blogspot.com
tedxrj.com tizanidinemusclerelaxant.blogspot.com
teenforporn.com tizanidinezanaflex.blogspot.com
teenfuck.tv top10-online-games.com
template-kid.com toyota.7zap.com
tengohydar.tk trackmedia101.com
texbaza.by trafficmonetize.org
thedownloadfromwarez.blogspot.com tramadolandtizanidine.blogspot.com
thefotosgratis.eu tvteleport.ru
themestotal.com twittruth.com
theporndude.com ukr-lit.com
thruport.com unece.org
timecrimea.ru unmaroll.ya.ru
tizanidine4mgstreetprice.blogspot.com uogonline.com
tizanidine4mgstreetvalue.blogspot.com
tizanidine6mg.blogspot.com
tizanidineforopiatewithdrawal.blogspot.com
tizanidinehydrochloride4mgstreetvalue.blogspot.com
tizanidinerecreationaluse.blogspot.com
tizanidinestreetvalue.blogspot.com
toonfamilies.net
top-l2.com
tovaroboom.vast.ru
trafficmania.com
trion.od.ua
tripper.de
triumf-realty.ru
tuckpointingmasonrysystems.com
turkeyreport.tk
tv-spoty.info
twittrading.com
uchetunet.su
ugogo.info
urengoy.pro urengoy.pro
uroki.net url2image.com
vereo.eu usiad.net
versaut.xxx-cam.webcam uytmaster.ru
verymes.xyz v720hd.ru
vapeface.club
vegascosmetics.ru
velen.io
vesnatehno.ru vesnatehno.ru
via-gra.webstarts.com viagroid.ru
videtubs.pl vip-parfumeria.ru
vkak.ru voloslove.ru
vltai.com vpnmouse.com
vod.com.ua
voltrknc1.com
voluumtrk.com
vuclip.com vuclip.com
vucms.com wardreapptokone.tk
w-journal.ru warningzscaler.heraeus.com
wallpapers-best.com webadvance.club
wareseeker.com website-speed-checker.site
webmonetizer.net website-speed-up.site
webscouter.net websiteexplorer.info
wfb.hatedriveapart.com weekes.biz.tc
whengirlsgowild.com wesharepics.site
wingsoffury2.com womensterritory.ru
woodyguthrie.se word-vorlagen.net
world-mmo.com worldhistory.biz
wpthemedetector.co.uk www.bookmaker-bets.com
www.jbetting.com www.jbetting.com
xn----8sbarihbihxpxqgaf0g1e.xn--80adxhks www.souvenirua.com
x-musics.com
xjrul.com
xkaz.org
xn------7cdbapdecfd4ak1bn0amjffj7afu3y.xn--p1ai
xn----7sbho2agebbhlivy.xn--p1ai
xn----8sblgmbj1a1bk8l.xn----161-4vemb6cjl7anbaea3afninj.xn--p1ai
xn--80aafb2a.xn--p1ai xn--80aafb2a.xn--p1ai
xn--b1agm2d.net
xxxasianporn.net xxxasianporn.net
yginekologa.com xxxdatinglocal.us
ynymnwbm.bloger.index.hr yaoguangdj.com
you-shall-not-pass.is74.ru youporn-forum.ga
youbrainboost.asia youraticles.pl
youthreaders.com youresponsive.com
yubikk.info yourmovies.pl
za-fun-offer.com yourserverisdown.com
zakonobosago.ru zaimite.ru
znakom.sibtest.ru zarajbuilders.com
zoodrawings.com zastenchivosti.net
zophim.me zebramart.ru
zeroredirect1.com
zeroredirect10.com
zixizop.net.ru
znakomstva-piter78.ru
zs2vm.top

482
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
00it.com 00go.com
2000k.ru 51unlim.ru
4kepics.com adcash.com
5000-cotydzien.com adsloads.com
ad-words.ru agapovdg.ru
adhome.biz alfa-img.com
aksonural.ru alibestsale.com
alessandraleone.com allknow.info
allkrim.com allmarketsnewdayli.gdn
allpdfmags.net alphaforum.ru
alta-realestate.com anaseracresar.tk
amateurlivechat.org angel1777.kz
ameblo.jp antons-transporte.de
ampower.me apibrowsesmartne-a.akamaihd.net
amyfoxfitness.com asscenihotosidea.blogspot.co.za
anabolics.shop atlasvkusov.ru
analytics-ads.xyz aucoinhomes.com
apiadanaknet-a.akamaihd.net autovideobroadcast.com
apimegabrowsebiz-a.akamaihd.net avramstroy.ru
apple.com-webbrowsing-security.science azte.ch
ardimobileinfo.ml back.dog
asseenontvonline.ru backgroundpictures.net
auto4style.ru backuperwebcam.weebly.com
avirasecureserver.com barnfurnituremart.com
avtochehli.by battleforupdating.site
azartniy-bonus.com beetpics.pw
bangla-chat-uk-paralud.ga bestbrainprod.win
bankcrediti.ru bestfortraders.com
bannerbank.ru bestpriceninja.com
bif-ru.info betteroffers.review
bkgr.se
bloggen.be
boleznikogi.com boleznikogi.com
bookhome.info brainboosting.club
bracketsmackdown.com bronzeaid-a.akamaihd.net
brimstonehillfortress.org buy-loft.ru
budilneg.xyz buyhoverboard.com
burger-tycoon.com callejondelpozo.es
buscarfoto.com cardul.ru
business-made-fun.com carsplate.com
carmuffler.net cartiertrinity.xyz
cdncash.net cdncash.com
cfsrating.sonicwall.com centrumcoachingu.com
chlooe.com cleansearch.net
chuckguilford.com clevernt.com
cialis-samples.com clickprotects.com
cialischstgerts.com club-samodelkin.ru
clicksor.com comeondog.info
co.lumb.co compliance-alexa.xyz
compliance-checker-7.info compliance-jess.top
compliance-checker.info conocer-sanabria.com
compliance-donald.xyz cosmetic.donna7753191.ru
cosmeticswomens-womensports.rhcloud.com creatives.adbetclickin.pink
covid-schutzmasken.de csgo4.win
crd.clan.su demon-tweeks.com
cutalltheshit.com dickssportinggoods.com
cypernhuset.se digilander.libero.it
cyse.tk digital-video-processing.com
damedingel.ya.ru digitalfaq.com
day-news.info dneprsvet.com.ua
dbmkfhqk.bloger.index.hr doeco.ru
deanmoore.ie dostavimvdom.ru
deluxedumps.com dostavka-v-krym.com
dispo.de downloadmefiranaratb1972.xpg.com.br
diusyawiga.tk ekn-art.se
divci-hry.info elektrozigarettekaufen2.blogse.nl
dorratex.tn
download-walpaperhd.blogspot.com
druzhbany.ru
easytuningshop.ru
ecommerce-seo.org
edudocs.net
egvar.net
elektrozigarette2.webs.com
elektrozigarette2.wordpressy.pl
elite-sex-finders.com
elmacho.xyz elmacho.xyz
enskedesquashclub.se elvenmachine.com
eshop.md esfchat.tk
essayservicewriting.org executehosting.com
extads.net ezigarettekaufen2.mpbloggar.se
eyes-on-you.ga
fakehandbags.xyz
fapgon.com
fast-wordpress-start.com
fba-mexico.com
feeriaclub.ru
fellowshipoftheminds.com
ff30236ddef1465f88547e760973d70a.com ff30236ddef1465f88547e760973d70a.com
fillmewithhappiness.com forum20.smailik.org
filmania-x.ru freelinkbuilding.website.tk
financetip.eu freshmac.space
flex4launch.ru friendflnder.com
forzeronly.com fsakhalin.ru
foto-telok.net galleryawesome.com
freshberry.com.ua gamblingnerd.com
fuel-gas.com gamedayhouse.com
fun2cell.net
fym.com.ru
gagrasector.ru
gheus.altervista.org
gkvector.ru gkvector.ru
glavprofit.ru googst2.ru
golmau.host.sk gosmeb.ru
greenzaim.ru gsasearchengineranker.xyz
h2monline.com hexpilot.com
healbio.ru hostcritique.com
highland-homes.com hotblog.top
hildinghr.se hotchatdate.com
homik.pw hothot.ru
hotelcrocenzi.sm hotsocialz.com
hoverboard360.nl house.sieraddns.com
hspline.com iccornacircri.cf
import-sales.com infobabki.ru
importchinacoach-teach.com insomniagamingfestival.com
incanto.in.ua int.search.mywebsearch.com
infoupdate.org inzn.ru
iscblog.info ivearchenceinflu.cf
isitwp.com izhevsk.zrus.org
itag.pw joy-penguin.com
jpcycles.com kaliningrad.zrus.org
kadashihotel.com karaganda.xkaz.org
kaidalibor.de ketoanhanoi.info
kinomaniatv.pl keywordhut.com
kiwe-analytics.com keywordsuggest.org
ladov.ru kino-filmi.com
lesbian.xyz kinozapas.com
likesuccess.com klosetkitten.com
love-baby.cz komputernaya-pomosh-moscow.ru
mail.allnews24.in kraljeva-sutjeska.com
manualterap.roleforum.ru kredit-blog.ru
mastershef.club kskjco.club
mcadamssupplyco.com kursy-ege.ru
mega-bony2017.pl lecbter-relationships.ga
mesto-x.com ledis.top
mobicover.com.ua linkbuddies.com
music.utrolive.ru linkredirect.biz
mycaf.it lion.bolegapakistan.com
mydirtyhobby.com machicon-akihabara.info
mydoctorok.ru mackeeper-center.club
mysex21.com marblestyle.ru
nastroyke.net marcoislandvacations.net
naturalbreakthroughsresearch.com mediaoffers.click
nerudlogistik.ru medicine-4u.org
netfacet.net medkletki.ru
nlfjjunb5.ru menstennisforums.com
nufaq.com metaxalonevstizanidine.blogspot.com
offers.bycontext.com mhi-systems.ru
oneminutesite.it milblueprint.com
onlinebay.ru mockupui.com
onthemarch.co moesexy.com
panchro.xyz moneyviking-a.akamaihd.net
parfusale.se moomi-daeri.com
partner-host.men moviezbonkerssk.cf
pastaleads.com mvpicton.co.uk
pcimforum.com mygameplus.com
pensplan.com myindospace.com
perfectpracticeweb.com mylovelibrabry.com
pics-group.com myplaycity.com
picswe.com na-telefon.biz
pio.polytopesexempt.com nicefloor.co.uk
pix-hd.com oakridgemo.com
oivcvx.website
orenburg-gsm.ru
outpersonals.com
ozoz.it
p-business.ru
paleohub.info
partner-pop.men
parvezmia.xyz
pc-services.ru
pc4download.co
physfunc.ru
pictures-and-images.net
pistonclasico.com
pivka.xyz
pix24x7.com
ploenjitmedia.azurewebsites.net
popcash.net
pornodojd.ru pornodojd.ru
pornosee.info preparevideosafesystem4unow.site
pozvonim.com pricheskaonline.ru
pushdata.sendpulse.com primedice.com
quick-offer.com pronekut.com
r-e-f-e-r-e-r.com prosmibank.ru
redbottomheels.xyz prostitutki-kiev.org
remote-dba.de proxyelite.biz
replicalouboutin.xyz pussyfleet.com
rfd-split.hr qexyfu.bugs3.com
rightenergysolutions.com.au ranksonic.org
ruf777.com realmonte.net
sabizonline.com remmling.de
saddiechoua.com remont-komputerov-notebook.ru
remont-ustanovka-tehniki.ru
ringtonepartner.com
ritlweb.com
robotixix.com
rp9.ru
rubanners.com
runofilms.ru
rusoft-zone.ru
scanner-jess.top
schoolfiles.net schoolfiles.net
se.bnt-team.com
seadragonherbery.com seadragonherbery.com
seemoreresultshu-a.akamaihd.net seemoreresultshu-a.akamaihd.net
serptehnika.ru seeresultshub-a.akamaihd.net
service-core.ru seminarykansas904.ml
sethrollins.net seozoom.it
sherlock.se serialsway.ucoz.ru
shisha-swag.de shop.acim.org
shoppingmiracles.co.uk sibecoprom.ru
sibvitr.ru site.ru
snowplanes.com sitopreferito.it
softomix.com skytraf.xyz
spaceshipad.com slim.sellany.ru
spb.ru snip.tw
sortthemesitesby.com
spacash.com
space2019.top
spamnuker.com
speeddream.xyz speeddream.xyz
spywarenuker.com standardchartered-forex.com
starpages.net statustroll.com
sugarkun.com subj.ukr-lit.com
sumo.com success-seo.com
symbaloo.com sugarlyflex.pw
teenforporn.com svarbit.com
telefonsexi.com tarad.com
templates.franklinfire.co the-torrent-tracker.blogspot.com
testbotprocessor44.com thebitcoincode.com
texbaza.by thedownloadfreeonlinegames.blogspot.com
time-japan.ru themeforest.net
timeallnews.ru thetoiletpaper.com
tonerbox.kz titslove.yopoint.in
toolsky.com tizanidineonline.blogspot.com
top10registrycleaners.com tootoo.to
traffic2money.com top-deal.com.pl
tsstcorpcddvdwshbbdriverfb.aircus.com torrnada.ru
tuckermktg.com torture.ml
turbabitload.weebly.com tozup.com
umnovocaminho.com trafficmonetize.org
unitexindia.com traffictrade.life
uogonline.com trahic.ru
uptime.com ua-company.ru
urdoot.win ucoz.ru
utiblog.fr uhdtv.website
vegan-foods.us unpredictable.ga
vertaform.com uprour.com
viandpet.com vancleefreplica.pw
videos-for-your-business.com vbikse.com
vids18.site videosbox.ru
villacoloniale.com vut.com.ru
vinsit.ru vvon.co.uk
vipps.com.my webix.me
visitcambridge.org websitevaluebot.com
wallpapersist.com whatistizanidinehclusedfor.blogspot.com
webmonetizer.net wholinkstome.com
websiteaccountant.de witherrom55.eklablog.fr
weburok.com wnhjavlhezp.gq
welcomeauto.ru woman-h.ru
wemarketing.se worldlovers.ru
wheelchairliftsarea.com x-diesel.org
wholesalejerseychinashop.com xn----itbeirbjbi7bc6bh2d.xn--p1ai
ws.ampower.me xn--80adaggc5bdhlfamsfdij4p7b.xn--p1ai
wstroika.ru xn--d1aifoe0a9a.top
wufak.com xn--l1aengat.xn--p1ai
xtube.com xpresscare.ru
xwatt.ru xuki.us
xxx-cam.webcam yun56.co
xxxtubesafari.com zirondelli.it
yebocasino.com zocaparj.kz
yellowads.men zreloeporno.tv
youjizz.vc
zakazfutbolki.com
zaloadi.ru
zarajbuilders.com
zebradudka.com
zeroredirect8.com
zoogdiesney.com
zscalerone.net

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.48 0; 10.1.0.8 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2021.08.2501 ### Version: V4.2021.08.2502
### Updated: Wed Aug 4 10:03:39 UTC 2021 ### Updated: Wed Aug 4 22:01:32 UTC 2021
### Bad Bot Count: 618 ### Bad Bot Count: 618
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2021.08.2501 ### Version: V4.2021.08.2502
### Updated: Wed Aug 4 10:03:39 UTC 2021 ### Updated: Wed Aug 4 22:01:32 UTC 2021
### Bad Bot Count: 618 ### Bad Bot Count: 618
################################################### ###################################################
### Version Information ## ### Version Information ##