vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-05 12:09:57 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2022.12.3502 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2022-12-01 22:07:21 +00:00
parent 62499543cc
commit 385069efec
46 changed files with 96193 additions and 96193 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.11.3501 #### Version: V4.2022.12.3502
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.11.3501 #### Version: V4.2022.12.3502
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -14,7 +14,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2022.11.3501 #### Version: V4.2022.12.3502
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

11892
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2022.11.3501 #### Version: V4.2022.12.3502
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

11896
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

11896
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

11896
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

11896
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.162 1; 10.1.0.123 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.162 0; 10.1.0.123 0;
127.0.0.1 0; 127.0.0.1 0;

11896
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.162 1; 10.1.0.123 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.162 0; 10.1.0.123 0;
127.0.0.1 0; 127.0.0.1 0;

11896
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.162 1; 10.1.0.123 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.162 0; 10.1.0.123 0;
127.0.0.1 0; 127.0.0.1 0;

11896
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
3501 3502

11896
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

11896
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.237.190.202 0; 20.245.83.77 0;

11896
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.162 1; 10.1.0.123 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.162 0; 10.1.0.123 0;
127.0.0.1 0; 127.0.0.1 0;

11896
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.162 1; 10.1.0.123 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.162 0; 10.1.0.123 0;
127.0.0.1 0; 127.0.0.1 0;

11896
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.162 1; 10.1.0.123 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.162 0; 10.1.0.123 0;
127.0.0.1 0; 127.0.0.1 0;

11896
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.237.190.202 0; 20.245.83.77 0;

11896
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.237.190.202 0; 20.245.83.77 0;

11896
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.162 1; 10.1.0.123 1;
127.0.0.1 1; 127.0.0.1 1;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
BlackWidow 01h4x.com
CCBot Aspiegel
ExtractorPro Cliqzbot
Humanlinks ECCP/1.0
MSFrontPage HMView
Microsoft URL Control Name Intelligence
Morfeus Fucking Scanner Pixray
WallpapersHD Reaper
com.plumanalytics Sottopop
tAkeOut Wallpapers/3.0

286
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
01h4x.com 01h4x.com
404checker
AIBOT AIBOT
ALittle Client ASPSeek
Abonti
Aboundexbot Aboundexbot
Acunetix AhrefsBot
AfD-Verbotsverfahren AiHitBot
Aipbot Alexibot
AlphaBot Anarchy99
Anarchie AwarioSmartBot
Anthill
Attach
BDCbot BDCbot
BDFetch
BackStreet BackStreet
Backlink-Ceck BackWeb
BacklinkCrawler Bandit
Badass Barkrowler
BatchFTP
Battleztar Bazinga
BlackWidow BlackWidow
Blackboard Blackboard
BotALot Boardreader
Buck Bolt
Bullseye Buddy
BuiltBotTough
BuiltWith
CODE87
Calculon Calculon
Cegbfeieh CensysInspect
CheeseBot
ChinaClaw ChinaClaw
Citoid Cloud mapping
Cocolyzebot
Cogentbot Cogentbot
Collector Collector
Copier
CopyRightCheck CopyRightCheck
Cosmos Cosmos
Crawling at Home Project Custo
CyotekWebCopy CyotekWebCopy
DBLBot DSearch
DTS Agent DTS Agent
DataCha0s Deusu
Devil Digincore
DigitalPebble Discoverybot
Discobot Dispatch
DomainCrawler DnyzBot
Dragonfly Drip
ECCP/1.0 ECCP/1.0
Ebingbong EMail Siphon
Ecxi EMail Wolf
EroCrawler EirGrabber
Exabot Exabot
Extractor Express WebPictures
ExtractorPro ExtractorPro
Extreme Picture Finder
EyeNetIE
Ezooms Ezooms
FDM
FHscan FHscan
FemtosearchBot FlashGet
Firefox/7.0 Flunky
Freeuploader FrontPage
GermCrawler
GetRight GetRight
GetWeb GetWeb
Getintent Go!Zilla
Gigabot Gotit
GrabNet GrabNet
HTMLparser GrapeFX
HTTP::Lite GridBot
HTTrack
Haansoft Haansoft
HaosouSpider Harvest
HonoluluBot
Humanlinks Humanlinks
IDBTE4M
IDBot IDBot
Iblog Iblog
Image Fetch Id-search
IndeedBot IndeedBot
Indy Library
InfoNaviRobot InfoNaviRobot
InternetSeer InternetSeer
Iria IstellaBot
Jbrofuzz Jbrofuzz
JennyBot JennyBot
JustView JetCar
Keybot Translation-Search-Machine Joomla
LWP::Simple Jorgee
Leap Jyxobot
Kinza
LNSpiderguy
Lanshanbot
LeechFTP
LieBaoFast LieBaoFast
LinkextractorPro LinkWalker
LinkpadBot LinkpadBot
LinqiaMetadataDownloaderBot
LinqiaRSSBot LinqiaRSSBot
Lipperhey Lipperhey
Ltx71 Lipperhey Spider
Litemage_walker
MIDown tool
MIIxpc MIIxpc
MJ12bot MJ12bot
MSFrontPage
MSIECrawler MSIECrawler
MTRobot Mail.RU_Bot
Mag-Net
Magnet
Majestic SEO
Majestic-SEO Majestic-SEO
MarkMonitor
MarkWatch
Mass Downloader Mass Downloader
Masscan
Mata Hari Mata Hari
Mb2345Browser MauiBot
MeanPath Bot Meanpathbot
Metauri Mediatoolkitbot
Microsoft URL Control Microsoft Data Access
Mister PiX
Moblie Safari
Mojolicious
Mozlila Mozlila
Msrabot Name Intelligence
Nameprotect Nameprotect
NearSite
Needle
Nessus Nessus
NetAnts NetAnts
NetSpider NetLyzer
NetZIP NetMechanic
Nettrack Netcraft
Nikto Netvibes
NimbleCrawler NextGenSearchBot
Not Nibbler
Niki-bot
Nimbostratus
Ninja
Nmap
Octopus Octopus
Offline Explorer Offline Explorer
Offline Navigator Offline Navigator
OnCrawl Openfind
Openvas
OutclicksBot OutclicksBot
PECL::HTTP PHPCrawl
PageAnalyzer POE-Component-Client-HTTP
PageThing.com PageThing.com
Pandalytics Pandalytics
Panscient
Papa Foto Papa Foto
Pavuk PeoplePal
Pi-Monster
Picscout Picscout
Picsearch Piepmatz
Pimonster Pixray
ProPowerBot PleaseCrawl
ProWebWalker
Probethenet Probethenet
Psbot Pump
PxBroker
PyCurl
QueryN Metasearch QueryN Metasearch
RSSingBot RSSingBot
RankActive
RankingBot2 RankingBot2
Rankivabot
RankurBot
Re-re Re-re
RealDownload RealDownload
RocketCrawler Reaper
RebelMouse
Recorder
SBIder SBIder
SEOkicks SEOkicks
SEOkicks-Robot
SEOprofiler
SEOstats
SalesIntelligent SalesIntelligent
ScanAlert Scanbot
ScoutJet Screaming
ScreenerBot Searchestate
ScrepyBot
Seekport
Semrush Semrush
SemrushBot SeobilityBot
SentiBot
SeoSiteCheckup
Seomoz Seomoz
Siphon
Site Sucker
SiteCheckerBotCrawler SiteCheckerBotCrawler
SiteLockSpider
SiteSnagger SiteSnagger
Sitebeam SlySearch
Sitevigil
Snake Snake
Snapbot Snapbot
SocialRankIOBot Spammen
Sosospider
SpankBot
Spanner Spanner
Spbot SputnikBot
Spinn3r Sqworm
Stripper Sucuri
Sucker
SuperBot SuperBot
Swiftbot SuperHTTP
T0PHackTeam T0PHackTeam
T8Abot
Telesoft Telesoft
TheNomad TheNomad
Thumbor
TightTwatBot
Tracemyfile Tracemyfile
Trendictionbot
Turnitin
TwengaBot TwengaBot
UnisterBot
Upflow Upflow
V-BOT V-BOT
VB Project
VCI
Vacuum
VelenPublicWebCrawler
VidibleScraper
Virusdie Virusdie
WEBDAV WPScan
WWW-Collector-E WWW-Mechanize
WWWOFFLE
Wallpapers Wallpapers
WeSEE WeSEE
Web Auto
Web Collage Web Collage
Web Enhancer Web Enhancer
Web Fetch Web Fetch
Web Fuck Web Fuck
Web Sucker Web Sauger
WebAuto WebBandit
WebCopier WebCollage
WebFetch WebFetch
WebFuck WebFuck
WebImageCollector WebImageCollector
WebLeacher WebLeacher
WebReaper WebPix
WebSauger WebStripper
WebWhacker WebWhacker
WebZIP Webalta
WebsiteExtractor WebmasterWorldForumBot
Webster
Whacker Whacker
Whatweb
Who.is Bot Who.is Bot
Woobot Wonderbot
Wotbox Xaldon WebSpider
Wprecon Xaldon_WebSpider
Zade
Zauba Zauba
Zermelo Zermelo
Zitebot ZumBot
ZmEu adscanner
arquivo-web-crawler archive.org_bot
arquivo.pt arquivo.pt
backlink-check backlink-check
cah.io.community check1.exe
clark-crawler coccocbot
crawl.sogou.com cognitiveseo
crawler.feedback crawler.feedback
crawler4j crawler4j
evc-batch
heritrix heritrix
instabid instabid
internetVista monitor lwp-request
iubenda-radar muhstik-scan
meanpathbot
netEstate NE Crawler
oBot oBot
pcBrowser
polaris version
ripz
s1z.ru s1z.ru
satoristudio.net scalaj-http
seocompany.store seobility
serpstatbot serpstatbot
sexsearcher
sogouspider sogouspider
trendiction.com
webgains-bot
webmeup-crawler webmeup-crawler
webpros.com webpros.com
x09Mozilla x09Mozilla
x22Mozilla zauba.io

274
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
404enemy 404enemy
80legs
AIBOT AIBOT
ALittle Client
ASPSeek
Abonti Abonti
Aboundexbot Aboundexbot
Acunetix Acunetix
AhrefsBot
AiHitBot
Alexibot Alexibot
AllSubmitter
Anarchy Anarchy
Anthill Anarchy99
Apexoo
Asterias Asterias
Attach AwarioRssBot
AwarioSmartBot
BBBike BBBike
BackStreet
BackWeb BackWeb
BacklinkCrawler BacklinkCrawler
Barkrowler Bandit
BatchFTP
Battleztar Bazinga
Black Hole
Blackboard Blackboard
Boardreader BlowFish
BotALot Bolt
Brandprotect
Brandwatch Brandwatch
Buddy Buck
BuiltBotTough
BuiltWith BuiltWith
Bullseye Bullseye
BuzzSumo BuzzSumo
CATExplorador CATExplorador
CCBot CODE87
Cegbfeieh
CensysInspect CensysInspect
CheTeam CheTeam
CherryPicker CherryPicker
Chlooe Collector
Citoid Copier
Claritybot Curious
Cloud mapping
Cocolyzebot
CopyRightCheck
Cosmos
Craftbot
Custo Custo
CyotekWebCopy DSearch
DIIbot
DTS Agent
DataCha0s DataCha0s
Demon
Devil Devil
Digincore Digincore
DigitalPebble
Dirbuster
Discobot Discobot
Dispatch
DnyzBot
DomCopBot DomCopBot
DomainAppender DomainAppender
DomainSigmaCrawler DomainCrawler
DomainStatsBot Drip
Dotbot Ecxi
Download Wonder EirGrabber
ECCP/1.0
EMail Siphon
Ebingbong
Evil Evil
Exabot Exabot
Extractor Extractor
ExtractorPro Extreme Picture Finder
FHscan FDM
Flunky Flunky
Freeuploader Foobot
FrontPage FrontPage
G-i-g-a-b-o-t FyberSpider
GT::WWW
GermCrawler GermCrawler
GetWeb GetRight
Gigabot
Go!Zilla Go!Zilla
Go-Ahead-Got-It Gotit
GoZilla Grafula
GrapeshotCrawler
HEADMasterSEO
HTMLparser
HTTP::Lite
Haansoft Haansoft
HaosouSpider HaosouSpider
Havij Harvest
Heritrix
Hloader Hloader
HonoluluBot
Humanlinks Humanlinks
HybridBot
IRLbot IRLbot
Image Sucker
IndeedBot IndeedBot
InfoNaviRobot Indy Library
Intelliseek Intelliseek
Internet Ninja Internet Ninja
IstellaBot JennyBot
Jbrofuzz JetCar
Jorgee Jetty
Joomla
Jyxobot Jyxobot
Keyword Density
Kinza Kinza
LNSpiderguy Kozmosbot
LWP::Simple Lanshanbot
Larbin
LexiBot
Lftp Lftp
LibWeb
Libwhisker Libwhisker
LieBaoFast
Lightspeedsystems
Likse
LinkScan LinkScan
LinkWalker
Linkbot Linkbot
LinkextractorPro
LinkpadBot LinkpadBot
LinksManager
LinqiaMetadataDownloaderBot LinqiaMetadataDownloaderBot
LinqiaRSSBot
LinqiaScrapeBot LinqiaScrapeBot
Lmspider Lipperhey
MJ12bot
MQQBrowser MQQBrowser
MSFrontPage MSFrontPage
MTRobot Mail.RU_Bot
Majestic12 Majestic SEO
MarkWatch MarkMonitor
Mass Downloader Mass Downloader
Masscan Mata Hari
Mb2345Browser
Mediatoolkitbot
MegaIndex.ru MegaIndex.ru
MicroMessenger Metauri
Mister PiX Microsoft URL Control
Minefield
Moblie Safari Moblie Safari
Mozlila Mozlila
Mr.4x3
Msrabot
NICErsPRO
Nameprotect
Navroad Navroad
NetMechanic Nessus
Netcraft NetSpider
NetZIP
Nettrack Nettrack
Netvibes
NextGenSearchBot NextGenSearchBot
Nibbler Nibbler
Ninja Nikto
Nmap NimbleCrawler
Not
Nuclei
Nutch Nutch
Octopus Offline Explorer
OnCrawl OrangeBot
OpenLinkProfiler
OpenVAS
OrangeSpider
PageGrabber PageGrabber
PageThing.com PageScorer
Pandalytics Panscient
Papa Foto
Pavuk
Picsearch Picsearch
PictureFinder Pixray
PleaseCrawl
ProPowerBot
ProWebWalker ProWebWalker
Probethenet
Psbot
Pump Pump
QueryN Metasearch QueryN Metasearch
RankActive RankActive
Rankivabot ReGet
Re-re RebelMouse
Reaper RedesScrapy
Recorder RepoMonkey
Ripper
RocketCrawler
Rogerbot Rogerbot
SBIder
SEOkicks-Robot SEOkicks-Robot
SEOprofiler SEOprofiler
SMTBot SMTBot
ScanAlert SalesIntelligent
Scanbot
Scrapy Scrapy
Screaming Screaming
ScrepyBot ScreenerBot
Seekport Seekport
SemrushBot SeobilityBot
SentiBot
SeoSiteCheckup
Shodan
Site Sucker Site Sucker
SiteExplorer SiteExplorer
SiteSnagger SiteSnagger
SiteSucker SiteSucker
Sitebeam
Siteimprove Siteimprove
SlySearch Sitevigil
Snake SpaceBison
Snoopy
SocialRankIOBot
Sogou web spider
SpankBot SpankBot
Spanner
Spbot Spbot
Spinn3r Sqlmap
SputnikBot Sqlworm
Steeler
Stripper Stripper
SuperBot
Surfbot
SurveyBot
Swiftbot
Szukacz
T0PHackTeam T0PHackTeam
Telesphoreo T8Abot
Telesphorep Teleport
The Intraformant TeleportPro
TheNomad
Thumbor Thumbor
TightTwatBot
Toata Toata
Toweyabot Toweyabot
Turingos Tracemyfile
Trendictionbot
True_Robot
Turnitin Turnitin
Typhoeus TwengaBot
URLy.Warning URLy.Warning
Upflow Upflow
VoidEYE VCI
Vagabondo
VeriCiteCrawler
Virusdie
WASALive-Bot WASALive-Bot
WBSearchBot WWW-Collector-E
WEBDAV WWW-Mechanize
Wallpapers WWWOFFLE
WallpapersHD WallpapersHD
Web Fuck Web Auto
Web Collage
Web Pix Web Pix
WebCopier Web Sucker
WebWhacker WebLeacher
WebSauger
WebSucker
Webalta Webalta
Webshag
WebsiteExtractor WebsiteExtractor
WebsiteQuester Webster
Who.is Bot Widow
WiseGuys Robot
Wonderbot Wonderbot
Woobot Woobot
YoudaoBot Xenu
Zauba
Zitebot Zitebot
ZoomBot ZoominfoBot
ZyBorg
archive.org_bot
autoemailspider autoemailspider
clark-crawler
coccocbot coccocbot
cognitiveseo demandbase-bot
crawler.feedback eCatch
evc-batch
gopher gopher
heritrix
instabid instabid
ips-agent
iubenda-radar iubenda-radar
linkdexbot linkdexbot
lwp-request
magpie-crawler magpie-crawler
mediawords
netEstate NE Crawler netEstate NE Crawler
oBot page scorer
plumanalytics plumanalytics
ripz ripz
seocompany.store s1z.ru
satoristudio.net
scalaj-http
seostar seostar
sexsearcher sysscan
sitechecker.pro trendiction.de
sogouspider
ubermetrics-technologies.com ubermetrics-technologies.com
voyagerx.com
webmeup-crawler webmeup-crawler
webprosbot webprosbot
x09Mozilla
xpymep1.exe
zgrab zgrab

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
dekoration.us 3-letter-domains.net
eldiariodeguadalajara.com agecheckadult.com
elektrozigarette1.dreamwidth.org alta-realestate.com
goldenggames.com geilehausfrauen.net
googst2.ru goldadpremium.com
hazardky.net gotcher.us
moxo.com hunthillfarmtrust.org
naperehresti.info php-market.ru
oxotl.com steebook.com
xn--1-8sbcpb0bdm8k6a.xn--p1ai teenforporn.com

926
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
007angels.com 101lesbian.xyz
00author.com 1314dh.com
1-99seo.com 1688.com
123movies.love 21h2o.com
12u.info 3dracergames.com
1webmaster.ml 3th.co.in
5tey7463.weebly.com 3xforum.ro
6hopping.com 4kpics.rocks
8si.ru 5-steps-to-start-business.com
9med.net 888.com
a.frcls.fr 8xv8.com
aa625d84f1587749c1ab011d6f269f7d64.com 991mostfm.co.id
aa8780bb28a1de4eb5bff33c28a218a930.com above.com
aa9bd78f328a6a41279d0fad0a88df1901.com absugars.com
aanapa.ru abwa.tk
abclauncher.com activepr.ru
abiente.ru adconscious.com
abovetherivernc.com adhome.biz
admatic.com.tr adrenalin-stk.ru
afftrack001.com adultfullhd.com
afora.ru adultnet.in
albuteroli.com adzerg.com
allblogroll.com aero2.ru
allcredits.su agardomains.com
alta-realestate.com alert-fjg.xyz
alvtank.se alert.scansafe.net
amateurlivechat.org alfa-img.com
amoi.tn alldubai.biz
allstatesugarbowl.org
am15.net
anal-acrobats.hol.es anal-acrobats.hol.es
angkortours.vn anaseracresar.tk
apimegabrowsebiz-a.akamaihd.net angry-fermi-7633.arukascloud.io
apioutoboxnet-a.akamaihd.net anlimebel.kiev.ua
appartement-stumm.at apimossnetinfo-a.akamaihd.net
apps-analytics.net appearance-cool.com
appsecurityr.com apptester.tk
apxeo.info arendatora.ru
ardimobileinfo.ml arewater.com
arius.tech arquapetrarca.info
artel116.ru atmagroup.ru
asscenihotosidea.blogspot.com atovh.local-finders.com
autoblogger24.info auto-moto-elektronika.cz
autodo.info autobrennero.it
autowebmarket.com.ua
aviapanda.ru aviapanda.ru
aviav.co aviav.eu
avirasecureserver.com avtochehli.by
awency.com avtocredit-legko.ru
babosas.com ayerbo.xhost.ro
bagcionderlab.com azarttoto.com
balitouroffice.com azbaseimages.net
banan.tv baikaleminer.com
bausparen.bz.it baladur.ru
beclean-nn.ru balois.worldbreak.com
bestcurs.org bankofthewext.com
betune.onlinewebshop.net beauty-bracelet.com
bigames.online best-games.today
bigcities.org bestbuy.ca
bingo8888.com bestcoin.cc
bestofferswalkmydogouteveryday.gq
bestplacetobuyeriacta.jw.lt
bestwebsiteawards.com
betonka.pro
bget.ru
bildsuche.ru
billiard-classic.com.ua
bio-optomarket.ru
bizfly.info
biznesluxe.ru
biznesschat.net biznesschat.net
blackhatworth.com
blog.remote-computer.de blog.remote-computer.de
bloggedporn.com blog.yam.com
blogig.org bloglag.com
blogos.kz blogos.kz
bolegapakistan.com bolitgorlo.net
bombla.org bombla.org
bonky.biz bonzibuddi.com
boobsimge.com brainboosting.club
bouda.kvalitne.cz brandimensions.com
brendbutik.ru buketeg.xyz
brk-rti.ru bukleteg.xyz
burkesales.com buyclomidonlaine.com
bus-offer.com buyhoverboard.com
business-made-fun.com buypanicdisorderpill.com
butstrap.space buypuppies.ca
bvlgaribracelet.xyz bwlx.prepedu.cn
calcularpagerank.com callawaygolfoutlet.online
calvet.altervista.org camdenmemorials.com
camsex.xxx-cam.webcam cand.jp
candytiner.com
canrole.com canrole.com
canvas.gloverid.site capsderfudd.tk
cardiosport.com.ua cartierlovestore.xyz
cardul.ru cartierreplica.win
carina-sy.de cartiertrinity.xyz
carrauterie.be casinopinup-wins.com
cartierbraceletsreplica.pw cbb1smartlist12.click
cartierlovebracelet.xyz chinese-amezon.com
casite-513049.cloudaccess.net chocolateslim-u-srbiji.com
cbozhe.com cityadspix.com
cdncash.com click2pawn.com
cheapjerseysfootballshop.com clickaider.com
cheapmoncler.pw coderstate.com
cheapmoncler.win
chiptuninger.com
christianlouboutinreplica.win
christianlouboutinsaleoutletonline.us
citysecurity.nu
clipartnew.com
club-samodelkin.ru
co.lumb.co
com-onlinesupport.host com-onlinesupport.host
commoncrawl.org compliance-andrew.xyz
compliance-andrew.top converse.ddsoldes.fr
compliance-barak.xyz cookie-law-enforcement-ff.xyz
compliance-brian.top cosmetic.donna7753191.ru
compliance-jane.top crd.clan.su
compliance-john.top cubs-jerseys.us
compliance-josh.top customerpromos-a.akamaihd.net
coolyarddecorations.com daisye.top
copblock.org daymusam.com
counciltally.com decorationspcs.com
country-chic.ru
cryptoswap.biz
cs-passion.pl
cupday.com
customcollegeessays.net
darkages.info
dating-app.ru
davidovic.info
dcj-nn.ru
decenttools.com
deda-moroza-zakaz.ru
deplim.com
detmebel.su
dev78.dioniqlabb.se
digital-video-processing.com digital-video-processing.com
diusyawiga.tk diminishedvalueoforegon.com
djihispano.com docstoc.com
domaincheck.io doeco.ru
domashneeruporno.com doublepimp.com
downloaddy.net e-collantes.com
doyouknowtheword-flummox.ml e-commerce-seo1.com
drivotracker.com
drunkmoms.net
dvervmoskvu.ru
e-biznes.info
e-kwiaciarz.pl
e90post.com e90post.com
egovaleo.it ebonyporn.site
ecommerce-seo.com
ecookna.com.ua
ed-shop01.ru
ekaterinburg.xrus.org ekaterinburg.xrus.org
elektrischezigarette1.onsugar.com electronicadirect.com
elmacho.xyz elektrischezigarette2.onsugar.com
energydiet24.ru elektroniksigaraankara.info
enews.tech elite-sex-finders.com
envaseslotusama.com energydiet-info.ru
es5.com eng-lyrics.com
escortplius.com enpolis.ru
espaceinventoristes.com etenininrade.ga
estibot.com
etur.ru
eugenevaultstorage.com
europages.com.ru europages.com.ru
extractorandburner.com evaashop.ru
ez8motelseaworldsandiego.com everypony.ru
expertblog.info
expolicenciaslatam.co
extads.net
extener.org
extlabs.io
ezaz.info ezaz.info
ezigarettekaufen2.blox.pl ezigarettenshop2.myblog.de
falllow.gq
familienzahnaerzte.com
fantasticpixcool.com fantasticpixcool.com
farm26.ru fearcrow.com
fashion-mk.net feel-planet.com
fastfixing.tech fertilitetsradgivningen.se
feeriaclub.ru fitnesspiks.com
fickluder69.com flashbannernow.com
filesdatabase.net foodcrafts.website
filesvine.com footbalive.org
financeloan.us forum.tvmir.org
fishingwholesale.us fototravel.eu
flex4launch.ru foxinsocks.ru
floating-share-buttons.com free-deals.faith
forms-mtm.ru freegamesplay.online
forodvd.com freemags.cc
fotopop.club front.ru
freelifetimefuckbook.com game300.ru
fuckingawesome.com games.kolossale.ru
fun-mobi.pl
fxtips.ru
fyl.com.ru
g33.org
gavuer.ru gavuer.ru
gay-file.com gazoblok.net.ua
genericviagrasildenafiled.net gcup.ru
ge0ip.com
getresponse.com getresponse.com
girlsfuckdick.com gg-arena.ru
glopages.ru ggiaro.com
googlepositions.com gifspics.com
googst2.ru girlsatgames.ru
gox.com.ua glall.ru
green-tea.tv gloverid.site
gta-top.ru goforexvps.com
guod.me gojiberriess.apishops.ru
hasfun.com goldadpremium.com
hd720kino.ru goodwinmetals.co
hdimagelib.com google-liar.ru
herokuapp.com googleseo.com.tr
himgaws.pw gov.yanao.ru
homedecoguide.info graphicwe.org
hotel-mkad.ru greenidesign.co
house.sieraddns.com groupmoney.ru
howopen.ru gsasearchengineranker.site
hyiphunter.org gstatey.net
igadgetsworld.com hamptonoaks.ca
igrovyeavtomaty777.ru hanink.biz.ly
imagez.co hannasolution.ru
img.wallpaperstock.net hatdc.org
imperia31.ru hermesbelts.xyz
hermesreplica.win
histock.info
hobild.net
hoholikik.club
homelygarden.com
hostnow.men
hotenergy.ru
hoverboard360.nl
huhn.altervista.org
ideashome.id
ideoworld.org
imk.com.ua
impotentik.com
incep.imagine-ex.co
increasewwwtraffic.info
infoupdate.org
insta-add.pro insta-add.pro
interesnie-faktu.ru integritylandscapeservices.com
interfucks.net intellekt21.ru
intervsem.ru investzalog.ru
iskalko.ru invitefashion.com
istizanidineanopiate.blogspot.com izhevsk.zrus.org
ivanstroi.ru jav-fetish.com
jimmychoosale.online jerseywholesalechinabiz.com
jobgirl24.ru jetsli.de
joessmogtestonly.com jose.mulinohouse.co
jofucipiku.tk jrpmakati.com
jrcigars.com
junglenet-a.akamaihd.net
kaac.ru
kabbalah-red-bracelets.com
kam-dom.ru
kamorel.com
karaganda.xkaz.org karaganda.xkaz.org
keywordteam.net kartiniresto.com
khadastoafarde.tk kevblog.top
keyhantercume.com
keyword-suggestions.com
kicknights.gq kicknights.gq
kino2018.cc kihi.gdn
kinobest.pl kinobest.pl
kinogolos.ru kinotorka.ru
kinostorm.net kliksaya.com
kleine-titten.biz kndxbkdx.bloger.index.hr
kongoultry.net konkursowo-24.pl
kongruan.com konturkrasoty.ru
kostenloser-sex.com kosova.de
kountrylife.com krasivye-devushki.net
krasnodar.zrus.org ks1234.com
layola.biz.tc ladov.ru
lemon-ade.site lalalove.ru
lenpipet.ru lanasshop.ru
lida-ru.com landinez.co
lider-zhaluzi.kiev.ua lankarns.com
linksharingt.com law-check-eight.xyz
littleberry.ru law-check-seven.xyz
littlesexdolls.com leboard.ru
live-sexcam.tk lexixxx.com
loadopia.com life-instyle.com
lion.snapmap.us
littlecity.ch
lombia.com
longgreen.info longgreen.info
lordzfilmz.me
ltvperf.com ltvperf.com
lyrics.home-task.com lunamedia.co
mainlinehobby.net mansiondelrio.co
maju.bluesalt.co
makis.nu
manyresultshub-a.akamaihd.net manyresultshub-a.akamaihd.net
map028.com mapquestz.us
marcowebonyodziezowe.pl marketingtechniques.info
matb3aa.com marktforschung-stuttgart.com
medtherapy.ru mathgym.com.au
megaapteka.ru mcar.in.ua
meltwater.com medanestesia.ru
merryhouse.co.uk meddesk.ru
metaxalonevstizanidine.blogspot.com metascephe.com
mikozstop.com microsoftportal.net
mikrobiologies.ru mielec.pl
militarysale.pro minet.club
mindeyegames.com mir-business-24.ru
minharevisao.com mixed-wrestling.ru
minyetki.ru mjchamonix.org
mir-betting.ru modnie-futbolki.net
mockupui.com monclerjacketsoutlet.pw
moivestiy.biz mp3ringtone.info
moneyteam24.com muabancantho.info
monthlywinners.com mymobilemoneypages.com
moomi-daeri.com na15.ru
moroccosurfadventures.com netanalytics.xyz
morpicert.pw netcheckcdn.xyz
moscow-region.ru netoil.no
mug-na-chas-moscow.ru networkcheck.xyz
musicas.baixar-musicas-gratis.com new7ob.com
muz-baza.net newhairstylesformen2014.com
mwtpludn.review niki-mlt.ru
mxgetcode.com nikitabuch.com
mybackgroundlandscape.blogspot.com nlfjjunb5.ru
mybinaryoptionsrobot.com nowtorrents.com
mydirtyhobby.com nudejapan.net
mydoctorok.ru o.light.d0t.ru
mylesosibirsk.ru o00.in
mzdish.site
nacap.ru
nalogovyykodeks.ru
narco24.me
narkologiya-penza.ru
net-radar.com
newstraveller.ru
newtechspb.ru
nextrent-crimea.ru
nonews.co
november-lax.com
nufaq.com
nuup.info
o-o-8-o-o.com
obesidadealgarve.com obesidadealgarve.com
offer.wpsecurity.website oconto.ru
offf.info offergroup.info
okeinfo.online offtime.ru
oneclickfiles.com onclickpredictiv.com
onlineserialy.ru onlineku.com
onthemarch.co onlinemeetingnow.com
openfrost.com
optibuymac.com
oralsexfilme.net
orgasmatrix.com orgasmatrix.com
ownshop.win oxford-book.com.ua
ozas.net oynat.info
pandroid.co paceform.com
pearlisland.ru paparazzistudios.com.au
pelfind.me pathwhelp.org
perfectplanned.com patol01.pw
picswe.com photo-clip.ru
pipki.r.acdnpro.com picsfair.com
piulatte.cz picture-group.com
pisanieprac.info
pivka.xyz
pl-vouchers.com pl-vouchers.com
plastgran.com play.leadzupc.com
play-mp3.com pooleroadmedicalcentre.co.uk
poisk-zakona.ru popads.net
pokemongooo.ml popugaychiki.com
pons-presse.com
popup-fdm.xyz popup-fdm.xyz
popup-jdh.xyz pornohd1080.online
pornhub-forum.ga pornosemki.info
pornhubforum.tk pornpost.in
porno-play.net porto.abuilder.net
porno-transsexuals.ru pp-budpostach.com.ua
potoideas.us prefersurvey.net
preventheadacheguide.info privacyassistant.net
princevc.com prokotov.com
printdirectforless.com prostitutki-odessa.org
printie.com prostitutki-tolyatti.org
priora-2.com prpops.com
prostitutki-almata.org pshare.biz
prostitutki-belgoroda.org pussyspace.net
pst2017.onlinewebshop.net raisedseo.com
purchasepillsnorx.com ranking2017.ga
pussyfleet.com rankingchart.de
quickbuck.com rankings-analytics.com
quizzitch.net ranksonic.info
qwarckoine.com reelheroes.net
qwertty.net remontbiz.ru
rada.ru remote-dba.de
ranksays.com remybutler.fr
ranksignals.com rennlist.com
ranksonic.org restaurantlescampi.com
recordpage-a.akamaihd.net retreatia.com
regionshop.biz richinvestmonitor.com
registratciya-v-moskve.ru roll123.com
remont-komputerov-notebook.ru royal-betting.net
remontvsamare.su ruex.org.ua
ribieiendom.no runtnc.net
rockingclicks.com russia-tao.ru
rockma.se sa-live.com
rogervivierforsale.com sabizonline.com
rollercoin.com sashagreyblog.ga
rome2rio.com saveindex.xyz
rosbalt.com.ua sbricur.com
rospromtest.ru sbt-aqua.ru
russia-today-video.ru scanner-don.top
rutor.group scanner-george.top
sady-urala.ru scanner-walter.top
sarafangel.ru scanspyware.net
satellite.maps.ilovevitaly.com schalke04fc.info
sbetodiodnye-lampy.ru scoopquest.com
scanner-irvin.top se-welding.ru
scansafe.net se.bnt-team.com
scrapy.org
screentoolkit.com
seadragonherbery.com seadragonherbery.com
seeingmeerkat.com searchmywindow-a.akamaihd.net
semaltmedia.com securityallianceservices.com
seksvideoonlain.com
seo-traffic-ranking.info
seotoolsagency.com
service.adtech.us
sex-tracker.com sex-tracker.com
sexkontakte-seite.com sexkontakte-seite.com
sexkrasivo.net shakhtar-doneck.ru
sexpornotales.com shareyards.com
shmetall.com.ua shijian.ac.cn
shoesonlinebuy.cn shinikiev.com.ua
shopfishing.com.ua shoesonlinebuy.xyz
sideeffectsoftizanidine.blogspot.com shoppingmiracles.co.uk
sientalyric.co shtaketniki.kz
sitebeam.net sicfor.bcu.cc
siteripz.net sindragosa.comxa.com
sladkoevideo.com sinel.info
slonechka.ru skypasss.com
smart-scripts.com slujbauborki.ru
snegozaderzhatel.ru smartshoppymac.com
snjack.info sobecjvuwa.com.ru
socialbutton.xyz soc-proof.su
soft-program.com sockshare.net
soheavyblog.com sodexo.com
soochi.co softlinesolutions.me
spinazdrav.ru sogimlecal.tk
spy-sts.com solinf.co
steelmaster.lv sortthemesitesby.com
storehouse.ua sportbetfair.com
stpicks.com sprttrack.com
squidoo.com
sr-rekneskap.no
sribno.net
sstroy44.ru
steebook.com
stickers-market.ru
streetfire.net streetfire.net
strigkaomsk.ru strfls.com
stroymonolit.su subj.ukr-lit.com
strv.se sugarkun.com
students-cheapskate.ml summerlinhomes411.info
success-seo.com superoboi.com.ua
suchenindeutschland.com svensk-poesi.com
superinterstitial.com swimpool.ca
supermesta.ru tabletkinaodchudzanie.com.pl
svbur.ru tagil.zrus.org
swiped.su talant-factory.ru
szamponrevita.pl taqywu51.soup.io
tattooha.com teastory.co
techart24.com telefonsexi.com
tecnoteakviareggio.it telefonsexkostenlos.tk
the-torrent-tracker.blogspot.com tengohydar.tk
themeforest.net thejournal.ru
themestotal.com thin.me.pn
thepantonpractice.co.uk thruport.com
timdreby.com tiens2010.ru
titangel-vietnam.com titangel-vietnam.com
titslove.yopoint.in tizanidinedrugtest.blogspot.com
tizanidine4mgstreetvalue.blogspot.com tizanidineformigraines.blogspot.com
tizanidine6mg.blogspot.com tizanidinehcl2mgsideeffects.blogspot.com
tizanidinecost.blogspot.com tizanidineshowupondrugtest.blogspot.com
tizanidinezanaflex.blogspot.com tizanidinesideeffects.blogspot.com
tksn.ru
top-deal.com.pl
top-study.work top-study.work
topads.men top10registrycleaners.com
topappspro.com topflownews.com
topkarkas.com touchmods.fr
topquality.cf toursmaps.com
tourismvictoria.com track2.shop
tracklead.net tubeline.biz
trafficstars.com turizm.bz
traffique.net twelvevisionspartyofcolorado.com
traffixer.com
traxdom.ru
tri-slona.org
tuckpointingmasonrysystems.com
tula.howotorg.ru
twitlinks.com twitlinks.com
uchil.net typimga.pw
ufa.xrus.org udsgame.online
uggsale.online unrealcommander.biz
uhdtv.website unrealcommander.org
upupa.net uptime-gamma.net
urengoy.pro urldelivery.com
usiad.net usswrite.com
vapeface.club utrolive.ru
videochat.bz uytmaster.ru
visitcambridge.org uzporno.mobi
vita.com.hr vacances-voyages.info
vkak.ru vacuumscleaner.com
vote-up.ru valuado.com
vpnhowto.info vandrie-ict.nl
vse-pesni.com vbabule.net
wahicbefa31.soup.io vedomstvo.net
wallpapers-best.com vegan-foods.us
warezkeeper.com velobikestock.com
watch-movies.ru vgoloveboli.net
webcamtalk.net videospornogratisx.net
website-audit.com.ua videtubs.pl
website-speed-up.top visa-china.ru
wemarketing.se vodkoved.ru
whatsappbot.flyland.ru vostoktrade.info
whatsappdownload10.com vrotike.ru
whosonmyserver.com vseuznaem.com
wildnatureimages.com vvpg.ru
winner7777.net w3data.co
womensplay.net watchinf.com
wdfdocando.com
website-speed-up.site
weddingdresses.xyz
westermarkanjou.se
wetgames.ru
wholinkstome.com
whos.amung.us
windowssearch-exp.com
womama.ru
word-vorlagen.net
worldinternetauthority.com worldinternetauthority.com
wowcasinoonline.ooo wrona.it
wpthemedetector.co.uk www.wohnkabinen-shop.de
wrz0iuebwhp5fg.freeddns.com wwwadultcheck.com
wygraj-teraz.com
x-mix.info x-mix.info
xchat26.myfreecams.com x-porno.video
xn-----6kccaibs5cb8afhjrfmix2n.xn--p1ai xblog.in
xn--80aaaks3bbhabgbigamdr2h.xn--p1ai xitjw.info
xn--80aagddcgkbcqbad7amllnejg6dya.xn--p1ai xmronta.com
xn--80ab4aa2g.xn--p1ai xn--h1aakne2ba.xn--p1ai
xn--h1ahbi.com.ua xnxx-n.com
xn--l1aengat.xn--p1ai xrus.org
xportvusbdriver8i.snack.ws xvideosporn.biz
xsfetish.org xxxsiterips.xyz
xvideosbay.com yachts-cruise.info
yaoguangdj.com yoopsie.com
youradexchange.com you-shall-not-pass.is74.ru
yuarra.pluto.ro youbrainboost.asia
zakonobosago.ru youradulthosting.com
zaobao.com.sg yoursearch.me
zarabiaj-dzis.pl za-music.mymobiplanet.com
zeroredirect5.com zastenchivosti.net
zmoda.hostreo.com zhorapankratov7.blogspot.com
zionstar.net
zojirushi-products.ru
zona-aqua.ru zona-aqua.ru
zoogdiesney.com zrelaya.pw
zskdla.site zvuker.net
zvezdagedon.ru
zvooq.eu

476
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
11pikachu.ru 1xbet4you.com
14b.info 5i2.net
24videos.tv 76brighton.co.uk
3w24.com 9med.net
6hopping.com
7yue.org
aaa38852e886ac4af1a3cff9b47cab6272.com aaa38852e886ac4af1a3cff9b47cab6272.com
abcguru.xyz abusora.com
add-add.men adidas.frwebs.fr
adktrailmap.com advocatemsk.ru
affordablewebsitesandmobileapps.com afslankpillen2017nl.eu
afftrack001.com agreda.pluto.ro
akuhni.by alarmobninsk.ru
alessandraleone.com amazingpic.net
alienwheels.de androids-store.com
allbizne.co.ua apartment.ru
alloysteel.ru apiappenableinfo-a.akamaihd.net
amateurlivechat.org appsecurityr.com
apartmentbay.ru arabgirls.adultgalls.com
apiadanaknet-a.akamaihd.net asrv-a.akamoihd.net
apparel-offer.com azte.ch
apper.de bablonow.ru
arenanews.com.ua baditri.com
asiavirtualsolutions.com bannerads.de
atmovs.com battle.net
azartclub.org bavsac.com
babs.com.ua
baikaleminer.com
bfz.biz bfz.biz
bidbuy.co.kr bioca.org
bloglag.com blacktwhite.com
bloke.com bluesalt.co
bronzeaid-a.akamaihd.net boazpower.com
buy-meds24.com bombla.org
buypillsorderonline.com bonanza-fortune.men
bycontext.com brainzpod.win
carsplate.com breastaugmentation.co.za
carstrends2015.com buy-cheap-online.info
cerev.info cablecar.us
cezartabac.ro cacheimages.com
charmstroy.info camdenmemorials.com
cheapestjerseys-wholesale.com cartierloveringreplica.xyz
check-host.net cbb1smartlist12.click
chocolateslim-u-srbiji.com chatroulette.online
cleanpcnow.com cheap-pills-norx.com
compliance-elena.top clips.ua.ac.be
clodo.ru
com-cleaner.systems
cometorussia.net
compliance-ivan.top compliance-ivan.top
compliance-mark.top compliance-josh.top
connectionstrenth.com dev33.dioniqlabb.se
copyrightclaims.org digest-project.ru
cpabegins.ru doeco.ru
culturevie.info domain-tracker.com
custodieva.ru domaincdn.xyz
custom-product-labels.com dustyorate.com
customerpromos-a.akamaihd.net dynainbox.com
datsun-do.com e2click.com
dekoration.us
diamond-necklace.info
download-wallpaper.net
edge.sharethis.com edge.sharethis.com
eduinfosite.com education-cz.ru
emergencyneeds.org eldiariodeguadalajara.com
escort-russian.com elektrischeziga.livejournal.com
eshop4u.jp embedle.com
eurosamodelki.ru epicbrogaming.com
extractorandburner.com ertelecom.ru
farmprofi.net european-torches.ru
fatfasts-4tmz.com excaliburfilms.com
favornews.com executehosting.com
fefo.gdn expdom.com
fetroshok.ru ezb.elvenmachine.com
fidelityfunding.com f0815.de
footballfarrago.com farm26.ru
forexunion.net felizporno.com
foto-sisek.porngalleries.top ff30236ddef1465f88547e760973d70a.com
free-social-buttons.com fillmewithhappiness.com
free-traffic.xyz finejewelryshop.ru
freesitetest.com floating-share-buttons.com
floridamobilebillboards.com
fodelsedagspresenter.nu
franecki.net
freefoto.ca
freshwallpapers.info
frvo.alptandem.ru frvo.alptandem.ru
fuckingawesome.com fsalas.com
funnymama.com gamingspark.com
gigapeta.com gaz-voshod.ru
gosmeb.ru gerhardhealer.com
gq-catalog.gq gfaq.ru
gsasearchengineranker.space
gsasearchengineranker.xyz
gsbs.com.ua gsbs.com.ua
gwebtools.com gunsvicceadadebt.tk
handicapbathtubarea.com hifidesign.ru
hasfun.com hjaoopoa.top
hdimagegallery.net
hermesbracelets.xyz
herokuapp.com
hikesearch.net
hol.es hol.es
holidaypics.org
hotenergy.ru
howlongdoestizanidinestayinyoursystem.blogspot.com howlongdoestizanidinestayinyoursystem.blogspot.com
hspline.com iloveitaly.ru
iboss.com
idc.com.ua
ihc2015.info
imagerydatabase.com imagerydatabase.com
in-tandem.co impisr.edunsk.ru
incanto.in.ua infostatsvc.com
inclk.com intellektmedia.at
innoslicon.com interior-stickers.ru
investsuccess.org isistaylorporn.info
ivearchenceinflu.cf ispac.org
jennyfire.ru iyasimasennka.com
jeremyeaton.co javrip.net
jerseywholesalebizchina.com jmat.cn
jetsli.de kamagragelusa.net
jofucipiku.tk karaganda.xkaz.org
keyhantercume.com katjimej.blog.fc2.com
kidskunst.info kazrent.com
kiinomaniak.pl keywordbasket.com
kino2018.club kicknights.gq
kleine-titten.biz kinocccp.net
kmgamex.cf
kndxbkdx.bloger.index.hr
knigonosha.net
kollekcioner.ru
konica.kz
konoplisemena.com
kvartiry-remont.ucoz.ru kvartiry-remont.ucoz.ru
lapitec.eu lanadelreyfans.us
lerporn.info leadwayau.com
lexiangwan.com locationdesaison.com
livesex-amateure.info locksmith.jp
loftdigital.eu maranbrinfo.com.br
lonfon.xyz mearns-tractors.co.uk
longadventure.com megavolt.net.ua
lookingglassemb.com message-warning.net
lrac.info mixx.com
mac-shield.com mobioffertrck.com
macnewtech.com monsterdivx.tv
magicalfind-a.akamaihd.net mrbitsandbytes.com
maju.bluesalt.co musicdaddy.net
matsdale.com musirc.com
meccadumps.net mydownloadengine.com
medizinreisen.de na15.ru
metalonly.info namecrumilchlet.tk
mini-modus.ru netfacet.net
mir-business-24.ru nhl17coins.exblog.jp
mistr-x.org novodigs.com
mitrasound.ru nudepatch.net
mobifunapp.weebly.com o.light.d0t.ru
moroccosurfadventures.com obesidadealgarve.com
mossmesi.com olvanto.ru
moyakuhnia.ru onclkads.com
mp3ritm.top onko-24.com
mriyadh.com openmultipleurl.com
musezone.ru
mydeathspace.com
myra.top
nalogovyykodeks.ru
netoil.no
nikitabuch.com
nl.netlog.com
nofreezingmac.work
nordstar.pro
nottyu.xyz
november-lax.com
obnal.org
onemactrckr.com
online247.ml
oralsexfilme.net
origin-my.ru origin-my.ru
oynat.info orion-v.com
palvira.com.ua pandroid.co
parfusale.se partnerads.men
partnerworkroom.men partnerworkroom.men
perfectpracticeweb.com pinup-casino1.ru
perosan.com pixelrz.com
phelissota.xyz placid-rounded-coast.glitch.me
piccshare.com playboyfiles.xblog.in
picscout.com plohaya-kreditnaya-istoriya.ru
piratecams.com poems.com.ua
plusnetwork.com popmarker.com
pogodnyyeavarii.gq poquoson.org
pornokorol.com pornstartits.xblog.in
pornoslive.net prostitutki-almata.org
portal-eu.ru proxyelite.biz
pp-budpostach.com.ua psoriasis-file.trade
predmety.in.ua pst2017.onlinewebshop.net
printdirectforless.com purplesphere.in
privatbank46.ru razyboard.com
prosperent.com relayblog.com
q-moto.ru remont-comp-pomosh.ru
quebec-bin.com rique.host.sk
quit-smoking.ga rusenvironmental.net
ranksays.com sabizonline.com
reklamuss.ru sarm.tk
remont-mobile-phones.ru scanner-alexa.top
remote-dba.de scanner-margo.top
rethinkwasteni.info scanner-walt.top
rockingclicks.com search.pch.com
rootandroid.org sel-hoz.com
s-forum.biz seozoom.it
samolet.fr serw.clicksor.com
sashagreyblog.ga shinikiev.com.ua
scalerite.co.za shtaketniki.ru
segol.tv site-analyzer.com
semalt.com sitiz.club
sextracker.be sklad-24.ru
sherlock.se smartshoppymac.com
shoplvlv.us smokewithrabbits.com
shoppingjequiti.com.br snomer1.ru
shopvilleroyboch.com.ua socialmadesimple.com
sibdevice.ru sonata-arctica.wz.cz
sideeffectsoftizanidine.blogspot.com soserfis.com
sitebeam.net sovinsteel.ru
sitevaluation.com sportbetfair.com
skytraf.xyz ssconstruction.co
slavic-magic.ru stanthonyscatholicchurch.org
sotkal.lark.ru strag-invest.ru
sport7777.net stretchingabuckblog.com
stroy-portal22.ru strongsignal-a.akamaihd.net
sudexpert66.ru sukarame.net
superkanpo.com supermodni.com.ua
swinginwithme.ru supers.com.ua
tackletarts.co swsociety.se
thenetinfo.com td-33.ru
thetoiletpaper.com teenforporn.com
torrentred.games teguh.info
toyota.7zap.com telefonsex-ohne0900.net
trafficmania.com telemetryverification.net
traffique.net thepornsex.org
trailer.cinemaflix.website tizanidine4mg.blogspot.com
tuberkuleznik.ru tizanidine4mguses.blogspot.com
turbo-suslik.org tizanidinecost.blogspot.com
twittrading.com tizanidineingredients.blogspot.com
udsgame.online tizanidinepain.blogspot.com
unionmarkt.de topsy.com
uprour.com trion.od.ua
utrolive.ru try-rx.com
valmetrundan.se tversvet.ru
viagra-soft.ru uac.net.au
videokrik.net urlopener.com
videosbox.ru vacuumcleanerguru.com
vip-dom.in videonsk.com
vksex.ru videositename.com
volgograd.xrus.org vipps.com.my
voprosotvet24.ru visa-pasport.ru
vsdshnik.com vote-up.ru
warezkeeper.com vpnhowto.info
wdfdocando.com waterefficiency.co
wejdz-tu.pl webkeyit.com
westen-v.life webs.com
wildnatureimages.com website-analytics.online
writingservices17.blogspot.ru websites-reviews.com
www.labves.ru westermarkanjou.se
xjlottery.com while.cheapwebsitehoster.com
xn----btbdvdh4aafrfciljm6k.xn--p1ai whiteelephantwellington.com
xn--80aanaardaperhcem4a6i.com wholesalecheapjerseysfree.com
xn--80ahdheogk5l.xn--p1ai witherrom55.eklablog.fr
xxx-cam.webcam womens-journal.net
zaloadi.ru www.arenda-yeisk.ru
zoompegs.com xep.info
xgames-04.com
xkaz.org
xn-----7kceclhb4abre1b4a0ccl2fxch1a.xn--p1ai
xn----8sbarihbihxpxqgaf0g1e.xn--80adxhks
xn----9sbebi2bvzr7h.xn--p1ai
xuki.us
ynymnwbm.bloger.index.hr
yubikk.info
yun56.co
zero1.it
zscalerone.net

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.162 0; 10.1.0.123 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.11.3501 ### Version: V4.2022.12.3502
### Updated: Wed Nov 30 10:03:29 UTC 2022 ### Updated: Thu Dec 1 22:01:29 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.11.3501 ### Version: V4.2022.12.3502
### Updated: Wed Nov 30 10:03:29 UTC 2022 ### Updated: Thu Dec 1 22:01:29 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##