vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-10 15:34:24 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2022.02.2929 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2022-02-19 22:07:23 +00:00
parent 71c2c2326e
commit 98099ca097
46 changed files with 94757 additions and 94757 deletions
Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.02.2928 #### Version: V4.2022.02.2929
#### Bad Referrers Blocked: [7090](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7090](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [636](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [636](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.02.2928 #### Version: V4.2022.02.2929
#### Bad Referrers Blocked: [7090](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7090](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [636](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [636](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -13,7 +13,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2022.02.2928 #### Version: V4.2022.02.2929
#### Bad Referrers Blocked: [7090](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7090](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [636](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [636](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

11708
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2022.02.2928 #### Version: V4.2022.02.2929
#### Bad Referrers Blocked: [7090](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7090](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [636](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [636](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

11712
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

11712
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

11712
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

11712
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.58 1; 10.1.1.36 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.58 0; 10.1.1.36 0;
127.0.0.1 0; 127.0.0.1 0;

11712
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.58 1; 10.1.1.36 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.58 0; 10.1.1.36 0;
127.0.0.1 0; 127.0.0.1 0;

11712
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.58 1; 10.1.1.36 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.58 0; 10.1.1.36 0;
127.0.0.1 0; 127.0.0.1 0;

11712
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
2928 2929

11712
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

11712
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.106.166.22 0; 52.146.42.201 0;

11712
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.58 1; 10.1.1.36 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.58 0; 10.1.1.36 0;
127.0.0.1 0; 127.0.0.1 0;

11712
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.58 1; 10.1.1.36 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.58 0; 10.1.1.36 0;
127.0.0.1 0; 127.0.0.1 0;

11712
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.58 1; 10.1.1.36 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.58 0; 10.1.1.36 0;
127.0.0.1 0; 127.0.0.1 0;

11712
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.106.166.22 0; 52.146.42.201 0;

11712
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.106.166.22 0; 52.146.42.201 0;

11712
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.58 1; 10.1.1.36 1;
127.0.0.1 1; 127.0.0.1 1;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
AhrefsBot Dispatch
Apexoo InternetSeer
ExtractorPro Litemage_walker
GrabNet Magnet
LinqiaScrapeBot Masscan
PeoplePal Nettrack
RankingBot Pixray
SalesIntelligent SputnikBot
Wallpapers Suzuran
WebCollage WiseGuys Robot

310
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
01h4x.com
360Spider 360Spider
80legs 80legs
ADmantX
AIBOT AIBOT
Abonti
Aboundexbot
Acunetix Acunetix
AfD-Verbotsverfahren
Aipbot
AllSubmitter AllSubmitter
Alligator AlphaBot
Anarchie Anarchy
Anarchy99
Anthill Anthill
Apexoo Apexoo
BDCbot Asterias
BacklinkCrawler Atomseobot
AwarioRssBot
BBBike
BLEXBot
BackStreet
BackWeb
Bandit Bandit
BatchFTP Barkrowler
Battleztar Bazinga
Black Hole Black Hole
BlackWidow Blackboard
Blow Boardreader
BlowFish BuiltWith
Bolt
Brandprotect
Brandwatch
Buck
Bullseye Bullseye
BunnySlippers
CATExplorador
CCBot CCBot
CODE87
CSHttp
Calculon
Cegbfeieh Cegbfeieh
CensysInspect CensysInspect
CheeseBot CheeseBot
CherryPicker CherryPicker
ChinaClaw Chlooe
Cocolyzebot Citoid
Cogentbot Copier
Collector Copyscape
Craftbot Cosmos
Crawling at Home Project CrazyWebCrawler
Crescent Crescent
CyotekWebCopy
DSearch DSearch
DTS Agent DTS Agent
DataCha0s DataCha0s
DigitalPebble Demon
DnyzBot Devil
DomainCrawler Digincore
DomainSigmaCrawler Discobot
Dotbot Dispatch
EMail Wolf DittoSpyder
DomainStatsBot
ECCP/1.0
EasyDL EasyDL
EirGrabber EirGrabber
EroCrawler EroCrawler
Evil Evil
Exabot
Extractor Extractor
ExtractorPro
Extreme Picture Finder Extreme Picture Finder
EyeNetIE Ezooms
FDM FHscan
Freeuploader FlashGet
FrontPage Foobot
GT::WWW
GermCrawler GermCrawler
GetWeb GetWeb
Go!Zilla GrabNet
GrapeFX GrapeFX
GrapeshotCrawler GridBot
HTMLparser
HTTP::Lite HTTP::Lite
HaosouSpider Haansoft
Harvest Harvest
HybridBot Hloader
IDBTE4M HonoluluBot
IDBot IRLbot
InfoTekies Id-search
InterGET InfoNaviRobot
InternetSeer
Iskanie Iskanie
JamesBOT JOC Web Spider
JetCar Jbrofuzz
JikeSpider Joomla
Jyxobot
Kenjin Spider Kenjin Spider
Keyword Density Kozmosbot
Kinza LWP::Simple
LNSpiderguy
Lanshanbot Lanshanbot
Larbin Larbin
LeechFTP LeechGet
LibWeb Lftp
Libwhisker
LieBaoFast
Likse Likse
Linkdexbot
LinqiaMetadataDownloaderBot LinqiaMetadataDownloaderBot
Litemage_walker LinqiaScrapeBot
Lipperhey Spider
MFC_Tear_Sample
MIDown tool MIDown tool
MJ12bot MJ12bot
MSFrontPage MQQBrowser
MSIECrawler MTRobot
Mag-Net Majestic SEO
Magnet Majestic-SEO
Mail.RU_Bot
Mass Downloader Mass Downloader
Meanpathbot Masscan
MeanPath Bot
MegaIndex.ru
Microsoft URL Control Microsoft URL Control
Moblie Safari Minefield
MolokaiBot Mojeek
Morfeus Fucking Scanner Mojolicious
Mozlila
NICErsPRO NICErsPRO
NPbot Nameprotect
NearSite Navroad
Nessus Needle
Net Vampire Netcraft
NetAnts Nibbler
NetLyzer
NetMechanic
NetZIP
Niki-bot Niki-bot
NimbleCrawler NimbleCrawler
Ninja
Nmap Nmap
Not Not
Nuclei
Octopus Octopus
Offline Navigator Offline Navigator
OpenLinkProfiler OpenLinkProfiler
OpenVAS Openvas
OrangeBot OrangeSpider
OutclicksBot OutclicksBot
POE-Component-Client-HTTP POE-Component-Client-HTTP
Page Analyzer PageAnalyzer
PageScorer PageScorer
Picsearch Pandalytics
Pavuk
PeoplePal
Petalbot
PictureFinder PictureFinder
Piepmatz Piepmatz
PleaseCrawl ProPowerBot
Probethenet Probethenet
RankActiveLinkBot Psbot
RankFlex Pu_iN
Pump
PxBroker
Quick-Crawler
RankingBot
RankingBot2
RankurBot RankurBot
Re-re Re-re
ReGet
Reaper Reaper
Recorder RepoMonkey
Ripper Ripper
RocketCrawler
Rogerbot Rogerbot
SBIder SBIder
SEOkicks
SEOstats SEOstats
SISTRIX SalesIntelligent
SMTBot Scanbot
Screaming Scrapy
ScreenerBot ScrepyBot
Searchestate SearchmetricsBot
Shodan Shodan
Siphon Siphon
SiteLockSpider Site Sucker
Sitebeam SiteCheckerBotCrawler
Siteimprove SiteExplorer
Sitevigil Sitevigil
Snapbot
Snoopy Snoopy
SocialRankIOBot
Sogou web spider
Sosospider Sosospider
Sottopop Sottopop
SpaceBison
Spammen Spammen
Sqlmap SpankBot
Sqlworm Sqlworm
Sucker Steeler
SuperBot Stripper
SuperHTTP Sucuri
SurveyBot
Suzuran
Swiftbot Swiftbot
Szukacz Szukacz
TeleportPro T0PHackTeam
Telesoft
The Intraformant
TheNomad
Thumbor Thumbor
TightTwatBot Titan
Toata Toata
Trendictionbot Toweyabot
Tracemyfile
True_Robot
Turingos Turingos
Turnitin
TwengaBot
Twice Twice
URLy.Warning Typhoeus
VCI URLy Warning
VB Project
Vacuum Vacuum
Vagabondo VelenPublicWebCrawler
Voltron VeriCiteCrawler
WWW-Collector-E VidibleScraper
Virusdie
WASALive-Bot
WEBDAV
WISENutbot
WWW::Mechanize WWW::Mechanize
Wallpapers WallpapersHD
Wallpapers/3.0 Web Collage
WeSEE Web Fetch
Web Auto Web Pix
Web Sauger
Web Sucker Web Sucker
WebCollage WebCollage
WebCopier WebCopier
WebEnhancer WebFuck
WebGo IS
WebLeacher WebLeacher
WebReaper WebStripper
WebSucker
WebWhacker WebWhacker
Webshag WebZIP
WebsiteExtractor WebsiteExtractor
Whack WebsiteQuester
Who.is Bot Whacker
WinHTTrack
WiseGuys Robot
Woobot
Wotbox
Wprecon Wprecon
Xaldon WebSpider Xaldon WebSpider
Xaldon_WebSpider YoudaoBot
Zade ZmEu
Zauba
Zermelo
Zeus
Zitebot
ZoomBot ZoomBot
arquivo.pt adscanner
com.plumanalytics archive.org_bot
cah.io.community
clark-crawler
cognitiveseo
crawl.sogou.com crawl.sogou.com
crawler.feedback
domainsproject.org
eCatch
evc-batch
facebookscraper
gopher
heritrix heritrix
instabid instabid
ips-agent lwp-request
iubenda-radar magpie-crawler
mediawords mediawords
muhstik-scan page scorer
plumanalytics probe-image-size
polaris version s1z.ru
satoristudio.net
seobility
seocompany.store seocompany.store
serpstatbot seostar
sexsearcher sitechecker.pro
siteripz sogouspider
trendiction.com sp_auditbot
trendiction.de ubermetrics-technologies.com
voyagerx.com
webgains-bot webgains-bot
webmeup-crawler webmeup-crawler
x22Mozilla webpros.com
x09Mozilla
xpymep1.exe xpymep1.exe
zauba.io zauba.io
zgrab

318
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
01h4x.com 01h4x.com
404checker 404checker
80legs 404enemy
ADmantX Aboundex
AIBOT Aipbot
ALittle Client Anarchy99
ASPSeek Anthill
AfD-Verbotsverfahren
AhrefsBot
Anarchie
Anarchy
Apexoo Apexoo
Aspiegel
Asterias
Atomseobot Atomseobot
Attach
AwarioRssBot AwarioRssBot
AwarioSmartBot AwarioSmartBot
BBBike BBBike
BackDoorBot BackDoorBot
BackStreet BackStreet
Backlink-Ceck BackWeb
BacklinkCrawler
Badass
Bandit
Barkrowler Barkrowler
BatchFTP Battleztar Bazinga
BetaBot Black Hole
Bitacle BlackWidow
Blackboard
BlowFish
Boardreader Boardreader
BotALot
Brandprotect
Brandwatch Brandwatch
Buck
Buddy Buddy
BuiltBotTough BuiltBotTough
BunnySlippers Bullseye
CATExplorador
CCBot CCBot
CODE87
CSHttp
Calculon Calculon
CensysInspect CensysInspect
CheTeam CheTeam
Chlooe Chlooe
Citoid
Claritybot Claritybot
Cliqzbot Craftbot
Collector Custo
Copier DSearch
CopyRightCheck Dirbuster
Copyscape Discobot
Cosmos DittoSpyder
CrazyWebCrawler
Curious
DataCha0s
DatabaseDriverMysqli
Demon
Digincore
DigitalPebble
Disco
DnBCrawler-Analytics DnBCrawler-Analytics
DnyzBot DnyzBot
DomainAppender
DomainSigmaCrawler
DomainStatsBot DomainStatsBot
Domains Project Domains Project
Download Wonder Dotbot
Dragonfly
ECCP/1.0
EMail Siphon EMail Siphon
Ebingbong Ebingbong
Ecxi EroCrawler
Evil
Extreme Picture Finder
EyeNetIE EyeNetIE
FemtosearchBot Ezooms
Fimap FHscan
Flunky
Foobot Foobot
Freeuploader Fyrebot
FrontPage GT::WWW
GalaxyBot GalaxyBot
Genieo
GermCrawler GermCrawler
GetRight GetRight
Gigabot Gigabot
Go!Zilla Go!Zilla
Grabber GoZilla
Gotit
Grafula Grafula
HMView GrapeFX
HTMLparser
HaosouSpider
Harvest Harvest
Havij
Heritrix Heritrix
HonoluluBot Hloader
IDBTE4M IDBTE4M
IRLbot IDBot
Id-search
IlseBot IlseBot
Image Sucker Image Fetch
IndeedBot IndeedBot
Indy Library InfoTekies
Intelliseek InterGET
Iria
IstellaBot
JOC Web Spider
JamesBOT
Jbrofuzz Jbrofuzz
JennyBot Jetty
Joomla Joomla
Jorgee Jorgee
Jyxobot JustView
Kenjin Spider
Keyword Density Keyword Density
LNSpiderguy LNSpiderguy
Larbin
Leap
LeechGet LeechGet
LexiBot LibWeb
Libwhisker Libwhisker
Linkbot LinkWalker
Linkdexbot Linkdexbot
LinkpadBot LinqiaMetadataDownloaderBot
MIDown tool Litemage_walker
MIIxpc Lmspider
Ltx71
MFC_Tear_Sample
MQQBrowser MQQBrowser
MSFrontPage MSFrontPage
Mag-Net MTRobot
Magnet MarkMonitor
Mail.RU_Bot MarkWatch
Majestic-SEO Masscan
Mass Downloader Mata Hari
MauiBot MauiBot
Mb2345Browser MegaIndex.ru
Meanpathbot Metauri
Microsoft Data Access
Microsoft URL Control Microsoft URL Control
Minefield
Moblie Safari Moblie Safari
MolokaiBot Mojolicious
Morfeus Fucking Scanner Morfeus Fucking Scanner
Needle Mozlila
Nessus Musobot
Net Vampire Nameprotect
NearSite
NetAnts NetAnts
NetSpider NetLyzer
Netvibes
NextGenSearchBot NextGenSearchBot
Nibbler Niki-bot
Nikto Nimbostratus
NimbleCrawler Nutch
Not Offline Explorer
Nuclei Openvas
Octopus PHPCrawl
Offline Navigator PageAnalyzer
OnCrawl PageScorer
OpenVAS
Openfind
OrangeBot
OrangeSpider
OutfoxBot
POE-Component-Client-HTTP
PageGrabber
PageThing.com
Pandalytics Pandalytics
Panscient
PeoplePal
Pi-Monster Pi-Monster
Pimonster PictureFinder
Pixray Pu_iN
PleaseCrawl Pump
Pockey PxBroker
ProWebWalker PyCurl
QueryN Metasearch RankActive
RankActiveLinkBot RankFlex
Reaper RankingBot2
SISTRIX Re-re
RebelMouse
Recorder
RocketCrawler
SEOlyticsCrawler
SEOprofiler
SMTBot
ScreenerBot
ScrepyBot ScrepyBot
Seekport Seekport
SemanticJuice SemanticJuice
Semrush Semrush
SemrushBot Shodan
SeobilityBot Site Sucker
Seomoz
SiteSnagger SiteSnagger
SiteSucker
Sitebeam Sitebeam
Siteimprove Sitevigil
Snapbot SlySearch
Snake
Snoopy Snoopy
SocialRankIOBot
Sociscraper Sociscraper
Sogou web spider SpaceBison
Sottopop SpankBot
Sqlworm Sqlworm
Stripper
Sucker Sucker
Sucuri
Surfbot
Szukacz Szukacz
T0PHackTeam
Teleport Teleport
TeleportPro
Telesoft Telesoft
Telesphorep
TheNomad
Thumbor
TightTwatBot
Titan Titan
Toweyabot Toata
Tracemyfile Turingos
Trendiction Turnitin
TurnitinBot TurnitinBot
Typhoeus TwengaBot
URLy Warning Twice
URLy.Warning UnisterBot
V-BOT Upflow
VB Project VB Project
VCI
Vacuum Vacuum
VelenPublicWebCrawler
VeriCiteCrawler VeriCiteCrawler
VidibleScraper VidibleScraper
VoidEYE VoidEYE
Voltron
WASALive-Bot
WBSearchBot WBSearchBot
WISENutbot
WWW-Collector-E WWW-Collector-E
WWW-Mechanize
Wallpapers/3.0 Wallpapers/3.0
WallpapersHD Web Auto
WeSEE
Web Fetch Web Fetch
Web Sauger Web Pix
WebAuto WebAuto
WebFuck WebBandit
WebGo IS WebCollage
WebImageCollector WebFetch
WebLeacher WebReaper
WebPix WebSauger
WebmasterWorldForumBot WebWhacker
WebsiteExtractor Webshag
Website Quester
WebsiteQuester
Whatweb
Widow Widow
Wonderbot WinHTTrack
Xenu Woobot
Zade Wotbox
Zauba Wprecon
YoudaoBot
Zermelo Zermelo
Zitebot ZmEu
ZoominfoBot
ZumBot ZumBot
ZyBorg arquivo.pt
archive.org_bot
backlink-check
cah.io.community cah.io.community
clark-crawler check1.exe
cognitiveseo coccocbot-web
demandbase-bot com.plumanalytics
domainsproject.org crawler4j
magpie-crawler eCatch
meanpathbot heritrix
ips-agent
lwp-trivial
muhstik-scan muhstik-scan
oBot
page scorer
pcBrowser pcBrowser
scalaj-http probe-image-size
scan.lol ripz
seobility seocompany.store
seoscanners seoscanners
siteripz seostar
sexsearcher
tAkeOut
trendiction.com trendiction.com
trendiction.de webgains-bot
webpros.com webmeup-crawler
webprosbot webprosbot
xpymep1.exe x09Mozilla
zauba.io x22Mozilla
zgrab

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
carloans.com animal-drawings.com
compliance-george.xyz asscenihotosidea.blogspot.co.za
corta.co ezigarettenkaufen1.deviantart.com
customcollegeessays.net freshsuperbloop.com
gallerylisting.com investingclub.ru
ihc2015.info mahnwachen-helfen.info
koopilka.com rada.ru
pooleroadmedicalcentre.co.uk rangjued.com
sbtdesign.co.uk strfls.com
theporndude.com zygophyceous.womanstars.site

926
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
0n-line.tv 00go.com
1008.su 03e.info
123cha.com 1-free-share-buttons.com
12u.info 101lesbian.xyz
13tabs.com 10bet.com
1qingdao.com 11pikachu.ru
1webmaster.ml 12bet.com
2daytrendingnews.com 2ads.co.uk
3dracergames.com 3-letter-domains.net
4ur.click 300richmond.co.nz
6128786.com 45en.ru
6hopping.com
70casino.online 70casino.online
a1security.com.ua 7fon.ru
aa8780bb28a1de4eb5bff33c28a218a930.com 7wind.ru
aab94f698f36684c5a852a2ef272e031bb.com 8558l.jobs.net
acmebtn.ml DomainStatsBot
actices.com aaa38852e886ac4af1a3cff9b47cab6272.com
activecampaign.dreamhosters.com abctoppictures.net
adf.ly acads.net
adanih.com
add-add.men
adhome.biz adhome.biz
adnotbad.com adman.se
ads.tremorhub.com adsland.men
adtech.de advertex.info
adtech.us affiliate-fr.com
adultgalls.com afftrack001.com
adventureparkcostarica.com agahinameh.com
adverster.com agecheckadult.com
aerogo.com akama.com
aksonural.ru akvamaster.dp.ua
ald2014.org alevinefesleri.com
alessandraleone.com
alienwheel.es alienwheel.es
alive-ua.com allwidewallpapers.com
allbizne.co.ua
allwomen.info allwomen.info
am-se.com amyfoxfitness.com
amazingninja.com android-systems.ru
ampower.me animal-drawings.com
android4fun.org animal36.com
androids-store.com appearance-cool.com
angkortours.vn appfixing.space
anlimebel.kiev.ua applicationg29.com
antons-transporte.de approved.su
apccargo.com arcadeplayhouse.com
apiportalmorecom-a.akamaihd.net artparquet.ru
appartement-stumm.at asrvvv-a.akamaihd.net
arcteryxstore.online atout-energie-69.com
arenda-yeisk.ru auspolice.com
arendatora.ru
arquivo.pt
as5000.com
asscenihotosidea.blogspot.com
atlant-auto.info
ausergrubhof.info
autorn.ru autorn.ru
aviav.ru.com avirasecureserver.com
avon-ukraine.com awaybird.ru
b2b-lounge.com ayodhya.co
back.dog azarttoto.com
balans.shahterworld.org azbukadiets.ru
beauby.ru backiee.com
best-deals-products.com bangla-chat-uk-paralud.ga
best-seo-solution.com bazaronline24.ru
bestbuy.ca bestchoice.cf
bestmarriages.com bestprofits-there.com
bestwebsiteawards.com bestwebsiteawards.com
bet-prognoz.com bezcmexa.ru
beta.hotkeys.com
bfz.biz bfz.biz
bgviagrachrx.com bharatdefencekavach.com
bidr.trellian.com
bigames.online bigames.online
bimatoprost-careprost.com.ua bigcareer.info
bingoporno.com bio-optomarket.ru
blockety.co bitcoins-live.ru
bloglag.com bjorkbacken.nu
boobsimge.com blog.axant.it
blog.yam.com
bloggers.nl
bmw-ark.ru
bonanza-fortune.men
bonzbuddy.com
book-bets.com
bookmaker-bet.com bookmaker-bet.com
boostmyppc.com bookmark4you.com
bosefux.esy.es brainboostingsupplements.org
bouda.kvalitne.cz brains2.biz
brillianty.info brandbucket.com
bristolhotel.com brus-vsem.ru
bumskontakte.org bumble.cheapwebsitehoster.com
buy-cheap-online.info businescoop.men
bzero1jewelry.net buy-forum.ru
callstevens.com buypanicdisorderpill.com
buyparajumpers.online
buypuppies.ca
candelluxsklep.pl candelluxsklep.pl
candycrushshop.com canrioloadm.gq
cardul.ru cashkitten-a.akamaihd.net
carstrends2015.com cb.iphantom.com
cartierlovestore.xyz cdn.walkme.com
cctva.tv cejewelry.xyz
centre-indigo.org.ua cercacamion.it
cgi2.nintendo.co.jp cerev.info
cheapjerseysap.com charmstroy.info
cheapmoncler.pw cheapwebsitehoster.com
checkm8.com cherubinimobili.it
cherrypointplace.ca chocolateslim-original.com
children-learningreading.info ciekawinki.pl
christianlouboutinsaleoutletonline.us classiquebijoux.ru
cinemaflix.website cleanallspyware.com
clevernt.com cleanmypc.com
clickaider.com clippingphotoindia.com
club-samodelkin.ru cobaltpro.ru
cocolyze.com codq.info
compliance-barak.top compliance-alexa.top
compliance-brian.xyz compliance-fred.xyz
compliance-elena.xyz compliance-ivan.top
compliance-jessica.top compliance-jessica.top
construmac.com.mx compliance-walt.top
cornerstone-countertops.com comsysnet.com
cowlmash.com confib.ifmo.ru
cpabegins.ru coolgamechannel.com
cracksplanet.com coolwallpapers-hd.com
cranly.net copro.pw
credit-online.ws
creditwell.ru creditwell.ru
csgo4.win custodieva.ru
cyse.tk cvety24.by
dafatiri.com damasarenai.info
data1.scopich.com danashop.ru
dating-time-now.com dealwifi.com
deadlinkchecker.com dev33.dioniqlabb.se
defenderxtactical.com dev78.dioniqlabb.se
demian.kz dichvuvesinhhanoi.com
depositfiles-porn.ga dignitasdata.se
dipstar.org docs4all.com
directrev.com domain-tracker.com
dktr.ru domaineaneblanc.com
dkvorota.ru domashneeruporno.com
doctissimo.fr download-of-the-warez.blogspot.com
dollartree.info dptaughtme.com
domini.cat dustyorate.com
downloader12.ru dvd-famille.com
downloadme.life dvr.biz.ua
dyshagi.ru earl-brown.info
e-commerce-seo.com easyukraine.com
econom.co ekn-art.se
ecookna.com.ua el-nation.com
edudocs.net election.interferencer.ru
ekaterinburg.xrus.org elektrischezigarette1.blog.pl
elektrozigaretten1.postbit.com elektronischezigarettekaufen1.myblog.de
elmifarhangi.com elstal.com.pl
eloconcream.blogspot.com eluxer.net
enge-fotzen.info empis.magix.net
englate.com eng-lyrics.com
este-line.com.ua enskedesquashclub.se
ewebarticle.info eropornosex.ru
exhibitionplus.eu europages.com.ru
ezofest.sk euroskat.ru
f5mtrack.com evrotekhservis.ru
fashion-stickers.ru excaliburfilms.com
fealq.com exchangeit.gq
fetishinside.com extractorandburner.com
fickkontakte.org extstat.com
filerockstar298.weebly.com ezigarettenshop2.postbit.com
filmgo.ru fanpagerobot.com
findanysex.com fastcrawl.com
finteks.ru ff30236ddef1465f88547e760973d70a.com
fitnesspiks.com filesmonster.porn
food.dtu.dk filmania-x.ru
forsex.info filmci.pro
fortwosmartcar.pw filmfanatic.com
findpics.pw
finuse.com
firesub.pl
floating-share-buttons.com
forum20.smailik.org forum20.smailik.org
fototravel.eu forum69.info
frankofficial.ru foxydeal.com
franch.info
free-laptop-reward.com free-laptop-reward.com
freewebs.com freenode.info
frighteningremain.cf freeseedsonline.com
gael-s.ru freshwallpapers.info
galaxyflowers.ru front.to
gamedayhouse.com frustrated-favorable.gq
fuckingawesome.com
fungamelands.com
fusoradio.info
gameplexcity.com gameplexcity.com
gameprimary.com gamezblox.com
gdzkurokam.ru gay.adultgalls.com
gearcraft.us gaypornmovie.net
gemara.com
gfaq.ru
gidonline.one
gigixo.com gigixo.com
glopages.ru glicol.kz
gne8.com goblacked.com
gogalleryawesome.com goodhousekeeping.com
golmau.host.sk gsasearchengineranker.top
goodwriterssales.com
gopro-online.info
gorabagrata.ru
grizzlysgrill.com
gsou.cf gsou.cf
guidefs.ru gwagka.com
gunsvicceadadebt.tk hayate.biz
h2monline.com hdfreeporno.net
handicapvansarea.com hledejvshopech.cz
hanwei.us homedecoguide.info
haveinc.xyz
hermesbelts.xyz
himazin.info
hiwibyh.bugs3.com
hobild.net
home.myplaycity.com
homik.pw homik.pw
host-protection.com
hostnow.men
hotdl.in
hotel-mkad.ru hotel-mkad.ru
hotenergy.ru hotgirlhdwallpaper.com
hotkeys.com hotloans.ru
housediz.com houseofrose.com
houseofgaga.ru hptwaakw.blog.fc2.com
hoverboard360.de hustoon.over-blog.com
hoverboard360.nl i-service.kz
howopen.ru iblogpress.xyz
iboss.com igrovyeavtomaty777.ru
idealtits.net ilikevitaly.com
iklysha.ml imagez.co
ilbe.club imgarit.pw
ilovevitaly.xyz imitex-plus.ru
imediadesk.com imk.com.ua
imperiafilm.ru imperiafilm.ru
incomekey.net inet-traffic.com
inmate-locator.us infobanks.ru
insomniagamingfestival.com insomniagamingfestival.com
interesnie-faktu.ru interior-stickers.ru
intim-uslugi.info io9.com
intimshop-fantasy.ru
iomoio.net
ip-guide.com ip-guide.com
iscblog.info iplogger.org
islandminingsupply.wordpress.com iqbazar.ru
ispaniya-costa-blanca.ru ivoiretechnocom.ci
itbc.kiev.ua iweblist.info
izhevsk.xrus.org ixora.pro
izismile.com janavibekken.no
jav-idol.com janettabridal.com
jmat.cn jav-fetish.com
journeydownthescale.info joingames.org
karpun-iris.ru justdating.online
kenaba.su jwcialislrt.com
keywordspay.com karadene.com
kiinomaniak.pl keywordsdoctor.com
kinogonew.ru kinohit1.ru
kinostorm.net kiprinform.com
kletkimehan.ru kleine-titten.biz
klikbonus.com klosetkitten.com
klumba55.ru knowyournextmove.com
kochanelli.com kongruan.com
kolotiloff.ru konkursov.net
krasnodar-avtolombards.ru kupit-adenu.ru
kskjco.club kutikomi.net
laexotic.com lacasamorett.com
landinez.co landreferat.ru
laxob.com letslowbefast.site
lechtaczka.net lezbiyanki.net
lidoradio.com lider-zhaluzi.kiev.ua
liffa.ru liffa.ru
linerdrilling.com likesdesign.com
linkbolic.com lion.bolegapakistan.com
linkbux.ru littleberry.ru
linkredirect.biz live-sexchat.ru
linkrr.com liveinternet.ru
lion.misba.us locimge.pw
liquimondo.com loftdigital.eu
live-cam6.info lollypopgaming.com
livetsomudvekslingstudent.bloggersdelight.dk
lob.com.ru
longadventure.com longadventure.com
longlifelomilomi.info louboutinbooties.xyz
lost-alpha.ru m4ever.net
mail.allnews24.in mafcards.ru
manuscript.su mainlinehobby.net
map028.com maladot.com
marcoislandvacations.net mall.uk
marketingtechniques.info manve.info
marketland.ml manyresultshub-a.akamaihd.net
marwer.info meendo-free-traffic.ga
mature.free-websites.com mesto-x.com
mebel-vstroika.ru
megaapteka.ru
metalonly.info
meteostate.com meteostate.com
mixtapetorrent.com mikozstop.com
mnogolok.info mindbox.co.za
modnie-futbolki.net minet.club
moesexy.com missclub.info
mompussy.net mockupui.com
modenamebel.ru
moivestiy.biz
monclerjacketsoutlet.pw
moncleroutletonline.pw moncleroutletonline.pw
moneymaster.ru moncleroutletonline.win
moneyzzz.ru
montredemarque.nl
moscow.online-podarki.com
moscow.xrus.org moscow.xrus.org
mrmoneymustache.com mosdverka.ru
most.gov.iq
mowser.com
moxo.com
mrlmedia.net
msfsaar.de
muizre.ru muizre.ru
mundoaberrante.com musezone.ru
music.utrolive.ru myyour.eu
mwtpludn.review naturalpharm.com.ua
mxgetcode.com naturtreenspicerx.pw
my-cash-bot.co negral.pluto.ro
mydirtystuff.com net-profits.xyz
mydownloadengine.com netanalytics.xyz
myfreemp3.eu newfilmsonline.ru
myhydros.org newtechspb.ru
myindospace.com nhl09.ru
myliveblog.ru nordvpn.com
mzdish.site
naj-filmy24.pl
narkologiya-peterburg.ru
natali-forex.com
nbsproject.ru
networkad.net
nibbler.silktide.com
nicovideo.jp
nina.az
noumeda.com
novodigs.com
nrjmobile.fr nrjmobile.fr
nudo.ca oconto.ru
o-o-6-o-o.ru onblastblog.online
obiavo.in onclickpredictiv.com
oecnhs.info online-zaymy.ru
officedocuments.net openmultipleurl.com
offside2.5v.pl orsonet.ru
offtime.ru osnova3.ru
okayimage.com ourville.info
oktube.ru partner-trustworthy.men
one.net.in peekyou.com
online-podarki.com pestomou.info
oranga.host.sk petsblogroll.com
outshop.ru photochki.com
paccohichetoti.ml pictures-and-images.net
paighambot.com play.leadzupc.com
pandarastore.top ploenjitmedia.azurewebsites.net
paparazzistudios.com.au plugingeorgia.com
paramountmarble.co.uk pogruztehnik.ru
partner-high.men pokemon-go-play.online
partnerline.men popugauka.ru
partnersafe.men porndroids.com
pattersonsweb.com porngalleries.top
pawli.eu pornoted.com
pcgroup.com.uy portside.xyz
pepperstyle.ru powenlite24.ru
petrovka-online.com pregnant.guru
peugeot-club.org preventheadacheguide.info
pewit.pw princeadvantagesales.com
phormchina.com privhosting.com
picture-group.com prizestohandle.club
pix-hd.com
pk-services.ru
pl-vouchers.com
play-mp3.com
playfortuna-play.ru
plohaya-kreditnaya-istoriya.ru
pochtovyi-index.ru
pod-muzyku.club
polytopesexempt.com
pornoforadult.com
pornotubexxx.name
portadd.men
prchecker.info
preconnubial.usuby.site
producm.ru
produkto.net
projectforte.ru projectforte.ru
proxyradar.com prostitutki-kiev.org
pukaporn.com questionmarque.ch
pussysaga.com quickbuck.com
puzo2arbuza.ru rankexperience.com
pyramidlitho.webs.com rankings-analytics.com
qld10000.net ranksignals.com
quick-seeker.com rcb101.ru
qwesa.ru rczhan.com
rcpmda.ikan1080.xyz rebuildermedical.com
realnye-otzyvy.info redirectingat.com
remont-comp-pomosh.ru refudiatethissarah.info
rocis.site registry-clean-up.net
roma-kukareku.livejournal.com remont-komputerov-notebook.ru
royal-investments.net remontvsamare.su
saletool.ru replicaclub.ru
sawin.beth.webd.pl research.ifmo.ru
sbtdesign.co.uk resellerclub.com
scanner-jess.top rethinkwasteni.info
scanner-marwin.top reversing.cc
scripted.com rezeptiblud.ru
seasonvar.ru rfd-split.hr
secretscook.ru ritlweb.com
sell-fb-group-here.com runofilms.ru
serptehnika.ru sanyuprojects.com
serving.adbetclickin.pink sardinie.us
sevenstars7.com satellite.maps.ilovevitaly.com
sex-tracker.de sayyoethe.blogspot.co.za
sexflirtbook.com scanner-jane.top
sexpartygirls.net scanner-john.top
sexs-foto.com scanner-mary.top
sexvideo-sex.com scottbywater.com
share-buttons-for-free.com searchengineranker.email
sideeffectsoftizanidine.blogspot.com searchlock.com
sierraapps.com see-your-website-here.com
sildenafilcitratemed.com segol.tv
sitevaluation.org seksotur.ru
sixcooler.de seonetwizard.com
sexyebonyteen.com
sheerseo.com
shoesonlinebuy.xyz
shop-electron.ru
shop.acim.org
shopvilleroyboch.com.ua
shopwme.ru
siha.de
silvercash.com
simul.co
sinestesia.host.sk
sisiynas.ru
site3.free-share-buttons.com
sitevaluation.com
sk.golden-praga.ru sk.golden-praga.ru
skuteczna-dieta.co.pl skutecznetabletkinaporostwlosow.pl
skylta.com skyway24.ru
slonechka.ru slowmacfaster.trade
sloopyjoes.com sodexo.com
snegozaderzhatel.ru spb.afora.ru
snjack.info starwars.wikia.com
socas.pluto.ro steame.ru
socialseet.ru steelmaster.lv
spasswelt.xyz
spb.ru
spidtest.org
spitfiremusic.com
srgwebmail.nl
sticken.co
stop-gepatit.te.ua stop-gepatit.te.ua
sundrugstore.com strangeduckfilms.com
supernew.org stretchmate.net
support.nopeas.sk superkanpo.com
tdsing.ru svarkagid.com
tecnoteakviareggio.it swingerseiten.com
teenfuck.tv tandvardshuset.net
templates.franklinfire.co telefonsexi.com
templates.radiodigital.co terrafootwear.us
the-usa-games.blogspot.com thebluenoodle.com
thejournal.ru thegalerie.eu
time-japan.ru thepokertimer.com
timhost.ru theprofitsmaker.net
tizanidine4mgstreetprice.blogspot.com tiens2010.ru
tizanidine6mg.blogspot.com titan-cloud.life
tizanidineformigraines.blogspot.com tizanidine4mg.blogspot.com
tizanidineshowupondrugtest.blogspot.com tizanidine4mgstreetvalue.blogspot.com
tizanidinesleepaid.blogspot.com tizanidinecost.blogspot.com
toloka.hurtom.com tizanidinehcl4mgisitanarcotic.blogspot.com
tonivedu.it tizanidinepain.blogspot.com
top-deal.com.pl
top10-way.com
topcasinoratings.ru topcasinoratings.ru
totu.info topvidos.ru
trafaret74.ru torrent-newgames.com
traffic2cash.org trafficjunky.net
truebeauty.cc trahic.ru
tubeline.biz trainoffend.ml
tytoona.com try-rx.com
uchil.net turbabitload.weebly.com
umekana.ru turizmus.us
uprour.com turvgori.ru
uptime-gamma.net tv-spoty.info
twitlinks.com
txxx.com
ua.tc
ucsol.ru
ukkelberg.no
umityangin.net
umnovocaminho.com
uptime.com
urldelivery.com urldelivery.com
urlopener.com uvozdeckych.info
urzedowski.eu
uytmaster.ru uytmaster.ru
v-doc.co
varikozdok.ru varikozdok.ru
via-energy-order.com vbtracker.net
viddyoze.com via-gra.webstarts.com
videochat.bz viagengrarx.com
videochat.ph viagra-soft.ru
vkontaktemusic.ru viagra.pp.ua
vodkoved.ru video-camer.com
voluumtrk.com videochat.life
vpnhowto.info videochaty.ru
vseuznaem.com vigrx-original.ru
wallpapersdesk.info vinylvault.co.uk
warezaccess.com vitalads.net
waysbetter.cn viveresaniesnelli.it
webjam.com vizitki.net
webkeyit.com volgograd.xrus.org
websiteexplorer.info voltrknc1.com
weekes.biz.tc vykup-avto-krasnodar.ru
wesharepics.info vzube.com
wesharepics.site walkme.com
westen-v.life wapsite.me
whatzmyip.net wcb.su
wholesalejerseys-cheapest.com webinstantservice.com
wholinkstome.com webnode.me
withstandingheartwarming.com webs.com
wjgony.com website-speed-checker.site
worldtraveler.world welck.octopis.com
ww1943.ru wemarketing.se
www.timer4web.com whatsupinfoley.com
wwwadultcheck.com where-toget.com
x-diesel.info whiteproduct.com
x-lime.net wholesalejerseychinaoutlet.com
x69ty.ru wleuaprpxuvr.ga
womensterritory.ru
works.if.ua
woweb.com.ua
wpsecurity.website
x-mix.info
xblog.in
xboxster.ru
xclicks.net
xep.info
xfluro.com xfluro.com
xitjw.info xn----7sbho2agebbhlivy.xn--p1ai
xn----7sbifcamovvfggw9d.xn--p1ai xn----8sbhefaln6acifdaon5c6f4axh.xn--p1ai
xn--80atua3d.xn--p1ai xn----dtbndd4ae7eub.top
xtrafficplus.com xn--80ajjbdhgmudixfjc8c5a9df8b.xn--p1ai
youtubologia.it xnxx-n.com
ytmnd.com xxx-treker.ru
yurgorod.ru yeartwit.com
zeroredirect9.com yellowstonevisitortours.com
zetmaster.ru yes-com.com
zigarettenonlinekaufen1.blox.pl yhit.press
zixizop.net.ru yoshkarola.zrus.org
zog.link you-shall-not-pass.is74.ru
zoolubimets.ru yougetsignal.com
zootoplist.com youresponsive.com
zrelaya.pw yousense.info
zscalerone.net zagadki.in.ua
zambini.ru
zapiszto.pl
zarabotok--doma.ru
zarepta.com
zeikopay.com
zeleznobeton.ru
zerocash.msk.ru
zlatnajesen.com
zocaparj.kz
zx6.ru

480
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
1hwy.com 1000n1.ru
1stat.ru 12u.info
214jaluwobapef.cf 1314dh.com
34.gs 2rich4bitches.com
3xforum.ro 4webmasters.org
7minuteworkout.com 51unlim.ru
aa08daf7e13b6345e09e92f771507fa5f4.com ahmedabadwebs.com
aa81bf391151884adfa3dd677e41f94be1.com airlandsea.info
aac52006ec82a24e08b665f4db2b5013f7.com aksonural.ru
adanih.com alert-hgd.xyz
adpremium.org animebox.com.ua
adrenalin-stk.ru apartmentratings.com
ads.gold apelsinnik.website
agapovdg.ru apibrowsesmartne-a.akamaihd.net
aihelen.net apidiamondatanet-a.akamaihd.net
albumsuper.info apimegabrowsebiz-a.akamaihd.net
alessandraleone.com ascat.porn
aliexpresscashback.club atofilms.com
allesohnegirls.net auto.rusvile.lt
amehdaily.com
ananumous.ru
anonymous-redirect.com
app5.letmacworkfaster.world
appleid-verification.com
arkartex.ru
asiavirtualsolutions.com
avkzarabotok.info avkzarabotok.info
avtolombard-krasnodar.com ayanaspa.com
azazu.ru azazaporn.com
azbuka-mo.ru babs.com.ua
b2b-lounge.com beachdriveblog.com
balook.com berrymall.ru
bbsoldes.fr bestserials.com
beauby.ru biznesschat.net
bezlimitko.xyz blacktwhite.com
biznesluxe.ru blogos.kz
bizzliving.com blogrankers.com
blackcurranthumidifiers.site blue-square.biz
burger-tycoon.com bmw-ark.ru
cartierjusteunclou.xyz bobba.dzaba.com
cartierlovebraceletreplica.xyz bonkers.name
castingbank.ru boobsimge.com
cezartabac.ro bosman.pluto.ro
chatroulette.life braindaily.xyz
chcu.net buydissertation.net
chelyabinsk.xrus.org buynorxx.com
cherubinimobili.it buypuppies.ca
chiblackhawks-jerseys.com cardsdumps.com
chuckguilford.com carfax.com.ua
cleanersoft.com cashkitten-a.akamaihd.net
clickprotects.com cellfun.mobi
clicksor.net chlooe.com
club-samodelkin.ru cialischmrx.com
coaching-netz.info ciceros.co
com-onlinesupport.site circlesl.com
commoncrawl.org clean-start.net
compliance-viktor.top clickaider.com
construmac.com.mx clicksor.com
coolbar.pro compliance-ivan.top
cottageofgrace.com cookie-law-enforcement-ff.xyz
cypernhuset.se cornerstone-countertops.com
dcj-nn.ru covid-schutzmasken.de
dealwifi.com crackguru.tk
detki-opt.ru crafthubs.com
diamond-necklace.info cscwtalkto.site
dktr.ru cutt.us
docsportal.net data1.scopich.com
dood.live ddospanel.com
dosugrostov.site decoratinghomes.ga
download-wallpaper.net decorazilla.com
downloadme.life dentfidemountpreach.tk
draniki.org design-lands.ru
dumpsmania24.com destinationrealestate.com
education-cz.ru dildofotzen.net
eloconcream.blogspot.com discovertreasurenow.com
emerson-rus.ru eas-seo.com
elektroniksigaraankara.info
elektronischezigarettekaufen1.myblog.de
elvel.com.ua
enbersoft.com enbersoft.com
eralph.tk epngo.bz
europeanwatches.ru eu-cookie-law.blogspot.com
eyes-on-you.ga
fashionindeed.ml
fba-mexico.com
fealq.com fealq.com
fettefrauen.net feargames.ru
fickenprivat.info ferretsoft.com
fikasound.tk fertilitetsradgivningen.se
filesmonster.porn fetishinside.com
findpics.pw findanysex.com
firstsiteguide.com formseo.com
footbalive.org fortwosmartcar.pw
forum20.smailik.org forums.toucharcade.com
freeuploader.ml franecki.net
frustrated-favorable.gq frustrated-favorable.gq
gaz-voshod.ru galleryawesome.com
ge0ip.org game-top.su
get-free-traffic-now.com
getlaid-xxxhookupdirect.com
getoutofdebtfree.org
ghazel.ru
glavprofit.ru glavprofit.ru
gorodservis.ru googlsucks.com
hackers-crackers.tk hard-porn.mobi
hasfun.com hit-men.men
highspeed5.net home.myplaycity.com
hitmuzik.ru homeinns.com
hundejo.com host-protection.com
husky-shop.cz iamsport.org
i-service.kz iinstalll-fii1leis.jus0wil.pp.ua
ihtec2019.org images-free.net
inboundlinks.win inclk.com
iron-age.info indiasourcemart.in
infazavr.ru
inspiring-desperate.tk
intimshop-fantasy.ru
islamtoday.co.za islamtoday.co.za
ispac.org javitas.info
itag.pw jrcigars.com
itch.io kino-filmi.com
jerseychinabizwholesale.com kinobaks.com
jjbabskoe.ru klitimg.pw
jobmarket.com.ua kredit-blog.ru
jofucipiku.tk krynica.info
johnnyhaley.top kutikomi.net
jovencitas.gratis landscaping.center
jrpmakati.com larutti.ru
junketjuice.blogspot.com law-check-seven.xyz
kabbalah-red-bracelets.com linkpulse.com
karting196.ru lion.conboy.us
keki.info liver-chintai.org
kenaba.su lkbennettstore.online
keywordblocks.com macrotek.ru
kino-ecran.ru mafcards.ru
kino-rf.ru masterseek.com
kovesszucs.atw.hu mearns-tractors.co.uk
lashstudia.ru mediaoffers.click
letmacwork.world mesbuta.info
linkredirect.biz millionare.com
linksharingt.com minecraft-neo.ru
liverpool.gsofootball.com moje-recenze.cz
lubetube.com moncleroutletonline.xyz
mainhp.net mrcsa.com.au
mebel-vstroika.ru msk-diplomat.com
med-zdorovie.com.ua my-cash-bot.co
megagrabber.ru myphotopipe.com
methodsmarketing.com myplaycity.com
moesen-ficken.com nakrutka.cc
mug-na-chas-moscow.ru netpics.org
musicktab.com
mxgetcode.com
mydoctorok.ru
myftpupload.com
myghillie.info
mysexpics.ru
myxdate.info
netallergy.ru
no-fuel.org
nrjmobile.fr nrjmobile.fr
nullrefer.com odesproperty.com
obiavo.ru oklogistic.ru
office-windows.ru okuos.com
oivcvx.website olympescort.com
okel.co one-gear.com
ovirus.ru onlinadverts.com
oxotl.com onlinefilmz.net
paighambot.com onlineserialy.ru
paperwritingservice17.blogspot.ru openmultipleurl.com
pawli.eu ops.picscout.com
perfectpracticeweb.com ownshop.win
pestomou.info p-business.ru
picture-group.com paclitor.com
pictures-and-images.net paparazzistudios.com.au
picturesboss.com paydayonlinecom.com
porn-w.org pills24h.com
porto.abuilder.net piratecams.com
portside.cc pk-pomosch.ru
pretty-mart.com podshipniki-ntn.ru
producm.ru pogruztehnik.ru
push-ad.com pojdelo.weebly.com
pyramidlitho.webs.com popunder.ru
ranksonic.org powenlite24.ru
redirlock.com pricheskaonline.ru
retreatia.com profolan.pl
reward-survey.net proftests.net
rockma.se progress-upakovka.ru
rockprogblog.com prom23.ru
roleforum.ru pskcijdc.bloger.index.hr
sabizonline.com quangcaons.com
sanjosestartups.com qwarckoine.com
sarahmilne.top radiodigital.co
saveriopiazza.it ruex.org.ua
scanner-elena.top runofilms.ru
scanner-viktor.top sajatvelemeny.com
secretscook.ru seeresultshub-a.akamaihd.net
semprofile.com seo-platform.com
seoexperimenty.ru seoholding.com
seorankinglinks.com service.adtech.fr
sex-sex-sex5.com sex-znakomstva.online
sexsaoy.com shariki-zuma-lines.ru
sharebutton.org shlyahten.ru
sharebutton.to shoppingjequiti.com.br
sheerseo.com sirpornogratis.xxx
sibdevice.ru site-speed-checker.site
sigmund-freud.co.uk smailik.org
simpoed.ufop.br small-game.com
siteonomy.com
sitevaluation.org
sivs.ru
smart-scripts.com smart-scripts.com
snjack.info soblaznu.net
snworks.com social-s-hhh.xyz
softxaker.ru staticfs.host
soheavyblog.com steelmaster.lv
songoo.wz.cz stpolice.com
spacash.com studiofmp.com
subj.ukr-lit.com suggest-keywords.com
surffoundation.nl syvertsen-da.no
svbur.ru td-33.ru
tackletarts.co tdsing.ru
templates.radiodigital.co teenforporn.com
thesmartsearch.net thegalerie.eu
thetoiletpaper.com thegamerznetwork.com
titangel-vietnam.com theporndude.com
tivolibasket.it titan-ads.life
tizanidine4mgstreetvalue.blogspot.com tizanidine4mguses.blogspot.com
tizanidinedruginteractions.blogspot.com tkanorganizma.ru
tizanidineduringpregnancy.blogspot.com
tizanidinehcl4mgisitanarcotic.blogspot.com
toloka.hurtom.com toloka.hurtom.com
topappspro.com touchmods.fr
tour-line.net traffic100.com
tourcroatia.co.uk trafficreceiver.club
traderzplanet.in treasuretrack-a.akamaihd.net
trafficmania.com trion.od.ua
trahvid.com triumf-realty.ru
ufa.xrus.org trkdf.com
ultimatesetnewfreeallsoftupgradesystems.pw tryrating.com
viandpet.com tubeline.biz
videosbox.ru tuckermktg.com
vikistars.com uhodzalijami.ru
villakohlanta.nu ukrtvir.com.ua
virtuagirl.com uptime-as.net
visionwell.com.cn url2image.com
webcamdevochka.com valkiria-tk.ru
wesharepics.site vandrie-ict.nl
worldmusicfests.com videokrik.net
wrz0iuebwhp5fg.freeddns.com vids18.site
x-porno.video vizitki.net
xcombear.ru vltai.com
xn----ctbbcjd3dbsehgi.xn--p1ai vmnmvzsmn.over-blog.com
xn--80ab4aa2g.xn--p1ai vroze.com
xn--b1adccaf1bzj.xn--p1ai vvpg.ru
xportvusbdriver8i.snack.ws vzlomtw.com
xxx-treker.ru webmonetizer.net
yes-com.com webstatsdomain.org
youdao.com where-toget.com
youradexchange.com wholesalecheapjerseysfree.com
yourporngay.com wholesalejerseys-cheapest.com
zeroredirect7.com wiosenny-bon-1500.pl
zhuravlev.info www.arenda-yeisk.ru
xn--24-glceagatoq7c2a6ioc.xn--p1ai
xn--b1ag5cfn.xn--p1ai
xzlive.com
yopoint.in
yourmovies.pl
zajm-pod-zalog-nedvizhimosti.ru
zeroredirect11.com
znakom.sibtest.ru
zytpirwai.net zytpirwai.net

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.58 0; 10.1.1.36 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.02.2928 ### Version: V4.2022.02.2929
### Updated: Sat Feb 19 10:04:02 UTC 2022 ### Updated: Sat Feb 19 22:01:29 UTC 2022
### Bad Bot Count: 636 ### Bad Bot Count: 636
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.02.2928 ### Version: V4.2022.02.2929
### Updated: Sat Feb 19 10:04:02 UTC 2022 ### Updated: Sat Feb 19 22:01:29 UTC 2022
### Bad Bot Count: 636 ### Bad Bot Count: 636
################################################### ###################################################
### Version Information ## ### Version Information ##