vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-03 02:59:57 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2022.10.3392 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2022-10-05 22:07:08 +00:00
parent 2b1092e68d
commit b0f213d6c9
46 changed files with 99128 additions and 99128 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.10.3391 #### Version: V4.2022.10.3392
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.10.3391 #### Version: V4.2022.10.3392
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -14,7 +14,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2022.10.3391 #### Version: V4.2022.10.3392
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

12258
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2022.10.3391 #### Version: V4.2022.10.3392
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

12262
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

12262
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

12262
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

12262
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.2.12 1; 10.1.0.44 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.2.12 0; 10.1.0.44 0;
127.0.0.1 0; 127.0.0.1 0;

12262
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.2.12 1; 10.1.0.44 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.2.12 0; 10.1.0.44 0;
127.0.0.1 0; 127.0.0.1 0;

12262
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.2.12 1; 10.1.0.44 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.2.12 0; 10.1.0.44 0;
127.0.0.1 0; 127.0.0.1 0;

12262
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
3391 3392

12262
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

12262
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.163.130.102 0; 20.232.30.45 0;

12262
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.2.12 1; 10.1.0.44 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.2.12 0; 10.1.0.44 0;
127.0.0.1 0; 127.0.0.1 0;

12262
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.2.12 1; 10.1.0.44 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.2.12 0; 10.1.0.44 0;
127.0.0.1 0; 127.0.0.1 0;

12262
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.2.12 1; 10.1.0.44 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.2.12 0; 10.1.0.44 0;
127.0.0.1 0; 127.0.0.1 0;

12262
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.163.130.102 0; 20.232.30.45 0;

12262
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.163.130.102 0; 20.232.30.45 0;

12262
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.2.12 1; 10.1.0.44 1;
127.0.0.1 1; 127.0.0.1 1;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
AiHitBot Grabber
DBLBot NPbot
Intelliseek Octopus
SMTBot OutfoxBot
SurveyBot Pimonster
WASALive-Bot SemrushBot
WebAuto URLy Warning
WebLeacher Vacuum
check1.exe Web Pix
polaris version scalaj-http

278
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
360Spider 360Spider
404enemy 404enemy
80legs 80legs
ADmantX
AIBOT
ALittle Client
ASPSeek
Aboundex Aboundex
Aboundexbot
Acunetix
AfD-Verbotsverfahren AfD-Verbotsverfahren
AhrefsBot AhrefsBot
Aipbot
Alexibot Alexibot
AllSubmitter AlphaBot
Alligator Anarchie
Anarchy Anthill
Anarchy99 Aspiegel
Ankit
Asterias
Atomseobot
AwarioRssBot AwarioRssBot
AwarioSmartBot AwarioSmartBot
BLEXBot BBBike
BDCbot
BackWeb BackWeb
BacklinkCrawler
BatchFTP BatchFTP
Black Hole
BlackWidow
Blow Blow
BlowFish BlowFish
Bolt
BotALot
Brandprotect Brandprotect
Brandwatch Brandwatch
BuiltWith
Bullseye Bullseye
BuzzSumo BunnySlippers
CATExplorador
CCBot
CODE87 CODE87
CazoodleBot
Cegbfeieh Cegbfeieh
CensysInspect
CheTeam CheTeam
CheeseBot CheeseBot
ChinaClaw ChinaClaw
Citoid Collector
Claritybot
Copier Copier
CopyRightCheck
Copyscape
Craftbot Craftbot
Crawling at Home Project CrazyWebCrawler
Crescent
DSearch DSearch
Deusu
Digincore
DigitalPebble DigitalPebble
Dirbuster Dirbuster
Discoverybot Discobot
Dispatch Dispatch
DnBCrawler-Analytics
DomCopBot
DomainAppender DomainAppender
DomainCrawler DomainSigmaCrawler
DomainStatsBot DomainStatsBot
Domains Project Drip
Dotbot
ECCP/1.0
EMail Siphon EMail Siphon
EMail Wolf Ebingbong
Ecxi EirGrabber
EroCrawler EroCrawler
Evil Evil
Express WebPictures
ExtLinksBot ExtLinksBot
Extractor ExtractorPro
Extreme Picture Finder FHscan
Firefox/7.0
FlashGet FlashGet
Foobot
Fuzz Fuzz
FyberSpider
GermCrawler
GetRight GetRight
Getintent Go!Zilla
Gigabot GrabNet
Grabber
Grafula Grafula
GridBot GrapeshotCrawler
HMView HTMLparser
HTTP::Lite HTTP::Lite
HTTrack
Haansoft
Havij
Hloader
HonoluluBot HonoluluBot
Humanlinks IDBTE4M
IDBot IDBot
Iblog Iblog
IlseBot IlseBot
IndeedBot Internet Ninja
Intelliseek
InterGET
InternetSeer InternetSeer
Iria Iria
Iskanie JamesBOT
Jbrofuzz JennyBot
Jetty JetCar
JikeSpider Jorgee
Jyxobot
Keybot Translation-Search-Machine Keybot Translation-Search-Machine
Kinza Lanshanbot
LNSpiderguy
LWP::Simple
Larbin Larbin
Leap LeechFTP
LeechGet
LexiBot
Lftp Lftp
Libwhisker Libwhisker
LieBaoFast LieBaoFast
LinkWalker LinkWalker
LinqiaMetadataDownloaderBot LinkpadBot
LinksManager
LinqiaRSSBot LinqiaRSSBot
Lipperhey Spider LinqiaScrapeBot
Litemage_walker
Lmspider Lmspider
MJ12bot MFC_Tear_Sample
MIIxpc
MSIECrawler
MTRobot
Mail.RU_Bot
Majestic SEO Majestic SEO
Majestic12
MarkMonitor MarkMonitor
Mata Hari
Metauri Metauri
Microsoft Data Access MicroMessenger
Microsoft URL Control Microsoft URL Control
MolokaiBot Moblie Safari
Morfeus Fucking Scanner Mr.4x3
Msrabot
Musobot Musobot
NICErsPRO
NPbot NPbot
Name Intelligence
Nameprotect Nameprotect
NearSite
Nessus Nessus
NetAnts NetAnts
NetLyzer NetMechanic
Nibbler NetZIP
Netcraft
Netvibes
Niki-bot
Nikto Nikto
Nmap NimbleCrawler
Nutch Nutch
Octopus
Offline Navigator Offline Navigator
OpenVAS
Openfind Openfind
OrangeBot
OrangeSpider OrangeSpider
PECL::HTTP PageScorer
PHPCrawl Pandalytics
POE-Component-Client-HTTP Panscient
PageAnalyzer
Pavuk Pavuk
PeoplePal PictureFinder
Pimonster Piepmatz
Pockey
ProWebWalker
Probethenet Probethenet
Psbot Psbot
Pu_iN PyCurl
PxBroker QueryN Metasearch
Quick-Crawler
RSSingBot RSSingBot
RankActive
RankActiveLinkBot
RankFlex RankFlex
RankingBot2
RankurBot RankurBot
ReGet
RealDownload
Reaper Reaper
RepoMonkey RepoMonkey
Rogerbot Ripper
SBIder SEOkicks
SEOkicks-Robot SEOkicks-Robot
SEOstats
SISTRIX
SMTBot SMTBot
ScanAlert
Scanbot Scanbot
ScoutJet ScoutJet
Searchestate Scrapy
Seekport Screaming
Semrush ScreenerBot
SemrushBot ScrepyBot
SearchmetricsBot
SeoSiteCheckup
SeobilityBot SeobilityBot
Shodan
Siphon
SiteLockSpider SiteLockSpider
SiteSnagger SiteSnagger
SiteSucker Sitevigil
SlySearch
SmartDownload SmartDownload
Sottopop Snake
Snapbot
Sosospider
SpaceBison
Spammen Spammen
SputnikBot Spanner
Sqlmap Spinn3r
Steeler Sqlworm
Sucuri Sucuri
SurveyBot SuperHTTP
T0PHackTeam
T8Abot T8Abot
TeleportPro Telesoft
Trendiction Telesphoreo
Trendictionbot TheNomad
Turingos Titan
Twice Toweyabot
True_Robot
Typhoeus
URLy Warning URLy Warning
URLy.Warning
V-BOT
VCI
Vacuum Vacuum
VelenPublicWebCrawler VelenPublicWebCrawler
VeriCiteCrawler
VidibleScraper VidibleScraper
Virusdie
VoidEYE
Voil Voil
Voltron WEBDAV
WASALive-Bot
WBSearchBot
WISENutbot WISENutbot
WWW-Mechanize WPScan
WWW::Mechanize WWW-Collector-E
Wallpapers Wallpapers
Web Sauger WallpapersHD
WebAuto WeSEE
Web Pix
Web Sucker
WebCollage WebCollage
WebEnhancer
WebFuck
WebImageCollector WebImageCollector
WebLeacher
WebReaper WebReaper
WebmasterWorldForumBot WebStripper
Webshag Webalta
Webster Website Quester
WebsiteQuester
Whack Whack
Widow
WiseGuys Robot WiseGuys Robot
Wonderbot
Woobot Woobot
Zade Zade
Zauba ZmEu
Zermelo ZoominfoBot
Zeus
Zitebot
ZyBorg ZyBorg
check1.exe adscanner
crawl.sogou.com autoemailspider
coccocbot
cognitiveseo
crawler.feedback crawler.feedback
demandbase-bot
domainsproject.org domainsproject.org
eCatch
evc-batch evc-batch
gopher
instabid instabid
isitwp.com
iubenda-radar
linkdexbot
lwp-request
muhstik-scan
oBot oBot
page scorer page scorer
pcBrowser
plumanalytics
s1z.ru s1z.ru
scan.lol scalaj-http
seocompany.store
seostar
serpstatbot serpstatbot
sysscan sitechecker.pro
trendiction.com sogouspider
trendiction.de ubermetrics-technologies.com
voyagerx.com webmeup-crawler
webpros.com
x09Mozilla x09Mozilla
x22Mozilla
xpymep1.exe xpymep1.exe
zauba.io zauba.io
zgrab

286
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
360Spider 360Spider
404checker
ADmantX
AIBOT
ALittle Client
ASPSeek ASPSeek
Acunetix Aboundex
AfD-Verbotsverfahren AfD-Verbotsverfahren
AhrefsBot Aipbot
AiHitBot AllSubmitter
Alligator Anarchie
Anarchy99 Anarchy
Ankit
Anthill
Apexoo Apexoo
Asterias
Atomseobot
Attach
AwarioRssBot AwarioRssBot
AwarioSmartBot
BBBike BBBike
BDCbot BDFetch
BackDoorBot BLEXBot
BackStreet
BackWeb BackWeb
Backlink-Ceck
BacklinkCrawler BacklinkCrawler
BetaBot BatchFTP
Bitacle Blow
Black Hole
Blackboard
BlowFish BlowFish
Boardreader Boardreader
Buck Buck
Buddy Buddy
BuiltWith BuiltBotTough
BuzzSumo BuzzSumo
CATExplorador
CSHttp
Cegbfeieh
CensysInspect CensysInspect
CheTeam CheeseBot
CherryPicker CherryPicker
Claritybot
Cloud mapping
Collector
CopyRightCheck CopyRightCheck
Copyscape
Cosmos Cosmos
Crawling at Home Project
CrazyWebCrawler CrazyWebCrawler
CrunchBot CrunchBot
CyotekWebCopy Curious
DTS Agent DBLBot
Demon
Deusu
Devil
DigitalPebble DigitalPebble
Dispatch Dirbuster
Disco
DittoSpyder
DnBCrawler-Analytics DnBCrawler-Analytics
DnyzBot DnyzBot
DomainAppender DomainCrawler
DomainStatsBot DomainSigmaCrawler
Domains Project EMail Siphon
Dotbot
EMail Wolf
EasyDL
EroCrawler EroCrawler
Evil Express WebPictures
ExtLinksBot Extractor
ExtractorPro
Extreme Picture Finder Extreme Picture Finder
FHscan
FemtosearchBot FemtosearchBot
Firefox/7.0 Foobot
FlashGet FrontPage
Flunky Fuzz
Fyrebot FyberSpider
GT::WWW
GalaxyBot GalaxyBot
GermCrawler GetRight
Getintent Getintent
Go!Zilla Go!Zilla
GrabNet
Grabber Grabber
GrapeFX Grafula
GrapeshotCrawler GrapeshotCrawler
HEADMasterSEO
HTMLparser HTMLparser
HTTrack HTTP::Lite
Haansoft Haansoft
HaosouSpider HaosouSpider
Heritrix Harvest
Hloader HybridBot
HonoluluBot
Iblog Iblog
IlseBot IlseBot
Image Fetch IndeedBot
InterGET InfoTekies
Intelliseek
Internet Ninja Internet Ninja
InternetSeer InternetSeer
JOC Web Spider Iskanie
JennyBot JennyBot
JetCar JustView
JikeSpider Kenjin Spider
Jorgee
Kinza Kinza
Kozmosbot Kozmosbot
LNSpiderguy
Larbin Larbin
LeechGet
Lftp Lftp
LieBaoFast Likse
LinkWalker LinkWalker
LinkpadBot Linkbot
LinksManager
LinqiaMetadataDownloaderBot LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Lipperhey
Lipperhey Spider
Lmspider
Ltx71
MIDown tool
MJ12bot
MSFrontPage
MSIECrawler MSIECrawler
MTRobot MTRobot
Magnet
MarkWatch MarkWatch
Mass Downloader
Masscan Masscan
MauiBot
Mb2345Browser
MeanPath Bot MeanPath Bot
Meanpathbot
MegaIndex.ru MegaIndex.ru
Metauri MicroMessenger
Minefield
Mister PiX Mister PiX
MolokaiBot Mojeek
Mr.4x3 Mr.4x3
Msrabot
Musobot Musobot
NICErsPRO NPbot
Nameprotect
NearSite
Net Vampire
NetAnts NetAnts
NetMechanic Niki-bot
NetZIP Not
NextGenSearchBot Nutch
Nibbler Octopus
Nikto OnCrawl
Openvas OrangeSpider
Page Analyzer OutfoxBot
PageAnalyzer
PageGrabber PageGrabber
PageThing.com PageThing.com
Pavuk Panscient
Papa Foto
Petalbot
Pi-Monster Pi-Monster
Picscout Picscout
Picsearch Piepmatz
PictureFinder Pockey
PleaseCrawl ProWebWalker
Probethenet Probethenet
Pu_iN
PyCurl
Quick-Crawler
RankActiveLinkBot RankActiveLinkBot
RankFlex RankFlex
RankingBot
Rankivabot
RankurBot RankurBot
RealDownload RealDownload
Recorder Reaper
RebelMouse
RepoMonkey RepoMonkey
Ripper
RocketCrawler
Rogerbot Rogerbot
SBIder SBIder
SEOkicks-Robot SEOkicks-Robot
SEOprofiler SEOlyticsCrawler
SISTRIX SEOstats
ScanAlert SalesIntelligent
Scanbot Scanbot
ScoutJet ScoutJet
Screaming Screaming
Searchestate
Seekport Seekport
SemrushBot
SentiBot
SeoSiteCheckup
SeobilityBot SeobilityBot
Siphon Seomoz
SiteLockSpider Shodan
SiteCheckerBotCrawler
Sitebeam
Siteimprove
Sitevigil
SlySearch SlySearch
SocialRankIOBot Sogou web spider
Sociscraper Sosospider
Sottopop Sottopop
Spammen Sqlmap
Sqworm Stripper
Sucker
SuperBot
SuperHTTP SuperHTTP
Suzuran Suzuran
Swiftbot
Szukacz Szukacz
T0PHackTeam T8Abot
Telesoft Teleport
Telesphoreo
Telesphorep
The Intraformant
TheNomad TheNomad
Thumbor Thumbor
TightTwatBot TightTwatBot
Toata
Toweyabot
TurnitinBot TurnitinBot
TwengaBot Typhoeus
URLy Warning URLy Warning
UnisterBot URLy.Warning
Vacuum
VelenPublicWebCrawler VelenPublicWebCrawler
VidibleScraper VoidEYE
Virusdie Voil
Voltron
WASALive-Bot
WEBDAV
WISENutbot
WPScan WPScan
WWW-Mechanize WWW-Mechanize
WWW::Mechanize
Wallpapers Wallpapers
Wallpapers/3.0 Wallpapers/3.0
Web Collage WallpapersHD
Web Auto
Web Pix Web Pix
Web Sauger Web Sucker
WebAuto WebFetch
WebCollage WebFuck
WebCopier
WebGo IS
WebLeacher WebLeacher
WebStripper WebWhacker
WebSucker
WebZIP WebZIP
Webalta
WebmasterWorldForumBot
Webshag Webshag
Website Quester
WebsiteExtractor
WebsiteQuester WebsiteQuester
Webster
Whack Whack
Whacker
Whatweb
Who.is Bot
Widow Widow
Xaldon WebSpider Wonderbot
Xaldon_WebSpider Wotbox
ZmEu Zauba
Zermelo
ZumBot ZumBot
ZyBorg
archive.org_bot
autoemailspider autoemailspider
backlink-check check1.exe
cah.io.community cognitiveseo
clark-crawler crawler4j
coccocbot
crawler.feedback
dataforseo.com dataforseo.com
demandbase-bot
domainsproject.org domainsproject.org
gopher evc-batch
facebookscraper
heritrix heritrix
internetVista monitor internetVista monitor
iubenda-radar iubenda-radar
linkdexbot linkdexbot
lwp-request lwp-request
lwp-trivial mediawords
muhstik-scan
oBot
pcBrowser pcBrowser
probe-image-size plumanalytics
ripz polaris version
s1z.ru satoristudio.net
scalaj-http scalaj-http
seoscanners seoscanners
serpstatbot seostar
voyagerx.com sitechecker.pro
sp_auditbot
tAkeOut
ubermetrics-technologies.com
webgains-bot
webmeup-crawler
x09Mozilla x09Mozilla
x22Mozilla xpymep1.exe

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
avtochehli.by actices.com
copenergo.ru eloconcream.blogspot.com
dame-ns.kz nalogovyykodeks.ru
gotomontenegro.net parlament.biz
locimge.pw ranking2017.ga
notebook-pro.ru rating-bestcasino.com
pornotubs.com socialtrade.biz
pulseonclick.com trustedhealthtips.com
u17795.netangels.ru unmaroll.ya.ru
websiteexplorer.info volgograd.xrus.org

920
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
108shot.com 01apple.com
2kata.ru 1flag.co.za
5elementov.ru 24-ak.ru
5forex.ru 2728fb936f0.com
8558l.jobs.net 3dracergames.com
aa625d84f1587749c1ab011d6f269f7d64.com 45en.ru
aa8b68101d388c446389283820863176e7.com 7fon.ru
absolute-s.ru 888.com
adanih.com abtasty.com
adbetclickin.pink acc.eu.org
adclickthru.net adloads.com
add-add.men adsloads.com
adultmeetonline.info agreda.pluto.ro
advancedcleaner.com
aerogo.com
agecheckadult.com
aghanyna.com
akama.com akama.com
algarveglobal.com allwomen.info
alibestsale.com alt-servis.ru
allknow.info am15.net
alvtank.se amazingninja.com
anal-acrobats.hol.es an-donut.com
animal-drawings.com angry-fermi-7633.arukascloud.io
api.stathat.com aosheng-tech.com
apimossnetinfo-a.akamaihd.net apccargo.com
apisecretsaucebi-a.akamaihd.net apiadanaknet-a.akamaihd.net
approved.su apimountainbikei-a.akamaihd.net
artavenuegardenstudios.com artdeko.info
as5000.com asrv-a.akamoihd.net
avirasecureserver.com astana.xxxkaz.org
avtocredit-legko.ru audiofree.ru
awaybird.ru autoloans.com
azazaporn.com aversis.net
azbaseimages.net aviav.eu
baditri.com avkzarabotok.info
balans.shahterworld.org azadnegar.com
banki76.ru azbukafree.com
b2b-lounge.com
baixar-musicas-gratis.com
baltgem.com
bashtime.ru bashtime.ru
beget.tech battleforupdating.site
beremenyashka.com bensbargains.net
bestbrainprod.win best-businessman.ru
bestdooz.com best-way.men
bestwrinklecreamnow.com besthoro.ru
beztuberkuleza.ru bestmarriages.com
big-boards.info bestofupload.info
binomo.kz bestserials.com
bitcoinremote.com bibys.com
bizru.info bidr.trellian.com
blockety.co bimatoprost-careprost.com
blogos.kz binomo.com
blogqpot.com blog-hits.com
bmw.afora.ru blog.koreadaily.com
bobba.dzaba.com bonzibuddi.com
bodybuilding-shop.biz boobsimge.com
bonkers.name bracketsmackdown.com
bpro1.top bronzeaid-a.akamaihd.net
brainzpod.win bukleteg.xyz
brillianty.info bum.com.ru
btc4u.ru
bumascloset.com
businescoop.men
buy-meds24.com
buyfriend.ru buyfriend.ru
buypuppies.ca c-gainsbourg.com
c-english.ru cakemediahq.com.au
callawaygolfstore.online callstevens.com
cartechnic.ru camdolls.com
cartierbracelet.xyz candytiner.com
censys.io canoncdriverq3.pen.io
cfcl.co.uk carloans.com
chatroulette.life cartierreplica.xyz
chatroulette.si celebsopics.com
cheapmoncler.xyz cgi2.nintendo.co.jp
checktext.org checktext.org
christianlouboutinsaleonline.us ciceros.co
cibpenonptib.flu.cc citysecurity.nu
cityadspix.com classiquebijoux.ru
clayvasedesigns.tk
cleanmypc.com cleanmypc.com
clippingphotoindia.com clevernt.com
clksite.com clickcash.com
clodo.ru cmhomestayagency.com
codq.info coccoc.com
coinsspb.com collegerentals.com
com-cleaner.systems compliance-don.xyz
com-secure.download compliance-elena.top
comissionka.net compliance-fred.top
compliance-fred.xyz compliance-mary.top
compliance-george.xyz compliance-willy.top
compliance-nelson.top contentsexpress.com
continent-e.tv continent-e.tv
cool-wedding.net
coolgamechannel.com coolgamechannel.com
coolgramgoods.com coolwallpapers4k.info
copenergo.ru
cranly.net
crazyprotocol.com
crd.clan.su
creams.makeforum.eu creams.makeforum.eu
creatives.adbetclickin.pink culmimg.pw
culturevie.info customboxes4less.com
custodieva.ru customsua.com.ua
customchocolate.business-for-home.com dairyindia.in
cyse.tk dandiyabeats.in
daretodonate.co daretodonate.co
deniven.1bb.ru daydream-studio.ru
ddsoldes.fr
detsky-nabytek.info
diarioaconcagua.com diarioaconcagua.com
dinkolove.ya.ru diffbot.com
directrev.com dignitasdata.se
dogbreedspicture.net dildofotzen.net
dokfilms.net dimaka.info
dominateforex.ml djihispano.com
dostavka-v-krym.com domain2008.com
downloadeer.net domaincrawler.com
driving.kiev.ua dood.live
downloadmefiranaratb1972.xpg.com.br
dpihatinh.gov.vn
draniki.org
drunkmoms.net
duawitchrarato.tk
dyt.net dyt.net
e-poker-2005.com e-kwiaciarz.pl
e90post.com eandsgallery.com
earl-brown.info ecommerce-seo.com
earn-from-articles.com edudocs.net
ebonyporn.site eduinfosite.com
ebooknovel.club efkt.jp
ecommerce-seo.org ege-essay.ru
ed-shop01.ru eksprognoz.ru
eldiariodeguadalajara.com ekto.ee
electronicadirect.com elmacho.xyz
elektrischezigaretten1.blogse.nl enbersoft.com
elektrozigaretten1.postbit.com encodable.com
elektrozigaretten1.webs.com enews.tech
eloconcream.blogspot.com enhand.se
eng-lyrics.com
enpolis.ru enpolis.ru
ero-advertising.com enskedesquashclub.se
erectile.bid
erot.co erot.co
este-line.com.ua erotag.com
extlabs.io erotik0049.com
facecup.top ertelecom.ru
falllow.gq eshop4u.jp
fashion-stickers.ru executehosting.com
fashion.stellaconstance.co exhibitionplus.eu
faz99.com exportshop.us
fetroshok.ru extlinks.com
ff30236ddef1465f88547e760973d70a.com ezigaretteshop2.mywapblog.com
filmi-v.online facebook-mobile.xyz
financetip.eu fbdownloader.com
finejewelryshop.ru feel-planet.com
fireads.men feeriaclub.ru
flex4launch.ru feorina.ru
forex21.ru fickenprivat.info
forexunion.net fikasound.tk
forum-engineering.ru filesdatabase.net
free-floating-buttons.com filmetricsasia.com
free-laptop-reward.com firesub.pl
free-social-buttons.xyz fishingwholesale.us
frequiry.com fitfloponline.store
fres-news.com flashbannernow.com
fuckmill.com focalink.com
fz139.ttk.ru forex-indextop20.ru
g.starmoe.xyz formseo.com
gambarkatabaru.com foto-sisek.porngalleries.top
gamezblox.com foxjuegos.com
gay.adultgalls.com fr-bearings.ru
free-stock-illustration.com
freemags.cc
fsakhalin.ru
galaxy-family.ru
galeon.com
gameonasia.com
gaygalls.net
ge0ip.net ge0ip.net
gk170.ru getmyads24.com
glall.ru ghostvisitor.com
globetrotting-culture.ru girlspicsa.com
gogalleryawesome.com globalscam.ga
golmau.host.sk gojiberriess.apishops.ru
goodnightjournal.com gox.com.ua
gosarhivrt.ru gq-catalog.gq
gosmeb.ru guod.me
grand-chlen.ru gwagka.com
graphicwe.org gymi.name
greatzip.com
hahashka.ru hahashka.ru
hanink.biz.ly hamacapty.com
hdpixion.com hatedriveapart.com
healmytrauma.info haveinc.xyz
health-medical-portal.info havepussy.com
help.tpu.ru hdimagegallery.net
herehloadibs.cf healgastro.com
heygidday.biz helicalpile.us
hildinghr.se helpmymacfaster.trade
hkdiiohi.skyrock.com hentai-manga.porn
hmywwogw.bloger.index.hr hidemyass.com
homedo.fabpage.com hit-men.men
hostingclub.lk homeart.space
houtings.xyz hoste.octopis.com
hplaserjetpdriver8y.pen.io hotkeys.com
ibmdatamanagement.co hoverboardforsaledirect.com
igrovyeavtomaty777.ru hunterboots.online
iideaidekonkatu.info iccornacircri.cf
iloveitaly.ru igru-xbox.net
imabase.com iklysha.ml
imfamous.info ilikevitaly.com
imgarcade.com images-free.net
inboundlinks.win immobiliaremassaro.com
indiakino.net impotentik.com
inet-traffic.com incomekey.net
insomniagamingfestival.com infogame.name
integritylandscapeservices.com intim-uslugi.info
internetproviderstucson.com investpamm.ru
investingclub.ru ipostroika.ru
iradiology.ru ispaniya-costa-blanca.ru
iron-age.info istizanidineanopiate.blogspot.com
itag.pw itronics.ca
jacago.com
janavibekken.no
jav-way.site jav-way.site
johannesburgsingles.co.za jerseysbizwholesalecheap.com
juliadiets.com jongose.ninja
karaganda.xkaz.org justdating.online
katadhin.co kadashihotel.com
kaz.kz kaz.kz
kerei.ru kerch.site
ketrzyn.pl keywesthideaways.co
keywordhouse.com keyword-suggestions.com
krynica.info keywordblocks.com
kutikomi.net kino2018.cc
kw21.org kinogonew.ru
labafydjxa.su kinotorka.ru
lafriore.ru klin3952.ru
languagecode.com knogg.net
lapitec.eu kol-energo.ru
law-check-seven.xyz konteiner24.com
lawyers.cafe kosmetyki.tm.pl
ldrtrack.com kosova.de
leadn.pl kovrenok.ru
lerporn.info kredit-blog.ru
kvartiry-remont.ucoz.ru
kwzf.net
laserpen.club
law-check-nine.xyz
leadwayau.com
leboard.ru
letmacworkfaster.site letmacworkfaster.site
likesdesign.com letolove.ru
lionking-1994.blogspot.com letslowbefast.today
localflirtbuddies.com lifebyleese.com
loginduepunti.it lion.snapmap.us
lonerangergames.com livesex-amateure.info
lottospring.com liveu.infoteka.hu
lyrster.com loadingpages.me
lombardfinder.ru
lostfilm-online.ru
louisvuittonoutletstore.net
love-baby.cz
lumb.co
m1media.net
macdamaged.space macdamaged.space
macotool.com madot.onlinewebshop.net
malls.com mall.uk
manifestyourmillion.com marwer.info
manve.info mastershef.club
martlinker.com matematikus.info
mature.free-websites.com matrixalchemy.com
max-eclat.men maximpartnerspr.com
max-p.men meble-bogart.info
maxthon.com mediaoffers.click
mcnamaratech.com medicineseasybuy.com
medictube.ru medizinreisen.de
medkletki.ru
medtherapy.ru medtherapy.ru
megagrabber.ru megahdporno.net
mensandals.xyz mesbuta.info
mesto-x.com mindeyegames.com
michellblog.online miniads.ca
middlerush-a.akamaihd.net mixtapetorrent.com
minegam.com mmog-play.ru
missis.top mobot.site
mobicover.com.ua monarchfind-a.akamaihd.net
moesen-ficken.com monarhs.info
mojowhois.com moomi-daeri.com
montazhnic.ru
mossmesi.com
mostantikor.ru mostantikor.ru
mp3ritm.top movies-in-theaters.net
mriyadh.com mp3downloadhq.com
mturkcontent.com mundoaberrante.com
musicdaddy.net musezone.su
my-big-family.com muz-baza.net
myblogregistercm.tk myonlinepayday.co
mydeathspace.com mypets.by
nakrutka.cc
naphukete.ru naphukete.ru
nastroyke.net nastydollars.com
naughtyconnect.com nerudlogistik.ru
navalwiki.info newfilmsonline.ru
netallergy.ru nfljerseyscheapchinabiz.com
nextrent-crimea.ru
nfljerseyscheapbiz.us
nhl09.ru nhl09.ru
nightvision746.weebly.com nl.netlog.com
njkmznnb.ru odoratus.net
nlfjjunb5.ru oivcvx.website
no-rx.info ontargetseo.us
nofreezingmac.click openlibrary.org
ntic.fr
nudejapan.net
nuup.info
oakleyglassesonline.us
oballergiya.ru
obiavo.by
offer.camp
oklogistic.ru
okonich.com.ua
onclkads.com
onemantrip.com
onlinemeetingnow.com
onthemarch.co
opinionreelle.com
ops.picscout.com ops.picscout.com
oren-cats.ru ororodnik.goodbb.ru
paclitor.com orsonet.ru
pagesense.com p-business.ru
partner-cdn.men paceform.com
partybunny.ru pammik.ru
paydayonlinecom.com panchro.xyz
pc-virus-d0l92j2.pw patol01.pw
pc4download.co
pendelprognos.se pendelprognos.se
perl.dp.ua petsblogroll.com
petedrummond.com piccdata.com
photostudiolightings.com piccshare.com
picsforkeywordsuggestion.com picturesmania.com
pio.polytopesexempt.com piter.xrus.org
pkr1hand.com piulatte.cz
platesauto.com pixell.club
playboyfiles.xblog.in pizda.lol
pliks.pl pizdeishn.com
plugingeorgia.com pk-services.ru
poem-paying.gq plusnetwork.com
pojdelo.weebly.com
polytopesexempt.com
popugauka.ru
porn-w.org porn-w.org
pornoforadult.com porn555.com
pornotubexxx.name pornobrazzers.biz
pornozhara.com pornofeuer.com
potolokelekor.ru pornogratisdiario.com
printdirectforless.com pornoinn.com
privat-girl.net pozdrawleniya.ru
privatefx.all4invest.info predmety.in.ua
prlog.ru priceg.com
productarium.com prizefestival.mobi
projectforte.ru pro-okis.ru
prom23.ru progonrumarket.ru
propranolol40mg.blogspot.com projefrio.com.br
prostitutki-kiev.org prostitutki-belgoroda.org
proxyradar.com pukaporn.com
puteshestvennik.com puteshestvennik.com
py100.ru pwwysydh.com
queerspace.com rating-bestcasino.com
quit-smoking.ga redirectme.net
r-control.ru redirlock.com
raavidesigns.com registratciya-v-moskve.ru
randalljhoward.com registrationdomainsite.com
ranksays.com
rcb101.ru
realtytimes.com
refererx.com
regionshop.biz
relayblog.com relayblog.com
retreatia.com remont-comp-pomosh.ru
reyel1985.webnode.fr remontvsamare.su
rfd-split.hr replicaclub.ru
runtnc.net replicalouboutin.xyz
rusprostitute.com research.ifmo.ru
rvtv.ru rixpix.ru
samara.rosfirm.ru robot-forex.biz
sandhillsonline.com roma-kukareku.livejournal.com
sanjosestartups.com rozalli.com
scanner-barak.top rumamba.com
scanner-margo.top runofilms.ru
scanner-walter.top runstocks.com
scoopquest.com russkoe-zdorovie.ru
screpy.com s-iwantyou.com
scrnet.biz.ua s8-nowy-wygraj.comli.com
sakhboard.ru
sbprabooks.com
sc-specialhost.com
screentoolkit.com
sdsjweb.com
search-error.com search-error.com
searchengineranker.email searchtooknow-a.akamaihd.net
searchimage.co seemoreresultshu-a.akamaihd.net
senger.atspace.co.uk semaltmedia.com
seorankinglinks.com seocheki.net
sexad.net service.adtech.fr
sexuria.net shoesonlinebuy.cn
sexxdate.net
shariki-zuma-lines.ru
shikiso.info
shoplvlv.us
shoppingmiracles.co.uk
shoppytoolmac.com shoppytoolmac.com
sicfor.bcu.cc shopsellcardsdumps.com
site3.free-share-buttons.com shopvilleroyboch.com.ua
skanninge.se shopwme.ru
skypasss.com silktide.com
simple-share-buttons.com
site.ru
siteexpress.co.il
sixcooler.de
skylta.com
skyway24.ru skyway24.ru
slim.sellany.ru slkrm.ru
sloopyjoes.com snjatie-geroinovoy-lomki.ru
slutloadlive.com
sms2x2.ru
smsactivator.ru
snegozaderzhatel.ru
social-button.xyz social-button.xyz
socialtrade.biz social-search.me
songplanet.ru socialbuttons.xyz
sosdepotdebilan.com sockshare.net
sportbetfair.com soft1.ru
stal-rulon.ru sohoindia.net
stard.shop soietvousmaime.fr
statistici.ro solnplast.ru
statustroll.com sonata-arctica.wz.cz
streetfooduncovered.com songoo.wz.cz
strongsignal-a.akamaihd.net sonnikforme.ru
stuffpride.com space2019.top
sureone.pro splendorsearch-a.akamaihd.net
susanholtphotography.com stairliftstrue.com
svetlotorg.ru stjamesschool.info
svetodiodoff.ru sumo.com
svtrd.com sunflowerdrawingpaintings.blogspot.com
swinger-mobil.net supers.com.ua
tandvardshuset.net supervesti.ru
taranerymagesswa.blogspot.com surgut.zrus.org
taxi-v-eisk.ru svolze.com
tdsing.ru tackletarts.co
tech4master.com tamada69.com
technika-remont.ru tds-advert005.info
tedxrj.com teastory.co
terraclicks.com teenbbw.yopoint.in
thecoral.com.br teenforporn.com
thedownloadfreeonlinegames.blogspot.com teesdaleflyballclub.co.uk
theprofitsmaker.net tehngr.ru
thetoiletpaper.com templates.franklinfire.co
tizanidine4mgprice.blogspot.com teslathemes.com
tizanidine4mgstreetprice.blogspot.com testingads.pro
tizanidinedrugtest.blogspot.com tetracsaudi.com
tizanidinepills.blogspot.com textads.men
tizanidineusedfor.blogspot.com thebluenoodle.com
tizanidinewithdrawal.blogspot.com titslove.yopoint.in
tnctrx.com tizanidine6mg.blogspot.com
toondinsey.com tizanidineformigraines.blogspot.com
top1-seo-service.com tizanidinehcl2mg.blogspot.com
topanasex.com tizanidinehcl2mgsideeffects.blogspot.com
topcasinoratings.ru tizanidinesleepaid.blogspot.com
touchmods.fr tizanidinevssoma.blogspot.com
tourismvictoria.com topvidos.ru
torrentred.games
totu.us
tpu.ru
tracfone.com
track.deriv.com
tracklead.net tracklead.net
traffpartners.com traffic100.com
trainoffend.ml trafficjunky.com
tri-slona.org traffixer.com
triumf-realty.ru truebeauty.cc
tuckermktg.com tsyndicate.com
tv-spoty.info tula.howotorg.ru
twu.com.ua turist-strani.ru
uchebavchehii.ru twelvevisionspartyofcolorado.com
uptime-delta.net twinderbella.com
usswrite.com uasb.ru
udsgame.online
ugogo.info
um-razum.ru
umekana.ru
unisexjewelry.org
upupa.net
urlcut.ru
uroffer.link
uroki.net
v24s.net v24s.net
vedomstvo.net vandrie-ict.nl
verymes.xyz vchulkax.com
via-energy-cumpara.com velpanex.ru
video-chat.cn via-gra.webstarts.com
videonsk.com viagroid.ru
videospornogratisx.net videospornogratisx.net
vip-file.com villakohlanta.nu
visa-pasport.ru vipromoffers.com
vodaodessa.com virtuagirl.com
voditeltrezviy.ru visionwell.com.cn
voluumtrk.com vizag.kharkov.ua
vpnhowto.info voloomoney.com
vuclip.com vzglyadriv.kg
vykupavto-krasnodar.ru
vysigy.su
vzube.com vzube.com
wahicbefa31.soup.io w3data.co
wapsite.me web-analytics.date
webextract.profound.net web.cvut.cz
webix.me website-speed-checker.site
webjam.com website-speed-up.top
webnode.me websiteexplorer.info
winner7777.net wesharepics.com
wiosenny-bon-1500.pl wheelchairliftsarea.com
witherrom55.eklablog.fr wholinkstome.com
wonderfulflowers.biz womama.ru
woodyguthrie.se
wordpress-crew.net
world-mmo.com world-mmo.com
worldhistory.biz
wurr.voila.net wurr.voila.net
xdoza.com www.souvenirua.com
xmnb.net xboxster.ru
xmronta.com xitjw.info
xn--80ahvj9e.xn--p1ai xjrul.com
xn--80ajbshivpvn2i.xn--p1ai xlovecam.com
xn--b1addnj3cah.xn--p1ai xn--80ak6aa92e.com
xn--lifehacer-1rb.com xsfetish.org
xportvusbdriver8i.snack.ws xtremeeagles.net
xtraffic.plus xxart.ru
xvideosporn.biz xxx-treker.ru
xxx-cam.webcam xxxtubesafari.com
xxxnatelefon.ru yaminecraft.ru
xxxsiterips.xyz
y8games-free.com
yellowads.men yellowads.men
youjizz.com yellowproxy.net
yourothersite.com youresponsive.com
yourporn.com yoursearch.me
ytmnd.com yugo-star.ru
yugk.net yunque.pluto.ro
yur-p.ru zajm-zalog-krasnodar.ru
zaim-pod-zalog-krasnodar.ru
zambini.ru zambini.ru
zarepta.com zeroredirect10.com
zigarettenonlinekaufen2.bloog.pl znakomstva-piter78.ru
zolotoy-lis.ru znakomstvaonlain.ru
zoogdinsney.com zone-kev717.info
zscalerone.net
zvetki.ru

492
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
1-99seo.com 1kdailyprofit.me
7a2rnuey1tw9ar.ru 2728fb936f0.com
aaronabel.com 51unlim.ru
add-add.men 7minuteworkout.com
advancedcleaner.com 8gold.com
aa9bd78f328a6a41279d0fad0a88df1901.com
aa9d046aab36af4ff182f097f840430d51.com
ad-words.ru
addbin.men
adtiger.tk
akama.com
albamargroup.com albamargroup.com
alienwheels.de algerianembassy.co.in
all-streaming-media.com alkoravto.ru
allproblog.com allmarketsnewdayli.gdn
amehdaily.com amateurmatch.com
an-donut.com animebox.com.ua
anapa-inns.ru animenime.ru
atley.eu.pn apimegabrowsebiz-a.akamaihd.net
autotrends.today apioutoboxnet-a.akamaihd.net
autowebmarket.com.ua appmsr.org
avitocars.ru arewater.com
banan.tv azadnegar.com
bangla-chat-uk-paralud.ga azbukafree.com
bausparen.bz.it azinoofficial777.ru
beauty-things.com baixar-musicas-gratis.com
belsetirehafi.tk basedecor.ru
bestofpicture.com bear.gotcher.us
bet365.com best-mam.ru
bitcoinpile.com betune.onlinewebshop.net
blog.koorg.ru bio-japan.net
blogig.org bioscorp.ru
bolegapakistan.com bitcoins-live.ru
bosefux.esy.es blog.f00kclan.de
bracketsmackdown.com book-bets.com
brateg.xyz braindaily.xyz
btc4u.ru bristolhotel.com.ua
buypuppies.ca browsepulse-a.akamaihd.net
buyscabiescream.com callstevens.com
chatroulette.world cardsharp1.ru
checkm8.com cartierreplica.top
ci.ua casite-513049.cloudaccess.net
cibpenonptib.flu.cc cementaresearch.se
clickbanksites.info centraletermice.us
com-onlinesupport.host chatroulette.life
compliance-alex.xyz christianlouboutinreplica.win
compliance-george.xyz cialischsrx.com
compliance-julia.top clicksor.com
confib.ifmo.ru compliance-jack.top
consorzioilmosaico.org contentlook.co
countbertwistdisp26.soup.io coolwallpapers4k.info
crest-poloski.ru
dafatiri.com
dailyrank.net
daydream-studio.ru daydream-studio.ru
detskie-konstruktory.ru derevesendeco.com
devochki.top dfwu1013.info
domashneeruporno.com dfwu1019.info
downloadme.life divci-hry.info
downloadmefiranaratb1972.xpg.com.br dmmspy.com
druzhbany.ru doeco.ru
dumpsmania24.com dogsrun.net
elektrischezigarette2.devhub.com drev.biz
elektrozigaretten1.tumblr.com elmifarhangi.com
eluxer.net eralph.tk
emergencyneeds.org extremal-blog.com
everytalk.tv ezigarettekaufen2.mpbloggar.se
expolicenciaslatam.co fanpagerobot.com
ezigarettenshop2.postbit.com fastfixing.tech
feeriaclub.ru fikasound.tk
financehint.eu filmidivx.com
financeloan.us firstsiteguide.com
flauntyoursite.com foxweber.com
flipper.top free-fb-traffic.com
forexgb.ru freelinkbuilding.website.tk
forminecrafters.ru freeseedsonline.com
forpostlock.ru front.ru
forum-engineering.ru fxgallery.com
free-gluten.ru gallery.rennlist.com
free-share-buttons.com gamblingnerd.com
galeria-zdjec.com gamesprite.me
gallerylisting.com gearsadspromo.club
ge0ip.net gelezki.com
getresponse.com getlamborghini.ga
girlsfuckdick.com goforexvps.com
golaya.pw goo.ne.jp
greatgrace.ru gpirate.com
gsasearchengineranker.pw guruofcasino.com
gsasearchengineranker.space h2monline.com
gsasearchengineranker.xyz hamilton.ca
habermetre.com heroz.fr
happy.new.yeartwit.com hjaoopoa.top
heartofpayne.xyz homegardenlova.com
homeart.space hoterika.com
hustoon.over-blog.com hotxnights.info
iboss.com housediz.com
ideashome.id ido3.com
igadgetsworld.com imgarcade.com
images-free.net imguramx.pw
indo-export.ru impresagaia.it
infektsii.com indiakino.net
instasexyblog.com insurple.com
investingclub.ru irkutsk.online-podarki.com
iskalko.ru janerikholst.se
istizanidinelikexanax.blogspot.com kam-dom.ru
ivearchenceinflu.cf kemerovo.zrus.org
javxxx18.com kerch.site
jerseywholesalechinabiz.com keywordbasket.com
jurajskie.info komp-pomosch.ru
keywesthideaways.co ks1234.com
kinoplen.ru kustanay.kz
kolotiloff.ru lalalove.ru
krasula.pp.ua leadwayau.com
kskjco.club linerdrilling.com
landscaping.center m292.info
leftofcentrist.com mafa-free.com
littlesunraiser.com maxthon.com
live-sexcam.tk medkritika.ru
lizace.com medmajor.ru
lyrics.home-task.com mensandals.xyz
machicon-akihabara.info menstennisforums.com
magento-crew.net metafilter.com
maju.bluesalt.co mexicosleevegastrectomy.com
mansiondelrio.co mlf.hordo.win
maranbrinfo.com.br mmoguider.ru
mararoom.ru mmostrike.ru
marinetraffic.com monarchfind-a.akamaihd.net
maslenka.kz monclercheap.xyz
matpre.top moncleroutletonline.win
mebel-alait.ru mossmesi.com
merryhouse.co.uk muizre.ru
mikrobiologies.ru musicstock.me
mirobuvi.com.ua muznachas-service.ru
mobplayer.net mykings.pw
mobsfun.net nacap.ru
modabutik.ru nastydollars.com
mokrayakiska.com newstraveller.ru
mrbojikobi4.biz northfacestore.online
msfsaar.de oakridgemo.com
myhitmp3.club oktube.ru
myphotopipe.com online-templatestore.com
napalm51.nut.cc onlyforemont.ru
needtosellmyhousefast.com openlibrary.org
offergroup.info ostroike.org
online247.ml ovirus.ru
onlinebay.ru ozoz.it
onlinefilmz.net partner-cdn.men
onlinemeetingnow.com partner-print.men
park.above.com partnerads.men
patterntrader-en.com pestomou.info
paydayonlinecom.com photosaga.info
pizdeishn.com physfunc.ru
plastgranar.nu pila.pl
platezhka.net pladform.ru
poffet.net plusnetwork.com
pontiacsolstice.info pogosh.com
popup-fdm.xyz poligon.com
popup.matchmaker.com pons-presse.com
porndairy.in porno-home365.com
porno-chaman.info pornoblood.com
porno-transsexuals.ru pornotubexxx.name
pornogad.com pornstartits.xblog.in
pornoklad.ru potolokelekor.ru
pornoslive.net promoheads.com
pornoxxx.com.mx prostitutki-rostova.org
preconnubial.usuby.site ranksonic.org
pro-poly.ru realnye-otzyvy.info
prostitutki-almata.org registry-cleaner.net
prostitutki-astana.org reklama-i-rabota.ru
pussyfleet.com renewablewealth.com
putevka24.ru rezeptiblud.ru
quangcaons.com robot-forex.biz
rainbowice.ru rusenvironmental.net
rankexperience.com rybalka-opt.ru
rcb101.ru s.lollypopgaming.com
redirlock.com saletool.ru
remote-dba.de sampleletters.net
rep-am.com santasgift.ml
rff-cfal.info sbetodiodnye-lampy.ru
ribieiendom.no sbricur.com
rique.host.sk sdelai-prosto.ru
rockma.se semalt.com
roofers.org.uk seobility.net
ruscopybook.com service.adtech.fr
saugatuck.com serw.clicksor.com
scmor.ilxc.cc shakhtar-doneck.ru
searchimpression.com shinikiev.com.ua
sel-hoz.com shoesonlinebuy.cn
semp.net shopvilleroyboch.com.ua
seo-traffic-ranking.info shtaketniki.kz
sex-znakomstva.online sibvitr.ru
sexvideo-sex.com sindragosa.comxa.com
shijian.ac.cn sivs.ru
sibdevice.ru slowmac.tech
sisiynas.ru snjack.info
sms2x2.ru snjatie-geroinovoy-lomki.ru
sonata-arctica.wz.cz snowplanes.com
spymac.net sodexo.com
spywarebegone.com soundfrost.org
start.myplaycity.com strag-invest.ru
stats-public.grammarly.io strigkaomsk.ru
stillmiracle.com svensk-poesi.com
stockquotes.wooeb.com taqplayer.info
stroilka.info taqywu51.soup.io
strongholdsb.ru taximytishi.ru
strongsignal-a.akamaihd.net theendivechronicles.com
svarbit.com thepokertimer.com
tabakur77.com tizanidineduringpregnancy.blogspot.com
tako3.com tizanidinenarcotic.blogspot.com
tgtclick.com tizanidinewithdrawal.blogspot.com
timdreby.com tomck.com
tizanidinesleepaid.blogspot.com top-deal.com.pl
tk-assortiment.ru topmira.com
tnaionline.org touchmods.fr
tooplay.com tracfone.com
topanasex.com tracksurf.daooda.com
torrentdownloadhub.com tracksz.co
trafficnetzwerk.de trafficfactory.biz
trustedmaccleaner.com ttsq.fr
ttrraacckkrr.com tupper-posuda.ru
turvgori.ru turizm.bz
tvand.ru turkeyreport.tk
u-cheats.ru twittruth.com
uggbootsoutletsale.us tytoona.com
unisexjewelry.org ukkelberg.no
vesnatehno.ru upupa.net
viel.su vchulkah.net
virus-schutzmasken.de vroze.com
vizitki.net vuclip.com
vk-mus.ru wapsite.me
vut.com.ru watchmygf.net
vzglyadriv.kg web-analytics.date
w3javascript.com while.cheapwebsitehoster.com
wareseeker.com williamrobsonproperty.com
watchdogs-2.ru wleuaprpxuvr.ga
welcomeauto.ru wnhjavlhezp.gq
wemarketing.se womama.ru
wesharepics.com worldis.me
wieseversa.no xn-----6kcaabbafhu7cskl7akvongwpo7hvjj.xn--p1ai
wildcattube.com xn--e1aggki3c.xn--80adxhks
wordkeyhelper.com xnxxandxvideos.com
x-diesel.biz
x-true.info
xblognetwork.com
xn--d1acah0c.xn--p1ai
xrus.org xrus.org
you-shall-not-pass.is74.ru xsfetish.org
yoursearch.me xxxsiterips.xyz
yubikk.info yatrk.xyz
za-fun-offer.com youghbould.wordpress.com
zahvat.ru yourporn.com
zaimhelp.ru zapiszto.pl
zhuravlev.info zastenchivosti.net
zed21.net
zhacker.net
znaturaloriginal.com znaturaloriginal.com
zophim.me zverokruh-shop.cz
zscalerone.net

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.2.12 0; 10.1.0.44 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.10.3391 ### Version: V4.2022.10.3392
### Updated: Wed Oct 5 10:03:55 UTC 2022 ### Updated: Wed Oct 5 22:01:24 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.10.3391 ### Version: V4.2022.10.3392
### Updated: Wed Oct 5 10:03:55 UTC 2022 ### Updated: Wed Oct 5 22:01:24 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##