vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-03 19:20:16 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2022.11.3461 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2022-11-09 22:07:04 +00:00
parent 28391e92b3
commit 2425f31d74
46 changed files with 94743 additions and 94743 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.11.3460 #### Version: V4.2022.11.3461
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.11.3460 #### Version: V4.2022.11.3461
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -14,7 +14,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2022.11.3460 #### Version: V4.2022.11.3461
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

11708
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2022.11.3460 #### Version: V4.2022.11.3461
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

11712
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

11712
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

11712
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

11712
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.121 1; 10.1.0.61 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.121 0; 10.1.0.61 0;
127.0.0.1 0; 127.0.0.1 0;

11712
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.121 1; 10.1.0.61 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.121 0; 10.1.0.61 0;
127.0.0.1 0; 127.0.0.1 0;

11712
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.121 1; 10.1.0.61 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.121 0; 10.1.0.61 0;
127.0.0.1 0; 127.0.0.1 0;

11712
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
3460 3461

11712
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

11712
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
172.173.162.225 0; 20.114.139.174 0;

11712
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.121 1; 10.1.0.61 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.121 0; 10.1.0.61 0;
127.0.0.1 0; 127.0.0.1 0;

11712
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.121 1; 10.1.0.61 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.121 0; 10.1.0.61 0;
127.0.0.1 0; 127.0.0.1 0;

11712
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.121 1; 10.1.0.61 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.121 0; 10.1.0.61 0;
127.0.0.1 0; 127.0.0.1 0;

11712
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
172.173.162.225 0; 20.114.139.174 0;

11712
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
172.173.162.225 0; 20.114.139.174 0;

11712
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.121 1; 10.1.0.61 1;
127.0.0.1 1; 127.0.0.1 1;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
Cliqzbot Cogentbot
EirGrabber Disco
Fyrebot LinkpadBot
InternetSeer PleaseCrawl
LinksManager Sucker
MJ12bot TurnitinBot
SeobilityBot WebStripper
Web Sucker WebWhacker
Website Quester Wprecon
ripz plumanalytics

310
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
01h4x.com 01h4x.com
ADmantX
AIBOT
ALittle Client ALittle Client
ASPSeek
Aboundexbot Aboundexbot
Acunetix AiHitBot
Aipbot Aipbot
Alexibot
AllSubmitter AllSubmitter
AlphaBot Anarchy99
Anarchy Apexoo
Ankit AwarioRssBot
Atomseobot
BBBike BBBike
BDCbot BLEXBot
BDFetch
BackDoorBot
BackStreet
BackWeb BackWeb
BacklinkCrawler Backlink-Ceck
Barkrowler BatchFTP
BetaBot BetaBot
Bigfoot
Blow Blow
BlowFish
Boardreader Boardreader
CSHttp Brandprotect
Brandwatch
Buddy
BuiltBotTough
BuiltWith
BunnySlippers
CCBot
CazoodleBot CazoodleBot
Cegbfeieh Cegbfeieh
CensysInspect CensysInspect
CheTeam
ChinaClaw
Claritybot Claritybot
Cocolyzebot Cloud mapping
Cogentbot Cogentbot
CopyRightCheck Copier
Copyscape Cosmos
Craftbot
Crawling at Home Project Crawling at Home Project
Curious DBLBot
DTS Agent DSearch
DataCha0s DataCha0s
DatabaseDriverMysqli
Demon Demon
Deusu Digincore
Devil Dirbuster
DittoSpyder Discobot
DnBCrawler-Analytics DnyzBot
DomCopBot DomCopBot
DomainCrawler
DomainSigmaCrawler DomainSigmaCrawler
DomainStatsBot DomainStatsBot
EMail Siphon
EMail Wolf
EasyDL EasyDL
Evil Ebingbong
Exabot Ecxi
Express WebPictures EroCrawler
FemtosearchBot Extractor
Firefox/7.0 ExtractorPro
EyeNetIE
Ezooms
FDM
Foobot
Freeuploader Freeuploader
FrontPage FrontPage
Fuzz GT::WWW
G-i-g-a-b-o-t GalaxyBot
Genieo
GetRight GetRight
GetWeb
Getintent Getintent
Go-Ahead-Got-It Gigabot
HMView Gotit
HTTP::Lite Grabber
Grafula
Haansoft
HaosouSpider
Harvest Harvest
Heritrix Heritrix
Hloader HonoluluBot
Humanlinks Humanlinks
HybridBot HybridBot
IRLbot IDBTE4M
Iblog Image Fetch
IndeedBot Image Sucker
Internet Ninja Indy Library
InfoNaviRobot
Intelliseek
InternetSeer
Iskanie
IstellaBot
JamesBOT JamesBOT
JikeSpider JennyBot
Joomla JetCar
Kenjin Spider Jetty
Keybot Translation-Search-Machine Jyxobot
Kinza Kinza
Kozmosbot
LNSpiderguy LNSpiderguy
Larbin LWP::Simple
LeechFTP LeechFTP
LeechGet
LexiBot LexiBot
Lightspeedsystems Lftp
LibWeb
LieBaoFast
LinkScan
LinkWalker
Linkbot Linkbot
LinkpadBot
LinqiaMetadataDownloaderBot LinqiaMetadataDownloaderBot
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey
Lipperhey Spider Lipperhey Spider
Litemage_walker Litemage_walker
MFC_Tear_Sample MIDown tool
MIIxpc MSFrontPage
MQQBrowser Mag-Net
Magnet Mail.RU_Bot
Majestic SEO MauiBot
Majestic12
MarkWatch
Masscan
Mata Hari
Mb2345Browser
MeanPath Bot MeanPath Bot
Meanpathbot
MegaIndex.ru
Metauri
Microsoft Data Access
Moblie Safari Moblie Safari
Mojeek MolokaiBot
Morfeus Fucking Scanner
Mozlila
Mr.4x3 Mr.4x3
Musobot Msrabot
NICErsPRO
NPbot NPbot
Navroad
NearSite NearSite
Netcraft Nessus
Nibbler Net Vampire
NetAnts
NetSpider
Nettrack
Niki-bot
Nikto
Nimbostratus Nimbostratus
Ninja
Nmap Nmap
Offline Explorer Not
Offline Navigator Nutch
OnCrawl OnCrawl
OpenLinkProfiler
OpenVAS OpenVAS
OrangeBot OrangeBot
OrangeSpider OrangeSpider
PHPCrawl PHPCrawl
PageThing.com POE-Component-Client-HTTP
Pavuk Page Analyzer
Pi-Monster PageScorer
PictureFinder Pandalytics
Piepmatz PeoplePal
Picscout
Pixray Pixray
Probethenet ProWebWalker
PxBroker Psbot
QueryN Metasearch Pu_iN
Quick-Crawler Quick-Crawler
RankActive RSSingBot
RankActiveLinkBot RankActiveLinkBot
RankFlex Reaper
RankingBot
Rankivabot
RealDownload
RebelMouse
RedesScrapy RedesScrapy
Rogerbot Rogerbot
SBIder
SEOkicks SEOkicks
SEOkicks-Robot
SEOlyticsCrawler SEOlyticsCrawler
SEOprofiler
SISTRIX
SMTBot
SalesIntelligent SalesIntelligent
ScanAlert
Scanbot Scanbot
ScoutJet
Screaming Screaming
ScrepyBot SearchmetricsBot
Searchestate Semrush
Seekport
SemrushBot
SentiBot SentiBot
Shodan SiteCheckerBotCrawler
Site Sucker SiteExplorer
SiteSnagger SiteLockSpider
Sitebeam Sitebeam
SmartDownload
Snake
Snapbot
Snoopy Snoopy
SpaceBison Sociscraper
Spammen Sottopop
SpankBot SpankBot
Spbot Spanner
SputnikBot
Sqlworm
Sqworm Sqworm
Stripper Sucker
Surfbot Surfbot
Szukacz Swiftbot
T0PHackTeam
T8Abot T8Abot
Teleport Teleport
The Intraformant
Thumbor Thumbor
TightTwatBot
Titan Titan
Toata Toata
Toweyabot
Tracemyfile Tracemyfile
TurnitinBot Trendiction
Trendictionbot
Turingos
TwengaBot TwengaBot
URLy.Warning Twice
UnisterBot Typhoeus
VB Project VCI
VeriCiteCrawler Vacuum
VidibleScraper Vagabondo
Virusdie Virusdie
Voltron
WISENutbot WISENutbot
WWWOFFLE WWW-Collector-E
WallpapersHD WWW-Mechanize
WWW::Mechanize
Wallpapers
Web Collage Web Collage
Web Fuck Web Fuck
WebCopier Web Pix
Web Sauger
WebAuto
WebFetch WebFetch
WebImageCollector
WebLeacher WebLeacher
WebReaper
WebSauger
WebWhacker WebWhacker
WebZIP Webalta
WebmasterWorldForumBot WebsiteQuester
Webshag
Website Quester
Webster
Whack
Whacker
Whatweb Whatweb
Widow WinHTTrack
Wotbox Wonderbot
Xenu Xenu
Zitebot Zade
Zermelo
ZoomBot
ZoominfoBot ZoominfoBot
ZumBot
adscanner adscanner
archive.org_bot
arquivo.pt arquivo.pt
backlink-check
check1.exe check1.exe
clark-crawler
coccocbot
cognitiveseo cognitiveseo
com.plumanalytics com.plumanalytics
crawl.sogou.com
crawler4j
dataforseo.com dataforseo.com
demandbase-bot demandbase-bot
gopher gopher
heritrix muhstik-scan
internetVista monitor page scorer
iubenda-radar pcBrowser
lwp-trivial
magpie-crawler
meanpathbot
netEstate NE Crawler
plumanalytics
polaris version polaris version
s1z.ru probe-image-size
scan.lol ripz
seobility scalaj-http
seocompany.store
seoscanners
serpstatbot
siteripz siteripz
sogouspider sogouspider
sp_auditbot spyfu
sysscan trendiction.com
voyagerx.com x09Mozilla
xpymep1.exe x22Mozilla
zauba.io
zgrab

308
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
01h4x.com
360Spider 360Spider
Abonti 404checker
Aboundex 404enemy
Aboundexbot AhrefsBot
Acunetix Aipbot
AfD-Verbotsverfahren Alexibot
AllSubmitter Atomseobot
AlphaBot Attach
Anarchy99
Ankit
AwarioRssBot AwarioRssBot
AwarioSmartBot
BBBike
BDCbot
BDFetch BDFetch
BackWeb BLEXBot
Backlink-Ceck Backlink-Ceck
BacklinkCrawler Barkrowler
BetaBot
Bigfoot Bigfoot
Black Hole
BlackWidow BlackWidow
Blackboard Blackboard
BlowFish Bolt
BotALot Buck
Brandwatch Buddy
BuiltWith BuiltBotTough
BuzzSumo BunnySlippers
CATExplorador CATExplorador
CCBot CCBot
Calculon
CazoodleBot
Cegbfeieh Cegbfeieh
CensysInspect CensysInspect
Chlooe CheTeam
Citoid Citoid
Claritybot Cocolyzebot
Collector Copier
CopyRightCheck
Copyscape Copyscape
Craftbot Craftbot
Crawling at Home Project Curious
CrazyWebCrawler
CrunchBot
DIIbot DIIbot
DSearch
DataCha0s DataCha0s
DatabaseDriverMysqli
Demon
Deusu
Devil Devil
Digincore
DigitalPebble DigitalPebble
DittoSpyder Discoverybot
DnyzBot
DomCopBot
DomainCrawler DomainCrawler
DomainSigmaCrawler Dotbot
DomainStatsBot Download Wonder
Domains Project Dragonfly
Drip
ECCP/1.0 ECCP/1.0
EMail Wolf
EasyDL
Ebingbong
Ecxi
Evil Evil
Exabot Exabot
ExtLinksBot Express WebPictures
Extractor Extractor
ExtractorPro ExtractorPro
Extreme Picture Finder
Ezooms
FDM
FHscan FHscan
Fimap
FrontPage
FyberSpider FyberSpider
Fyrebot
GT::WWW GT::WWW
GalaxyBot
Genieo Genieo
Go-Ahead-Got-It Getintent
Gotit
Grabber Grabber
GrapeshotCrawler GrapeFX
Harvest HEADMasterSEO
HTMLparser
Haansoft
HaosouSpider
Havij
Heritrix Heritrix
HonoluluBot
Humanlinks Humanlinks
IDBTE4M
IDBot IDBot
Id-search IRLbot
IlseBot IndeedBot
Image Fetch InfoTekies
InterGET Intelliseek
InternetSeer InternetSeer
Iria Iskanie
IstellaBot IstellaBot
JennyBot JamesBOT
JetCar Jbrofuzz
JikeSpider Jetty
Jorgee
Keybot Translation-Search-Machine
Keyword Density Keyword Density
Kinza Kinza
LNSpiderguy Kozmosbot
LWP::Simple LWP::Simple
Leap
LeechFTP LeechFTP
LeechGet
Lftp
LibWeb LibWeb
Libwhisker Libwhisker
Lightspeedsystems LinkWalker
LinkScan LinkextractorPro
LinqiaScrapeBot LinkpadBot
Lmspider LinksManager
MFC_Tear_Sample LinqiaMetadataDownloaderBot
MJ12bot Lipperhey
MSFrontPage Lipperhey Spider
Litemage_walker
Ltx71
MQQBrowser
MTRobot MTRobot
Mag-Net Majestic SEO
Mail.RU_Bot
Majestic-SEO
Majestic12 Majestic12
MarkMonitor Masscan
Mass Downloader
Mata Hari Mata Hari
MauiBot
Mb2345Browser Mb2345Browser
Microsoft Data Access MeanPath Bot
Mojeek Meanpathbot
Mojolicious Mediatoolkitbot
Morfeus Fucking Scanner MegaIndex.ru
Metauri
Moblie Safari
Mozlila Mozlila
Mr.4x3 NearSite
NICErsPRO
NPbot
Navroad
Net Vampire Net Vampire
NetLyzer NetLyzer
NetMechanic
NetZIP
Netcraft
Nikto Nikto
NimbleCrawler Nmap
Ninja Nutch
Not Offline Explorer
Octopus
Offline Navigator
OnCrawl OnCrawl
OpenVAS OpenLinkProfiler
Openvas OutclicksBot
OutfoxBot OutfoxBot
PHPCrawl Page Analyzer
PageAnalyzer PageAnalyzer
PageScorer PageGrabber
Pandalytics Pandalytics
Papa Foto Papa Foto
Pavuk
PeoplePal PeoplePal
Pi-Monster Pi-Monster
Picscout
Picsearch Picsearch
PictureFinder
Piepmatz Piepmatz
Pixray
PleaseCrawl PleaseCrawl
Pockey Pockey
Psbot ProWebWalker
Pu_iN Pu_iN
PyCurl QueryN Metasearch
Quick-Crawler
RSSingBot RSSingBot
RankActive RankurBot
Rankivabot ReGet
RealDownload
Reaper Reaper
RebelMouse RepoMonkey
Recorder Rogerbot
RedesScrapy
Ripper
SBIder SBIder
SEOkicks SEOkicks
SEOprofiler SEOstats
SMTBot
SalesIntelligent SalesIntelligent
ScanAlert ScoutJet
ScrepyBot Screaming
Searchestate
SemrushBot
SentiBot
SeoSiteCheckup SeoSiteCheckup
SeobilityBot
Shodan Shodan
SiteCheckerBotCrawler SiteSucker
SiteExplorer SmartDownload
SiteLockSpider
Siteimprove
Snake
Snapbot Snapbot
Snoopy Sosospider
Sogou web spider SpaceBison
Sottopop
Spammen Spammen
Spbot Spanner
Steeler Spinn3r
Szukacz Sucuri
Swiftbot
T8Abot T8Abot
TeleportPro Telesoft
Telesphoreo The Intraformant
TheNomad
Toata Toata
Tracemyfile True_Robot
Turingos
TwengaBot
Typhoeus Typhoeus
URLy Warning
URLy.Warning URLy.Warning
Upflow
V-BOT V-BOT
Vagabondo VCI
Vacuum
VelenPublicWebCrawler VelenPublicWebCrawler
VeriCiteCrawler VeriCiteCrawler
VidibleScraper
Virusdie Virusdie
VoidEYE
Voil
WBSearchBot WBSearchBot
WEBDAV WISENutbot
WWW::Mechanize WeSEE
WWWOFFLE Web Fetch
WallpapersHD Web Pix
Web Auto
Web Collage
Web Sucker Web Sucker
WebCollage WebFuck
WebCopier WebGo IS
WebPix
WebReaper WebReaper
WebStripper WebSauger
WebSucker WebSucker
WebWhacker WebmasterWorldForumBot
Webshag Webster
WebsiteQuester
Whacker Whacker
Whatweb Who.is Bot
WinHTTrack Woobot
Wonderbot Wotbox
YoudaoBot Xaldon WebSpider
Xenu
Zauba
Zermelo
ZmEu ZmEu
ZoomBot
ZumBot ZumBot
coccocbot ZyBorg
crawler4j archive.org_bot
dataforseo.com arquivo-web-crawler
backlink-check
cognitiveseo
com.plumanalytics
crawl.sogou.com
demandbase-bot
domainsproject.org domainsproject.org
gopher heritrix
ips-agent internetVista monitor
isitwp.com linkdexbot
lwp-request
magpie-crawler magpie-crawler
mediawords mediawords
netEstate NE Crawler netEstate NE Crawler
oBot polaris version
pcBrowser
s1z.ru s1z.ru
scalaj-http scalaj-http
scan.lol
seobility seobility
seocompany.store
seostar seostar
sitechecker.pro sexsearcher
sogouspider sp_auditbot
spyfu
sysscan sysscan
trendiction.com
ubermetrics-technologies.com ubermetrics-technologies.com
webmeup-crawler webpros.com
x09Mozilla x09Mozilla
x22Mozilla
xpymep1.exe
zauba.io
zgrab zgrab

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
aliexpresscashback.club cakesplus.com.au
babieca.com circlesl.com
bestprofits-there.com energydiet-info.ru
deplim.com hayate.biz
erotikchat-24.com healgastro.com
photokitchendesign.com invest-pamm.ru
pornoelita.info lacapilla.info
razvratnoe.org stroimajor.ru
tsyndicate.com whipme.yopoint.in
videochat.ph x-porno.video

924
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
0daymusic.org 101raccoon.ru
123kuma.com 12u.info
1j7740kd.website 13tabs.com
3weekdiet.com 178evakuator178.ru
45en.ru 214jaluwobapef.cf
4replicawatch.net 24-ak.ru
5ws.dating-app.ru 273-fz.ru
8xv8.com 4kepics.com
a14download.com 51unlim.ru
aa8780bb28a1de4eb5bff33c28a218a930.com 7yue.org
aanapa.ru 7zap.com
abcdefh.xyz a.frcls.fr
acmebtn.ml aarbur.com
addray.pro absolute-s.ru
adultfullhd.com abwa.tk
aero2.ru academia-nsk.org
affrh2015.com acheterviagrafr24.com
afftrack001.com adcash.com
agreda.pluto.ro adconscious.com
alfa-img.com adman.se
alive-ua.com admeasures.com
all-number.com adservme.com
all4wap.ru adsref.men
alpinism.ru adtech.us
altamayoztourism.com adult3dgames.com
am-se.com adultwebhosting.info
amazingpic.net agysya.ru
akama.com
akita.kz
alert-hgd.xyz
alfabot.xyz
allesohnegirls.net
allsilver925.co.il
amospalla.es amospalla.es
anime.dougasouko.com ample-awards-today.us
apartamentwroclaw.eu ampower.me
apartmentbay.ru anatomiy.com
apessay.com androids-store.com
animalrank.com
animaltoplist.com
apiallgeniusinfo-a.akamaihd.net
apilinkswiftco-a.akamaihd.net apilinkswiftco-a.akamaihd.net
apiluckyleapnet-a.akamaihd.net apiportalmorecom-a.akamaihd.net
appsecurityr.com apper.de
aquarium-pro.ru aquarium-pro.ru
ardimobileinfo.ml articlesdirectoryme.info
arendakvartir.kz auto-moto-elektronika.cz
artparquet.ru auto.rusvile.lt
aruplighting.com autoplate.info
asociatia-tipografilor-transilvania.ro avtointeres.ru
asseenontv.ru avtolombard-krasnodar.com
atlant-auto.info awency.com
aucoinhomes.com axbocz.net
autobudpostach.club azartniy-bonus.com
autoua.top azbukadiets.ru
avramstroy.ru baditri.com
azazu.ru baersaratov.ru
azinoofficial777.ru baixar-musicas-gratis.com
babieca.com balla-boo.se
badavit.com.ua bankiem.pl
baltgem.com
banksrf.ru
battle.net
battlecarnival.su
bdsmgalls.net bdsmgalls.net
bear.gotcher.us bear.gotcher.us
beauty-bracelet.com beatifullandscape.co
beauty-clinic.ru becuo.com
belstaffstore.online bedandbreakfast.com
best-mam.ru bestcurs.org
besthomemadepornsites.com besthomemadepornsites.com
bestkfiledxd.cf bin-brokers.com
bestmarriages.com bioca.org
besttorrentknifta.weebly.com bjanshee.ru
bidbuy.co.kr bloggers.nl
bigcities.org blogs.rediff.com
biographiya.com bmw-ark.ru
biznesluxe.ru brandehk.dk
bkns.vn
blog.f00kclan.de
blogos.kz
blogrankers.com
bluejays-jerseys.us
bnt-team.com
bochemit.com.ua
bonzbuddy.com
bookmark4you.com
bouda.kvalitne.cz
braintobe.win
browserprotecter.com
btvn.ru
bukleteg.xyz bukleteg.xyz
bus-offer.com bumascloset.com
businesxxl.com buntube.net
buyantiviralwp.com cablecar.us
buyfriend.ru cactussoft.biz
buypuppies.ca cakesplus.com.au
canvas.gloverid.site callawaygolfoutlet.online
canyougethighofftizanidine.blogspot.com cardsdumps.com
carson.getenjoyment.net carstrends2015.com
cartujano-pre.de cartierreplica.top
casinos4dummies.co.uk casinorewards.info
cbox.ws cbox.ws
ccbill.com cbozhe.com
cctva.tv cdncash.net
cheapbarbour.online centrumcoachingu.com
chelnytruck.ru changde.58.com
choosecuisine.com cheapcigarettesc.info
cialisndbrx.com checktext.org
cigarpass.com children-learningreading.info
circlesl.com cialischmrx.com
citizenclsdriveri7.pen.io cjmc.info
cleanersoft.com clipartnew.com
club-samodelkin.ru clmforexeu.com
co.lumb.co collegeessay19.blogspot.ru
coaching-netz.info conciergegroup.org
coindirect.io constantaservice.net
community.allhiphop.com cookie-law-enforcement-ff.xyz
compliance-margo.top coolbar.pro
compliance-olga.top counterbot.com
compliance-walter.top
compucelunlock.net
computernetworksonline.com
contextualyield.com
cookie-law-enforcement-ee.xyz
coolgramgoods.com
cosmeticswomens-womensports.rhcloud.com
countercrazy.com countercrazy.com
credit-respect.ru covadhosting.biz
cubook.supernew.org customcollegeessays.net
customcatchcan.com cwetochki.ru
customerguru.in cypernhuset.se
cutalltheshit.com d2jsp.org
cymbaltaandtizanidine.blogspot.com dafatiri.com
darkages.info data-ox.com
darodar.com dating-app.ru
deda-moroza-zakaz.ru datsun-do.com
delayreferat.ru detsky-nabytek.info
dieta-personalna.pl diegolopezcastan.com
digilander.libero.it digital-sale.su
dividendo.ru dildofotzen.net
divci-hry.info
dktr.ru
dnepropetrovsk.mistr-x.org
dneprsvet.com.ua
dodlive.mil
dogbreedspicture.net dogbreedspicture.net
domain-tracker.com dogclothing.store
domainsatcost.com domashneeruporno.com
dood.live domination.ml
download-of-the-warez.blogspot.com
download-wallpaper.net download-wallpaper.net
downvids.net downloadkakaotalk.com
doyouknowtheword-flummox.ml
dptaughtme.com
drugspowerstore.com drugspowerstore.com
dwomlink.info dtnlyss.com
e-c.al easync.io
eduinfosite.com ec-file.info
elektrischezigaretten2.beeplog.com elektrozigarettekaufen1.devhub.com
elektronischezigarettekaufen2.tumblr.com elexies.info
elektrozigaretten2.yn.lt elitedollars.com
eloxal.ru elstal.com.pl
elvenmachine.com elvenar.com
empathica.com erotag.com
eropornosex.ru erotik0049.com
eshop.md escortslet.net
etm-consult.de esnm.ru
eu-cookie-law.blogspot.com
everypony.ru everypony.ru
exhibitionplus.eu exchangeit.gq
extads.net exci.ru
extrabot.com excitacion.info
extremepornos.net extener.org
ezigarettekaufen2.mpbloggar.se ezigarettenshop2.myblog.de
f-online.de ezigaretteshop.webs.com
f5mtrack.com ezrvrentals.com
facebook-mobile.xyz faithe.top
falcon-images.blogspot.com fanoboi.com
familyholiday.ml fashion.stellaconstance.co
felizporno.com fast-torrent.ru
feorina.ru fbdownloader.com
ferrotodo.com feeriaclub.ru
ferretsoft.com
fickkontaktehobbyhuren.com fickkontaktehobbyhuren.com
figuringmoneyout.com filesdatabase.net
financetip.eu firesub.pl
flashlarevista.com fix-website-errors.com
footbalive.org forexunion.net
fortwosmartcar.pw forum.doctissimo.fr
forum20.smailik.org free-stock-illustration.com
frameimage.org freevpn.space
free-share-buttons.top freewhatsappload.com
front.ru freewlan.info
fuck-paid-share-buttons.xyz freshwallpapers.info
fyl.com.ru gael-s.ru
game300.ru gallerily.com
gameonasia.com gambarkataku.co
gazobeton-p.com.ua games.kolossale.ru
geckoandfly.com geckoandfly.com
getoutofdebtfree.org gemgrab-a.akamaihd.net
gifspics.com gentamicineyedrops.blogspot.com
girlgamerdaily.com getmyads24.com
girlporn.ru ghostvisitor.com
girlsfuckdick.com glavprofit.ru
gktt.ru glcomputers.ru
glicol.kz go2album.com
globalsurfari.com go2mike.ru
goodly.pro gobongo.info
goodprotein.ru goodnightjournal.com
gotomontenegro.net googlsucks.com
greatidea.marketing greatgrace.ru
green-tea.tv hamacapty.com
groupmoney.ru hasshe.com
growshop.es
grupografico-pilar.com.ar
gsasearchenginerankerhelp.com
gyffu.com
hccoder.info hccoder.info
hdapp1008-a.akamaihd.net hdhc.ru
hem.passagen.se hdpixion.com
healgastro.com
heartofbeijing.blogspot.com
helicalpile.us
heroz.fr
hetmanship.xyz hetmanship.xyz
historichometeam.com heygidday.biz
hledejvshopech.cz hmmm.cz
homik.pw hundejo.com
hopeonthestreet.co.uk igru-xbox.net
hoporno.com imagecoolpub.com
hotchatdate.com informatiecentro.be
hotshoppymac.com
hreade.com
husky-shop.cz
igtools.club
ilte.info
images-graphics-pics.com
import-sales.com
in-tandem.co
incolors.club
indiakino.net
infospot.pt
infowarcraft.ru
inmate-locator.us
int.search.mywebsearch.com int.search.mywebsearch.com
iomoio.net interesnie-faktu.ru
iqbazar.ru interferencer.ru
islandminingsupply.wordpress.com investpamm.ru
iwantedmoney.com iopeninghours.co.uk
izhevsk.xrus.org iphantom.com
j-times.ru iplogger.org
jeremyeaton.co itag.pw
jerseywholesalechinabiz.com itch.io
jmat.cn ixora.pro
joingames.org izismile.com
joyceblog.top james13prix.info
jyvopys.com jav-fetish.site
kabbalah-red-bracelets.com javstock.com
javxxx18.com
jerseywholesaleelitestore.com
justprofit.xyz
justucalling32211123456789.tk
jwss.cc
kazrent.com
kenaba.su
kerwinandcariza.com kerwinandcariza.com
kimcurlrvsms.com khafre.us
kino-key.info kiinomaniak.pl
kinogonew.ru kinoplen.ru
kinopolet.net kinotorka.ru
kinozapas.org koleso24.com.ua
kit-opt.ru kostenlos-sexvideos.com
kladrus.ru kvartiry-remont.ucoz.ru
klikbonus.com lacapilla.info
klumba55.ru landscaping.center
konkursov.net lasvegaslockandsafe.com
koptims.tiu.ru ledis.top
kountrylife.com lego4x4.ru
ktotut.net letslowbefast.today
kumuk.info lflash.ru
kunstaktien.info limtu.ifmo.ru
kupit-adenu.ru littlesunraiser.com
lacloop.info live-sexchat.ru
law-check-two.xyz liveshoppersmac.com
lazymanyoga.com
leftofcentrist.com
lescinq.com
letsrepair.in
letto.by
lifeinsurancekb.com
lincolntheatre.com
lion.misba.us
llastbuy.ru llastbuy.ru
localflirtbuddies.com lombia.com
lockerz.com lonerangergames.com
locustdesign.co low-format.ru
lostfilm-online.ru
lowephotos.info lowephotos.info
lunamedia.co m0r0zk0-krava.ru
lyngdalhudterapi.no machicon-akihabara.info
mackeeper-center.club macotool.com
mafa-free.com maju.bluesalt.co
magazin-pics.ru
mainlinehobby.net
manifestyourmillion.com manifestyourmillion.com
mathgym.com.au mararoom.ru
mebel-vstroika.ru maridan.com.ua
mediafresh.online markjaybeefractal.com
medicineseasybuy.com masturbate.co.uk
medkletki.ru max-p.men
megakino.net maxxtor.eu
meget.co.za mcar.in.ua
menstennisforums.com mcnamaratech.com
mesbuta.info mecash.ru
metafilter.com meltwater.com
metalonly.info members.ghanaweb.com
missvietnam.org minecraft-neo.ru
mobile-appster.ru miniature.io
modabutik.ru mirzonru.net
mitrasound.ru
mnogabukaff.net
mobifunapp.weebly.com
moetomnenie.com moetomnenie.com
monarchfind-a.akamaihd.net mojaocena.com
monclercoats.xyz moncleronline.xyz
monetizationking.net monetizationking.net
moscow-clining.ru monetizer.com-01.site
mototsikl.org more-letom.ru
moviezbonkerssk.cf moscow.xrus.org
mp3films.ru mosrif.ru
msk-diplomat.com movies-in-theaters.net
mttwtrack.com movpod.in
mundoaberrante.com mug-na-chas-moscow.ru
musicktab.com
muz-baza.net muz-baza.net
muzaporn.com mydirtyhobby.com
mvpicton.co.uk myyour.eu
mydeathspace.com narkologiya-penza.ru
mydownlodablefiles.com nastroyke.net
mymercy.info nastydollars.com
nerudlogistik.ru nationalbreakdown.com
netallergy.ru negral.pluto.ro
nippon-bearings.ru neks.info
nl.netlog.com nextbackgroundcheck.gq
northfacestore.online niki-mlt.ru
nosecret.com.ua norththeface.store
november-lax.com
novosti-hi-tech.ru novosti-hi-tech.ru
nowtorrents.com nrjmobile.fr
nrv.co.za nrv.co.za
oakleyglassesonline.us obiavo.kz
ok-ua.info officedocuments.net
okuos.com okel.co
oneclickfiles.com okmusic.jp
onko-24.com omgtnc.com
online-hd.pl one-gear.com
onlineserialy.ru oneminutesite.it
optibuymac.com online.ktc45.ru
orel-reshka.net open-odyssey.org
ororodnik.goodbb.ru osoznanie-narkotikam.net
ownshop.cf outshop.ru
paighambot.com owohho.com
panamaforbeginners.com oxford-book.com.ua
pacificair.com
paintingplanet.ru
panouri-solare-acoperis.com
paparazzistudios.com.au
par-fallen.ga par-fallen.ga
pay2me.pl partnersafe.men
peekyou.com partnerworkroom.men
patterntrader-en.com
pawli.eu
pcads.ru
perfectplanned.com
pertlocogasilk.tk
php-market.ru
phpdevops.com
phrcialiled.com
picmoonco.pw
picphotos.net picphotos.net
picsfair.com picsfair.com
pihl.se picture-group.com
pipki.r.acdnpro.com pictures-and-images.net
pistonclasico.com piluli.info
pinkduck.ga
piuminiita.com piuminiita.com
pkr1hand.com pizza-tycoon.com
plastgran.com pl.aasoldes.fr
polybuild.ru plohaya-kreditnaya-istoriya.ru
pogodnyyeavarii.gq
polcin.de
pons-presse.com pons-presse.com
porno-video-chati.ru popugaychiki.com
pornolook.net popunder.net
pornoreino.com pornhive.org
pornosmola.info pornoklad.ru
pornosok.ru pornosemki.info
pornzone.tv pornoxxx.com.mx
postclass.com pornozhara.com
potoideas.us
pourvous.info
pozdravleniya-c.ru
preg.marketingvici.com preg.marketingvici.com
printdirectforless.com privacylocationforloc.com
privatefx-in.ru privatefx.all4invest.info
producm.ru privhosting.com
prodvigator.ua professionaldieselcare.com
prostitutki-almata.org prokotov.com
pskcijdc.bloger.index.hr pts163.ru
ptr.ruvds.com pulse33.ru
pufip.com puzzleweb.ru
pukaporn.com quick-seeker.com
puserving.com quickchange.cc
quangcaons.com qwesa.ru
rabotaetvse.ru rapidsites.pro
randki-sex.com rebrand.ly
ranking2017.ga rebuildermedical.com
rebelmouse.com recipedays.com
relayblog.com redhotfreebies.co.uk
rentalcarnavi.info refudiatethissarah.info
rfd-split.hr remont-komputerov-notebook.ru
riders.ro restorator-msk.ru
rimedia.org ritlweb.com
rumamba.com rniaeba.ga
rybalka-opt.ru rubbed.us
salutmontreal.com scanner-elena.top
samara.rosfirm.ru scanner-ivan.top
saratov.xrus.org scanner-olga.top
saugatuck.com scat.porn
scanner-george.top searchinquire.com
scanner-margo.top searchtooknow-a.akamaihd.net
scanner-marwin.top semalt.com
sdi-pme.com seocheckupx.com
search.xtconnect.com seoexperimenty.ru
sei80.com serialsway.ucoz.ru
seofied.com servethis.com
seonetwizard.com sex-tracker.com
seorank.info sexkontakte-seite.com
servingnotice.com sexy-screen-savers.com
sex-pr.net
sexs-foto.com
sexy-pings.com
shakhtar-doneck.ru
shemalegalls.blogporn.in shemalegalls.blogporn.in
shopwme.ru ship-marvel.co.ua
signoredom.com shodanhq.com
siha.de shop-electron.ru
sildenafilcitratemed.com shop.xz618.com
simply.net shtaketniki.kz
sinel.info sibtest.ru
site.ru sildenafil-tadalafil.info
slutloadlive.com simplepooltips.com
snomer1.ru siteimprove.com
soblaznu.net sitevaluation.com
sosdepotdebilan.com skachat-besplatno-obrazcy.ru
sovetogorod.ru skincrate.net
spidtest.space slayerlife.com
sr-rekneskap.no slomm.ru
steamoff.net sluganarodu.ru
stefanbakosab.se social-buttons.com
stop-gepatit.te.ua soda.media
stop-zavisimost.com soft-terminal.ru
stopnarco.ru softlinesolutions.me
streha-metalko.si solinf.co
stroicol.net sonata-arctica.wz.cz
students-cheapskate.ml space-worry.ml
studworks.org spamnuker.com
stuffpride.com spb-plitka.ru
sudexpert66.ru spl63.fr
suhanpacktech.com sportbetfair.com
superinterstitial.com spravka130.ru
superkanpo.com spywarenuker.com
superlist.biz spywarespy.com
superoboi.com.ua stretchmate.net
stroiminsk.org
stroymonolit.su
sugarkun.com
supermesta.ru
supervesti.ru
surgut.zrus.org
surintech.ac.th surintech.ac.th
svensk-poesi.com swinger-mobil.net
t3chtonic.com tacbibirfa.tk
taaaak.com taranerymagesswa.blogspot.com
tandvardshuset.net telsis.com
taqywu51.soup.io tengohydar.tk
teenforporn.com thecounter.com
thefarmergame.com thedownloadfromwarez.blogspot.com
thegamerznetwork.com tiens2010.ru
titslove.yopoint.in tizanidine4mgstreetvalue.blogspot.com
tizanidine4mgstreetprice.blogspot.com tizanidinewithdrawalsymptoms.blogspot.com
tizanidinedosage.blogspot.com tomatis.gospartner.com
tizanidinehcl4mgtablet.blogspot.com tomck.com
topvidos.ru torrents-tracker.com
torrentgamer.net torrnada.ru
tourismvictoria.com track-rankings.online
trackmedia101.com traffmonster.info
trailer.cinemaflix.website trustaffs.com
trustedmaccleaner.com ttrraacckkrr.com
trustl.life tuckpointingmasonrysystems.com
tupper-posuda.ru turizmus.us
twitlinks.com turvgori.ru
unitygame3d.com u555u.info
ucoz.ru
universals.com.ua
unpredictable.ga
upstore.me
uptime-gamma.net uptime-gamma.net
urengoy.pro urlcut.ru
urzedowski.eu ussearche.cf
ustion.ru vchulkax.com
valmetrundan.se vegascosmetics.ru
vapomnoncri.tk viagengrarx.com
varbergsvind.se viagra-soft.ru
vedomstvo.net videochat.cafe
video-production.com videosbox.ru
videochat.life videositename.com
vipsexfinders.com villakohlanta.nu
voltrknc1.com vinsit.ru
vpnhowto.info virtualbb.com
vtc.pw vitanail.ru
vtcdns.com vizag.kharkov.ua
w3data.co voluumtracker1.com
vseigry.fun
vut.com.ru
wanker.us
wareseeker.com wareseeker.com
wcb.su watchdogs-2.ru
wdfdocando.com webcamdevochka.com
webads.co.nz webkeyit.com
webadvance.club webmasterhome.cn
weightatraining.com webpromotion.ae
wfb.hatedriveapart.com website-analytics.online
wholesalejerseys-cheapest.com website-speed-checker.site
woman-orgasm.ru websiteexplorer.info
womensplay.net webstatsdomain.org
worldis.me winwotgold.pl
writingservices17.blogspot.ru worldhistory.biz
www.event-tracking.com woweb.com.ua
wygraj-teraz.com wstroika.ru
xaylapdiendanang.com ww2awards.info
xclicks.net www.kabbalah-red-bracelets.com
xn----itbkqkfiq.xn--p1ai x-diesel.org
xn--80aaajbdbddwj2alwjieei2afr3v.xn--p1ai xbaboon.com
xn--h1aakne2ba.xn--p1ai xkaz.org
xtremeeagles.net xmlinde.com
xn----7sbbagbq7bd5aheftfllo4m.xn--p1ai
xn----7sbifcamovvfggw9d.xn--p1ai
xn----btbdvdh4aafrfciljm6k.xn--p1ai
xn--b1addnj3cah.xn--p1ai
xn--c1acygb.xn--p1ai
xn--lifehacer-1rb.com
xnxx699.com
xxlargepop.com
xxxkaz.org xxxkaz.org
yaaknaa.info zaapplesales.blogspot.com
yogamatsexpert.com zajm-zalog-krasnodar.ru
youdesigner.kz zarajbuilders.com
youraticles.pl zoogdinsney.com
yoursearch.me zryydi.com
youtube-downloader.savetubevideo.com zvooq.eu
youtuhe.com
yugk.net
zaloadi.ru
zeroredirect10.com
zhacker.net
zirondelli.it
zoogdiesney.com

464
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
98oi.ru 100dollars-seo.com
acc.eu.org 3xforum.ro
adsref.men 51.la
adtology.com 6hopping.com
adultnet.in aa9bd78f328a6a41279d0fad0a88df1901.com
adrunnr.com
afftrack001.com
ageofclones.com ageofclones.com
agroeconom.kz akita.kz
ahmedabadwebs.com aktobe.xkaz.org
aksonural.ru albumsuper.info
alekseevec.ru alert-jdh.xyz
apishops.ru anatomiy.com
apple.com-webbrowsing-security.review apiitsthirteende-a.akamaihd.net
applyneedy.xyz apple.com-webbrowsing-security.science
asophoto.com aproposde.com
autoseo-traffic.com as5000.com
b-styles.xyz asmxsatadriverin.aircus.com
bcmp.org asrv-a.akamaihd.net
bestcoin.cc asrvrep-a.akamaihd.net
bestmobilityscooterstoday.com asseenontv.ru
big-boards.info asseenontvonline.ru
bkgr.se autorn.ru
bugof.gq banan.tv
butstrap.space beachdriveblog.com
buydissertation.net bensbargains.net
buyessay3.blogspot.ru bestmouthwash.club
bigcareer.info
blackplanet.com
blavia.00author.com
bmw-ark.ru
brothers-smaller.ru
buy-forum.ru
buypanicdisorderpill.com
buypuppies.ca buypuppies.ca
c-gainsbourg.com bytimedance.ru
cah.io.community candytiner.com
carsdined.org cartierlovestore.xyz
cartierlove.xyz cementaresearch.se
charmstroy.info chidporn.com
cheapmoncler.win
cialgenisrx.com
cienum.fr
cityadspix.com
civilwartheater.com civilwartheater.com
clayvasedesigns.tk classicakuhni.ru
clean-start.net claytransformations.info
clknsee.com clickaider.com
co.lumb.co compliance-barak.top
coccoc.com contentsexpress.com
coindirect.io cookingmeat.ru
com-cleaner.systems cool-wedding.net
compliance-brian.xyz cornomase.win
compliance-viktor.top customcatchcan.com
compucelunlock.net customchocolate.business-for-home.com
computernetworksonline.com d0t.ru
concealthyself.com danashop.ru
coolbar.pro datsun-do.com
cowblog.fr daydream-studio.ru
culmimg.pw dbmkfhqk.bloger.index.hr
db.speedup.gdn decorationspcs.com
deanmoore.ie dengi-pod-zalog-nedvizhimosti.ru
detmebel.su digest-project.ru
dev33.dioniqlabb.se
dfwu1013.info
dieta-personalna.pl
digilander.libero.it digilander.libero.it
dogbreedspicture.net downvids.net
dood.live dwomlink.info
dorratex.tn ekaterinburg.xrus.org
dosugrostov.site elektrozigarettekaufen1.devhub.com
doublepimp.com elstal.com.pl
download-of-the-warez.blogspot.com englate.com
downloader12.ru eropornosex.ru
earn-from-articles.com exchangeit.gq
eduserver.net ezofest.sk
emailaccountlogin.co faracontrol.ir
envaseslotusama.com ff30236ddef1465f88547e760973d70a.com
fashionavenuegame.com fifa-coins.online
fellowshipoftheminds.com filefilter.weebly.com
fetishinside.com firma-legion.ru
fiuxy.com forpostlock.ru
flex4launch.ru forumprofi.de
freakycheats.com fr-bearings.ru
front.to free-floating-buttons.com
gembird.com free-stock-illustration.com
gemgrab-a.akamaihd.net freelifetimefuckbook.com
generic-pills-online.com freshberry.com.ua
genericlowlatencyasiodriverhq.aircus.com fungirlsgames.net
getlamborghini.ga funtoonez.com
glass-msk.ru gaypornmovie.net
go2album.com germetiki.com.ua
golfresa.lucania.se getdot.ru
goodnightjournal.com go2jump.org
goroda-vsego-mira.ru gosarhivrt.ru
gratuitxblcodes.com grupografico-pilar.com.ar
gsmlab.pl gta-top.ru
guidefs.ru guiadeserraazul.com
hamptonoaks.ca guigyverpo.cf
handicapbathtubarea.com gymi.name
handicapvantoday.com gz2.bbsoldes.fr
hdapp1008-a.akamaihd.net
hermesbirkinhandbagoutlets.com
hermesreplica.pw
hermesreplica.win hermesreplica.win
highland-homes.com highland-homes.com
hollywoodactress.info hobbyhuren24.net
homedo.fabpage.com ikritikimou.gr
hoverboard360.nl infobabki.ru
hybrid.ru innodgfdriverhm.aircus.com
iideaidekonkatu.info innoslicon.com
instasexyblog.com intellego.info
int.search.mywebsearch.com investmac.com
itis4you.com janerikholst.se
ivoiretechnocom.ci javrip.net
japfm.com jikoman.info
johnnyhaley.top johannesburgsingles.co.za
jolic2.com kareliatobacco.ru
kashubadesign.ru kartiniresto.com
keywords-monitoring-success.com keywordsuggest.org
kfon.eu kimcurlrvsms.com
kinocccp.net krasivoe-hd.net
krasnodar.ru kretpicf.pw
kredit-blog.ru kvartir-remont.biz
lanasshop.ru lanasshop.ru
landmania.ru landoftracking.com
letslowbefast.today lasvegaslockandsafe.com
lidoradio.com laxob.com
lifebyleese.com lflash.ru
lifehacĸer.com lightinghomes.net
limads.men lion.conboy.us
llastbuy.ru lionking-1994.blogspot.com
lmrauction.com livingcanarias.com
lookingglassemb.com lockerz.com
lost-alpha.ru lsex.xyz
luxmagazine.cf mabdoola.blogspot.com
lyrics.home-task.com magicplayer-s.acestream.net
m5home.ru
macdamaged.space
mactechinfo.info
maglid.ru maglid.ru
marcowebonyodziezowe.pl marinetraffic.com
mathgym.com.au martlinker.com
matsdale.com medictube.ru
mebel-ekb.com mini-modus.ru
medosmotr-ufa.ru mobplayer.ru
mere.host.sk moskva.nodup.ru
mil-stak.com myhydros.org
mir-business-24.ru myindospace.com
misswell.net myonigroup.com
mister-shop.com national-today-winning-winner.club
mixed-wrestling.ru netanalytics.xyz
moi-glazki.ru obiavo.net
monetizationking.net ofanda.com
morepoweronmac.trade
morf.snn.gr
moscow-region.ru
mozello.ru
mtmtv.info
muizre.ru
myfreecams.com
myghillie.info
naturalbreakthroughsresearch.com
neobux-bg.info
news-speaker.com
nikitabuch.com
no-fuel.org
nordvpn.com
obiavo.ru
officedocuments.net officedocuments.net
ohmyrings.com olvanto.ru
openstat.com onlainbesplatno.ru
paperwritingservice17.blogspot.ru onlinadverts.com
parajumpersoutlet.online online-sbank.ru
pavlodar.xkaz.org online.ktc45.ru
pawli.eu paramountmarble.co.uk
paydayloanslocal.com perl.dp.ua
pc-test.net petitions.whitehouse.gov
pekori.to pharmacyincity.com
photosaga.info phormchina.com
placid-rounded-coast.glitch.me pills24h.com
playtap.us pogodnyyeavarii.gq
portside.cc popup-hgd.xyz
porn-w.org
pornosmola.info
pornosok.ru
pornowarp.info
portside.xyz
potolokelekor.ru
powenlite24.ru
pozvonim.com
pretty-mart.com pretty-mart.com
prlog.ru professionalwritingservices15.blogspot.ru
pron.pro
prostitutki-kharkova.org prostitutki-kharkova.org
proxyelite.biz pushdata.sendpulse.com
pshare.biz quick-seeker.com
pulseonclick.com qwertty.net
putevka24.ru rasteniya-vs-zombi.ru
ranksignals.com recipedays.com
rapidgator-porn.ga relatodelpresente.com.ar
redbottomheels.xyz rennlist.com
rednise.com responsive-test.net
reining.lovasszovetseg.hu
remont-fridge-tv.ru
renecaovillasale.online
replicaclub.ru
rfserial.net
rightenergysolutions.com.au rightenergysolutions.com.au
ringtonepartner.com rn-to-bsn.com
rocketchange.ru roznica.com.ua
romhacking.ru rp9.ru
royalads.net s1z.ru
russia-today-video.ru see-your-website-here.com
saratov.xrus.org seo-traffic-ranking.info
scanmarine.info sexphoto.site
searchengineranker.email ship-marvel.co.ua
sexystrippe.info shoppingmiracles.co.uk
shoppingjequiti.com.br si-unique.com
sildenafil-tadalafil.info site-speed-checker.site
skuteczna-dieta.co.pl snow.nvr163.com
sledstvie-veli.net softonicads.com
social-s-ggg.xyz sr-rekneskap.no
socialbutton.xyz stroiminsk.org
sodexo.com stroy-portal22.ru
spywarebegone.com success-seo.com
stillmiracle.com surfbuyermac.com
swingerseiten.com szucs.ru
taxi-v-eisk.ru taaaak.com
tehngr.ru technika-remont.ru
thebluffs.com telesvoboda.ru
thesmartsearch.net thefotosgratis.eu
tizanidineorflexeril.blogspot.com threecolumnblogger.com
tizanidineformigraines.blogspot.com
tizanidinehcl2mgtablet.blogspot.com
tizanidinestreetprice.blogspot.com tizanidinestreetprice.blogspot.com
top10-online-games.com toloka.hurtom.com
topkarkas.com toolsky.com
topmira.com track112.site
trafficfactory.biz tramadolandtizanidine.blogspot.com
trustaffs.com tvory.predmety.in.ua
turbo-suslik.org twiclub.in
tvnewsclips.info urengoy.pro
uhodzalijami.ru urlopener.com
vchulkah.net vapeface.club
veopornogratis.xxx videokrik.net
vezuviy.su viteonlusarezzo.it
video-chat.love vysigy.su
wallpapersist.com vzlom-na-zakaz.com
wahicbefa31.soup.io
wallpaperstock.net
wdfdocando.com wdfdocando.com
webnode.me
weburlopener.com weburlopener.com
wordpresscore.com westermarkanjou.se
workle.website wma-x.com
worldhistory.biz
worldoffiles.ru worldoffiles.ru
www.bookmaker-bets.com worldtraveler.world
xblog.in wormix-cheats.ru
xlovecam.com wowas31.ucoz.ru
xn----7sbaphztdjeboffeiof6c.xn--p1ai wtsindia.in
www.jbetting.com
www.pinnacle-bets.com
x-musics.com
x-stars.ru
xkaz.org
xmladserver.com
xn-----6kcaabbafhu7cskl7akvongwpo7hvjj.xn--p1ai
xn----btbdvdh4aafrfciljm6k.xn--p1ai
xn----dtbndd4ae7eub.top xn----dtbndd4ae7eub.top
xn--80ahdheogk5l.xn--p1ai xnxxandxvideos.com
xn--b1adccaf1bzj.xn--p1ai xtubeporno.net
xxxtube69.com xxxdatinglocal.us
yaoguangdj.com yaoguangdj.com
yourdesires.ru yebocasino.com
yuweng.info yoshkarola.zrus.org
zed21.net youradulthosting.com
zeroredirect11.com yunque.pluto.ro
zojirushi-products.ru zaim-pod-zalog-krasnodar.ru
zytpirwai.net zeleznobeton.ru
zhongwenlink.com
zmoda.hostreo.com
zzlgxh.com

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.121 0; 10.1.0.61 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.11.3460 ### Version: V4.2022.11.3461
### Updated: Wed Nov 9 10:03:28 UTC 2022 ### Updated: Wed Nov 9 22:01:17 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.11.3460 ### Version: V4.2022.11.3461
### Updated: Wed Nov 9 10:03:28 UTC 2022 ### Updated: Wed Nov 9 22:01:17 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##