vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-06 20:50:05 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2022.08.3263 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2022-08-01 10:09:08 +00:00
parent 3bfa035e48
commit 9917d204b4
46 changed files with 97829 additions and 97829 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.07.3262 #### Version: V4.2022.08.3263
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.07.3262 #### Version: V4.2022.08.3263
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -14,7 +14,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2022.07.3262 #### Version: V4.2022.08.3263
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

12094
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2022.07.3262 #### Version: V4.2022.08.3263
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

12098
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

12098
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

12098
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

12098
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.71 1; 10.1.1.168 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.71 0; 10.1.1.168 0;
127.0.0.1 0; 127.0.0.1 0;

12098
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.71 1; 10.1.1.168 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.71 0; 10.1.1.168 0;
127.0.0.1 0; 127.0.0.1 0;

12098
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.71 1; 10.1.1.168 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.71 0; 10.1.1.168 0;
127.0.0.1 0; 127.0.0.1 0;

12098
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
3262 3263

12098
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

12098
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.29.92.182 0; 20.127.69.63 0;

12098
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.71 1; 10.1.1.168 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.71 0; 10.1.1.168 0;
127.0.0.1 0; 127.0.0.1 0;

12098
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.71 1; 10.1.1.168 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.71 0; 10.1.1.168 0;
127.0.0.1 0; 127.0.0.1 0;

12098
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.71 1; 10.1.1.168 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.71 0; 10.1.1.168 0;
127.0.0.1 0; 127.0.0.1 0;

12098
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.29.92.182 0; 20.127.69.63 0;

12098
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.29.92.182 0; 20.127.69.63 0;

12098
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.71 1; 10.1.1.168 1;
127.0.0.1 1; 127.0.0.1 1;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
G-i-g-a-b-o-t Crescent
Internet Ninja Custo
Mojolicious Indy Library
OnCrawl NetLyzer
OpenVAS Page Analyzer
SEOstats Papa Foto
SiteLockSpider Pu_iN
SuperHTTP Swiftbot
check1.exe True_Robot
mediawords Wallpapers

314
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
360Spider
404checker 404checker
404enemy ADmantX
AIBOT ALittle Client
Abonti Aboundex
AhrefsBot AhrefsBot
AiHitBot AiHitBot
Aipbot Aipbot
Alligator Alexibot
AlphaBot AllSubmitter
Attach Anarchie
Anarchy99
Anthill
Apexoo
Atomseobot
AwarioRssBot AwarioRssBot
AwarioSmartBot AwarioSmartBot
BBBike
BDCbot BDCbot
BDFetch BacklinkCrawler
BackWeb Bandit
BatchFTP BatchFTP
BetaBot BetaBot
Bitacle
Black Hole
BlackWidow
Blow
Boardreader
Bolt
BotALot BotALot
Brandprotect
Buddy Buddy
CATExplorador BuiltBotTough
CazoodleBot BunnySlippers
CheeseBot BuzzSumo
CCBot
CSHttp
CensysInspect
CherryPicker
ChinaClaw ChinaClaw
Cliqzbot Claritybot
Cloud mapping Cloud mapping
Cocolyzebot
Copier
CopyRightCheck CopyRightCheck
Copyscape
Cosmos
Craftbot Craftbot
Crawling at Home Project CrazyWebCrawler
CrunchBot CrunchBot
Demon CyotekWebCopy
Deusu Deusu
Digincore Digincore
DigitalPebble DigitalPebble
Dispatch Dirbuster
Disco
Discobot
DittoSpyder DittoSpyder
DnBCrawler-Analytics DnBCrawler-Analytics
DnyzBot DomCopBot
DomainCrawler DomainAppender
DomainSigmaCrawler DomainStatsBot
Domains Project Download Wonder
Dragonfly
Drip Drip
EMail Siphon EMail Siphon
EirGrabber EMail Wolf
Evil Exabot
Extractor ExtractorPro
EyeNetIE Extreme Picture Finder
Ezooms FHscan
FemtosearchBot FemtosearchBot
Firefox/7.0 Firefox/7.0
Fuzz FrontPage
GT::WWW FyberSpider
GalaxyBot GalaxyBot
GetRight Genieo
GetWeb Getintent
Gigabot
Go!Zilla Go!Zilla
Go-Ahead-Got-It Gotit
GoZilla Grabber
GrapeshotCrawler Grafula
HEADMasterSEO HEADMasterSEO
HMView HMView
HTMLparser HTTP::Lite
HTTrack Haansoft
Heritrix Harvest
Humanlinks IDBTE4M
IDBot
IRLbot IRLbot
Iblog IlseBot
Image Fetch Image Fetch
InterGET Image Sucker
Internet Ninja Indy Library
InfoTekies
Intelliseek
IstellaBot IstellaBot
JennyBot
JetCar JetCar
Jetty
JikeSpider JikeSpider
LWP::Simple Kinza
Leap LNSpiderguy
LeechFTP LeechGet
LexiBot
Lftp
Libwhisker Libwhisker
Lightspeedsystems Linkbot
LinkWalker
LinkextractorPro LinkextractorPro
LinksManager
LinqiaRSSBot LinqiaRSSBot
LinqiaScrapeBot LinqiaScrapeBot
Lmspider Lipperhey
Lipperhey Spider
MFC_Tear_Sample MFC_Tear_Sample
MIDown tool
MJ12bot MJ12bot
MSFrontPage
Mag-Net
Mail.RU_Bot
Majestic12 Majestic12
MarkMonitor MarkMonitor
MarkWatch
Masscan Masscan
Meanpathbot Mata Hari
Metauri MauiBot
Mb2345Browser
MicroMessenger MicroMessenger
Microsoft Data Access Microsoft URL Control
Mojeek Mister PiX
Mojolicious Morfeus Fucking Scanner
Mr.4x3 Mozlila
Msrabot
Musobot Musobot
NPbot Name Intelligence
Nameprotect
NearSite NearSite
Needle
Net Vampire Net Vampire
NetAnts NetLyzer
NetMechanic
NetZIP
Netcraft Netcraft
Nettrack Nettrack
Nibbler NextGenSearchBot
Nikto Nimbostratus
NimbleCrawler Nuclei
Nutch Octopus
Offline Explorer
Offline Navigator
OnCrawl
OpenLinkProfiler OpenLinkProfiler
Openfind OpenVAS
Openvas Openvas
OrangeBot OrangeSpider
OutfoxBot OutfoxBot
PECL::HTTP
PHPCrawl PHPCrawl
POE-Component-Client-HTTP PageThing.com
PageAnalyzer Pandalytics
PageScorer
Panscient Panscient
Papa Foto
PeoplePal PeoplePal
Petalbot Picscout
PictureFinder Pixray
Pimonster
ProPowerBot ProPowerBot
Probethenet Quick-Crawler
Psbot RSSingBot
Pu_iN RankActive
PyCurl RankActiveLinkBot
QueryN Metasearch RankFlex
RankingBot RankingBot
Rankivabot
RankurBot
Re-re Re-re
Recorder
RedesScrapy RedesScrapy
RepoMonkey Rogerbot
SEOkicks-Robot SEOkicks
SEOlyticsCrawler SEOlyticsCrawler
SEOprofiler ScrepyBot
SEOstats Searchestate
SISTRIX SemrushBot
SalesIntelligent SeoSiteCheckup
ScanAlert
Scanbot
ScoutJet
Scrapy
Screaming
SearchmetricsBot
Semrush
SeobilityBot SeobilityBot
Seomoz Seomoz
Site Sucker Shodan
SiteSucker Sitebeam
SlySearch Sitevigil
Snapbot
SocialRankIOBot SocialRankIOBot
Sosospider Sosospider
Spammen
SpankBot SpankBot
Spanner Spinn3r
Sqlmap
Sqworm Sqworm
Sucker
Sucuri Sucuri
SuperHTTP
Surfbot Surfbot
SurveyBot Szukacz
Suzuran
Swiftbot
T0PHackTeam T0PHackTeam
T8Abot Telesoft
TeleportPro Telesphoreo
Telesphorep
The Intraformant The Intraformant
TightTwatBot Toata
Toweyabot Trendiction
Trendictionbot True_Robot
Turnitin Turnitin
UnisterBot TurnitinBot
VCI TwengaBot
Vagabondo Typhoeus
URLy Warning
VeriCiteCrawler VeriCiteCrawler
VoidEYE VidibleScraper
Voil
Voltron
WASALive-Bot
WBSearchBot WBSearchBot
WEBDAV
WISENutbot
WPScan WPScan
WWW-Mechanize WWW-Collector-E
WeSEE Wallpapers
Web Auto
Web Collage Web Collage
Web Enhancer
Web Fetch Web Fetch
Web Pix
Web Sauger Web Sauger
WebFetch WebAuto
WebGo IS
WebLeacher WebLeacher
WebSauger WebSauger
WebStripper WebStripper
WebSucker
WebZIP WebZIP
Webalta Webalta
WebmasterWorldForumBot WebmasterWorldForumBot
Website Quester
Webster Webster
Whack Whack
Whacker Whatweb
Who.is Bot WinHTTrack
Widow Woobot
Wonderbot Wotbox
Wprecon Xaldon WebSpider
Xaldon_WebSpider Zeus
Zade Zitebot
ZoomBot ZmEu
ZumBot ZoominfoBot
ZyBorg adscanner
archive.org_bot archive.org_bot
arquivo-web-crawler
autoemailspider
com.plumanalytics
crawl.sogou.com
crawler.feedback
demandbase-bot
eCatch eCatch
gopher heritrix
internetVista monitor internetVista monitor
ips-agent
isitwp.com isitwp.com
iubenda-radar iubenda-radar
linkdexbot mediawords
magpie-crawler muhstik-scan
meanpathbot pcBrowser
netEstate NE Crawler plumanalytics
satoristudio.net
scan.lol scan.lol
seostar seobility
sitechecker.pro seocompany.store
siteripz serpstatbot
sp_auditbot spyfu
sysscan sysscan
webgains-bot tAkeOut
webpros.com trendiction.com
ubermetrics-technologies.com
x22Mozilla
xpymep1.exe xpymep1.exe
zgrab

304
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
01h4x.com
404checker 404checker
404enemy 404enemy
ALittle Client ADmantX
ASPSeek ASPSeek
Acunetix
AiHitBot AiHitBot
Aipbot AllSubmitter
Alexibot Alligator
AlphaBot AlphaBot
Aspiegel Anarchy
AwarioRssBot Anarchy99
Attach
AwarioSmartBot AwarioSmartBot
BackWeb BBBike
Backlink-Ceck BackStreet
BacklinkCrawler
Badass
Bandit Bandit
BatchFTP
Battleztar Bazinga Battleztar Bazinga
BetaBot
Bigfoot
Bitacle Bitacle
BlackWidow Black Hole
Blackboard
BlowFish
Boardreader Boardreader
Bolt
BotALot BotALot
Brandwatch Brandwatch
Buddy
BuiltWith BuiltWith
BunnySlippers Bullseye
BuzzSumo BuzzSumo
CCBot Calculon
CazoodleBot CazoodleBot
CensysInspect
CherryPicker
ChinaClaw ChinaClaw
Citoid
Claritybot
Cocolyzebot Cocolyzebot
Collector Curious
Copyscape Custo
Crawling at Home Project DIIbot
CrunchBot
CyotekWebCopy
DTS Agent DTS Agent
DataCha0s Devil
DatabaseDriverMysqli
Demon
Deusu
Discobot
Dispatch
DnBCrawler-Analytics DnBCrawler-Analytics
DomainAppender DnyzBot
DomainCrawler
DomainSigmaCrawler
Domains Project Domains Project
Dotbot Dotbot
Dragonfly
ECCP/1.0
EMail Siphon EMail Siphon
EirGrabber Ebingbong
Exabot EroCrawler
ExtractorPro Extractor
Extreme Picture Finder
EyeNetIE EyeNetIE
FDM FDM
FemtosearchBot Firefox/7.0
Foobot FlashGet
Flunky
Fuzz
Fyrebot Fyrebot
GT::WWW Go-Ahead-Got-It
Genieo Gotit
GetWeb Grabber
Go!Zilla Grafula
GoZilla Haansoft
GrapeFX
GrapeshotCrawler
HEADMasterSEO
HTMLparser
HTTP::Lite
HaosouSpider HaosouSpider
Harvest
Heritrix Heritrix
Hloader HonoluluBot
IDBot Humanlinks
HybridBot
IRLbot
Iblog Iblog
Image Fetch IlseBot
Image Sucker Image Sucker
IndeedBot IndeedBot
Indy Library InfoNaviRobot
InterGET
Internet Ninja
Iria Iria
Iskanie
IstellaBot IstellaBot
JOC Web Spider
JamesBOT JamesBOT
JetCar Jbrofuzz
JennyBot
Jetty Jetty
Jyxobot Joomla
Kenjin Spider Kenjin Spider
Keybot Translation-Search-Machine
Kozmosbot Kozmosbot
LNSpiderguy LNSpiderguy
Lanshanbot
Larbin Larbin
Leap LeechFTP
LexiBot LexiBot
Libwhisker Lftp
LieBaoFast
LinkWalker LinkWalker
LinkextractorPro
LinksManager LinksManager
LinqiaMetadataDownloaderBot LinqiaMetadataDownloaderBot
LinqiaScrapeBot LinqiaRSSBot
Lipperhey Litemage_walker
Ltx71 MJ12bot
MFC_Tear_Sample MQQBrowser
MIIxpc MSFrontPage
MSIECrawler Mail.RU_Bot
Mag-Net Majestic-SEO
Majestic12
MarkMonitor MarkMonitor
MarkWatch
Mass Downloader Mass Downloader
Masscan
Mata Hari
Mb2345Browser
MeanPath Bot MeanPath Bot
MegaIndex.ru MicroMessenger
Metauri
Microsoft Data Access
Microsoft URL Control Microsoft URL Control
Moblie Safari Moblie Safari
Mojeek
Mojolicious
MolokaiBot
Morfeus Fucking Scanner Morfeus Fucking Scanner
Mozlila
Mr.4x3
Msrabot
Musobot
NICErsPRO NICErsPRO
Name Intelligence Name Intelligence
Navroad Navroad
NearSite
Nessus Nessus
NetSpider Net Vampire
Netcraft NetAnts
NetZIP
Nettrack
Netvibes
NextGenSearchBot
Niki-bot
NimbleCrawler
Nimbostratus
Not Not
Offline Explorer Nuclei
Offline Navigator Offline Navigator
OnCrawl OnCrawl
OpenLinkProfiler
OpenVAS OpenVAS
Openfind
Openvas Openvas
OrangeBot OrangeBot
OrangeSpider
OutfoxBot OutfoxBot
PECL::HTTP
PHPCrawl PHPCrawl
PeoplePal PageScorer
Pi-Monster Panscient
Pavuk
Petalbot
Picscout Picscout
Pimonster Picsearch
Pixray Pixray
Pockey ProWebWalker
Probethenet Psbot
Pump
PxBroker PxBroker
Quick-Crawler Quick-Crawler
RankActive RSSingBot
RankingBot RankingBot
RankingBot2 RealDownload
RebelMouse Recorder
RepoMonkey Ripper
SEOlyticsCrawler SEOlyticsCrawler
SEOprofiler SEOprofiler
SEOstats SEOstats
Scrapy SMTBot
ScrepyBot SalesIntelligent
ScreenerBot
Searchestate
SearchmetricsBot SearchmetricsBot
SemanticJuice SemanticJuice
Semrush
SentiBot
SeoSiteCheckup SeoSiteCheckup
SeobilityBot SeobilityBot
Shodan
Siphon Siphon
SiteCheckerBotCrawler Site Sucker
SiteExplorer SiteSnagger
SiteLockSpider SiteSucker
Siteimprove Sitebeam
SlySearch
SocialRankIOBot
Sogou web spider
Sottopop Sottopop
Spanner Spanner
Sqlmap
Sqlworm
Sqworm Sqworm
Steeler
Stripper
Sucker Sucker
Swiftbot Sucuri
Surfbot
Szukacz
T0PHackTeam T0PHackTeam
Telesoft T8Abot
Telesphorep Telesphoreo
Thumbor Thumbor
Titan TightTwatBot
Toweyabot
Tracemyfile
Trendiction
True_Robot True_Robot
TurnitinBot URLy Warning
Typhoeus VelenPublicWebCrawler
URLy.Warning VeriCiteCrawler
V-BOT VidibleScraper
VCI
Vagabondo
Virusdie
Voil Voil
WASALive-Bot
WBSearchBot WBSearchBot
WWW::Mechanize WISENutbot
Wallpapers WPScan
WWW-Collector-E
WWWOFFLE
WallpapersHD WallpapersHD
WeSEE Web Collage
Web Enhancer
Web Fetch
Web Pix
Web Sucker Web Sucker
WebAuto
WebBandit
WebEnhancer
WebFetch
WebImageCollector WebImageCollector
WebLeacher
WebPix
WebSauger WebSauger
WebStripper
WebWhacker
WebZIP
Webalta Webalta
WebsiteExtractor WebsiteExtractor
Who.is Bot WebsiteQuester
Widow Webster
Whacker
WinHTTrack
WiseGuys Robot WiseGuys Robot
Woobot Wonderbot
Wprecon Wprecon
Zade
Zeus
ZmEu ZmEu
ZyBorg adscanner
arquivo-web-crawler archive.org_bot
autoemailspider arquivo.pt
check1.exe cognitiveseo
clark-crawler com.plumanalytics
domainsproject.org crawler.feedback
evc-batch eCatch
gopher
instabid instabid
internetVista monitor
iubenda-radar iubenda-radar
linkdexbot linkdexbot
magpie-crawler lwp-trivial
meanpathbot
oBot oBot
page scorer pcBrowser
scan.lol polaris version
probe-image-size
ripz
s1z.ru
satoristudio.net
scalaj-http
seoscanners seoscanners
seostar
sp_auditbot
sysscan
tAkeOut
trendiction.com
trendiction.de
ubermetrics-technologies.com ubermetrics-technologies.com
voyagerx.com webgains-bot
webmeup-crawler
webpros.com webpros.com
webprosbot zauba.io
x09Mozilla
x22Mozilla
xpymep1.exe
zgrab

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
check-this-out-now.online 1kinobig.ru
findthe.pet anaseracresar.tk
gallerily.com forum.poker4life.ru
hoverboardforsaledirect.com graphicwe.org
inmate-locator.us hdwallpapers-free.com
lerporn.info topquality.cf
pornosmola.info truebeauty.cc
promalp-universal.ru ukrtextbook.com
ric.info virus-respirators.com
smartadserver.com wechatdownload10.com

922
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
1kinobig.ru 00author.com
1webmaster.ml 0daymusic.org
3-letter-domains.net 108shot.com
34.gs 123locker.com
3rbseyes.com
4webmasters.com 4webmasters.com
5i2.net 5forex.ru
5kstore.com 883zy.com
70casino.online 8gold.com
a.pr-cy.ru abclauncher.com
a1security.com.ua above.com
aasoldes.fr
acortarurl.es
actionnooz.com
activecampaign.dreamhosters.com activecampaign.dreamhosters.com
adimmix.com addray.pro
adtiger.tk adpremium.org
alert-jdh.xyz adrenalin-stk.ru
adsland.men
adsloads.com
adsref.men
adultnet.in
advokat-grodno.by
aero2.ru
aerogo.com
afmuseum.com
air-edem.ru
ald2014.org
alert-hgd.xyz
alfa-img.com alfa-img.com
alienwheel.es allbizne.co.ua
all-number.com allstatesugarbowl.org
all4wap.ru amazingpic.net
allcredits.su an-donut.com
allnews24.in animali.deagostinipassion.it
amehdaily.com anonymizeme.pro
amigobulls.com ap.senai.br
amyfoxfitness.com apibetweenlinesn-a.akamaihd.net
anticrawler.org apimountainbikei-a.akamaihd.net
appsaurus.com apispringsmartne-a.akamaihd.net
arate.ru app5.letmacworkfaster.world
arendovalka.xyz applicationg29.com
arkkivoltti.net apxeo.info
arcadepages.com
arcteryxsale.online
arendakvartir.kz
aruplighting.com
asacopaco.tk asacopaco.tk
asdfg.pro availit.weebly.com
asiavirtualsolutions.com aviav.ru
asseenontvonline.ru avitocars.ru
atout-energie-69.com avon-severozapad.ru
aussie-prizes.com
auto4style.ru
avtolombard-krasnodar.ru avtolombard-krasnodar.ru
azadnegar.com badavit.com.ua
babespcs.com banan.tv
banksrf.ru bangla-chat-uk-paralud.ga
bannerads.de bankcrediti.ru
bannertesting.com banki76.ru
beauty-things.com barnfurnituremart.com
beachdriveblog.com
beachtoday.ru
beetpics.pw beetpics.pw
begalka.xyz
bensbargains.net bensbargains.net
best-seo-offer.com beremenyashka.com
bestcoin.cc bestdooz.com
bestfortraders.com bestwaystogetpaid.us
betterhdporn.com bezlimitko.xyz
betwinservice.com bg6s0.com
bgviagrachrx.com bingo8888.com
bif-ru.info bizcheapjerseyswholesalechina.com
bimatoprost-careprost.com.ua
binaryoptionscops.info
binomo.kz
biznesrealnost.ru
blackplanet.com
blagovest-med.ru blagovest-med.ru
blog.yam.com blavia.00author.com
blue-square.biz
bmw-ark.ru
bmw.afora.ru bmw.afora.ru
bouda.kvalitne.cz bnt-team.com
brainxs.us bonky.biz
breget74.ru boostmyppc.com
bumskontakte.org brainboosting.club
braintobe.win
brg8.com
business-suggested.tk
buyantiviralwp.com
buyessay3.blogspot.ru
buypanicdisorderpill.com buypanicdisorderpill.com
buzz-porno.info
buzzzg.men buzzzg.men
cactussoft.biz bycontext.com
canacopegdl.com callmd5map.com
candytiner.com canzoni.ru
cardsharp1.ru carmuffler.net
carloans.com carrauterie.be
cartechnic.ru cars-modification.net
ccbill.com cb.iphantom.com
cdnnetwok.xyz cfcl.co.uk
censys.io
cfacarrosserie74.com
chatroulette.life chatroulette.life
chcu.net check-host.net
chlooe.com checkhit.com
chocolateslim-en-france.com checkm8.com
chocoslim.pro checkpagerank.net
choice-credit.ru chee-by.biz
christianlouboutinreplica.win chidporn.com
cinemaenergy-hd.ru chocolateslim-en-espana.com
citizenclsdriveri7.pen.io christianlouboutinsaleoutletonline.us
clarithromycin500mg.com citetick.com
collegerentals.com classiquebijoux.ru
compliance-don.xyz clicksor.net
compliance-jane.top coin-hive.com
compliance-julia.top coinsspb.com
connectingsingles.com comissionka.net
commoncrawl.org
compliance-andrew.xyz
compliance-george.top
compliance-john.top
compliance-mary.top
comsysnet.com
cookie-law-enforcement-hh.xyz
cookingmeat.ru
coolwallpapers4k.info coolwallpapers4k.info
counter.bloke.com copyrightclaims.org
crafthubs.com cougfan.info
craftinsta.ru counciltally.com
creditnation.ru cxpromote.com
crest3d.ru dandiyabeats.in
cs-passion.pl datsun-do.com
customerpromos-a.akamaihd.net davebestdeals.com
d2jsp.org ddospanel.com
dailyrank.net dear-diary.ru
danschawbel.com detective01.ru
datract.com detmebel.su
descargar-musica-gratis.net deutschehobbyhuren.net
detalizaciya-tut.biz diarioaconcagua.com
diesel-parts28.ru dikqlyremy.info
digital-sale.su dikx.gdn
digitalfaq.com discountliv.com
discovertreasure-a.akamaihd.net documentbase.net
djihispano.com dojki365.online
dogclothing.store domaincheck.io
dokfilms.net
dolohen.com
domain2008.com
domaincrawler.com
domainsphoto.com
dominateforex.ml dominateforex.ml
dominterior.org dostavimvdom.ru
doska-vsem.ru dotmass.top
dprtb.com e-buyeasy.com
drpornogratisx.xxx editmedios.com
drupa.com ednorxmed.com
dvervmoskvu.ru educatemetv.com
dwomlink.info education-cz.ru
ebooknovel.club election.interferencer.ru
ege-essay.ru eleimgo.pw
electricwheelchairsarea.com emerson-rus.ru
electro-prom.com empis.magix.net
elektrozigarettekaufen2.blogse.nl enbersoft.com
elektrozigaretten1.webs.com eng-lyrics.com
eloconcream.blogspot.com eorogo.top
englishdictionaryfree.com erotische-geschichten-xxl.com
enternet.ee es5.com
eralph.tk esnm.ru
escortslet.net essay-edu.biz
essaypro.com essayassist.com
etm-consult.de eu-cookie-law.info
euromasterclass.ru evidencecleanergold.com
europeanwatches.ru evrotekhservis.ru
exportshop.us excaliburfilms.com
extremez.net excitacion.info
ezigarettekaufen1.hpage.com expertblog.info
eyessurgery.ru
ezb.elvenmachine.com
ezigarettenshop2.postbit.com
ezigaretteshop2.mywapblog.com ezigaretteshop2.mywapblog.com
family1st.ca facialporntube.com
fanrto.com familyphysician.ru
fapgon.com famix.xyz
fealq.com favoritemoney.ru
feeriaclub.ru fba-mexico.com
fidelityfunding.com felizporno.com
fighrofacciufreesig.ga fellowshipoftheminds.com
filmgo.ru ferieboligkbh.dk
fertilitetsradgivningen.se
financetip.eu financetip.eu
firstdrugmall.ru firesub.pl
fix-website-errors.com flauntyoursite.com
fm-upgrade.ru forminecrafters.ru
footballfarrago.com forpackningsutveckling.se
forex-procto.ru free-deals.faith
forum.doctissimo.fr freewlan.info
forum.tvmir.org fullfileaccess.com
forum69.info fun-mobi.pl
forzeronly.com fun2cell.net
franecki.net funnymama.com
freesitetest.com gambarkataku.co
frustrated-favorable.gq game-top.su
fxtips.ru genericlowlatencyasiodriverhq.aircus.com
fym.com.ru genetworx.com
fyxabomiw.ru getpopunder.com
gallerily.com gettpromos.com
gembird.com gheus.altervista.org
germetiki.com.ua given2.com
ghostvisitor.com golden-catalog.pro
globalscam.ga goldenggames.com
globatur.ru gopixdatabase.com
goldpanningtools.com gpms.org.my
good-mummy.ru greenshop.su
gotomontenegro.net guiadeserraazul.com
greenzaim.ru hackers-crackers.tk
gribokstop.com hacktougroup.ru
handicapvansarea.com hanink.biz.ly
harmonyglen.us
hauleddes.com hauleddes.com
hazardky.net hausfrauensex18.com
heatpower.ru hdhc.ru
heliko.no
hentaiheroes.com hentaiheroes.com
hermesbracelets.xyz himazin.info
histats.com hmywwogw.bloger.index.hr
homemade.gq hoholikik.club
hotdl.in hoste.octopis.com
hoverboardforsaledirect.com hostingclub.lk
huhn.altervista.org hoverboard360.nl
hut1.ru howtowhitenteethfast.xyz
ihtec2019.org hplaserjetpdriver8y.pen.io
ikearugs.xyz iboss.com
ilovevitaly.xyz icaseclub.ru
imediadesk.com iflycapetown.co.za
incomekey.net ilbe.club
infektsii.com ilikevitaly.com
infostatsvc.com ilmen.net
intellego.info imgarcade.com
invivo.hu integritylandscapeservices.com
iomoio.net investingclub.ru
iplusbit.blogspot.co.za istock-mebel.ru
irkutsk.online-podarki.com iweblist.info
ispac.org izismile.com
itsdp3.com jabimgo.pw
javitas.info james13prix.info
johannesburgsingles.co.za jennyfire.ru
jongose.ninja jrcigars.com
journalhome.com justdating.online
karaganda.xkaz.org kalandranis.gr
kasino-money.pw kambasoft.com
kazinogames.lv kazan.xrus.org
kimcurlrvsms.com kemerovo.zrus.org
kinostorm.net kinocccp.net
kiprinform.com kinosed.net
kirov.zrus.org krasula.pp.ua
kit-opt.ru kredit-pod-zalog-krasnodar.ru
kliksaya.com
koleso24.com.ua
kongruan.com
konoplisemena.com
koversite.info
krasivye-devushki.net
kretpicf.pw kretpicf.pw
kunstaktien.info lacapilla.info
kutikomi.net lacave.ntic.fr
ladsblue.com
laexotic.com laexotic.com
lafriore.ru lancheck.net
larchik.net
laxdrills.com laxdrills.com
ldrtrack.com le-clos-des-alouettes.com
leftofcentrist.com likesdesign.com
lego4x4.ru lineshops.biz
lexiangwan.com live-sexchat.ru
lida-ru.com ljusihus.se
life.biz.ua lombia.com
lion.bolegapakistan.com lomza.info
liquimondo.com lordzfilmz.me
listiseltemournlan.gq lottospring.com
littlecity.ch luckyday.world
livejasmin.com m.b00kmarks.com
livetsomudvekslingstudent.bloggersdelight.dk macdamaged.space
loadingpages.me macfix.life
longlifelomilomi.info manimpotence.com
luciddiagnostics.in marblestyle.ru
luxup.ru marketingtechniques.info
m1media.net maslenka.kz
m292.info masturbate.co.uk
magicplayer-s.acestream.net medanestesia.ru
magnetic-bracelets.ru medictube.ru
maju.bluesalt.co medispainstitute.com.au
malwareremovalcenter.com medkletki.ru
manve.info meetingrainstorm.bid
megakino.net mensandals.xyz
meget.co.za mexicosleevegastrectomy.com
meltwater.com michellblog.online
menhealed.net mikrobiologies.ru
mere.host.sk millionare.com
mindeyegames.com miniads.ca
minyetki.ru mirobuvi.com.ua
mobicover.com.ua misslike.ru
mobsfun.net mjchamonix.org
moncleroutletonline.pw monarchfind-a.akamaihd.net
money-every-day.com
moonci.ru
motherboard.vice.com motherboard.vice.com
moz.com moviezbonkerssk.cf
mp3films.ru movpod.in
muzaporn.com mrpornogratis.xxx
mydearest.co mundoaberrante.com
myonlinepayday.co my-cash-bot.co
myplaycity.com mybackgroundlandscape.blogspot.com
mypornfree.ru nakozhe.com
myprintscreen.com nakrutka.cc
nalogovyy-kodeks.ru
nalogovyykodeks.ru nalogovyykodeks.ru
newfilmsonline.ru naughtyconnect.com
nfljerseyscheapbiz.us net-profits.xyz
nuit-artisanale.com nextlnk12.com
nyfinance.ml nhl17coins.exblog.jp
obiavo.kz nikitabuch.com
offer.camp nmrk.ru
oklogistic.ru nootrino.com
one-gear.com nottyu.xyz
onefilms.net oakridgemo.com
online-sbank.ru obesidadealgarve.com
online-templatestore.com obiavo.su
onstrapon.purplesphere.in oecnhs.info
ownshop.cf offers.bycontext.com
owohho.com okonich.com.ua
paidonlinesites.com omsk.xrus.org
paighambot.com onlinebay.ru
panicatack.com onlinewritingjobs17.blogspot.ru
pdamods.ru ooomeru.ru
pdn-4.com ordernorxx.com
pelfind.me orgasmus-virtual.com
penisvergrotendepillennl.ovh orion-code-access.net
ostrovtaxi.ru
ourville.info
outpersonals.com
outrageousdeal-a.akamaihd.net
ownshop.win
oxotl.com
oyster-green.com
park.above.com
pc-services.ru
peugeot-club.org
phormchina.com phormchina.com
photokitchendesign.com photokitchendesign.com
picmoonco.pw php-market.ru
picsfair.com picsearch.com
picsforkeywordsuggestion.com pictures-and-images.net
picswe.com pijoto.net
pihl.se platesauto.com
pio.polytopesexempt.com platezhka.net
pixell.club playlott.com
pk-pomosch.ru pliks.pl
plastjulgranar.se plohaya-kreditnaya-istoriya.ru
popup-fdm.xyz pojdelo.weebly.com
poquoson.org poquoson.org
porno.simple-image.com.ua porno-video-chati.ru
pornobrazzers.biz pornoblood.com
pornofiljmi.com portnoff.od.ua
pornoklad.ru powenlite24.ru
porodasobak.net preventheadacheguide.info
prefersurvey.net prod2016.com
privat-girl.net profolan.pl
professionaldieselcare.com
profitsport.club
projectforte.ru projectforte.ru
prostitutki-astana.org prospekt-st.ru
prostitutki-belgoroda.org
proxyelite.biz
purchasepillsnorx.com
puzo2arbuza.ru puzo2arbuza.ru
pyramidlitho.webs.com quality-traffic.com
qor360.com quickchange.cc
quickcashlimited.com quizzitch.net
qwertty.net rainbowice.ru
rapevideosmovies.com rapidgator-porn.ga
razamicroelectronics.com razvratnoe.org
real-time-analytics.com
realtytimes.com
redbottomheels.xyz redbottomheels.xyz
redirectingat.com refudiatethissarah.info
remont-mobile-phones.ru registratciya-v-moskve.ru
revistaindustria.com remmling.de
rosbalt.com.ua remote-dba.de
ru-dety.ru rewardpoll.com
rus-pornuha.com rn-to-bsn.com
rusprostitute.com rockingclicks.com
sack.net runtnc.net
saitevpatorii.com rusenvironmental.net
sarahmilne.top rusoft-zone.ru
rvi.biz
samolet.fr
sape.top
satellite.maps.ilovevitaly.com
scanmarine.info
scanner-alex.top scanner-alex.top
scanner-alexa.top scanner-nelson.top
scanner-elena.top
scanner-walter.top scanner-walter.top
search-goo.com scanner-willy.top
searchaddis.com scat.porn
sei80.com schlampen-treffen.com
seinterface.com scopich.com
seksvideoonlain.com scrnet.biz.ua
semxiu.com search.alot.com
seo-2-0.com selectads.men
seocdvig.ru
seocheckupx.com
seofied.com
seorankinglinks.us
seorussian.ru
serdcenebolit.com serdcenebolit.com
serviporno.com sexobzor.info
sethrollins.net sexs-foto.com
sevenstars7.com sextracker.de
sex-tracker.com shymkent.xkaz.org
sexkontakte-seite.com sibdevice.ru
sexy-screen-savers.com
shinikiev.com.ua
shodanhq.com
shopvilleroyboch.com.ua
sildenafilcitratemed.com sildenafilcitratemed.com
simpoed.ufop.br sim-service.net
simul.co sispe.com.br
sinestesia.host.sk site-speed-check.site
sitevalued.com siteexpress.co.il
slavic-magic.ru
slavkokacunko.de slavkokacunko.de
slkrm.ru
sluganarodu.ru sluganarodu.ru
smadihome.com slujbauborki.ru
small-game.com slutloadlive.com
smichovbike.cz smailik.org
small-games.biz
smartbalanceworld.com
snegozaderzhatel.ru snegozaderzhatel.ru
snjatie-geroinovoy-lomki.ru socas.pluto.ro
snyatie-lomki-v-stacionare.ru sockshare.net
sockshares.tv soda.media
spaceshipad.com soietvousmaime.fr
spb-plitka.ru solicita.info
special-porn.com solmarket.by
speeddream.xyz space-worry.ml
sport7777.net speechfoodie.com
srgwebmail.nl staff.prairiesouth.ca
sribno.net statoutlook.info
startwp.org steebook.com
statustroll.com streetfooduncovered.com
suchenindeutschland.com strongsignal-a.akamaihd.net
stroymonolit.su
strv.se
stuffpride.com
styro.ru
sukarame.net
sukirgenk.dvrlists.com sukirgenk.dvrlists.com
swimpool.ca szamponrevita.pl
tako3.com tabakur77.com
tds-advert005.info teguh.info
tdsing.ru telemetryverification.net
teenforporn.com thedownloadfreeonlinegames.blogspot.com
texbaza.by themestotal.com
the-trader.net thiegs.reco.ws
theendivechronicles.com tizanidineandhydrocodone.blogspot.com
thewomenlife.com
titan-ads.life
titan-cloud.life
tizanidine4mg.blogspot.com
tizanidineonline.blogspot.com
tizanidinevssoma.blogspot.com tizanidinevssoma.blogspot.com
token-lab.org toloka.hurtom.com
toolsky.com topcar-krasnodar.ru
top1-seo-service.com torontoplumbinggroup.com
topdownloads.ru torrnada.ru
trafficjunky.net touchmods.fr
trafficmp.com tracksurf.daooda.com
traffixer.com tradedeals.biz
treasuretrack-a.akamaihd.net trafficcentr.xyz
tri-slona.org traffpartners.com
truck-land.life tvteleport.ru
trustl.life typer.one
tsstcorpcddvdwshbbdriverfb.aircus.com u-cheats.ru
twinderbella.com udsgame.online
twittrading.com
ublaze.ru
uchetunet.su
ultimatesetnewfreeallsoftupgradesystems.pw ultimatesetnewfreeallsoftupgradesystems.pw
upproar.com umnovocaminho.com
upstore.me unmaroll.ya.ru
uptimebot.net url-extractor.xyz
uptimechecker.com uvozdeckych.info
ural-buldozer.ru validdomain.xyz
url-img.link valoresito.com
uroffer.link vapomnoncri.tk
usiad.net ventelnos.com
utiblog.fr video-chat.love
validccseller.com video-woman.com
vandrie-ict.nl videochat.life
vellings.info videochat.tv.br
vesnatehno.com videokrik.net
virtualbb.com videooko.weebly.com
visa-pasport.ru vietimgy.pw
vk-mus.ru vip2ch.com
vksaver-all.ru vipps.com.my
vod.com.ua vizitki.net
voloo.ru vkonche.com
vremya.eu vkontarkte.com
vrnelectro.ru voloslove.ru
vykup-avto-krasnodar.ru voluumtracker1.com
vzlomfb.com w3data.co
warning.or.kr wallpapers-best.com
watchmygf.net wallpapersist.com
website-analytics.online webadvance.club
websiteexplorer.info weblibrary.win
whatsappdownload10.com website-datenbank.de
whos.amung.us website-speed-up.site
wildworld.site wechatdownload10.com
wiosenny-bon-1500.pl wesharepics.site
woman-h.ru westen-v.life
worldis.me whatistizanidine2mg.blogspot.com
wovis.site while.cheapwebsitehoster.com
wsgames.ru wholesalejerseychinaoutlet.com
ww2awards.info wieseversa.no
x-diesel.info wingsofrefuge.net
x-porno.video wma-x.com
xaylapdiendanang.com word-vorlagen.net
xdoza.com www.timer4web.com
xep.info xedserver.com
xingzi-vision.com xev.ru
xjrul.com xkaz.org
xmronta.com xn------7cdbapdecfd4ak1bn0amjffj7afu3y.xn--p1ai
xn-----7kceclhb4abre1b4a0ccl2fxch1a.xn--p1ai xn----itbeirbjbi7bc6bh2d.xn--p1ai
xn----7sbho2agebbhlivy.xn--p1ai xn--80aebbcbcdemfkhba4byaehoejh8dza3v.xn--p1ai
xn----8sbhefaln6acifdaon5c6f4axh.xn--p1ai xn--b1agm2d.net
xn----btbdvdh4aafrfciljm6k.xn--p1ai y8games-free.com
xn--1-8sbcpb0bdm8k6a.xn--p1ai yellowads.men
xn--80aafb2a.xn--p1ai yginekologa.com
xn--80adaggc5bdhlfamsfdij4p7b.xn--p1ai youjizz.com
xn--80atua3d.xn--p1ai youradexchange.com
xn--b1ag5cfn.xn--p1ai yoursearch.me
xn--lifehacer-1rb.com youtuhe.com
xnxxandxvideos.com zajm-zalog-krasnodar.ru
xtraffic.plus zeg-distribution.com
xxxasianporn.net zetmaster.ru
yaoguangdj.com zhorapankratov7.blogspot.com
yoshkarola.zrus.org zigarettenonlinekaufen.tumblr.com
yubikk.info zixizop.net.ru
yun56.co zona-aqua.ru
z-master.ru
za-music.mymobiplanet.com
zeroredirect10.com
zeroredirect7.com
zhongwenlink.com
zirondelli.it
zone-kev717.info
zooggames.com
zrelaya.pw
zrizvtrnpale.tk

462
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
0c47f8422d3f.com 1stat.ru
0lovespells0.blogspot.com 28n2gl3wfyb0.ru
11pikachu.ru 3-letter-domains.net
2728fb936f0.com 3weekdiet.com
45en.ru a.frcls.fr
4ur.click acheterviagrafr24.com
51.la addbin.men
5ws.dating-app.ru adf.ly
aab94f698f36684c5a852a2ef272e031bb.com aktivator-windows10.blogspot.com
abbanreddy.com alfa-img.com
above.com allnews.md
adultwebhosting.info aludecor.info
affordablewebsitesandmobileapps.com an-donut.com
ahhjf.com animali.deagostinipassion.it
amazingpic.net apioasisspacenet-a.akamaihd.net
apiadanaknet-a.akamaihd.net apispringsmartne-a.akamaihd.net
arabsexxxtube.com arenda-avtoprokat-krasnodar.ru
ardimobileinfo.ml
asscenihotosidea.blogspot.co.za
auto-zapchasti.org auto-zapchasti.org
autorn.ru ayerbo.xhost.ro
avramstroy.ru babs.com.ua
ayakino.net baltgem.com
bannerspace.com bannerswap.com
bestplacetobuyeriacta.jw.lt bbtec.net
bestwebsitesawards.com beachtoday.ru
bio-japan.net berlininsl.com
bitcoin-ua.top betterhdporn.com
bitcoins-live.ru bezcmexa.ru
blog.yam.com bigcareer.info
blue-square.biz bitcoinpile.com
boleznikogi.com bizfly.info
boo-arts.com blog-hits.com
bpro1.top bluesman.nu
bryansk.zrus.org bmwhighperformers.com
btvn.ru bochemit.com.ua
cam-kontakte.org bombla.org
canyougethighofftizanidine.blogspot.com cacheimages.com
cartierring.xyz camdenmemorials.com
cfcl.co.uk candypeople.se
cigarpass.com canrole.com
clickcash.com cerev.info
collegeessay19.blogspot.ru chatroulette.world
compliance-jane.top christianlouboutinsaleoutletonline.us
compliance-jess.top coindirect.io
compliance-jessica.top companies-catalog.com
compucelunlock.net compliance-walt.top
concealthyself.com compliance-walter.top
coolgramgoods.com
cordstrap.cc cordstrap.cc
crystalslot.com customerpromos-a.akamaihd.net
cyse.tk cyclobenzaprinevstizanidine.blogspot.com
d-black.bz dear-diary.ru
ddlmega.net defenderxtactical.com
detmebel.su dirtpics.pw
dev33.dioniqlabb.se dktr.ru
domainsatcost.com downloaddy.net
domainsphoto.com downloadeer.net
domik-derevne.ru draniki.org
domznaniy.ru e-poker-2005.com
doreenblog.online electro-prom.com
dostavimvdom.ru elektrozigarette2.wordpressy.pl
dostavka-v-ukrainu.ru embedle.com
download-walpaperhd.blogspot.com eralph.tk
ecxtracking.com ereko.ru
empirepoker.com essayassist.com
energydiet-info.ru everflora.ru
envaseslotusama.com exdocsfiles.com
erotikchat-24.com executehosting.com
escortplius.com extlabs.io
essaypro.com extremez.net
essayservicewriting.org ezigarettekaufen1.hpage.com
european-torches.ru ezigaretteshop2.vefblog.net
ewebarticle.info falcon-images.blogspot.com
exportshop.us
fandlr.com
fbdownloader.com fbdownloader.com
filmgo.ru femdom.twiclub.in
firstsiteguide.com fickblock18.com
formulaf1results.blogspot.com findanysex.com
forums.d2jsp.org finejewelryshop.ru
foxweber.com footballfarrago.com
front.ru forum-engineering.ru
fyxabomiw.ru frighteningremain.cf
genericlowlatencyasiodriverhq.aircus.com gael-s.ru
goodnightjournal.com gamezblox.com
goodwinmetals.co gazoblok.net.ua
gcup.ru
gosreg.amchs.ru
graphid.com
gratuitbaise.com
gribkovye-zabolevaniya.com
guildebzh.info guildebzh.info
hexpilot.com homeinns.com
himgaws.pw
host-protection.com
hostingclub.lk hostingclub.lk
houseofgaga.ru houdom.net
ifirestarter.ru icaseclub.ru
igithab.com iloveitaly.ru
ikearugs.xyz incep.imagine-ex.co
increasewwwtraffic.info increasewwwtraffic.info
innoslicon.com inspiring-desperate.tk
invivo.hu inzn.ru
ispac.org ip-guide.com
ispaniya-costa-blanca.ru irkutsk.zrus.org
jackwolfskinoutlet.online iusstf.org
japfm.com ivanstroi.ru
jongose.ninja izoll.ru
jrcigars.com jav-idol.com
kanimage.com jerseysbizwholesalecheap.com
khadastoafarde.tk joingames.org
kinohall.ru joyceblog.top
kongoultry.net kemerovo.zrus.org
konica.kz kino2018.cc
kursy-ege.ru kinogolos.ru
kvartir-remont.biz kletkimehan.ru
lacapilla.info klikbonus.com
lancheck.net komp-pomosch.ru
konteiner24.com
kw21.org
landscaping.center
lankarns.com
law-check-seven.xyz
legionalpha.com legionalpha.com
letmacwork.world letmacwork.world
liveshoppersmac.com livejasmin.com
ljusihus.se lodki-pvh.dp.ua
lol-smurfs.com madot.onlinewebshop.net
lulea-auktionsverk.se magiadinamibia.blogspot.com
macdamaged.tech manifestyourmillion.com
mbiologi.ru mapquestz.us
medicineseasybuy.com markjaybeefractal.com
megagrabber.ru matematikus.info
michaelkorssaleoutletonline.net me-ke.com
moesen-ficken.com metallosajding.ru
mojaocena.com metarip.ru
mexicotravelnet.com
missvietnam.org
moesonce.com
mojpregled.com mojpregled.com
mojpreskumanie.com mojpreskumanie.com
moncleronline.xyz moroccosurfadventures.com
money-for-placing-articles.com
mossmesi.com mossmesi.com
moviemail-online.co.uk mostantikor.ru
muycerdas.xxx mturkcontent.com
muzaporn.com multgo.ru
mwtpludn.review muz-shoes.ru
mylovelibrabry.com mydirtystuff.com
myonlinepayday.co myfreecams.com
nationalbreakdown.com napalm51.nut.cc
naturalbreakthroughsresearch.com naperehresti.info
neobux-bg.info nl.netlog.com
noumeda.com northfacestore.online
nsatc.net o00.in
officedocuments.net onemactrckr.com
offside2.5v.pl online-podarki.com
ohmyrings.com osoznanie-narkotikam.net
oklogistic.ru outpersonals.com
olvanto.ru
onlinadverts.com
onlinemeetingnow.com
onstrapon.purplesphere.in
ops.picscout.com
orion-code-access.net
oxford-book.com.ua
oynat.info oynat.info
pearlisland.ru p-business.ru
pisanieprac.info paceform.com
piter.xrus.org picquery.com
pixell.club pizda.lol
pizdopletka.club
podshipniki-ntn.ru podshipniki-ntn.ru
pornosee.info pomoc-drogowa.cba.pl
privatefx-in.ru pons-presse.com
pro-okis.ru pornhubforum.tk
prom23.ru pornoblood.com
puteshestvennik.com pornohub.me
pyrodesigns.com.au portnoff.od.ua
quick-offer.com projectforte.ru
psa48.ru
puzo2arbuza.ru
quality-traffic.com
quickloanbank.com quickloanbank.com
rankingchart.de ranksonic.com
razorweb-a.akamaihd.net responsive-test.net
remont-fridge-tv.ru respublica-otel.ru
resant.ru ring4rhino.com
running-line.ru rn-to-bsn.com
sabaapress.com salut-camp.ru
sbricur.com sarf3omlat.com
scanmyphones.com semxiu.com
sdsjweb.com seomarketings.online
securityallianceservices.com shikiso.info
seorank.info shtora66.ru
service-core.ru sibtest.ru
sexblog.pw sim-service.net
sexpornotales.com sitiz.club
sexvideo-sex.com skatestick.bid
sfd-chess.ru slavkokacunko.de
sheerseo.com
site.ru
sklad-24.ru
skutecznetabletkinaporostwlosow.pl
slowmac.tech
sluganarodu.ru sluganarodu.ru
smartpet.ru smokewithrabbits.com
sobecjvuwa.com.ru sms2x2.ru
socialtrade.biz social-fun.ru
sockshares.tv sofit-dmd.ru
sonata-arctica.wz.cz soserfis.com
ssconstruction.co spasswelt.net
stretchmate.net speedup-my.site
suture.co stats-collector.org
sygraem.com supermama.top
taboola.com svarkagid.com
terraclicks.com sweepstakes.rewardit.com
the-trader.net tattooreligion.ru
time-japan.ru td-l-market.ru
tivolibasket.it tds-advert002.info
tizanidine4mguses.blogspot.com thegolfclub.info
token-lab.org tizanidinesideeffects.blogspot.com
torrents.cd top10-online-games.com
trafficreceiver.club topanasex.com
torrents-tracker.com
tradgardspartner.se
traffic2money.com
trainoffend.ml
tuckpointingmasonrysystems.com
turist-strani.ru turist-strani.ru
tvory.predmety.in.ua tvory.predmety.in.ua
uchebavchehii.ru
ukrtvir.com.ua ukrtvir.com.ua
umg-stroy.ru unacittaconte.org
upstore.me unrealcommander.com
urengoy.pro urlopener.com
usiad.net usdx.us
vancleefreplica.pw veles.shop
varikoz24.com viagra.pp.ua
veerotech.com video-production.com
vepad.com vigrx-original.ru
verymes.xyz vip-parfumeria.ru
vodkoved.ru vip.51.la
voronezh.xrus.org visitcambridge.org
vpnhowto.info vita.com.hr
vysigy.su vitoriacabos.com
vzlomfb.com vodaodessa.com
wallpapersdesk.info voluumtracker1.com
webpromotion.ae vseigry.fun
webtherapy.ru vtcdns.com
whengirlsgowild.com warning.or.kr
white-truck.life webads.co.nz
wholesalejerseychinashop.com webnode.me
wiosenny-bon-1500.pl website-speed-check.site
wnhjavlhezp.gq wemarketing.se
wordpresscore.com westen-z.life
www.bookmaker-bets.com wfb.hatedriveapart.com
x-rates.ru wjgony.com
xmlinde.com word-vorlagen.xyz
xcc24.pl
xn----ctbbcjd3dbsehgi.xn--p1ai
xnxx699.com xnxx699.com
xxxguitars.com xzlive.com
yougame.biz yougotanewdomain.com
youtubedownload.org zarabotat-na-sajte.ru
yugo-star.ru zawyna.ua
zaidia.xhost.ro zeroredirect1.com
zazagames.org zeroredirect11.com
zeikopay.com zeroredirect8.com
zeroredirect.com zmoda.hostreo.com
zigzog.ru zoogdisany.com
znakomstvaonlain.ru

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.71 0; 10.1.1.168 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.07.3262 ### Version: V4.2022.08.3263
### Updated: Sun Jul 31 22:01:34 UTC 2022 ### Updated: Mon Aug 1 10:03:23 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.07.3262 ### Version: V4.2022.08.3263
### Updated: Sun Jul 31 22:01:34 UTC 2022 ### Updated: Mon Aug 1 10:03:23 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##