vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-02 18:50:13 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2022.08.3281 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2022-08-10 10:09:27 +00:00
parent 29c1d05344
commit 4ae43409d8
46 changed files with 87862 additions and 87862 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.08.3280 #### Version: V4.2022.08.3281
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.08.3280 #### Version: V4.2022.08.3281
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -14,7 +14,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2022.08.3280 #### Version: V4.2022.08.3281
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

10848
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2022.08.3280 #### Version: V4.2022.08.3281
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

10852
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

10852
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

10852
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

10852
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.175 1; 10.1.1.75 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.175 0; 10.1.1.75 0;
127.0.0.1 0; 127.0.0.1 0;

10852
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.175 1; 10.1.1.75 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.175 0; 10.1.1.75 0;
127.0.0.1 0; 127.0.0.1 0;

10852
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.175 1; 10.1.1.75 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.175 0; 10.1.1.75 0;
127.0.0.1 0; 127.0.0.1 0;

10852
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
3280 3281

10852
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

10852
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.9.27.155 0; 20.245.236.38 0;

10852
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.175 1; 10.1.1.75 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.175 0; 10.1.1.75 0;
127.0.0.1 0; 127.0.0.1 0;

10852
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.175 1; 10.1.1.75 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.175 0; 10.1.1.75 0;
127.0.0.1 0; 127.0.0.1 0;

10852
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.175 1; 10.1.1.75 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.175 0; 10.1.1.75 0;
127.0.0.1 0; 127.0.0.1 0;

10852
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.9.27.155 0; 20.245.236.38 0;

10852
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.9.27.155 0; 20.245.236.38 0;

10852
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.175 1; 10.1.1.75 1;
127.0.0.1 1; 127.0.0.1 1;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
BDCbot DataCha0s
Copyscape FemtosearchBot
Download Wonder GetRight
Haansoft Kozmosbot
Larbin Navroad
SMTBot NetLyzer
SiteExplorer Ripper
Swiftbot Sqlworm
Web Collage WebStripper
sp_auditbot crawler.feedback

284
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
404checker 404enemy
80legs 80legs
ADmantX AIBOT
Abonti Aboundex
AfD-Verbotsverfahren Aboundexbot
AhrefsBot
Aipbot
AllSubmitter AllSubmitter
Alligator Alligator
Anarchy AlphaBot
Anthill Anarchie
Apexoo AwarioSmartBot
Atomseobot BackStreet
BBBike BackWeb
Backlink-Ceck BacklinkCrawler
Badass
Bandit
Barkrowler Barkrowler
BatchFTP
Bigfoot Bigfoot
Black Hole
Blackboard Blackboard
Brandprotect
Buck Buck
Buddy Buddy
BuiltBotTough Bullseye
BuiltWith BunnySlippers
CATExplorador CATExplorador
CCBot CSHttp
Calculon Calculon
Cegbfeieh Cegbfeieh
CensysInspect CheTeam
CheeseBot CheeseBot
CherryPicker CherryPicker
ChinaClaw Chlooe
Citoid Citoid
Claritybot
Cocolyzebot Cocolyzebot
Collector Crawling at Home Project
CopyRightCheck Custo
Copyscape
CrazyWebCrawler
DBLBot
DIIbot DIIbot
DataCha0s
DatabaseDriverMysqli
Demon
Devil Devil
Digincore
Discobot
Discoverybot Discoverybot
Dispatch
DnBCrawler-Analytics DnBCrawler-Analytics
DnyzBot
DomainAppender
DomainSigmaCrawler
DomainStatsBot DomainStatsBot
Domains Project Domains Project
Dotbot Dotbot
Download Wonder
Drip Drip
ECCP/1.0
EMail Siphon
EasyDL EasyDL
EroCrawler Ecxi
Exabot Exabot
ExtLinksBot Express WebPictures
ExtractorPro
EyeNetIE EyeNetIE
Ezooms Ezooms
FemtosearchBot FHscan
Fimap
Firefox/7.0 Firefox/7.0
FlashGet Flunky
Fuzz Freeuploader
FyberSpider FrontPage
Fyrebot
G-i-g-a-b-o-t G-i-g-a-b-o-t
GT::WWW
Genieo Genieo
GermCrawler
GetWeb
Getintent Getintent
Gigabot Gigabot
GrabNet GoZilla
Grafula
GrapeFX
GrapeshotCrawler GrapeshotCrawler
GridBot HTTrack
HMView Harvest
HTTP::Lite
Havij Havij
Heritrix
HonoluluBot HonoluluBot
Humanlinks
HybridBot HybridBot
IDBTE4M
IDBot IDBot
Iblog InfoTekies
Id-search IstellaBot
IndeedBot JOC Web Spider
Intelliseek Joomla
Iskanie JustView
JennyBot
JetCar
Jorgee
Kenjin Spider Kenjin Spider
Keyword Density Keyword Density
Kozmosbot Kozmosbot
LeechFTP LNSpiderguy
Lftp LWP::Simple
Likse LibWeb
LinkScan Libwhisker
Linkbot LinkextractorPro
LinksManager LinksManager
LinqiaMetadataDownloaderBot
LinqiaRSSBot LinqiaRSSBot
Lipperhey LinqiaScrapeBot
Lmspider
Ltx71 Ltx71
MFC_Tear_Sample MFC_Tear_Sample
MIDown tool
MIIxpc MIIxpc
MSIECrawler MJ12bot
MQQBrowser
MSFrontPage
Mag-Net Mag-Net
Magnet
Majestic SEO Majestic SEO
Majestic-SEO
Majestic12
MarkWatch MarkWatch
Masscan Masscan
Meanpathbot MauiBot
Metauri MeanPath Bot
Mediatoolkitbot
Microsoft URL Control Microsoft URL Control
Mister PiX Mozlila
Morfeus Fucking Scanner
Mr.4x3
Msrabot Msrabot
Musobot Musobot
Name Intelligence NICErsPRO
NearSite
Needle Needle
Nessus
Net Vampire
NetLyzer
NetSpider
NetZIP NetZIP
Netcraft
Niki-bot Niki-bot
Nikto
NimbleCrawler NimbleCrawler
Nmap Nimbostratus
Octopus Ninja
Offline Explorer Not
Nuclei
Nutch
Offline Navigator Offline Navigator
OrangeSpider OnCrawl
PHPCrawl OpenVAS
Openvas
OutclicksBot
OutfoxBot
POE-Component-Client-HTTP
Page Analyzer
PageAnalyzer PageAnalyzer
PageScorer
Pandalytics Pandalytics
Panscient Panscient
Papa Foto
Pavuk Pavuk
PeoplePal PictureFinder
Pi-Monster Piepmatz
Pixray Pixray
PleaseCrawl
Pockey Pockey
Psbot
QueryN Metasearch
Quick-Crawler Quick-Crawler
RankActive RSSingBot
RankActiveLinkBot
RankingBot
Rankivabot
ReGet ReGet
Reaper RebelMouse
Recorder Recorder
RedesScrapy RocketCrawler
RepoMonkey Scanbot
Ripper Scrapy
SEOprofiler ScreenerBot
SEOstats ScrepyBot
Searchestate
SearchmetricsBot SearchmetricsBot
Seekport
SemanticJuice
Semrush Semrush
SemrushBot
Seomoz
Siphon Siphon
SiteCheckerBotCrawler
SiteExplorer
SiteLockSpider SiteLockSpider
SiteSnagger SiteSnagger
SiteSucker
Sitebeam Sitebeam
Sitevigil
SmartDownload SmartDownload
Snapbot Snapbot
SocialRankIOBot Sogou web spider
Spammen Sosospider
Spanner
SputnikBot SputnikBot
Stripper Sqlworm
Sucker
Sucuri Sucuri
SuperHTTP Swiftbot
Suzuran
Szukacz Szukacz
T0PHackTeam Teleport
Telesphoreo TeleportPro
Telesphorep Telesoft
TightTwatBot Titan
Toata
Toweyabot Toweyabot
Trendictionbot TurnitinBot
TwengaBot
Typhoeus Typhoeus
URLy.Warning VB Project
Upflow VelenPublicWebCrawler
Virusdie VeriCiteCrawler
Voil VoidEYE
Voltron
WBSearchBot
WEBDAV WEBDAV
WISENutbot WWW-Collector-E
WWW-Mechanize
WWWOFFLE WWWOFFLE
Wallpapers/3.0 WallpapersHD
WeSEE WeSEE
Web Auto
Web Enhancer Web Enhancer
Web Fuck
Web Sauger Web Sauger
Web Sucker
WebBandit WebBandit
WebFetch WebCopier
WebEnhancer
WebFuck WebFuck
WebImageCollector
WebReaper WebReaper
WebSauger WebSauger
WebStripper WebStripper
WebSucker
WebWhacker WebWhacker
Webalta WebmasterWorldForumBot
Webshag
Website Quester Website Quester
Whack
Whatweb
Who.is Bot Who.is Bot
Widow Widow
WinHTTrack
WiseGuys Robot WiseGuys Robot
Wonderbot Woobot
Wotbox Wotbox
Wprecon Xenu
Zade Zade
Zauba
Zeus
Zitebot
ZmEu ZmEu
ZoominfoBot
ZyBorg
adscanner adscanner
archive.org_bot
autoemailspider autoemailspider
backlink-check cah.io.community
check1.exe
coccocbot
cognitiveseo
com.plumanalytics com.plumanalytics
crawl.sogou.com crawler4j
demandbase-bot demandbase-bot
eCatch gopher
evc-batch
facebookscraper
instabid
ips-agent ips-agent
lwp-trivial iubenda-radar
linkdexbot
magpie-crawler magpie-crawler
mediawords muhstik-scan
page scorer pcBrowser
ripz probe-image-size
satoristudio.net
scalaj-http scalaj-http
seobility
seoscanners seoscanners
seostar tAkeOut
trendiction.com trendiction.com
voyagerx.com voyagerx.com
webprosbot webmeup-crawler
x22Mozilla x09Mozilla
zauba.io
zgrab zgrab

314
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
360Spider
404checker
404enemy 404enemy
80legs
ADmantX ADmantX
AIBOT
Abonti Abonti
Acunetix Aboundex
Alligator Aboundexbot
Anarchie AiHitBot
Aipbot
AllSubmitter
Anarchy99 Anarchy99
Anthill Anthill
Aspiegel Apexoo
Atomseobot
Attach Attach
AwarioRssBot
AwarioSmartBot AwarioSmartBot
BBBike Backlink-Ceck
BDCbot BacklinkCrawler
BackDoorBot Badass
Bandit Barkrowler
BatchFTP BatchFTP
Battleztar Bazinga BetaBot
Bigfoot Bigfoot
Black Hole
BlackWidow BlackWidow
Blackboard
Blow Blow
Boardreader BlowFish
Bolt
Brandprotect Brandprotect
Brandwatch Brandwatch
Buck Buck
BuiltBotTough Buddy
BunnySlippers BuiltWith
CODE87 CODE87
CSHttp
Calculon
CazoodleBot CazoodleBot
Cegbfeieh CensysInspect
CherryPicker
ChinaClaw
Citoid
Cliqzbot
Cloud mapping Cloud mapping
CopyRightCheck Cocolyzebot
Copyscape Cogentbot
Copier
Craftbot
Crawling at Home Project Crawling at Home Project
Crescent Crescent
CrunchBot
DBLBot
DTS Agent
DataCha0s DataCha0s
DatabaseDriverMysqli Demon
Deusu
Devil Devil
Digincore Digincore
DigitalPebble
Disco Disco
Discoverybot
DittoSpyder DittoSpyder
DomCopBot DnBCrawler-Analytics
DnyzBot
DomainStatsBot
Dotbot Dotbot
Download Wonder Drip
Dragonfly EMail Siphon
Ecxi Ecxi
EirGrabber EirGrabber
Exabot Evil
Express WebPictures Express WebPictures
ExtLinksBot ExtLinksBot
Extractor
EyeNetIE
Ezooms Ezooms
FDM FHscan
FemtosearchBot FemtosearchBot
FlashGet
Flunky Flunky
FyberSpider
Fyrebot
GalaxyBot GalaxyBot
Genieo GermCrawler
GetRight
GetWeb GetWeb
Gigabot Gigabot
Go-Ahead-Got-It Go-Ahead-Got-It
Grabber GoZilla
Grafula Gotit
GrapeFX GrapeFX
GridBot HTMLparser
HEADMasterSEO HTTrack
Haansoft Haansoft
HaosouSpider HonoluluBot
Harvest
Havij
Heritrix
Hloader
Humanlinks
HybridBot
IDBot
IRLbot IRLbot
Id-search Id-search
Image Sucker Image Fetch
IndeedBot
Indy Library Indy Library
InfoNaviRobot InfoNaviRobot
Intelliseek
Internet Ninja
JOC Web Spider JOC Web Spider
Jbrofuzz
Jetty Jetty
JikeSpider JikeSpider
Joomla Kenjin Spider
Jorgee Keybot Translation-Search-Machine
JustView Keyword Density
Kozmosbot Lanshanbot
LWP::Simple LexiBot
Larbin Lftp
Leap LibWeb
LeechGet Libwhisker
LinkScan Lightspeedsystems
LinkWalker LinkpadBot
Linkbot
Lipperhey Lipperhey
Lmspider Lipperhey Spider
MFC_Tear_Sample Litemage_walker
MSIECrawler Ltx71
MIDown tool
MTRobot
Mag-Net Mag-Net
Mail.RU_Bot
Majestic SEO
MarkMonitor MarkMonitor
Masscan Masscan
MauiBot MauiBot
Microsoft Data Access MeanPath Bot
Mediatoolkitbot
Metauri
MicroMessenger
Minefield
Mister PiX Mister PiX
Moblie Safari Mojeek
MolokaiBot
Morfeus Fucking Scanner Morfeus Fucking Scanner
Mozlila NPbot
Mr.4x3
Msrabot
Musobot
Name Intelligence Name Intelligence
Nameprotect
NearSite
Needle
Net Vampire
NetLyzer NetLyzer
NetMechanic NetZIP
Netcraft Netcraft
Netvibes Nmap
Nibbler Octopus
NimbleCrawler
Nuclei
Nutch
Offline Explorer Offline Explorer
Openfind Offline Navigator
Openvas
OrangeSpider
OutclicksBot
OutfoxBot OutfoxBot
PECL::HTTP PECL::HTTP
Page Analyzer Page Analyzer
PageScorer
PageThing.com PageThing.com
Pandalytics Papa Foto
Panscient Pavuk
Petalbot PictureFinder
Picscout Pimonster
ProWebWalker Probethenet
PxBroker Psbot
QueryN Metasearch Pump
RankActive Quick-Crawler
RankActiveLinkBot RankurBot
RankingBot2 Re-re
Rankivabot Reaper
ReGet
RebelMouse RebelMouse
Ripper
Rogerbot
SBIder SBIder
SMTBot SEOlyticsCrawler
SISTRIX
SalesIntelligent SalesIntelligent
ScanAlert Scrapy
ScoutJet ScrepyBot
Screaming
ScreenerBot
SearchmetricsBot
Seekport Seekport
SemanticJuice SemrushBot
Semrush SeoSiteCheckup
Siphon Seomoz
Site Sucker
SiteCheckerBotCrawler SiteCheckerBotCrawler
SiteExplorer Snake
SiteSnagger SocialRankIOBot
Sitebeam
Siteimprove
Sociscraper Sociscraper
SpaceBison
SpankBot SpankBot
Spbot Spbot
Sqlmap Sqlworm
Steeler Sqworm
SuperHTTP Stripper
Surfbot Sucker
Szukacz Sucuri
T8Abot SurveyBot
Telesphoreo Suzuran
Telesphorep Telesphorep
Thumbor
Toata Toata
Trendiction Tracemyfile
True_Robot Trendictionbot
TwengaBot
Twice
Typhoeus Typhoeus
URLy Warning Upflow
V-BOT
VB Project
VCI VCI
Vagabondo
VelenPublicWebCrawler
Voil
Voltron
WASALive-Bot WASALive-Bot
WEBDAV WBSearchBot
WISENutbot WISENutbot
WPScan WPScan
WWW::Mechanize WWW-Mechanize
WebCollage Wallpapers
WebEnhancer Wallpapers/3.0
Web Fuck
Web Pix
WebCopier
WebFuck
WebImageCollector WebImageCollector
WebSucker WebReaper
WebWhacker WebSauger
Webalta WebStripper
Website Quester WebmasterWorldForumBot
WebsiteExtractor
Webster Webster
WinHTTrack Whack
Whatweb
Who.is Bot
Widow
WiseGuys Robot
Wonderbot Wonderbot
Xaldon_WebSpider Woobot
YoudaoBot YoudaoBot
Zade
Zauba Zauba
Zermelo Zermelo
Zitebot ZoomBot
ZmEu
ZoominfoBot ZoominfoBot
ZumBot
adscanner
archive.org_bot
arquivo-web-crawler arquivo-web-crawler
arquivo.pt
autoemailspider
coccocbot coccocbot
cognitiveseo
com.plumanalytics com.plumanalytics
crawler.feedback
crawler4j
dataforseo.com
domainsproject.org domainsproject.org
facebookscraper evc-batch
heritrix heritrix
ips-agent iubenda-radar
isitwp.com lwp-trivial
magpie-crawler magpie-crawler
meanpathbot meanpathbot
muhstik-scan mediawords
netEstate NE Crawler page scorer
oBot
polaris version
probe-image-size
ripz ripz
satoristudio.net s1z.ru
scalaj-http sogouspider
seocompany.store sp_auditbot
seoscanners
sexsearcher
spyfu spyfu
trendiction.com tAkeOut
trendiction.de
ubermetrics-technologies.com
webgains-bot webgains-bot
webprosbot webmeup-crawler
webpros.com
x09Mozilla
xpymep1.exe
zauba.io zauba.io

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
applyneedy.xyz beachdriveblog.com
bio-japan.net bestserials.com
ezrvrentals.com boobsimge.com
meddesk.ru elvenmachine.com
naval.jislaaik.com kmgamex.cf
putevka24.ru optibuymac.com
redirectingat.com polcin.de
socialmediasuggest.com sexblog.pw
www.ehscloud.cn veerotech.com
youbrainboost.asia xn----7sbahjd3btneuw1joc.xn--p1ai

924
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
101flag.ru
123cha.com 123cha.com
1pamm.ru 4ureyesonly.com
28n2gl3wfyb0.ru 7fon.ru
3dracergames.com 8558l.jobs.net
55wmz.ru 999webdesign.com
6hopping.com 9med.net
7a2rnuey1tw9ar.ru abctoppictures.net
7xc4n.com abtasty.com
991mostfm.co.id academia-nsk.org
acheterviagrafr24.com adbetclickin.pink
adrenalin-stk.ru adclickservice.com
adservme.com adexprts.com
adtech.de alborzan.com
adtech.fr albuteroli.com
adultfriendfinder.com algarveglobal.com
ahhjf.com all4invest.ru
aktobe.xkaz.org am15.net
alevinefesleri.com amazon-seo-service.com
alf-img.com anatomiy.com
algerianembassy.co.in animalia-life.club
alif-ba-ta.com anticrawler.org
all4wap.ru apiadanaknet-a.akamaihd.net
allbizne.co.ua apiitsthirteende-a.akamaihd.net
allkrim.com apioutoboxnet-a.akamaihd.net
alot.com arius.tech
alyeskaresort.com artel116.ru
amehdaily.com ascat.porn
anaksma.info asociatia-tipografilor-transilvania.ro
animenime.ru
apessay.com
apibetweenlinesn-a.akamaihd.net
apidiamondatanet-a.akamaihd.net
apiqualitinknet-a.akamaihd.net
appleid-verification.com
arewater.com
arquivo.pt
asdfz.pro
asiavirtualsolutions.com
asscenihotosidea.blogspot.co.za asscenihotosidea.blogspot.co.za
asseenontv.ru atleticpharm.org
audiobangout.com atofilms.com
australia-opening-times.com atout-energie-69.com
autodo.info avkzarabotok.com
autoloans.com avtolombard-krasnodar.ru
autoseo-traffic.com backuperwebcam.weebly.com
autotop.com.ua baersaratov.ru
avirasecureserver.com balla-boo.se
avtoarenda.by bbtec.net
b2b-lounge.com
back.dog
backgroundpictures.net
balkanfarma.org
bamo.xsl.pt
bannerswap.com
barnfurnituremart.com
bcmp.org
bdsmgalls.net bdsmgalls.net
beachdriveblog.com belinka.com.ua
belsetirehafi.tk best-businessman.ru
bestbrainprod.win betterhdporn.com
bestdooz.com betwinservice.com
bestofferswalkmydogouteveryday.gq bidbuy.co.kr
bestpriceninja.com bigpenisguide.com
besttorrentknifta.weebly.com bigpictures.club
bestwaystogetpaid.us blackhatworth.com
bestwrinklecreamnow.com bloggen.be
bet-prognoz.com bluejays-jerseys.us
bin-brokers.com bochemit.com.ua
bio-market.kz boltalko.xyz
bizfly.info bookmaker-bet.com
biznesluxe.ru brainboosting.club
bjanshee.ru brains2.biz
blog.remote-computer.de bronzeaid-a.akamaihd.net
blogs.rediff.com btvn.ru
bonkers.name bum.com.ru
bosefux.esy.es butstrap.space
brandedleadgeneration.com buy-meds24.com
brianhenry.co buzzzg.men
briomotor.co bvlgaribracelet.xyz
btnativenav.com canacopegdl.com
burkesales.com candypeople.se
bus-offer.com carina-sy.de
buyessay3.blogspot.ru
buypuppies.ca
buzzsumo.com
callejondelpozo.es
cam-kontakte.org
candlehandmade.com
capture-room.com
cartierbraceletsreplica.pw cartierbraceletsreplica.pw
cartujano-pre.de cartierreplica.win
casinopinup-wins.com castingbank.ru
cdncash.org caulderwoodkennels.com
celejihad.info cbox.ws
chatroulette.world cejewelry.xyz
cheap-pills-norx.com celebsopics.com
cheapmoncler.pw centrdebut.ru
check-this-out-now.online cezartabac.ro
chinese-amezon.com cfacarrosserie74.com
cicaki.net charmstroy.info
ciceros.co chatroulette.life
cinemaenergy-hd.ru cheapjerseysfootballshop.com
cjmc.info christianlouboutinoutlet.win
cjs.com.ru circlesl.com
claytransformations.info clarithromycin500mg.com
clodo.ru clean-start.net
conocer-sanabria.com clean-virus-mac.com
contentsexpress.com clickbanksites.info
converse.ddsoldes.fr clickpapa.com
cookie-law-enforcement-aa.xyz clips.ua.ac.be
counciltally.com cmd.kz
countbertwistdisp26.soup.io cntravelre.com
craftinsta.ru cocyq.inwtrade.com
culturevie.info community.allhiphop.com
dating-time-now.com compliance-andrew.xyz
deluxedumps.com compliance-barak.top
compliance-brian.top
compliance-irvin.xyz
constantaservice.net
cookie-law-enforcement-ff.xyz
cool-wedding.net
counter.bloke.com
counter.yadro.ru
cpajunkies.com
crystalslot.com
cyse.tk
d-black.bz
dailystrength.org
daisye.top
data-mining.tk
data-ox.com
datract.com
ddsoldes.fr
demon-tweeks.com
derevesendeco.com
deshevo-nedorogo.ru
detective01.ru
deutschland123.de deutschland123.de
dinosaurus.site divci-hry.info
diusyawiga.tk dlya-android.org
djstools.com dogsrun.net
domashneeruporno.com
dosug-lux.ru dosug-lux.ru
dtnlyss.com dtm-spain.com
dvd-famille.com duplicashapp.com
dverimegapolis.ru dustyorate.com
dyt.net dyt.net
e-commerce-seo.com
e-poker-2005.com
e705.net
eas-seo.com eas-seo.com
easyshoppermac.com ebonyporn.site
ecxtracking.com edge.sharethis.com
elmacho.xyz educatemetv.com
emerson-rus.ru eduinfosite.com
en.altezza.travel elektrischezigarettekaufen2.cowblog.fr
enbersoft.com elektronischezigarette2.mex.tl
englishgamer.com elektrozigaretten1.webs.com
ereko.ru en.home-task.com
erotikchat-24.com energy-ua.com
eorogo.top
erectile.bid
es5.com
esnm.ru
essay-writing.work essay-writing.work
eugenevaultstorage.com este-line.com.ua
euroskat.ru eu-cookie-law.info
evehemming.blogspot.com.au excaliburfilms.com
exchangeit.gq f-loaded.de
expertnaya-ocenka.ru f5mtrack.com
exportshop.us factorynightclub.com
expresstoplivo.ru fanpagerobot.com
extremal-blog.com fetishinside.com
ezrvrentals.com filefilter.weebly.com
f012.de filerockstar298.weebly.com
farm26.ru financepoints.eu
farmprofi.net findpik.com
fast-torrent.ru finemanteam.com
fastfixing.tech firstsiteguide.com
fearcrow.com flashahead.info
femdom.twiclub.in fm-upgrade.ru
fishtauto.ru folowsite.com
floridamobilebillboards.com frcls.fr
fortevidyoze.net freecamdollars.com
forum20.smailik.org fres-news.com
foxweber.com funcrushgames.com
franch.info galaxyflowers.ru
franklinfire.co gallerily.com
free-fbook-traffic.com game-top.su
free-gluten.ru garciniaxt.us
fuckmill.com generousdeal-a.akamaihd.net
fullgirl.ru get-seo-domain.com
game-mmorpg.net getdot.ru
gamedayhouse.com getridofstretchmarks.org
gaming-journal.com girlgamerdaily.com
gateway.zscalertwo.net goatse.ru
gay-file.com googst2.ru
gelezki.com
getyourimage.club
ghernnqr.skyrock.com
glcomputers.ru
globetrotting-culture.ru
golaya.pw
gonextmedia.com
goodhumor24.com
gopro-online.info
gosmeb.ru gosmeb.ru
gosreg.amchs.ru greatidea.marketing
gowreckdiving.com gsbs.com.ua
graphicwe.org guod.me
greatgrace.ru gz2.bbsoldes.fr
gsasearchengineranker.space haveinc.xyz
gsasearchengineranker.top hawaiielectriclight.com
gta-club.ru hornymatches.com
handicapbathtubarea.com hotel-mkad.ru
hdwallpapers-free.com
hdxnxxtube.mobi
headpharmacy.com
hermesbelts.xyz
hkladys.com
hledejvshopech.cz
home-task.com
homedecorpicture.us
horoshieokna.com
hotsocialz.com
houtings.xyz houtings.xyz
hunthillfarmtrust.org husky-shop.cz
i-hobot.ru hustoon.over-blog.com
ido3.com hyipmanager.in
igithab.com iideaidekonkatu.info
imagine-ex.co imfamous.info
imagui.eu imgata.com
incest-ru.com imguramx.pw
incomekey.net impotentik.com
informatiecentro.be in-tandem.co
int.search.tb.ask.com inboxdollars.com
iqoption.com infazavr.ru
isitwp.com innodgfdriverhm.aircus.com
islamtoday.co.za instasexyblog.com
itronics.ca intermesh.net
iusstf.org internet-apteka.ru
izhevsk.zrus.org intimshop-fantasy.ru
jacago.com inzn.ru
jagg.info iomoio.net
javlibrary.cc ip-guide.com
jerseysbizwholesalecheap.com iphantom.com
jerseyssportsshop.com iron-age.info
justucalling32211123456789.tk janerikholst.se
kalb.ru japfm.com
katadhin.co javatex.co.id
katushka.net jerseychinabizwholesale.us
kazrent.com kabbalah-red-bracelets.com
ketoanhanoi.info kakablog.net
keywesthideaways.co kakadu-interior.com.ua
keywordhut.com karachev-city.ru
keywords-monitoring-success.com keki.info
keywordsuggests.com keywordblocks.com
kinopolet.net khadastoafarde.tk
kladrus.ru
klitimg.pw
klosetkitten.com klosetkitten.com
kmgamex.cf knogg.net
kountrylife.com konica.kz
koversite.info koronirealestate.gr
krasivye-devushki.net kreativperlen.ch
krassh.ru kskjco.club
lacapilla.info ktotut.net
lanasshop.ru kwzf.net
landscaping.center labafydjxa.su
laptoper.net laexotic.com
larose.jb2c.me lafourmiliaire.com
leadwayau.com lankarns.com
lecbter-relationships.ga lecbter-relationships.ga
lechtaczka.net ledis.top
letolove.ru likesuccess.com
linerdrilling.com lineshops.biz
linkbolic.com linkwithin.com
linkrr.com
lionking-1994.blogspot.com
liquimondo.com
lirunet.ru lirunet.ru
livefixer.com lisque.batcave.net
liveu.infoteka.hu locationdesaison.com
lkbennettstore.online lunamedia.co
lottospring.com lunchrock.co
louisvuittonoutletstore.net lutherstable.org
luckyday.world luxup.ru
macresource.co.uk macdamaged.space
magazin-pics.ru
magicalfind-a.akamaihd.net
manualterap.roleforum.ru
manyresultshub-a.akamaihd.net
marktforschung-stuttgart.com marktforschung-stuttgart.com
mb140.ru mastershef.club
mcadamssupplyco.com matpre.top
mebel-vstroika.ru meduza-consult.ru
mebelcomplekt.ru member-quiz.com
med-zdorovie.com.ua members.ghanaweb.com
medicinacom.ru memberty.com
medicineseasybuy.com
meendo-free-traffic.ga
meet-flirt-dating.com
meetlocalchicks.com
mex-annushka.ru mex-annushka.ru
mirtorrent.net micasainvest.com
mistr-x.org mir-business-24.ru
mmgq.ru misswell.net
mncrftpcs.com mobilemedia.md
moesexy.com mobplayer.ru
moncleronline.xyz mokrayakiska.com
morf.snn.gr monclercheap.xyz
mototsikl.org monsterdivx.tv
musezone.ru moroccosurfadventures.com
mossmesi.com
motherboard.vice.com
moz.com
mp3ringtone.info
msfsaar.de
musicktab.com
muztops.ru muztops.ru
mybinaryoptionsrobot.com my-aladin.com
myblogregistercm.tk my-big-family.com
mydeathspace.com mycaf.it
myfreemp3.eu mylesosibirsk.ru
myliveblog.ru mypets.by
mystats.xyz myyour.eu
namenectar.com networkad.net
naughtyconnect.com nfljerseyscheapchinabiz.com
netvouz.com nordstar.pro
nfvsz.com northfacestore.online
nodup.ru nosecret.com.ua
npoet.ru nudepatch.net
nudejapan.net obesidadealgarve.com
nullrefer.com oconto.ru
obsessionphrases.com
offer.camp
offer.wpsecurity.website
okmusic.jp okmusic.jp
okroshki.ru onko-24.com
omsk.xrus.org onlinebay.ru
online-hit.info onlinemeetingnow.com
online-podarki.com onlinemegax.com
onlyforemont.ru oralsexfilme.net
ontargetseo.us ordernorxx.com
openmultipleurl.com orion-v.com
ops.picscout.com orsonet.ru
optitrade24.com ovirus.ru
optom-deshevo.ru pacificair.com
paighambot.com
panchro.co.uk
paradontozanet.ru paradontozanet.ru
pdns.download partner-cdn.men
penisvergrotendepillennl.ovh partner-trustworthy.men
pc-virus-d0l92j2.pw
pdfprof.com
pearlisland.ru
pertlocogasilk.tk
pestomou.info pestomou.info
peugeot-club.org petitions.whitehouse.gov
pic-re.blogspot.com photo.houseofgaga.ru
pierrehardysale.online pillscheap24h.com
pinkduck.ga
pinsdaddy.com pinsdaddy.com
piter.xrus.org
pk-pomosch.ru pk-pomosch.ru
pl-top.pl platezhka.net
plastgran.com play-mp3.com
plastgranar.nu podshipniki-ntn.ru
platinumdeals.gr polytopesexempt.com
plusnetwork.com pony-business.com
podshipniki-nsk.ru porno-video-chati.ru
pornozhara.com pornoelita.info
pornzone.tv pornoslive.net
portal-eu.ru portadd.men
pr0fit-b0x.com positive2b.ru
predmety.in.ua pospr.waw.pl
priceg.com pozdrawleniya.ru
pricheski-video.com
primedice.com primedice.com
producm.ru printdirectforless.com
proekt-gaz.ru privacyassistant.net
promodj.com professionalwritingservices15.blogspot.ru
profit-opportunity.com
propranolol40mg.blogspot.com propranolol40mg.blogspot.com
proprostatit.com proxyelite.biz
prostitutki-belgoroda.org psvita.ru
prostitutki-tolyatti.org putitin.me
purchasepillsnorx.com
pussysaga.com
pxhdwsm.com
qcstrtvt.bloger.index.hr
r-control.ru r-control.ru
raavidesigns.com rainbowice.ru
rada.ru redbottomheels.xyz
ranksonic.org rednise.com
ratemodels.net regionshop.biz
rating-bestcasino.com registrydomainservices.com
razleton.com remont-mobile-phones.ru
realitykings.com
recipedays.ru
reckonstat.info
redhotfreebies.co.uk
relatodelpresente.com.ar
remont-comp-pomosh.ru
remontvsamare.su
renewablewealth.com renewablewealth.com
rentaremotecomputer.com rentaremotecomputer.com
rep-am.com resellerclub.com
rn-to-bsn.com resultshub-a.akamaihd.net
rock-cafe.info rfserial.net
rollercoin.com ribieiendom.no
rostov.xrus.org robot-forex.biz
runtnc.net roleforum.ru
sabizonline.com rosbalt.com.ua
sad-torg.com.ua rossmark.ru
saecsa.co rucrypt.com
sanatorrii.ru rus-pornuha.com
sanjosestartups.com russintv.fr
saveriopiazza.it salmonfishingsacramentoriver.com
scanhub.ru sammyweaver.com
scanner-julianna.top sampleletters.net
searchimpression.com sbf441.com
searchtooknow-a.akamaihd.net sbt-aqua.ru
scalerite.co.za
scanner-george.top
scopich.com
scrapinghub.com
scrapy.org
sdelai-prosto.ru
sdrescher.net
search.pch.com
secretscook.ru
securityallianceservices.com securityallianceservices.com
sel-hoz.com seinterface.com
seminarygeorgia59.ga selectads.men
semp.net seminarykansas904.ml
seoholding.com senger.atspace.co.uk
sexkvartal.com seo-smm.kz
sexobzor.info seolab.top
ship-marvel.co.ua seorussian.ru
shoesonlinebuy.cn serving.adbetclickin.pink
shopperifymac.com sevendays.com.ua
shtora66.ru sex-tracker.com
sitevalued.com shisha-swag.de
sledstvie-veli.net shopsellcardsdumps.com
shopwme.ru
sibecoprom.ru
simplesite.com
sinestesia.host.sk
sisiynas.ru
sispe.com.br
siteonomy.com
skachat-besplatno-obrazcy.ru
skuteczna-dieta.co.pl
slim.sellany.ru
slomm.ru
sloopyjoes.com
smadihome.com
small-games.biz small-games.biz
socas.pluto.ro smokewithrabbits.com
social-button.xyz social-buttons.com
socialbutton.xyz spidtest.org
socialbuttons.xyz spitfiremusic.com
sockshares.tv sps-shop.com
softomix.net spyfu.com
solinf.co spywarespy.com
sstroy44.ru stair.registrydomainservices.com
stardevine.com stairliftsarea.com
store-rx.com star61.de
stroimajor.ru stathat.com
studiofaca.com stauga.altervista.org
sureone.pro stpicks.com
suture.co streha-metalko.si
symbaloo.com stretchmate.net
szamponrevita.pl stroydetali.ru
tagil.zrus.org success-seo.com
takethatad.com sucsesofinspiration.com
taqplayer.info sukirgenk.dvrlists.com
tattooreligion.ru superfish.com
techart24.com svarbit.com
teesdaleflyballclub.co.uk syvertsen-da.no
textads.men t-bygg.com
thaismartloan.com tackletarts.co
theallgirlarcade.com tattooha.com
thebestweightlosspills.ovh taxi-v-eisk.ru
thefotosgratis.eu td-l-market.ru
thegolfclub.info tehngr.ru
thewebsitetemplate.info template-kid.com
tilido.com
timecrimea.ru timecrimea.ru
titangel-vietnam.com tizanidinehcl4mgtab.blogspot.com
tizanidineinfo.blogspot.com tizanidinerecreationaluse.blogspot.com
tizanidinemusclerelaxant.blogspot.com tizanidinevsvalium.blogspot.com
tizanidinewithdrawal.blogspot.com tmtrck.com
tmearegion26.com tobeyouday.win
tongkatmadura.info tomck.com
tootoo.to tootoo.to
top-deal.com.pl torrnada.ru
top-l2.com
top-study.work
top250movies.ru
topappspro.com
topclickguru.com
topdownloads.ru
topvidos.ru
torrent-to-magnet.com
tracfone.com
tradgardspartner.se tradgardspartner.se
trafficmania.com trahvid.com
trafficstars.com triumf-realty.ru
traffpartners.com trudogolik.net
trk-4.net tula.mdverey.ru
truck-addzilla.life typer.one
tt-ipd.info ukrobstep.com
tubeoffline.com umg-stroy.ru
tvand.ru unisexjewelry.org
tytoona.com
u-cheats.ru
uggsale.online
um-razum.ru
unrealcommander.com unrealcommander.com
uroki.net upproar.com
vancleefreplica.pw upstore.me
viberdownload10.com upupa.net
videochat.mx utiblog.fr
vkgaleria.com uzungil.com
veerotech.com
vellings.info
via-energy-acquistare.com
viagra.pp.ua
videochat.ph
videositename.com
videtubs.pl
vinylvault.co.uk
virus-schutzmasken.de
vk-mus.ru
vkak.ru
vkonche.com
vodaodessa.com vodaodessa.com
voloslove.ru
vonradio.com
vostoktrade.info vostoktrade.info
vykup-avto-krasnodar.ru vozbujdenie.com
warningzscaler.heraeus.com w7s.ru
watchinf.com walkme.com
watchmygf.net wallpapersist.com
we-are-gamers.com wapsite.me
website-analytics.online webmasterhome.cn
website-datenbank.de webnode.me
webtherapy.ru weddingdresses.xyz
wechatdownload10.com wejdz-tu.pl
whatsappdownload10.com weprik.ru
wholesalejerseychinaoutlet.com westsextube.com
wordkeyhelper.com whatzmyip.net
wholinkstome.com
windowssearch-exp.com
witclub.info
wjgony.com
wladimirpayen.com
wordpresscore.com
worldoffiles.ru
wpsecurity.website
www.ehscloud.cn
wyniki-lista.pl wyniki-lista.pl
x-lime.net wzgyyq.com
xep.info xn--80aafb2a.xn--p1ai
xn----7sbbagbq7bd5aheftfllo4m.xn--p1ai
xn----7sbbahaq9bb5afgiqfliv4m.xn--p1ai
xn----8sblgmbj1a1bk8l.xn----161-4vemb6cjl7anbaea3afninj.xn--p1ai
xn--80aanaardaperhcem4a6i.com
xn--80ab4aa2g.xn--p1ai
xn--80ahvj9e.xn--p1ai xn--80ahvj9e.xn--p1ai
xn--h1ahbi.com.ua xn--80ajjbdhgmudixfjc8c5a9df8b.xn--p1ai
xolodremont.ru xnxx699.com
xtremeeagles.net xtraffic.plus
yachts-cruise.info xvideosporn.biz
yaoguangdj.com xxxdatinglocal.us
yourads.website yaaknaa.info
za-music.mymobiplanet.com yadro.ru
zagadki.in.ua yeartwit.com
zarabotok--doma.ru youbrainboost.asia
zarepta.com yougetsignal.com
zero1.it youjizz.vc
zocaparj.kz yoursearch.me
yoursite.com
youtubologia.it
yun56.co
yunque.pluto.ro
zaobao.com.sg
zeroredirect9.com
zigarettenonlinekaufen1.blox.pl
zoogdiesney.com zoogdiesney.com
zrelaya.pw zynax.ua

482
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
1008.su 0912701309f8ce.com
13tabs.com 2015god.org
3weekdiet.com 2x2fan.ru
404.mn 4ureyesonly.com
4rent.ru 888.com
883zy.com 8kisses.eu
adanih.com aa8780bb28a1de4eb5bff33c28a218a930.com
add-add.men activepr.ru
admitad.com admitad.com
aihelen.net alif-ba-ta.com
alpinism.ru allcredits.su
amehdaily.com allpdfmags.net
animal36.com alltheviews.com
apiwoodensealcom-a.akamaihd.net alyeskaresort.com
arquapetrarca.info android-style.com
artefakct.com anonymous-redirect.com
asacopaco.tk api.stathat.com
asdfz.pro apple.com-webbrowsing-security.science
asseenontvonline.ru asia-forum.ru
autoblogger24.info asophoto.com
avkzarabotok.info avtoarenda.by
axbocz.net avtointeres.ru
ayakino.net azbukafree.com
azbaseimages.net bashtime.ru
backlink4u.net bestplacetobuyeriacta.jw.lt
baladur.ru betterhdporn.com
baoxaydung.com.vn bezcmexa.ru
battle.net blackplanet.com
bbsoldes.fr blacktwhite.com
bestprofits-there.com blagovest-med.ru
besttorrentknifta.weebly.com blog.axant.it
bestwebsiteawards.com blogporn.in
bestwrinklecreamnow.com boo-arts.com
billiard-classic.com.ua btvn.ru
bodybuilding-shop.biz buy-loft.ru
c-english.ru buyscabiescream.com
cand.jp byme.se
cartierreplica.win camsex.xxx-cam.webcam
casinos4dummies.co.uk carapics.com
cayado.snn.gr carson.getenjoyment.net
cfjump.com cartierlovebraceletreplica.xyz
charmstroy.info casite-513049.cloudaccess.net
cheapmoncler.xyz chatseo.com
cheapwebsitehoster.com chinaelitecheapjerseys.com
chelnytruck.ru chlooe.com
cialischsrx.com chocolateslim-en-espana.com
clicksor.net cialischmrx.com
coderstate.com cialiswithoutadoctor.net
companies-catalog.com cindymatches.com
compliance-george.xyz club-samodelkin.ru
compliance-walt.top codysbbq.com
cognitiveseo.com
community.allhiphop.com
compliance-elena.xyz
contentsexpress.com
coslab.club
cottageofgrace.com
credit-respect.ru credit-respect.ru
creditmoney.com.ua custodieva.ru
customsua.com.ua cutalltheshit.com
ddospanel.com czat.wp.pl
dear-diary.ru dellalimov.com
deda-moroza-zakaz.ru design-ideas.info
deluxedumps.com digest-project.ru
demian.kz dildofotzen.net
detective01.ru directrev.com
diarioaconcagua.com discovertreasurenow.com
donna7753191.ru dneprsvet.com.ua
ednorxmed.com dollartree.info
electrik-avenue.com domashneeruporno.com
elektrischeziga.livejournal.com easyukraine.com
elektronischezigarettekaufen1.myblog.de edge.sharethis.com
elexies.info elektrischezigarette2.onsugar.com
elitepcgames.com elektrozigarette1.dreamwidth.org
eralph.tk elitedollars.com
exci.ru erotag.com
eyemagination.com erotiktreff24.info
fanpagerobot.com extener.org
filmci.pro ezb.elvenmachine.com
filunika.com.ru familyphysician.ru
finemanteam.com fdzone.org
food.dtu.dk firesub.pl
freeuploader.com fordsonmajbor.cf
freshberry.com.ua fotzen-ficken.com
funcrushgames.com foxtechfpv.com
fym.com.ru free-social-buttons.com
gallery.rennlist.com free-social-buttons.xyz
gallerylisting.com freelotto.com
gaming-journal.com freenode.info
futbolkisales.ru
geile-lelly.eu geile-lelly.eu
get-your-social-buttons.info get-seo-domain.com
getresponse.com girlsfuckdick.com
gotwebsite1.com gosarhivrt.ru
guod.me gox.com.ua
harmonyglen.us gpirate.com
hchha.com gsasearchengineranker.site
hebr.myddns-flir.com gsasearchengineranker.space
hexpilot.com hacktougroup.ru
highspeed5.net hdpixent.com
histats.com historichometeam.com
hop.clickbank.net host-protection.com
horoshieokna.com iccornacircri.cf
housekuba.org ifirestarter.ru
idealtits.net iklysha.ml
impotentik.com ilovevitaly.xyz
interfucks.net immobiliaremassaro.com
iron-age.info inbabes.sexushost.com
istizanidineacontrolledsubstance.blogspot.com iqupdatetmz.win
jav-fetish.com jo24news.com
jaxcube.info johannesburgsingles.co.za
jerseyssportsshop.com kam-dom.ru
jmat.cn klumba55.ru
karusel-market.ru kopihijau.info
keki.info kraljeva-sutjeska.com
khadastoafarde.tk kredit-pod-zalog-krasnodar.ru
kichenaid.ru la-fa.ru
knowsitall.info lineavabit.it
kurwa.win liumimgx.pw
kuzinsp.ru loftdigital.eu
ldrtrack.com m1media.net
letslowbefast.today mainlinehobby.net
lexiangwan.com mantramusic.ru
lider-zhaluzi.kiev.ua matrixalchemy.com
lion.playtap.us medkritika.ru
locksmith.jp message-warning.net
longlifelomilomi.info minegam.com
losangeles-ads.com monarchfind-a.akamaihd.net
lost-alpha.ru moncleronline.xyz
lovi-moment.com.ua monthlywinners.com
lubetube.com moonci.ru
macresource.co.uk motherboard.vice.com
manyresultshub-a.akamaihd.net mrcsa.com.au
marketingtechniques.info mrvideospornogratis.xxx
mecash.ru muabancantho.info
meddesk.ru myghillie.info
medkletki.ru myindospace.com
mega-polis.biz.ua myprintscreen.com
methodsmarketing.com nailsimg.com
mhi-systems.ru naturalshair.site
mmog-play.ru netoil.no
my-bc.ru notasprensa.info
myphotopipe.com nufaq.com
nalogovyy-kodeks.ru o-o-8-o-o.com
napalm51.nut.cc obesidadealgarve.com
newstaffadsshop.club onemactrckr.com
norththeface.store onlinemegax.com
nullrefer.com origin-my.ru
obiavo.com pacificair.com
obiavo.su par-fallen.ga
offers.bycontext.com pastaleads.com
oklogistic.ru physfunc.ru
oktube.ru
okuos.com
onetravelguides.com
online-zaymy.ru
opinionreelle.com
orenburg-gsm.ru
ostrovtaxi.ru
ourtherapy.ru
perm-profnastil.ru
perm.xrus.org
picsearch.com picsearch.com
plastgranar.nu picture-group.com
poems.com.ua piluli.info
poppen-nw.net pixgood.com
porno-transsexuals.ru pl-vouchers.com
platinumdeals.gr
porno-video-chati.ru
pornodojd.ru
pornonik.com pornonik.com
pornoplen.com potolokelekor.ru
powenlite24.ru powc.r.ca.d.sendibm2.com
pravoholding.ru priceg.com
predmety.in.ua psvita.ru
prokotov.com
pyramidlitho.webs.com
qld10000.net qld10000.net
razyboard.com qwarckoine.com
recinziireale.com r-control.ru
rfserial.net remedyotc.com
remont-comp-pomosh.ru
resultshub-a.akamaihd.net
rimedia.org rimedia.org
russia-tao.ru ring4rhino.com
ros-ctm.ru
ruscopybook.com
sammlungfotos.online sammlungfotos.online
sanatorrii.ru saneitconsulting.com
scanner-fred.top sarafangel.ru
seo18.su sc-specialhost.com
seojokes.net scanner-ivan.top
sex-foto.pw scanner-jessica.top
sexblog.pw scottbywater.com
sexkontakte-seite.com searchaddis.com
sexpornotales.com sei80.com
sextracker.be sel-hoz.com
ship-marvel.co.ua seofirmreviewsus.info
shmetall.com.ua sibvitr.ru
shoesonlinebuy.xyz sim-service.net
shohanb.com simple-image.com.ua
slavkokacunko.de skyway24.ru
social-s-iii.xyz snip.to
softonicads.com social-vestnik.ru
solicita.info spy-sts.com
spasswelt.net stauga.altervista.org
spywarebegone.com stoki.ru
stockspmb.info supermodni.com.ua
streetfire.net surffoundation.nl
strongholdsb.ru swingerseiten.com
strongsignal-a.akamaihd.net swinginwithme.ru
strv.se taqplayer.info
studworks.org tattoo33.ru
suchenindeutschland.com teenporn18.net
telefonsex-ohne0900.net telefonsexsofort.tk
theendivechronicles.com telemetryverification.net
thefds.net teletype.in
ticketsys.inetwd.com thegamerznetwork.com
tizanidinemusclerelaxant.blogspot.com tizanidine6mg.blogspot.com
top-l2.com tizanidinecost.blogspot.com
tubeoffline.com topanasex.com
tuckpointingmasonrysystems.com trafficgenius.xyz
tytoona.com trafficmania.com
vavilone.com tri-slona.org
vepad.com truck-rece.life
viagra.pp.ua tuckermktg.com
video-chat.in tvand.ru
vigrx-original.ru twojebook.pl
viteonlusarezzo.it tx41tclega.ru
vltai.com u17795.netangels.ru
vmnmvzsmn.over-blog.com udsgame.online
vseigru.one umaseh.com
universals.com.ua
unrealcommander.com
urldelivery.com
v-doc.co
valuado.com
video-camer.com
videotuber.ru
virus-schutzmasken.de
vostoktrade.info
vut.com.ru vut.com.ru
vykupavto-krasnodar.ru w7s.ru
walkme.com webalan.ru
wardreapptokone.tk wholesalecheapjerseysfree.com
warezkeeper.com wonderfulflowers.biz
warning.or.kr word-vorlagen.xyz
warningwar.ru wovis.site
watchdogs-2.ru xfire.com
webmasterhome.cn xn--24-glceagatoq7c2a6ioc.xn--p1ai
wechatdownload10.com xn--80aaajbdbddwj2alwjieei2afr3v.xn--p1ai
whatistizanidine2mg.blogspot.com xn--80aebbcbcdemfkhba4byaehoejh8dza3v.xn--p1ai
winx-play.ru xn--90acenikpebbdd4f6d.xn--p1ai
wpsecurity.website xn--b1ag5cfn.xn--p1ai
wsgames.ru xn--e1aggki3c.xn--80adxhks
wstroika.ru xxxkaz.org
www.event-tracking.com yebocasino.com
x-mix.info za-music.mymobiplanet.com
xn-----6kcaacnblni5c5bicdpcmficy.xn--p1ai zaloro.com
xn--b1agm2d.net znakomstva-piter78.ru
xrus.org zoomovies.org
xsion.net zygophyceous.womanstars.site
xxx-cam.webcam
xxxtubesafari.com
yatrk.xyz
yellocloud.be
yourdesires.ru
yun56.co
zacreditom.ru
zajm-zalog-krasnodar.ru
zakon-ob-obrazovanii.ru
zebradudka.com
zigarettenonlinekaufen1.bloog.pl

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.175 0; 10.1.1.75 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.08.3280 ### Version: V4.2022.08.3281
### Updated: Tue Aug 9 22:01:20 UTC 2022 ### Updated: Wed Aug 10 10:03:42 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.08.3280 ### Version: V4.2022.08.3281
### Updated: Tue Aug 9 22:01:20 UTC 2022 ### Updated: Wed Aug 10 10:03:42 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##