vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-10 15:34:24 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2022.05.3103 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2022-05-13 22:07:16 +00:00
parent 03559db47d
commit a02507004d
46 changed files with 102204 additions and 102204 deletions
Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.05.3102 #### Version: V4.2022.05.3103
#### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.05.3102 #### Version: V4.2022.05.3103
#### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -14,7 +14,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2022.05.3102 #### Version: V4.2022.05.3103
#### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

12638
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2022.05.3102 #### Version: V4.2022.05.3103
#### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

12642
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

12642
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

12642
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

12642
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.154 1; 10.1.0.204 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.154 0; 10.1.0.204 0;
127.0.0.1 0; 127.0.0.1 0;

12642
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.154 1; 10.1.0.204 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.154 0; 10.1.0.204 0;
127.0.0.1 0; 127.0.0.1 0;

12642
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.154 1; 10.1.0.204 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.154 0; 10.1.0.204 0;
127.0.0.1 0; 127.0.0.1 0;

12642
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
3102 3103

12642
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

12642
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.39.43.155 0; 20.106.124.141 0;

12642
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.154 1; 10.1.0.204 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.154 0; 10.1.0.204 0;
127.0.0.1 0; 127.0.0.1 0;

12642
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.154 1; 10.1.0.204 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.154 0; 10.1.0.204 0;
127.0.0.1 0; 127.0.0.1 0;

12642
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.154 1; 10.1.0.204 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.154 0; 10.1.0.204 0;
127.0.0.1 0; 127.0.0.1 0;

12642
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.39.43.155 0; 20.106.124.141 0;

12642
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.39.43.155 0; 20.106.124.141 0;

12642
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.154 1; 10.1.0.204 1;
127.0.0.1 1; 127.0.0.1 1;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
Anarchie Chlooe
DomainCrawler CrunchBot
IRLbot DIIbot
Internet Ninja Dotbot
Lightspeedsystems EroCrawler
Pavuk Majestic-SEO
Rankivabot ScoutJet
Stripper WebsiteQuester
cognitiveseo plumanalytics
x22Mozilla seocompany.store

334
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
01h4x.com 01h4x.com
Aboundex 360Spider
AfD-Verbotsverfahren AIBOT
Aboundexbot
Aipbot
Alexibot
AllSubmitter
Alligator Alligator
AlphaBot AlphaBot
Anarchy Aspiegel
Ankit Asterias
Apexoo Atomseobot
Attach
AwarioRssBot
BBBike BBBike
BDFetch BDFetch
BLEXBot BLEXBot
BackDoorBot BackDoorBot
BackStreet
Backlink-Ceck
Bandit
BatchFTP
BetaBot
Bigfoot
BlackWidow
Blackboard
Boardreader
BotALot
Brandprotect
Buck Buck
Bullseye Buddy
BuiltBotTough
BuiltWith
BunnySlippers
BuzzSumo
CODE87 CODE87
Calculon CazoodleBot
CherryPicker CheeseBot
Chlooe Chlooe
Citoid
Claritybot Claritybot
Cliqzbot Cloud mapping
Collector Cocolyzebot
CopyRightCheck Cosmos
Craftbot CrazyWebCrawler
CrunchBot Curious
CyotekWebCopy Custo
DBLBot DataCha0s
Deusu Deusu
Devil Disco
Discobot
Discoverybot Discoverybot
DnBCrawler-Analytics Dispatch
DittoSpyder
DnyzBot DnyzBot
DomCopBot DomainSigmaCrawler
DomainAppender Domains Project
Dotbot
Download Wonder
Dragonfly
Drip
ECCP/1.0 ECCP/1.0
EMail Wolf EMail Wolf
EirGrabber Ebingbong
Evil Evil
Exabot Exabot
Express WebPictures ExtractorPro
Extractor
Ezooms Ezooms
FHscan FlashGet
FemtosearchBot
Fimap
Firefox/7.0
Flunky
Freeuploader
FrontPage
Fuzz
Fyrebot
G-i-g-a-b-o-t
Genieo
GermCrawler GermCrawler
GetWeb Gigabot
Getintent
Go!Zilla Go!Zilla
GoZilla Go-Ahead-Got-It
GrapeFX
GrapeshotCrawler GrapeshotCrawler
HEADMasterSEO HTMLparser
HMView
HTTP::Lite
Haansoft
HaosouSpider HaosouSpider
Havij Harvest
Heritrix
HonoluluBot HonoluluBot
Humanlinks HybridBot
IRLbot
Iblog Iblog
Image Sucker Id-search
IndeedBot IlseBot
InfoNaviRobot Image Fetch
InternetSeer Internet Ninja
Iskanie JOC Web Spider
JamesBOT JamesBOT
JennyBot
JetCar JetCar
JikeSpider JikeSpider
Joomla Jorgee
LNSpiderguy Keybot Translation-Search-Machine
Keyword Density
Kozmosbot
LWP::Simple
Lanshanbot Lanshanbot
LexiBot Leap
Libwhisker Libwhisker
LieBaoFast
Lightspeedsystems
Likse
LinkScan LinkScan
LinkextractorPro Linkbot
LinkpadBot Lipperhey
LinksManager Lipperhey Spider
LinqiaMetadataDownloaderBot Litemage_walker
LinqiaRSSBot
LinqiaScrapeBot
Lmspider Lmspider
Ltx71 MFC_Tear_Sample
MIDown tool
MSFrontPage MSFrontPage
MTRobot MSIECrawler
Mag-Net
Magnet Magnet
Mail.RU_Bot Mail.RU_Bot
Majestic-SEO Majestic SEO
MarkMonitor Majestic12
MarkWatch
Mass Downloader
Masscan Masscan
MauiBot Mata Hari
Mb2345Browser
MeanPath Bot
Meanpathbot Meanpathbot
MegaIndex.ru MegaIndex.ru
Metauri Metauri
MicroMessenger Microsoft Data Access
Mister PiX Microsoft URL Control
Moblie Safari Mojolicious
Mojeek NICErsPRO
MolokaiBot Needle
Musobot Nessus
Navroad Net Vampire
NearSite
NetAnts NetAnts
NetZIP NetLyzer
Netvibes NetMechanic
Nibbler Nmap
Niki-bot Not
NimbleCrawler Nuclei
Nimbostratus
Nutch Nutch
Offline Explorer Octopus
OpenLinkProfiler
OpenVAS OpenVAS
OrangeBot OrangeBot
OrangeSpider
OutclicksBot OutclicksBot
PECL::HTTP OutfoxBot
PHPCrawl PHPCrawl
Page Analyzer Page Analyzer
Pi-Monster PageAnalyzer
Picscout PageGrabber
PeoplePal
Picsearch
Piepmatz
Pixray Pixray
Pockey
ProPowerBot
Pu_iN Pu_iN
Quick-Crawler Pump
RankActiveLinkBot PxBroker
RankingBot2 PyCurl
Rankivabot RankingBot
Re-re RankurBot
ReGet RealDownload
Recorder
RocketCrawler
Rogerbot Rogerbot
SEOkicks
SEOkicks-Robot
SEOlyticsCrawler
SEOprofiler
SEOstats SEOstats
SMTBot
SalesIntelligent SalesIntelligent
ScanAlert Scanbot
ScoutJet ScoutJet
Seekport Searchestate
SemanticJuice SeoSiteCheckup
SemrushBot Site Sucker
SentiBot SiteExplorer
SeobilityBot SiteSucker
SiteLockSpider Siteimprove
SlySearch Snake
SmartDownload
Snapbot
Snoopy Snoopy
SocialRankIOBot SocialRankIOBot
Sociscraper
Sottopop
SpaceBison
Spammen Spammen
Spbot SpankBot
Spanner
SputnikBot SputnikBot
Sqlmap Sqlworm
Sqworm Sqworm
Suzuran Steeler
Swiftbot Sucuri
Telesphorep Surfbot
Szukacz
T8Abot
Teleport
TeleportPro
TheNomad
Thumbor
TightTwatBot
Titan Titan
Tracemyfile Toweyabot
True_Robot True_Robot
TurnitinBot Turingos
TwengaBot Turnitin
Twice
Typhoeus
URLy Warning URLy Warning
UnisterBot UnisterBot
VB Project VB Project
VCI VelenPublicWebCrawler
Virusdie
Voil
Voltron Voltron
WASALive-Bot
WBSearchBot
WEBDAV
WPScan WPScan
WWW-Collector-E
WWWOFFLE
Wallpapers/3.0 Wallpapers/3.0
WallpapersHD
Web Enhancer
Web Fetch
Web Pix
Web Sauger
WebBandit
Web Collage Web Collage
WebPix Web Enhancer
Web Sauger
Web Sucker Web Sucker
WebmasterWorldForumBot WebBandit
Webshag WebEnhancer
Website Quester WebSucker
WebsiteExtractor WebZIP
WebsiteQuester Webalta
Whack Whatweb
Widow Widow
WinHTTrack
WiseGuys Robot
Wonderbot Wonderbot
Woobot Wprecon
Xaldon_WebSpider
Xenu
YoudaoBot
Zauba Zauba
Zermelo Zermelo
Zeus ZoominfoBot
ZmEu ZyBorg
ZoomBot
ZumBot
adscanner
arquivo-web-crawler arquivo-web-crawler
arquivo.pt arquivo.pt
autoemailspider check1.exe
backlink-check
clark-crawler
com.plumanalytics
crawl.sogou.com
crawler.feedback
crawler4j crawler4j
evc-batch eCatch
facebookscraper gopher
ips-agent heritrix
instabid
internetVista monitor
isitwp.com
linkdexbot
lwp-trivial
magpie-crawler
mediawords mediawords
plumanalytics muhstik-scan
oBot
page scorer
polaris version polaris version
s1z.ru
scalaj-http scalaj-http
serpstatbot
sexsearcher
sogouspider sogouspider
sp_auditbot sp_auditbot
sysscan spyfu
tAkeOut tAkeOut
trendiction.com
trendiction.de
ubermetrics-technologies.com ubermetrics-technologies.com
voyagerx.com webgains-bot
webpros.com
x09Mozilla x09Mozilla
x22Mozilla x22Mozilla
zgrab

308
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
404checker
404enemy 404enemy
ALittle Client ADmantX
AIBOT
ASPSeek ASPSeek
AhrefsBot Abonti
Aboundex
Aboundexbot
AfD-Verbotsverfahren
AiHitBot
Aipbot Aipbot
Alexibot
AllSubmitter
Alligator
AlphaBot AlphaBot
Apexoo Anarchie
Attach Anarchy99
AwarioRssBot Ankit
Aspiegel
Asterias
AwarioSmartBot AwarioSmartBot
BDCbot
BDFetch BDFetch
BLEXBot BackDoorBot
BackStreet BackStreet
BackWeb
Badass Badass
Bandit
Barkrowler Barkrowler
BatchFTP Bitacle
Battleztar Bazinga Black Hole
Blackboard
Blow Blow
Boardreader Brandprotect
BotALot
Brandwatch Brandwatch
Buddy
BuiltBotTough BuiltBotTough
Bullseye BuiltWith
BuzzSumo CazoodleBot
CCBot CensysInspect
CSHttp
Calculon
CherryPicker CherryPicker
Citoid Chlooe
Claritybot Craftbot
Cogentbot Custo
Copier CyotekWebCopy
CopyRightCheck DataCha0s
DIIbot Demon
Deusu
Devil
Disco
Discoverybot Discoverybot
Dispatch
DittoSpyder DittoSpyder
DnyzBot DnyzBot
DomCopBot DomainAppender
DomainCrawler DomainCrawler
Domains Project DomainSigmaCrawler
Drip EMail Wolf
EMail Siphon
EasyDL EasyDL
EroCrawler Evil
Exabot
Express WebPictures
ExtLinksBot
Extractor
ExtractorPro ExtractorPro
FDM
FHscan FHscan
Fimap
Firefox/7.0
FlashGet FlashGet
Flunky
Foobot Foobot
Freeuploader FyberSpider
Fyrebot
G-i-g-a-b-o-t
GT::WWW GT::WWW
GetWeb GermCrawler
Getintent Gigabot
Go-Ahead-Got-It
Gotit Gotit
GrabNet
Grabber Grabber
GrapeshotCrawler Grafula
GridBot GrapeFX
HTTP::Lite HEADMasterSEO
HTTrack
Haansoft Haansoft
HaosouSpider HaosouSpider
Hloader Havij
Humanlinks IDBTE4M
IRLbot IRLbot
Image Fetch Id-search
IndeedBot Image Sucker
Indy Library
InfoNaviRobot
InfoTekies
Intelliseek Intelliseek
Internet Ninja Internet Ninja
JOC Web Spider InternetSeer
JamesBOT Iria
Jbrofuzz IstellaBot
JennyBot JennyBot
JetCar JetCar
Jetty Joomla
Kenjin Spider
Keybot Translation-Search-Machine Keybot Translation-Search-Machine
Keyword Density
Kozmosbot Kozmosbot
LNSpiderguy LNSpiderguy
LWP::Simple
Lanshanbot
Larbin
Leap
LexiBot LexiBot
Libwhisker
LieBaoFast LieBaoFast
Lightspeedsystems Likse
LinkpadBot Litemage_walker
LinksManager Ltx71
LinqiaMetadataDownloaderBot MIDown tool
Lipperhey Spider
MFC_Tear_Sample
MIIxpc
MSFrontPage
MTRobot MTRobot
Magnet Magnet
Mail.RU_Bot
Majestic SEO Majestic SEO
Majestic-SEO
Majestic12 Majestic12
MarkMonitor
Mass Downloader Mass Downloader
Masscan
Mata Hari Mata Hari
Meanpathbot MauiBot
Mediatoolkitbot MegaIndex.ru
Microsoft URL Control Metauri
MicroMessenger
Minefield Minefield
Mojeek Mojeek
MolokaiBot Morfeus Fucking Scanner
Mr.4x3 NPbot
Msrabot
Musobot
NICErsPRO
NearSite
Nessus Nessus
Netcraft NetLyzer
Netvibes NetMechanic
NextGenSearchBot NetZIP
Offline Navigator Nettrack
Nibbler
Niki-bot
Nimbostratus
Nmap
Nutch
OpenLinkProfiler OpenLinkProfiler
OpenVAS Openvas
OutclicksBot OrangeBot
OrangeSpider
OutfoxBot OutfoxBot
PECL::HTTP
PHPCrawl PHPCrawl
PageGrabber
PageScorer PageScorer
PageThing.com PageThing.com
Panscient Panscient
Pavuk Papa Foto
PeoplePal PeoplePal
Pi-Monster Petalbot
Picsearch
PictureFinder
Pimonster Pimonster
Pockey PleaseCrawl
ProPowerBot ProWebWalker
Psbot Probethenet
Pu_iN PxBroker
RSSingBot PyCurl
QueryN Metasearch
Quick-Crawler
RankActiveLinkBot RankActiveLinkBot
RankFlex RankFlex
Re-re Rankivabot
RebelMouse ReGet
Ripper Ripper
SMTBot RocketCrawler
SalesIntelligent Rogerbot
SBIder
SEOkicks-Robot
SEOlyticsCrawler
SISTRIX
ScanAlert
Scanbot
Scrapy Scrapy
Seekport ScreenerBot
Semrush SearchmetricsBot
SemrushBot
SentiBot SentiBot
SeoSiteCheckup SeoSiteCheckup
Siphon SeobilityBot
SiteExplorer SiteCheckerBotCrawler
SiteSnagger
Sitebeam Sitebeam
Siteimprove Siteimprove
SmartDownload SmartDownload
Snake
Snapbot Snapbot
SocialRankIOBot Sociscraper
SpankBot SpankBot
Spanner Spinn3r
Sqlworm
Steeler
Stripper Stripper
Sucker SuperBot
SurveyBot SuperHTTP
Szukacz Suzuran
T8Abot Swiftbot
Teleport
Telesoft Telesoft
Telesphoreo
TheNomad
TightTwatBot
Tracemyfile
Trendiction Trendiction
True_Robot Trendictionbot
TurnitinBot Turingos
TwengaBot
Twice Twice
Typhoeus URLy.Warning
URLy Warning
UnisterBot
Vacuum Vacuum
VeriCiteCrawler VelenPublicWebCrawler
VidibleScraper VidibleScraper
Virusdie WBSearchBot
Voil
WASALive-Bot
WEBDAV
WISENutbot WISENutbot
WWW-Collector-E WWW-Collector-E
WWW-Mechanize Wallpapers/3.0
WallpapersHD WallpapersHD
WeSEE
Web Auto Web Auto
Web Pix Web Enhancer
Web Fuck
Web Sucker Web Sucker
WebEnhancer WebEnhancer
WebFuck WebFuck
WebGo IS WebLeacher
WebImageCollector
WebPix
WebReaper WebReaper
WebZIP WebWhacker
WebmasterWorldForumBot Webalta
Website Quester
WebsiteExtractor
WebsiteQuester WebsiteQuester
Whacker
Whatweb
Who.is Bot Who.is Bot
Widow WinHTTrack
WiseGuys Robot WiseGuys Robot
Wonderbot Wonderbot
YoudaoBot Zade
Zauba
Zeus
Zitebot
ZmEu ZmEu
archive.org_bot ZoominfoBot
ZyBorg
arquivo-web-crawler
arquivo.pt
autoemailspider autoemailspider
clark-crawler backlink-check
coccocbot check1.exe
cognitiveseo
com.plumanalytics
crawl.sogou.com
crawler.feedback
crawler4j
heritrix heritrix
iubenda-radar internetVista monitor
ips-agent
linkdexbot linkdexbot
magpie-crawler lwp-request
mediawords
muhstik-scan muhstik-scan
s1z.ru oBot
satoristudio.net polaris version
scan.lol seobility
seocompany.store
seoscanners seoscanners
seostar
serpstatbot serpstatbot
sexsearcher sexsearcher
siteripz
sp_auditbot sp_auditbot
sysscan sysscan
tAkeOut
trendiction.com
webmeup-crawler
webpros.com webpros.com
webprosbot
x09Mozilla
x22Mozilla
zauba.io zauba.io
zgrab zgrab

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
graphicwe.org 1millionusd.xyz
jav-idol.com acads.net
live-sexcam.tk best-seo-offer.com
nelc.edu.eg cinemaenergy-hd.ru
sbornik-zakonov.ru famix.xyz
sex-foto.pw internetartfair.com
szamponrevita.pl pornzone.tv
timhost.ru terraclicks.com
tovaroboom.vast.ru vbabule.net
zeroredirect2.com zoogdiesney.com

920
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
08800.top 03e.info
1-99seo.com
1008.su 1008.su
100dollars-seo.com 1bet.com
11pikachu.ru 28n2gl3wfyb0.ru
12bet.com 5kstore.com
1kdailyprofit.me abiente.ru
1kinobig.ru absolute-s.ru
2345.com activepr.ru
57883.net ads-seo.men
5elementov.ru adult-shop.com.ua
5forex.ru agardomains.com
6hopping.com aihelen.net
98oi.ru aimayangzhi.com
aac500b7a15b2646968f6bd8c6305869d7.com airlandsea.info
aarbur.com albamargroup.com
actices.com ald2014.org
adrenalin-stk.ru algarveglobal.com
adserver-e7.com alive-ua.com
advancedcleaner.com allcredits.su
agadelha.com.br allsilver925.co.il
aktivator-windows10.blogspot.com alphacarolinas.com
akuhni.by alphavisions.net
alert-fjg.xyz aludecor.info
alienwheel.es alyeskaresort.com
alldezservice.kz amoi.tn
allknow.info anniemation.com
allwomen.info apccargo.com
alpharma.net apiluckyleapnet-a.akamaihd.net
alta-realestate.com apiqualitinknet-a.akamaihd.net
ameblo.jp apispringsmartne-a.akamaihd.net
ap.senai.br
apiholdingmypage-a.akamaihd.net
apparel-offer.com apparel-offer.com
arabgirls.adultgalls.com apple.com-cleaner.systems
arcadepages.com aquarium-pro.ru
asdfg.pro artdeko.info
asmxsatadriverin.aircus.com ascat.porn
atlasvkusov.ru asscenihotosidea.blogspot.com
atmagroup.ru atmovs.com
auspolice.com auto-zapchasti.org
avtoarenda.by autoblogger24.info
axbocz.net ayodhya.co
azbukafree.com bablonow.ru
azlex.uz bad-stars.net
babosas.com balans.shahterworld.org
back.dog bannertesting.com
baersaratov.ru baoxaydung.com.vn
baltgem.com
bamo.xsl.pt
bankcrediti.ru
bashtime.ru bashtime.ru
battlecarnival.su battlecarnival.su
bavsac.com becuo.com
beauty-bracelet.com best-deals-products.com
belinvestdom.by bestplacetobuyeriacta.jw.lt
bestcalovebracelet.cn betune.onlinewebshop.net
bestcoin.cc big-cash.net
bestwaystogetpaid.us bird1.ru
billiard-classic.com.ua bkgr.se
bingoporno.com blackhatworth.com
biteg.xyz blackplanet.com
bizru.info blog.f00kclan.de
bobinoz.com blog.koorg.ru
bonux.nextview.ru blog.koreadaily.com
blogos.kz
blogsfunky672.weebly.com
boobsimge.com boobsimge.com
boostmyppc.com brianhenry.co
bosefux.esy.es bronzeaid-a.akamaihd.net
bravegirlsclub.com brus-vsem.ru
bryansk.zrus.org buy-cheap-online.info
buchananshardware.com
bugshoot.cn
burkesales.com
buy-meds24.com
buyantiviralwp.com buyantiviralwp.com
buyessay3.blogspot.ru c-english.ru
buzzurl.jp callawaygolfstore.online
c1.onedmp.com
cablecar.us
callmd5map.com callmd5map.com
canvas.gloverid.site cars-modification.net
cdncash.net carsdined.org
cete.ru casinos4dummies.co.uk
chatroulette.video cbb1smartlist12.click
cheapjerseysap.com centrumcoachingu.com
chinaelitecheapjerseys.com cezartabac.ro
checkhit.com
chelnytruck.ru
chinacheapelitejerseys.com
chocolateslim-u-srbiji.com
christianlouboutinreplica.win christianlouboutinreplica.win
cialgenisrx.com chuckguilford.com
cialischmrx.com cialisovercounteratwalmartusa.com
cialischsrx.com cleanpcnow.com
cialischstgerts.com clksite.com
cicaki.net cmhomestayagency.com
ciekawinki.pl colobit.biz
civilwartheater.com compiko.info
clean-virus-mac.com conciergegroup.org
clickbank.net concordexoticrentals.com
clickso.com coolgamechannel.com
cntravelre.com coolyarddecorations.com
com-onlinesupport.site countbertwistdisp26.soup.io
compliance-alexa.xyz covid-schutzmasken.de
compliance-andrew.xyz cowblog.fr
compliance-george.top cranly.net
compliance-jessica.top crd.clan.su
compliance-julianna.top
compliance-willy.top
conocer-sanabria.com
constantaservice.net
coolingoods.com
copyrightclaims.org
counter.bloke.com
crafthubs.com
creativehutindia.com creativehutindia.com
credit-online.ws
credit.co.ua
creditmoney.com.ua creditmoney.com.ua
creditnation.ru cryptoswap.biz
customcollegeessays.net cs-passion.pl
damedingel.ya.ru custom-product-labels.com
darodar.com cyclobenzaprinevstizanidine.blogspot.com
dating-app.ru dairyindia.in
davebestdeals.com dangphoto.trade
decoratinghomes.ga ddpills.com
dengi-pod-zalog-nedvizhimosti.ru deadlinkchecker.com
design-lands.ru demenageur.com
dfiles.me descargar-musica-gratis.net
diamond-necklace.info digilander.libero.it
diffbot.com dildofotzen.net
dikx.gdn dipstar.org
discovertreasurenow.com dirtpics.pw
dispo.de dispo.de
distver.ru docstoc.com
docsportal.net documentbase.net
dogbreedspicture.net dodlive.mil
doreenblog.online domain-tracker.com
drpornogratisx.xxx domainsphoto.com
dvr.biz.ua dood.live
easycommerce.cf doublepimp.com
editmedios.com earthmagic.info
eduserver.net econom.co
elektrozigarette1.dreamwidth.org ecxtracking.com
emerson-rus.ru eets.net
enbersoft.com elektronischezigarettekaufen1.beeplog.com
enge-fotzen.info elektronischezigarettekaufen1.myblog.de
es5.com englishgamer.com
eshop4u.jp enthuse.computernetworksonline.com
exct.net escortplius.com
exlarseva.webblog.es esopini.com
extremal-blog.com espaceinventoristes.com
ezigaretteshop2.vefblog.net everypony.ru
faracontrol.ir evogarage.com
fashion-mk.net ewebarticle.info
fashionavenuegame.com extener.org
ferrotodo.com face.hostingx.eu
fetlifeblog.com fandlr.com
fickenprivat.info farmingworm.com
filerockstar298.weebly.com felizporno.com
fighrofacciufreesig.ga
filmci.pro filmci.pro
findpik.com findpics.pw
finuse.com
firstdrugmall.ru
fishtauto.ru fishtauto.ru
flprog.com floridamobilebillboards.com
forensicpsychiatry.ru flowwwers.com
forex-indextop20.ru folowsite.com
formulaf1results.blogspot.com food.dtu.dk
forum.poker4life.ru foodgid.net
freewebs.com forex-procto.ru
freshsuperbloop.com formulaantiuban.com
fsakhalin.ru forodvd.com
fuck-paid-share-buttons.xyz foto-telok.net
fuckingawesome.com foto-weinberger.at
funnymama.com fotzen-ficken.com
galaxyflowers.ru frankofficial.ru
gambarkatabaru.com frbizlist.com
gamedayassist.com free-deals.faith
gaz-voshod.ru free-share-buttons.top
germetiki.com.ua freelifetimefuckbook.com
getoutofdebtfree.org front.ru
gg-arena.ru frvo.alptandem.ru
glavprofit.ru fungirlsgames.net
goodwriterssales.com fusoradio.info
googlemare.com fxund.us
gosmeb.ru gabeshop.ru
gotwebsite1.com games.kolossale.ru
gwhwpxbw.bloger.index.hr gay.adultgalls.com
hatedriveapart.com ge0ip.net
heroz.fr get-free-social-traffic.com
hikesearch.net getlamborghini.ga
historichometeam.com getprismatic.com
hollywoodactress.info getresponse.com
hornymatches.com gigixo.com
hotblognetwork.com girlsatgames.ru
houtings.xyz gloverid.site
hoztorg-opt.ru golaya.pw
huhn.altervista.org gombita.info
hustoon.over-blog.com goodwinmetals.co
i-hobot.ru goroda-vsego-mira.ru
id-forex.com gosarhivrt.ru
idegenvezeto.eu gotcher.us
ihtec2019.org gotomontenegro.net
ikearugs.xyz gpirate.com
imk.com.ua grizzlysgrill.com
inclk.com gsasearchengineranker.xyz
infobanks.ru gstatey.net
intellektmedia.at gunsvicceadadebt.tk
internet-apteka.ru haikuware.com
iscblog.info handsandlegs.ru
ispac.org hd720kino.ru
istizanidineacontrolledsubstance.blogspot.com herehloadibs.cf
itservicesthatworkforyou.com hobild.net
izhevsk.xrus.org homeart.space
izismile.com homedecoguide.info
janavibekken.no homegardenlova.com
jerseywholesaleelitestore.com howtowhitenteethfast.xyz
jmat.cn hscsscotland.com
johnnyhaley.top hulfingtonpost.com
joingames.org hunthillfarmtrust.org
jongose.ninja i-midias.net.br
justprofit.xyz ictizanidinehcl4mg.blogspot.com
kakablog.net ie.57883.net
kakadu-interior.com.ua ikritikimou.gr
kaliningrad.zrus.org ilmexico.com
kam-dom.ru iminent.com
kambasoft.com inbabes.sexushost.com
incolors.club
infektsii.com
insider.pro
io9.com
iopeninghours.co.uk
iphantom.com
iqoption-bin.com
isistaylorporn.info
itag.pw
japfm.com
jav-fetish.site
jerseychinabizwholesale.com
jewelryandfiligree.com
justkillingti.me
justucalling32211123456789.tk
kalandranis.gr
karadene.com karadene.com
kevblog.top kashubadesign.ru
khafre.us katadhin.co
kicknights.gq keenoutlet.online
kinky-fetishes.com ketoanhanoi.info
kino2018.club keyhantercume.com
kovrenok.ru keywordglobal.co.za
kskjco.club kinopolet.net
kustanay.kz kmgamex.cf
lacapilla.info kopihijau.info
lacasamorett.com kosmetyki.tm.pl
laptop-4-less.com kosova.de
laxdrills.com kotaku.com
le-clos-des-alouettes.com krafte.ru
livingroomdecor.info krasivoe-hd.net
locustdesign.co krasnodar.ru
longadventure.com kretpicf.pw
louisvuittonoutletstore.net lifehacĸer.com
lunchrock.co lightinghomes.net
lutherstable.org linkarena.com
luxmagazine.cf linkredirect.biz
mackeeper-center.club lion.playtap.us
magicdiet.gq listiseltemournlan.gq
magnetpress.sk livesex-amateure.info
makemoneyonline.com lovelycraftyhome.com
lubetube.com
mac-shield.com
maranbrinfo.com.br maranbrinfo.com.br
matchpal-a.akamaihd.net
matematikus.info
maximpartnerspr.com
mazda-roadsters.com
mearns-tractors.co.uk
mebel-alait.ru mebel-alait.ru
mebel-vstroika.ru mebel-ekb.com
meble-bogart.info mebeldekor.com.ua
med-zdorovie.com.ua medicine-4u.org
medicinacom.ru medkritika.ru
mega-bony-2017.pl mesbuta.info
meget.co.za mex-annushka.ru
members.ghanaweb.com minecraft-neo.ru
microsoftportal.net minegam.com
mnimmigrantrights.net mlvc4zzw.space
moi-glazki.ru mmog-play.ru
moje-recenze.cz mobile.ok.ru
moroccosurfadventures.com mole.pluto.ro
moscow.xrus.org money-every-day.com
motherboard.vice.com monsterdivx.tv
moscow-clining.ru
mostantikor.ru
movpod.in
mozello.ru mozello.ru
mrlmedia.net mrbojikobi4.biz
msfsaar.de mrsdalloways.com
musflashtv.com mrwhite.biz
msk.afora.ru
mural.co
music.utrolive.ru music.utrolive.ru
musirc.com my-aladin.com
muznachas-service.ru myfreecams.com
muztops.ru myghillie.info
my-bc.ru myxdate.info
myhealthcare.com na15.ru
myonlinepayday.co nagdak.ru
myperiod.club narutonaruto.ru
myprintscreen.com nastydollars.com
mysexpics.ru natali-forex.com
mystats.xyz nationalbreakdown.com
nac-bearings.ru negral.pluto.ro
nakrutka.cc nelc.edu.eg
namecrumilchlet.tk
naphukete.ru
neks.info
netcheckcdn.xyz
networkcheck.xyz
new7ob.com new7ob.com
next-dentists.tk news-readers.ru
nfljerseyscheapbiz.us nlfjjunb5.ru
ngps1.ru nootrino.com
noumeda.com nordstar.pro
novosti-hi-tech.ru northfacestore.online
nuit-artisanale.com noscrapleftbehind.co
o-dachnik.ru notasprensa.info
o.light.d0t.ru nudejapan.net
o333o.com o333o.com
obiavo.ru oballergiya.ru
obiavo.uz okout.ru
oconto.ru olympescort.com
office2web.com onclkads.com
onemantrip.com online-templatestore.com
onko-24.com onstrapon.purplesphere.in
online-hd.pl orel-reshka.net
openfrost.com otbelivanie-zubov.com
openfrost.net outshop.ru
optikremont.ru oz-offers.com
orsonet.ru partner-high.men
osagonline.ru pharmacyincity.com
ourville.info photochki.com
outrageousdeal-a.akamaihd.net pic-re.blogspot.com
parfusale.se picsfair.com
pdns.download picture-group.com
penisvergrotendepillennl.ovh pinstake.com
perfection-pleasure.ru pinup-casino1.ru
perl.dp.ua pirateday.ru
perso.wanadoo.es piter.xrus.org
picquery.com pogosh.com
picturesmania.com pomoc-drogowa.cba.pl
pizdeishn.com pornohd1080.online
play.leadzupc.com pornoinn.com
playmsn.com portadd.men
playtap.us
podshipniki-ntn.ru
pokemongooo.ml
pons-presse.com
popunder.net
popup-jdh.xyz
porndairy.in
pornohub.me
pornosmola.info
pornosok.ru
pornotubexxx.name
pornpost.in
portside.xyz portside.xyz
pozvonim.com pretty-mart.com
predmety.in.ua privatbank46.ru
pregnant.guru pro-tec.kz
pricheskaonline.ru pssucai.info
promgirldresses.xyz psvita.ru
pronorm.fr pukaporn.com
proprostatit.com purchasepillsnorx.com
prostitutki-almata.org purplestats.com
push-ad.com puserving.com
pussyfleet.com raavidesigns.com
py100.ru
quickbuck.com
raisedseo.com
randki-sex.com randki-sex.com
rasteniya-vs-zombi.ru ranksonic.com
recinziireale.com ratemodels.net
reckonstat.info rebuildermedical.com
rednise.com rednise.com
refererx.com registry-clean-up.net
regdefense.com remont-komputerov-notebook.ru
repeatlogo.co.uk remybutler.fr
responsive-test.net rent2spb.ru
rocketchange.ru replicaclub.ru
rubanners.com resellerclub.com
rubbed.us retreatia.com
rfserial.net
ric.info
richinvestmonitor.com
ring4rhino.com
rn-to-bsn.com
roma-kukareku.livejournal.com
rostov.xrus.org
royalads.net
rusoft-zone.ru
russintv.fr russintv.fr
rutor.group sabaapress.com
sady-urala.ru saltspray.ru
sanjosestartups.com samara.rosfirm.ru
sarafangel.ru samoiedo.it
sbornik-zakonov.ru sanyuprojects.com
sbricur.com scanner-josh.top
scanner-ivan.top scanner-julia.top
scottbywater.com scrapinghub.com
screpy.com scripted.com
seansonline24.pl
search-error.com search-error.com
seminarygeorgia59.ga seemoreresultshu-a.akamaihd.net
seinterface.com
semprofile.com semprofile.com
serdcenebolit.com seo-prof1.xyz
serptehnika.ru seoanalyses.com
sevendays.com.ua seoholding.com
sexflirtbook.com seorankinglinks.xyz
sexsearch.com serving.adbetclickin.pink
shama-rc.net sexpartygirls.net
signx.info sexvideo-sex.com
silvermature.net sharebutton.net
simon3.ru shymkent.xkaz.org
simul.co sicfor.bcu.cc
sindragosa.comxa.com simplesite.com
siteimprove.com skutecznetabletkinaporostwlosow.pl
sivs.ru skytraf.xyz
slomm.ru slimcdn.com
sloopyjoes.com smart-balancewheel.com
smailik.org smartpet.ru
smallseotools.com smsactivator.ru
soaksoak.ru snts.shell-pmr.ru
social-button.xyz social-buttons.xyz
sodexo.com socialmadesimple.com
softomix.net soft1.ru
solution4u.com softlinesolutions.me
songplanet.ru soietvousmaime.fr
spidtest.org solicita.info
spinnerco.ca sortthemesitesby.com
spravka-medosmotr.ru spylog.com
spravka130.ru spywarespy.com
spy-app.info srgwebmail.nl
staff.prairiesouth.ca stairliftstrue.com
start.myplaycity.com stpicks.com
statoutlook.info styro.ru
strongholdsb.ru sucsesofinspiration.com
supermodni.com.ua svetodiodoff.ru
suralink.com svnuppsalaorebro.se
surintech.ac.th
suture.co
swingerseiten.com
szucs.ru szucs.ru
takeprofitsystem.com tabakur77.com
telesvoboda.ru tattomedia.com
templates.radiodigital.co tattooreligion.ru
the-usa-games.blogspot.com telefonsexsofort.tk
thelottosecrets.com theallgirlarcade.com
thenetinfo.com thecoral.com.br
timhost.ru thewebsitetemplate.info
timdreby.com
tizanidine4mguses.blogspot.com
tizanidineandhydrocodone.blogspot.com tizanidineandhydrocodone.blogspot.com
tizanidineformigraines.blogspot.com tizanidinepain.blogspot.com
tizanidinehcl4mgtablet.blogspot.com topquality.cf
tizanidineinfo.blogspot.com topsiteminecraft.com
toon-families.com torrents.cd
toondinsey.com toxicwap.com
tourismvictoria.com track2.shop
toy-shop.top trackzapper.com
tradedeals.biz tradedeals.biz
traderzplanet.in traderzplanet.in
traffic-club.info traffic-club.info
trafficjunky.com traffic100.com
trafficshaper.com trafficcentr.xyz
traffique.net trafficfactory.biz
triumf-realty.ru traffpartners.com
trubywriting.com trion.od.ua
trucri.me trucri.me
truebeauty.cc try-rx.com
tuckermktg.com udsgame.online
tuckpointingmasonrysystems.com ural-buldozer.ru
turn-up-life.life
tvnewsclips.info
tvorozhnaja-zapekanka-recept.ru
ucsol.ru
ukrobstep.com
unblocksit.es
unisexjewelry.org
universals.com.ua
unpredictable.ga
urlcut.ru
urlopener.blogspot.com.au urlopener.blogspot.com.au
uroki.net
usadacha.net usadacha.net
usbggettwku.ga vancleefreplica.pw
vabasa.inwtrade.com vchulkah.net
vesnatehno.ru vedomstvo.net
viagengrarx.com velobikestock.com
viagroid.ru velpanex.ru
videochat.ph vgoloveboli.net
via-energy-order.com
videonsk.com videonsk.com
vinylvault.co.uk videos-for-your-business.com
visitcambridge.org videtubs.pl
vksex.ru villacoloniale.com
vpnmouse.com vinsit.ru
vzlomfb.com viveresaniesnelli.it
w-journal.ru vkontaktemusic.ru
wapsite.me vykupavto-krasnodar.ru
warezaccess.com wardreapptokone.tk
watracker.net
web.cvut.cz web.cvut.cz
webix.biz weburlopener.com
wesharepics.info wedding0venues.tk
wholesalejerseychinaoutlet.com whipme.yopoint.in
whosonmyserver.com whosonmyserver.com
windowssearch-exp.com
wnoz.de wnoz.de
woman-tampon.ru woodyguthrie.se
wpsecurity.website word-vorlagen.xyz
www.wohnkabinen-shop.de world-mmo.com
wwwadultcheck.com wormix-cheats.ru
xjrul.com wovis.site
xn-----6kcaabbafhu7cskl7akvongwpo7hvjj.xn--p1ai wrz0iuebwhp5fg.freeddns.com
xn----7sbbagbq7bd5aheftfllo4m.xn--p1ai ww2awards.info
xn----7sbbahaq9bb5afgiqfliv4m.xn--p1ai wyniki-lista.pl
xn--80aanaardaperhcem4a6i.com x-diesel.info
xn--80ajjbdhgmudixfjc8c5a9df8b.xn--p1ai x-diesel.org
x-mix.info
xaylapdiendanang.com
xblognetwork.com
xgftnlrt.bloger.index.hr
xlolitka.com
xn-----6kccaibs5cb8afhjrfmix2n.xn--p1ai
xn----btbdvdh4aafrfciljm6k.xn--p1ai
xn--80aaagvmjabrs1aoc9luc.xn--p1ai
xn--80aaajbdbddwj2alwjieei2afr3v.xn--p1ai
xn--80abgj3a5acid6ghs.top
xn--b1addnj3cah.xn--p1ai
xnxx-n.com xnxx-n.com
xolodremont.ru xportvusbdriver8i.snack.ws
xrus.org xxxdatinglocal.us
xvideosbay.com
xz618.com xz618.com
yellowstonesafaritours.com yaderenergy.ru
youporn-ru.com yellocloud.be
youtubedownload.org yourserverisdown.com
ypmuseum.ru yousense.info
yugo-star.ru zarabiaj-dzis.pl
zaloadi.ru zeroredirect10.com
zeg-distribution.com zhacker.net
zeroredirect12.com zkjovpdgxivg.ga
zigarettenonlinekaufen2.drupalgardens.com zootravel.com
zionstar.net zs2vm.top
zoogdinsney.com
zoompegs.com
zvezdagedon.ru

490
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
123any.com 123movies.love
12u.info 1flag.co.za
404.mn 20pascals.nl
aadroid.net 256bit.by
adconscious.com 8jn.dating-app.ru
advancedcleaner.com 8xv8.com
amyfoxfitness.com abctoppictures.net
api.stathat.com abiente.ru
apispringsmartne-a.akamaihd.net absolute-s.ru
arendatora.ru adultnet.in
artdeko.info aerogo.com
articlesdirectoryme.info all-streaming-media.com
aversis.net allnews24.in
avkzarabotok.info allpdfmags.net
avto-oligarh.ru alphaforum.ru
azte.ch alpharma.net
bankmib.ru anabolics.shop
bannerpower.com animal-drawings.com
beclean-nn.ru apple.com-webbrowsing-security.science
appleid-verification.com
arcteryxsale.online
arenda-avtoprokat-krasnodar.ru
artefakct.com
arvut.org
asrvrep-a.akamaihd.net
asscenihotosidea.blogspot.com
azartclub.org
balkanfarma.org
bannerconnect.net
bestkfiledxd.cf
bestmouthwash.club
bestofpicture.com bestofpicture.com
bestprofits-there.com binomo.kz
bigcareer.info birzha-truda.eu
binomo.com bitcoin-ua.top
bloke.com blobar.org
bonanza-fortune.men bmsco.co
brainxs.us braindaily.xyz
buckspar.gq braip.com.br
businescoop.men buy-meds24.com
business-suggested.tk buzzurl.jp
buypuppies.ca chatroulette.online
c-gainsbourg.com cheapcigarettesc.info
candlehandmade.com cheapjerseysbizwholesale.us
carrauterie.be ci.ua
cayado.snn.gr ciceros.co
cenoval.ru civilwartheater.com
centraletermice.us clickbank.net
chcu.net clknsee.com
cheapbelstaff.online compliance-don.top
chocolateslim-en-espana.com confib.ifmo.ru
cibpenonptib.flu.cc courtshipgift.com
cigarpass.com crafthubs.com
cleansearch.net cyclobenzaprinevstizanidine.blogspot.com
clickcash.com danashop.ru
compliance-margo.top deniven.1bb.ru
concordexoticrentals.com dimfour.com
costablue.xyz discountliv.com
culturevie.info downloaddy.net
customboxes4less.com downloadeer.net
damasarenai.info earn-from-articles.com
detalizaciya-tut.biz enskedesquashclub.se
dev33.dioniqlabb.se exoclick.com
dominterior.org expertnaya-ocenka.ru
easytuningshop.ru fenoyl.batcave.net
editors.choice6912650.hulfingtonpost.com fillmewithhappiness.com
education-cz.ru floridamobilebillboards.com
elektronischezi.livejournal.com foodcrafts.website
elektrozigarette2.webs.com footballfarrago.com
elitepcgames.com forum.poker4life.ru
erotikstories.ru freelotto.com
eu-cookie-law.blogspot.com freenode.info
evening-dating-club.info friendflnder.com
extener.org fsalas.com
ezaz.info fun2cell.net
f-online.de fx-brokers-review.com
f1nder.org fyxabomiw.ru
fastfixing.tech galaxy-family.ru
fickblock18.com gallerylisting.com
filesdatabase.net gemgrab-a.akamaihd.net
filkhbr.com getpopunder.com
financeloan.us girlspicsa.com
finejewelryshop.ru gktt.ru
folowsite.com goodwinmetals.co
forpackningsutveckling.se gtopstats.com
forums.d2jsp.org hamacapty.com
forzeronly.com hatdc.org
foxinsocks.ru hitmuzik.ru
frcls.fr hostcritique.com
freakycheats.com hut1.ru
free-fb-traffic.com hyipmanager.in
fungirlsgames.net ilmen.net
gaytube.com images-graphics-pics.com
ge0ip.org immobiliaremassaro.com
gombita.info iplogger.org
goroda-vsego-mira.ru itronics.ca
groupmoney.ru iweblist.info
guigyverpo.cf janavibekken.no
hopeonthestreet.co.uk jasonpartington.com
hoporno.com javlibrary.cc
hotel-mkad.ru joyceblog.top
howmuchdoestizanidinecost.blogspot.com kaidalibor.de
howtoclean.club kandidos.com
hustoon.over-blog.com
iloveitaly.ru
imagui.eu
iminent.com
inome.com.ua
interesnie-faktu.ru
interior-stickers.ru
iqoption.com
irkutsk.online-podarki.com
iskalko.ru
istizanidineacontrolledsubstance.blogspot.com
jerseychinabizwholesale.com
katadhin.co
keywordsdoctor.com
keywordsking.com keywordsking.com
keywordspay.com kinostorm.net
kinobest.pl klosetkitten.com
konpax.com lacloop.info
kopihijau.info laexotic.com
kurwa.win lapolis.it
kustanay.kz letmacworkfaster.site
laapp.com lexixxx.com
laptop-4-less.com lonely-mature.com
linerdrilling.com long-beach-air-conditioning.com
linkbolic.com lovelycraftyhome.com
linkredirect.biz m292.info
lombia.co magento-crew.net
lomza.info matb3aa.com
lsp-awak-perikanan.com maxxtor.eu
luciddiagnostics.in mebelcomplekt.ru
lyrics.home-task.com med-zdorovie.com.ua
m.b00kmarks.com mediawhirl.net
mabdoola.blogspot.com megagrabber.ru
macnewtech.com mex-annushka.ru
mainhp.net michaelkorsoutletstore.net
makedo.ru mindeyegames.com
max-eclat.men mirzonru.net
mesbuta.info missclub.info
mhi-systems.ru missvietnam.org
missis.top monarchfind-a.akamaihd.net
misterjtbarbers.com moncleroutletonline.win
mobplayer.ru moneyviking-a.akamaihd.net
modenamebel.ru mygameplus.ru
moesen-ficken.com napalm51.nut.cc
moi-glazki.ru national-today-winning-winner.club
morefastermac.trade netanalytics.xyz
mriyadh.com nfljerseyscheapchinabiz.com
mrlmedia.net nordvpn.com
mug-na-chas-moscow.ru offergroup.info
multgo.ru offf.info
myhydros.org offtime.ru
negral.pluto.ro okayimage.com
newhairstylesformen2014.com onescreen.cc
newstudio.tv openlibrary.org
nonews.co paleohub.info
notfastfood.ru
novosti-hi-tech.ru
offers.bycontext.com
okmedia.sk
okout.ru
oksrv.com
onlinemeetingnow.com
onlineslotmaschine.com
paydayonlinecom.com
perl.dp.ua perl.dp.ua
photostudiolightings.com petrovka-online.com
pierrehardysale.online picscout.com
pixelrz.com picturesify.com
polybuild.ru piulatte.cz
popads.net pixell.club
porn555.com pizza-tycoon.com
pornosee.info pladform.ru
pokemon-go-play.online
popcash.net
poppen-nw.net
pornmania.pl
pornstartits.xblog.in pornstartits.xblog.in
prlog.ru positive2b.ru
pufip.com potoideas.us
pyramidlitho.webs.com priceg.com
qexyfu.bugs3.com pro-poly.ru
quality-traffic.com progonrumarket.ru
quick-offer.com psoriasis-file.trade
radiogambling.com pssucai.info
rankingchart.de py100.ru
rankings-analytics.com qor360.com
rapevideosmovies.com qualitymarketzone.com
ragecash.com
razyboard.com
repeatlogo.co.uk
rimedia.org
rocketchange.ru rocketchange.ru
rucrypt.com rogervivierforsale.com
ruex.org.ua rp9.ru
sadaholding.com runofilms.ru
saveindex.xyz rusexy.xyz
scalerite.co.za sbprabooks.com
scanner-julianna.top scanner-alexa.top
scanner-mary.top scanner-andrew.top
seo-prof1.xyz scanner-jess.top
seomarketings.online sex-sex-sex5.com
sex-tracker.de shopcheermakeup.info
sexyebonyteen.com shoplvlv.us
sharebutton.org snegozaderzhatel.ru
sheerseo.com snomer1.ru
shemalegalls.blogporn.in social-buttons.com
shiksabd.com solnplast.ru
shop.xz618.com sotechco.co
sibdevice.ru sotkal.lark.ru
sirpornogratis.xxx sovinsteel.ru
site-speed-checker.site spb-plitka.ru
siteimprove.com spylog.com
skutecznetabletkinaporostwlosow.pl spymac.net
skypasss.com starpages.net
sneakyboy.com stefanbakosab.se
sophang8.com stroiminsk.org
space4update.pw stroymonolit.su
stevemonsen.com sureone.pro
stroiminsk.com surintech.ac.th
strongholdsb.ru sygraem.com
superlist.biz szucs.ru
tabletkinaodchudzanie.com.pl tackletarts.co
tasteidea.com telegramdownload10.com
taxi-v-eisk.ru thebitcoincode.com
teguh.info tizanidine4mgstreetprice.blogspot.com
tehngr.ru tizanidinecapsules.blogspot.com
terraclicks.com tizanidineinteractions.blogspot.com
thaisamkok.com toyota.7zap.com
thenews-today.info trafficmp.com
tizanidine4mgprice.blogspot.com truck-land.life
tizanidinehcl4mgtab.blogspot.com tsan.net
tizanidinepain.blogspot.com typimga.pw
top-karkas.ru uchil.net
topflownews.com ucoz.ru
tourcroatia.co.uk uhodzalijami.ru
tracfone.com ukkelberg.no
treasuretrack-a.akamaihd.net unece.org
trkur.com univerfiles.com
truck-addzilla.life urlcut.ru
truck-rece.life usbggettwku.ga
turvgori.ru utrolive.ru
tv-spoty.info vacuumcleanerguru.com
tx41tclega.ru ventelnos.com
ukrtvory.in.ua voronezh.xrus.org
us-america.ru vriel.batcave.net
veerotech.com vucms.com
vids18.site webkeyit.com
vipps.com.my webnode.me
vitalads.net wesharepics.com
warezaccess.com whatsappdownload10.com
webjam.com whatzmyip.net
webpromotion.ae winner7777.net
website-speed-checker.site worldoffiles.ru
wrz0iuebwhp5fg.freeddns.com woweb.com.ua
xn----8sbdbjgb1ap7a9c4czbh.xn--p1acf wtsindia.in
xn--b1addnj3cah.xn--p1ai x-mix.info
xn--b1ag5cfn.xn--p1ai xboxster.ru
xn--d1acah0c.xn--p1ai xn-----6kcaabbafhu7cskl7akvongwpo7hvjj.xn--p1ai
xxxtube69.com xn-----6kcaacnblni5c5bicdpcmficy.xn--p1ai
yoluxuryevents.com xxlargepop.com
youtube-downloader.savetubevideo.com xxxnatelefon.ru
ytmnd.com yellowproxy.net
zerocash.msk.ru youghbould.wordpress.com
zetmaster.ru yoursearch.me
zigzog.ru ypmuseum.ru
zooggames.com za-music.mymobiplanet.com
zoompegs.com zahvat.ru
zeroredirect.com
znakomstva-moskva77.ru
zytpirwai.net

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.154 0; 10.1.0.204 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.05.3102 ### Version: V4.2022.05.3103
### Updated: Fri May 13 10:03:30 UTC 2022 ### Updated: Fri May 13 22:01:27 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.05.3102 ### Version: V4.2022.05.3103
### Updated: Fri May 13 10:03:30 UTC 2022 ### Updated: Fri May 13 22:01:27 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##