vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-04 03:29:57 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2021.11.2711 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2021-11-12 22:07:01 +00:00
parent 1cfc072e0d
commit ca817a6e4e
46 changed files with 61821 additions and 61821 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2021.11.2710 #### Version: V4.2021.11.2711
#### Bad Referrers Blocked: [7078](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7078](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [626](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [626](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2021.11.2710 #### Version: V4.2021.11.2711
#### Bad Referrers Blocked: [7078](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7078](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [626](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [626](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -11,7 +11,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2021.11.2710 #### Version: V4.2021.11.2711
#### Bad Referrers Blocked: [7078](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7078](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [626](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [626](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

7592
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2021.11.2710 #### Version: V4.2021.11.2711
#### Bad Referrers Blocked: [7078](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7078](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [626](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [626](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

7596
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

7596
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

7596
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

7596
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.240 1; 10.1.0.13 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.240 0; 10.1.0.13 0;
127.0.0.1 0; 127.0.0.1 0;

7596
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.240 1; 10.1.0.13 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.240 0; 10.1.0.13 0;
127.0.0.1 0; 127.0.0.1 0;

7596
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.240 1; 10.1.0.13 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.240 0; 10.1.0.13 0;
127.0.0.1 0; 127.0.0.1 0;

7596
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
2710 2711

7596
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

7596
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.69.183.40 0; 20.114.51.105 0;

7596
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.240 1; 10.1.0.13 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.240 0; 10.1.0.13 0;
127.0.0.1 0; 127.0.0.1 0;

7596
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.240 1; 10.1.0.13 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.240 0; 10.1.0.13 0;
127.0.0.1 0; 127.0.0.1 0;

7596
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.240 1; 10.1.0.13 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.240 0; 10.1.0.13 0;
127.0.0.1 0; 127.0.0.1 0;

7596
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.69.183.40 0; 20.114.51.105 0;

7596
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.69.183.40 0; 20.114.51.105 0;

7596
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.240 1; 10.1.0.13 1;
127.0.0.1 1; 127.0.0.1 1;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
BatchFTP Brandprotect
Cliqzbot Cosmos
Dirbuster Iskanie
DnBCrawler-Analytics Musobot
Evil PictureFinder
Grabber Psbot
PeoplePal Rogerbot
WebWhacker Wonderbot
Wprecon sexsearcher
crawl.sogou.com x22Mozilla

308
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
01h4x.com
360Spider
404enemy 404enemy
ADmantX 80legs
ASPSeek AIBOT
Aboundex Aboundexbot
AfD-Verbotsverfahren AiHitBot
AhrefsBot
Alexibot
AllSubmitter
Alligator
AlphaBot AlphaBot
Attach Anarchy
Ankit
Anthill
AwarioRssBot
AwarioSmartBot
BBBike BBBike
BDCbot BLEXBot
BDFetch
BackDoorBot BackDoorBot
BackStreet
BackWeb BackWeb
Badass
Barkrowler Barkrowler
BatchFTP
BetaBot BetaBot
Bigfoot Bigfoot
Bitacle
Blackboard Blackboard
Blow Blow
Bolt Buck
Brandprotect Buddy
BuiltBotTough BuiltWith
CCBot Bullseye
CSHttp BuzzSumo
CazoodleBot CazoodleBot
ChinaClaw Cegbfeieh
Chlooe CensysInspect
CherryPicker
Claritybot Claritybot
Cloud mapping Cliqzbot
Copyscape Cocolyzebot
Cosmos CopyRightCheck
Craftbot Crawling at Home Project
CrazyWebCrawler Custo
DBLBot CyotekWebCopy
DSearch DIIbot
DTS Agent DTS Agent
Demon DataCha0s
Devil
Digincore
Dirbuster Dirbuster
Disco Discobot
Discoverybot DomainCrawler
DittoSpyder
DnBCrawler-Analytics
DomCopBot
DomainAppender
DomainSigmaCrawler DomainSigmaCrawler
DomainStatsBot
Domains Project
Dotbot Dotbot
Drip Evil
EMail Siphon Express WebPictures
EasyDL ExtLinksBot
Ecxi Extractor
EirGrabber
Exabot
Extreme Picture Finder
EyeNetIE
Ezooms Ezooms
FDM FemtosearchBot
FHscan Fimap
Flunky Firefox/7.0
FrontPage FlashGet
FyberSpider
Fyrebot Fyrebot
Genieo G-i-g-a-b-o-t
Go-Ahead-Got-It GT::WWW
GrabNet GalaxyBot
Grabber GermCrawler
GetRight
GoZilla
Grafula Grafula
GrapeFX
HEADMasterSEO HEADMasterSEO
HMView HMView
HTTrack
Haansoft Haansoft
HaosouSpider Harvest
Heritrix IDBTE4M
Hloader IDBot
IRLbot IRLbot
Id-search
Image Fetch
Image Sucker Image Sucker
IndeedBot IndeedBot
InfoNaviRobot
InfoTekies
Intelliseek Intelliseek
Internet Ninja
InternetSeer InternetSeer
Iskanie Iskanie
JennyBot Jbrofuzz
JetCar JetCar
JikeSpider JikeSpider
JustView
Kinza Kinza
Lanshanbot LNSpiderguy
LeechGet LWP::Simple
Linkbot Leap
Linkdexbot Libwhisker
Lightspeedsystems
LinkextractorPro LinkextractorPro
LinksManager LinksManager
LinqiaRSSBot LinqiaRSSBot
LinqiaScrapeBot LinqiaScrapeBot
Lipperhey Lipperhey
Lipperhey Spider Litemage_walker
Lmspider
MFC_Tear_Sample MFC_Tear_Sample
MIIxpc MIIxpc
MQQBrowser MJ12bot
Magnet MSIECrawler
Mag-Net
Majestic SEO
Masscan
MauiBot MauiBot
MegaIndex.ru
Metauri Metauri
MicroMessenger Mister PiX
Mojolicious Moblie Safari
Morfeus Fucking Scanner Morfeus Fucking Scanner
Mozlila Mozlila
Msrabot Msrabot
Name Intelligence NICErsPRO
NPbot
Navroad Navroad
NetLyzer Needle
NetMechanic Nessus
NetSpider NetSpider
Netcraft
NextGenSearchBot NextGenSearchBot
Nikto
NimbleCrawler NimbleCrawler
Ninja Offline Navigator
Nuclei OpenLinkProfiler
OnCrawl Openvas
OrangeBot
OrangeSpider
OutclicksBot
OutfoxBot OutfoxBot
Panscient PHPCrawl
POE-Component-Client-HTTP
Page Analyzer
PageThing.com
Papa Foto
PeoplePal PeoplePal
Pi-Monster
Picscout
Picsearch
PictureFinder PictureFinder
Pixray
Pockey
ProPowerBot
ProWebWalker
Probethenet Probethenet
Pu_iN Pu_iN
RankingBot2 PxBroker
Rankivabot PyCurl
RankurBot QueryN Metasearch
RSSingBot
RankActive
RankActiveLinkBot
RankFlex
Re-re
ReGet ReGet
RealDownload RealDownload
Recorder
RepoMonkey
Ripper Ripper
RocketCrawler
SEOkicks
SEOkicks-Robot
SEOlyticsCrawler SEOlyticsCrawler
SISTRIX SEOprofiler
ScanAlert SMTBot
ScoutJet SalesIntelligent
Scrapy
ScrepyBot ScrepyBot
SeobilityBot SearchmetricsBot
Seomoz Seomoz
Shodan
Siphon Siphon
SiteCheckerBotCrawler
Site Sucker Site Sucker
Siteimprove SiteExplorer
Sitevigil Sitebeam
SmartDownload Snapbot
Snake Snoopy
Sosospider
SpankBot SpankBot
SputnikBot Spbot
Sqlworm Spinn3r
Sucker Steeler
Sucuri Sucuri
SuperHTTP SuperBot
SurveyBot SurveyBot
Swiftbot
Szukacz Szukacz
T8Abot T0PHackTeam
Teleport TeleportPro
Telesphoreo TheNomad
Thumbor
TightTwatBot
Toata
Toweyabot
True_Robot True_Robot
TurnitinBot
TwengaBot TwengaBot
Twice Twice
Typhoeus URLy.Warning
URLy Warning Upflow
V-BOT V-BOT
VB Project VB Project
VCI
Vagabondo Vagabondo
VidibleScraper VelenPublicWebCrawler
Voltron VoidEYE
Voil
WPScan WPScan
WWW-Collector-E
WWW-Mechanize WWW-Mechanize
Wallpapers/3.0 Wallpapers
Web Auto WeSEE
Web Enhancer
Web Pix
Web Sauger
WebBandit
WebCollage WebCollage
WebCopier
WebEnhancer WebEnhancer
WebFuck WebFuck
Web Sauger WebPix
Web Sucker WebZIP
WebAuto WebmasterWorldForumBot
WebBandit
WebFetch
WebImageCollector
WebLeacher
WebStripper
WebSucker
Website Quester Website Quester
Whatweb Who.is Bot
Widow Widow
WinHTTrack
Wonderbot
Wotbox Wotbox
Xaldon WebSpider Wprecon
Xenu Xenu
YoudaoBot YoudaoBot
Zade Zade
Zermelo Zauba
Zitebot Zitebot
ZoomBot
ZoominfoBot
ZumBot
archive.org_bot
arquivo-web-crawler arquivo-web-crawler
arquivo.pt
backlink-check backlink-check
cah.io.community
check1.exe check1.exe
coccocbot-web crawl.sogou.com
cognitiveseo
crawler.feedback crawler.feedback
domainsproject.org dataforseo.com
gopher demandbase-bot
facebookscraper
instabid instabid
ips-agent ips-agent
lwp-request isitwp.com
lwp-trivial plumanalytics
magpie-crawler
mediawords
muhstik-scan
oBot
page scorer
pcBrowser
polaris version polaris version
s1z.ru ripz
satoristudio.net
scan.lol scan.lol
seobility seobility
seoscanners
seostar seostar
serpstatbot
sitechecker.pro
siteripz siteripz
sogouspider sogouspider
sp_auditbot
spyfu
tAkeOut
trendiction.com trendiction.com
ubermetrics-technologies.com webmeup-crawler
webpros.com
webprosbot
x09Mozilla x09Mozilla
x22Mozilla
xpymep1.exe
zauba.io

306
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
360Spider 404checker
AIBOT ADmantX
ALittle Client
ASPSeek
Abonti
Aboundexbot Aboundexbot
AiHitBot Acunetix
AfD-Verbotsverfahren
Aipbot Aipbot
Alexibot Alexibot
AllSubmitter Anarchy
Anarchy99 Anarchy99
Anthill
Apexoo
Aspiegel Aspiegel
BDCbot BackDoorBot
BDFetch
BackStreet BackStreet
BackWeb
BacklinkCrawler BacklinkCrawler
Badass
BetaBot BetaBot
Bigfoot
Black Hole
BlackWidow BlackWidow
Boardreader Blackboard
Bolt Bolt
BuzzSumo BotALot
Brandprotect
Brandwatch
CATExplorador CATExplorador
Calculon CCBot
CODE87
CSHttp
CazoodleBot CazoodleBot
CheTeam CensysInspect
CherryPicker CheeseBot
Chlooe
Claritybot
Cliqzbot Cliqzbot
CopyRightCheck Cogentbot
Copyscape Collector
Craftbot Cosmos
CrazyWebCrawler CrazyWebCrawler
Crescent CrunchBot
Custo
DSearch DSearch
DataCha0s DTS Agent
Deusu Deusu
Devil
Digincore Digincore
DigitalPebble Dirbuster
Dispatch Discobot
DittoSpyder Discoverybot
DomCopBot DomainAppender
DomainStatsBot DomainCrawler
Domains Project Dragonfly
Download Wonder Drip
ECCP/1.0
EasyDL EasyDL
Ecxi EirGrabber
EroCrawler
Express WebPictures Express WebPictures
Extractor ExtractorPro
Extreme Picture Finder
Ezooms Ezooms
FDM FHscan
FyberSpider FemtosearchBot
Fimap
Flunky
Freeuploader
FrontPage
G-i-g-a-b-o-t G-i-g-a-b-o-t
GalaxyBot
Genieo Genieo
GermCrawler
GetRight
GetWeb GetWeb
Getintent Gigabot
Go!Zilla Go!Zilla
Grabber Go-Ahead-Got-It
GrapeshotCrawler Gotit
GrabNet
GrapeFX
GridBot
HMView HMView
HTMLparser
HTTP::Lite
Haansoft Haansoft
HaosouSpider
Harvest
Heritrix Heritrix
Hloader
Humanlinks
HybridBot
IRLbot
Iblog Iblog
IlseBot IlseBot
Image Fetch Image Fetch
InfoNaviRobot Indy Library
Intelliseek
InterGET InterGET
IstellaBot Internet Ninja
JOC Web Spider Iskanie
Jbrofuzz Jbrofuzz
JennyBot JennyBot
JetCar
Jetty
Joomla Joomla
Jorgee Jorgee
JustView Kenjin Spider
Keyword Density
Kinza Kinza
Kozmosbot LWP::Simple
LNSpiderguy Lanshanbot
Larbin Leap
Lftp LeechFTP
LibWeb LexiBot
Likse Libwhisker
Lightspeedsystems
LinkScan LinkScan
Linkbot
Linkdexbot
LinkpadBot
LinksManager LinksManager
Lipperhey Spider Litemage_walker
Lmspider Lmspider
MJ12bot Ltx71
Mail.RU_Bot MIIxpc
Majestic SEO MQQBrowser
MSFrontPage
Majestic-SEO Majestic-SEO
Majestic12 MarkMonitor
MarkWatch
Mass Downloader Mass Downloader
Masscan Mata Hari
Meanpathbot Mb2345Browser
Mediatoolkitbot
MegaIndex.ru
MicroMessenger MicroMessenger
Microsoft Data Access Microsoft Data Access
Microsoft URL Control Mojeek
Mister PiX
Morfeus Fucking Scanner Morfeus Fucking Scanner
Mozlila Mr.4x3
Msrabot
Musobot
NICErsPRO NICErsPRO
Nameprotect Navroad
NearSite NearSite
NetAnts NetAnts
NetZIP NetLyzer
NetMechanic
Nettrack
NextGenSearchBot NextGenSearchBot
Nibbler Niki-bot
Nutch Ninja
Nmap
Octopus
Offline Explorer Offline Explorer
Offline Navigator Offline Navigator
OnCrawl OnCrawl
OpenVAS
Openfind
Openvas Openvas
OrangeBot
OrangeSpider OrangeSpider
OutclicksBot OutclicksBot
PECL::HTTP OutfoxBot
PHPCrawl
POE-Component-Client-HTTP
Page Analyzer Page Analyzer
PageScorer PageAnalyzer
Pandalytics Panscient
Pavuk Pavuk
Petalbot PeoplePal
Pi-Monster
Piepmatz
ProPowerBot ProPowerBot
ProWebWalker ProWebWalker
Probethenet
Psbot Psbot
Pu_iN QueryN Metasearch
PyCurl RSSingBot
RankActive RankActiveLinkBot
RankingBot
RankingBot2
Re-re Re-re
RebelMouse RealDownload
Recorder Recorder
Ripper Ripper
RocketCrawler RocketCrawler
SEOkicks SEOstats
SEOlyticsCrawler SISTRIX
ScanAlert
Scrapy
Screaming Screaming
ScrepyBot ScreenerBot
SearchmetricsBot
SemrushBot SemrushBot
SentiBot SentiBot
SeoSiteCheckup SeobilityBot
SiteExplorer
SiteLockSpider SiteLockSpider
SiteSnagger SiteSnagger
SiteSucker
Sitebeam
Siteimprove Siteimprove
SlySearch
Snapbot Snapbot
SocialRankIOBot Sosospider
Sogou web spider Sottopop
SpaceBison
Spammen Spammen
SpankBot SpankBot
Spbot Spbot
Spinn3r SputnikBot
Sqlworm Sqlmap
Sucker Steeler
SuperBot
SuperHTTP SuperHTTP
Surfbot Telesoft
Suzuran
Szukacz
TeleportPro
Telesphoreo Telesphoreo
TheNomad Telesphorep
TightTwatBot TightTwatBot
Titan
Toweyabot Toweyabot
Tracemyfile Trendiction
Trendictionbot Trendictionbot
True_Robot
Turingos Turingos
TwengaBot Turnitin
TurnitinBot
UnisterBot
VB Project
VCI
Vacuum
Vagabondo Vagabondo
VelenPublicWebCrawler
Virusdie
Voil
Voltron
WASALive-Bot WASALive-Bot
WWW-Mechanize WWW::Mechanize
WWWOFFLE WWWOFFLE
Wallpapers Wallpapers/3.0
WallpapersHD WallpapersHD
WeSEE WeSEE
Web Auto Web Enhancer
Web Fetch
Web Fuck
WebCollage
WebCopier
WebFetch WebFetch
WebFuck WebFuck
WebPix WebPix
WebAuto WebReaper
WebCollage
WebFuck
WebSucker WebSucker
WebmasterWorldForumBot WebWhacker
WebZIP
Webalta
Webshag
Website Quester
WebsiteExtractor
Webster
Whack
Whacker Whacker
Whatweb
WinHTTrack WinHTTrack
WiseGuys Robot Woobot
Wonderbot Wprecon
Xaldon WebSpider
Xenu Xenu
Zermelo Zade
Zauba
Zeus Zeus
ZoomBot Zitebot
cah.io.community ZoominfoBot
coccocbot-web archive.org_bot
cognitiveseo arquivo-web-crawler
crawler.feedback check1.exe
evc-batch crawl.sogou.com
facebookscraper crawler4j
gopher eCatch
internetVista monitor instabid
ips-agent lwp-request
isitwp.com
lwp-trivial lwp-trivial
mediawords plumanalytics
muhstik-scan
oBot
page scorer
polaris version
s1z.ru s1z.ru
seobility
seocompany.store seocompany.store
serpstatbot serpstatbot
sexsearcher spyfu
sp_auditbot sysscan
tAkeOut ubermetrics-technologies.com
x09Mozilla
x22Mozilla x22Mozilla
zauba.io

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
101lesbian.xyz bjetjt.com
articlesdirectoryme.info cezartabac.ro
buttons-for-your-website.com compliance-fred.xyz
cbcseward.com foodgid.net
cracksplanet.com hotshoppymac.com
fakehandbags.xyz metascephe.com
pornoslive.net runtnc.net
space-worry.ml segol.tv
trahvid.com trafficreceiver.club
validccseller.com unimodemhalfduplefw.pen.io

928
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
101raccoon.ru 0912701309f8ce.com
108shot.com 1001watch.com.ua
11235813.webzdarma.cz 1008.su
100searchengines.com
123movies.love
178evakuator178.ru
1millionusd.xyz
1webmaster.ml 1webmaster.ml
2015god.org 1xbet4you.com
202ch.com 28n2gl3wfyb0.ru
2728fb936f0.com 4k-player.pl
4rent.ru 8jn.dating-app.ru
4ureyesonly.com 999webdesign.com
4webmasters.org
70casino.online
7ooo.ru
aa9bd78f328a6a41279d0fad0a88df1901.com aa9bd78f328a6a41279d0fad0a88df1901.com
aanapa.ru
aarbur.com
absolute-s.ru absolute-s.ru
adman.se absugars.com
ads-cool.pro abusora.com
advancedmassagebysara.com ad-words.ru
advertex.info adhome.biz
advokateg.ru adservme.com
akama.com adsland.men
agapovdg.ru
alborzan.com alborzan.com
ald2014.org alert-hgd.xyz
algarveglobal.com alfa-medosmotr.ru
all-streaming-media.com all4invest.info
allwidewallpapers.com allknow.info
allwomen.info amazingninja.com
alta-realestate.com ameblo.top
amazingpic.net apccargo.com
an-donut.com apibatbrowsecom-a.akamaihd.net
animebox.com.ua apidigidocketnet-a.akamaihd.net
anonymousfox.co apparel-offer.com
aproposde.com appfixing.space
arenda-avtoprokat-krasnodar.ru applicationg29.com
asiengirls.net applyneedy.xyz
asophoto.com approvedlocal.co.za
auto-moto-elektronika.cz architecturebest.com
autochoixspinelli.com arendas.net
autolombard-krasnodar.ru arewater.com
autorn.ru arquivo.pt
avek.ru arvut.org
astrochicks.com
atmagroup.ru
aviapanda.ru aviapanda.ru
aviav.eu azbukadiets.ru
aviva-limoux.com bagcionderlab.com
avtovolop.ru bangla-chat-uk-paralud.ga
ayodhya.co bannerspace.com
azbuka-mo.ru barbourjackets.online
b00kmarks.com basedecor.ru
backlinkwatch.com beclean-nn.ru
backuperwebcam.weebly.com
bang-hotties.com
bankcrediti.ru
bannertesting.com
beatifullandscape.co
beget.tech beget.tech
best-games.today bestbrainprod.win
best-mam.ru bestempresas.es
bestadbid.com bestplacetobuyeriacta.jw.lt
bestcalovebracelet.cn bharatdefencekavach.com
bestofupload.info bimmerpost.com
bestsexyblog.com bitnote.co
betteroffers.review bjetjt.com
bikini-image.com
binomo.com
bizlist.com.de
blackcurranthumidifiers.site
blackplanet.com blackplanet.com
blog.axant.it blackwitchcraft.ru
blogporn.in bluejays-jerseys.us
bluerobot.info bmwhighperformers.com
bochemit.com.ua bonzbuddy.com
bocoarchives.org bonzybuddy.com
boleznikogi.com boole.onlinewebshop.net
boltalko.xyz boostmyppc.com
brainboostingsupplements.org brains2.biz
browsepulse-a.akamaihd.net brus-vsem.ru
bukleteg.xyz burger-imperia.com
bum.com.ru
bus-offer.com
buscarfoto.com buscarfoto.com
cactussoft.biz business-suggested.tk
camel-beach.com c-english.ru
candcstuccoandstone.com californianews.cf
candycrushshop.com callejondelpozo.es
carmuffler.net
carsplate.com carsplate.com
cartechnic.ru cartierlovestore.xyz
cartierlovestore.com cayado.snn.gr
cartiertrinity.xyz celebsopics.com
celejihad.info cenoval.ru
cellfun.mobi centraletermice.us
chatroulette.video ceotrk.com
chorus.terakeet.com cfjump.com
cialischmrx.com chastnoeporno.com
cicaki.net cheapestjerseysonwholesale.com
classicakuhni.ru cheapmoncler.xyz
clickprotects.com cheapsergiorossi.online
clickzzs.nl cialiswithoutadoctor.net
clubfashionista.com cinemaenergy-hd.ru
compliance-andrew.top claytransformations.info
compliance-checker.info cleanmypc.com
connectionstrenth.com clickbank.net
continent-e.tv clips.ua.ac.be
credit.co.ua coaching-netz.info
culad.com coldfilm.ru
cutt.us communisave.co.za
dailyrank.net conboy.us
datsun-do.com conocer-sanabria.com
dcj-nn.ru contentlook.co
dealighted.com contextualyield.com
delfin-aqua.com.ua cookingmeat.ru
depositfiles-porn.ga cougfan.info
detki-opt.ru counterbot.com
dev-seo.blog craftburg.ru
dev.citetick.com customerpromos-a.akamaihd.net
diegolopezcastan.com ddsoldes.fr
diffbot.com dealitright.click
discountbarbour.online dealwifi.com
dms-sw.ru dentfidemountpreach.tk
domain-tracker.com derevesendeco.com
domcran.net destinationrealestate.com
download-of-the-warez.blogspot.com detective01.ru
digital-video-processing.com
dimkino.ru
dogbreedspicture.net
dokumentalkino.net
dolohen.com
donna7753191.ru
donvito.unas.cz
downloadkakaotalk.com
doyouknowtheword-flummox.ml doyouknowtheword-flummox.ml
drhomes.biz dptaughtme.com
drillsaw.ru draniki.org
drivotracker.com droidlook.net
duplicashapp.com eas-seo.com
e-commerce-seo.com easync.io
e-kwiaciarz.pl ekaterinburg.xrus.org
easycommerce.cf ekspertmed.com
edwinkonijn.com.au encodable.com
efkt.jp energydiet24.ru
ekto.ee englishdictionaryfree.com
elektronischezigarettekaufen1.beeplog.com eropornosex.ru
eluxer.net escort-russian.com
embedle.com
engines-usa.com
erot.co
esopini.com
essay-writing.work
estelight.ru
estibot.com
eu-cookie-law.blogspot.com
eupornstar.info eupornstar.info
evening-dating-club.info
evogarage.com evogarage.com
exchangeit.gq ewebarticle.info
ezigarettenkaufen1.deviantart.com exmasters.com
exoneration-project.us
eyemagination.com
eyes-on-you.ga
eywords-monitoring-your-success.com
ezigarettekaufen.myblog.de
ezigarettenkaufen1.pagina.gr ezigarettenkaufen1.pagina.gr
ezigarettenkaufen2.dreamwidth.org f00kclan.de
familyphysician.ru factorynightclub.com
faracontrol.ir falopicm.pw
fastcrawl.com fanoboi.com
fealq.com farm26.ru
feargames.ru farmprofi.net
ferieboligkbh.dk fast-torrent.ru
ferrotodo.com fast-wordpress-start.com
ff30236ddef1465f88547e760973d70a.com femmesdenudees.com
filefilter.weebly.com fickenprivat.info
financetip.eu filmania-x.ru
fireads.men filmgo.ru
flauntyoursite.com find1friend.com
floating-share-buttons.com fiverr.com
foxinsocks.ru flex4launch.ru
free-share-buttons.blogspot.com floridamobilebillboards.com
freelinkbuilding.website.tk forpostlock.ru
forsex.info
fototravel.eu
free-fbook-traffic.com
free-today.com
freemaintenancesysforpcandmac.top freemaintenancesysforpcandmac.top
fuck-paid-share-buttons.xyz
fuckbuddybestgilf.info fuckbuddybestgilf.info
fusoradio.info fullfileaccess.com
g33.org fxund.us
gambarkatabaru.com galaxy-family.ru
gaygalls.net gallery.rennlist.com
gfaq.ru gallictures.com
gilsonchiro.xyz gamerscorps.com
glasof.es gamevalue7.weebly.com
glavtral.ru gaming-journal.com
goblacked.com gateway.zscalerone.net
goodhumor24.com gdcentre.ru
goodprotein.ru gepezz.info
googlsucks.com getmiro.com
goroda-vsego-mira.ru getmyads24.com
gowreckdiving.com goforexvps.com
gpms.org.my goldenggames.com
gq-catalog.gq gomusix.com
gratuitxblcodes.com goo.ne.jp
greatfind-a.akamaihd.net goodwriterssales.com
guitar-master.org googglet.com
hamacapty.com google-liar.ru
handicapvantoday.com goosefishpost.bid
gosmeb.ru
gosreg.amchs.ru
graphicwe.org
gsasearchengineranker.xyz
gwhwpxbw.bloger.index.hr
hamptonoaks.ca
hccoder.info hccoder.info
hentaiheroes.com hdhc.ru
hermesbracelets.xyz hdimagegallery.net
hidefiles.org helicalpile.us
hjaoopoa.top hermesbelts.xyz
hkladys.com hledejvshopech.cz
homeinns.com home.myplaycity.com
homik.pw hotdl.in
hoste.octopis.com housemilan.ru
hostsshop.ru hoverboard360.at
hotshoppymac.com i-service.kz
houston-vikings.com
howopen.ru
hustoon.over-blog.com
i4track.net
iideaidekonkatu.info iideaidekonkatu.info
imagez.co ilovevitaly.xyz
img.wallpaperstock.net
in-tandem.co
inbabes.sexushost.com
incanto.in.ua incanto.in.ua
inclk.com indetiske.ya.ru
increasewwwtraffic.info indiakino.net
infobanks.ru infospot.pt
innoslicon.com intermesh.net
insta-add.pro iplogger.org
int.search.mywebsearch.com iscblog.info
investmac.com
investsuccess.org
iopeninghours.co.uk
istripper.com istripper.com
itbc.kiev.ua iwantedmoney.com
itservicesthatworkforyou.com izhevsk.xrus.org
jacago.com juliadiets.com
jav-idol.com
jeremyeaton.co
jewelryandfiligree.com
joingames.org
jwcialislrt.com jwcialislrt.com
keywordbasket.com jwss.cc
kidskunst.info karusel-market.ru
kimcurlrvsms.com katadhin.co
kinoplen.ru kazan.zrus.org
kinotorka.ru kerwinandcariza.com
kleine-titten.biz keywordsuggest.org
kletkimehan.ru kiinomaniak.pl
kndxbkdx.bloger.index.hr kinohall.ru
koleso24.com.ua komputers-best.ru
kollesa.ru kostenloser-sex.com
konkursowo-24.pl krasnodar.ru
kredit-pod-zalog-krasnodar.ru krasula.pp.ua
kreativperlen.ch
ku6.com ku6.com
kutikomi.net laudit.ru
laptop-4-less.com ledpolice.ru
laulini.soclog.se letmacworkfaster.world
lazy-z.com letslowbefast.today
lazymanyoga.com levaquin750mg.blogspot.com
lescinq.com lion.conboy.us
lida-ru.com
lineavabit.it
linerdrilling.com
lion.playtap.us lion.playtap.us
live-sexcam.tk liran-locks.com
live-sexchat.ru
liveshoppersmac.com liveshoppersmac.com
locustdesign.co ljusihus.se
lomb.co lolnex.us
long-beach-air-conditioning.com lonely-mature.com
lottospring.com lonfon.xyz
louisvuittonoutletstore.net longlifelomilomi.info
luckyday.world low-format.ru
luxmagazine.cf luxup.ru
lyngdalhudterapi.no m.b00kmarks.com
macotool.com magicplayer-s.acestream.net
magicalfind-a.akamaihd.net mailemedicinals.com
mainhp.net make-money-online.com
mararoom.ru manifestyourmillion.com
matsdale.com marcogrup.com
mature.free-websites.com marmitaco.cat
maximpartnerspr.com masthopehomes.com
mebel-alait.ru matchpal-a.akamaihd.net
mebel-ekb.com matrixalchemy.com
metalonly.info max-p.men
midst.eu medicovi.com
migente.com merryhouse.co.uk
mindeyegames.com message-warning.net
minegam.com metaxalonevstizanidine.blogspot.com
minet.club mhtr.be
mixx.com mikrobiologies.ru
money-every-day.com mil-stak.com
moneymaster.ru milblueprint.com
morefastermac.trade militarysale.pro
morocco-nomad-excursions.com mobstarr.com
moskva.nodup.ru moesonce.com
mouselink.co monthlywinners.com
moyaterapiya.ru moomi-daeri.com
mp3ringtone.info morpicert.pw
mrbojikobi4.biz mowser.com
mturkcontent.com mrmoneymustache.com
mundoaberrante.com musezone.ru
musezone.su mwtpludn.review
muz-baza.net myphotopipe.com
muztops.ru myra.top
mydownlodablefiles.com netallergy.ru
myprintscreen.com networkcheck.xyz
myxdate.info nfvsz.com
mzdish.site nicefloor.co.uk
nakrutka.cc nikhilbahl.com
nastydollars.com nisuturnetdgu.tk
nerudlogistik.ru nosecret.com.ua
nofreezingmac.click noumeda.com
o-o-6-o-o.ru nzfilecloud.weebly.com
o-o-8-o-o.com oddamzadarmo.eu
o.light.d0t.ru offf.info
o00.in okel.co
odoratus.net
oil-td.ru
okmusic.jp
olvanto.ru
olympescort.com
omoikiri-japan.ru
oneclickfiles.com
onlainbesplatno.ru onlainbesplatno.ru
onlinadverts.com onlinebay.ru
optikremont.ru onlinemeetingnow.com
oralsexfilme.net onlineporno.site
outpersonals.com ontargetseo.us
outshop.ru oz-offers.com
paceform.com paparazzistudios.com.au
pandroid.co paphoselectricianandplumber.com
parajumpersoutlet.online partner-print.men
parlament.biz patol01.pw
partner-cdn.men
partybunny.ru
paydayloanslocal.com paydayloanslocal.com
pcgroup.com.uy pelfind.me
perfectpracticeweb.com
perm-profnastil.ru
perso.wanadoo.es
pestomou.info
petrovka-online.com petrovka-online.com
photorepair.ru photo-clip.ru
picquery.com
picscout.com
picswe.com
picture-group.com picture-group.com
pierrehardysale.online picurams.pw
pl-top.pl pinup-casino1.ru
play-mp3.com pinwallpaper.top
popmarker.com piter.xrus.org
pornhubforum.tk piuminiita.com
pornodojd.ru pivka.xyz
pornohd1080.online popunder.ru
pornokajf.com popup-jdh.xyz
pornstartits.xblog.in porn555.com
portadd.men pornhub-ru.com
posible.net porno-dojki.net
pozdrawleniya.com porno-raskazy.ru
predmety.in.ua porno-video-chati.ru
pornobrazzers.biz
pornotubs.com
portal-eu.ru
portside.xyz
pourvous.info
preparevideosafesystem4unow.space
presleycollectibles.com presleycollectibles.com
privatefx-in.ru pricheskaonline.ru
privetsochi.ru purplesphere.in
prokotov.com puserving.com
promover.org questionmarque.ch
pron.pro quizzitch.net
proposal-engine.com raavidesigns.com
prosperent.com ranking2017.ga
prostitutki-kiev.org rating-casino2021.ru
prostitutki-yaroslavlya.org realizmobi.com
proxyradar.com reelheroes.net
purchasepillsnorx.com remont-mobile-phones.ru
qexyfu.bugs3.com retailwith.com
quality-traffic.com rialp.getenjoyment.net
radiogambling.com ribieiendom.no
raisedseo.com royal-betting.net
rczhan.com rozalli.com
realmonte.net rp9.ru
realresultslist.com rus-teh.narod.ru
rebelmouse.com russian-postindex.ru
recinziireale.com s.lollypopgaming.com
recipedays.ru saecsa.co
redirectingat.com salmonfishingsacramentoriver.com
reklamuss.ru
relatodelpresente.com.ar
remont-fridge-tv.ru
remontvsamare.su
remybutler.fr
replica-watch.ru
responsive-test.net
ricorsogiustizia.org
rique.host.sk
rockprogblog.com
roofers.org.uk
rumamba.com
rustic-quiver.win
sa-live.com
sack.net
sale-japan.com
salutmontreal.com salutmontreal.com
sarf3omlat.com saneyes.com
scenicmissouri.us sawin.beth.webd.pl
searchinterneat-a.akamaihd.net sbwealthsolutions.ca
secretscook.ru scanner-elena.top
seminarygeorgia59.ga scanner-mary.top
seocheckupx.com scat.porn
seolab.top searchlock.com
serialsway.ucoz.ru secret.xn--oogle-wmc.com
service.adtech.fr seminarykansas904.ml
seo-prof1.xyz
seo18.su
seonetwizard.com
service-core.ru
seryeznie-znakomstva.ru
sex-foto.pw
sexcamamateurchat.com
sexobzor.info sexobzor.info
shopfishing.com.ua sexystrippe.info
sientalyric.co shitting.pro
sierraapps.com shop-electron.ru
siteimprove.com shopcheermakeup.info
skachat-besplatno-obrazcy.ru shoppingjequiti.com.br
skatestick.bid sildenafilcitratemed.com
skypasss.com sitechecker.pro
slutloadlive.com slavkokacunko.de
smart-scripts.com sobecjvuwa.com.ru
softwaretrend.net socialsignals24.com
solitaire-game.ru sophang8.com
sotechco.co souvenirua.com
sovetogorod.ru sovinsteel.ru
spb.afora.ru spb.afora.ru
spb.ru
speedup-my.site
spidtest.space spidtest.space
spyfu.com srdrvp.com
spymac.net stackthatbucks.com
storehouse.ua staff.prairiesouth.ca
streetfooduncovered.com stairliftsarea.com
stroy-portal22.ru start.myplaycity.com
stuff-about-money.com statustroll.com
suhanpacktech.com stillmiracle.com
superoboi.com.ua stroyplus.ru
suralink.com suggest-keywords.com
svensk-poesi.com swinginwithme.ru
tackletarts.co tabakur77.com
tam-gde-more.ru telegramdownload10.com
td-33.ru terraclicks.com
technopellet.gr teslathemes.com
telefonsexsofort.tk theautoprofit.ml
thecoral.com.br themeforest.net
thegolfclub.info thewebsitetemplate.info
thruport.com tiandeural.ru
ticketsys.inetwd.com timer4web.com
timhost.ru titan-cloud.life
tizanidine4mgstreetvalue.blogspot.com tizanidine6mg.blogspot.com
tizanidinefibromyalgia.blogspot.com tjkckpytpnje.com
tizanidinehcl2mgtablet.blogspot.com tnaionline.org
tizanidinerecreationaluse.blogspot.com toloka.hurtom.com
tmtrck.com tonerbox.kz
topsy.com tootoo.to
toxicwap.com topbestgames.com
tozup.com totu.info
track.deriv.com toursmaps.com
tradedeals.biz toyota.7zap.com
traderzplanet.in traffique.net
traffixer.com trion.od.ua
triumf-realty.ru truck-rece.life
tt-ipd.info trudogolik.net
tubeline.biz tube8.com
turist-strani.ru tupper-shop.ru
twinderbella.com turizm.bz
u555u.info turn-up-life.life
ua.tc turvgori.ru
ucoz.ru tvorozhnaja-zapekanka-recept.ru
unblocksit.es twu.com.ua
urlopener.com typer.one
usacasino.com ublaze.ru
ussearche.cf uhdtv.website
uhod-za-sobakoj.ru
ukr-lit.com
ukrobstep.com
unimodemhalfduplefw.pen.io
unrealcommander.com
uprour.com
usswrite.com usswrite.com
vabasa.inwtrade.com uytmaster.ru
valoresito.com vektorpress.ru
valsalud.com videochat.bz
vapeface.club vip2ch.com
vbtracker.net vipps.com.my
via-energy-acquistare.com visa-pasport.ru
videochat.world viteonlusarezzo.it
videos-for-your-business.com viveresaniesnelli.it
vilingstore.net vladimir.zrus.org
vipms.ru vucms.com
vksaver-all.ru wallpaperaccess.com
vladhistory.com wallpaperstock.net
vodaodessa.com warningwar.ru
voronezh.xrus.org webextract.profound.net
vrnelectro.ru wechatdownload10.com
vtcdns.com westsextube.com
vvpg.ru whatsappdownload10.com
vzlom-na-zakaz.com whatsupinfoley.com
webalan.ru whereverdesperate.gq
webkeyit.com whiteelephantwellington.com
weblo.com wieseversa.no
weboptimizes.com wineitudes.wordpress.com
weightatraining.com
wemarketing.se
wesharepics.info
while.cheapwebsitehoster.com
wholesalecheapjerseysfree.com
winner7777.net
worldis.me
wpsecurity.website wpsecurity.website
www.jbetting.com wpthemedetector.co.uk
x-rates.ru wsgames.ru
xaylapdiendanang.com wstroika.ru
xblog.in www.event-tracking.com
xn----7sbbahaq9bb5afgiqfliv4m.xn--p1ai www.kabbalah-red-bracelets.com
xn----7sbho2agebbhlivy.xn--p1ai www.labves.ru
xn--24-glceagatoq7c2a6ioc.xn--p1ai x-diesel.info
xn--80aaagvmjabrs1aoc9luc.xn--p1ai xbaboon.com
xn--80ajjbdhgmudixfjc8c5a9df8b.xn--p1ai xboxster.ru
xn-----7kceclhb4abre1b4a0ccl2fxch1a.xn--p1ai
xn----7sbaaabaei0cc8aj5bj0bncejx.xn--p1ai
xn----7sbbagbq7bd5aheftfllo4m.xn--p1ai
xn--90acenikpebbdd4f6d.xn--p1ai
xxx-treker.ru xxx-treker.ru
yebocasino.com xxxtube69.com
yellowstonesafaritours.com yellowads.men
yginekologa.com
yogamatsexpert.com
yottos.com
yougame.biz yougame.biz
youghbould.wordpress.com yoursite.com
youradulthosting.com z-master.ru
yourmovies.pl za-fun-offer.com
youtoner.it zacreditom.ru
yuweng.info zaidia.xhost.ro
zarepta.com zarabotok--doma.ru
zigarettenonlinekaufen2.drupalgardens.com zeleznobeton.ru
zootravel.com zirondelli.it
zone-kev717.info
zygophyceous.womanstars.site
zzbroya.com.ua

476
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
1314dh.com 1000n1.ru
20pascals.nl 18ps.ru
2x2fan.ru 1bet.com
3w24.com 1hwy.com
6128786.com 2kata.ru
acgs.tk abclauncher.com
advancedsoftwaresupport.com abctoppictures.net
airmaxshoes-2016.com adultwebhosting.info
alert-hgd.xyz albuteroli.com
alldubai.biz alive-ua.com
allwidewallpapers.com amateurgalls.com
alveris.ru amyfoxfitness.com
amazingpic.net anlimebel.kiev.ua
ample-awards-today.us apelsinnik.website
apartamentwroclaw.eu apiluckyleapnet-a.akamaihd.net
app-ready.xyz apispringsmartne-a.akamaihd.net
artel116.ru apiwoodensealcom-a.akamaihd.net
apps-analytics.net
ascat.porn ascat.porn
asiengirls.net atlant-auto.info
bablonow.ru ayanaspa.com
bamo.xsl.pt baltgem.com
beauty-bracelet.com bazaronline24.ru
bharatdefencekavach.com beauty-clinic.ru
bimmerpost.com best-seo-solution.com
bitporno.sx bidr.trellian.com
bkgr.se binomo.com
blog.koreadaily.com binomo.kz
blpmovies.com bioscorp.ru
boom-celebs.com bizcheapjerseyswholesalechina.com
brandehk.dk browsepulse-a.akamaihd.net
break-the-chains.com bycontext.com
bristolhostel.com camel-beach.com
buttons-for-your-website.com candelluxsklep.pl
buzzsumo.com cartechnic.ru
canacopegdl.com cdn.walkme.com
cartujano-pre.de cete.ru
cfsrating.sonicwall.com chatseo.com
changde.58.com cheapjerseysap.com
cheapjerseysa.com chinacheapelitejerseys.com
cheapsergiorossi.online choosecuisine.com
chee-by.biz citizenclsdriveri7.pen.io
chinese-amezon.com cityadspix.com
cialisovercounteratwalmartusa.com clayvasedesigns.tk
cienum.fr cleansearch.net
cinemaflix.website clickso.com
clickprotects.com compliance-jessica.top
com-supportcenter.website compliance-walt.top
compliance-don.top cookie-law-enforcement-ff.xyz
compliance-don.xyz costablue.xyz
conocer-sanabria.com covetnica.com
cosmetic.donna7753191.ru ddpills.com
cracksplanet.com de.zapmeta.com
cv.wallhade.co dellalimov.com
delayreferat.ru dev33.dioniqlabb.se
diegolopezcastan.com djonwatch.ru
doktoronline.no dneprsvet.com.ua
dvervmoskvu.ru doublepimp.com
dvrlists.com dpihatinh.gov.vn
edge.sharethis.com drunkmoms.net
ekobata.ru dumuelave.xyz
elektronischezigarettekaufen2.tumblr.com ec-file.info
elitesportsadvisor.com eloconcream.blogspot.com
encodable.com emailaccountlogin.co
esnm.ru enternet.ee
essaypro.com
essayservicewriting.org
evehemming.blogspot.com.au
ezigarettenshop2.myblog.de ezigarettenshop2.myblog.de
ezrvrentals.com f-online.de
fandlr.com f1nder.org
fanoboi.com falopicm.pw
ferieboligkbh.dk faz99.com
ferretsoft.com fettefrauen.net
fickluder69.com fickluder69.com
fifa-coins.online find1friend.com
flashahead.info floating-share-buttons.com
forum.tvmir.org floridamhca.org
flowwwers.com
foodcrafts.website
foxweber.com
free-fb-traffic.com free-fb-traffic.com
freelotto.com fsakhalin.ru
freewebs.com galaxys6manual.info
freshsuperbloop.com gameplexcity.com
funponsel.com gate5.co.za
gdzkurokam.ru gavuer.ru
ge0ip.org gerhardhealer.com
genericviagrasildenafiled.net gtopstats.com
germes-trans.com guge.io
globalscam.ga guidefs.ru
golmau.host.sk
gonextmedia.com
googleseo.com.tr
gowreckdiving.com
graphid.com
gsasearchengineranker.top
hdimagelib.com
healing-dysplasia.ru healing-dysplasia.ru
heatpower.ru heatpower.ru
hetmanship.xyz himgaws.pw
hotenergy.ru hol.es
houston-vikings.com homeinns.com
husky-shop.cz houdom.net
hyipmanager.in houseofgaga.ru
igtools.club houtings.xyz
imgarcade.com howlongdoestizanidinestayinyoursystem.blogspot.com
inome.com.ua hoztorg-opt.ru
insta-add.pro humbmosquina.tk
instakink.com hunthillfarmtrust.org
investingclub.ru hystersister.com
io9.com informatiecentro.be
innodgfdriverhm.aircus.com
iomoio.net iomoio.net
jerseywholesalechinabiz.com iqs.biz.ua
jose.mulinohouse.co jagg.info
jovencitas.gratis javcoast.com
jumptap.com kamorel.com
kam-dom.ru ketrzyn.pl
kamagragelusa.net keywordglobal.co.za
kellyonline.xyz konteiner24.com
khafre.us ktotut.net
kicknights.gq
kinogonew.ru
krasivoe-hd.net
lacloop.info
lafriore.ru
lapolis.it lapolis.it
larchik.net letolove.ru
lazy-z.com liky.co.ua
leadn.pl littlecity.ch
longgreen.info liveinternet.ro
longlifelomilomi.info localflirtbuddies.com
louboutinshoes.xyz lollypopgaming.com
lrac.info lostfilm-online.ru
m.b00kmarks.com louisvuittonoutletstore.net
macdamaged.space lutherstable.org
machicon-ueno.info lyngdalhudterapi.no
macotool.com m0r0zk0-krava.ru
magazintiande.ru managerpak204.weebly.com
manifestation.betteroffers.review mcnamaratech.com
mansparskats.com mebel-alait.ru
master-muznachas.ru meble-bogart.info
masterseek.com medi-fitt.hu
mcadamssupplyco.com meet-flirt-dating.com
medanestesia.ru mesto-x.com
medicine-4u.org mmofreegames.online
menstennisforums.com mobile.ok.ru
message-warning.net mojaocena.com
minet.club monclerboots.xyz
minharevisao.com money-for-placing-articles.com
moesexy.com morefastermac.trade
moncleroutletonline.pw moroccosurfadventures.com
moneyteam24.com myanyone.net
moneytop.ru myonlinepayday.co
msfsaar.de na15.ru
muycerdas.xxx nakozhe.com
myiptest.com naphukete.ru
narosty.com netoil.no
naval.jislaaik.com newstudio.tv
nerudlogistik.ru nina.az
next-dentists.tk noscrapleftbehind.co
niki-mlt.ru nudo.ca
noclegonline.info nvformula.ru
nrjmobile.fr offers.bycontext.com
oconto.ru okroshki.ru
online.ktc45.ru okuos.com
onstrapon.purplesphere.in olympescort.com
oops-cinema.ru parajumpersoutlet.online
oralsexfilme.net park.above.com
owathemes.com partner-cdn.men
partner-print.men partybunny.ru
pdns.cz pastaleads.com
pflexads.com paydayonlinecom.com
pharmacyincity.com pb-dv.ru
phpdevops.com pinwallpaper.xyz
pierrehardysale.online pixell.club
pills24h.com plastjulgranar.se
pinwallpaper.top play.leadzupc.com
pizza-tycoon.com playlott.com
plastgran.com pokemon-go-play.online
porno-transsexuals.ru porn-w.org
pornogad.com pornhub-ru.com
pornonik.com pornmania.pl
producm.ru pornoinn.com
qld10000.net powc.r.ca.d.sendibm2.com
qwertty.net priceg.com
rank-checker.online profitfx.online
rapevideosmovies.com prosmibank.ru
rapidokbrain.com prostitutki-kiev.org
rasteniya-vs-zombi.ru pyrodesigns.com.au
reining.lovasszovetseg.hu radiodigital.co
remontbiz.ru redirlock.com
responsinator.com remorcicomerciale.ro
renewablewealth.com
rentalcarnavi.info
research.ifmo.ru
rightenergysolutions.com.au
robot-forex.biz
rockma.se rockma.se
rutor.group rukino.org
sbtdesign.co.uk salutmontreal.com
sbwealthsolutions.ca sape.top
semxiu.com scanner-jane.top
seorankinglinks.xyz searchinquire.com
shama-rc.net sei80.com
sherlock.se seotoolsagency.com
site3.free-share-buttons.com shinikiev.com.ua
smichovbike.cz shopcheermakeup.info
sms2x2.ru simply.net
soblaznu.net sims-sims.ru
soviet-portal.do.am sisi-go.ru
sivs.ru
snsdeainavi.info
solitaire-game.ru
soundfrost.org
sovinsteel.ru
space4updating.win
spasswelt.net
spravka-medosmotr.ru
srecorder.com srecorder.com
stairliftstrue.com
standardchartered-forex.com
starpages.net
stroilka.info stroilka.info
symbaloo.com support.nopeas.sk
tagil.zrus.org svtrd.com
tandvardshuset.net the-torrent-tracker.blogspot.com
technika-remont.ru thedownloadfromwarez.blogspot.com
technopellet.gr theprofitsmaker.net
telefonsexi.com tizanidineinfo.blogspot.com
texbaza.by topclickguru.com
thecoral.com.br topmira.com
tilido.com tpu.ru
tizanidinestreetprice.blogspot.com traffic100.com
toon-families.com tsstcorpcddvdwshbbdriverfb.aircus.com
tozup.com tuberkuleznik.ru
track-rankings.online unitexindia.com
trafficreceiver.club uptimechecker.com
trahic.ru urdoot.win
trailer.cinemaflix.website urldelivery.com
trk-4.net uzporno.mobi
tvorozhnaja-zapekanka-recept.ru vapeface.club
twincitiescarservice.com veles.shop
uac.net.au veopornogratis.xxx
ukrtextbook.com vkonche.com
ultimatesetnewfreeallsoftupgradesystems.pw vkontarkte.com
unblocksit.es vladimir.xrus.org
uptimebot.net
vchulkah.net
videochat.life
vse-pesni.com vse-pesni.com
vucms.com waycash.net
vzubah.com website-speed-up.top
w7s.ru welck.octopis.com
watch-movies.ru whatsappdownload10.com
we-are-gamers.com x-rates.ru
wechatdownload10.com xclicks.net
white-truck.life xlovecam.com
wma-x.com xn--80aeahghtf8ac5i.xn--p1ai
worldlovers.ru xxlargepop.com
wpsecurity.website xxxdatinglocal.us
xn-----6kcaabbafhu7cskl7akvongwpo7hvjj.xn--p1ai xxxguitars.com
xn-----7kceclhb4abre1b4a0ccl2fxch1a.xn--p1ai y8games-free.com
xn--80aaajbdbddwj2alwjieei2afr3v.xn--p1ai yaderenergy.ru
youtuhe.com yoursearch.me
zebradudka.com zeroredirect9.com
zero1.it zirondelli.it
zerocash.msk.ru
zhacker.net
zskdla.site

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.240 0; 10.1.0.13 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2021.11.2710 ### Version: V4.2021.11.2711
### Updated: Fri Nov 12 10:03:15 UTC 2021 ### Updated: Fri Nov 12 22:01:13 UTC 2021
### Bad Bot Count: 626 ### Bad Bot Count: 626
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2021.11.2710 ### Version: V4.2021.11.2711
### Updated: Fri Nov 12 10:03:15 UTC 2021 ### Updated: Fri Nov 12 22:01:13 UTC 2021
### Bad Bot Count: 626 ### Bad Bot Count: 626
################################################### ###################################################
### Version Information ## ### Version Information ##