vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-10 06:15:06 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2021.11.2730 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2021-11-22 10:09:17 +00:00
parent 489e19b518
commit 9f5c5523be
47 changed files with 72438 additions and 72428 deletions
Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2021.11.2729 #### Version: V4.2021.11.2730
#### Bad Referrers Blocked: [7077](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7077](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [627](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [627](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2021.11.2729 #### Version: V4.2021.11.2730
#### Bad Referrers Blocked: [7077](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7077](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [627](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [627](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -11,7 +11,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2021.11.2729 #### Version: V4.2021.11.2730
#### Bad Referrers Blocked: [7077](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7077](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [627](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [627](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

8918
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2021.11.2729 #### Version: V4.2021.11.2730
#### Bad Referrers Blocked: [7077](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7077](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [627](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [627](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

8922
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

8922
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

8922
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

8922
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.117 1; 10.1.0.141 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.117 0; 10.1.0.141 0;
127.0.0.1 0; 127.0.0.1 0;

8922
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.117 1; 10.1.0.141 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.117 0; 10.1.0.141 0;
127.0.0.1 0; 127.0.0.1 0;

8922
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.117 1; 10.1.0.141 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.117 0; 10.1.0.141 0;
127.0.0.1 0; 127.0.0.1 0;

8922
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
2729 2730

8922
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

8922
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.112.97.59 0; 20.112.85.28 0;

8922
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.117 1; 10.1.0.141 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.117 0; 10.1.0.141 0;
127.0.0.1 0; 127.0.0.1 0;

8922
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.117 1; 10.1.0.141 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.117 0; 10.1.0.141 0;
127.0.0.1 0; 127.0.0.1 0;

8922
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.117 1; 10.1.0.141 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.117 0; 10.1.0.141 0;
127.0.0.1 0; 127.0.0.1 0;

8922
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.112.97.59 0; 20.112.85.28 0;

8922
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.112.97.59 0; 20.112.85.28 0;

8922
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.117 1; 10.1.0.141 1;
127.0.0.1 1; 127.0.0.1 1;

18
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
Cegbfeieh Devil
Digincore HEADMasterSEO
DomainStatsBot Larbin
EMail Siphon Libwhisker
Meanpathbot NetLyzer
Navroad PictureFinder
OrangeSpider
Sucuri
WebReaper WebReaper
Webster WebWhacker
Zeus
serpstatbot

298
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
01h4x.com 01h4x.com
360Spider 80legs
ADmantX
ALittle Client ALittle Client
Abonti Abonti
Aboundexbot
Acunetix
AfD-Verbotsverfahren AfD-Verbotsverfahren
Alexibot Alexibot
Alligator
AlphaBot
Anarchie
Anarchy Anarchy
Anthill Aspiegel
Asterias Asterias
AwarioRssBot
BBBike BBBike
BDCbot BLEXBot
BDFetch
BackDoorBot
BackStreet
BackWeb
Backlink-Ceck
BacklinkCrawler BacklinkCrawler
Bandit BatchFTP
Barkrowler
Bitacle Bitacle
Black Hole BlackWidow
Blow
BlowFish BlowFish
Bolt Boardreader
BotALot
Brandwatch Brandwatch
Buddy Buck
BuiltBotTough
BuiltWith BuiltWith
CCBot BunnySlippers
CazoodleBot CATExplorador
CheeseBot ChinaClaw
CherryPicker
Claritybot Claritybot
Cloud mapping
Cocolyzebot Cocolyzebot
Copier
CopyRightCheck CopyRightCheck
Cosmos
Craftbot Craftbot
CrazyWebCrawler CyotekWebCopy
Crescent
CrunchBot
Curious
Custo
DIIbot DIIbot
DataCha0s DataCha0s
Demon Demon
Devil Deusu
DigitalPebble Dirbuster
Disco
Discobot Discobot
Discoverybot DittoSpyder
Dispatch
DnyzBot DnyzBot
DomainCrawler DomCopBot
DomainAppender
DomainSigmaCrawler
DomainStatsBot DomainStatsBot
Dotbot Dotbot
Download Wonder Download Wonder
Dragonfly Dragonfly
ECCP/1.0 ECCP/1.0
EMail Siphon
EMail Wolf
EasyDL EasyDL
Ebingbong Ebingbong
Express WebPictures Exabot
ExtractorPro
Extreme Picture Finder Extreme Picture Finder
EyeNetIE EyeNetIE
FHscan
FemtosearchBot
Flunky
Freeuploader
FrontPage FrontPage
FyberSpider Fuzz
Fyrebot
GT::WWW GT::WWW
GermCrawler
GetWeb
Go!Zilla
Go-Ahead-Got-It Go-Ahead-Got-It
GrabNet GoZilla
Gotit
Grabber Grabber
GrapeFX HEADMasterSEO
GrapeshotCrawler
HMView HMView
HTTP::Lite HTTP::Lite
HTTrack HTTrack
HaosouSpider Haansoft
Heritrix Havij
Hloader Humanlinks
HybridBot HybridBot
IDBTE4M IRLbot
Id-search
Image Fetch
Image Sucker Image Sucker
IndeedBot IndeedBot
Indy Library InfoTekies
InfoNaviRobot Intelliseek
InterGET Iskanie
JetCar JennyBot
Jetty
Jorgee
JustView
Kenjin Spider Kenjin Spider
Keyword Density Kozmosbot
LNSpiderguy LNSpiderguy
Lanshanbot LibWeb
Larbin
LeechFTP
LeechGet
Libwhisker Libwhisker
LinkWalker LinkWalker
LinkextractorPro Linkdexbot
LinkpadBot LinkpadBot
LinqiaMetadataDownloaderBot LinksManager
LinqiaRSSBot
Lipperhey
Lipperhey Spider Lipperhey Spider
Litemage_walker Litemage_walker
Lmspider
Ltx71
MFC_Tear_Sample MFC_Tear_Sample
MIDown tool MIDown tool
MIIxpc
MJ12bot MJ12bot
MSFrontPage MQQBrowser
MSIECrawler
MTRobot MTRobot
Magnet
Mail.RU_Bot Mail.RU_Bot
Mass Downloader Majestic SEO
Mata Hari Majestic-SEO
Mb2345Browser MarkWatch
Mediatoolkitbot MauiBot
Metauri MeanPath Bot
Mister PiX Meanpathbot
MegaIndex.ru
MicroMessenger
Mojeek Mojeek
Morfeus Fucking Scanner Morfeus Fucking Scanner
Mozlila
NPbot
Name Intelligence
Nameprotect Nameprotect
Navroad
NearSite
Net Vampire Net Vampire
NetAnts
NetZIP
Nettrack
Netvibes Netvibes
Niki-bot Niki-bot
Openfind Nikto
Openvas Octopus
Offline Explorer
Offline Navigator
OutfoxBot OutfoxBot
PHPCrawl PECL::HTTP
PageAnalyzer POE-Component-Client-HTTP
PageGrabber PageGrabber
Pandalytics
Pavuk
PeoplePal PeoplePal
Petalbot Petalbot
Pi-Monster Pi-Monster
Picsearch Piepmatz
PictureFinder Pixray
Pimonster Pockey
ProPowerBot
Psbot Psbot
Pu_iN PxBroker
Pump PyCurl
RSSingBot Quick-Crawler
Rankivabot RealDownload
RankurBot RepoMonkey
Reaper SalesIntelligent
Ripper Scrapy
RocketCrawler Screaming
SEOkicks-Robot
SISTRIX
SMTBot
ScoutJet
ScreenerBot
ScrepyBot
Searchestate Searchestate
SearchmetricsBot SearchmetricsBot
SemanticJuice Seomoz
Semrush
SentiBot
SeoSiteCheckup
Shodan Shodan
SiteCheckerBotCrawler SiteCheckerBotCrawler
SiteExplorer SiteExplorer
SiteLockSpider SiteSnagger
Sitevigil Sitevigil
Snoopy Snapbot
Sogou web spider SocialRankIOBot
Sottopop Sosospider
SpaceBison SpaceBison
Spammen
Spanner Spanner
SputnikBot Spbot
Spinn3r
Sqlworm Sqlworm
Steeler
Stripper Stripper
Sucker Sucker
SuperHTTP Sucuri
SurveyBot Surfbot
Swiftbot
Szukacz
T0PHackTeam
T8Abot
Teleport Teleport
TeleportPro TeleportPro
Telesoft Telesphoreo
Telesphorep
The Intraformant
TheNomad TheNomad
Toweyabot Toweyabot
Tracemyfile Twice
Trendictionbot
Turingos
Typhoeus Typhoeus
URLy Warning URLy.Warning
UnisterBot UnisterBot
Upflow V-BOT
VB Project
VCI
Vagabondo Vagabondo
VelenPublicWebCrawler VidibleScraper
VeriCiteCrawler Virusdie
WEBDAV
WISENutbot WISENutbot
WPScan WPScan
WWW-Collector-E
WWWOFFLE WWWOFFLE
Wallpapers/3.0 Wallpapers
WeSEE Web Fetch
Web Auto
Web Fuck Web Fuck
WebCopier Web Sucker
WebEnhancer WebBandit
WebFuck WebGo IS
WebImageCollector
WebLeacher
WebReaper
WebSucker WebSucker
WebWhacker Webalta
WebZIP Webshag
WebmasterWorldForumBot
Website Quester
WebsiteExtractor WebsiteExtractor
WebsiteQuester WebsiteQuester
Webster
Whacker
Whatweb Whatweb
Who.is Bot
Widow Widow
WinHTTrack
Wonderbot
Woobot
Wotbox Wotbox
Wprecon Xaldon_WebSpider
Xenu Xenu
YoudaoBot ZmEu
Zermelo ZoomBot
adscanner ZumBot
arquivo-web-crawler arquivo-web-crawler
clark-crawler autoemailspider
coccocbot-web cah.io.community
cognitiveseo dataforseo.com
crawler.feedback
demandbase-bot demandbase-bot
eCatch domainsproject.org
facebookscraper
gopher
heritrix heritrix
internetVista monitor netEstate NE Crawler
lwp-request oBot
magpie-crawler
page scorer
pcBrowser
plumanalytics plumanalytics
ripz
s1z.ru s1z.ru
scan.lol satoristudio.net
seobility seostar
seoscanners sogouspider
serpstatbot sp_auditbot
sitechecker.pro spyfu
siteripz trendiction.com
voyagerx.com trendiction.de
ubermetrics-technologies.com
webpros.com webpros.com
xpymep1.exe xpymep1.exe
zauba.io

314
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
80legs
ADmantX
AIBOT
ALittle Client ALittle Client
Abonti Aboundex
Aboundexbot AfD-Verbotsverfahren
AiHitBot AiHitBot
AllSubmitter Aipbot
Alligator Alexibot
AlphaBot Anarchie
Anarchy99 Anarchy99
Anthill
Apexoo Apexoo
Attach
AwarioRssBot AwarioRssBot
BBBike BBBike
BDFetch BDCbot
BackStreet BackStreet
BackWeb
BacklinkCrawler BacklinkCrawler
Badass Battleztar Bazinga
Bandit
Barkrowler
BetaBot BetaBot
Bigfoot
BlackWidow BlackWidow
Blackboard Blackboard
Blow Blow
BlowFish BlowFish
Boardreader
Bolt
BotALot
Brandprotect Brandprotect
Brandwatch
Buck
Buddy Buddy
BuiltBotTough BuiltBotTough
BuiltWith BuiltWith
Bullseye Bullseye
CODE87 BunnySlippers
Cegbfeieh BuzzSumo
CATExplorador
CSHttp
CheeseBot
CherryPicker CherryPicker
ChinaClaw Cliqzbot
Claritybot Cocolyzebot
Cogentbot CopyRightCheck
Cosmos Crescent
CrunchBot Custo
DBLBot Digincore
DIIbot DigitalPebble
DSearch Disco
DTS Agent Dispatch
DatabaseDriverMysqli DnBCrawler-Analytics
Dirbuster DomCopBot
Discobot
Discoverybot
DomainAppender DomainAppender
DomainCrawler DomainSigmaCrawler
DomainStatsBot Domains Project
Dotbot Download Wonder
Dragonfly Dragonfly
Drip
ECCP/1.0
EMail Siphon EMail Siphon
Ebingbong EroCrawler
Exabot Evil
Express WebPictures Extreme Picture Finder
Extractor
ExtractorPro
EyeNetIE EyeNetIE
FDM
FHscan
FemtosearchBot FemtosearchBot
Flunky Firefox/7.0
FrontPage FlashGet
GetRight Freeuploader
GetWeb FyberSpider
Getintent Fyrebot
GT::WWW
GermCrawler
Go!Zilla
Go-Ahead-Got-It Go-Ahead-Got-It
Grabber GoZilla
GrapeFX GrabNet
GrapeshotCrawler
HMView HMView
HTTP::Lite HTMLparser
HTTrack Haansoft
Havij
Heritrix
Hloader
IDBot
IRLbot
Id-search Id-search
InterGET Indy Library
InfoTekies
Iria Iria
JOC Web Spider
JamesBOT JamesBOT
Jbrofuzz Jbrofuzz
JennyBot JennyBot
JetCar
Jetty
JikeSpider JikeSpider
Joomla Kenjin Spider
Jyxobot Kinza
Kozmosbot Kozmosbot
LNSpiderguy Lanshanbot
Larbin
Leap Leap
LeechGet LeechFTP
LexiBot LexiBot
Lftp
LibWeb LibWeb
LieBaoFast LieBaoFast
Lightspeedsystems Lightspeedsystems
LinkScan LinkScan
LinkWalker
Linkbot
Linkdexbot Linkdexbot
LinkpadBot
LinqiaScrapeBot LinqiaScrapeBot
Lipperhey Lmspider
Litemage_walker Ltx71
MFC_Tear_Sample
MQQBrowser MQQBrowser
MSFrontPage MTRobot
MSIECrawler Mag-Net
Magnet Majestic12
Mail.RU_Bot Mb2345Browser
Majestic SEO Mediatoolkitbot
MarkMonitor
MauiBot
MeanPath Bot
MegaIndex.ru MegaIndex.ru
Metauri Microsoft Data Access
Mister PiX Microsoft URL Control
Moblie Safari Moblie Safari
Mojolicious Mojolicious
Morfeus Fucking Scanner Morfeus Fucking Scanner
Mozlila
Mr.4x3 Mr.4x3
Musobot Msrabot
NearSite Needle
Net Vampire
NetLyzer
NetMechanic NetMechanic
NetZIP Netcraft
Nettrack Netvibes
NextGenSearchBot Nikto
Nibbler NimbleCrawler
Niki-bot Nmap
Ninja Nuclei
Nutch
Octopus
Offline Explorer Offline Explorer
Offline Navigator OpenVAS
Openfind Openfind
OrangeSpider Openvas
PECL::HTTP PHPCrawl
POE-Component-Client-HTTP PageAnalyzer
PageThing.com PageGrabber
PageScorer
Pi-Monster
PictureFinder PictureFinder
Pixray Pimonster
Pockey
ProPowerBot ProPowerBot
RSSingBot Psbot
RankActive PyCurl
QueryN Metasearch
RankActiveLinkBot
RankingBot RankingBot
Rankivabot Re-re
RealDownload
Reaper Reaper
Recorder RebelMouse
RedesScrapy RepoMonkey
Ripper
Rogerbot
SBIder
SEOkicks-Robot
SISTRIX
SalesIntelligent
Scanbot Scanbot
Scrapy ScoutJet
Searchestate ScrepyBot
SearchmetricsBot SentiBot
SemanticJuice
SemrushBot
SeoSiteCheckup SeoSiteCheckup
Siphon Siphon
Site Sucker
SiteCheckerBotCrawler
SiteExplorer SiteExplorer
SiteLockSpider SiteLockSpider
SiteSnagger
Sitebeam Sitebeam
Siteimprove Siteimprove
Sitevigil Sitevigil
SlySearch SlySearch
Snapbot SmartDownload
SocialRankIOBot Sociscraper
Sosospider Spammen
Sqlmap SpankBot
Sqworm Spbot
Steeler
Stripper Stripper
Sucker Sucker
Sucuri
SuperBot
SuperHTTP
Surfbot
Suzuran
Szukacz
T0PHackTeam
Teleport
TeleportPro
Telesphoreo Telesphoreo
Thumbor TightTwatBot
Toweyabot
Tracemyfile Tracemyfile
Trendiction Trendictionbot
True_Robot
Turingos Turingos
Turnitin
TurnitinBot
TwengaBot TwengaBot
URLy.Warning Twice
Upflow URLy Warning
VB Project UnisterBot
V-BOT
Vacuum Vacuum
Virusdie VelenPublicWebCrawler
VeriCiteCrawler
VoidEYE VoidEYE
Voil WPScan
WASALive-Bot WWW::Mechanize
WISENutbot
WWW-Collector-E
WWWOFFLE WWWOFFLE
Wallpapers
Wallpapers/3.0 Wallpapers/3.0
WallpapersHD WeSEE
Web Collage Web Enhancer
Web Pix Web Pix
Web Sauger WebAuto
WebEnhancer
WebFetch
WebGo IS
WebImageCollector WebImageCollector
WebLeacher WebLeacher
WebPix WebPix
WebReaper WebSucker
WebWhacker Webalta
WebZIP
WebmasterWorldForumBot
Webshag Webshag
WebsiteQuester
Whack Whack
Whacker
Whatweb Whatweb
Who.is Bot Who.is Bot
Widow WinHTTrack
Wonderbot Wonderbot
Woobot Wotbox
Xaldon WebSpider Xaldon WebSpider
Xaldon_WebSpider
Xenu
YoudaoBot YoudaoBot
Zade Zauba
adscanner ZoomBot
ZoominfoBot
archive.org_bot archive.org_bot
eCatch arquivo.pt
clark-crawler
coccocbot-web
cognitiveseo
com.plumanalytics
crawler4j
dataforseo.com
evc-batch
facebookscraper facebookscraper
gopher gopher
internetVista monitor heritrix
instabid
ips-agent ips-agent
magpie-crawler
mediawords mediawords
netEstate NE Crawler muhstik-scan
oBot oBot
probe-image-size page scorer
seostar seobility
seocompany.store
sp_auditbot
tAkeOut tAkeOut
ubermetrics-technologies.com trendiction.com
webmeup-crawler trendiction.de
voyagerx.com
webpros.com
webprosbot
x09Mozilla x09Mozilla
xpymep1.exe xpymep1.exe
zgrab zauba.io

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
craftinsta.ru aa14ab57a3339c4064bd9ae6fad7495b5f.com
gk170.ru fxtips.ru
hermesbracelets.xyz headpress.ru
iqoption.com hildinghr.se
offer.wpsecurity.website koleso24.com.ua
photostudiolightings.com obiavo.kz
pontiacsolstice.info softlinesolutions.me
sitevalued.com thaismartloan.com
swimpool.ca yourporn.com
xxxtubesafari.com youtube-downloader.savetubevideo.com

928
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
000free.us
08800.top
101raccoon.ru
11235813.webzdarma.cz 11235813.webzdarma.cz
123locker.com 12u.info
1314dh.com 300richmond.co.nz
1688.com 3th.co.in
2015god.org 4ur.click
24videos.tv 4webmasters.org
3w24.com 55wmz.ru
7search.com 66cpwgln.space
999webdesign.com 9icmzvn6.website
a96527gi.beget.tech aac52006ec82a24e08b665f4db2b5013f7.com
aa8780bb28a1de4eb5bff33c28a218a930.com aanapa.ru
aaa38852e886ac4af1a3cff9b47cab6272.com abwa.tk
aarbur.com adcash.com
absolutelyanalog.com advocatemsk.ru
adidas.frwebs.fr aerogo.com
advokateg.xyz aksonural.ru
albamargroup.com akvamaster.dp.ua
alfa9.com alarmobninsk.ru
alfapro.ru alert.scansafe.net
alldezservice.kz alice.it
allornamenti.com alkoravto.ru
allproblog.com all-streaming-media.com
alphahoverboards.com all4invest.ru
apiwoodensealcom-a.akamaihd.net allboard.xobor.de
apple.com-webbrowsing-security.review aludecor.info
applyneedy.xyz amehdaily.com
arkkivoltti.net anabolics.shop
ascat.porn android-vsem.org
antons-transporte.de
approved.su
apps-analytics.net
asdfg.pro
asophoto.com
asscenihotosidea.blogspot.co.za
atofilms.com
aussie-prizes.com aussie-prizes.com
autoblogger24.info autobrennero.it
aviva-limoux.com aviav.ru.com
avtochehli.by avramstroy.ru
avtocredit-legko.ru azbuka-mo.ru
azazaporn.com babieca.com
babyfactory.fr babs.com.ua
backlinkwatch.com banan.tv
baladur.ru bankmib.ru
balkanfarma.ru bcmp.org
bank.uz bedandbreakfast.com
bannertesting.com beetpics.pw
bard-real.com.ua best-seo-software.xyz
bbsoldes.fr besthomemadepornsites.com
beachfix.co betonka.pro
beauty-b0x.pl bidr.trellian.com
beget.tech bimatoprost-careprost.com
berdasovivan.ru bimmerpost.com
bestbuy.ca bjanshee.ru
bestmarriages.com blackhatworth.com
betune.onlinewebshop.net blackle.com
bezcmexa.ru blogos.kz
bif-ru.info bloke.com
bigpictures.club bluerobot.info
bimatoprost-careprost.com.ua bmsco.co
bin-brokers.com bongiornos.info
bingo8888.com bonkers.name
biographiya.com book-bets.com
bitcoins-live.ru brandehk.dk
bjetjt.com brimstonehillfortress.org
blockworld.ru
bobba.dzaba.com
bochemit.com.ua
bravegirlsclub.com
break-the-chains.com
brewdom.ru
brianhenry.co
brk-rti.ru
browserprotecter.com browserprotecter.com
brus-vsem.ru
buehne-fuer-menschenrechte.de
bumble.cheapwebsitehoster.com
bus-offer.com
buy-cheap-online.info
buy-cheap-pills-order-online.com
buydissertation.net buydissertation.net
buynorxx.com buyhoverboard.com
buyscabiescream.com buypuppies.ca
callstevens.com buytizanidineonlinenoprescription.blogspot.com
cardul.ru bvlgaribracelet.xyz
carina-sy.de c-english.ru
cardsdumps.com
cartierbracelet.xyz cartierbracelet.xyz
cartujano-pre.de cartierreplica.pw
cashonads.com cctva.tv
castingbank.ru cdnanalytics.xyz
cbb1smartlist12.click
cdncash.net
cellfun.mobi cellfun.mobi
centre-indigo.org.ua ceotrk.com
cheap-trusted-backlinks.com certifywebsite.win
cheapbelstaff.online charmstroy.info
chatroulette.online
cheapmoncler.pw
check-this-out-now.online
cherubinimobili.it cherubinimobili.it
chimiver.info chinacheapelitejerseys.com
chiptuninger.com cialischsrx.com
chocolateslim-u-srbiji.com citetick.com
choice-credit.ru cjmc.info
classiquebijoux.ru cocyq.inwtrade.com
cleanallspyware.com colobit.biz
club-samodelkin.ru com-supportcenter.website
coderstate.com compliance-fred.top
compliance-checker.info compliance-nelson.top
compliance-fred.xyz cookie-law-enforcement-hh.xyz
compliance-george.top coolingoods.com
compliance-jessica.top copypaste.traderzplanet.in
compliance-john.top creativehutindia.com
compliance-walter.top culad.com
compucelunlock.net
cowblog.fr
cpabegins.ru
crackzplanet.com
crafthubs.com
crd.clan.su
credit-respect.ru
cwetochki.ru
cymbaltaandtizanidine.blogspot.com
dailystrength.org dailystrength.org
derevesendeco.com damasarenai.info
darodar.com
dcj-nn.ru
decenttools.com
detalizaciya-tut.biz detalizaciya-tut.biz
detmebel.su
dev-seo.blog dev-seo.blog
dfwu1019.info digitalfaq.com
diamond-necklace.info dimaka.info
digest-project.ru
digilander.libero.it
dignitasdata.se
dikqlyremy.info
dirtpics.pw
dispo.de dispo.de
docs4all.com doctissimo.fr
dodlive.mil doyouknowtheword-flummox.ml
dojki365.online dtm-spain.com
domain.webkeyit.com dverimegapolis.ru
dominterior.org dvervmoskvu.ru
downtuptv.gq e-collantes.com
drugspowerstore.com e-kwiaciarz.pl
dscaas.website e705.net
dvrlists.com easyshoppermac.com
e-biznes.info eduinfosite.com
e-poker-2005.com egovaleo.it
edge.sharethis.com electrik-avenue.com
election.interferencer.ru electro-prom.com
elektronischezigarettekaufen1.beeplog.com electronicadirect.com
elektronischezigarettekaufen2.tumblr.com elektir.ru
elektrozigaretten1.postbit.com elektronischezigarettekaufen1.myblog.de
elitesportsadvisor.com eropornosex.ru
emediate.eu erotik0049.com
emerson-rus.ru eu-cookie-law.info
empis.magix.net europages.com.ru
energydiet24.ru expolicenciaslatam.co
enpolis.ru extremal-blog.com
eorogo.top ezaz.info
eropho.net
ertelecom.ru
essaypro.com
estibot.com
euronis-free.com
evaashop.ru
evrotekhservis.ru
exchanges-bet.com
extads.net
ezigarettenshop2.myblog.de
ezigaretteshop2.vefblog.net
f-online.de f-online.de
facecup.top falcon-images.blogspot.com
factorynightclub.com fanoboi.com
fandlr.com fanrto.com
faracontrol.ir
fashionavenuegame.com fashionavenuegame.com
fdzone.org fatfasts-4tmz.com
fickblock18.com faz99.com
fickenbumsen.net fearcrow.com
fefo.gdn
ferieboligkbh.dk
fickkontakte.org
fidelityfunding.com fidelityfunding.com
fikasound.tk fikasound.tk
filesmonster.porn filesclub.net
fillmewithhappiness.com filmania-x.ru
filmidivx.com filunika.com.ru
financetip.eu fitfloponline.store
fiuxy.com fiverr.com
fm-upgrade.ru flashahead.info
focalink.com forum-engineering.ru
forums.toucharcade.com free-fbook-traffic.com
freejabs.com freelifetimefuckbook.com
freelinkbuilding.website.tk fsakhalin.ru
freemags.cc fym.com.ru
freenode.info g.starmoe.xyz
freenom.link galaxyflowers.ru
freeseedsonline.com gamedayassist.com
frvo.alptandem.ru gameonasia.com
fun2cell.net gamerscorps.com
gagrasector.ru gavuer.ru
gambarkatabaru.com ge0ip.org
games.kolossale.ru gearsadspromo.club
gaytube.com getpopunder.com
gdcentre.ru
generic-pills-online.com
genericviagrasildenafiled.net
generousdeal-a.akamaihd.net
getmyads24.com
getyourimage.club
ghazel.ru ghazel.ru
gloverid.site glopages.ru
gnuetella.com goldenggames.com
go2mike.ru goo.ne.jp
gok-kasten.net goosefishpost.bid
gorabagrata.ru greamimgo.pw
gotcher.us greatdealshop.com
gotomontenegro.net
gpms.org.my
graphicwe.org
gribokstop.com
guardlink.org
guiadeserraazul.com guiadeserraazul.com
guitar-master.org guod.me
handicapvantoday.com gwhwpxbw.bloger.index.hr
hard-porn.mobi hacktougroup.ru
hatedriveapart.com hawaiielectriclight.com
hdimagegallery.net hchha.com
hdimagelib.com hdseriale.pl
home-task.com hdxnxxtube.mobi
honyaku.yahoofs.jp healing-dysplasia.ru
hostnow.men helvetia.com.ua
hotcore.info highland-homes.com
hoterika.com homeart.space
housekuba.org hostsshop.ru
hoverboard360.at hotchatdate.com
howtowhitenteethfast.xyz hscsscotland.com
ictizanidinehcl4mg.blogspot.com https-legalrc.biz
ideashome.id hut1.ru
iccornacircri.cf
ideibiznesa2015.ru
ie.57883.net ie.57883.net
ifmo.ru
igru-xbox.net
ilbe.club ilbe.club
img.wallpaperstock.net imgarcade.com
immobiliaremassaro.com imperia31.ru
import-sales.com import-sales.com
in-tandem.co inspiring-desperate.tk
indiakino.net int.search.mywebsearch.com
infodocsportal.com intellego.info
infokonkurs.ru iopeninghours.co.uk
infowarcraft.ru ipornox.xxx
instabid.tech irkutsk.zrus.org
int.search.tb.ask.com islandminingsupply.wordpress.com
interfucks.net ivanovo.zrus.org
ispaniya-costa-blanca.ru ivearchenceinflu.cf
ivoiretechnocom.ci j-times.ru
iwantmyfreecash.com jagg.info
iwanttodeliver.com jasonpartington.com
japan-bearings.ru jewelryandfiligree.com
jav-fetish.com johnnyhaley.top
javlibrary.cc juliaworld.net
jerseyssportsshop.com kalb.ru
jestr.org kambasoft.com
jikoman.info karachev-city.ru
jongose.ninja kareliatobacco.ru
joyceblog.top kashubadesign.ru
jurajskie.info kevblog.top
kamalsinha.com kicknights.gq
kamen-e.ru kinoduh.ru
kamorel.com kinogolos.ru
karting196.ru kollekcioner.ru
katadhin.co kozhniebolezni.com
kazinogames.lv
kazka.ru
keywesthideaways.co
keywordglobal.co.za
kino2018.cc
kinohall.ru
kinostorm.net
kletkimehan.ru
klikbonus.com
koleso24.com.ua
konkursowo-24.pl
konoplisemena.com
kostenloser-sex.com
kovrenok.ru
krasnodar.zrus.org krasnodar.zrus.org
krynica.info krassh.ru
labafydjxa.su kupiproday.com.ua
landscaping.center laxob.com
lenvred.org lechenie-gemorroya.com
lexixxx.com lesbian.xyz
lezbiyanki.net letsrepair.in
light.ifmo.ru likesuccess.com
lionking-1994.blogspot.com limads.men
littlesunraiser.com linkbuddies.com
liveinternet.ru lion.bolegapakistan.com
localmatchbook.com lion.conboy.us
lockerz.com liumimgx.pw
loginduepunti.it livesex-amateure.info
lostfilm-online.ru lizace.com
louboutinshoes.xyz ljusihus.se
lrac.info locustdesign.co
lyngdalhudterapi.no lodki-pvh.dp.ua
mac-shield.com lol-smurfs.com
mafcards.ru lonely-mature.com
mansparskats.com luciddiagnostics.in
manyresultshub-a.akamaihd.net luxmagazine.cf
martlinker.com luxup.ru
maximpartnerspr.com m.b00kmarks.com
meetlocalchicks.com m292.info
megakino.net mabdoola.blogspot.com
micasainvest.com mackeeper-center.club
microsearch.ru macresource.co.uk
mactechinfo.info
magnetic-bracelets.ru
mail.allnews24.in
makedo.ru
mall.uk
malwareremovalcenter.com
manualterap.roleforum.ru
marketingvici.com
marketland.ml
masthopehomes.com
mcadamssupplyco.com
mearns-tractors.co.uk
mediawhirl.net
medicineseasybuy.com
meendo-free-traffic.ga
memberty.com
mexicosleevegastrectomy.com
minet.club minet.club
mini-modus.ru minneapoliscopiers.com
mobicover.com.ua mnogabukaff.net
moinozhki.com mompussy.net
moivestiy.biz moneymaster.ru
moneyteam24.com montazhnic.ru
monthlywinners.com
morepoweronmac.trade
moskva.nodup.ru
mountainstream.ms mountainstream.ms
mozello.ru
mrbitsandbytes.com mrbitsandbytes.com
mrlmedia.net mturkcontent.com
mundoaberrante.com muizre.ru
musicpro.monster musicdaddy.net
mustwineblog.com muznachas-service.ru
myphotopipe.com my-bc.ru
myprintscreen.com myblogregistercm.tk
nacap.ru mydownlodablefiles.com
nakozhe.com myiptest.com
nalogovyykodeks.ru mywallpaper.top
naphukete.ru mzdish.site
navalwiki.info narosty.com
nerudlogistik.ru nastydollars.com
nevansk.ru newyorkhotelsmotels.info
norththeface.store no-rx.info
nosecret.com.ua novgorod.xrus.org
o-o-6-o-o.com nrjmobile.fr
nudejapan.net
o-o-6-o-o.ru o-o-6-o-o.ru
ochistka-stokov.ru o00.in
oddamzadarmo.eu oakleyglassesonline.us
omsk.xrus.org obiavo.com
ooo-gotovie.ru offer.camp
osagonline.ru oivcvx.website
otbelivanie-zubov.com okeinfo.online
outpersonals.com olympescort.com
oz-offers.com onemactrckr.com
paparazzistudios.com.au online-podarki.com
parfusale.se online247.ml
partner-high.men onlinemegax.com
pathwhelp.org onlywoman.org
patterntrader-en.com paccohichetoti.ml
perso.wanadoo.es panchro.xyz
php-market.ru parajumpersoutlet.online
picscout.com partner-host.men
picsfair.com pelfind.me
pigrafix.at perl.dp.ua
pijoto.net pestomou.info
pl-top.pl photostudiolightings.com
plugingeorgia.com pinsdaddy.com
plusnetwork.com pivka.xyz
podshipniki-ntn.ru pixshark.com
pornhub-ru.com pizda.lol
pornmania.pl pizza-tycoon.com
plastweb.ru
playtap.us
poiskzakona.ru
poptool.net
popugaychiki.com
porndroids.com
porno-video-chati.ru porno-video-chati.ru
pornodojd.ru
pornoelita.info
pornoklad.ru pornoklad.ru
pornonik.com pornozhara.com
pornoplen.com positive2b.ru
pornpost.in preventheadacheguide.info
pozdrawleniya.com princeadvantagesales.com
prchecker.info privatamateure.com
pricheskaonline.ru privatefx-in.ru
pricheski-video.com professionaldieselcare.com
priora-2.com proprostatit.com
produkto.net prostitutki-astana.org
promover.org prostitutki-yaroslavlya.org
prostitutki-tyumeni.org purchasepillsnorx.com
pukaporn.com
pussyspace.net pussyspace.net
qor360.com puteshestvennik.com
quality-traffic.com py100.ru
quizzitch.net qcstrtvt.bloger.index.hr
qwarckoine.com qwarckoine.com
qwesa.ru rapevideosmovies.com
real-time-analytics.com rating-bestcasino.com
realnye-otzyvy.info
rebuildermedical.com rebuildermedical.com
remont-komputerov-notebook.ru redhotfreebies.co.uk
redirlock.com
renecaovilla.online renecaovilla.online
rosbalt.com.ua resellerclub.com
sammlungfotos.online rewardpoll.com
sanidumps.com reyel1985.webnode.fr
sape.top ribieiendom.no
scanner-irvin.top rightenergysolutions.com.au
royal-investments.net
royalcar-ufa.ru
roznica.com.ua
rusenvironmental.net
rusoft-zone.ru
saitevpatorii.com
samolet.fr
sbtdesign.co.uk
scanner-josh.top
scanner-julianna.top
scanner-olga.top scanner-olga.top
scripted.com search-error.com
sei80.com searchencrypt.com
seinterface.com searchwebknow-a.akamaihd.net
semxiu.com securityallianceservices.com
seo-traffic-ranking.info semaltmedia.com
serdcenebolit.com seofirmreviewsus.info
serving.adbetclickin.pink seokicks.de
sex-foto.pw sexblog.pw
sex-watch.com sexgalleries.top
sexad.net sexy-screen-savers.com
sexobzor.info sexyali.com
sexpartygirls.net sharebutton.net
sexy.babes.frontend-stack.top shareyards.com
sexyebonyteen.com sherlock.se
sfj-ror.no shmetall.com.ua
sharebutton.to signal03.ru
shopfishing.com.ua silverage.ru
sibtest.ru sindragosa.comxa.com
sklad-24.ru sitebeam.net
skutecznetabletkinaporostwlosow.pl sivs.ru
slkrm.ru softwaretrend.net
slowmacfaster.trade soserfis.com
socas.pluto.ro spacash.com
social-s-ggg.xyz space2019.top
sophang8.com spb.ru
spasswelt.xyz
speechfoodie.com
spin2016.cf
spravka-medosmotr.ru spravka-medosmotr.ru
spywarebegone.com starwars.wikia.com
startufa.ru strangeduckfilms.com
startwp.org subj.ukr-lit.com
strongsignal-a.akamaihd.net sugarkun.com
strv.se supers.com.ua
success-seo.com susanholtphotography.com
sucsesofinspiration.com svarbit.com
svetodiodoff.ru takeflyte.com
svtrd.com taranerymagesswa.blogspot.com
swingerseiten.com techart24.com
swsociety.se telefonsexkostenlos.tk
szucs.ru terraclicks.com
t-bygg.com terrafootwear.us
t3chtonic.com thaismartloan.com
taaaak.com theporndude.com
talant-factory.ru thetardistimes.ovh
tam-gde-more.ru timer4web.com
tampabaywatch.org
taxi-v-eisk.ru
tds-advert005.info
the-usa-games.blogspot.com
thenetinfo.com
thewomenlife.com
titelhelden.eu titelhelden.eu
tizanidinedrugtest.blogspot.com tivolibasket.it
tizanidineorflexeril.blogspot.com tizanidineinfo.blogspot.com
tobeyouday.win tizanidinesideeffects.blogspot.com
topbestgames.com tjkckpytpnje.com
topsiteminecraft.com tomatis.gospartner.com
toyota.7zap.com top10-online-games.com
trafficmonetize.org topdownloads.ru
trkdf.com torrents.cd
truebeauty.cc toursmaps.com
trustedhealthtips.com tozup.com
turvgori.ru tracksz.co
tvnewsclips.info traffic-club.info
tytoona.com traffic2cash.org
uggsale.online traffic2money.com
ukrobstep.com trailer.cinemaflix.website
ukrup.com trichizobswiv.agddns.net
underthesite.com trubywriting.com
unece.org truck-land.life
unrealcommander.biz try-rx.com
ural-buldozer.ru twincitiescarservice.com
usadacha.net uac.net.au
usdx.us unmaroll.ya.ru
ussearche.cf uogonline.com
vapomnoncri.tk urldelivery.com
velpanex.ru urll.eu
video-production.com vapsy.com
vids18.site veerotech.com
vielporno.net vereo.eu
vintontech.info viel.su
vipsiterip.org vipromoffers.com
vita.com.hr vltai.com
vladimir.zrus.org vodaodessa.com
voloomoney.com voluumtrk.com
vonradio.com voronezh.xrus.org
vriel.batcave.net vostoktrade.info
vsexkontakte.net wallpaperaccess.com
vzlomsn.org wareseeker.com
vzubah.com watracker.net
webads.co.nz
webnode.me webnode.me
weburok.com webpromotion.ae
weclipart.com wedding0venues.tk
wedding-salon.net wemarketing.se
whatsappdownload10.com wesharepics.com
whipme.yopoint.in westsextube.com
wholesalecheapjerseysfree.com whatsappbot.flyland.ru
winner7777.net wholesalejerseys-cheapest.com
wiosenny-bon-1500.pl wladimirpayen.com
worldmusicfests.com wonderfulflowers.biz
wowcasinoonline.ooo wovis.site
wrona.it wsgames.ru
wttavern.com www.888.com
wufak.com www.labves.ru
xchangetrak.com www.solartek.ru
xn--80ak6aa92e.com www.wohnkabinen-shop.de
xnxx699.com wygraj-teraz.com
x-musics.com
xaijo.com
xn-----6kcaacnblni5c5bicdpcmficy.xn--p1ai
xn-----6kccaibs5cb8afhjrfmix2n.xn--p1ai
xn-----7kcabaipgeakzcss7bjdqdwpfnhv.xn--p1ai
xn----7sbbagbq7bd5aheftfllo4m.xn--p1ai
xn--24-glceagatoq7c2a6ioc.xn--p1ai
xn--80aeahghtf8ac5i.xn--p1ai
xn--d1abj0abs9d.in.ua
xtubeporno.net xtubeporno.net
xxlargepop.com xxxrus.org
xxx-cam.webcam yadro.ru
xzlive.com yellowstonevisitortours.com
youbloodyripper.com your-bearings.com
yougetsignal.com yoursite.com
youjizz.com zarabotok--doma.ru
yousense.info zatjmuzu.info
zakazfutbolki.com zeikopay.com
zakazvzloma.com zkjovpdgxivg.ga
zakon-ob-obrazovanii.ru zone-kev717.info
zaloro.com zootoplist.com
zetgie.com.pl zryydi.com
zhuravlev.info zvuker.net

478
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
00webcams.com
10bet.com 10bet.com
11235813.webzdarma.cz 12bet.com
2015god.org 178evakuator178.ru
4rent.ru 3dracergames.com
4replicawatch.net 777-club.ru
999webdesign.com
aanapa.ru aanapa.ru
adktrailmap.com
adloads.net
admanaerofoil.com
ads.tremorhub.com ads.tremorhub.com
aghanyna.com agahinameh.com
ahhjf.com agysya.ru
alldezservice.kz alert.scansafe.net
alyeskaresort.com alphaforum.ru
am15.net amazon-adsystem.com
android-systems.ru amyfoxfitness.com
anapa-inns.ru
androids-store.com
animali.deagostinipassion.it animali.deagostinipassion.it
aosexkontakte.net apiportalmorecom-a.akamaihd.net
arcteryxsale.online apispringsmartne-a.akamaihd.net
arendakvartir.kz
arquapetrarca.info arquapetrarca.info
autonew.biz atdedinotuho.tk
aversis.net ausergrubhof.info
axbocz.net australia-opening-times.com
ayodhya.co avramstroy.ru
balois.worldbreak.com avtolombard-krasnodar.ru
bambi.ck.ua azartclub.org
bank.uz babespcs.com
bavsac.com backiee.com
beauty-b0x.pl bagcionderlab.com
belstaffstore.online bannerconnect.net
bestdraws.com bestprofits-there.com
bimmerpost.com betterscooter.com
bjanshee.ru bigpictures.club
bjorkbacken.nu bikini-image.com
blog.koorg.ru bio.trade-jp.net
bluejays-jerseys.us blackwitchcraft.ru
boc.kz bluesalt.co
buehne-fuer-menschenrechte.de bnt-team.com
bus-offer.com brus.city
buy-forum.ru calvet.altervista.org
buy-meds24.com candycrushshop.com
buytizanidineonline.blogspot.com carloans.com
candlewooddentalcentre.com.au cfsrating.sonicwall.com
cartierbraceletsreplica.pw cheapmoncler.xyz
casablancamanor.co.za children-learningreading.info
cheapbarbour.online christianlouboutinshoes.xyz
ciproandtizanidine.blogspot.com citetick.com
cosmeticswomens-womensports.rhcloud.com clodo.ru
creatives.adbetclickin.pink coin-hive.com
dairyindia.in confib.ifmo.ru
decorazilla.com credit-respect.ru
derevesendeco.com czeshop.info
digitalfaq.com dailyrank.net
diusyawiga.tk decoratinghomes.ga
divku.ru delayreferat.ru
dnepr-avtospar.com.ua demian.kz
docstoc.com detskie-konstruktory.ru
domainanalyzing.xyz doublepimp.com
downvids.net dumuelave.xyz
dustyorate.com electronicadirect.com
dvd-famille.com elektrozigarette1.dreamwidth.org
dvr.biz.ua embedle.com
e-commerce-seo1.com emergencyneeds.org
ebonyporn.site empis.magix.net
ec-file.info esfchat.tk
education-cz.ru european-torches.ru
edwinkonijn.com.au exhibitionplus.eu
eets.net faithe.top
elektronischezigarettekaufen2.tumblr.com family1st.ca
erotik-kostenlos.net fanpagerobot.com
eyelike.com.ua fast-wordpress-start.com
ezaz.info fickkontakte.org
ezigaretteshop2.vefblog.net flash4fun.com
ezofest.sk forex-procto.ru
filmi-v.online formularz-konkurs.tk
financetip.eu forpostlock.ru
fitfloponline.store freelotto.com
forexunion.net fuckbuddybestgilf.info
forodvd.com funponsel.com
freenode.info futbolkisales.ru
frighteningremain.cf galaxys6manual.info
fuck-paid-share-buttons.xyz game300.ru
g33.org ghostvisitor.com
gamerextra.com gigixo.com
ge0ip.org globalscam.ga
geckoandfly.com glogow.pl
go2jump.org gloverid.site
gogalleryawesome.com gotorussia.com
golmau.host.sk gpms.org.my
gorabagrata.ru guidefs.ru
grizzlysgrill.com habermetre.com
gsmlab.pl hamacapty.com
gunsvicceadadebt.tk havepussy.com
hackers-crackers.tk hd-filmy.net
hacktougroup.ru hd720kino.ru
hdpixion.com hermesbirkinhandbagoutlets.com
herehloadibs.cf
hermesbelts.xyz
highspeed5.net highspeed5.net
hoverboard360.nl hitcpm.com
hubbble.com homeandhealth.ru
hystersister.com horoshieokna.com
iamsport.org howtowhitenteethfast.xyz
ideibiznesa2015.ru iboss.com
igru-xbox.net ico.re
images-graphics-pics.com iinstalll-fii1leis.jus0wil.pp.ua
intellektmedia.at imagefinder.site
iplogger.org interesnie-faktu.ru
iplusbit.blogspot.co.za internetartfair.com
istmira.ru iqbazar.ru
jackpotchances.com jerseychinabizwholesale.us
kit-opt.ru jofucipiku.tk
krafte.ru kadashihotel.com
kskjco.club kandidos.com
landoftracking.com karachev-city.ru
laptoper.net kartiniresto.com
kazan.zrus.org
kazrent.com
kerei.ru
klikbonus.com
kongoultry.net
kredit-blog.ru
krynica.info
kumuk.info
la-fa.ru
landinez.co
lankarns.com
laptop-4-less.com
larchik.net larchik.net
law-check-eight.xyz linkpulse.com
leboard.ru liveinternet.ro
life.biz.ua llastbuy.ru
liky.co.ua lonfon.xyz
lisque.batcave.net louboutinshoes.xyz
liverpool.gsofootball.com madot.onlinewebshop.net
longadventure.com makis.nu
macdamaged.space maladot.com
malls.com
managerpak204.weebly.com
mearns-tractors.co.uk mearns-tractors.co.uk
meccadumps.net medkritika.ru
memberty.com menetie.ru
midst.eu message-warning.net
mindeyegames.com mobstarr.com
mobilierland.com msk.afora.ru
mojpregled.com musicdaddy.net
moscow.online-podarki.com na-telefon.biz
movpod.in networkcheck.xyz
mulberryoutletonlineeu.com newstudio.tv
mypets.by next-dentists.tk
myyour.eu nfljerseysforsalewholesaler.com
nfvsz.com nibbler.silktide.com
november-lax.com nrv.co.za
offers.bycontext.com omsk.xrus.org
onetravelguides.com onlinetvseries.me
onlinedomains.ru onlywoman.org
ooo-olni.ru optitrade24.com
outpersonals.com orion-code-access.net
oxotl.com ourtherapy.ru
p-business.ru paintingplanet.ru
paceform.com paleohub.info
paperwritingservice17.blogspot.ru partner-pop.men
partner-high.men pechikamini.ru
pawli.eu petrovka-online.com
paydayloanslocal.com pivka.xyz
phobia.us pixgood.com
pillscheap24h.com pony-business.com
pix24x7.com porno.simple-image.com.ua
pizdopletka.club pornolook.net
plastgranar.nu pravoholding.ru
plastjulgranar.se
plastweb.ru
ploenjitmedia.azurewebsites.net
pod-muzyku.club
podshipniki-ntn.ru
posible.net
pr-ten.de
pricheski-video.com
prize44.com prize44.com
prodvigator.ua proekt-gaz.ru
prohoster.info projefrio.com.br
pron.pro pronorm.fr
prostitutki-yaroslavlya.org puserving.com
rangjued.com rapidokbrain.com
rednise.com realting-moscow.ru
relax.ru rebelmouse.com
rent2spb.ru recipedays.ru
research.ifmo.ru replicaclub.ru
responsinator.com rockingclicks.com
saitevpatorii.com rvi.biz
savememoney.co.za rybalka-opt.ru
scanner-marwin.top scansafe.net
scanner-nelson.top se.bnt-team.com
scottbywater.com segol.tv
screpy.com
selectads.men selectads.men
sergiorossistore.online seo18.su
serving.adbetclickin.pink seocheckupx.com
sexpartygirls.net seofied.com
shama-rc.net sex-tracker.com
shlyahten.ru sharpchallenge.com
si-unique.com shopfishing.com.ua
silktide.com
simpoed.ufop.br
sims-sims.ru
site-auditor.online
site3.free-share-buttons.com
siteripz.net
skatestick.bid skatestick.bid
snegozaderzhatel.ru slim.sellany.ru
snomer1.ru smstraf.ru
solution4u.com softomix.net
sonnikforme.ru soserfis.com
spb.ru spammen.de
squidoo.com staticfs.host
standardchartered-forex.com stpolice.com
stpicks.com styro.ru
stromerrealty.com success-seo.com
surintech.ac.th szucs.ru
swinon.site thegameriders.com
swsociety.se tilido.com
tampabaywatch.org tongkatmadura.info
teencastingporn.com top10-online-games.com
teenforporn.com topquality.cf
thenetinfo.com totu.us
tizanidine6mg.blogspot.com twincitiescarservice.com
tizanidinecost.blogspot.com univerfiles.com
tizanidineinfo.blogspot.com uptime-as.net
tizanidinerecreationaluse.blogspot.com urdoot.win
top1-seo-service.com usacasino.com
torrnada.ru ventelnos.com
tourcroatia.co.uk vesnatehno.ru
tozup.com via-energy-acquistare.com
tradedeals.biz videochat.bz
traffictrade.life videonsk.com
trahvid.com visa-pasport.ru
trubywriting.com vykup-avto-krasnodar.ru
tvteleport.ru watchmyfb.pl
twiclub.in website-datenbank.de
unrealcommander.org welcomeauto.ru
urlopener.com wemarketing.se
validdomain.xyz westen-z.life
vereo.eu wnhjavlhezp.gq
videochat.life woman-h.ru
viteonlusarezzo.it wowcasinoonline.ooo
vltai.com www.ehscloud.cn
vonradio.com www.timer4web.com
vsexkontakte.net x-true.info
vysigy.su xaijo.com
wait3sec.org xfluro.com
weddingdresses.xyz xn----7sbbagbq7bd5aheftfllo4m.xn--p1ai
whereiskentoday.com xn----9sbebi2bvzr7h.xn--p1ai
wholesalejerseychinaoutlet.com xn--h1ahbi.com.ua
wildcattube.com xn--lifehacer-1rb.com
xn--hxazdsfy.blogspot.com xn--q1a.xn--b1aube0e.xn--c1acygb.xn--p1ai
yeartwit.com xuki.us
zeroredirect10.com xxx-cam.webcam
zolotoy-lis.ru xxxrus.org
zoogdiesney.com xxxsiterips.xyz
zrelaya.pw xxxtubesafari.com
zscalerone.net youporn-forum.ga
yoursite.com
zastenchivosti.net
zdesoboi.com
zetgie.com.pl
znakomstvaonlain.ru
zrus.org
zskdla.site

10
dev-tools/test_units/ratelimittest-master.txt
View file

@ -581,4 +581,14 @@
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html> </html>

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.117 0; 10.1.0.141 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2021.11.2729 ### Version: V4.2021.11.2730
### Updated: Sun Nov 21 22:01:09 UTC 2021 ### Updated: Mon Nov 22 10:03:24 UTC 2021
### Bad Bot Count: 627 ### Bad Bot Count: 627
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2021.11.2729 ### Version: V4.2021.11.2730
### Updated: Sun Nov 21 22:01:09 UTC 2021 ### Updated: Mon Nov 22 10:03:24 UTC 2021
### Bad Bot Count: 627 ### Bad Bot Count: 627
################################################### ###################################################
### Version Information ## ### Version Information ##