vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-03 19:20:16 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2022.10.3433 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2022-10-26 10:09:13 +00:00
parent ce41c461af
commit 4b7ab30865
47 changed files with 102427 additions and 102437 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.10.3432 #### Version: V4.2022.10.3433
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.10.3432 #### Version: V4.2022.10.3433
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -14,7 +14,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2022.10.3432 #### Version: V4.2022.10.3433
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

12666
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2022.10.3432 #### Version: V4.2022.10.3433
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

12670
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

12670
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

12670
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

12670
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.23 1; 10.1.1.19 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.23 0; 10.1.1.19 0;
127.0.0.1 0; 127.0.0.1 0;

12670
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.23 1; 10.1.1.19 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.23 0; 10.1.1.19 0;
127.0.0.1 0; 127.0.0.1 0;

12670
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.23 1; 10.1.1.19 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.23 0; 10.1.1.19 0;
127.0.0.1 0; 127.0.0.1 0;

12670
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
3432 3433

12670
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

12670
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
4.246.203.252 0; 20.232.213.249 0;

12670
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.23 1; 10.1.1.19 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.23 0; 10.1.1.19 0;
127.0.0.1 0; 127.0.0.1 0;

12670
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.23 1; 10.1.1.19 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.23 0; 10.1.1.19 0;
127.0.0.1 0; 127.0.0.1 0;

12670
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.23 1; 10.1.1.19 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.23 0; 10.1.1.19 0;
127.0.0.1 0; 127.0.0.1 0;

12670
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
4.246.203.252 0; 20.232.213.249 0;

12670
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
4.246.203.252 0; 20.232.213.249 0;

12670
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.23 1; 10.1.1.19 1;
127.0.0.1 1; 127.0.0.1 1;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
Acunetix 80legs
BDFetch Buddy
CherryPicker DomainAppender
IndeedBot Foobot
MTRobot Rogerbot
NPbot URLy.Warning
Re-re Virusdie
SiteExplorer WEBDAV
seobility WebCollage
x09Mozilla probe-image-size

322
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
80legs 360Spider
AIBOT
ASPSeek
Abonti
Aboundexbot Aboundexbot
Acunetix Acunetix
Aipbot AiHitBot
Alexibot
AllSubmitter AllSubmitter
AlphaBot
Anarchy99 Anarchy99
Anthill Anthill
Aspiegel Apexoo
Asterias AwarioRssBot
Attach AwarioSmartBot
BBBike BDFetch
BDCbot
BackStreet
BackWeb
Backlink-Ceck Backlink-Ceck
Badass Barkrowler
Bandit BetaBot
Bigfoot
Bitacle Bitacle
Black Hole BlackWidow
Blackboard Blackboard
Blow BlowFish
Brandprotect BotALot
Brandwatch Brandwatch
Buddy Buck
BuiltBotTough BuiltWith
Bullseye
BuzzSumo
CATExplorador CATExplorador
CCBot CCBot
CSHttp CODE87
Cegbfeieh CensysInspect
CherryPicker CheTeam
CheeseBot
ChinaClaw ChinaClaw
Chlooe Chlooe
Citoid Cliqzbot
Cocolyzebot Copyscape
Copier
Cosmos Cosmos
Crawling at Home Project Craftbot
Crescent CrazyWebCrawler
Curious
Custo
CyotekWebCopy
DBLBot
DIIbot
DSearch
DatabaseDriverMysqli
Deusu Deusu
Devil Digincore
Disco DigitalPebble
Discoverybot Discoverybot
DittoSpyder DnBCrawler-Analytics
Drip DomCopBot
DomainAppender
Dotbot
ECCP/1.0 ECCP/1.0
EMail Siphon EasyDL
Ebingbong Ecxi
EirGrabber
EroCrawler
Evil
ExtLinksBot
Extractor
ExtractorPro ExtractorPro
Extreme Picture Finder Extreme Picture Finder
Flunky Ezooms
FDM
FemtosearchBot
Firefox/7.0
FlashGet
Foobot Foobot
Fuzz Freeuploader
FyberSpider FyberSpider
Fyrebot Fyrebot
GT::WWW GT::WWW
GalaxyBot
GermCrawler GermCrawler
GetWeb GetWeb
Go-Ahead-Got-It Getintent
Gotit Gigabot
GoZilla
GrabNet GrabNet
Grafula Grafula
GrapeshotCrawler GrapeshotCrawler
GridBot GridBot
HEADMasterSEO
HTTP::Lite HTTP::Lite
Heritrix Haansoft
HybridBot Harvest
Havij
HonoluluBot
Image Fetch
Image Sucker
IndeedBot IndeedBot
Indy Library Indy Library
Iskanie InfoNaviRobot
InfoTekies
InterGET
Internet Ninja
InternetSeer
IstellaBot IstellaBot
Jetty JOC Web Spider
Jorgee JetCar
JustView
Kenjin Spider
Keyword Density Keyword Density
Kinza
Lanshanbot Lanshanbot
Leap Larbin
LexiBot LeechGet
Lftp Lftp
LibWeb LibWeb
Libwhisker
LieBaoFast LieBaoFast
Likse Lightspeedsystems
LinkpadBot LinkScan
LinqiaScrapeBot LinkWalker
Linkbot
Lipperhey Lipperhey
MIDown tool Lipperhey Spider
Lmspider
MFC_Tear_Sample
MIIxpc MIIxpc
MQQBrowser
MSFrontPage MSFrontPage
MSIECrawler MTRobot
Mag-Net
Magnet Magnet
Majestic SEO Mail.RU_Bot
Majestic12 Majestic-SEO
Mass Downloader MarkMonitor
Masscan Mata Hari
MauiBot
MeanPath Bot
Meanpathbot
MicroMessenger MicroMessenger
Microsoft Data Access Mister PiX
Mojeek
Morfeus Fucking Scanner Morfeus Fucking Scanner
Mr.4x3 Mozlila
Musobot Msrabot
Name Intelligence NICErsPRO
Net Vampire Nameprotect
NetAnts Needle
NetLyzer NetLyzer
NetZIP Nettrack
NextGenSearchBot NextGenSearchBot
Nibbler Nikto
NimbleCrawler
Nmap
Not
Nuclei Nuclei
Octopus Nutch
Offline Explorer Offline Navigator
OpenVAS OnCrawl
OutclicksBot Openfind
OutfoxBot Openvas
PECL::HTTP OrangeBot
PHPCrawl OrangeSpider
POE-Component-Client-HTTP POE-Component-Client-HTTP
PageGrabber Page Analyzer
Pandalytics PageAnalyzer
Panscient
Pavuk
Petalbot
Pi-Monster
Picsearch
Piepmatz Piepmatz
PleaseCrawl PleaseCrawl
ProPowerBot ProPowerBot
ProWebWalker ProWebWalker
Probethenet Probethenet
PxBroker RankActiveLinkBot
RankActive RankingBot
RankFlex
RankingBot2 RankingBot2
Rankivabot Re-re
RealDownload Reaper
RebelMouse
Recorder
RepoMonkey
Ripper
SBIder
SEOkicks
SEOkicks-Robot SEOkicks-Robot
SEOprofiler SEOstats
SISTRIX SalesIntelligent
SMTBot
ScoutJet ScoutJet
Scrapy Scrapy
ScreenerBot Screaming
Searchestate ScrepyBot
SearchmetricsBot
SemanticJuice SemanticJuice
Semrush Semrush
SentiBot SeoSiteCheckup
Seomoz
Siphon
SiteSnagger
Sitebeam Sitebeam
SlySearch Sottopop
Snapbot Spammen
Snoopy Sqlmap
Sosospider Sqworm
SpaceBison Steeler
SpankBot Sucuri
Spanner
SputnikBot
Sqlworm
Stripper
SuperBot SuperBot
SuperHTTP SuperHTTP
SurveyBot Surfbot
Swiftbot
T0PHackTeam T0PHackTeam
T8Abot T8Abot
Telesphoreo TeleportPro
Telesphorep The Intraformant
TheNomad
Thumbor Thumbor
TightTwatBot Titan
Typhoeus Toata
Tracemyfile
Trendictionbot
TurnitinBot
Twice
URLy Warning URLy Warning
VB Project URLy.Warning
VCI VelenPublicWebCrawler
VidibleScraper
WEBDAV WEBDAV
WISENutbot WWW-Mechanize
WPScan
WWW-Collector-E
WWW::Mechanize WWW::Mechanize
Wallpapers Wallpapers/3.0
Web Auto WeSEE
Web Pix Web Sauger
WebBandit WebAuto
WebCollage
WebFuck WebFuck
WebGo IS WebGo IS
WebStripper WebSauger
Webshag
Website Quester
WebsiteExtractor WebsiteExtractor
WebsiteQuester WebsiteQuester
Webster Whacker
Who.is Bot Who.is Bot
WinHTTrack Widow
Woobot
Wotbox Wotbox
Xaldon_WebSpider Xaldon_WebSpider
Xenu YoudaoBot
Zermelo Zeus
ZmEu
ZoomBot ZoomBot
arquivo.pt ZumBot
cah.io.community archive.org_bot
check1.exe arquivo-web-crawler
clark-crawler backlink-check
coccocbot coccocbot
dataforseo.com crawler4j
eCatch eCatch
facebookscraper gopher
heritrix heritrix
instabid instabid
iubenda-radar ips-agent
linkdexbot
lwp-request lwp-request
magpie-crawler lwp-trivial
meanpathbot
mediawords
page scorer page scorer
pcBrowser
probe-image-size probe-image-size
ripz
s1z.ru
satoristudio.net satoristudio.net
scan.lol scalaj-http
seobility
seocompany.store
serpstatbot serpstatbot
sexsearcher sexsearcher
sitechecker.pro
siteripz
sp_auditbot sp_auditbot
trendiction.com sysscan
tAkeOut
ubermetrics-technologies.com ubermetrics-technologies.com
webmeup-crawler voyagerx.com
x09Mozilla webgains-bot
x22Mozilla webprosbot
xpymep1.exe
zauba.io
zgrab zgrab

318
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
01h4x.com 01h4x.com
360Spider 360Spider
ALittle Client 404enemy
Abonti ADmantX
AhrefsBot AIBOT
Aipbot ASPSeek
Alexibot Aboundex
AiHitBot
Alligator
AlphaBot AlphaBot
Anarchy Asterias
Atomseobot AwarioRssBot
AwarioSmartBot
BBBike
BDFetch
BLEXBot BLEXBot
BackStreet BackStreet
BackWeb BackWeb
BacklinkCrawler
Bandit
Barkrowler Barkrowler
BatchFTP Battleztar Bazinga
Bigfoot
Bitacle
Black Hole Black Hole
BlackWidow BlackWidow
Blow Blackboard
BlowFish BlowFish
BotALot Bolt
BuiltWith Buck
Buddy
Bullseye
BunnySlippers
BuzzSumo
CATExplorador CATExplorador
CCBot CODE87
CazoodleBot Calculon
Cegbfeieh
CensysInspect CensysInspect
CheTeam CheTeam
CheeseBot
Citoid Citoid
Claritybot
Cloud mapping Cloud mapping
Collector Cocolyzebot
Copier Copier
Copyscape CopyRightCheck
Cosmos Crawling at Home Project
Craftbot CrazyWebCrawler
CrunchBot
Curious Curious
Custo
CyotekWebCopy CyotekWebCopy
DBLBot DIIbot
DTS Agent DTS Agent
DatabaseDriverMysqli DatabaseDriverMysqli
Demon Dirbuster
DigitalPebble Discobot
Disco Discoverybot
Dispatch Dispatch
DittoSpyder DittoSpyder
DnyzBot DnBCrawler-Analytics
DomainSigmaCrawler DomainStatsBot
Dotbot Domains Project
Dragonfly Download Wonder
Drip
ECCP/1.0 ECCP/1.0
EMail Wolf EMail Wolf
Ebingbong ExtLinksBot
Ecxi Extractor
EirGrabber
EroCrawler
Evil
Exabot
Express WebPictures
EyeNetIE
Ezooms Ezooms
Fimap FHscan
Freeuploader
FrontPage FrontPage
Fuzz Genieo
FyberSpider GetRight
Fyrebot
G-i-g-a-b-o-t
GT::WWW
Getintent
Gigabot
GoZilla GoZilla
GrabNet
Grabber Grabber
Grafula GrapeFX
HEADMasterSEO GridBot
HMView HTMLparser
HTTrack HTTP::Lite
HaosouSpider HaosouSpider
Harvest Heritrix
HonoluluBot Humanlinks
IDBTE4M IDBTE4M
IDBot
IRLbot IRLbot
Id-search
IlseBot IlseBot
Indy Library Image Sucker
Intelliseek InfoNaviRobot
Iria Iria
IstellaBot Iskanie
JOC Web Spider JamesBOT
JennyBot Jorgee
JetCar Kenjin Spider
Jetty Keybot Translation-Search-Machine
Keyword Density Kozmosbot
LNSpiderguy LNSpiderguy
LWP::Simple
Lanshanbot Lanshanbot
Larbin
Leap
Lftp
LibWeb
LieBaoFast LieBaoFast
LinqiaMetadataDownloaderBot Likse
Lipperhey Spider LinkextractorPro
Litemage_walker Lipperhey
MFC_Tear_Sample
MIIxpc MIIxpc
MJ12bot MQQBrowser
MSFrontPage
MSIECrawler
MTRobot
Magnet Magnet
Mail.RU_Bot Mail.RU_Bot
Majestic-SEO
Majestic12
MarkWatch
Mass Downloader Mass Downloader
Masscan Masscan
MeanPath Bot Mata Hari
Mediatoolkitbot Mediatoolkitbot
Microsoft URL Control MegaIndex.ru
Minefield MicroMessenger
Mojeek Microsoft Data Access
Mojolicious MolokaiBot
Morfeus Fucking Scanner Msrabot
Mozlila Nameprotect
Nessus Needle
NetMechanic Net Vampire
NetZIP NetAnts
NextGenSearchBot Netcraft
Nettrack
Nibbler Nibbler
Nikto Niki-bot
NimbleCrawler
Nimbostratus
Ninja
Nmap Nmap
Not Not
Nuclei Octopus
Offline Navigator
OnCrawl
OpenVAS OpenVAS
OrangeBot
OutclicksBot OutclicksBot
PECL::HTTP PHPCrawl
POE-Component-Client-HTTP
Page Analyzer Page Analyzer
PageAnalyzer PageScorer
PageGrabber Papa Foto
PeoplePal PeoplePal
Petalbot Pi-Monster
PleaseCrawl PictureFinder
Probethenet Pixray
Pu_iN Pu_iN
PxBroker Pump
QueryN Metasearch QueryN Metasearch
Quick-Crawler
RankActiveLinkBot RankActiveLinkBot
RankFlex
RankingBot
RankingBot2 RankingBot2
Re-re RealDownload
ReGet RedesScrapy
RebelMouse
Recorder
RepoMonkey RepoMonkey
Ripper RocketCrawler
SBIder Rogerbot
SEOkicks-Robot
SEOlyticsCrawler SEOlyticsCrawler
SEOstats
SISTRIX SISTRIX
SMTBot
SalesIntelligent
ScanAlert ScanAlert
ScoutJet Scrapy
Searchestate Seekport
SearchmetricsBot Semrush
SeoSiteCheckup SeoSiteCheckup
SeobilityBot SeobilityBot
Siphon Siphon
SiteExplorer Site Sucker
SiteLockSpider Sitebeam
Sitevigil
SlySearch SlySearch
SpaceBison SmartDownload
Spanner Snake
Spbot Snoopy
Sociscraper
Sosospider
Spinn3r
Sucker
Sucuri Sucuri
SuperHTTP SuperHTTP
SurveyBot
Suzuran Suzuran
Swiftbot Swiftbot
Szukacz Szukacz
T0PHackTeam T8Abot
Teleport TeleportPro
Telesoft Telesphorep
TheNomad TheNomad
Tracemyfile Thumbor
Trendiction Trendiction
True_Robot True_Robot
Turingos
TwengaBot
Twice Twice
Typhoeus
URLy Warning URLy Warning
URLy.Warning VB Project
Upflow Vacuum
VCI Vagabondo
Voltron VelenPublicWebCrawler
VeriCiteCrawler
VidibleScraper
WASALive-Bot WASALive-Bot
WWW-Collector-E WPScan
WeSEE WWW-Mechanize
Web Auto Web Auto
Web Fetch
Web Fuck
Web Sucker
WebCopier WebCopier
WebPix WebLeacher
WebReaper
WebStripper
WebZIP
Webalta Webalta
Webshag
WebsiteExtractor
WebsiteQuester WebsiteQuester
Webster
Whacker Whacker
Whatweb WinHTTrack
Who.is Bot WiseGuys Robot
Wonderbot
Wprecon
Xaldon WebSpider
Xaldon_WebSpider Xaldon_WebSpider
Zauba YoudaoBot
Zade
Zermelo
ZmEu ZmEu
ZoomBot
ZoominfoBot
ZyBorg
adscanner adscanner
archive.org_bot archive.org_bot
arquivo-web-crawler arquivo.pt
cah.io.community autoemailspider
com.plumanalytics backlink-check
crawl.sogou.com check1.exe
crawler.feedback clark-crawler
domainsproject.org cognitiveseo
ips-agent crawler4j
iubenda-radar eCatch
evc-batch
instabid
internetVista monitor
linkdexbot linkdexbot
lwp-request lwp-request
magpie-crawler
muhstik-scan muhstik-scan
netEstate NE Crawler netEstate NE Crawler
oBot oBot
page scorer
pcBrowser
probe-image-size
ripz
s1z.ru s1z.ru
scalaj-http
scan.lol scan.lol
seocompany.store
seoscanners
seostar seostar
sexsearcher trendiction.com
sitechecker.pro
sogouspider
sp_auditbot
tAkeOut
ubermetrics-technologies.com ubermetrics-technologies.com
webgains-bot webmeup-crawler
webprosbot webprosbot
x09Mozilla zauba.io
xpymep1.exe zgrab

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
bitcoinremote.com club-musics.ru
calvet.altervista.org custodieva.ru
goo.ne.jp dafatiri.com
hidemyass.com donna7753191.ru
honyaku.yahoofs.jp iwantmyfreecash.com
ifmo.ru misterjtbarbers.com
rainbowice.ru rebelmouse.com
sanatorrii.ru slavkokacunko.de
trafficreceiver.club telegraf.by
woman-orgasm.ru xn----8sblgmbj1a1bk8l.xn----161-4vemb6cjl7anbaea3afninj.xn--p1ai

922
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
0c47f8422d3f.com 007angels.com
1000n1.ru 100searchengines.com
10bet.com 108shot.com
123movies.love 1314dh.com
2000k.ru 1j7740kd.website
2daytrendingnews.com 5-steps-to-start-business.com
2itech.ru 5000-cotydzien.com
2kata.ru 5kstore.com
2nt.ru 5tey7463.weebly.com
3w24.com 7wind.ru
5i2.net 883zy.com
7fon.ru 999webdesign.com
7search.com a.pr-cy.ru
a96527gi.beget.tech aa8b68101d388c446389283820863176e7.com
aa08daf7e13b6345e09e92f771507fa5f4.com abcdeg.xyz
aa9bd78f328a6a41279d0fad0a88df1901.com abcguru.xyz
actionnooz.com absolutelyanalog.com
adnotbad.com addray.pro
adrenalin-stk.ru admeasures.com
adserver-e7.com adminshop.com
adservme.com adultfriendfinder.com
adtech.de adultgalls.com
affrh2015.com advancedcleaner.com
aghanyna.com adventureparkcostarica.com
akita.kz agadelha.com.br
alborzan.com akama.com
albuteroli.com allornamenti.com
alfabot.xyz alta-realestate.com
allesohnegirls.net amateurgalls.com
allforminecraft.ru amigobulls.com
amateurmatch.com amyfoxfitness.com
amospalla.es anapa-inns.ru
anal-acrobats.com android4fun.org
android-vsem.org
anonymizeme.pro
ap.senai.br ap.senai.br
apartment.ru apartamentwroclaw.eu
apelsinnik.website
apibrowsesmartne-a.akamaihd.net
apiholdingmypage-a.akamaihd.net apiholdingmypage-a.akamaihd.net
arcadepages.com apple.com-webbrowsing-security.science
arendovalka.xyz arenda-avtoprokat-krasnodar.ru
arius.tech arkkivoltti.net
asseenontvonline.ru astana.xxxkaz.org
aucoinhomes.com autoplate.info
ausergrubhof.info availit.weebly.com
autotrends.today
aversis.net
aviav.org
aviav.ru aviav.ru
avitocars.ru
avon-severozapad.ru avon-severozapad.ru
avtocredit-legko.ru avtolombard-krasnodar.ru
ayanaspa.com
azartmix.com
azbukadiets.ru
azbukafree.com azbukafree.com
b-styles.xyz backiee.com
bagcionderlab.com bagcionderlab.com
baixar-musicas-gratis.com baixar-musicas-gratis.com
balook.com bashtime.ru
baoxaydung.com.vn best-deals-products.com
beauty-bracelet.com best-seo-offer.com
best-coupon-offer.com best-seo-software.xyz
betonka.pro best-seo-solution.com
bg6s0.com bestofferswalkmydogouteveryday.gq
bin-brokers.com besttorrentknifta.weebly.com
binomo.kz beta.hotkeys.com
bird1.ru betteroffers.review
bizlist.com.de bget.ru
blog.koreadaily.com bioca.org
bloke.com bioinnovate.co
bnt-team.com bjgugu.net.ua
board.f00d.de blog.koorg.ru
blogos.kz
bolezniorganov.ru bolezniorganov.ru
bombla.org
bonanza-fortune.men bonanza-fortune.men
bookmaker-bet.com bongacams.com
brateg.xyz braip.com.br
bristolhostel.com brandehk.dk
brokergid.ru brewdom.ru
brus.city briomotor.co
bugof.gq buy-cheap-pills-order-online.com
burkesales.com buy-meds24.com
buyessay3.blogspot.ru buyclomidonlaine.com
bycontext.com buyhoverboard.com
c1.onedmp.com bzero1jewelry.net
calcularpagerank.com callejondelpozo.es
calvet.altervista.org carloans.com
candytiner.com cartierlovebraceletreplica.xyz
canrole.com cartierlovestore.com
carabela.com.do cartiertrinity.xyz
cashkitten-a.akamaihd.net casinos4dummies.co.uk
catalogs-parts.com ccjp.eu
centre-indigo.org.ua cdnanalytics.xyz
centrumcoachingu.com celebsopics.com
certifywebsite.win celejihad.info
chatseo.com
cheapcigarettesc.info cheapcigarettesc.info
cheapsergiorossi.online check-host.net
chiblackhawks-jerseys.com
chidporn.com chidporn.com
chinacheapelitejerseys.com chinese-amezon.com
chinaelitecheapjerseys.com cjs.com.ru
ciproandtizanidine.blogspot.com clickbanksites.info
civilwartheater.com clickprotects.com
clayvasedesigns.tk clicksor.net
cleanersoft.com
clickso.com
club-musics.ru
cmd.kz cmd.kz
coin-hive.com compliance-jane.top
colobit.biz compliance-josh.top
compliance-barak.xyz comsysnet.com
compliance-ivan.xyz construmac.com.mx
connectingsingles.com coolyarddecorations.com
coolgramgoods.com copypaste.traderzplanet.in
crazyprotocol.com cornomase.win
crd.clan.su counterbot.com
countercrazy.com
covadhosting.biz
credit-respect.ru credit-respect.ru
creditmoney.com.ua creditmoney.com.ua
cubs-jerseys.us creditwell.ru
cutalltheshit.com customcatchcan.com
destinationrealestate.com cutt.us
d0t.ru
danceuniverse.ru
darodar.com
dating-time-now.com
dear-diary.ru
dekoration.us
dellalimov.com
dengi-pod-zalog-nedvizhimosti.ru
detsky-nabytek.info
dikqlyremy.info
discountbarbour.online
dispo.de
disruptingdinnerparties.com
divatraffic.com divatraffic.com
dnsrsearch.com diy-handmade-ideas.com
dogbreedspicture.net dkvorota.ru
dokumentalkino.net domaincdn.xyz
domainanalyzing.xyz domination.ml
dprtb.com domznaniy.ru
drugstoreforyou.com download-wallpaper.net
e-commerce-seo1.com downloaddy.net
ebonyporn.site downloadkakaotalk.com
drugs-no-rx.info
dverimegapolis.ru
eandsgallery.com
eaplay.ru
earncash.com.ua
ed-shop01.ru
edudocs.net
election.interferencer.ru election.interferencer.ru
electrik-avenue.com elektrischezigarette1.blog.pl
eleimgo.pw eloxal.ru
elektrischeziga.livejournal.com encodable.com
elektrischezigarette2.devhub.com enhand.se
elektrischezigarettekaufen2.cowblog.fr erectile.bid
elektrozigarettekaufen2.blogse.nl esopini.com
elitedollars.com europeanwatches.ru
englishdictionaryfree.com event-tracking.com
epicbrogaming.com f00kclan.de
ertelecom.ru facecup.top
evehemming.blogspot.com.au fandlr.com
everypony.ru fearcrow.com
evogarage.com feeriaclub.ru
exchanges-bet.com felizporno.com
executehosting.com fickenprivat.info
exportshop.us fickkontakte.org
f-loaded.de fikasound.tk
fable.in.ua filesclub.net
failingmarriege.blogspot.com filmbokep69.com
faptitans.com flagcounter.me
faz99.com folowsite.com
fbdownloader.com fordsonmajbor.cf
fickenbumsen.net forpackningsutveckling.se
filesmonster.porn forzeronly.com
filmetricsasia.com foxweber.com
findclan.org fr.netlog.com
firesub.pl frankofficial.ru
fivedwld.cf free-social-buttons.xyz
floridahuntingfishingadventures.com freewebs.com
forensicpsychiatry.ru front.to
forex21.ru fuckbuddybestgilf.info
fototravel.eu fxtips.ru
fyl.com.ru gagrasector.ru
gamerextra.com game300.ru
gamezblox.com gaygalls.net
gay-file.com gaypornmovie.net
gdzkurokam.ru gazporno.com
ge0ip.org
gearcraft.us gearcraft.us
get-free-social-traffic.com geckoandfly.com
get-free-traffic-now.com genericlowlatencyasiodriverhq.aircus.com
getaclueamerica.com gifspics.com
getyourimage.club gilbertbanda.net
gheus.altervista.org gogalleryawesome.com
gok-kasten.net
golfresa.lucania.se
gonextmedia.com gonextmedia.com
googst2.ru goo.ne.jp
gotorussia.com graphics8.info
gov.yanao.ru gstatey.net
gq-catalog.gq gta-top.ru
gratis-sexkontakte.com gwebtools.com
gribkovye-zabolevaniya.com
growboxbl.ru
guod.me
gwebtools.com.br gwebtools.com.br
gz2.bbsoldes.fr hanink.biz.ly
habermetre.com hao123.com
handicapvansarea.com hccoder.info
hanwei.us hdfreeporno.net
happy.new.yeartwit.com helicalpile.us
hatdc.org hermesbirkinhandbagoutlets.com
hdimagelib.com
hem.passagen.se
hidemyass.com hidemyass.com
histats.com histats.com
hjaoopoa.top horoshieokna.com
houseofgaga.ru hotenergy.ru
humanelydrew.com house.sieraddns.com
i-midias.net.br hptwaakw.blog.fc2.com
ibb.com.ua humbmosquina.tk
iblogpress.xyz husky-shop.cz
icaseclub.ru iccornacircri.cf
iklysha.ml igithab.com
ilikevitaly.com ihc2015.info
ilovevitaly.com ilbe.club
imadedinner.net imadedinner.net
imguramx.pw infospot.pt
immobiliaremassaro.com insider.pro
inbabes.sexushost.com internetproviderstucson.com
innoslicon.com irkutsk.online-podarki.com
instabid.tech
intellekt21.ru
inzn.ru
iopeninghours.co.uk
iphantom.com
isistaylorporn.info
islamtoday.co.za islamtoday.co.za
islandminingsupply.wordpress.com ix20.ru
isoveti.ru
ivanovo.zrus.org
j-times.ru
janettabridal.com janettabridal.com
javidol.site jasonpartington.com
jerseyswholesalechinalimited.com javxxx18.com
jobmarket.com.ua jerseywholesalechinabiz.com
johnnyhaley.top jillepille.com
junketjuice.blogspot.com jyvopys.com
justbcause.com kandidos.com
kalb.ru kartiniresto.com
kazinogames.lv kazan.xrus.org
keywesthideaways.co kazan.zrus.org
keywordsuggest.org keenoutlet.online
keywordsuggests.com keywordhouse.com
kinoduh.ru kino-rating.ru
kinozapas.org kinobest.pl
kndxbkdx.bloger.index.hr krasivye-devushki.net
knogg.net kumuk.info
kochanelli.com kupit-adenu.ru
kometars.xyz kurwa.win
kosynka-games.ru laptoper.net
koversite.info larger.io
krassh.ru larutti.ru
lawyers.cafe law-check-nine.xyz
lazymanyoga.com
leadn.pl leadn.pl
lechenie-gemorroya.com lechtaczka.net
legionalpha.com
letsart.ru letsart.ru
linksharingt.com lexixxx.com
liupis.com littleberry.ru
livejasmin.com littlecity.ch
llastbuy.ru livefixer.com
lob.com.ru loadingpages.me
lombia.co lombia.com
lost-alpha.ru lomza.info
lulea-auktionsverk.se low-format.ru
luchshie-topcasino.ru
m.b00kmarks.com m.b00kmarks.com
macdamaged.tech m292.info
makis.nu magicalfind-a.akamaihd.net
maxthon.com mamasuper.prom.ua
medicovi.com map028.com
medispainstitute.com.au marcoislandvacations.net
medizinreisen.de maslenka.kz
medtherapy.ru matchpal-a.akamaihd.net
menhealed.net mcnamaratech.com
message-warning.net me-ke.com
michellblog.online medicineseasybuy.com
militarysale.pro mega-bony-2017.pl
minneapoliscopiers.com mega-polis.biz.ua
misterjtbarbers.com mezaruk.info
mobilemedia.md michaelkorssaleoutletonline.net
mojowhois.com mikozstop.com
mindeyegames.com
mini.7zap.com
miniads.ca
mir-betting.ru
mir-limuzinov.ru
mjchamonix.org
moetomnenie.com
moivestiy.biz
monarhs.info
monclerjacketsoutlet.pw
monclervests.xyz monclervests.xyz
moneyteam24.com morocco-nomad-excursions.com
moonci.ru moscow.online-podarki.com
morf.snn.gr mosrif.ru
mrbojikobi4.biz motherboard.vice.com
moyaterapiya.ru
mp3films.ru
mttwtrack.com
mundoaberrante.com mundoaberrante.com
music7s.me musicktab.com
myftpupload.com mygameplus.ru
mymobilemoneypages.com myindospace.com
myperiod.club
mzdish.site
nailsimg.com
needtosellmyhousefast.com needtosellmyhousefast.com
neodownload.webcam negociosdasha.com
netvouz.com nerudlogistik.ru
news-readers.ru netcheckcdn.xyz
newyorkhotelsmotels.info netoil.no
nextbackgroundcheck.gq newsperuse.com
nfljerseys.online nicovideo.jp
noclegonline.info njpalletremoval.com
normalegal.ru nmrk.ru
nrv.co.za nofreezingmac.click
nuker.com novatech.vn
o00.in npoet.ru
obsessionphrases.com nw-servis.ru
oecnhs.info o-o-6-o-o.com
of-ireland.info obiavo.uz
offf.info odesproperty.com
ok-ua.info ofanda.com
ok.ru offergroup.info
okmedia.sk omsk.xrus.org
oktube.ru onemactrckr.com
onlineserialy.ru oneminutesite.it
onetravelguides.com
onlainbesplatno.ru
onload.pw onload.pw
ontargetseo.us ons-add.men
optom-deshevo.ru openfrost.com
oren-cats.ru ordernorxx.com
ostroike.org osagonline.ru
ovirus.ru ozas.net
p-business.ru ozoz.it
paccohichetoti.ml pacificair.com
paclitor.com paleohub.info
paradontozanet.ru pandarastore.top
partnerworkroom.men panicatack.com
paydayloanslocal.com parajumpersoutlet.online
pdfprof.com partner-pop.men
perfection-pleasure.ru pcgroup.com.uy
perosan.com piccshare.com
photorepair.ru picturesboss.com
picsearch.com pinwallpaper.xyz
pirateday.ru pipki.r.acdnpro.com
pk-services.ru piratecams.com
pl-vouchers.com
plastgran.com plastgran.com
plastgranar.nu popads.net
poiskzakona.ru popcash.net
pons-presse.com pornhub-forum.ga
popmarker.com pornhubforum.tk
popup-hgd.xyz porno-chaman.info
porndairy.in porno.simple-image.com.ua
porngalleries.top pornohd1080.online
portadd.men pornoklad.ru
pozdrawleniya.ru pornotubs.com
preventheadacheguide.info portnoff.od.ua
printingpeach.com powenlite24.ru
privacyassistant.net pr0fit-b0x.com
privatamateure.com predominant-invent.tk
privatefx.all4invest.info privhosting.com
prize44.com prize44.com
professionaldieselcare.com producm.ru
prom23.ru profolan.pl
promgirldresses.xyz proftests.net
prostitutki-tolyatti.org putitin.me
push-ad.com quelle.ru
qor360.com quickcashlimited.com
qwarckoine.com ragecash.com
qwesa.ru rainbowice.ru
rankexperience.com realitykings.com
razleton.com recordpage-a.akamaihd.net
refads.pro redbottomheels.xyz
registrysweeper.com relax.ru
rewardpoll.com renecaovilla.online
ricorsogiustizia.org respublica-otel.ru
ringtonepartner.com ring4rhino.com
robertefuller.com risparmiocasa.bz.it
royal-betting.net rossanasaavedra.net
rubanners.com rp9.ru
russia-tao.ru saddiechoua.com
russia-today-video.ru saecsa.co
russkoe-zdorovie.ru saletool.ru
sabizonline.com santasgift.ml
sadaholding.com sc-specialhost.com
samolet.fr scanner-elena.top
sbdl.no see-your-website-here.com
scanner-olga.top seoanalyses.com
scanner-walter.top seoexperimenty.ru
scoopquest.com seorank.info
scopich.com sexkontakte-seite.com
search-error.com shakhtar-doneck.ru
search-goo.com
searchimage.co
searchtooknow-a.akamaihd.net
seksvideoonlain.com
sel-hoz.com
selectads.men
semprofile.com
sendearnings.com
seo-prof1.xyz
seo-smm.kz
seorussian.ru
seotoolsagency.com
service.adtech.fr
servisural.ru
sexcamamateurchat.com
sexkontakteao.info
sexphoto.site
sexsearch.com
sexy.babes.frontend-stack.top
sexyali.com
shijian.ac.cn shijian.ac.cn
ship-marvel.co.ua shop.acim.org
shop-electron.ru sientalyric.co
shoppingjequiti.com.br siha.de
simplepooltips.com simpoed.ufop.br
skachat-besplatno-obrazcy.ru sinestesia.host.sk
sklad-24.ru siteheart.net
small-game.com skincrate.net
snjatie-geroinovoy-lomki.ru slim.sellany.ru
snowplanes.com softomix.com
social-button.xyz softonicads.com
social-vestnik.ru sosdepotdebilan.com
sockshare.net souvenirua.com
soheavyblog.com spravka130.ru
solinf.co starwars.wikia.com
spinnerco.ca stats-public.grammarly.io
spy-sts.com stauga.altervista.org
srgwebmail.nl stockquotes.wooeb.com
stal-rulon.ru
standardchartered-forex.com
stjamesschool.info
stoki.ru
stop-gepatit.te.ua stop-gepatit.te.ua
stpolice.com styro.ru
suggest-keywords.com
sugvant.ru
summerlinhomes411.info summerlinhomes411.info
superinterstitial.com svensk-poesi.com
suralink.com tako3.com
swingerseiten.com tam-gde-more.ru
swsociety.se td-l-market.ru
tacbelarus.ru teenfuck.tv
taraz.xkaz.org teletype.in
taxi-v-eisk.ru terrafootwear.us
telegramdownload10.com the-usa-games.blogspot.com
thaismartloan.com thecoral.com.br
thedownloadfromwarez.blogspot.com thefds.net
thefotosgratis.eu theguardlan.com
thegamerznetwork.com timeallnews.ru
thenetinfo.com tizanidine4mgprice.blogspot.com
tizanidinehcl4mgtabinfo.blogspot.com tizanidinehcl2mgtablet.blogspot.com
tizanidinesideeffects.blogspot.com tizanidinehclsideeffects.blogspot.com
tizanidinewithdrawal.blogspot.com tizanidinepain.blogspot.com
tn811.us tk-assortiment.ru
token-lab.org tobeyouday.win
toy-shop.top top-deal.com.pl
tracxn.com top10registrycleaners.com
trafficmania.com topcasinoratings.ru
trafficmp.com topvidos.ru
traffictrade.life torontoplumbinggroup.com
traffique.net torture.ml
trainoffend.ml totu.info
trustl.life traffic-club.info
tube8.com trafficfactory.biz
tvory.predmety.in.ua trafficjunky.net
twittruth.com tramadolandtizanidine.blogspot.com
typimga.pw trk-4.net
ua-company.ru tryrating.com
udayavani.com tt-ipd.info
udsgame.online turkeyreport.tk
ufa.xrus.org tv-spoty.info
uptime-as.net tversvet.ru
uptimebot.net tvnewsclips.info
urldelivery.com tx41tclega.ru
vacuumcleanerguru.com uhod-za-sobakoj.ru
venerologiya.com unrealcommander.org
video-chat.in uogonline.com
videooko.weebly.com userequip.com
videotuber.ru v24s.net
videtubs.pl v720hd.ru
vipcallsgirls.com valuado.com
virtuagirl.com valueclick.com
virtualbb.com vavilone.com
vksex.ru vduplo.ru
vodkoved.ru vedomstvo.net
voluumtrk.com veerotech.com
vpnmouse.com velen.io
vrotike.ru veselokloun.ru
vsdshnik.com vezuviy.su
wait3sec.org videochaty.ru
we-are-gamers.com vladimir.xrus.org
webtherapy.ru vseigry.fun
weekes.biz.tc wallpaperaccess.com
whereverdesperate.gq warningzscaler.heraeus.com
wholesalecheapjerseysfree.com webextract.profound.net
wingsofrefuge.net webshoppermac.com
wma-x.com website-analyzer.info
wordpresscore.com website-speed-check.site
workle.website wemedinc.com
works.if.ua where-toget.com
worldhistory.biz whipme.yopoint.in
wowas31.ucoz.ru wholesalejerseychinaoutlet.com
wrz0iuebwhp5fg.freeddns.com whos.amung.us
ww1943.ru wingsoffury2.com
www.kabbalah-red-bracelets.com wordkeyhelper.com
x-diesel.info ww2awards.info
wzgyyq.com
xblognetwork.com
xboxster.ru xboxster.ru
xn-----8kcatubaocd1bneepefojs1h2e.xn--p1ai xlovecam.com
xn----7sbaaabaei0cc8aj5bj0bncejx.xn--p1ai xn----itbkqkfiq.xn--p1ai
xn--80aanaardaperhcem4a6i.com xn--80abgj3a5acid6ghs.top
xn--80aebbcbcdemfkhba4byaehoejh8dza3v.xn--p1ai
xn--q1a.xn--b1aube0e.xn--c1acygb.xn--p1ai
xnxx-n.com xnxx-n.com
xpresscare.ru xolodremont.ru
xsion.net xtube.com
xxxhdvideo.site xxxhdvideo.site
yginekologa.com yebocasino.com
ynymnwbm.bloger.index.hr yellowads.men
yoshkarola.zrus.org yougame.biz
youjizz.com yoursearch.me
youtoner.it zahvat.ru
za-music.mymobiplanet.com zakon-ob-obrazovanii.ru
zeg-distribution.com zeroredirect6.com
zeikopay.com zophim.me
zeroredirect9.com zrelaya.pw
zkjovpdgxivg.ga zscaler.net
znakomstva-piter78.ru
zoogdiesney.com
zoosexart.com

484
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
0lovespells0.blogspot.com 101billion.com
12u.info 1stat.ru
5000-cotydzien.com 1xbet4you.com
70casino.online 2itech.ru
aa81bf391151884adfa3dd677e41f94be1.com 3xforum.ro
abcdeg.xyz 4kplayer.pl
adrenalin-stk.ru 72-news.com
adult3dgames.com absolutelyanalog.com
adverster.com adimmix.com
aghanyna.com adloads.net
alert-fdm.xyz affiliate-fr.com
alert-hgd.xyz agecheckadult.com
amateurlivechat.org alekseevec.ru
anal-acrobats.com alert-fjg.xyz
angigreene.com alfa9.com
animal-drawings.com amigobulls.com
animalia-life.club apessay.com
apartment.ru apibetweenlinesn-a.akamaihd.net
apimossnetinfo-a.akamaihd.net apioasisspacenet-a.akamaihd.net
arcadeplayhouse.com apper.de
architecturebest.com
arcteryxsale.online arcteryxsale.online
arcteryxstore.online arewater.com
ardimobileinfo.ml bag77.ru
australia-opening-times.com bagsonsale.online
balois.worldbreak.com bavsac.com
baoxaydung.com.vn bestcalovebracelet.cn
battle.net bestwebsitesawards.com
bet-prognoz.com bezsporno.ru
betterhdporn.com bmw.afora.ru
bitcoins-live.ru budpost.com.ua
biznesluxe.ru bum.com.ru
blacktwhite.com businescoop.men
blog.koorg.ru callawaygolfstore.online
bongacams.com cbb1smartlist12.click
brainsandeggs.blogspot.com cenokos.ru
brianhenry.co cete.ru
bryansk.zrus.org checkhit.com
buscarfoto.com christianlouboutinreplica.pw
bvlgaribracelet.xyz clicksotrk.com
californianews.cf coldfilm.ru
callejondelpozo.es compliance-barak.xyz
carloans.com coslab.club
castingbank.ru cpajunkies.com
cbozhe.com csgo4.win
cdncash.org cymbaltaandtizanidine.blogspot.com
cherrypointplace.ca dgfitness.co
chidporn.com dnepropetrovsk.mistr-x.org
ciceros.co domcran.net
clickcash.com download-wallpaper.net
cmd.kz drunkmoms.net
customcatchcan.com dumuelave.xyz
customcollegeessays.net dvr.biz.ua
dailyfinancefix.com dynainbox.com
dealitright.click eksprognoz.ru
delta-line.men elektir.ru
demian.kz eralph.tk
demon-tweeks.com exlarseva.webblog.es
detki-opt.ru extlinks.com
dev.citetick.com facialporntube.com
dojki365.online factorynightclub.com
drpornogratisx.xxx fenoyl.batcave.net
ee77ee.com fickkontakte.org
ekaterinburg.xrus.org frbizlist.com
enge-fotzen.info free411games.com
extstat.com freecamdollars.com
fakehandbags.xyz fun2cell.net
fealq.com gabeshop.ru
feel-planet.com galeria-zdjec.com
ferretsoft.com gameonasia.com
filefilter.weebly.com ge0ip.org
filesvine.com
filmania-x.ru
finansov.info
finuse.com
fiverr.com
flprog.com
formulaantiuban.com
forum20.smailik.org
free-today.com
freewlan.info
fuckbuddybestgilf.info
futbolkisales.ru
galaxyflowers.ru
gallery.rennlist.com
gallerylisting.com
gambarxkata.co
get-seo-domain.com get-seo-domain.com
gifspics.com glavtral.ru
goblacked.com gobongo.info
goodly.pro golaya.pw
googlsucks.com gosmeb.ru
guod.me gsasearchengineranker.xyz
gymi.name guardlink.org
hasshe.com happy.new.yeartwit.com
hawaiisurf.com histock.info
highland-homes.com hit-kino.ru
hotkeys.com hoste.octopis.com
hoverboardforsaledirect.com hothor.se
iframe-toloka.com housediz.com
hscsscotland.com
hulfingtonpost.com
hully.altervista.org
i-midias.net.br
igtools.club igtools.club
ilo134uloh.com indianmedicaltourismshop.com
ilovevitaly.ru interferencer.ru
imagecoolpub.com invivo.hu
inbabes.sexushost.com isitwp.com
interior-stickers.ru jav-fetish.site
internetproviderstucson.com javrip.net
invest-pamm.ru jimmychoosale.online
invitefashion.com kamorel.com
istizanidineanopiate.blogspot.com keyhantercume.com
javatex.co.id keywordbasket.com
javstock.com
jikoman.info
jus0wil.pp.ua
kaac.ru
kaliningrad.zrus.org
kashubadesign.ru
kasino-money.pw
katjimej.blog.fc2.com
keywordsuggests.com
kino-fun.ru kino-fun.ru
ku6.com knowyournextmove.com
kustanay.kz konkursov.net
laptoper.net krasnodar-avtolombards.ru
layola.biz.tc lacasamorett.com
lazy-z.com ledis.top
leadwayau.com liran-locks.com
light.ifmo.ru livingcanarias.com
live-sexchat.ru
lomb.co lomb.co
louboutinbooties.xyz lombia.co
low-format.ru losangeles-ads.com
m1media.net lostaruban.com
macdamaged.space louboutinshoes.xyz
machicon-ueno.info lovelycraftyhome.com
mackeeper-center.club m0r0zk0-krava.ru
manualterap.roleforum.ru macotool.com
mediaoffers.click mainhp.net
members.ghanaweb.com make-money-online.com
midst.eu markjaybeefractal.com
mir-betting.ru meget.co.za
mobilierland.com meltwater.com
moinozhki.com mielec.pl
movpod.in mikozstop.com
musezone.su minegam.com
mwtpludn.review mir-limuzinov.ru
mykings.pw moskva.nodup.ru
narkologiya-orel.ru muizre.ru
narkologiya-peterburg.ru musicas.baixar-musicas-gratis.com
national-today-winning-winner.club musicktab.com
northfacestore.online musicspire.online
norththeface.store myghillie.info
novatech.vn myiptest.com
oballergiya.ru mywallpaper.top
ok.ru nash-krym.info
online247.ml nastydollars.com
onlineslotmaschine.com news-speaker.com
paighambot.com newyorkhotelsmotels.info
pandroid.co nhl17coinsforps3.gratisblog.biz
pdns.download nl.netlog.com
nmrk.ru
notaria-desalas.com
novosibirsk.xrus.org
o-o-8-o-o.com
o333o.com
obiavo.ru
onemactrckr.com
onko-24.com
onlythegames.com
optibuymac.com
p-business.ru
pandarastore.top
partner-host.men
partner-pop.men
partnerworkroom.men
pastaleads.com
pendelprognos.se pendelprognos.se
perfectplanned.com perm.xrus.org
pixgood.com pinsdaddy.com
play-mp3.com pirateday.ru
pliks.pl piski.top
pogruztehnik.ru pixshark.com
popcash.net pojdelo.weebly.com
pornotubexxx.name pornoted.com
portside.cc pornpost.in
pr-ten.de pp-budpostach.com.ua
priceg.com rabot.host.sk
privhosting.com rebuildermedical.com
raavidesigns.com redirectingat.com
rankings-analytics.com renecaovillasale.online
rapevideosmovies.com rialp.getenjoyment.net
rapidgator-porn.ga rixpix.ru
remont-fridge-tv.ru rospromtest.ru
remont-ustanovka-tehniki.ru ruex.org.ua
respublica-otel.ru rvi.biz
rossmark.ru saitevpatorii.com
rozalli.com sampleletters.net
roznica.com.ua sardinie.us
rusvideos.su sashagreyblog.ga
s8-nowy-wygraj.comli.com scrapinghub.com
sadaholding.com scrapy.org
samo-soznanie.ru seadragonherbery.com
sarafangel.ru secret.xn--oogle-wmc.com
savetubevideo.com seoheap.com
searchimpression.com seokicks.de
security60-e.com sexiporno.net
securityallianceservices.com shell-pmr.ru
servingnotice.com shop.xz618.com
sigmund-freud.co.uk shopsellcardsdumps.com
sisiynas.ru sibecoprom.ru
sloopyjoes.com sicfor.bcu.cc
smichovbike.cz siteripz.net
social-s-iii.xyz skladvaz.ru
soda.media skuteczna-dieta.co.pl
sotechco.co soaksoak.ru
spinazdrav.ru socialbookmarksubmission.org
sportbetfair.com softonicads.com
sports-supplements.us solmarket.by
spravka-medosmotr.ru songoo.wz.cz
spyfu.com sosdepotdebilan.com
steebook.com spywarebegone.com
strag-invest.ru spywareit.com
strfls.com squidoo.com
subj.ukr-lit.com sr-rekneskap.no
suralink.com stairliftstrue.com
svarkagid.com standardchartered-forex.com
taqplayer.info starpages.net
themestotal.com stpolice.com
timetorelax.biz stuffpride.com
tizanidinehcl2mgtablet.blogspot.com taranerymagesswa.blogspot.com
top10registrycleaners.com tedxrj.com
topdownloads.ru teslathemes.com
theplacetoupdating.pw
tiens2010.ru
tizanidine4mguses.blogspot.com
tizanidinedosageforsleep.blogspot.com
tizanidinehydrochloride2mg.blogspot.com
top-l2.com
top10-way.com
torrentdownloadhub.com
traffic-club.info traffic-club.info
trahic.ru traffic2money.com
tryrating.com tupper-shop.ru
tvoystartup.ru tvnewsclips.info
ukrtextbook.com udayavani.com
uprour.com ultimatesetnewfreeallsoftupgradesystems.pw
url2image.com unionmarkt.de
vedomstvo.net usiad.net
vgoloveboli.net validdomain.xyz
via-energy-order.com vancleefreplica.pw
vigrx-original.ru viagra.pp.ua
vip.51.la videogamesecrets.com
vitanail.ru videositename.com
vysigy.su vipps.com.my
waterpurifier.club wallpapersdesk.info
webads.co.nz x-lime.com
weblibrary.win xclicks.net
website-speed-check.site xn-----6kcaacnblni5c5bicdpcmficy.xn--p1ai
westen-v.life xn----8sbdbjgb1ap7a9c4czbh.xn--p1acf
while.cheapwebsitehoster.com xn----dtbndd4ae7eub.top
word-vorlagen.net xn--24-glceagatoq7c2a6ioc.xn--p1ai
workle.website xn--80aagddcgkbcqbad7amllnejg6dya.xn--p1ai
www.arenda-yeisk.ru xn--80ak6aa92e.com
x-diesel.org xn--c1acygb.xn--p1ai
xaylapdiendanang.com xolodremont.ru
xcombear.ru youdao.com
xmronta.com youresponsive.com
xn--80aebbcbcdemfkhba4byaehoejh8dza3v.xn--p1ai z-master.ru
xn--80aikhbrhr.net zebramart.ru
xxxhdvideo.site zeroredirect11.com
yoshkarola.zrus.org zkjovpdgxivg.ga
zeroredirect10.com zog.link
zoogdinsney.com zoogdinsney.com
zootoplist.com

10
dev-tools/test_units/ratelimittest-beta.txt
View file

@ -581,14 +581,4 @@
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html> </html>

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.23 0; 10.1.1.19 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.10.3432 ### Version: V4.2022.10.3433
### Updated: Tue Oct 25 22:01:15 UTC 2022 ### Updated: Wed Oct 26 10:03:31 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.10.3432 ### Version: V4.2022.10.3433
### Updated: Tue Oct 25 22:01:15 UTC 2022 ### Updated: Wed Oct 26 10:03:31 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##