vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-10 23:34:41 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2022.09.3338 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2022-09-08 10:09:26 +00:00
parent 0cc3df1367
commit 63a42b88ad
47 changed files with 94787 additions and 94777 deletions
Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.09.3337 #### Version: V4.2022.09.3338
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.09.3337 #### Version: V4.2022.09.3338
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -14,7 +14,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2022.09.3337 #### Version: V4.2022.09.3338
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

11714
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2022.09.3337 #### Version: V4.2022.09.3338
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

11718
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

11718
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

11718
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

11718
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.68 1; 10.1.1.68 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.68 0; 10.1.1.68 0;
127.0.0.1 0; 127.0.0.1 0;

11718
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.68 1; 10.1.1.68 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.68 0; 10.1.1.68 0;
127.0.0.1 0; 127.0.0.1 0;

11718
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.68 1; 10.1.1.68 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.68 0; 10.1.1.68 0;
127.0.0.1 0; 127.0.0.1 0;

11718
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
3337 3338

11718
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

11718
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.253.239.233 0; 20.29.103.106 0;

11718
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.68 1; 10.1.1.68 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.68 0; 10.1.1.68 0;
127.0.0.1 0; 127.0.0.1 0;

11718
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.68 1; 10.1.1.68 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.68 0; 10.1.1.68 0;
127.0.0.1 0; 127.0.0.1 0;

11718
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.68 1; 10.1.1.68 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.68 0; 10.1.1.68 0;
127.0.0.1 0; 127.0.0.1 0;

11718
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.253.239.233 0; 20.29.103.106 0;

11718
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.253.239.233 0; 20.29.103.106 0;

11718
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.68 1; 10.1.1.68 1;
127.0.0.1 1; 127.0.0.1 1;

18
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
Black Hole CCBot
IstellaBot IstellaBot
Masscan Litemage_walker
MegaIndex.ru NICErsPRO
Mr.4x3 ScanAlert
Openfind Sosospider
VeriCiteCrawler VCI
Wprecon Web Collage
ZmEu page scorer
trendiction.de probe-image-size

272
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
404enemy 404enemy
80legs ADmantX
ALittle Client ASPSeek
Abonti
Aboundexbot
Acunetix Acunetix
AiHitBot AhrefsBot
Aipbot Aipbot
Alexibot
AllSubmitter AllSubmitter
Anthill Alligator
AwarioRssBot Anarchie
Anarchy
Anarchy99
Aspiegel
Attach
BDCbot BDCbot
BDFetch BLEXBot
BackWeb BackStreet
Backlink-Ceck
BacklinkCrawler
Bandit
Barkrowler Barkrowler
BatchFTP
Battleztar Bazinga Battleztar Bazinga
Bitacle
BlackWidow
BlowFish BlowFish
Bolt Bolt
BotALot Buck
Buddy
BuzzSumo BuzzSumo
CATExplorador CATExplorador
CCBot CCBot
CODE87 CensysInspect
CSHttp CheeseBot
CheTeam
CherryPicker CherryPicker
Chlooe
Cloud mapping Cloud mapping
Cocolyzebot Cocolyzebot
Collector Collector
Copier Craftbot
CrazyWebCrawler
CrunchBot
Curious Curious
CyotekWebCopy
DBLBot DBLBot
DTS Agent
DatabaseDriverMysqli DatabaseDriverMysqli
Demon Demon
Deusu
Devil
DigitalPebble DigitalPebble
Discobot Dirbuster
Dispatch Disco
DnyzBot
DomainCrawler DomainCrawler
DomainSigmaCrawler
Domains Project
Dotbot Dotbot
Drip
ECCP/1.0 ECCP/1.0
EMail Siphon Ebingbong
EasyDL
EirGrabber EirGrabber
Evil Evil
Express WebPictures ExtLinksBot
Extractor Extractor
ExtractorPro
Extreme Picture Finder Extreme Picture Finder
EyeNetIE
Ezooms Ezooms
Flunky Fimap
Freeuploader Freeuploader
FrontPage FyberSpider
Fyrebot
G-i-g-a-b-o-t
Genieo Genieo
GetWeb
Getintent Getintent
Grabber Grafula
GrapeshotCrawler GrapeFX
HMView HMView
HTMLparser HTMLparser
HTTrack HTTrack
HaosouSpider Haansoft
IDBot IDBTE4M
IRLbot IRLbot
Indy Library Iblog
Id-search
IlseBot
Image Fetch
Image Sucker
InfoNaviRobot InfoNaviRobot
Intelliseek Intelliseek
Internet Ninja Internet Ninja
InternetSeer Iria
Iskanie JamesBOT
IstellaBot
JOC Web Spider
JennyBot
JetCar
Jetty Jetty
JikeSpider JikeSpider
Joomla
Jorgee
JustView
Kenjin Spider Kenjin Spider
Keybot Translation-Search-Machine Keybot Translation-Search-Machine
Kinza Keyword Density
Kozmosbot
LWP::Simple
Larbin
Leap Leap
LeechFTP LeechFTP
Lftp
LibWeb LibWeb
Libwhisker
LieBaoFast LieBaoFast
Lightspeedsystems Lightspeedsystems
Likse
LinkScan
LinkWalker
Linkbot
LinkextractorPro LinkextractorPro
LinkpadBot
LinksManager
LinqiaMetadataDownloaderBot LinqiaMetadataDownloaderBot
LinqiaRSSBot LinqiaRSSBot
Lipperhey Spider
Litemage_walker Litemage_walker
Lmspider
MIDown tool MIDown tool
MTRobot MSIECrawler
Majestic SEO Majestic SEO
Majestic12 Masscan
Mata Hari Mata Hari
Meanpathbot MeanPath Bot
MegaIndex.ru
Mister PiX Mister PiX
Morfeus Fucking Scanner Mojolicious
Msrabot Mr.4x3
NICErsPRO Musobot
Name Intelligence Name Intelligence
Nameprotect
NearSite
Needle Needle
Net Vampire NetAnts
NetMechanic NetSpider
NetZIP
Netcraft Netcraft
Nibbler Niki-bot
Nikto
NimbleCrawler NimbleCrawler
Ninja
Not
Nuclei Nuclei
Offline Explorer Offline Explorer
Offline Navigator
OnCrawl
OpenVAS
Openfind Openfind
Openvas
OrangeSpider OrangeSpider
PECL::HTTP PHPCrawl
PeoplePal Page Analyzer
PageAnalyzer
Petalbot
Pi-Monster Pi-Monster
Pimonster Picscout
Picsearch
Pixray
PleaseCrawl
Pockey
ProWebWalker
Psbot
PyCurl PyCurl
QueryN Metasearch RankActive
Quick-Crawler
RSSingBot
RankFlex
RankingBot
RankingBot2 RankingBot2
RepoMonkey
Ripper Ripper
SEOkicks-Robot
SEOlyticsCrawler SEOlyticsCrawler
SISTRIX SEOprofiler
SalesIntelligent SEOstats
ScreenerBot SMTBot
Searchestate Scanbot
Semrush Scrapy
SentiBot Screaming
SeobilityBot SearchmetricsBot
SemanticJuice
Seomoz Seomoz
Shodan Site Sucker
SiteCheckerBotCrawler
SiteSnagger
SiteSucker
Sitebeam Sitebeam
Siteimprove
SmartDownload SmartDownload
Snake
Snoopy Snoopy
SocialRankIOBot Sogou web spider
Sosospider
Sottopop Sottopop
SpankBot Steeler
Spanner Sucker
Spbot SurveyBot
Sqlworm
Sucuri
Suzuran
T0PHackTeam
T8Abot T8Abot
Teleport Telesoft
TeleportPro Telesphorep
Telesphoreo The Intraformant
Thumbor Thumbor
TightTwatBot Titan
Trendictionbot Trendiction
Turnitin Turnitin
TurnitinBot TurnitinBot
Typhoeus TwengaBot
URLy.Warning Twice
UnisterBot
VB Project
VeriCiteCrawler
VidibleScraper VidibleScraper
Virusdie Virusdie
WWW::Mechanize WASALive-Bot
WWWOFFLE WISENutbot
WPScan
WWW-Collector-E
WWW-Mechanize
WallpapersHD WallpapersHD
WeSEE WeSEE
Web Pix Web Collage
Web Sauger Web Enhancer
Web Sucker Web Sucker
WebAuto
WebCollage WebCollage
WebCopier WebCopier
WebEnhancer
WebFuck
WebGo IS WebGo IS
WebImageCollector WebImageCollector
WebLeacher
WebPix WebPix
WebReaper WebReaper
WebSucker WebStripper
WebWhacker WebsiteExtractor
WebZIP
Website Quester
WebsiteQuester WebsiteQuester
Whatweb Webster
WinHTTrack Whack
Who.is Bot
WiseGuys Robot
Wonderbot Wonderbot
Woobot
Wotbox Wotbox
Wprecon
Xaldon WebSpider
Xaldon_WebSpider Xaldon_WebSpider
YoudaoBot
Zade Zade
Zermelo Zauba
Zeus Zeus
ZoomBot ZmEu
ZyBorg
arquivo-web-crawler
autoemailspider
backlink-check backlink-check
cah.io.community
check1.exe check1.exe
clark-crawler clark-crawler
cognitiveseo
crawler4j
demandbase-bot demandbase-bot
domainsproject.org
eCatch
gopher
instabid instabid
internetVista monitor
ips-agent ips-agent
linkdexbot linkdexbot
lwp-request lwp-request
magpie-crawler lwp-trivial
mediawords mediawords
oBot netEstate NE Crawler
pcBrowser pcBrowser
probe-image-size probe-image-size
ripz
satoristudio.net
scan.lol
seobility
seocompany.store seocompany.store
seostar sexsearcher
serpstatbot
sitechecker.pro
siteripz siteripz
sogouspider sogouspider
spyfu spyfu
sysscan
tAkeOut tAkeOut
trendiction.com trendiction.com
ubermetrics-technologies.com
voyagerx.com voyagerx.com
webprosbot webprosbot
zauba.io x09Mozilla
x22Mozilla
xpymep1.exe

290
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
404checker 01h4x.com
80legs 80legs
ADmantX ADmantX
Aboundexbot
Acunetix Acunetix
Aipbot Aipbot
AllSubmitter AllSubmitter
AlphaBot Anarchy
Ankit Ankit
Apexoo Aspiegel
Atomseobot BackStreet
BDFetch BackWeb
BackDoorBot
Backlink-Ceck Backlink-Ceck
Bitacle Barkrowler
BlackWidow Battleztar Bazinga
BlowFish Bigfoot
Bolt Black Hole
Buddy Blow
Bullseye Brandprotect
Buck
BuiltBotTough
BunnySlippers
BuzzSumo BuzzSumo
CATExplorador CATExplorador
CODE87
CSHttp CSHttp
Calculon CazoodleBot
Cegbfeieh
CheeseBot
ChinaClaw ChinaClaw
Chlooe
Cliqzbot Cliqzbot
Copier Cogentbot
CopyRightCheck CopyRightCheck
Crawling at Home Project
CrazyWebCrawler
CyotekWebCopy CyotekWebCopy
DSearch DBLBot
DTS Agent Demon
DataCha0s Deusu
DatabaseDriverMysqli Digincore
DigitalPebble
Dirbuster Dirbuster
Disco Disco
Dispatch Dispatch
DittoSpyder DittoSpyder
DnyzBot
DomainAppender DomainAppender
DomainSigmaCrawler DomainStatsBot
Domains Project
Dragonfly Dragonfly
Drip
ECCP/1.0
EMail Wolf
EasyDL EasyDL
Ecxi ExtLinksBot
EirGrabber Extractor
EroCrawler
Evil
ExtractorPro ExtractorPro
EyeNetIE Ezooms
FDM FDM
Firefox/7.0
FrontPage FrontPage
G-i-g-a-b-o-t
GalaxyBot GalaxyBot
GermCrawler GermCrawler
GetRight
GetWeb
Getintent
Go!Zilla Go!Zilla
Go-Ahead-Got-It Go-Ahead-Got-It
GoZilla Gotit
GrapeshotCrawler GrabNet
Grabber
GridBot
HEADMasterSEO
HMView HMView
HTTrack HTTP::Lite
Harvest Harvest
Havij Heritrix
Hloader
HonoluluBot
Humanlinks Humanlinks
Id-search HybridBot
InfoNaviRobot Image Sucker
IndeedBot
InfoTekies InfoTekies
Intelliseek Intelliseek
InterGET InterGET
InternetSeer
Iria Iria
IstellaBot IstellaBot
JOC Web Spider JOC Web Spider
JamesBOT JamesBOT
JennyBot
Jetty
Joomla Joomla
Keybot Translation-Search-Machine Kinza
Lanshanbot LNSpiderguy
LexiBot Larbin
LibWeb LeechGet
Libwhisker LieBaoFast
Lightspeedsystems
Likse Likse
LinkScan
LinkWalker
Linkbot Linkbot
LinkpadBot
LinqiaMetadataDownloaderBot LinqiaMetadataDownloaderBot
LinqiaScrapeBot Lipperhey Spider
Lipperhey
Litemage_walker Litemage_walker
Lmspider
MFC_Tear_Sample
MIDown tool
MIIxpc
MJ12bot
MQQBrowser
MSFrontPage MSFrontPage
MSIECrawler
MTRobot MTRobot
Mail.RU_Bot
Majestic-SEO
Majestic12
MarkMonitor MarkMonitor
MarkWatch
Mata Hari
MauiBot
Mb2345Browser
MeanPath Bot MeanPath Bot
MegaIndex.ru Mediatoolkitbot
MicroMessenger
Microsoft URL Control Microsoft URL Control
Moblie Safari Moblie Safari
Mojolicious MolokaiBot
Mozlila
Mr.4x3 Mr.4x3
Msrabot Name Intelligence
NPbot
Nameprotect Nameprotect
NearSite NearSite
Net Vampire Needle
Nessus
NetAnts NetAnts
NetMechanic NetLyzer
NetZIP Nibbler
NimbleCrawler Nutch
OutfoxBot Octopus
PHPCrawl OnCrawl
OpenVAS
Openvas
OrangeSpider
Page Analyzer Page Analyzer
Pandalytics PageAnalyzer
PeoplePal Papa Foto
Petalbot
Pi-Monster
Picscout Picscout
Picsearch Picsearch
PictureFinder Piepmatz
PleaseCrawl Pixray
Pockey Pockey
ProPowerBot
Probethenet Probethenet
Psbot Psbot
Pump Quick-Crawler
QueryN Metasearch
RSSingBot RSSingBot
RankActive
RankingBot2
Rankivabot Rankivabot
RealDownload Re-re
RepoMonkey
RocketCrawler RocketCrawler
SEOkicks SBIder
SISTRIX SEOstats
SMTBot
ScanAlert ScanAlert
Screaming Scanbot
ScrepyBot ScoutJet
SearchmetricsBot Searchestate
Seekport Seekport
SemanticJuice
Semrush
SeoSiteCheckup
SeobilityBot
Seomoz Seomoz
Site Sucker SiteCheckerBotCrawler
SiteExplorer SiteLockSpider
SiteSnagger SiteSucker
Sitebeam
Siteimprove Siteimprove
Sitevigil Sogou web spider
SmartDownload Sosospider
Snake Spinn3r
Snapbot
Snoopy
Sociscraper
Sottopop
SpaceBison
Spbot
Sqlmap Sqlmap
Sqlworm Steeler
Stripper Stripper
Sucuri Sucker
SuperBot
SuperHTTP SuperHTTP
Suzuran Szukacz
Swiftbot T8Abot
TeleportPro Telesoft
Telesphoreo Thumbor
Telesphorep Titan
The Intraformant
TheNomad
TightTwatBot
Trendiction
Trendictionbot
True_Robot True_Robot
Turnitin Turnitin
TurnitinBot TurnitinBot
Twice
Typhoeus Typhoeus
URLy.Warning URLy.Warning
UnisterBot
Upflow
V-BOT V-BOT
VCI Virusdie
VelenPublicWebCrawler VoidEYE
Voltron WBSearchBot
WEBDAV WWW-Collector-E
WISENutbot
WWW-Mechanize
WWW::Mechanize WWW::Mechanize
WWWOFFLE WWWOFFLE
Wallpapers Wallpapers
Wallpapers/3.0 Wallpapers/3.0
Web Collage WallpapersHD
WeSEE
Web Enhancer Web Enhancer
Web Fuck Web Fetch
Web Sauger WebAuto
WebCollage WebCollage
WebCopier
WebFetch WebFetch
WebImageCollector
WebLeacher
WebPix
WebSauger WebSauger
WebStripper WebWhacker
Webalta
WebmasterWorldForumBot WebmasterWorldForumBot
Website Quester Website Quester
WebsiteExtractor Whatweb
Webster Who.is Bot
Whack Widow
WiseGuys Robot Wonderbot
Woobot Woobot
Wotbox
Wprecon
Xaldon WebSpider
Xaldon_WebSpider Xaldon_WebSpider
YoudaoBot Zade
Zermelo
Zitebot
ZoomBot ZoomBot
ZoominfoBot adscanner
ZumBot arquivo.pt
ZyBorg
arquivo-web-crawler
autoemailspider autoemailspider
backlink-check backlink-check
cah.io.community
check1.exe
coccocbot coccocbot
crawl.sogou.com cognitiveseo
dataforseo.com com.plumanalytics
crawler.feedback
eCatch eCatch
internetVista monitor evc-batch
heritrix
ips-agent ips-agent
isitwp.com isitwp.com
iubenda-radar
linkdexbot linkdexbot
lwp-request lwp-request
lwp-trivial lwp-trivial
meanpathbot magpie-crawler
muhstik-scan
netEstate NE Crawler
oBot oBot
pcBrowser pcBrowser
plumanalytics
probe-image-size probe-image-size
satoristudio.net satoristudio.net
scan.lol scan.lol
seocompany.store seobility
serpstatbot seostar
tAkeOut sitechecker.pro
trendiction.com trendiction.com
trendiction.de
webmeup-crawler webmeup-crawler
webprosbot webpros.com
x09Mozilla x09Mozilla
x22Mozilla

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
approved.su bannerpower.com
headpress.ru flipper.top
infobabki.ru mere.host.sk
npoet.ru mlf.hordo.win
offer.wpsecurity.website rogervivierforsale.com
pinstake.com ruscopybook.com
powc.r.ca.d.sendibm2.com sexkontakte-seite.com
randalljhoward.com umityangin.net
se.bnt-team.com wildcattube.com
youjizz.com yourads.website

946
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
00it.com 000free.us
03p.info 1stat.ru
100searchengines.com 202ch.com
101lesbian.xyz 214jaluwobapef.cf
12bet.com 3xforum.ro
1j7740kd.website 4istoshop.com
2020iscoming.info 4kpics.rocks
300richmond.co.nz 7ooo.ru
5000-cotydzien.com aa08daf7e13b6345e09e92f771507fa5f4.com
57883.net abwa.tk
7a2rnuey1tw9ar.ru academia-nsk.org
7fon.ru accessoires-mode.in
a.frcls.fr actulite.com
above.com adclickthru.net
addbin.men addblueoff.com.ua
addray.pro adloads.com
adf.ly ads.gold
adidas.frwebs.fr adserver-e7.com
adnotbad.com adultfullhd.com
adultwebhosting.info
advancedmassagebysara.com
advokat-grodno.by advokat-grodno.by
airmaxshoes-2016.com aimayangzhi.com
ald2014.org akama.com
alfa-img.com akita.kz
allwidewallpapers.com aktivator-windows10.blogspot.com
altamayoztourism.com aktobe.xkaz.org
alveris.ru all-streaming-media.com
amateurmatch.com allfinweb.com
ameblo.top am-se.com
anti-virus-removal.info anti-virus-removal.info
apelsinnik.website apartamentwroclaw.eu
apessay.com apartment.ru
apilinkswiftco-a.akamaihd.net apishops.ru
app-ready.xyz appiq.mobi
apps-analytics.net arcadepages.com
aruplighting.com arenda-yeisk.ru
ausmepa.org.au artefakct.com
auto4style.ru asia-forum.ru
asrvvv-a.akamaihd.net
audiobangout.com
audiofree.ru
autochoixspinelli.com autochoixspinelli.com
autoua.top autonew.biz
aviav.eu avek.ru
avramstroy.ru avon-severozapad.ru
ayeartoforget.com avto-oligarh.ru
back.dog avtocredit-legko.ru
beauty-b0x.pl avtovolop.ru
belinka.com.ua awaybird.ru
best-games.today azazu.ru
best-seo-solution.com backiee.com
bestkfiledxd.cf backlink4u.net
bestpornuha.com basisches-wasser.net
bigcities.org bausparen.bz.it
bimatoprost-careprost.com.ua bavsac.com
bitcoinpile.com bbsoldes.fr
biteg.xyz bestimagecoollibrary.com
bkns.vn bestmobilityscooterstoday.com
blackwitchcraft.ru bestmouthwash.club
blog.axant.it bestsexyblog.com
bloggerads.net bezlimitko.xyz
blogqpot.com bfz.biz
bmsco.co bidr.trellian.com
bonvillan.com biglistofwebsites.com
boostmyppc.com binomo.kz
bosman.pluto.ro bitcoin-ua.top
brains2.biz blagovest-med.ru
brainzpod.win bluesalt.co
brg8.com bobinoz.com
bristolhostel.com bonzbuddy.com
bugof.gq bonzybuddy.com
bugshoot.cn book-bets.com
bus-offer.com brandbucket.com
business-suggested.tk brillianty.info
buynorxx.com btc4u.ru
buzzurl.jp builtwith.com
byme.se buy-loft.ru
callawaygolfoutlet.online buyparajumpers.online
camdenmemorials.com bycontext.com
cand.jp camdolls.com
candlewooddentalcentre.com.au canzoni.ru
capacitacionyaprendizaje.com casinopinup-wins.com
cardsdumps.com
carrauterie.be
cartierreplica.top
cbcseward.com
certifywebsite.win certifywebsite.win
cfjump.com cheapjerseysa.com
cfsrating.sonicwall.com cheapmoncler.xyz
chatroulette.video cheatcode-lita12.rhcloud.com
cheapjerseysbizwholesale.us chlooe.com
checkm8.com christianlouboutinsaleoutletonline.us
chiblackhawks-jerseys.com citysecurity.nu
chocolateslim-u-srbiji.com claytransformations.info
cialis-samples.com clknsee.com
cigarpass.com co.lumb.co
cinemaenergy-hd.ru coinsspb.com
cleanersoft.com coldfilm.ru
click2pawn.com collegerentals.com
clmforexeu.com comissionka.net
cmhomestayagency.com commoncrawl.org
compliance-barak.xyz consorzioilmosaico.org
compliance-elena.top copyrightclaims.org
compliance-john.top cowlmash.com
compliance-willy.top creatives.adbetclickin.pink
concordexoticrentals.com cubs-jerseys.us
contentsexpress.com culad.com
coolwallpapers4k.info customchocolate.business-for-home.com
craftburg.ru cxpromote.com
cubook.supernew.org dairyindia.in
datadepths.com dealitright.click
ddospanel.com delta-line.men
descargar-musica-gratis.net detsky-nabytek.info
detective01.ru digital-sale.su
detmebel.su dividendo.ru
detskie-zabavi.ru djonwatch.ru
deutschland123.de dodlive.mil
dichvuvesinhhanoi.com download-of-the-warez.blogspot.com
dikqlyremy.info doxysexy.com
djstools.com dpihatinh.gov.vn
dokfilms.net driving.kiev.ua
dolohen.com dumpsmania24.com
domainsphoto.com e-commerce-seo1.com
dostavka-v-ukrainu.ru eager-nash.188-93-233-196.plesk.page
dotmass.top eaplay.ru
dotnetdotcom.org
downloadeer.net
drunkmoms.net
dverimegapolis.ru
dwomlink.info
eduinfosite.com eduinfosite.com
ee77ee.com eduserver.net
efkt.jp egvar.net
ekspresihati.info ekn-art.se
el-nation.com electricwheelchairsarea.com
elektrischeziga.livejournal.com elite-sex-finders.com
elektronischezigarettekaufen1.beeplog.com enskedesquashclub.se
elektrozigarettekaufen2.blogse.nl esnm.ru
eloxal.ru essayassist.com
elvenar.com este-line.com.ua
emergencyneeds.org f5mtrack.com
eonpal.com
erotik-kostenlos.net
essay-edu.biz
euroskat.ru
exmasters.com
expresstoplivo.ru
ezigarettenshop2.postbit.com
facialporntube.com facialporntube.com
falllow.gq falllow.gq
familienzahnaerzte.com fanrto.com
farm26.ru fbdownloader.com
fastfixing.tech fenoyl.batcave.net
favorcosmetics.com fettefrauen.net
fba-mexico.com filesdatabase.net
fickblock18.com film-one.ru
fickkontaktehobbyhuren.com fishtauto.ru
filmfanatic.com fitfloponline.store
finteks.ru flash4fun.com
flooringinstallation-edmonton.com flooringinstallation-edmonton.com
floridahuntingfishingadventures.com flytourisme.org
forminecrafters.ru fordsonmajbor.cf
frameimage.org forex21.ru
free-deals.faith formseo.com
free-stock-illustration.com fortunejack.com
freshdz.com freetangodownload.com
fullgirl.ru freeuploader.com
fsalas.com
fugarif.ga
fungamelands.com fungamelands.com
funnymama.com fxtips.ru
fxgallery.com gambarkatabaru.com
g7m.pl gameonasia.com
gamblingnerd.com gamevalue7.weebly.com
gamebackyard.com gardene.ru
gay-site.store gearsadspromo.club
gaz-voshod.ru gentamicineyedrops.blogspot.com
gearcraft.us getlaid-xxxhookupdirect.com
genericlowlatencyasiodriverhq.aircus.com gifspics.com
germetiki.com.ua girlgamerdaily.com
getmyads24.com glicol.kz
gigapeta.com gnuetella.com
girlsfuckdick.com gojiberriess.apishops.ru
glass-msk.ru goodly.pro
glogow.pl gowreckdiving.com
gosreg.amchs.ru gsasearchengineranker.xyz
haikuware.com gsasearchenginerankerhelp.com
hamilton.ca gsmlab.pl
hannasolution.ru guiadeserraazul.com
hdhc.ru guigyverpo.cf
hdpixion.com handicapvansarea.com
hesteel.pl handsandlegs.ru
hit-kino.ru hanink.biz.ly
hkladys.com hasshe.com
homedecorpicture.us hauleddes.com
howlongdoestizanidinestayinyoursystem.blogspot.com hawaiisurf.com
hreade.com high-speed1.net
htmlcorner.com hjaoopoa.top
https-legalrc.biz homelygarden.com
huimin764128.com homemature.net
hut1.ru host-protection.com
iamsport.org houdom.net
ico.re housemilan.ru
ictizanidinehcl4mg.blogspot.com hubbble.com
ilovevitaly.xyz humanorightswatch.org
impotentik.com husky-shop.cz
infodocsportal.com icaseclub.ru
integritylandscapeservices.com iframe-toloka.com
intellego.info igadgetsworld.com
istripper.com igru-xbox.net
it-max.com.ua imagefinder.site
ivoiretechnocom.ci images.gyffu.com
ix20.ru imitex-plus.ru
izismile.com imk.com.ua
import-sales.com
infospot.pt
insurple.com
internet-apteka.ru
intervsem.ru
inzn.ru
iqoption.com
iradiology.ru
jasonpartington.com
javlibrary.cc
jerseychinabizwholesale.com
jerseywholesalebizchina.com
jewelryandfiligree.com
johnrobertsoninc.com
jongose.ninja jongose.ninja
jose.mulinohouse.co
jpcycles.com
justprofit.xyz justprofit.xyz
jyrxd.com jwcialislrt.com
kandidos.com kaliningrad.zrus.org
keywordblocks.com kashubadesign.ru
kichenaid.ru katushka.net
kino-fun.ru kenaba.su
kino2018.cc kerch.site
kmd-pto.ru kerwinandcariza.com
kollekcioner.ru keywordsuggests.com
koronirealestate.gr kinky-fetishes.com
kozhniebolezni.com kinoflux.net
kredit-blog.ru klejonka.info
kursy-ege.ru kmgamex.cf
lampokrat.ws knowyournextmove.com
lancheck.net ktotut.net
landoftracking.com ku6.com
lasvegaslockandsafe.com labelwater.se
lawyersinfo.org lakomka.com.ua
levaquin750mg.blogspot.com lanasshop.ru
lezbiyanki.net laptop-4-less.com
libertybilisim.com laserpen.club
lifeinsurancekb.com law-check-eight.xyz
linkarena.com lolnex.us
llastbuy.ru lombardfinder.ru
lomb.co lottospring.com
low-format.ru
lulea-auktionsverk.se lulea-auktionsverk.se
lyrster.com lumb.co
m0r0zk0-krava.ru lunchrock.co
m3gadownload.pl luxup.ru
magazintiande.ru mac-shield.com
maladot.com magda-gadalka.ru
mall.uk magiadinamibia.blogspot.com
malwareremovalcenter.com marblestyle.ru
manyresultshub-a.akamaihd.net marinetraffic.com
mb140.ru marmitaco.cat
mcnamaratech.com mcadamssupplyco.com
mediawhirl.net meddesk.ru
megaapteka.ru medicineseasybuy.com
member-quiz.com megakino.net
meget.co.za
methodsmarketing.com methodsmarketing.com
micasainvest.com mmoguider.ru
mil-stak.com
mindbox.co.za
mindeyegames.com
minharevisao.com
mixed-wrestling.ru
mixtapetorrent.com
mmog-play.ru
mnogabukaff.net mnogabukaff.net
mobile.ok.ru modnie-futbolki.net
moetomnenie.com moncleronline.xyz
moinozhki.com moncleroutletonline.xyz
moivestiy.biz monclervests.xyz
mojpreskumanie.com money-every-day.com
morf.snn.gr moneyteam24.com
mosrif.ru monthlywinners.com
mostantikor.ru moomi-daeri.com
mouselink.co most-kerch.org
mp3films.ru movies-in-theaters.net
muz-tracker.net mowser.com
myblogregistercm.tk musicas.baixar-musicas-gratis.com
myliveblog.ru muztops.ru
mymercy.info mypornfree.ru
myra.top naperehresti.info
naval.jislaaik.com naval.jislaaik.com
neks.info news-readers.ru
nero-us.com newstudio.tv
networkcheck.xyz next-dentists.tk
newtechspb.ru
nhl17coinsforps3.gratisblog.biz nhl17coinsforps3.gratisblog.biz
nicovideo.jp nikitabuch.com
nl.netlog.com nisuturnetdgu.tk
nootrino.com nodup.ru
nrv.co.za notebook-pro.ru
nufaq.com npoet.ru
nullrefer.com nyfinance.ml
o333o.com nzfilecloud.weebly.com
odoratus.net o-o-8-o-o.ru
office2web.com obesidadealgarve.com
offtime.ru oconto.ru
ok.ru oecnhs.info
online-podarki.com offer.wpsecurity.website
onlyporno.ru offside2.5v.pl
orion-code-access.net olgacvetmet.com
ororodnik.goodbb.ru olvanto.ru
paclitor.com onlinadverts.com
paidonlinesites.com online.ktc45.ru
panchro.xyz onload.pw
paparazzistudios.com.au onthemarch.co
paphoselectricianandplumber.com openlibrary.org
parajumpersstore.online orsonet.ru
paramountmarble.co.uk osagonline.ru
parfusale.se osoznanie-narkotikam.net
partner-trustworthy.men ostroike.org
parvezmia.xyz paintingplanet.ru
pb-dv.ru paradontozanet.ru
petsblogroll.com pateaswing.com
picsfair.com paydayonlinecom.com
picturesmania.com pc-services.ru
pirateday.ru pdns.download
piter.xrus.org pestomou.info
pix-hd.com photo.houseofgaga.ru
plastgranar.nu piccshare.com
plugingeorgia.com picphotos.net
pobeiranie.pl picture-group.com
pons-presse.com picurams.pw
popcash.net pihl.se
poquoson.org pixgood.com
porndroids.com plastgran.com
pornhub-ru.com platinumdeals.gr
porno-chaman.info playboyfiles.xblog.in
porno-video-chati.ru playfortuna-play.ru
pornofiljmi.com pokerniydom.ru
pornophoto.xyz polytopesexempt.com
pornpost.in popander.mobi
pricheskaonline.ru popmarker.com
primedice.com popugauka.ru
printie.com pornhub-forum.ga
produkto.net porno-play.net
prodvigator.ua portnoff.od.ua
prohoster.info poshiv-chehol.ru
proposal-engine.com pretty-mart.com
pts163.ru pro-poly.ru
qcstrtvt.bloger.index.hr promoheads.com
quelle.ru proprostatit.com
quick-offer.com prostitutki-novgoroda.org
qwarckoine.com prostitutki-odessa.org
reckonstat.info proxyradar.com
relax.ru psvita.ru
purchasepillsnorx.com
purplestats.com
putevka24.ru
quality-traffic.com
quebec-bin.com
rank-checker.online
ranksonic.org
rapevideosmovies.com
redirectingat.com
refudiatethissarah.info
remont-mobile-phones.ru
remontvsamare.su
remybutler.fr remybutler.fr
renewablewealth.com rep-am.com
rewardpoll.com resant.ru
ringporno.com rethinkwasteni.info
romhacking.ru rewardit.com
rossmark.ru rixpix.ru
samolet.fr rukino.org
sampleletters.net runofilms.ru
sashagreyblog.ga rvtv.ru
scanner-fred.top sajatvelemeny.com
scanner-josh.top sakhboard.ru
scanner-mark.top samara.rosfirm.ru
scoopquest.com sammlungfotos.online
search.pch.com saneitconsulting.com
searchimage.co sanjosestartups.com
searchkut.com sanyuprojects.com
seccioncontrabajo.com satellite.maps.ilovevitaly.com
securesmrt-dt.com scanhub.ru
seminarygeorgia59.ga scanner-elena.top
seo-smm.kz scanner-jessica.top
seocdvig.ru scat.porn
seotoolsagency.com schalke04fc.info
serving.adbetclickin.pink seasaltwithfood.com
sexad.net segol.tv
sextracker.de seksotur.ru
sharebutton.net serpstat.com
shillyourcoins.com sex-foto.pw
sex-znakomstva.online
sexkrasivo.net
sexphoto.site
sfd-chess.ru
ship-marvel.co.ua ship-marvel.co.ua
shitmovs.com
shop-electron.ru
shtaketniki.kz shtaketniki.kz
sibdevice.ru signoredom.com
site-auditor.online signx.info
site-speed-checker.site sildenafil-tadalafil.info
siteaero.com sixcooler.de
skuteczna-dieta.co.pl skyway24.ru
slavkokacunko.de sledstvie-veli.net
smartadserver.com sloopyjoes.com
smartpet.ru smallseotools.com
social-buttons.xyz smartbalanceworld.com
soietvousmaime.fr snip.tw
spb.ru spaceshipad.com
spbchampionat.ru spamnuker.com
spinazdrav.ru sps-shop.com
spymac.net statoutlook.info
sr-rekneskap.no stauga.altervista.org
star61.de stefanbakosab.se
stjamesschool.info strana-krasoty.ru
studiofaca.com strangeduckfilms.com
suhanpacktech.com strongsignal-a.akamaihd.net
sunflowerdrawingpaintings.blogspot.com studentguide.ru
superkanpo.com studiofmp.com
supernew.org styro.ru
svarkagid.com supermesta.ru
svensk-poesi.com swimpool.ca
swagbucks.com sygraem.com
szamponrevita.pl
t-bygg.com
tacbibirfa.tk
tackletarts.co tackletarts.co
teenforporn.com takethatad.com
tetracsaudi.com taxi-v-eisk.ru
texbaza.by telegramdownload10.com
tgtclick.com
thebestphotos.eu thebestphotos.eu
thefds.net thefds.net
thewebsitetemplate.info tilido.com
thruport.com timeallnews.ru
tizanidineformigraines.blogspot.com titan-ads.life
tizanidinesideeffectsweightloss.blogspot.com titangel-vietnam.com
tonivedu.it tizanidine4mguses.blogspot.com
top-deal.com.pl tizanidinehcl4mgtablet.blogspot.com
top10-way.com tizanidinesideeffects.blogspot.com
topcasinoratings.ru tkanorganizma.ru
torontoplumbinggroup.com todohr.com
torrent-newgames.com toonfamilies.net
torrents.cd torrents.cd
toursmaps.com tozup.com
tpu.ru
tracfone.com
track-rankings.online track-rankings.online
track.deriv.com track.deriv.com
traffic-club.info tracksz.co
traffic100.com traderzplanet.in
traffic2money.com tubeline.biz
trafficgenius.xyz
trafficmonetize.org
trk-4.net
trkdf.com
truck-land.life
tubeoffline.com
tupper-posuda.ru
tupper-shop.ru tupper-shop.ru
tv-spoty.info twinderbella.com
tvand.ru ua-company.ru
ultimatesetnewfreeallsoftupgradesystems.pw ucsol.ru
univerfiles.com uggsale.online
unrealcommander.com ultramart.biz
uogonline.com upproar.com
upstore.me urzedowski.eu
uptime-alpha.net uzungil.com
uptime-as.net vacances-voyages.info
uptime-gamma.net vasileostrovsky-rayon.ru
uptime.com vbabule.net
vacuumscleaner.com videochat.mx
valuado.com videochat.tv.br
vashsvet.com vip.51.la
velobikestock.com virtuagirl.com
vesnatehno.com vita.com.hr
vesnatehno.ru vitanail.ru
video--production.com
videokrik.net
vinsit.ru
vintontech.info
vipsiterip.org
virus-respirators.com
vitalads.net
vizitki.net
vk-mus.ru
vkontarkte.com
vladimir.xrus.org
vmnmvzsmn.over-blog.com
vodaodessa.com vodaodessa.com
voditeltrezviy.ru vostoktrade.info
voloo.ru vote-up.ru
vzglyadriv.kg vpnmouse.com
watch-movies.ru vzube.com
waterefficiency.co w3data.co
wdrake.com web-analytics.date
webmasters.stackexchange.com webjam.com
webnode.me webpromotion.ae
wesharepics.com website-speed-check.site
westsextube.com website-stealer.nufaq.com
whatistizanidinehclusedfor.blogspot.com whengirlsgowild.com
whatsappdownload10.com winner7777.net
whipme.yopoint.in womens-journal.net
williamrobsonproperty.com woodyguthrie.se
womama.ru word-vorlagen.net
wordpress-crew.net works.if.ua
world-mmo.com wpsecurity.website
wowcasinoonline.ooo ws.ampower.me
x69ty.ru www.pinnacle-bets.com
xclicks.net xaylapdiendanang.com
xingzi-vision.com xblog.in
xn--80abgj3a5acid6ghs.top xboxster.ru
xn--80ahvj9e.xn--p1ai xep.info
xn--e1aggki3c.xn--80adxhks xn------7cdbapdecfd4ak1bn0amjffj7afu3y.xn--p1ai
xxxdatinglocal.us xn----7sbbagbq7bd5aheftfllo4m.xn--p1ai
xz618.com xn----8sbhefaln6acifdaon5c6f4axh.xn--p1ai
y8games-free.com xn--1-8sbcpb0bdm8k6a.xn--p1ai
yottos.com xn--80aaafbn2bc2ahdfrfkln6l.xn--p1ai
you-shall-not-pass.is74.ru xn--80aagddcgkbcqbad7amllnejg6dya.xn--p1ai
youdesigner.kz xtubeporno.net
youjizz.com xzlive.com
youradulthosting.com youandcredit.ru
youtubologia.it yourporngay.com
zakazvzloma.com yoursite.com
zarabotat-na-sajte.ru youtubedownload.org
zeroredirect.com yuarra.pluto.ro
zigarettenonlinekaufen2.drupalgardens.com yugo-star.ru
zirondelli.it za-fun-offer.com
zooggames.com zaobao.com.sg
zoompegs.com zastroyka.org
zdesformula.ru
zeroredirect1.com
zeroredirect8.com
zhuravlev.info
zigarettenonl.canalblog.com
znakomstva-piter78.ru
zoogdinsney.com
zryydi.com

472
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
1001watch.com.ua 4kplayer.pl
28n2gl3wfyb0.ru
7makemoneyonline.com
aa9d046aab36af4ff182f097f840430d51.com aa9d046aab36af4ff182f097f840430d51.com
adktrailmap.com aaronabel.com
adsland.men affiliate-fr.com
adsref.men affordablewebsitesandmobileapps.com
adultgalls.com agysya.ru
aktivator-windows10.blogspot.com alfa-medosmotr.ru
akuhni.by alif-ba-ta.com
ald2014.org alldezservice.kz
algarveglobal.com allstatesugarbowl.org
allbizne.co.ua anatomiy.com
aloofly.com anniemation.com
amazingpic.net apispringsmartne-a.akamaihd.net
ameblo.top asiavirtualsolutions.com
amigobulls.com
anabolics.shop
androids-store.com
appfastplay.com
appsecurityr.com
arate.ru
artparquet.ru
asiengirls.net
atout-energie-69.com atout-energie-69.com
aviav.eu audiofree.ru
aviva-limoux.com auto4style.ru
azartclub.org ayakino.net
beclean-nn.ru baditri.com
beetpics.pw baltgem.com
bankmib.ru
bannerbank.ru
bbsoldes.fr
beachpics.com
belstaffstore.online
bestofupload.info bestofupload.info
bezlimitko.xyz
bin-brokers.com bin-brokers.com
bkgr.se bolitgorlo.net
burkesales.com brainboosting.club
buyessay3.blogspot.ru brateg.xyz
buynorxx.com brg8.com
camel-beach.com bronzeaid-a.akamaihd.net
cashonads.com btc4u.ru
certifywebsite.win bumskontakte.org
cfsrating.sonicwall.com businesxxl.com
choice-credit.ru buypillsorderonline.com
clicksor.net buytizanidineonlinenoprescription.blogspot.com
clmforexeu.com capacitacionyaprendizaje.com
coccoc.com chatroulette.si
collegerentals.com cheapjerseysap.com
compliance-donald.xyz cheapjerseysfootballshop.com
contextualyield.com cheapmoncler.win
cordstrap.cc claytransformations.info
crackguru.tk clips.ua.ac.be
creativehutindia.com cognitiveseo.com
cwetochki.ru cometorussia.net
d2jsp.org coolgamechannel.com
darkbooks.org coop-gamers.ru
davidovic.info cornomase.win
dcj-nn.ru creatives.adbetclickin.pink
decorationspcs.com credit.co.ua
cs-passion.pl
cutt.us
damedingel.ya.ru
data-ox.com
dealitright.click
demon-tweeks.com
derevesendeco.com
dimfour.com dimfour.com
dostavimvdom.ru documentsite.net
e-kwiaciarz.pl dojki-hd.com
edwinkonijn.com.au downtuptv.gq
ekn-art.se e-commerce-seo.com
eleimgo.pw elektrozigaretten2.yn.lt
elektrozigarettekaufen1.devhub.com es5.com
elektrozigaretten1.postbit.com eu-cookie-law.info
elkacentr.ru extlabs.io
eorogo.top
euromasterclass.ru
evaashop.ru
everypony.ru
ezigarettenkaufen1.deviantart.com
fantasticpixcool.com fantasticpixcool.com
fatmaelgarny.com fillmewithhappiness.com
fdzone.org filmbokep69.com
fetlifeblog.com finuse.com
fifa-coins.online fiverr.com
find1friend.com flashlarevista.com
fotosfotos.eu flex4launch.ru
frankofficial.ru foodgid.net
fordsonmajbor.cf
forums.d2jsp.org
freevpn.space
front.to
ftns.ru
funcrushgames.com funcrushgames.com
fxund.us g.starmoe.xyz
gavuer.ru gael-s.ru
girlspicsa.com gamevalue7.weebly.com
gkvector.ru gelezki.com
goatse.ru gemara.com
gogalleryawesome.com generalporn.org
gosreg.amchs.ru get-seo-domain.com
graphicwe.org gk-atlant.info
harmonyglen.us gonextmedia.com
hccoder.info gratuitxblcodes.com
hdpixent.com greatdealshop.com
heliko.no herokuapp.com
hentaiheroes.com hit-men.men
herehloadibs.cf honyaku.yahoofs.jp
high-speed1.net houseofgaga.ru
hitcpm.com howtoclean.club
hotenergy.ru
hully.altervista.org
hunthillfarmtrust.org
ibmdatamanagement.co
ico.re
ictizanidinehcl4mg.blogspot.com
ifirestarter.ru
iframe-toloka.com
iloveitaly.ru iloveitaly.ru
infokonkurs.ru immobiliaremassaro.com
internetartfair.com impisr.edunsk.ru
irunfar.com inome.com.ua
ivanstroi.ru instakink.com
jerseychinabizwholesale.us intelhdgraphicsgtdrive6w.metroblog.com
jewelryandfiligree.com intervsem.ru
joessmogtestonly.com janavibekken.no
johnrobertsoninc.com jennyfire.ru
justucalling32211123456789.tk kabbalah-red-bracelets.com
keywordblocks.com kalandranis.gr
kinostorm.net kamalsinha.com
kostenlos-sexvideos.com kinofak.net
krasnodar-avtolombards.ru klosetkitten.com
ku6.com kosova.de
laexotic.com kreativperlen.ch
landinez.co kunstaktien.info
lapitec.eu lalalove.ru
law-check-eight.xyz landoftracking.com
ledpolice.ru laparfumotec.com
lescinq.com larutti.ru
letolove.ru laudit.ru
linkdebrideur.xyz light.ifmo.ru
livingroomdecor.info live-sexcam.tk
lol-smurfs.com liveshoppersmac.com
lolnex.us liveu.infoteka.hu
ltvperf.com llastbuy.ru
lubetube.com locimge.pw
luckyshop.net.ua lovelycraftyhome.com
macdamaged.tech macotool.com
macrotek.ru mahnwachen-helfen.info
mall.uk managerpak204.weebly.com
members.ghanaweb.com mansparskats.com
metalonly.info marketingvici.com
mezaruk.info matb3aa.com
mature.free-websites.com
mister-shop.com mister-shop.com
mitrasound.ru mmostrike.ru
mobplayer.ru mobile.ok.ru
mostantikor.ru morocco-nomad-excursions.com
motherboard.vice.com movpod.in
mrpornogratis.xxx moyaterapiya.ru
mygameplus.com mriyadh.com
mymobilemoneypages.com mrsdalloways.com
myplaycity.com myxdate.info
negociosdasha.com nailsimg.com
nikhilbahl.com narkologiya-penza.ru
niki-mlt.ru neobux-bg.info
nordvpn.com nevansk.ru
nullrefer.com newhairstylesformen2014.com
o-o-6-o-o.ru nextconseil.com
o00.in nfljerseys.online
okout.ru niroo.info
okuos.com nonews.co
osagonline.ru noumeda.com
outrageousdeal-a.akamaihd.net nsatc.net
oyster-green.com obiavo.uz
paighambot.com olgacvetmet.com
partner-trustworthy.men online-podarki.com
petitions.whitehouse.gov online7777.com
pflexads.com ozas.net
poffet.net pacificair.com
pornosok.ru paleohub.info
pp-budpostach.com.ua panchro.xyz
privatefx.all4invest.info pelfind.me
pskcijdc.bloger.index.hr pinkduck.ga
putevka24.ru playlott.com
quelle.ru pokerniydom.ru
quizzitch.net porto.abuilder.net
rczhan.com prefersurvey.net
rebuildermedical.com promover.org
redirlock.com rebelmouse.com
refudiatethissarah.info
regionshop.biz
registratciya-v-moskve.ru registratciya-v-moskve.ru
renhacklids.tk responsinator.com
responsive-test.net roofers.org.uk
rfid-locker.co ruspdd.com
ric.info saddiechoua.com
s-forum.biz sanatorrii.ru
sarahmilne.top sanyuprojects.com
searchlock.com sardinie.us
secret.xn--oogle-wmc.com seo-prof1.xyz
seoanalyses.com seokicks.de
seojokes.net seorussian.ru
seonetwizard.com
sexkontakte-seite.com sexkontakte-seite.com
sexphoto.site sexpartygirls.net
sexsaoy.com sextracker.be
sfj-ror.no shtaketniki.ru
sibecoprom.ru simply.net
signoredom.com sitevalued.com
simple-share-buttons.com sluganarodu.ru
simul.co souvenir.cc
sitechecker.pro spinazdrav.ru
smartpet.ru spylog.com
social-s-ggg.xyz sr-rekneskap.no
social-s-hhh.xyz sstroy44.ru
sptslmtrafms.com
spywarebegone.com
stair.registrydomainservices.com stair.registrydomainservices.com
stroyplus.ru stairliftsarea.com
students-cheapskate.ml starpages.net
surcentro.com sticken.co
testingads.pro studiokamyk.com.pl
tgtclick.com surfbuyermac.com
theporndude.com susanholtphotography.com
tamada69.com
tdsing.ru
thegamerznetwork.com
thesmartsearch.net
timeallnews.ru
timetorelax.biz
tizanidinehcl4mgisitanarcotic.blogspot.com tizanidinehcl4mgisitanarcotic.blogspot.com
tizanidinestreetprice.blogspot.com tksn.ru
tizanidinevssoma.blogspot.com torrentred.games
topdownloads.ru tversvet.ru
traffic2money.com uggsale.online
trafficmp.com unitexindia.com
truebeauty.cc uptime-alpha.net
tuberkuleznik.ru uptime-delta.net
tula.howotorg.ru vandrie-ict.nl
txxx.com venta-prom.ru
u555u.info video-chat.in
ukrtvory.in.ua videtubs.pl
uzungil.com vielporno.net
validdomain.xyz vladimir.xrus.org
vektorpress.ru voditeltrezviy.ru
vellings.info voluumtrk.com
vipms.ru voronezh.xrus.org
visionwell.com.cn vse-pesni.com
vksaver-all.ru vzglyadriv.kg
web.cvut.cz w3data.co
webcamtalk.net webpromotion.ae
westen-v.life wheelchairliftsarea.com
wfb.hatedriveapart.com workle.website
where-toget.com wowas31.ucoz.ru
worldhistory.biz ww2awards.info
woweb.com.ua www.ehscloud.cn
ws.ampower.me www.kabbalah-red-bracelets.com
x-diesel.org wyniki-lista.pl
x-true.info x-diesel.biz
xep.info xingzi-vision.com
xn----9sbubg3ambdfl1j.xn--p1ai xn-----8kcatubaocd1bneepefojs1h2e.xn--p1ai
xn--d1abj0abs9d.in.ua xn----itbkqkfiq.xn--p1ai
xn--e1afanlbnfckd7c3d.xn--p1ai xn--80aanaardaperhcem4a6i.com
xtraffic.plus xportvusbdriver8i.snack.ws
xxart.ru xpresscare.ru
yellowstonesafaritours.com
yoshkarola.zrus.org
youbrainboost.asia youbrainboost.asia
youghbould.wordpress.com yougetsignal.com
yur-p.ru zebradudka.com
za-fun-offer.com zhongwenlink.com
zooggames.com znakom.sibtest.ru
zvezdagedon.ru zscaler.net
zynax.ua

10
dev-tools/test_units/ratelimittest-beta.txt
View file

@ -581,4 +581,14 @@
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html> </html>

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.68 0; 10.1.1.68 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.09.3337 ### Version: V4.2022.09.3338
### Updated: Wed Sep 7 22:01:29 UTC 2022 ### Updated: Thu Sep 8 10:03:29 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.09.3337 ### Version: V4.2022.09.3338
### Updated: Wed Sep 7 22:01:29 UTC 2022 ### Updated: Thu Sep 8 10:03:29 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##