vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-05 20:20:02 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2022.01.2844 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2022-01-10 10:09:23 +00:00
parent e6576329f2
commit 6ca00e3f97
47 changed files with 69504 additions and 69494 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.01.2843 #### Version: V4.2022.01.2844
#### Bad Referrers Blocked: [7087](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7087](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [632](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [632](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.01.2843 #### Version: V4.2022.01.2844
#### Bad Referrers Blocked: [7087](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7087](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [632](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [632](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -13,7 +13,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2022.01.2843 #### Version: V4.2022.01.2844
#### Bad Referrers Blocked: [7087](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7087](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [632](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [632](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

8550
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2022.01.2843 #### Version: V4.2022.01.2844
#### Bad Referrers Blocked: [7087](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7087](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [632](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [632](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

8554
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

8554
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

8554
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

8554
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.19 1; 10.1.1.111 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.19 0; 10.1.1.111 0;
127.0.0.1 0; 127.0.0.1 0;

8554
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.19 1; 10.1.1.111 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.19 0; 10.1.1.111 0;
127.0.0.1 0; 127.0.0.1 0;

8554
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.19 1; 10.1.1.111 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.19 0; 10.1.1.111 0;
127.0.0.1 0; 127.0.0.1 0;

8554
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
2843 2844

8554
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

8554
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
23.99.195.111 0; 20.127.116.24 0;

8554
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.19 1; 10.1.1.111 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.19 0; 10.1.1.111 0;
127.0.0.1 0; 127.0.0.1 0;

8554
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.19 1; 10.1.1.111 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.19 0; 10.1.1.111 0;
127.0.0.1 0; 127.0.0.1 0;

8554
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.19 1; 10.1.1.111 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.19 0; 10.1.1.111 0;
127.0.0.1 0; 127.0.0.1 0;

8554
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
23.99.195.111 0; 20.127.116.24 0;

8554
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
23.99.195.111 0; 20.127.116.24 0;

8554
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.19 1; 10.1.1.111 1;
127.0.0.1 1; 127.0.0.1 1;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
BackDoorBot 360Spider
Buck Backlink-Ceck
EyeNetIE Mr.4x3
Fuzz Nikto
Pavuk Pockey
SpaceBison RankActive
WebmasterWorldForumBot SMTBot
Wotbox Site Sucker
Zauba check1.exe
evc-batch facebookscraper

286
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
01h4x.com
360Spider
404checker 404checker
ADmantX
ASPSeek ASPSeek
Aboundex AiHitBot
Alligator Aipbot
Anarchie Alexibot
AlphaBot
Anarchy Anarchy
Ankit Anarchy99
Anthill
Apexoo Apexoo
Aspiegel
Attach Attach
AwarioSmartBot BLEXBot
BBBike
BDCbot
BackStreet BackStreet
BacklinkCrawler Backlink-Ceck
Barkrowler Barkrowler
Bitacle BetaBot
Black Hole
BlackWidow BlackWidow
Blackboard
Blow Blow
BlowFish BlowFish
Brandprotect Boardreader
Brandwatch
Bullseye Bullseye
BuzzSumo BunnySlippers
Cegbfeieh CSHttp
CheTeam CheTeam
CherryPicker
Citoid
Cliqzbot Cliqzbot
Cloud mapping Cloud mapping
Cocolyzebot Cocolyzebot
Collector Copier
Copyscape Cosmos
Crescent Crawling at Home Project
Curious CrunchBot
Custo DIIbot
DBLBot
DSearch
DTS Agent
DataCha0s
Demon
Devil Devil
Dirbuster Dirbuster
Disco
Discobot Discobot
Dispatch
DittoSpyder DittoSpyder
DomCopBot DnBCrawler-Analytics
DomainCrawler DomainSigmaCrawler
Dotbot DomainStatsBot
EMail Siphon Drip
EMail Wolf ECCP/1.0
EasyDL
Ebingbong
Ecxi
EirGrabber EirGrabber
EroCrawler
Evil Evil
Exabot Exabot
Express WebPictures
ExtLinksBot
Extractor
ExtractorPro ExtractorPro
Extreme Picture Finder Extreme Picture Finder
EyeNetIE FDM
FemtosearchBot FemtosearchBot
Fimap Fimap
FyberSpider Firefox/7.0
FrontPage
Fyrebot Fyrebot
GT::WWW GalaxyBot
Genieo Genieo
GermCrawler GermCrawler
GetRight
GetWeb GetWeb
Go!Zilla Go!Zilla
GoZilla GoZilla
Gotit Grafula
GrapeshotCrawler HMView
HEADMasterSEO HTMLparser
HTTrack
Haansoft Haansoft
Harvest Harvest
Hloader Heritrix
Humanlinks
IDBTE4M
IDBot IDBot
Iblog Image Fetch
Image Sucker
IndeedBot IndeedBot
Indy Library
InfoTekies InfoTekies
InterGET
InternetSeer
Iria Iria
Iskanie Iskanie
IstellaBot IstellaBot
JamesBOT JOC Web Spider
Jetty
JikeSpider
Jorgee
Jyxobot Jyxobot
Kenjin Spider
Keyword Density Keyword Density
LNSpiderguy Kozmosbot
LWP::Simple LWP::Simple
Larbin Lftp
LexiBot LibWeb
LieBaoFast Libwhisker
Likse Lightspeedsystems
Linkbot LinkWalker
Linkdexbot LinkpadBot
Lipperhey LinksManager
Lipperhey Spider
Lmspider
MFC_Tear_Sample MFC_Tear_Sample
MIDown tool MIDown tool
MIIxpc
MJ12bot MJ12bot
MQQBrowser MSFrontPage
MSIECrawler Magnet
Majestic-SEO Majestic-SEO
Mass Downloader Mass Downloader
Masscan Masscan
Mata Hari Mata Hari
Mb2345Browser Meanpathbot
MeanPath Bot MicroMessenger
Mediatoolkitbot Mister PiX
Metauri
Microsoft Data Access
Moblie Safari Moblie Safari
Mozlila Mojeek
NPbot Morfeus Fucking Scanner
Nameprotect Mr.4x3
Navroad
Needle Needle
Nessus Net Vampire
NextGenSearchBot NetSpider
Nettrack
Nikto Nikto
NimbleCrawler Nimbostratus
Nmap
Not
Nutch Nutch
Offline Explorer Octopus
Offline Navigator Offline Navigator
OpenLinkProfiler OutfoxBot
OpenVAS
Openvas
OrangeBot
OutclicksBot
PECL::HTTP
PHPCrawl PHPCrawl
POE-Component-Client-HTTP POE-Component-Client-HTTP
PageAnalyzer PageAnalyzer
PageThing.com Pandalytics
Panscient Panscient
Papa Foto
Pavuk Pavuk
PeoplePal
Petalbot
Pi-Monster
Picsearch Picsearch
PictureFinder Piepmatz
Pimonster
ProPowerBot ProPowerBot
ProWebWalker
Psbot
Pu_iN Pu_iN
Pump Pump
QueryN Metasearch
Quick-Crawler Quick-Crawler
RankActive
RankFlex RankFlex
RankingBot2 RankingBot2
Rankivabot Rankivabot
Re-re Re-re
ReGet RealDownload
RebelMouse Reaper
RedesScrapy RedesScrapy
RepoMonkey RepoMonkey
Ripper Ripper
RocketCrawler
Rogerbot
SBIder SBIder
SEOkicks
SEOkicks-Robot
SEOlyticsCrawler SEOlyticsCrawler
SEOstats SEOstats
SalesIntelligent Scanbot
ScreenerBot Scrapy
ScrepyBot
Searchestate Searchestate
Seekport Semrush
SemrushBot SemrushBot
SeobilityBot SentiBot
Seomoz Shodan
Site Sucker Siphon
SiteLockSpider
SiteSucker SiteSucker
Sitebeam SlySearch
Snake Snapbot
SocialRankIOBot Sociscraper
Sosospider Sosospider
SpaceBison SpaceBison
Spammen SputnikBot
SpankBot
Sqlmap
Sqlworm Sqlworm
Sqworm Sqworm
Stripper
Sucker Sucker
SuperBot SuperBot
Surfbot SuperHTTP
T8Abot Szukacz
Telesoft
Telesphoreo Telesphoreo
The Intraformant
TheNomad
Thumbor
TightTwatBot TightTwatBot
Tracemyfile Toata
True_Robot Trendiction
TurnitinBot Turingos
Upflow Turnitin
VeriCiteCrawler Twice
Virusdie VB Project
Voil Voil
Voltron
WASALive-Bot
WEBDAV
WPScan WPScan
WWW-Collector-E
WWW-Mechanize
WWW::Mechanize WWW::Mechanize
Wallpapers Wallpapers
WallpapersHD Wallpapers/3.0
WeSEE WeSEE
Web Collage Web Collage
Web Fuck Web Enhancer
Web Pix Web Sauger
Web Sucker
WebAuto WebAuto
WebCollage
WebEnhancer
WebFetch WebFetch
WebGo IS WebGo IS
WebImageCollector
WebLeacher WebLeacher
WebStripper WebPix
WebWhacker
WebZIP
Webalta Webalta
WebmasterWorldForumBot WebmasterWorldForumBot
Webster Webshag
Whatweb WebsiteExtractor
Who.is Bot
Widow
WiseGuys Robot
Woobot
Wprecon Wprecon
Xaldon WebSpider YoudaoBot
Xenu Zade
Zermelo Zitebot
ZmEu ZoomBot
ZoominfoBot ZoominfoBot
ZumBot ZumBot
adscanner ZyBorg
arquivo-web-crawler
autoemailspider
check1.exe check1.exe
clark-crawler clark-crawler
com.plumanalytics crawl.sogou.com
eCatch domainsproject.org
evc-batch facebookscraper
lwp-request heritrix
instabid
isitwp.com
lwp-trivial
meanpathbot
muhstik-scan
netEstate NE Crawler netEstate NE Crawler
probe-image-size satoristudio.net
seobility scalaj-http
seocompany.store sogouspider
seostar
serpstatbot
spyfu spyfu
sysscan
tAkeOut
trendiction.de
webpros.com webpros.com
webprosbot
x09Mozilla x09Mozilla
zauba.io xpymep1.exe

324
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
360Spider ALittle Client
404checker
404enemy
AIBOT
Abonti Abonti
Aboundex
Aboundexbot Aboundexbot
AiHitBot AfD-Verbotsverfahren
AllSubmitter Alligator
AlphaBot AlphaBot
Anarchie
Anarchy
Anarchy99 Anarchy99
Anthill Ankit
AwarioSmartBot Asterias
BDCbot BBBike
BDFetch Bandit
BLEXBot BatchFTP
BacklinkCrawler Bigfoot
Bitacle
Black Hole
BlackWidow BlackWidow
BuiltWith Blackboard
Bullseye Blow
BunnySlippers BlowFish
CSHttp BotALot
CazoodleBot Brandprotect
Buck
Buddy
Calculon
Cegbfeieh Cegbfeieh
CheeseBot
CherryPicker
ChinaClaw ChinaClaw
Citoid
Claritybot Claritybot
Cocolyzebot Cliqzbot
Collector Collector
Copier
Copyscape
Craftbot
Crawling at Home Project
CrazyWebCrawler
CrunchBot
Curious Curious
CyotekWebCopy Custo
DIIbot DIIbot
DTS Agent Demon
DataCha0s Deusu
Devil Disco
Discoverybot Discoverybot
DittoSpyder DnyzBot
DnBCrawler-Analytics DomainAppender
DomCopBot DomainCrawler
DomainSigmaCrawler DomainSigmaCrawler
DomainStatsBot
Domains Project Domains Project
Download Wonder Dragonfly
Drip ECCP/1.0
EMail Siphon
EMail Wolf
EasyDL EasyDL
Ebingbong
Ecxi
Evil
Exabot
Extractor Extractor
ExtractorPro
Extreme Picture Finder Extreme Picture Finder
EyeNetIE Ezooms
FDM
FHscan
Firefox/7.0 Firefox/7.0
Foobot Foobot
Fuzz FyberSpider
Fyrebot G-i-g-a-b-o-t
GT::WWW GT::WWW
Genieo GetRight
GermCrawler
GetWeb
Getintent Getintent
Gigabot
Go!Zilla Go!Zilla
Go-Ahead-Got-It Go-Ahead-Got-It
GoZilla
Gotit
GrabNet
Grabber
GrapeFX GrapeFX
GridBot GrapeshotCrawler
HTMLparser Haansoft
HTTP::Lite
Harvest Harvest
Havij Heritrix
Humanlinks
IDBTE4M IDBTE4M
IDBot IDBot
IRLbot Id-search
Image Fetch
Image Sucker Image Sucker
Intelliseek InfoNaviRobot
InternetSeer InterGET
IstellaBot
JOC Web Spider JOC Web Spider
JetCar JamesBOT
Jetty JennyBot
Joomla Jorgee
Jyxobot JustView
Kozmosbot
LWP::Simple LWP::Simple
Lanshanbot Lanshanbot
Larbin LeechFTP
LeechGet
LexiBot LexiBot
Lftp Lftp
Lightspeedsystems LinkScan
Likse LinkextractorPro
LinkWalker LinksManager
Linkbot
Linkdexbot
LinqiaMetadataDownloaderBot
LinqiaRSSBot
Lipperhey
Lipperhey Spider Lipperhey Spider
Litemage_walker
Ltx71 Ltx71
MFC_Tear_Sample
MIDown tool MIDown tool
MIIxpc MSIECrawler
MJ12bot Mag-Net
Magnet
Majestic SEO Majestic SEO
MarkMonitor Majestic-SEO
MarkWatch Masscan
Mass Downloader
Mata Hari Mata Hari
MauiBot
MeanPath Bot
Mediatoolkitbot Mediatoolkitbot
MegaIndex.ru
MicroMessenger MicroMessenger
Mojeek Minefield
Mojolicious Morfeus Fucking Scanner
Msrabot NPbot
NICErsPRO Navroad
Nessus
Net Vampire Net Vampire
NetAnts NetAnts
NetMechanic NetMechanic
NetZIP Nettrack
Netvibes Nibbler
NextGenSearchBot Niki-bot
NimbleCrawler Ninja
Nimbostratus
Nmap
Nuclei Nuclei
Offline Explorer Offline Explorer
OrangeBot OpenVAS
OrangeSpider OutclicksBot
OutfoxBot PECL::HTTP
POE-Component-Client-HTTP Page Analyzer
PageAnalyzer PageThing.com
PageGrabber Panscient
PageScorer Petalbot
Pandalytics Picsearch
Papa Foto Pockey
Pavuk
Pi-Monster
Piepmatz
Pixray
ProWebWalker ProWebWalker
Probethenet Probethenet
Pu_iN Pump
PxBroker RankingBot
PyCurl
Quick-Crawler
RSSingBot
RankFlex
Rankivabot Rankivabot
RealDownload RealDownload
RebelMouse RebelMouse
Recorder
RocketCrawler
SBIder SBIder
SEOlyticsCrawler SEOlyticsCrawler
Scanbot SEOprofiler
SalesIntelligent
ScanAlert
ScoutJet
Scrapy Scrapy
Screaming SearchmetricsBot
Seekport SemanticJuice
Semrush
SemrushBot
SentiBot
SeoSiteCheckup
SeobilityBot SeobilityBot
Seomoz Shodan
SiteLockSpider Site Sucker
SiteSnagger SiteExplorer
Siteimprove
Sitevigil Sitevigil
Snapbot SlySearch
SocialRankIOBot SmartDownload
Snake
Snoopy
Sociscraper Sociscraper
Sosospider
Sottopop Sottopop
SpaceBison
Spbot
Spinn3r Spinn3r
SputnikBot
Sqlworm Sqlworm
Steeler Steeler
Stripper Stripper
Sucker Sucker
SuperHTTP Sucuri
Surfbot SurveyBot
T8Abot Szukacz
T0PHackTeam
Teleport Teleport
Telesoft The Intraformant
Telesphoreo TheNomad
Telesphorep Toata
Thumbor
Titan
Tracemyfile Tracemyfile
Trendiction Trendiction
Trendictionbot Trendictionbot
TurnitinBot True_Robot
Twice
Typhoeus Typhoeus
URLy Warning URLy Warning
URLy.Warning
V-BOT V-BOT
VB Project VCI
Vacuum Vagabondo
VeriCiteCrawler VeriCiteCrawler
VidibleScraper
VoidEYE VoidEYE
Voil WPScan
WEBDAV
WWW-Collector-E WWW-Collector-E
WallpapersHD WWW-Mechanize
Web Collage
Web Enhancer Web Enhancer
Web Sucker Web Fetch
WebGo IS WebEnhancer
WebLeacher WebImageCollector
WebReaper WebReaper
WebSauger WebSauger
WebSucker WebWhacker
WebZIP Webster
Webalta
WebsiteQuester
Whack
Whacker
Whatweb Whatweb
WinHTTrack Who.is Bot
WiseGuys Robot Widow
Wonderbot
Wotbox
Xaldon_WebSpider Xaldon_WebSpider
Xenu
YoudaoBot YoudaoBot
adscanner Zauba
archive.org_bot Zermelo
arquivo.pt Zitebot
ZoomBot
ZoominfoBot
ZyBorg
arquivo-web-crawler
check1.exe
clark-crawler
coccocbot-web coccocbot-web
cognitiveseo
com.plumanalytics
crawler.feedback crawler.feedback
demandbase-bot
domainsproject.org domainsproject.org
eCatch
facebookscraper facebookscraper
instabid gopher
isitwp.com heritrix
lwp-trivial ips-agent
lwp-request
magpie-crawler
mediawords mediawords
muhstik-scan muhstik-scan
netEstate NE Crawler
oBot oBot
polaris version pcBrowser
plumanalytics
probe-image-size
s1z.ru s1z.ru
seocompany.store satoristudio.net
serpstatbot scalaj-http
sexsearcher scan.lol
sitechecker.pro seobility
siteripz siteripz
spyfu ubermetrics-technologies.com
tAkeOut
trendiction.de
voyagerx.com voyagerx.com
x09Mozilla webgains-bot
xpymep1.exe zgrab

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
backlink4u.net bagsonsale.online
bio.trade-jp.net datract.com
elektrozigarettekaufen1.devhub.com dealwifi.com
hermesbracelets.xyz leadn.pl
iqoption.pro popmarker.com
lazymanyoga.com ranksonic.info
mrwhite.biz seozoom.it
qpypcx.com vashsvet.com
solmarket.by witherrom55.eklablog.fr
tizanidinedosage.blogspot.com xn--e1aggki3c.xn--80adxhks

942
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
00it.com 100searchengines.com
108shot.com 101flag.ru
123kuma.com 11pikachu.ru
1stat.ru 1688.com
2015god.org 178evakuator178.ru
256bit.by 2000k.ru
3dracergames.com 20pascals.nl
404.mn 2daytrendingnews.com
4replicawatch.net 2kata.ru
57883.net 3xforum.ro
72-news.com 8jn.dating-app.ru
883zy.com 8xv8.com
8kisses.eu aa81bf391151884adfa3dd677e41f94be1.com
9med.net aac500b7a15b2646968f6bd8c6305869d7.com
a.pr-cy.ru aac52006ec82a24e08b665f4db2b5013f7.com
aasoldes.fr acmebtn.ml
abovetherivernc.com actices.com
academiacsmendoza.org adhome.biz
adamoads.com adobereader-free.ru
adultgalls.com adrenalin-stk.ru
adventureparkcostarica.com adzerg.com
ahrefs.com affrh2015.com
airlandsea.info afslankpillen2017nl.eu
allesohnegirls.net alibestsale.com
allnews24.in alice.it
allpdfmags.net all-streaming-media.com
amung.us allbizne.co.ua
android-style.com alpharma.net
apiitsthirteende-a.akamaihd.net amateurgalls.com
apple.com-webbrowsing-security.review amyfoxfitness.com
arclk.net android4fun.org
arenanews.com.ua angel1777.kz
arenda-avtoprokat-krasnodar.ru animal36.com
asmxsatadriverin.aircus.com animalia-life.club
atmovs.com animebox.com.ua
babyfactory.fr anti-virus-removal.info
baksman.com apccargo.com
bankofthewext.com aproposde.com
beachtoday.ru arabgirls.adultgalls.com
beclean-nn.ru arius.tech
bestbrainprod.win atmagroup.ru
bestcoin.cc ausmepa.org.au
autodo.info
autolombard-krasnodar.ru
aviav.ru
aviva-limoux.com
ayanaspa.com
azartclub.org
bablonow.ru
bagcionderlab.com
bard-real.com.ua
basisches-wasser.net
begalka.xyz
berrymall.ru
best-way.men
besthomemadepornsites.com
bestimagecoollibrary.com bestimagecoollibrary.com
bestplacetobuyeriacta.jw.lt bestmarriages.com
bg6s0.com bestwaystogetpaid.us
bestwebsitesawards.com
bfz.biz
bif-ru.info
biglistofwebsites.com
binomo.kz
bio-japan.net
bioca.org bioca.org
bitcoinpile.com bjetjt.com
bizcheapjerseyswholesalechina.com blogos.kz
biznesschat.net bloke.com
bloggen.be bmwhighperformers.com
bloglag.com bobinoz.com
blogqpot.com bocoarchives.org
bmsco.co bongiornos.info
bmw-ark.ru bonkers.name
boazpower.com braip.com.br
bobba.dzaba.com brg8.com
bonvillan.com brimstonehillfortress.org
boom-celebs.com bscodecs.com
bouda.kvalitne.cz btvn.ru
brandbucket.com budpost.com.ua
brateg.xyz bugof.gq
briomotor.co calvet.altervista.org
budilneg.xyz camdenmemorials.com
bugshoot.cn cartechnic.ru
businesn.men cartierring.xyz
buy-cheap-online.info cbozhe.com
callejondelpozo.es cctva.tv
candiceloves.us cdnnetwok.xyz
canrole.com cellfun.mobi
canyougethighofftizanidine.blogspot.com cheapjerseysbizwholesale.us
carloans.com cheapmarmot.online
carmuffler.net cheapmoncler.pw
carson.getenjoyment.net
casablancamanor.co.za
cejewelry.xyz
chatroulette.video
cheapmoncler.win
check-this-out-now.online
chee-by.biz chee-by.biz
chelyabinsk.xrus.org chimiver.info
chocolateslim-en-espana.com choosecuisine.com
cibpenonptib.flu.cc christianlouboutinsaleonline.us
cicaki.net citizenclsdriveri7.pen.io
clean-start.net clarithromycin500mg.com
clipartnew.com cleanpcnow.com
club-samodelkin.ru clevernt.com
co.lumb.co clickso.com
cocolyze.com clothesforcash.com
codysbbq.com cmd.kz
companies-catalog.com cometorussia.net
compliance-checker.info compliance-elena.xyz
compliance-george.top compliance-josh.top
compliance-irvin.top compliance-walter.top
computernetworksonline.com concordexoticrentals.com
cookingmeat.ru cool-wedding.net
coolwallpapers4k.info copro.pw
cpajunkies.com cottageofgrace.com
creams.makeforum.eu counter.yadro.ru
data1.scopich.com cubook.supernew.org
dengi-pod-zalog-nedvizhimosti.ru dalavia.ru
depositfiles-porn.ga damasarenai.info
destinationrealestate.com daneshetabiat.com
detskie-zabavi.ru darkages.info
detsky-nabytek.info data.vtc.pw
dev.citetick.com dataloading.net
diamond-necklace.info dbmkfhqk.bloger.index.hr
digital-video-processing.com delfin-aqua.com.ua
dimfour.com dentalpearls.com.au
domain-submit.info detskie-konstruktory.ru
domaincdn.xyz dev33.dioniqlabb.se
devochki.top
dildofotzen.net
distver.ru
dividendo.ru
docsportal.net
doktoronline.no
domain2008.com
domoysshop.ru domoysshop.ru
doreenblog.online domznaniy.ru
doublepimp.com downloader12.ru
dprtb.com druzhbany.ru
driving.kiev.ua dtnlyss.com
dstroy.su dynainbox.com
dustyorate.com educatemetv.com
dwomlink.info ege-russian.ru
e-buyeasy.com ekosmetyki.net.pl
e-c.al el-nation.com
easyshoppermac.com electrik-avenue.com
ebonyporn.site elektrischezigaretten1.blogse.nl
ecommerce-seo.com elektrischezigaretten2.beeplog.com
eduinfosite.com elexies.info
ekn-art.se englishdictionaryfree.com
elektrischezi.canalblog.com enpolis.ru
elektrischezigarettekaufen2.cowblog.fr ertelecom.ru
elitedollars.com escortslet.net
elitepcgames.com etenininrade.ga
erotik-kostenlos.net
errorfixing.space
eu-cookie-law.blogspot.com
event-tracking.com event-tracking.com
ewebarticle.info evogarage.com
expresstoplivo.ru
eyelike.com.ua
ez8motelseaworldsandiego.com ez8motelseaworldsandiego.com
ezigarettekaufen.myblog.de ezb.elvenmachine.com
ezigarettenkaufen2.dreamwidth.org
f-loaded.de f-loaded.de
f00kclan.de f-online.de
falcon-images.blogspot.com fast-wordpress-start.com
farm26.ru fealq.com
farmprofi.net feargames.ru
fba-mexico.com femmesdenudees.com
feeriaclub.ru fickluder69.com
fefo.gdn fikasound.tk
fickenprivat.info filerockstar298.weebly.com
filmfanatic.com filesvine.com
fiuxy.com fillmewithhappiness.com
fix-website-errors.com flooringinstallation-edmonton.com
flauntyoursite.com flprog.com
forminecrafters.ru forminecrafters.ru
forpostlock.ru forodvd.com
forum-engineering.ru fortunejack.com
forumprofi.de foxydeal.com
fotzen-ficken.com franecki.net
foxjuegos.com freesitetest.com
free-share-buttons.blogspot.com freewhatsappload.com
froggytube.com fungirlsgames.net
ftns.ru fxgallery.com
fusoradio.info fxtips.ru
fxund.us
galaxys6manual.info galaxys6manual.info
gallerily.com geile-lelly.eu
gamedayassist.com geilehausfrauen.net
gamewrath.com gg.zzyjxs.com
gemara.com go2jump.org
getresponse.com goblacked.com
gettpromos.com gonextmedia.com
glopages.ru gotcher.us
go2mike.ru grand-chlen.ru
goatse.ru graphics8.info
gotorussia.com green-tea.tv
gourcy.altervista.org greenzaim.ru
greatidea.marketing gwebtools.com.br
gribkovye-zabolevaniya.com hd720kino.ru
gsasearchengineranker.pw herehloadibs.cf
gta-top.ru hifidesign.ru
guod.me histats.com
gymi.name hobbyhuren-datenbank.com
hao123.com
hd-filmy.net
healbio.ru
helpmymacfaster.trade
hitcpm.com
hollywoodactress.info hollywoodactress.info
homemade.gq homeandhealth.ru
host-tracker.com hostnow.men
housediz.com hostsshop.ru
hoverboard360.nl hoverboard360.se
hully.altervista.org hoverboardforsaledirect.com
hspline.com
hunterboots.online
husky-shop.cz
iamsport.org
ibmdatamanagement.co
idegenvezeto.eu
igithab.com
ihtec2019.org ihtec2019.org
ilmen.net ilovevitaly.com
ilovevitaly.xyz increasewwwtraffic.info
imfamous.info indianmedicaltourismshop.com
import-sales.com infokonkurs.ru
inclk.com infowarcraft.ru
instakink.com invest-pamm.ru
intimshop-fantasy.ru iptool.xyz
investzalog.ru iqbazar.ru
jabimgo.pw isitpaleo.info
jacago.com ivoiretechnocom.ci
jbl-charge.info janavibekken.no
jwss.cc jestr.org
keenoutlet.online johnnyhaley.top
keki.info kadashihotel.com
kellyonline.xyz kamagragelusa.net
kinobaks.com kasino-money.pw
kinohit1.ru ketrzyn.pl
kinozapas.org kfon.eu
kiprinform.com kidd.reunionwatch.com
kiwe-analytics.com klejonka.info
kletkimehan.ru kolotiloff.ru
koptims.tiu.ru kongoultry.net
kostenloser-sex.com lacloop.info
kraljeva-sutjeska.com lanadelreyfans.us
krasnodar.ru lancheck.net
kumuk.info lechenie-gemorroya.com
kurwa.win lego4x4.ru
kustanay.kz lennatin.info
lapolis.it lenvred.org
larger.io lernur.net
larutti.ru liffa.ru
law-check-seven.xyz lion.playtap.us
laxob.com
lechtaczka.net
leftofcentrist.com
legalrc.biz
letmacwork.world
letsart.ru
lexaprogeneric.link
light.ifmo.ru
limads.men
limtu.ifmo.ru
linkbuddies.com
linkredirect.biz
liran-locks.com
listiseltemournlan.gq
littlesunraiser.com littlesunraiser.com
lost-alpha.ru lkbennettoutlet.online
louboutinbooties.xyz loftdigital.eu
lubetube.com long-beach-air-conditioning.com
macotool.com lostfilm-online.ru
magicplayer-s.acestream.net lovelycraftyhome.com
mail.allnews24.in mac-shield.com
mansparskats.com maju.bluesalt.co
masserect.com manuscript.su
matsdale.com marketingtechniques.info
mature.free-websites.com matematikus.info
maxthon.com mcnamaratech.com
mediafresh.online meet-flirt-dating.com
memberty.com members.ghanaweb.com
metalonly.info mexicotravelnet.com
mir-business-24.ru mielec.pl
missclub.info mjchamonix.org
mlvc4zzw.space mobplayer.ru
mncrftpcs.com moneyzzz.ru
mnimmigrantrights.net morpicert.pw
moesen-ficken.com moscow-clining.ru
moesonce.com msk.afora.ru
moje-recenze.cz multgo.ru
monarchfind-a.akamaihd.net musflashtv.com
monclercoats.xyz musicas.baixar-musicas-gratis.com
monetizationking.net musicktab.com
moscow-region.ru my-aladin.com
most-kerch.org mybinaryoptionsrobot.com
moxo.com mykings.pw
mrinsidesales.com myxdate.info
mrvideospornogratis.xxx
musicspire.online
myblogregistercm.tk
mypornfree.ru
mywallpaper.top
nacap.ru nacap.ru
nalogovyy-kodeks.ru narkologiya-orel.ru
nardulan.com national-today-winning-winner.club
narkologiya-peterburg.ru navalwiki.info
negral.pluto.ro nelc.edu.eg
neobux-bg.info nero-us.com
netallergy.ru newstaffadsshop.club
nhl17coins.exblog.jp newyorkhotelsmotels.info
nikhilbahl.com nhl17coinsforps3.gratisblog.biz
nikitabuch.com
nofreezingmac.work
nonews.co nonews.co
november-lax.com nosecret.com.ua
nrjmobile.fr nufaq.com
nucia.biz.ly nvformula.ru
nudejapan.net o-o-6-o-o.com
nudo.ca obesidadealgarve.com
o00.in obiavo.net
oakridgemo.com okout.ru
obiavo.su onlinadverts.com
omoikiri-japan.ru online-hit.info
online-templatestore.com onlinefilmz.net
opinionreelle.com orenburg-gsm.ru
osoznanie-narkotikam.net osoznanie-narkotikam.net
otbelivanie-zubov.com page2rss.com
outclicks.net pandarastore.top
outshop.ru pb-dv.ru
paintingplanet.ru perfectplanned.com
palvira.com.ua perso.wanadoo.es
paphoselectricianandplumber.com petedrummond.com
parfusale.se phobia.us
partner-host.men pictures-and-images.net
pathwhelp.org pinapchik.com
pawli.eu
pensplan.com
picsfair.com
pio.polytopesexempt.com
pivka.xyz pivka.xyz
pojdelo.weebly.com plugingeorgia.com
popup-jdh.xyz plusnetwork.com
pornoelita.info pokemongooo.ml
pornonik.com pons-presse.com
pornosok.ru popcash.net
praisong.net poppen-nw.net
prchecker.info porndroids.com
preparevideosafesystem4unow.site pornmania.pl
printdirectforless.com porno-transsexuals.ru
producm.ru pornoklad.net
proekt-gaz.ru pornotubexxx.name
promgirldresses.xyz pozdravleniya-c.ru
promodj.com preparevideosafesystem4unow.space
proposal-engine.com privacyassistant.net
prostitutki-yaroslavlya.org privetsochi.ru
pssucai.info prlog.ru
pufip.com professionalwritingservices15.blogspot.ru
pussysaga.com proftests.net
pussyspace.net prointer.net.ua
projectforte.ru
promalp-universal.ru
prombudpostach.com.ua
pronorm.fr
prostitutki-odessa.org
purplestats.com
qexyfu.bugs3.com qexyfu.bugs3.com
r-control.ru qld10000.net
quality-traffic.com
randalljhoward.com
ranksignals.com ranksignals.com
ranksonic.org
rczhan.com
real-time-analytics.com real-time-analytics.com
rebuildermedical.com redirect.trafficreceiver.club
recipedays.com redirectme.net
redirectingat.com referencemoi.com
registry-cleaner.net regdefense.com
responsive-test.net reimageplus.com
rethinkwasteni.info rent2spb.ru
reward-survey.net repeatlogo.co.uk
ros-ctm.ru replicalouboutin.xyz
reyel1985.webnode.fr
ribieiendom.no
robertefuller.com
roofers.org.uk
rospromtest.ru rospromtest.ru
royalcar-ufa.ru royalcar-ufa.ru
roznica.com.ua rusprostitute.com
ruclicks.com rvzr-a.akamaihd.net
ruscoininvest.company rybalka-opt.ru
russian-postindex.ru sanjosestartups.com
rvi.biz sawin.beth.webd.pl
saecsa.co sayyoethe.blogspot.co.za
saletool.ru
sampleletters.net
sanyuprojects.com
sape.top
sbf441.com sbf441.com
scanner-andrew.top sbt-aqua.ru
scanner-brian.top scopich.com
scanner-jack.top scrnet.biz.ua
scanner-john.top searchaddis.com
scanner-julianna.top seeingmeerkat.com
scanner-marwin.top seo-platform.com
sdi-pme.com seo-traffic-ranking.info
seccioncontrabajo.com seoanalyses.com
security60-e.com seonetwizard.com
seksotur.ru seorank.info
servethis.com seozoom.it
serving.adbetclickin.pink servingnotice.com
sexvporno.ru sexsaoy.com
sexyebonyteen.com sextracker.be
sexytrend.ru shama-rc.net
share-buttons-for-free.com shinikiev.com.ua
sharebutton.to ship-marvel.co.ua
shareyards.com shohanb.com
sharpchallenge.com shopcheermakeup.info
simply.net siha.de
sinel.info site-speed-check.site
siteexpress.co.il siteimprove.com
sitiz.club skanninge.se
smart-balancewheel.com skincrate.net
smartadserver.com skuteczna-dieta.co.pl
snsdeainavi.info sky-mine.ru
soblaznu.net slavic-magic.ru
social-buttons.com slavkokacunko.de
social-buttons.xyz sledstvie-veli.net
soft1.ru slim.sellany.ru
soietvousmaime.fr slowmac.tech
solinf.co smadihome.com
solution4u.com smallseotools.com
sosdepotdebilan.com sneakyboy.com
souvenir.cc snow.nvr163.com
souvenirua.com social-vestnik.ru
spbchampionat.ru socialmonkee.com
spravka-medosmotr.ru softwaretrend.net
staff.prairiesouth.ca spaceshipad.com
stairliftsarea.com spamnuker.com
stats-public.grammarly.io spasswelt.net
steebook.com statustroll.com
stickers-market.ru streetfooduncovered.com
strangeduckfilms.com stroyplus.ru
stroymonolit.su students-cheapskate.ml
strv.se
studiokamyk.com.pl studiokamyk.com.pl
sudexpert66.ru stuffpride.com
supers.com.ua subj.ukr-lit.com
supervesti.ru suchenindeutschland.com
support.nopeas.sk suhanpacktech.com
surcentro.com superiends.org
surflinksmedical.com supermama.top
surintech.ac.th svetlotorg.ru
svetodiodoff.ru sweepstakes.rewardit.com
swinginwithme.ru taqplayer.info
tako3.com taranerymagesswa.blogspot.com
templates.franklinfire.co tds-advert002.info
textads.men tecspb.ru
thaisamkok.com tedxrj.com
teenforporn.com
teenfuck.tv
telefonsexkostenlos.tk
thedownloadfreeonlinegames.blogspot.com thedownloadfreeonlinegames.blogspot.com
thexart.club thegioixekhach.com
tizanidine4mguses.blogspot.com theheroes.ru
tizanidineforopiatewithdrawal.blogspot.com thenetinfo.com
tizanidinehclsideeffects.blogspot.com titan-cloud.life
tizanidineshowupondrugtest.blogspot.com tizanidineandgabapentin.blogspot.com
tizanidineusedfor.blogspot.com tizanidinecost.blogspot.com
tizanidinevssoma.blogspot.com toolsky.com
top-karkas.ru toon-families.com
top-l2.com top1-seo-service.com
topappspro.com topsy.com
torrentdownloadhub.com toyota.7zap.com
torrents.cd tracfone.com
torrents.life trackzapper.com
tracxn.com trafficnetzwerk.de
tradedeals.biz tramadolandtizanidine.blogspot.com
traffic-club.info tubo360.com
traffic100.com turizmus.us
traffmonster.info twinderbella.com
trkur.com
trudogolik.net
trustedmaccleaner.com
tubeline.biz
tula.mdverey.ru
tversvet.ru
tzritel.tk tzritel.tk
udayavani.com uasb.ru
uk-zheu20.ru uggbootsoutletsale.us
unrealcommander.biz ukrtvory.in.ua
urlcut.ru umaseh.com
usacasino.com universals.com.ua
usadacha.net unmaroll.ya.ru
usdx.us uptime.com
valmetrundan.se upupa.net
varikoz24.com url2image.com
vavilone.com uroffer.link
vbikse.com vapsy.com
via-energy-cumpara.com vegan-foods.us
viagengrarx.com verymes.xyz
video-hollywood.ru videooko.weebly.com
video-production.com videositename.com
videonsk.com vip-file.com
vinylvault.co.uk vkgaleria.com
vkak.ru vykup-avto-krasnodar.ru
vladimir.zrus.org walkme.com
vpnhowto.info wallpapers-best.com
w3data.co warezkeeper.com
wdrake.com webjam.com
webextract.profound.net
weblo.com weblo.com
weburok.com webs.com
welcomeauto.ru wellcome2slovenia.ru
westsextube.com whatsupinfoley.com
wholesalejerseys-cheapest.com whiteelephantwellington.com
winwotgold.pl wieseversa.no
wiosenny-bon-1500.pl win-spy.com
wma-x.com wineration.com
withstandingheartwarming.com
wleuaprpxuvr.ga
wnoz.de wnoz.de
worldhistory.biz womensplay.net
worldmusicfests.com wonderfulflowers.biz
worldtraveler.world www.ehscloud.cn
wygraj-teraz.com www.jbetting.com
x-diesel.info wzgyyq.com
xerox-douglas.cf xep.info
xmnb.net xlovecam.com
xn----btbdvdh4aafrfciljm6k.xn--p1ai xn--80ak6aa92e.com
xn----ctbigni3aj4h.xn--p1ai xn--b1agm2d.net
xn--80aeahghtf8ac5i.xn--p1ai xn--e1aggki3c.xn--80adxhks
xn--h1aakne2ba.xn--p1ai xpresscare.ru
xrus.org xxxtubesafari.com
xvideospornoru.com yaminecraft.ru
xxxkaz.org yellowads.men
yoshkarola.zrus.org yogamatsexpert.com
youbloodyripper.com you-shall-not-pass.is74.ru
youradulthosting.com youandcredit.ru
youraticles.pl youdao.com
youtube-downloader.savetubevideo.com youghbould.wordpress.com
youtuhe.com youjizz.vc
yugo-star.ru zarabotok--doma.ru
zambini.ru zdesformula.ru
zdesoboi.com
zeikopay.com zeikopay.com
zeroredirect12.com zeroredirect12.com
zigarettenonlinekaufen2.drupalgardens.com zoogdisany.com
zojirushi-products.ru
zolotoy-lis.ru
zrizvtrnpale.tk

484
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
100dollars-seo.com 007angels.com
101billion.com 1000n1.ru
101raccoon.ru 12bet.com
2pxg8bcf.top 13tabs.com
51unlim.ru 1xbet4you.com
aa8780bb28a1de4eb5bff33c28a218a930.com 3-letter-domains.net
aanapa.ru 7search.com
abwa.tk 9med.net
adprotect.net adanih.com
ads.tremorhub.com adconscious.com
advancedcleaner.com adman.se
afmuseum.com adsloads.com
aktobe.xkaz.org akusherok.ru
alborzan.com alert-fdm.xyz
alert-jdh.xyz alice.it
allblogroll.com allesohnegirls.net
anatomiy.com amung.us
anonymizeme.pro ananumous.ru
apartamentwroclaw.eu anmysite.com
apelsinnik.website apps-analytics.net
apiwebwebgetcom-a.akamaihd.net asiavirtualsolutions.com
arkartex.ru auto-moto-elektronika.cz
as5000.com avkzarabotok.com
asseenontvonline.ru b2b-lounge.com
autodo.info bablonow.ru
azartmsl.com bbtec.net
backuperwebcam.weebly.com beetpics.pw
betterhdporn.com beremenyashka.com
bitcoins-live.ru bestofpicture.com
biznesluxe.ru bibys.com
bjanshee.ru biteg.xyz
blockety.co boc.kz
blog.f00kclan.de book-bets.com
blogporn.in bosefux.esy.es
bmwhighperformers.com brandedleadgeneration.com
bronzeaid-a.akamaihd.net bravegirlsclub.com
brus.city brendbutik.ru
businesn.men butstrap.space
cand.jp buynorxx.com
candelluxsklep.pl buzzsumo.com
cartierlovebraceletreplica.xyz byme.se
candy-glam-hp.com
carfax.com.ua
cartierwatch.xyz cartierwatch.xyz
cenoval.ru cb.iphantom.com
cheapmoncler.xyz cbox.ws
cheapwebsitehoster.com cheapwebsitehoster.com
cherrypointplace.ca ciceros.co
christianlouboutinoutlet.win classicakuhni.ru
cityadspix.com com-secure.download
click2pawn.com compliance-alexa.xyz
cmd.kz craftburg.ru
com-cleaner.systems culad.com
compliance-julianna.top czat.wp.pl
cookie-law-enforcement-hh.xyz day-news.info
cool-wedding.net dbmkfhqk.bloger.index.hr
courtshipgift.com decorationspcs.com
culturevie.info dellalimov.com
custom-product-labels.com dikqlyremy.info
customchocolate.business-for-home.com dimkino.ru
customerguru.in
deplim.com
designdevise.com
directrev.com
divci-hry.info
dividendo.ru
djstools.com djstools.com
dneprsvet.com.ua dnepr-avtospar.com.ua
dogbreedspicture.net documentbase.net
domain2008.com dolohen.com
drillsaw.ru downloadeer.net
drugs-no-rx.info escort-russian.com
earthmagic.info eshop.md
ed-shop01.ru exchanges-bet.com
egovaleo.it extrabot.com
ekn-art.se facebook-mobile.xyz
elektrozigaretten1.webs.com fatfasts-4tmz.com
erotag.com ferretsoft.com
erotik0049.com fetlifeblog.com
espaceinventoristes.com filunika.com.ru
euronis-free.com findclan.org
everypony.ru findsexguide.com
extremepornos.net fishingwholesale.us
eyemagination.com fitness-video.net
eyes-on-you.ga florida-tourism.net
fertilitetsradgivningen.se foodgid.net
fickenprivat.info free-deals.faith
fickkontaktehobbyhuren.com freewebs.com
forpostlock.ru fsalas.com
fortevidyoze.net g.starmoe.xyz
freefoto.ca game-top.su
freevpn.space gamedayhouse.com
funtoonez.com gamesprite.me
fxgallery.com ge0ip.org
fxund.us geilehausfrauen.net
gaygalls.net ghernnqr.skyrock.com
gok-kasten.net gilbertbanda.net
golden-catalog.pro gkvector.ru
gonextmedia.com gobongo.info
goodhousekeeping.com gojiberriess.apishops.ru
greendream.com.ua goodly.pro
h2monline.com gorodservis.ru
hchha.com gsasearchenginerankerdiscount.com
hermesbelts.xyz hao123.com
hotelcrocenzi.sm happy.new.yeartwit.com
hptwaakw.blog.fc2.com harmonyglen.us
ibmdatamanagement.co hazardky.net
idegenvezeto.eu hd720kino.ru
ikritikimou.gr headpharmacy.com
indianmedicaltourismshop.com healing-dysplasia.ru
insomniagamingfestival.com hentai-manga.porn
instabid.tech homegardenlova.com
iron-age.info hothor.se
jagg.info humbmosquina.tk
jasonpartington.com hybrid.ru
journeydownthescale.info iboss.com
kaidalibor.de imgarcade.com
keki.info infobanks.ru
kino-key.info ipornox.xxx
kino-rating.ru iskalko.ru
kiprinform.com jav-fetish.com
koopilka.com kam-dom.ru
kotaku.com kamalsinha.com
kurbappeal.info karadene.com
kuzinsp.ru kevblog.top
lalalove.ru kino2018.cc
lanadelreyfans.us kit-opt.ru
landscaping.center krasula.pp.ua
lego4x4.ru kretpicf.pw
letolove.ru lampokrat.ws
localflirtbuddies.com layola.biz.tc
losangeles-ads.com leadwayau.com
lifeinsurancekb.com
lion.snapmap.us
littleberry.ru
lostaruban.com lostaruban.com
lowephotos.info mackeeper-land-672695126.us-east-1.elb.amazonaws.com
m292.info magazin-pics.ru
mactechinfo.info mailemedicinals.com
magiadinamibia.blogspot.com makis.nu
manimpotence.com marcowebonyodziezowe.pl
masserect.com mastershef.club
mebel-alait.ru medanestesia.ru
mediaoffers.click mejoresfotos.eu
medicinacom.ru mielec.pl
meendo-free-traffic.ga miniature.io
merryhouse.co.uk mirobuvi.com.ua
misandesign.se moivestiy.biz
mncrftpcs.com mossmesi.com
moinozhki.com mouselink.co
moneymaster.ru mrbitsandbytes.com
moskva.nodup.ru myplaycity.com
muznachas-service.ru neks.info
myxdate.info neobux-bg.info
napalm51.nut.cc
narkologiya-belgorod.ru
narkologiya-voronezh.ru
naturalbreakthroughsresearch.com
netanalytics.xyz
netfacet.net netfacet.net
o00.in nikitabuch.com
oddamzadarmo.eu ningessaybe.me
odoratus.net nomuos.it
oklogistic.ru ohmyrings.com
onlinetvseries.me okout.ru
ororodnik.goodbb.ru oktube.ru
outpersonals.com onlinadverts.com
page2rss.com online-podarki.com
paidonlinesites.com onlywoman.org
pateaswing.com ovirus.ru
pc4download.co ownshop.cf
pinup-casino1.ru pandroid.co
pix-hd.com partner-print.men
pliks.pl pathwhelp.org
pornohub.me pinkduck.ga
pornosmola.info piulatte.cz
priscilarodrigues.com.br pix24x7.com
privatefx.all4invest.info podshipniki-ntn.ru
prospekt-st.ru pogosh.com
q-moto.ru pornhive.org
refudiatethissarah.info privatov-zapisi.ru
projefrio.com.br
prostitutki-almata.org
quickcashlimited.com
realtytimes.com
renecaovilla.online renecaovilla.online
rennlist.com resant.ru
ringporno.com s1z.ru
ruscoininvest.company sandhillsonline.com
sack.net saratov.xrus.org
scanner-alex.top sawin.beth.webd.pl
scanner-jessica.top scanner-jack.top
score-ads.men seo-traffic-ranking.info
screentoolkit.com sexs-foto.top
sexsearch.com shoesonlinebuy.cn
shivafurnishings.com shtaketniki.kz
simon3.ru signx.info
site3.free-share-buttons.com slowmac.tech
siteonomy.com snyatie-lomki-v-stacionare.ru
skuteczna-dieta.co.pl social-s-ggg.xyz
skutecznetabletkinaporostwlosow.pl sockshare.net
sloopyjoes.com spaceshipad.com
smichovbike.cz spy-app.info
sobecjvuwa.com.ru stard.shop
sodexo.com steamoff.net
spl63.fr superkanpo.com
sports-supplements.us surfbuyermac.com
stair.registrydomainservices.com
stevemonsen.com
stroymonolit.su
svensk-poesi.com
tabletkinaodchudzanie.com.pl
tacbelarus.ru
taraz.xkaz.org
tattomedia.com tattomedia.com
teslathemes.com textads.men
tfxiq.com thaisamkok.com
thedownloadfreeonlinegames.blogspot.com thiegs.reco.ws
tiens2010.ru tiandeural.ru
timdreby.com tizanidine4mg.blogspot.com
tizanidinedosageforsleep.blogspot.com tizanidine4mgprice.blogspot.com
topsiteminecraft.com tizanidine4mgtablets.blogspot.com
traffmonster.info tizanidinenarcotic.blogspot.com
trailer.cinemaflix.website tizanidinerestlesslegsyndrome.blogspot.com
trustl.life toolsky.com
tube8.com topdownloads.ru
torrent-to-magnet.com
totu.us
traffictrade.life
trion.od.ua
trucri.me
tula.mdverey.ru tula.mdverey.ru
tyumen.xrus.org twinderbella.com
undergroundcityphoto.com uamtrk.com
uprour.com umnovocaminho.com
veerotech.com valkiria-tk.ru
venerologiya.com vegascosmetics.ru
vereo.eu vekzdorov.ru
vita.com.hr videospornogratisx.net
watch-movies.ru villacoloniale.com
waterefficiency.co viven.host.sk
waycash.net vizitki.net
waysbetter.cn vzglyadriv.kg
webmonetizer.net w3data.co
website-analytics.online w7s.ru
website-analyzer.info warning.or.kr
weprik.ru wcb.su
www.labves.ru website-audit.com.ua
xjlottery.com whatistizanidinehclusedfor.blogspot.com
xn----7sbaaabaei0cc8aj5bj0bncejx.xn--p1ai whos.amung.us
xn----7sbbagbq7bd5aheftfllo4m.xn--p1ai womens-journal.net
xn--80abgj3a5acid6ghs.top worldis.me
xn--d1aifoe0a9a.top www.ehscloud.cn
xportvusbdriver8i.snack.ws x5market.ru
xtremeeagles.net xgftnlrt.bloger.index.hr
yachts-cruise.info xn-----7kceclhb4abre1b4a0ccl2fxch1a.xn--p1ai
you-shall-not-pass.is74.ru xn----7sbifcamovvfggw9d.xn--p1ai
youbloodyripper.com xn--80atua3d.xn--p1ai
youraticles.pl xpresscare.ru
yourserverisdown.com xxx-cam.webcam
zaimhelp.ru yeartwit.com
zapatosenventa.info yousense.info
zoolubimets.ru youtoner.it
zx6.ru zaidia.xhost.ro
zeikopay.com
zeroredirect7.com
zlatnajesen.com
zoominfo.com

10
dev-tools/test_units/ratelimittest-beta.txt
View file

@ -581,4 +581,14 @@
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html> </html>

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.19 0; 10.1.1.111 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.01.2843 ### Version: V4.2022.01.2844
### Updated: Sun Jan 9 22:01:28 UTC 2022 ### Updated: Mon Jan 10 10:03:33 UTC 2022
### Bad Bot Count: 632 ### Bad Bot Count: 632
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.01.2843 ### Version: V4.2022.01.2844
### Updated: Sun Jan 9 22:01:28 UTC 2022 ### Updated: Mon Jan 10 10:03:33 UTC 2022
### Bad Bot Count: 632 ### Bad Bot Count: 632
################################################### ###################################################
### Version Information ## ### Version Information ##