vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-02 02:29:58 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2019.09.1837 [ci skip]

Browse source
This commit is contained in:
Travis 2019-09-10 13:45:49 +02:00
parent b9398a09a0
commit 3267af8484
57 changed files with 16283 additions and 16294 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

5
.dev-tools/beta_conf_files/bots.d/blacklist-ips.conf
View file

@ -70,9 +70,6 @@
63.144.0.0/13 0; 63.144.0.0/13 0;
65.112.0.0/12 0; 65.112.0.0/12 0;
65.192.0.0/11 0; 65.192.0.0/11 0;
65.213.208.128/27 0;
65.222.176.96/27 0;
65.222.185.72/29 0;
# --------------- # ---------------
# Berkely Scanner # Berkely Scanner
@ -90,7 +87,7 @@
# If you really do want to block them change all the 0 below to 1. # If you really do want to block them change all the 0 below to 1.
169.229.3.91 0; 169.229.3.88/29 0;
# ------------ # ------------
# MY BLACKLIST # MY BLACKLIST

1694
.dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
.dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
35.184.226.236 1; 34.66.178.120 1;
127.0.0.1 1; 127.0.0.1 1;

2
.dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
35.184.226.236 0; 34.66.178.120 0;
127.0.0.1 0; 127.0.0.1 0;

1694
.dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
.dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
35.184.226.236 1; 34.66.178.120 1;
127.0.0.1 1; 127.0.0.1 1;

2
.dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
35.184.226.236 0; 34.66.178.120 0;
127.0.0.1 0; 127.0.0.1 0;

1694
.dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
.dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
35.184.226.236 1; 34.66.178.120 1;
127.0.0.1 1; 127.0.0.1 1;

2
.dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
35.184.226.236 0; 34.66.178.120 0;
127.0.0.1 0; 127.0.0.1 0;

1694
.dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

1694
.dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

1694
.dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

5
.dev-tools/test1_conf_files/bots.d/blacklist-ips.conf
View file

@ -70,9 +70,6 @@
63.144.0.0/13 0; 63.144.0.0/13 0;
65.112.0.0/12 0; 65.112.0.0/12 0;
65.192.0.0/11 0; 65.192.0.0/11 0;
65.213.208.128/27 0;
65.222.176.96/27 0;
65.222.185.72/29 0;
# --------------- # ---------------
# Berkely Scanner # Berkely Scanner
@ -90,7 +87,7 @@
# If you really do want to block them change all the 0 below to 1. # If you really do want to block them change all the 0 below to 1.
169.229.3.91 0; 169.229.3.88/29 0;
# ------------ # ------------
# MY BLACKLIST # MY BLACKLIST

2
.dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
35.184.226.236 0; 104.198.131.58 0;

1694
.dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
.dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
35.193.7.13 1; 104.154.113.151 1;
127.0.0.1 1; 127.0.0.1 1;

2
.dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
35.193.7.13 0; 104.154.113.151 0;
127.0.0.1 0; 127.0.0.1 0;

1694
.dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
.dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
35.193.7.13 1; 104.154.113.151 1;
127.0.0.1 1; 127.0.0.1 1;

2
.dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
35.193.7.13 0; 104.154.113.151 0;
127.0.0.1 0; 127.0.0.1 0;

1694
.dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
.dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
35.193.7.13 1; 104.154.113.151 1;
127.0.0.1 1; 127.0.0.1 1;

2
.dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
35.193.7.13 0; 104.154.113.151 0;
127.0.0.1 0; 127.0.0.1 0;

1694
.dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

5
.dev-tools/test2_conf_files/bots.d/blacklist-ips.conf
View file

@ -70,9 +70,6 @@
63.144.0.0/13 0; 63.144.0.0/13 0;
65.112.0.0/12 0; 65.112.0.0/12 0;
65.192.0.0/11 0; 65.192.0.0/11 0;
65.213.208.128/27 0;
65.222.176.96/27 0;
65.222.185.72/29 0;
# --------------- # ---------------
# Berkely Scanner # Berkely Scanner
@ -90,7 +87,7 @@
# If you really do want to block them change all the 0 below to 1. # If you really do want to block them change all the 0 below to 1.
169.229.3.91 0; 169.229.3.88/29 0;
# ------------ # ------------
# MY BLACKLIST # MY BLACKLIST

4
.dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,5 +45,5 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
35.193.7.13 0; 104.198.131.58 0;
104.154.120.187 0; 34.66.178.120 0;

1694
.dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

5
.dev-tools/test3_conf_files/bots.d/blacklist-ips.conf
View file

@ -70,9 +70,6 @@
63.144.0.0/13 0; 63.144.0.0/13 0;
65.112.0.0/12 0; 65.112.0.0/12 0;
65.192.0.0/11 0; 65.192.0.0/11 0;
65.213.208.128/27 0;
65.222.176.96/27 0;
65.222.185.72/29 0;
# --------------- # ---------------
# Berkely Scanner # Berkely Scanner
@ -90,7 +87,7 @@
# If you really do want to block them change all the 0 below to 1. # If you really do want to block them change all the 0 below to 1.
169.229.3.91 0; 169.229.3.88/29 0;
# ------------ # ------------
# MY BLACKLIST # MY BLACKLIST

4
.dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,5 +45,5 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
35.192.85.2 0; 35.192.136.167 0;
104.154.120.187 0; 35.188.73.34 0;

1694
.dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

5
.dev-tools/test4_conf_files/bots.d/blacklist-ips.conf
View file

@ -70,9 +70,6 @@
63.144.0.0/13 0; 63.144.0.0/13 0;
65.112.0.0/12 0; 65.112.0.0/12 0;
65.192.0.0/11 0; 65.192.0.0/11 0;
65.213.208.128/27 0;
65.222.176.96/27 0;
65.222.185.72/29 0;
# --------------- # ---------------
# Berkely Scanner # Berkely Scanner
@ -90,7 +87,7 @@
# If you really do want to block them change all the 0 below to 1. # If you really do want to block them change all the 0 below to 1.
169.229.3.91 0; 169.229.3.88/29 0;
# ------------ # ------------
# MY BLACKLIST # MY BLACKLIST

6
.dev-tools/test4_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,6 +45,6 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
35.188.1.99 0; 104.198.131.58 0;
35.202.145.110 0; 35.188.73.34 0;
35.184.226.236 0; 35.192.136.167 0;

1694
.dev-tools/test4_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

5
.dev-tools/test5_conf_files/bots.d/blacklist-ips.conf
View file

@ -70,9 +70,6 @@
63.144.0.0/13 0; 63.144.0.0/13 0;
65.112.0.0/12 0; 65.112.0.0/12 0;
65.192.0.0/11 0; 65.192.0.0/11 0;
65.213.208.128/27 0;
65.222.176.96/27 0;
65.222.185.72/29 0;
# --------------- # ---------------
# Berkely Scanner # Berkely Scanner
@ -90,7 +87,7 @@
# If you really do want to block them change all the 0 below to 1. # If you really do want to block them change all the 0 below to 1.
169.229.3.91 0; 169.229.3.88/29 0;
# ------------ # ------------
# MY BLACKLIST # MY BLACKLIST

5
.dev-tools/test5_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,6 +45,5 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
35.184.226.236 0; 35.192.136.167 0;
35.224.112.202 0; 34.66.178.120 0;
35.192.85.2 0;

1694
.dev-tools/test5_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
.dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
35.184.226.236 1; 34.66.178.120 1;
127.0.0.1 1; 127.0.0.1 1;

20
.dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
DittoSpyder BackDoorBot
evc-batch BBBike
GrabNet BDFetch
LinksManager FHscan
Pixray InternetSeer
ScoutJet lwp-request
Sogou web spider RealDownload
Spammen TightTwatBot
Upflow Vagabondo
WWWOFFLE VB Project

272
.dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
404checker
80legs 80legs
Abonti
Aboundexbot
Acunetix
ADmantX
AfD-Verbotsverfahren AfD-Verbotsverfahren
AhrefsBot
AiHitBot
Aipbot Aipbot
Alligator
Anarchie Anarchie
autoemailspider Apexoo
BacklinkCrawler BacklinkCrawler
BackStreet Bigfoot
BackWeb
BatchFTP
Battleztar Bazinga
BDCbot
BDFetch
Bitacle
Blackboard Blackboard
Black Hole Black Hole
BLEXBot
BlowFish BlowFish
Boardreader
Bolt Bolt
BotALot BotALot
Brandprotect Brandprotect
Brandwatch
BuiltBotTough
BuiltWith
Bullseye Bullseye
BunnySlippers BuzzSumo
CATExplorador
Cegbfeieh
CheeseBot CheeseBot
CherryPicker CheTeam
Chlooe ChinaClaw
coccocbot-web Claritybot
Cogentbot Cogentbot
com.plumanalytics
CopyRightCheck CopyRightCheck
Copyscape Copyscape
crawler.feedback Cosmos
Craftbot
crawler4j
crawl.sogou.com crawl.sogou.com
CrazyWebCrawler CrazyWebCrawler
CSHttp
Curious Curious
DataCha0s Custo
DBLBot Demon
Deusu Digincore
Devil
DigitalPebble DigitalPebble
Discobot
Dispatch Dispatch
DittoSpyder DittoSpyder
DnyzBot DomainAppender
DomainStatsBot Dotbot
Download Wonder Download Wonder
Drip Dragonfly
DSearch
EasyDL EasyDL
Ebingbong
eCatch eCatch
ECCP/1.0 ECCP/1.0
EirGrabber EirGrabber
EMail Wolf EMail Siphon
EroCrawler evc-batch
Evil Exabot
Express WebPictures Express WebPictures
FHscan ExtLinksBot
Foobot Extractor
FrontPage FDM
GalaxyBot Fimap
FlashGet
Freeuploader
GermCrawler GermCrawler
Getintent Getintent
GetWeb
Go-Ahead-Got-It Go-Ahead-Got-It
Gotit GoZilla
Go!Zilla Go!Zilla
Grabber Grafula
GrabNet GrapeFX
GT::WWW GridBot
Haansoft Haansoft
Harvest HaosouSpider
HEADMasterSEO HEADMasterSEO
Heritrix Hloader
HTMLparser
HTTrack HTTrack
Humanlinks
HybridBot
Iblog Iblog
IDBot IDBot
IlseBot
Image Fetch Image Fetch
Image Sucker Image Sucker
Indy Library Indy Library
InfoNaviRobot InfoNaviRobot
InfoTekies InfoTekies
Intelliseek instabid
Internet Ninja IRLbot
Iskanie Iskanie
IstellaBot IstellaBot
JamesBOT JamesBOT
Jbrofuzz Jbrofuzz
Jetty JikeSpider
JOC Web Spider JOC Web Spider
Kenjin Spider Joomla
JustView
Jyxobot
Keyword Density Keyword Density
Kozmosbot
LeechFTP
LeechGet
LexiBot
Lftp Lftp
LibWeb
Libwhisker Libwhisker
Lightspeedsystems
Likse
Linkdexbot Linkdexbot
LinkextractorPro
LinkpadBot LinkpadBot
LinkScan LinkScan
LinqiaMetadataDownloaderBot LinksManager
LinqiaRSSBot LinkWalker
Litemage_walker LinqiaScrapeBot
Lmspider Lmspider
Ltx71
lwp-request lwp-request
magpie-crawler Mag-Net
Mail.RU_Bot
Majestic SEO Majestic SEO
MarkWatch Majestic-SEO
MarkMonitor
Masscan Masscan
Mass Downloader
Mata Hari
MauiBot
MeanPath Bot
Mediatoolkitbot
mediawords mediawords
MegaIndex.ru Metauri
MFC_Tear_Sample MFC_Tear_Sample
Microsoft Data Access Microsoft Data Access
MJ12bot MIDown tool
Morfeus Fucking Scanner MIIxpc
MSIECrawler Mojeek
Msrabot Mr.4x3
muhstik-scan Musobot
Name Intelligence Nameprotect
Navroad
NearSite NearSite
Needle NetAnts
Nessus netEstate NE Crawler
NetLyzer
NetSpider NetSpider
Nettrack
Net Vampire Net Vampire
Netvibes
NetZIP NetZIP
NextGenSearchBot Nibbler
NICErsPRO NICErsPRO
Niki-bot
Nikto Nikto
Ninja Nmap
Nutch NPbot
Octopus
Offline Explorer Offline Explorer
Offline Navigator Offline Navigator
OpenLinkProfiler OpenLinkProfiler
Openvas OpenVAS
OrangeBot OutclicksBot
OrangeSpider
OutfoxBot
PageAnalyzer PageAnalyzer
PageScorer Page Analyzer
Panscient Panscient
Papa Foto Papa Foto
Pavuk
pcBrowser pcBrowser
PECL::HTTP
PeoplePal PeoplePal
PHPCrawl PHPCrawl
Pi-Monster Picsearch
PictureFinder
Pixray Pixray
PleaseCrawl
Pockey
POE-Component-Client-HTTP POE-Component-Client-HTTP
ProPowerBot Probethenet
Psbot
Pump
PxBroker PxBroker
QueryN Metasearch QueryN Metasearch
Quick-Crawler RankActive
RankActiveLinkBot
RankFlex RankFlex
RankingBot2 RebelMouse
RealDownload RedesScrapy
Recorder Ripper
ReGet
RocketCrawler
Rogerbot
s1z.ru s1z.ru
SBIder SBIder
scan.lol scan.lol
ScoutJet
Scrapy
Screaming Screaming
ScreenerBot ScreenerBot
SemrushBot SemrushBot
SEOkicks
SEOkicks-Robot
SEOlyticsCrawler SEOlyticsCrawler
SEOprofiler
SeoSiteCheckup
SEOstats
Shodan Shodan
SiteExplorer
Siteimprove Siteimprove
SiteLockSpider SiteLockSpider
SiteSnagger SiteSucker
Site Sucker SMTBot
Sitevigil
SlySearch
Snapbot
Snoopy Snoopy
Sosospider Sottopop
SpaceBison SpankBot
Spammen
Spanner Spanner
sp_auditbot sp_auditbot
Spinn3r Spinn3r
spyfu Sqworm
Sqlmap
Sqlworm
Stripper Stripper
Sucuri Sucker
SuperBot
Surfbot Surfbot
Suzuran Suzuran
Swiftbot T8Abot
T0PHackTeam
tAkeOut tAkeOut
TeleportPro Teleport
Telesphorep
The Intraformant The Intraformant
TheNomad
TightTwatBot TightTwatBot
Toata Titan
Toweyabot
Tracemyfile Tracemyfile
Trendiction
trendiction.com trendiction.com
trendiction.de True_Robot
Turingos Turingos
TwengaBot TwengaBot
UnisterBot Typhoeus
VCI URLy Warning
URLy.Warning
VB Project
Virusdie Virusdie
Voltron Wallpapers/3.0
WallpapersHD Webalta
WebAuto WebCollage
WebCopier WEBDAV
Web Enhancer Web Enhancer
Web Fetch Web Fetch
WebFuck WebGo IS
Web Fuck WebLeacher
WebImageCollector Web Pix
WebmasterWorldForumBot WebReaper
webmeup-crawler
Website Quester Website Quester
Webster Webster
Web Sucker
WebWhacker
WebZIP WebZIP
Widow Whack
WinHTTrack Whacker
WISENutbot Who.is Bot
WiseGuys Robot
Wonderbot Wonderbot
Wotbox Woobot
WWW-Collector-E
WWW-Mechanize
WWW::Mechanize
WWWOFFLE WWWOFFLE
Xaldon WebSpider x09Mozilla
x22Mozilla
Xaldon_WebSpider Xaldon_WebSpider
Xenu YoudaoBot
xpymep1.exe
Zade Zade
zgrab Zermelo
ZmEu
ZumBot

266
.dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
360Spider
404checker 404checker
404enemy 404enemy
80legs 80legs
Abonti Aboundex
AfD-Verbotsverfahren Aboundexbot
Alligator AiHitBot
AllSubmitter AllSubmitter
AlphaBot
Anarchie Anarchie
ASPSeek ASPSeek
autoemailspider backlink-check
Backlink-Ceck BackWeb
BacklinkCrawler
Badass
Bandit Bandit
BatchFTP Battleztar Bazinga
BBBike BBBike
BDCbot BDCbot
BDFetch BetaBot
Bitacle Bigfoot
Black Hole Black Hole
BlowFish BlowFish
Boardreader
Bolt Bolt
BotALot
Brandprotect Brandprotect
Bullseye Buddy
BuzzSumo BuiltBotTough
CazoodleBot CazoodleBot
ChinaClaw CheeseBot
CherryPicker
Chlooe
Claritybot Claritybot
Cliqzbot
Cloud mapping
coccocbot-web coccocbot-web
cognitiveseo Cogentbot
Collector com.plumanalytics
Copier Copier
crawler4j crawler4j
Crescent crawl.sogou.com
Curious CrunchBot
Custo
DataCha0s
DBLBot DBLBot
Disco Deusu
Discobot DIIbot
DomainStatsBot Dispatch
Dragonfly DomainSigmaCrawler
Dotbot
DTS Agent DTS Agent
EasyDL
eCatch
ECCP/1.0
EirGrabber EirGrabber
EMail Siphon
EMail Wolf EMail Wolf
EroCrawler EroCrawler
evc-batch evc-batch
Evil
Exabot Exabot
ExtLinksBot Express WebPictures
Extreme Picture Finder
EyeNetIE EyeNetIE
facebookscraper facebookscraper
FDM FDM
FemtosearchBot FemtosearchBot
FHscan
Firefox/7.0 Firefox/7.0
FlashGet
Flunky Flunky
Foobot Foobot
Fyrebot
GalaxyBot GalaxyBot
Genieo
GermCrawler GermCrawler
Getintent
GetRight GetRight
G-i-g-a-b-o-t G-i-g-a-b-o-t
Go!Zilla Gotit
GrapeFX GoZilla
GridBot Grabber
Grafula
GT::WWW GT::WWW
Haansoft HMView
HaosouSpider
Harvest
HEADMasterSEO
HTMLparser HTMLparser
HTTP::Lite HTTrack
HybridBot Humanlinks
Image Fetch Iblog
Id-search
Image Sucker
IndeedBot IndeedBot
InfoNaviRobot instabid
Intelliseek
InterGET
InternetSeer InternetSeer
internetVista monitor IRLbot
ips-agent IstellaBot
Iskanie Jbrofuzz
JamesBOT JOC Web Spider
JetCar Joomla
Jetty Jyxobot
JustView
Kenjin Spider Kenjin Spider
Kozmosbot Keyword Density
Larbin Larbin
LeechFTP
LeechGet
LexiBot LexiBot
Lftp
LibWeb LibWeb
Libwhisker
Lightspeedsystems Lightspeedsystems
Likse Likse
Linkdexbot
LinkextractorPro
LinkpadBot LinkpadBot
LinkScan
LinksManager LinksManager
LinqiaMetadataDownloaderBot
LinqiaRSSBot LinqiaRSSBot
LinqiaScrapeBot Lipperhey
Lipperhey Spider Litemage_walker
Ltx71 lwp-request
Magnet
Majestic12 Majestic12
Majestic SEO
Majestic-SEO Majestic-SEO
Mata Hari MarkMonitor
meanpathbot MauiBot
MeanPath Bot MeanPath Bot
Mediatoolkitbot MFC_Tear_Sample
mediawords
Microsoft Data Access Microsoft Data Access
MJ12bot Microsoft URL Control
Mr.4x3 MIDown tool
MIIxpc
Msrabot Msrabot
muhstik-scan Musobot
Nameprotect Name Intelligence
NearSite
Needle
NetAnts NetAnts
Netcraft Netcraft
NetMechanic NetMechanic
Nettrack Nettrack
Netvibes Netvibes
NetZIP
NextGenSearchBot NextGenSearchBot
NICErsPRO
Nikto Nikto
Nimbostratus
Ninja Ninja
Nutch Nmap
oBot
Octopus Octopus
Offline Explorer
Offline Navigator Offline Navigator
Openfind
OpenLinkProfiler OpenLinkProfiler
OrangeBot OrangeSpider
OutclicksBot OutclicksBot
Page Analyzer
PageGrabber
page scorer page scorer
PageScorer Panscient
Pandalytics Papa Foto
PECL::HTTP Pavuk
pcBrowser
PeoplePal PeoplePal
PHPCrawl
Picscout Picscout
Picsearch
Pi-Monster Pi-Monster
Pockey plumanalytics
POE-Component-Client-HTTP ProWebWalker
Probethenet
Pump Pump
PxBroker PxBroker
QueryN Metasearch QueryN Metasearch
RankActiveLinkBot Quick-Crawler
RankFlex
RankingBot RankingBot
RankingBot2 RankingBot2
RankurBot RankurBot
Reaper RebelMouse
Recorder
RedesScrapy RedesScrapy
ReGet ReGet
Ripper Rogerbot
SalesIntelligent s1z.ru
ScanAlert ScanAlert
Scanbot
scan.lol
ScoutJet ScoutJet
Scrapy Screaming
ScreenerBot
Searchestate
SearchmetricsBot
SEOkicks SEOkicks
SEOkicks-Robot SEOkicks-Robot
SEOlyticsCrawler
Seomoz Seomoz
SEOprofiler SEOprofiler
seoscanners seoscanners
SeoSiteCheckup
serpstatbot serpstatbot
sexsearcher sexsearcher
Shodan Siteimprove
SISTRIX
Sitebeam
SiteSnagger SiteSnagger
SiteSucker Site Sucker
SlySearch
SmartDownload SmartDownload
Snake Snake
Sociscraper Snapbot
Snoopy
SocialRankIOBot
sogouspider sogouspider
Sosospider Sosospider
Sottopop sp_auditbot
Spanner SputnikBot
Sqlmap Sqlmap
Steeler Steeler
Stripper Stripper
Sucuri
SuperBot SuperBot
SuperHTTP
Surfbot Surfbot
Swiftbot Suzuran
Szukacz Szukacz
T0PHackTeam T0PHackTeam
T8Abot tAkeOut
Teleport
TeleportPro TeleportPro
Telesphoreo Telesoft
Telesphorep Thumbor
TheNomad Titan
TightTwatBot Toata
Toweyabot Trendictionbot
Tracemyfile
trendiction.com
True_Robot
Turingos Turingos
Turnitin
TurnitinBot TurnitinBot
TwengaBot Twice
Typhoeus UnisterBot
URLy Warning Vagabondo
Vacuum VB Project
VCI VCI
VeriCiteCrawler
VoidEYE VoidEYE
Voil Voil
Voltron Webalta
WASALive-Bot
WBSearchBot
WebAuto WebAuto
WebBandit Web Collage
WebCopier WEBDAV
WebEnhancer
Web Enhancer Web Enhancer
WebFetch
Web Fuck Web Fuck
webmeup-crawler webmeup-crawler
Web Pix Web Pix
WebSauger WebReaper
Web Sauger Web Sauger
Webshag WebsiteQuester
WebsiteExtractor
Website Quester
WebStripper
WebSucker
Web Sucker
WebZIP
Whack Whack
Whacker
Whatweb
Who.is Bot
Widow Widow
WinHTTrack
WiseGuys Robot
Wonderbot Wonderbot
Wprecon Wprecon
WWW-Collector-E WWW-Mechanize
x09Mozilla WWWOFFLE
Xaldon WebSpider
Xaldon_WebSpider
Xenu
YoudaoBot
Zade Zade
Zauba Zauba
zauba.io Zeus
zgrab Zitebot
ZmEu
ZumBot

20
.dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
addblueoff.com.ua alloysteel.ru
astrochicks.com blog.yam.com
cenokos.ru iflycapetown.co.za
choosecuisine.com integritylandscapeservices.com
eyessurgery.ru krynica.info
gallery.rennlist.com mokrayakiska.com
legionalpha.com reyel1985.webnode.fr
rebuildermedical.com shoppingmiracles.co.uk
reversing.cc telegraf.by
zarajbuilders.com ttsq.fr

932
.dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
01apple.com 0lovespells0.blogspot.com
0c47f8422d3f.com 1001watch.com.ua
0daymusic.org 11235813.webzdarma.cz
101raccoon.ru 1millionusd.xyz
123any.com 45en.ru
21h2o.com 5ws.dating-app.ru
23kw.ru 7a2rnuey1tw9ar.ru
4replicawatch.net 7makemoneyonline.com
6hopping.com 7yue.org
aa625d84f1587749c1ab011d6f269f7d64.com abiente.ru
aab94f698f36684c5a852a2ef272e031bb.com absugars.com
aac500b7a15b2646968f6bd8c6305869d7.com abwa.tk
abusora.com acads.net
acmebtn.ml adclickthru.net
adcash.com addblueoff.com.ua
adclickservice.com adelly.bg
adpremium.org adexprts.com
ads.gold admanaerofoil.com
adssafeprotected.com adultfullhd.com
adultfriendfinder.com adventureparkcostarica.com
a.frcls.fr
aktivator-windows10.blogspot.com
akvamaster.dp.ua akvamaster.dp.ua
alert-fjg.xyz albumsuper.info
alfabot.xyz allornamenti.com
all-number.com alta-realestate.com
aludecor.info amateurlivechat.org
amanda-porn.ga amazon-adsystem.com
amateurmatch.com ameblo.top
ampower.me anal-acrobats.hol.es
angry-fermi-7633.arukascloud.io animalia-life.club
animal-drawings.com anjalika.co.in
anti-virus-removal.info anonymous-redirect.com
aosheng-tech.com apibatbrowsecom-a.akamaihd.net
apartamentwroclaw.eu apimossnetinfo-a.akamaihd.net
apessay.com apiwoodensealcom-a.akamaihd.net
apilinkswiftco-a.akamaihd.net appiq.mobi
apiluckyleapnet-a.akamaihd.net appmsr.org
apiqualitinknet-a.akamaihd.net approvedlocal.co.za
apple.com-cleaner.systems arenanews.com.ua
arabsexxxtube.com arenda-avtoprokat-krasnodar.ru
arabseyes.com arpelsreplica.xyz
arcadeplayhouse.com asophoto.com
arius.tech asrv-a.akamoihd.net
artdeko.info atofilms.com
articlesdirectoryme.info auto.rusvile.lt
as5000.com availit.weebly.com
asmxsatadriverin.aircus.com aviapanda.ru
asociatia-tipografilor-transilvania.ro avon-severozapad.ru
asrv-a.akamaihd.net avramstroy.ru
atlasvkusov.ru azartniy-bonus.com
atmagroup.ru
audiobangout.com
autoblogger24.info
babyfactory.fr
back.dog
balois.worldbreak.com
balook.com
bankiem.pl
barbourjackets.online
bear.gotcher.us bear.gotcher.us
belinka.com.ua belinvestdom.by
belstaffstore.online berdasovivan.ru
berlininsl.com
bestbuy.ca
bestofferswalkmydogouteveryday.gq bestofferswalkmydogouteveryday.gq
best-way.men bestofupload.info
beta.hotkeys.com bestpornuha.com
big-cash.net betterscooter.com
bingoporno.com bingo8888.com
bizru.info bioca.org
bjetjt.com bird1.ru
bkns.vn bjanshee.ru
blog.f00kclan.de blacktwhite.com
blog.remote-computer.de
blogs.rediff.com blogs.rediff.com
bluerobot.info bocoarchives.org
boc.kz bonanza-fortune.men
bonzybuddy.com
braip.com.br
brateg.xyz brateg.xyz
brg8.com break-the-chains.com
bryansk.zrus.org bugof.gq
budilneg.xyz buqyxa.rincian.info
buntube.net burn-fat.ga
businesxxl.com business-made-fun.com
buy-cheap-online.info buy-cheap-online.info
buynorxx.com bwlx.prepedu.cn
bvlgariring.xyz cam-kontakte.org
calc-for-credit.ru camsex.xxx-cam.webcam
californianews.cf candcstuccoandstone.com
calvet.altervista.org cartechnic.ru
canacopegdl.com cdncash.com
carfax.com.ua cellfun.mobi
cartierbracelet.xyz c-english.ru
cartierlovebraceletreplica.xyz chatroulette.online
cartierlove.xyz cheapestjerseysonwholesale.com
caveavins.fr chidporn.com
chinacheapelitejerseys.com chocolateslim-en-france.com
chocolateslim-u-srbiji.com cialis-samples.com
cialgenisrx.com cjmc.info
cialischstgerts.com claytransformations.info
cibpenonptib.flu.cc click2pawn.com
cmhomestayagency.com club-musics.ru
codq.info cocyq.inwtrade.com
coinsspb.com coinsspb.com
coldfilm.ru comeondog.info
cometorussia.net
compliance-alexa.xyz
compliance-andrew.top compliance-andrew.top
compliance-checker-7.info compliance-nelson.top
compliance-irvin.top contextualyield.com
cookie-law-enforcement-aa.xyz copenergo.ru
cookingmeat.ru corta.co
cornerstone-countertops.com counter.yadro.ru
cupday.com customsua.com.ua
cv.wallhade.co cymbaltaandtizanidine.blogspot.com
cyprusbuyproperties.com czat.wp.pl
daisye.top dataloading.net
darkages.info data-mining.tk
darkbooks.org date-withme.com
daymusam.com dealitright.click
dcj-nn.ru deanmoore.ie
deadlinkchecker.com decenttools.com
defenderxtactical.com defenderxtactical.com
delayreferat.ru dekorkeramik.ru
demenageur.com
deniven.1bb.ru deniven.1bb.ru
designdevise.com descargar-musica-gratis.net
dichvuvesinhhanoi.com diarioaconcagua.com
diffbot.com
digitalfaq.com digitalfaq.com
directivepub.com dimaka.info
docs4all.com dinkolove.ya.ru
dokfilms.net dinosaurus.site
domain.webkeyit.com directrev.com
dptaughtme.com div.as
drev.biz dneprsvet.com.ua
driving.kiev.ua docsportal.net
dvd-famille.com docstoc.com
eaplay.ru domainsatcost.com
easycommerce.cf domain-tracker.com
dosugrostov.site
drugs-no-rx.info
drunkmoms.net
dyshagi.ru
earthmagic.info
easyukraine.com
ec-file.info
ednorxmed.com
eduinfosite.com eduinfosite.com
eduserver.net election.interferencer.ru
ekn-art.se elektrischezigarette1.blog.pl
elektrischezigaretten1.blogse.nl elektronischezi.livejournal.com
elexies.info elektrozigarettekaufen2.blogse.nl
eluxer.net elmifarhangi.com
energydiet24.ru eloxal.ru
englishdictionaryfree.com englate.com
es5.com esnm.ru
esopini.com essaypro.com
evogarage.com essayservicewriting.org
exmasters.com etotupo.ru
exoneration-project.us eugenevaultstorage.com
ezigarettenkaufen1.pagina.gr eyes-on-you.ga
ezigarettenshop1.yolasite.com ezb.elvenmachine.com
ezigaretteshop.webs.com ezigaretteshop.webs.com
f012.de
f0815.de
fable.in.ua fable.in.ua
facebook-mobile.xyz facecup.top
falllow.gq falcoware.com
fashion-mk.net familyphysician.ru
faz99.com fantasticpixcool.com
fefo.gdn feorina.ru
fettefrauen.net fetroshok.ru
filunika.com.ru financetip.eu
findpics.pw firstdrugmall.ru
f-online.de flashahead.info
fordsonmajbor.cf flashlarevista.com
forex-indextop20.ru florida-tourism.net
forum69.info flowwwers.com
forum.doctissimo.fr formseo.com
foto-weinberger.at fortwosmartcar.pw
fotzen-ficken.com forum-engineering.ru
free-fb-traffic.com foxjuegos.com
freesitetest.com froggytube.com
freetangodownload.com fsalas.com
freshmac.space fuel-gas.com
freshwallpapers.info funnel.co.za
funcrushgames.com gael-s.ru
funtoonez.com galaxys6manual.info
gamezblox.com gaygalls.net
gaming-journal.com gayxperience.com
gateway.zscalerone.net ge0ip.com
gay.adultgalls.com geilehausfrauen.net
getlamborghini.ga germetiki.com.ua
gg-arena.ru
gigapeta.com
gigixo.com gigixo.com
glcomputers.ru gktt.ru
gne8.com gkvector.ru
glall.ru
globetrotting-culture.ru
go2album.com
go2jump.org go2jump.org
googlsucks.com golden-praga.ru
gopro-online.info gopixdatabase.com
gotorussia.com goroda-vsego-mira.ru
gotwebsite1.com gosarhivrt.ru
greatdealshop.com greatfind-a.akamaihd.net
growmyfunds.ca greenidesign.co
grtyi.com groupmoney.ru
gsbs.com.ua growboxbl.ru
guruofcasino.com hccoder.info
gwebtools.com hdfreeporno.net
gwebtools.com.br hdhc.ru
handicapvansarea.com headpress.ru
haveinc.xyz healthcarestore.info
helpmymacfaster.trade heliko.no
hentai-manga.porn hem.passagen.se
hollywoodactress.info hmmm.cz
homedecorpicture.us hol.es
homik.pw horoshieokna.com
hotshoppymac.com hotenergy.ru
hspline.com hothor.se
humbmosquina.tk howopen.ru
ibmdatamanagement.co htmlcorner.com
icaseclub.ru hut1.ru
ideoworld.org ico.re
ihc2015.info idealtits.net
ilikevitaly.com ideawheel.com
imperia31.ru images-free.net
indo-export.ru imediadesk.com
interferencer.ru iminent.com
interfucks.net import-sales.com
internetproviderstucson.com impresagaia.it
iqoption-bin.com inome.com.ua
irunfar.com insta-add.pro
ivanstroi.ru internet-apteka.ru
ivearchenceinflu.cf io9.com
iwanttodeliver.com istizanidineanopiate.blogspot.com
jackpotchances.com istmira.ru
janavibekken.no itag.pw
itch.io
itsdp3.com
james13prix.info
javatex.co.id javatex.co.id
jerseyschinabizwholesale.us jav-fetish.site
jestr.org javitas.info
jolic2.com jerseychinabizwholesale.com
kaliningrad.zrus.org jobmarket.com.ua
karpun-iris.ru joessmogtestonly.com
kenaba.su jose.mulinohouse.co
keywordglobal.co.za jpcycles.com
kinky-fetishes.com juliadiets.com
kino-fun.ru jus0wil.pp.ua
kit-opt.ru kabbalah-red-bracelets.com
knigonosha.net karadene.com
kochanelli.com kihi.gdn
konoplisemena.com kinogolos.ru
konpax.com kino-rating.ru
kosova.de kinostorm.net
kozhniebolezni.com kliksaya.com
krasnodar-avtolombards.ru kosmetyki.tm.pl
kumuk.info kostenloser-sex.com
kurwa.win kwzf.net
laexotic.com ladov.ru
lakomka.com.ua landoftracking.com
laparfumotec.com
laserpen.club
law-check-eight.xyz
lawyers.cafe
laxob.com
le-clos-des-alouettes.com
ledpolice.ru
lego4x4.ru
lerporn.info
li-er.ru
life-instyle.com
lifeinsurancekb.com
link.ac link.ac
linkdebrideur.xyz liveinternet.ru
linkpulse.com
linkredirect.biz
lion.misba.us
littlesunraiser.com
liupis.com
liver-chintai.org liver-chintai.org
loadingpages.me liveu.infoteka.hu
lollypopgaming.com loadopia.com
lostaruban.com localmatchbook.com
lowephotos.info lolnex.us
mackeeper-center.club lonerangergames.com
malls.com lostfilm-online.ru
louisvuittonoutletstore.net
lovi-moment.com.ua
luciddiagnostics.in
luckyday.world
macfix.life
magda-gadalka.ru
magento-crew.net
makemoneyonline.com
mall.uk mall.uk
mamasuper.prom.ua mapquestz.us
maranbrinfo.com.br marcoislandvacations.net
mararoom.ru maridan.com.ua
marmitaco.cat marketingtechniques.info
masthopehomes.com master-muznachas.ru
matpre.top meetlocalchicks.com
max-p.men me-ke.com
mebel-alait.ru minecraft-rus.org
mecash.ru mmoguider.ru
medicine-4u.org mobstarr.com
medispainstitute.com.au
mega-bony2017.pl
metascephe.com
methodsmarketing.com
midst.eu
minharevisao.com
missclub.info
mmog-play.ru
moetomnenie.com moetomnenie.com
monarhs.info more-letom.ru
monclerboots.xyz mosdverka.ru
moncleronline.xyz mriyadh.com
monsterdivx.tv
motherboard.vice.com
muabancantho.info muabancantho.info
mulberryoutletonlineeu.com mug-na-chas-moscow.ru
myfreetutorials.com muz-shoes.ru
mylida.org mycaf.it
nardulan.com mydirtystuff.com
narkologiya-voronezh.ru myindospace.com
newhairstylesformen2014.com myperiod.club
new-post.tk na15.ru
nlfjjunb5.ru narosty.com
northfacestore.online nbsproject.ru
nrjmobile.fr nero-us.com
oconto.ru no-rx.info
offf.info nosecret.com.ua
oktube.ru npoet.ru
nzfilecloud.weebly.com
offer.camp
okayimage.com
okel.co
ok.ru
oneclickfiles.com
oneminutesite.it
onescreen.cc
online7777.com
ooomeru.ru ooomeru.ru
openmediasoft.com ops.picscout.com
outpersonals.com osoznanie-narkotikam.net
ownshop.win ownshop.win
oynat.info papasdelivery.ru
oz-offers.com
partner-high.men partner-high.men
patol01.pw partnerline.men
percin.biz.ly partner-pop.men
picphotos.net pattersonsweb.com
pigrafix.at pawli.eu
pinwallpaper.top pay2me.pl
pixshark.com photo-clip.ru
playtap.us photo.houseofgaga.ru
pokerniydom.ru pictures-and-images.net
pooleroadmedicalcentre.co.uk piluli.info
popup-jdh.xyz plohaya-kreditnaya-istoriya.ru
pornofeuer.com podshipniki-nsk.ru
pornolook.net popmarker.com
porno-raskazy.ru popup-fdm.xyz
porn555.com
pornosee.info pornosee.info
porn-w.org pornoxxx.com.mx
porodasobak.net pornpost.in
pozdravleniya-c.ru portnoff.od.ua
pozdrawleniya.com powitania.pl
pricheski-video.com prchecker.info
prodvigator.ua prefersurvey.net
ptr.ruvds.com printdirectforless.com
rankingchart.de privatov-zapisi.ru
razamicroelectronics.com prizeestates.cricket
realmonte.net productarium.com
redirectingat.com promgirldresses.xyz
proprostatit.com
puzo2arbuza.ru
puzzleweb.ru
radiodigital.co
ranksonic.org
recipedays.ru
rednise.com
regdefense.com
reimageplus.com reimageplus.com
remont-mobile-phones.ru reining.lovasszovetseg.hu
reyel1985.webnode.fr renewablewealth.com
ricorsogiustizia.org rep-am.com
rightenergysolutions.com.au resultshub-a.akamaihd.net
runofilms.ru rfid-locker.co
ryetaw.com ringporno.com
saletool.ru rogervivierforsale.com
salmonfishingsacramentoriver.com rome2rio.com
sawin.beth.webd.pl rosbalt.com.ua
rucrypt.com
saecsa.co
sanjosestartups.com
sankt-peterburg.nodup.ru
sape.top
sayyoethe.blogspot.co.za sayyoethe.blogspot.co.za
sbf441.com scanner-andrew.top
scanner-barak.top scanner-olga.top
scanner-brian.top scanner-walt.top
scanner-jane.top searchencrypt.com
scanner-viktor.top searchtooknow-a.akamaihd.net
scanner-willy.top seasaltwithfood.com
schoolfiles.net selectads.men
sdelai-prosto.ru sell-fb-group-here.com
sdrescher.net senger.atspace.co.uk
sdsjweb.com serialsway.ucoz.ru
searchwebknow-a.akamaihd.net sexflirtbook.com
seminarygeorgia59.ga sexkontakteao.info
seminarykansas904.ml sexy-pings.com
semrush.com sharebutton.net
seocdvig.ru shillyourcoins.com
seoexperimenty.ru shopcheermakeup.info
seoprofiler.com shopsellcardsdumps.com
seorussian.ru shtaketniki.kz
sexfreepornoxxx.com
sextracker.de
sexyali.com
sfd-chess.ru
sharebutton.to
signoredom.com signoredom.com
silverage.ru simply.net
skincrate.net sims-sims.ru
skytraf.xyz slavia.info
sladkoevideo.com snip.to
s.lollypopgaming.com snomer1.ru
slonechka.ru snowplanes.com
slowmac.tech snworks.com
sluganarodu.ru sobecjvuwa.com.ru
smadihome.com social-buttons.com
smartadserver.com social-fun.ru
smart-balancewheel.com socialmadesimple.com
snow.nvr163.com social-s-hhh.xyz
snyatie-lomki-v-stacionare.ru softlinesolutions.me
social-s-iii.xyz softonicads.com
solmarket.by sogimlecal.tk
sotechco.co solinf.co
spaceshipad.com sotkal.lark.ru
spy-app.info spabali.org
squidoo.com spbchampionat.ru
srdrvp.com spin2016.cf
stal-rulon.ru splendorsearch-a.akamaihd.net
statustroll.com sports-supplements.us
staynplay.net spylog.com
sticken.co spy-sts.com
stillmiracle.com stairliftsarea.com
stoki.ru stmassage.ru
stroicol.net strana-solnca.ru
stroiminsk.org stroymonolit.su
sudexpert66.ru suggest-keywords.com
suhanpacktech.com supermama.top
sukarame.net superstarfloraluk.com
sumo.com svbur.ru
sureone.pro svnuppsalaorebro.se
survival.betteroffers.review swagbucks.com
szamponrevita.pl t3chtonic.com
taqplayer.info tako3.com
tarad.com taraz.xkaz.org
teastory.co tattooreligion.ru
terraclicks.com tedy.su
tgtclick.com telefonsexsofort.tk
time-japan.ru thecoral.com.br
tizanidine4mgstreetprice.blogspot.com themestotal.com
tizanidinehcl2mg.blogspot.com thepantonpractice.co.uk
tizanidineshowupondrugtest.blogspot.com theplacetoupdating.pw
tizanidinewithdrawal.blogspot.com thesmartsearch.net
tmtrck.com thfox.com
tnctrx.com thin.me.pn
token-lab.org thruport.com
top10-online-games.com tizanidinedosage.blogspot.com
top250movies.ru tizanidinehcl4mgtablet.blogspot.com
tovaroboom.vast.ru tmearegion26.com
tnaionline.org
toloka.hurtom.com
toolsky.com
topbestgames.com
top-l2.com
torontoplumbinggroup.com
toys.erolove.in toys.erolove.in
tozup.com trafaret74.ru
traffic2cash.org traffic100.com
trahic.ru trafficfactory.biz
trafficgenius.xyz
trichizobswiv.agddns.net
triumf-realty.ru triumf-realty.ru
trkur.com trucri.me
trustl.life trustl.life
ttrraacckkrr.com tvorozhnaja-zapekanka-recept.ru
tubeoffline.com ufa.xrus.org
tupper-posuda.ru uptimechecker.com
u555u.info url2image.com
ua-company.ru usacasino.com
u-cheats.ru uytmaster.ru
ucoz.ru v24s.net
unacittaconte.org video-chat.cn
urlcut.ru
uroffer.link
usbggettwku.ga
utrolive.ru
valkiria-tk.ru
vancleefreplica.pw
vasileostrovsky-rayon.ru
ventelnos.com
via-energy-acquistare.com
videosbox.ru
videositename.com videositename.com
viktoria-center.ru vip2ch.com
vip-file.com vitalads.net
vladimir.zrus.org vkak.ru
vpnhowto.info vkontaktemusic.ru
wallpapersdesk.info vpnmouse.com
watchdogs-2.ru wareseeker.com
webadvance.club watchmygf.net
webradiology.ru website-analyzer.info
weburok.com website-audit.com.ua
westen-z.life website-speed-check.site
westermarkanjou.se websites-reviews.com
wheelchairliftsarea.com weclipart.com
wildworld.site weightatraining.com
windowssearch-exp.com whatzmyip.net
woweb.com.ua while.cheapwebsitehoster.com
wzgyyq.com wingsoffury2.com
xn--80ahdheogk5l.xn--p1ai womensterritory.ru
xn----8sbarihbihxpxqgaf0g1e.xn--80adxhks wordpresscore.com
xn--b1adccaf1bzj.xn--p1ai wowas31.ucoz.ru
xn--e1aggki3c.xn--80adxhks www.kabbalah-red-bracelets.com
xn--q1a.xn--b1aube0e.xn--c1acygb.xn--p1ai wygraj-skiny.win
x-rates.ru xaylapdiendanang.com
xcc24.pl
xep.info
x-lime.com
xmladserver.com
x-musics.com
xn--80aaajbdbddwj2alwjieei2afr3v.xn--p1ai
xn--80ahvj9e.xn--p1ai
xn----9sbubg3ambdfl1j.xn--p1ai
xn--e1afanlbnfckd7c3d.xn--p1ai
xn--oogle-wmc.com
xnxxandxvideos.com
xportvusbdriver8i.snack.ws
xrus.org xrus.org
xxx-treker.ru youdao.com
xxxtube69.com youjizz.vc
xxxtubesafari.com yourads.website
yachts-cruise.info youtube-downloader.savetubevideo.com
yebocasino.com yubikk.info
yottos.com yurgorod.ru
yourserverisdown.com za-fun-offer.com
yoursite.com zaloro.com
zaidia.xhost.ro zeroredirect12.com
zdesoboi.com zeroredirect2.com
zeroredirect11.com zojirushi-products.ru
zeroredirect9.com zrus.org
znaniyapolza.ru zytpirwai.net
zog.link
zona-aqua.ru
zrelaya.pw
zverokruh-shop.cz

480
.dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
007angels.com 12bet.com
0daymusic.org 13tabs.com
202ch.com 1pamm.ru
2345.com 21h2o.com
300richmond.co.nz 3-letter-domains.net
3weekdiet.com 991mostfm.co.id
4kplayer.pl
55wmz.ru
8lufu.com
aa8780bb28a1de4eb5bff33c28a218a930.com aa8780bb28a1de4eb5bff33c28a218a930.com
aa9bd78f328a6a41279d0fad0a88df1901.com aaa38852e886ac4af1a3cff9b47cab6272.com
abovetherivernc.com acmebtn.ml
adrunnr.com addblueoff.com.ua
akama.com addray.pro
aktivator-windows10.blogspot.com adinterax.com
aktobe.xkaz.org adult-shop.com.ua
alfa-medosmotr.ru aliexpress.com
alyeskaresort.com alphaforum.ru
am15.net alta-realestate.com
animal36.com amyfoxfitness.com
anniemation.com animenime.ru
arabgirls.adultgalls.com anonymizeme.pro
audiobangout.com apifasterlightin-a.akamaihd.net
autotrends.today arendovalka.xyz
azazu.ru artel116.ru
bad-stars.net asrv-a.akamoihd.net
beachtoday.ru asrvvv-a.akamaihd.net
bear.gotcher.us atout-energie-69.com
beauby.ru autobrennero.it
belinvestdom.by azartmix.com
bestofupload.info beget.tech
betterscooter.com
billiard-classic.com.ua
bird1.ru
bizfly.info
blackle.com
blogrankers.com
bluejays-jerseys.us bluejays-jerseys.us
bmw.afora.ru bobinoz.com
boeuklad.com bonzybuddy.com
bongacams.com boo-arts.com
brandedleadgeneration.com bookmaker-bet.com
bupropion-sr-150-mg.us brandehk.dk
business-made-fun.com buehne-fuer-menschenrechte.de
buyhoverboard.com cacheimages.com
cakesplus.com.au carmuffler.net
cialgenisrx.com carsplate.com
cdnanalytics.xyz
cejewelry.xyz
cenokos.ru
charmstroy.info
checkpagerank.net
checktext.org
chocolateslim-en-france.com
cialischmrx.com
cineacademy.ru
cleanallspyware.com cleanallspyware.com
clickintext.net compliance-brian.top
clksite.com compliance-checker-7.info
club-samodelkin.ru compliance-walt.top
cocyq.inwtrade.com compucelunlock.net
co.lumb.co connectingsingles.com
cornomase.win coolgramgoods.com
counciltally.com cosmetic.donna7753191.ru
cscwtalkto.site cosmeticswomens-womensports.rhcloud.com
customboxes4less.com crest3d.ru
cutalltheshit.com customerguru.in
darkbooks.org cymbaltaandtizanidine.blogspot.com
ddlmega.net dailyrank.net
ddospanel.com dangphoto.trade
discountbarbour.online dikqlyremy.info
divci-hry.info downloadeer.net
divku.ru eandsgallery.com
documentsite.net egvar.net
dodlive.mil elektrischezigarette2.devhub.com
dogbreedspicture.net elektrischezigarette2.onsugar.com
dogsrun.net elektronischezigarette2.mex.tl
domainanalyzing.xyz elektronischezigarettekaufen2.tumblr.com
domainsphoto.com elektrozigaretten1.tumblr.com
domoysshop.ru elitesportsadvisor.com
doublepimp.com elvel.com.ua
downloadmefiranaratb1972.xpg.com.br eu-cookie-law.blogspot.com
drugspowerstore.com exct.net
dvr.biz.ua ezigarettenkaufen1.deviantart.com
eduinfosite.com ezigaretteshop2.vefblog.net
electronicadirect.com facebook-mobile.xyz
elektrozigaretten1.webs.com falcoware.com
elitepcgames.com findpik.com
evaashop.ru forexunion.net
excitacao.com freenom.link
eywords-monitoring-your-success.com fsakhalin.ru
ezigarettenshop2.myblog.de funcrushgames.com
facecup.top gamblingnerd.com
falopicm.pw game-mmorpg.net
farm26.ru gk170.ru
farmprofi.net globalsurfari.com
favoritemoney.ru good-mummy.ru
filmci.pro googlepositions.com
flashbannernow.com greatzip.com
flavors.me gribokstop.com
footbalive.org gsasearchenginerankerdiscount.com
forums.d2jsp.org helvetia.com.ua
foxjuegos.com hermesbracelets.xyz
gamebackyard.com hoholikik.club
gamedayassist.com homegardenlova.com
gateway.zscalerone.net iinstalll-fii1leis.jus0wil.pp.ua
glcomputers.ru imediadesk.com
golden-praga.ru inet-traffic.com
goo.ne.jp infazavr.ru
gsasearchengineranker.space infektsii.com
hidefiles.org iptool.xyz
himazin.info iscblog.info
hiwibyh.bugs3.com istmira.ru
homedecorpicture.us javcoast.com
horoshieokna.com journalhome.com
housediz.com keki.info
houseofrose.com
hoverboardforsaledirect.com
hscsscotland.com
hunthillfarmtrust.org
husky-shop.cz
id-forex.com
igtools.club
ilmexico.com
indianmedicaltourismshop.com
insider.pro
insta-add.pro
instabid.tech
irkutsk.online-podarki.com
itch.io
kakadu-interior.com.ua
kaliningrad.zrus.org
kazinogames.lv
kchaxton.com
keywordsking.com
keyword-suggestions.com keyword-suggestions.com
kicknights.gq kidskunst.info
komputernaya-pomosh-moscow.ru kinky-fetishes.com
kraljeva-sutjeska.com kinogolos.ru
kw21.org laxdrills.com
lanasshop.ru layola.biz.tc
lechtaczka.net lego4x4.ru
lezbiyanki.net letmacwork.world
lietaer.com lider-zhaluzi.kiev.ua
liffa.ru lion.snapmap.us
liver-chintai.org liupis.com
low-format.ru lockerz.com
mamasuper.prom.ua lsp-awak-perikanan.com
matrixalchemy.com ltvperf.com
me-ke.com luxmagazine.cf
mexicotravelnet.com m4ever.net
micasainvest.com mac-shield.com
misandesign.se malwareremovalcenter.com
mlf.hordo.win mansiondelrio.co
moetomnenie.com marketingvici.com
mojpregled.com markjaybeefractal.com
moneytop.ru m.b00kmarks.com
mosdverka.ru meds-online24.com
mountainstream.ms members.ghanaweb.com
moviemail-online.co.uk menetie.ru
mrbitsandbytes.com mex-annushka.ru
muztops.ru milblueprint.com
my-cash-bot.co minecraft-rus.org
mydearest.co minet.club
myfreemp3.eu missis.top
mykings.pw missvietnam.org
mywallpaper.top mobilemedia.md
naughtyconnect.com more-letom.ru
morpicert.pw
moscow.online-podarki.com
most-kerch.org
mouselink.co
mttwtrack.com
mymercy.info
mystats.xyz
nbsproject.ru nbsproject.ru
needtosellmyhousefast.com neks.info
newstudio.tv nelc.edu.eg
nmrk.ru
noumeda.com
nuker.com
nuup.info
oakleyglassesonline.us oakleyglassesonline.us
ok.ru onclickpredictiv.com
online247.ml perl.dp.ua
onlineku.com pharmacyincity.com
oren-cats.ru picturesboss.com
pensplan4u.com pinsdaddy.com
petitions.whitehouse.gov play-movie.pl
pistonclasico.com
play-mp3.com
poffet.net
pooleroadmedicalcentre.co.uk pooleroadmedicalcentre.co.uk
pregnant.guru porngalleries.top
proftests.net privatefx.all4invest.info
rainbowice.ru pron.pro
prostitutki-tolyatti.org
push-ad.com
pushdata.sendpulse.com
pussyspace.net
quit-smoking.ga
radiodigital.co
ranksonic.org ranksonic.org
rasteniya-vs-zombi.ru rapidsites.pro
recipedays.ru regionshop.biz
replicalouboutin.xyz remmling.de
responsive-test.net rennlist.com
restorator-msk.ru retailwith.com
sack.net rightenergysolutions.com.au
sad-torg.com.ua ritlweb.com
salut-camp.ru rogervivierforsale.com
sammyweaver.com rusenvironmental.net
samolet.fr russintv.fr
santechnik.jimdo.com rvzr-a.akamaihd.net
sbetodiodnye-lampy.ru sajatvelemeny.com
sdelatmebel.ru saletool.ru
search.pch.com sanatorrii.ru
seocdvig.ru sbdl.no
seoexperimenty.ru scanner-mark.top
sexsearch.com sexad.net
sexy-screen-savers.com sextracker.de
shariki-zuma-lines.ru sharpchallenge.com
shoppytoolmac.com shopvilleroyboch.com.ua
simplepooltips.com sibtest.ru
site3.free-share-buttons.com signal03.ru
skuteczna-dieta.co.pl sirpornogratis.xxx
slavia.info sisiynas.ru
smart-scripts.com slkrm.ru
soc-econom-problems.ru snomer1.ru
social-s-iii.xyz snts.shell-pmr.ru
softonicads.com soaksoak.ru
solution4u.com spb-plitka.ru
special-porn.com spidtest.org
spidtest.space stardevine.com
spravka130.ru stefanbakosab.se
storehouse.ua supermesta.ru
stroilka.info
stromerrealty.com
sudexpert66.ru
superiends.org
superinterstitial.com
swagbucks.com swagbucks.com
sygraem.com swinginwithme.ru
tecspb.ru szucs.ru
thegalerie.eu telsis.com
theguardlan.com textads.men
theporndude.com thebluffs.com
tizanidine4mg.blogspot.com thecounter.com
tizanidineusedfor.blogspot.com thegamerznetwork.com
toolsky.com thenetinfo.com
top-l2.com tilido.com
torrents.cd tizanidinehcl2mgsideeffects.blogspot.com
tizanidinehcl4mgtabinfo.blogspot.com
tonerbox.kz
topmira.com
tozup.com tozup.com
traffpartners.com tracksz.co
tula.mdverey.ru trafficnetzwerk.de
uggbootsoutletsale.us turvgori.ru
unitygame3d.com twinderbella.com
usbggettwku.ga ucoz.ru
vacuumscleaner.com uptime-gamma.net
via-energy-acquistare.com ural-buldozer.ru
voloslove.ru urdoot.win
voltrknc1.com venerologiya.com
vzlom-na-zakaz.com viagra-soft.ru
webkeyit.com vintontech.info
wholesalecheapjerseysfree.com visa-china.ru
whos.amung.us vmnmvzsmn.over-blog.com
woman-tampon.ru wallpaperstock.net
www.arenda-yeisk.ru website-speed-up.top
xmronta.com whatsappdownload10.com
xn----itbkqkfiq.xn--p1ai whereiskentoday.com
xvideosporn.biz xclicks.net
youbloodyripper.com xjrul.com
youporn-forum.ga x-musics.com
youporn-ru.com xn-----7kceclhb4abre1b4a0ccl2fxch1a.xn--p1ai
yoursearch.me xn----9sbubg3ambdfl1j.xn--p1ai
yuarra.pluto.ro xn--h1aakne2ba.xn--p1ai
zeroredirect6.com yellocloud.be
zhorapankratov7.blogspot.com yhit.press
yopoint.in
yougetsignal.com
zeroredirect5.com

8
.dev-tools/test_units/ratelimittest-beta.txt
View file

@ -5,6 +5,14 @@
<hr><center>nginx/1.16.1</center> <hr><center>nginx/1.16.1</center>
</body> </body>
</html> </html>
ody>
</html><html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.16.1</center>
</body>
</html>
<html> <html>
<head><title>503 Service Temporarily Unavailable</title></head> <head><title>503 Service Temporarily Unavailable</title></head>
<body> <body>

2
.dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
35.184.226.236 0; 34.66.178.120 0;
127.0.0.1 0; 127.0.0.1 0;

BIN
.latest_release/bots.d.tar.gz
View file

Binary file not shown.

BIN
.latest_release/conf.d.tar.gz
View file

Binary file not shown.

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2019.09.1828 #### Version: V4.2019.09.1837
#### Bad Referrers Blocked: [6754](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [6754](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [556](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [556](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [212](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [212](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2019.09.1828 #### Version: V4.2019.09.1837
#### Bad Referrers Blocked: [6754](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [6754](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [556](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [556](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [212](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [212](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -11,7 +11,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2019.09.1828 #### Version: V4.2019.09.1837
#### Bad Referrers Blocked: [6754](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [6754](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [556](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [556](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [212](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [212](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

1690
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2019.09.1828 #### Version: V4.2019.09.1837
#### Bad Referrers Blocked: [6754](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [6754](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [556](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [556](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [212](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [212](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

1694
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

1694
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

1694
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2019.09.1828 ### Version: V4.2019.09.1837
### Updated: Thu Sep 5 16:31:07 SAST 2019 ### Updated: Tue Sep 10 13:36:03 SAST 2019
### Bad Bot Count: 556 ### Bad Bot Count: 556
################################################### ###################################################
### Version Information ## ### Version Information ##