vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-03 19:20:16 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2021.01.2249 [ci skip]

Browse source
This commit is contained in:
Travis 2021-01-14 09:37:24 +02:00
parent 30e07fd7dc
commit b6a763e1b5
49 changed files with 92485 additions and 92464 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

10161
.dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

10161
.dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

10161
.dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

1
.dev-tools/beta_conf_files_whitelist/bots.d/custom-bad-referrers.conf
View file

@ -5194,6 +5194,7 @@
"~*(?:\b)semp\.net(?:\b)" 0; "~*(?:\b)semp\.net(?:\b)" 0;
"~*(?:\b)semprofile\.com(?:\b)" 0; "~*(?:\b)semprofile\.com(?:\b)" 0;
"~*(?:\b)semrush\.com(?:\b)" 0; "~*(?:\b)semrush\.com(?:\b)" 0;
"~*(?:\b)semxiu\.com(?:\b)" 0;
"~*(?:\b)sendearnings\.com(?:\b)" 0; "~*(?:\b)sendearnings\.com(?:\b)" 0;
"~*(?:\b)senger\.atspace\.co\.uk(?:\b)" 0; "~*(?:\b)senger\.atspace\.co\.uk(?:\b)" 0;
"~*(?:\b)seo\-2\-0\.com(?:\b)" 0; "~*(?:\b)seo\-2\-0\.com(?:\b)" 0;

10161
.dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

10161
.dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

10161
.dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

1
.dev-tools/referrers-regex-format-whitelist-test.txt
View file

@ -5147,6 +5147,7 @@
"~*(?:\b)semp\.net(?:\b)" 0; "~*(?:\b)semp\.net(?:\b)" 0;
"~*(?:\b)semprofile\.com(?:\b)" 0; "~*(?:\b)semprofile\.com(?:\b)" 0;
"~*(?:\b)semrush\.com(?:\b)" 0; "~*(?:\b)semrush\.com(?:\b)" 0;
"~*(?:\b)semxiu\.com(?:\b)" 0;
"~*(?:\b)sendearnings\.com(?:\b)" 0; "~*(?:\b)sendearnings\.com(?:\b)" 0;
"~*(?:\b)senger\.atspace\.co\.uk(?:\b)" 0; "~*(?:\b)senger\.atspace\.co\.uk(?:\b)" 0;
"~*(?:\b)seo\-2\-0\.com(?:\b)" 0; "~*(?:\b)seo\-2\-0\.com(?:\b)" 0;

1
.dev-tools/referrers-regex-format.txt
View file

@ -5143,6 +5143,7 @@
"~*(?:\b)semp\.net(?:\b)" 1; "~*(?:\b)semp\.net(?:\b)" 1;
"~*(?:\b)semprofile\.com(?:\b)" 1; "~*(?:\b)semprofile\.com(?:\b)" 1;
"~*(?:\b)semrush\.com(?:\b)" 1; "~*(?:\b)semrush\.com(?:\b)" 1;
"~*(?:\b)semxiu\.com(?:\b)" 1;
"~*(?:\b)sendearnings\.com(?:\b)" 1; "~*(?:\b)sendearnings\.com(?:\b)" 1;
"~*(?:\b)senger\.atspace\.co\.uk(?:\b)" 1; "~*(?:\b)senger\.atspace\.co\.uk(?:\b)" 1;
"~*(?:\b)seo\-2\-0\.com(?:\b)" 1; "~*(?:\b)seo\-2\-0\.com(?:\b)" 1;

2
.dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
34.122.208.80 0; 35.193.184.18 0;

10161
.dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
.dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
34.122.173.211 1; 35.193.184.18 1;
127.0.0.1 1; 127.0.0.1 1;

2
.dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
34.122.173.211 0; 35.193.184.18 0;
127.0.0.1 0; 127.0.0.1 0;

10161
.dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
.dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
34.122.173.211 1; 35.193.184.18 1;
127.0.0.1 1; 127.0.0.1 1;

2
.dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
34.122.173.211 0; 35.193.184.18 0;
127.0.0.1 0; 127.0.0.1 0;

10161
.dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
.dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
34.122.173.211 1; 35.193.184.18 1;
127.0.0.1 1; 127.0.0.1 1;

1
.dev-tools/test1_conf_files_whitelist/bots.d/custom-bad-referrers.conf
View file

@ -5194,6 +5194,7 @@
"~*(?:\b)semp\.net(?:\b)" 0; "~*(?:\b)semp\.net(?:\b)" 0;
"~*(?:\b)semprofile\.com(?:\b)" 0; "~*(?:\b)semprofile\.com(?:\b)" 0;
"~*(?:\b)semrush\.com(?:\b)" 0; "~*(?:\b)semrush\.com(?:\b)" 0;
"~*(?:\b)semxiu\.com(?:\b)" 0;
"~*(?:\b)sendearnings\.com(?:\b)" 0; "~*(?:\b)sendearnings\.com(?:\b)" 0;
"~*(?:\b)senger\.atspace\.co\.uk(?:\b)" 0; "~*(?:\b)senger\.atspace\.co\.uk(?:\b)" 0;
"~*(?:\b)seo\-2\-0\.com(?:\b)" 0; "~*(?:\b)seo\-2\-0\.com(?:\b)" 0;

2
.dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
34.122.173.211 0; 35.193.184.18 0;
127.0.0.1 0; 127.0.0.1 0;

10161
.dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
.dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,5 +45,5 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
35.193.184.18 0; 104.154.182.187 0;
34.122.208.80 0; 34.122.208.80 0;

10161
.dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
.dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,5 +45,5 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
35.193.184.18 0;
104.154.182.187 0; 104.154.182.187 0;
34.122.173.211 0;

10161
.dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

3
.dev-tools/test4_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,6 +45,5 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
34.122.208.80 0;
104.154.182.187 0; 104.154.182.187 0;
34.122.173.211 0; 35.193.184.18 0;

10161
.dev-tools/test4_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

10161
.dev-tools/test5_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

1
.dev-tools/test_units/custom-bad-referrers.conf
View file

@ -5194,6 +5194,7 @@
"~*(?:\b)semp\.net(?:\b)" 0; "~*(?:\b)semp\.net(?:\b)" 0;
"~*(?:\b)semprofile\.com(?:\b)" 0; "~*(?:\b)semprofile\.com(?:\b)" 0;
"~*(?:\b)semrush\.com(?:\b)" 0; "~*(?:\b)semrush\.com(?:\b)" 0;
"~*(?:\b)semxiu\.com(?:\b)" 0;
"~*(?:\b)sendearnings\.com(?:\b)" 0; "~*(?:\b)sendearnings\.com(?:\b)" 0;
"~*(?:\b)senger\.atspace\.co\.uk(?:\b)" 0; "~*(?:\b)senger\.atspace\.co\.uk(?:\b)" 0;
"~*(?:\b)seo\-2\-0\.com(?:\b)" 0; "~*(?:\b)seo\-2\-0\.com(?:\b)" 0;

18
.dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
Devil BackStreet
Foobot Blow
Iblog CopyRightCheck
Lipperhey Spider DomainCrawler
SearchmetricsBot Heritrix
Sogou web spider Mag-Net
Metauri
SEOstats
Toweyabot Toweyabot
VeriCiteCrawler x22Mozilla
Web Fuck
WebSauger

272
.dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
360Spider 404checker
Abonti
Aboundex
Acunetix Acunetix
ADmantX
AhrefsBot
AIBOT
Aipbot Aipbot
Alligator Alexibot
AllSubmitter
Anarchie Anarchie
Apexoo
arquivo.pt arquivo.pt
Aspiegel Aspiegel
ASPSeek ASPSeek
Asterias Asterias
AwarioRssBot AwarioSmartBot
BackDoorBot BackDoorBot
backlink-check Backlink-Ceck
BacklinkCrawler
BackStreet
BackWeb BackWeb
Badass
Bandit
BatchFTP BatchFTP
Battleztar Bazinga
BDFetch BDFetch
Bitacle Blackboard
BlackWidow
Boardreader Boardreader
Bolt
BotALot
Brandprotect Brandprotect
Brandwatch Brandwatch
Buddy Bullseye
BuiltBotTough CazoodleBot
BunnySlippers
Calculon
Cegbfeieh
CensysInspect
check1.exe
CheeseBot CheeseBot
CheTeam ChinaClaw
Claritybot Chlooe
Cloud mapping
coccocbot-web
Cocolyzebot Cocolyzebot
Cogentbot Cogentbot
cognitiveseo cognitiveseo
Copier CopyRightCheck
Craftbot Cosmos
crawl.sogou.com crawler.feedback
Crescent Crescent
CSHttp CrunchBot
Digincore CyotekWebCopy
DataCha0s
DBLBot
demandbase-bot
Devil
DigitalPebble
DIIbot
Dirbuster
Disco
Dispatch Dispatch
DittoSpyder DittoSpyder
Domains Project DomainSigmaCrawler
domainsproject.org domainsproject.org
Dotbot
Download Wonder Download Wonder
Dragonfly Dragonfly
EasyDL Drip
eCatch eCatch
ECCP/1.0 ECCP/1.0
Ecxi evc-batch
EirGrabber
EMail Siphon
Exabot
Express WebPictures Express WebPictures
ExtLinksBot Extractor
ExtractorPro ExtractorPro
Extreme Picture Finder Extreme Picture Finder
facebookscraper EyeNetIE
Ezooms
FDM FDM
FemtosearchBot
Firefox/7.0 Firefox/7.0
FlashGet
Flunky Flunky
Freeuploader Freeuploader
FyberSpider FrontPage
GetRight GalaxyBot
Genieo
GermCrawler
GetWeb
Gigablast Gigablast
Go-Ahead-Got-It Gigabot
Gotit Go!Zilla
GrabNet
Grafula Grafula
GrapeshotCrawler GrapeFX
GT::WWW
Haansoft Haansoft
Harvest Harvest
Havij Havij
HEADMasterSEO
heritrix heritrix
Heritrix HTTP::Lite
Hloader HTTrack
HTMLparser
Humanlinks Humanlinks
IDBot
IDBTE4M
IlseBot IlseBot
Image Fetch
Image Sucker Image Sucker
Indy Library InfoTekies
Intelliseek Intelliseek
Iria Internet Ninja
IRLbot InternetSeer
Jbrofuzz IstellaBot
JennyBot JennyBot
JetCar JetCar
Jetty Jetty
JOC Web Spider JOC Web Spider
Joomla
Jorgee
JustView
Kenjin Spider Kenjin Spider
Kozmosbot Kozmosbot
Larbin
LeechFTP LeechFTP
Lftp
LieBaoFast LieBaoFast
Likse Likse
Linkbot
Linkdexbot
LinkextractorPro LinkextractorPro
LinkWalker LinkWalker
Lipperhey Spider LinqiaMetadataDownloaderBot
Ltx71 LinqiaRSSBot
lwp-request Magnet
LWP::Simple
lwp-trivial
Mag-Net Mag-Net
magpie-crawler magpie-crawler
Majestic12 Majestic12
Majestic SEO Majestic SEO
Majestic-SEO Majestic-SEO
MarkMonitor MarkMonitor
Mata Hari Masscan
meanpathbot MauiBot
Meanpathbot MeanPath Bot
Metauri Mediatoolkitbot
MegaIndex.ru
MFC_Tear_Sample MFC_Tear_Sample
MicroMessenger MicroMessenger
MIDown tool MIDown tool
MJ12bot MJ12bot
Mojolicious Mojeek
Morfeus Fucking Scanner
Mozlila Mozlila
MQQBrowser Musobot
Nameprotect
Navroad Navroad
NearSite Nessus
netEstate NE Crawler
NetMechanic NetMechanic
NetSpider
Nettrack Nettrack
Net Vampire
Netvibes Netvibes
NextGenSearchBot
Nibbler Nibbler
Niki-bot Niki-bot
Nikto Nikto
NimbleCrawler Ninja
Nimbostratus oBot
Nmap
Octopus Octopus
Offline Navigator OpenLinkProfiler
Openvas Openvas
OPPO A33 OPPO A33
OrangeSpider Page Analyzer
OutclicksBot PageGrabber
Pandalytics Pandalytics
Pavuk Pavuk
PECL::HTTP pcBrowser
Petalbot
PHPCrawl PHPCrawl
Picscout
Pixray Pixray
PleaseCrawl
plumanalytics plumanalytics
Pockey Probethenet
POE-Component-Client-HTTP QueryN Metasearch
ProPowerBot RankingBot2
ProWebWalker
Psbot
RankActive
RankingBot
RankurBot RankurBot
Reaper
Recorder Recorder
RedesScrapy
ReGet ReGet
RocketCrawler SBIder
Rogerbot
s1z.ru
satoristudio.net
Scanbot
scan.lol
ScoutJet
Scrapy Scrapy
SearchmetricsBot Screaming
SEOlyticsCrawler ScreenerBot
Searchestate
Semrush
SemrushBot
SEOkicks
SEOprofiler SEOprofiler
SISTRIX serpstatbot
sexsearcher
Sitebeam Sitebeam
SiteSucker SiteCheckerBotCrawler
SiteExplorer
SiteLockSpider
Sitevigil Sitevigil
SlySearch
SmartDownload SmartDownload
SMTBot
Snake
Snoopy Snoopy
Sociscraper SocialRankIOBot
Sosospider SpaceBison
Sottopop SpankBot
Spammen
sp_auditbot
Spbot Spbot
Steeler spyfu
Stripper Sqlworm
Sucker Sqworm
Sucuri Sucuri
SuperBot SuperBot
SurveyBot
Swiftbot Swiftbot
sysscan sysscan
Szukacz Szukacz
tAkeOut T0PHackTeam
Teleport
TeleportPro TeleportPro
Telesphoreo Telesphoreo
Telesphorep The Intraformant
TheNomad
Thumbor Thumbor
TightTwatBot Titan
Toata Toweyabot
Tracemyfile Tracemyfile
Turnitin Trendictionbot
TurnitinBot TwengaBot
Typhoeus Typhoeus
UnisterBot
URLy Warning URLy Warning
URLy.Warning URLy.Warning
Vagabondo
VB Project VB Project
Virusdie VidibleScraper
WASALive-Bot WASALive-Bot
WBSearchBot WBSearchBot
Web Auto Webalta
Web Collage WebCollage
WEBDAV WebEnhancer
Web Enhancer
Web Fetch Web Fetch
WebFuck
Web Fuck Web Fuck
WebImageCollector WebImageCollector
WebmasterWorldForumBot WebSauger
webmeup-crawler Webshag
Web Pix Webster
Web Sauger
WebsiteExtractor
Website Quester
WebSucker WebSucker
WebZIP Web Sucker
WebWhacker
WeSEE
Whack
Whatweb Whatweb
WISENutbot Who.is Bot
Wonderbot Widow
Woobot WinHTTrack
Wprecon
WPScan
WWW-Collector-E WWW-Collector-E
WWW::Mechanize
WWWOFFLE
x09Mozilla
x22Mozilla
Xaldon WebSpider Xaldon WebSpider
Xenu
YoudaoBot YoudaoBot
Zade
Zauba Zauba
Zermelo zauba.io
zgrab Zitebot
ZmEu
ZoominfoBot

286
.dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
360Spider
404checker
80legs 80legs
Aboundex Abonti
Acunetix Acunetix
ADmantX ADmantX
AfD-Verbotsverfahren
AIBOT AIBOT
AiHitBot
Aipbot Aipbot
Alexibot Alexibot
arquivo-web-crawler Alligator
Attach AllSubmitter
autoemailspider Anarchie
AwarioRssBot Ankit
AwarioSmartBot Anthill
archive.org_bot
ASPSeek
Asterias
BackDoorBot BackDoorBot
BacklinkCrawler BacklinkCrawler
BackStreet BackWeb
BBBike Badass
BDCbot BatchFTP
BlackWidow Blackboard
BLEXBot Blow
BlowFish
BotALot BotALot
Brandwatch
Buddy Buddy
BuiltBotTough BuiltBotTough
BuiltWith Bullseye
Calculon BunnySlippers
CATExplorador CazoodleBot
CCBot
Cegbfeieh Cegbfeieh
CensysInspect
check1.exe
CheeseBot CheeseBot
CheTeam Claritybot
Chlooe
Cliqzbot Cliqzbot
Cocolyzebot Cocolyzebot
CODE87
Cogentbot Cogentbot
Collector cognitiveseo
com.plumanalytics
Copier
Copyscape Copyscape
Cosmos
Craftbot Craftbot
crawler4j
crawler.feedback crawler.feedback
crawl.sogou.com
CrazyWebCrawler
Crescent Crescent
CSHttp CSHttp
Curious Custo
DIIbot CyotekWebCopy
DatabaseDriverMysqli
DBLBot
demandbase-bot
Demon
DigitalPebble
Dirbuster Dirbuster
Discobot Discobot
Discoverybot
Dispatch Dispatch
DomainSigmaCrawler DittoSpyder
DnyzBot
DomainCrawler
domainsproject.org domainsproject.org
DomainStatsBot Drip
EMail Wolf EroCrawler
Evil
Express WebPictures Express WebPictures
ExtLinksBot Extractor
EyeNetIE ExtractorPro
facebookscraper facebookscraper
FDM Firefox/7.0
FHscan
Flunky Flunky
Freeuploader
FrontPage FrontPage
FyberSpider
Fyrebot
GermCrawler
Getintent Getintent
Gigablast Go-Ahead-Got-It
G-i-g-a-b-o-t Go!Zilla
GrapeshotCrawler Grafula
GridBot
GT::WWW GT::WWW
Haansoft
Havij Havij
Heritrix HEADMasterSEO
Hloader heritrix
HMView HMView
HTMLparser
HTTP::Lite HTTP::Lite
IlseBot HybridBot
IDBTE4M
Id-search
Image Fetch
IndeedBot IndeedBot
Indy Library
InfoNaviRobot InfoNaviRobot
InterGET InterGET
InternetSeer
internetVista monitor internetVista monitor
Iskanie ips-agent
Jbrofuzz IstellaBot
JetCar JamesBOT
JOC Web Spider JennyBot
JikeSpider
Jorgee Jorgee
JustView JustView
Jyxobot Jyxobot
Kenjin Spider
Keyword Density Keyword Density
Kozmosbot
Lanshanbot Lanshanbot
Larbin Larbin
LeechFTP LeechFTP
LexiBot
Lftp Lftp
LibWeb Libwhisker
LieBaoFast Lightspeedsystems
Likse Linkdexbot
LinkpadBot LinkScan
LinksManager LinksManager
LinkWalker
LinqiaRSSBot LinqiaRSSBot
Lipperhey
Lipperhey Spider Lipperhey Spider
Litemage_walker Lmspider
LNSpiderguy
Ltx71 Ltx71
lwp-request lwp-request
LWP::Simple LWP::Simple
lwp-trivial lwp-trivial
Mag-Net Mail.RU_Bot
Majestic12 Majestic SEO
Masscan MarkMonitor
Mass Downloader Mass Downloader
MauiBot Mb2345Browser
Meanpathbot MeanPath Bot
mediawords MegaIndex.ru
Metauri
MicroMessenger MicroMessenger
Microsoft Data Access Microsoft URL Control
MIDown tool
MJ12bot MJ12bot
Mojeek
Mojolicious Mojolicious
Msrabot Mozlila
MQQBrowser
Mr.4x3
MSFrontPage
MSIECrawler
Name Intelligence Name Intelligence
Nameprotect Needle
NetAnts NetSpider
netEstate NE Crawler
NetLyzer
NetMechanic
Nettrack Nettrack
Net Vampire Net Vampire
Netvibes
NetZIP
NextGenSearchBot
Niki-bot
Nikto Nikto
NPbot Nimbostratus
Nmap
Nutch Nutch
oBot
Offline Navigator
OnCrawl
Openfind
Openvas Openvas
OpenVAS OPPO A33
PageScorer OrangeBot
Pandalytics OrangeSpider
Pavuk OutfoxBot
PeoplePal PageAnalyzer
PHPCrawl PECL::HTTP
PictureFinder Petalbot
Pimonster Picsearch
Pi-Monster Pi-Monster
Pixray
plumanalytics plumanalytics
Pockey Pockey
POE-Component-Client-HTTP POE-Component-Client-HTTP
Psbot ProPowerBot
PxBroker ProWebWalker
PyCurl RankingBot2
RankFlex
Recorder
RedesScrapy
ReGet ReGet
Ripper Ripper
RSSingBot satoristudio.net
s1z.ru
Scanbot
Scrapy
ScreenerBot
Searchestate Searchestate
SearchmetricsBot SemrushBot
SentiBot SeoSiteCheckup
SEOkicks serpstatbot
SEOkicks-Robot
SEOlyticsCrawler
Seomoz
seoscanners
Siphon Siphon
Sitebeam
sitechecker.pro sitechecker.pro
Siteimprove
SiteLockSpider SiteLockSpider
SiteSnagger
SiteSucker SiteSucker
Site Sucker Sitevigil
SmartDownload
SMTBot SMTBot
Snake Snoopy
Snapbot SocialRankIOBot
sogouspider sogouspider
Sogou web spider
Sosospider Sosospider
SpankBot SpaceBison
Spanner Spanner
sp_auditbot sp_auditbot
Spbot
Spinn3r Spinn3r
SputnikBot SputnikBot
Sqlmap Sqlworm
Sqworm Sqworm
Sucker Sucker
Sucuri Suzuran
Swiftbot Swiftbot
sysscan
T8Abot T8Abot
tAkeOut TeleportPro
Telesphorep Telesphoreo
TheNomad Thumbor
Toweyabot Toata
Trendiction trendiction.com
True_Robot True_Robot
Turingos
Turnitin Turnitin
Twice TurnitinBot
Upflow Upflow
URLy.Warning URLy Warning
Vacuum Vacuum
VB Project Vagabondo
VCI VelenPublicWebCrawler
Virusdie VeriCiteCrawler
Voil Voil
Voltron Voltron
Wallpapers/3.0
WallpapersHD WallpapersHD
WASALive-Bot WASALive-Bot
WBSearchBot
WebAuto
Web Auto
WebBandit WebBandit
WebCollage Web Collage
WebCopier WebCopier
WEBDAV WebEnhancer
Web Enhancer Web Enhancer
Web Fetch WebFetch
WebFuck WebFuck
Web Fuck
webmeup-crawler webmeup-crawler
WebPix Web Pix
WebReaper WebReaper
Web Sauger
Webshag
Website Quester Website Quester
WebWhacker WebStripper
Whack WebSucker
Whacker WebZIP
WeSEE
Whatweb Whatweb
Who.is Bot WISENutbot
Widow
Wonderbot
Woobot Woobot
Wprecon Wotbox
WPScan
WWW-Collector-E WWW-Collector-E
WWW-Mechanize
WWW::Mechanize
x22Mozilla x22Mozilla
Xenu Xenu
Zeus xpymep1.exe
zgrab zauba.io
ZmEu
ZumBot ZumBot
ZyBorg ZyBorg

20
.dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
brakehawk.com calcularpagerank.com
cibpenonptib.flu.cc cheapmarmot.online
este-line.com.ua elidelcream.weebly.com
gogps.me handicapvansarea.com
ifirestarter.ru kraljeva-sutjeska.com
pastaleads.com law-check-eight.xyz
seccioncontrabajo.com link.ac
smokewithrabbits.com mailemedicinals.com
video-woman.com unionmarkt.de
womensterritory.ru usdx.us

932
.dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
03e.info 01apple.com
08800.top 101raccoon.ru
1001desert.com 123cha.com
123locker.com 1bet.com
12u.info 1stat.ru
1qingdao.com
2728fb936f0.com
2drittel.de
2girls1cup-free.com 2girls1cup-free.com
34.gs 4k-player.pl
888.com 4ur.click
9icmzvn6.website 57883.net
aasoldes.fr 5u.com
abbanreddy.com 6hopping.com
abcdeg.xyz 7yue.org
abwa.tk 91abcw.com
acgs.tk 9med.net
adf.ly aa8780bb28a1de4eb5bff33c28a218a930.com
adidas.frwebs.fr aaa38852e886ac4af1a3cff9b47cab6272.com
adimmix.com aadroid.net
adman.gr accessoires-mode.in
adrenalin-stk.ru acmebtn.ml
adsref.men adelly.bg
ads.tremorhub.com adnotbad.com
adult-shop.com.ua adsland.men
advancedsoftwaresupport.com ad-words.ru
ageofclones.com afftrack001.com
albuteroli.com airmaxshoes-2016.com
alekseevec.ru akuhni.by
alfapro.ru akusherok.ru
aliexpress.com albamargroup.com
allornamenti.com alevinefesleri.com
alveris.ru all4invest.ru
amateurmatch.com allkrim.com
amazon-adsystem.com alpharma.net
ameblo.jp amospalla.es
anapa-inns.ru amung.us
andpolice.com anal-acrobats.hol.es
android4fun.org anatomiy.com
animaltoplist.com apimegabrowsebiz-a.akamaihd.net
anmysite.com aquarium-pro.ru
anonymous-redirect.com arcadeplayhouse.com
apidiamondatanet-a.akamaihd.net arendovalka.xyz
apparel-offer.com asiengirls.net
approvedlocal.co.za asrv-a.akamoihd.net
arabgirls.adultgalls.com atlasvkusov.ru
arenda-avtoprokat-krasnodar.ru atley.eu.pn
arius.tech audiobangout.com
artel116.ru australia-opening-times.com
articlesdirectoryme.info auto-moto-elektronika.cz
asscenihotosidea.blogspot.co.za auto.rusvile.lt
atmagroup.ru autoua.top
autogrep.ru avitocars.ru
aviav.org avto-oligarh.ru
avkzarabotok.com back.dog
avtointeres.ru bag77.ru
awaybird.ru bagcionderlab.com
babespcs.com bannerswap.com
bagsonsale.online
balitouroffice.com
balois.worldbreak.com
beauty-bracelet.com beauty-bracelet.com
beauty-clinic.ru benchmarkcommunications.co.uk
begalka.xyz best-deals-products.com
bestchoice.cf bestssaker.com
bestdooz.com bet365.com
bestempresas.es betonka.pro
bestofferswalkmydogouteveryday.gq bidbuy.co.kr
best-seo-solution.com
bestserials.com
betwinservice.com
big-boards.info
bigcareer.info
big-cash.net
bio-optomarket.ru bio-optomarket.ru
bio.trade-jp.net blog-hits.com
biteg.xyz bluerobot.info
bkgr.se
blockety.co
blockworld.ru
bmwhighperformers.com bmwhighperformers.com
boazpower.com bocoarchives.org
bochemit.com.ua bonanza-fortune.men
bongacams.com bonzybuddy.com
boo-arts.com brandedleadgeneration.com
bookmark4you.com bukleteg.xyz
boole.onlinewebshop.net buypanicdisorderpill.com
bosefux.esy.es carson.getenjoyment.net
bouda.kvalitne.cz casablancamanor.co.za
braintobe.win castingbank.ru
browserprotecter.com catalogs-parts.com
business-made-fun.com caveavins.fr
buy-meds24.com cbb1smartlist12.click
buzzurl.jp cete.ru
candlehandmade.com chatroulette.world
carsdined.org chiblackhawks-jerseys.com
cartiertrinity.xyz chidporn.com
casite-513049.cloudaccess.net chocoslim.pro
censys.io choice-credit.ru
chcu.net chuckguilford.com
chocolateslim-en-espana.com clayvasedesigns.tk
christianlouboutinsaleonline.us clickhype.com
clknsee.com clknsee.com
clubfashionista.com clmforexeu.com
club-samodelkin.ru club-lukojl.ru
cobaltpro.ru club-musics.ru
codq.info
cometorussia.net
comissionka.net comissionka.net
cookie-law-enforcement-aa.xyz compliance-elena.top
compliance-elena.xyz
compliance-julianna.top
compliance-margo.top
conocer-sanabria.com
cookingmeat.ru
copenergo.ru copenergo.ru
copyrightclaims.org
cornerstone-countertops.com
cornomase.win
cosmetic.donna7753191.ru cosmetic.donna7753191.ru
cpabegins.ru cottageofgrace.com
crafthubs.com danceuniverse.ru
crazyprotocol.com data-mining.tk
crd.clan.su datract.com
creditnation.ru dentalpearls.com.au
cubs-jerseys.us depositfiles-porn.ga
customboxes4less.com descargar-musica-gratis.net
cxpromote.com designdevise.com
d2jsp.org detki-opt.ru
dairyindia.in detmebel.su
dame-ns.kz dev.citetick.com
db.speedup.gdn dfwu1019.info
ddpills.com dieswaene.com
deanmoore.ie diffbot.com
delfin-aqua.com.ua dinkolove.ya.ru
detoxmed24.ru directrev.com
dfiles.me djstools.com
dildofotzen.net dnepr-avtospar.com.ua
dotnetdotcom.org dojki-hd.com
downtuptv.gq domainanalyzing.xyz
droidlook.net domaincdn.xyz
druzhininevgeniy63.blogspot.com dosug-lux.ru
dstroy.su dprtb.com
dvervmoskvu.ru drhomes.biz
e705.net driving.kiev.ua
elektrischezi.canalblog.com dwomlink.info
elektrischezigarette1.onsugar.com eachdayisagift.review
elektrischezigarette2.onsugar.com efkt.jp
epngo.bz ekto.ee
eredijovon.com e-kwiaciarz.pl
eropho.com elektronischezigarettekaufen1.beeplog.com
esopini.com elektronischezigarettekaufen2.tumblr.com
essayservicewriting.org elektronischezi.livejournal.com
estibot.com elkacentr.ru
etenininrade.ga englishgamer.com
exoneration-project.us eng-lyrics.com
extractorandburner.com enthuse.computernetworksonline.com
extremez.net escortplius.com
ezigaretteshop2.vefblog.net estelight.ru
fatmaelgarny.com eupornstar.info
fenoyl.batcave.net europages.com.ru
fickkontaktehobbyhuren.com everflora.ru
filkhbr.com evogarage.com
filmbokep69.com exchanges-bet.com
financetip.eu exportshop.us
flashahead.info failingmarriege.blogspot.com
flavors.me fashionavenuegame.com
femdom.twiclub.in
fettefrauen.net
fickblock18.com
fifa-coins.online
filmidivx.com
filmi-onlain.info
findanysex.com
findsexguide.com
firesub.pl
firstdrugmall.ru
fix-website-errors.com
flex4launch.ru flex4launch.ru
flirt4free.com floridahuntingfishingadventures.com
foodcrafts.website f-online.de
forexgb.ru fordsonmajbor.cf
formularz-konkurs.tk forex21.ru
freetangodownload.com fortunejack.com
frustrated-favorable.gq forums.d2jsp.org
frvo.alptandem.ru free-laptop-reward.com
galleryawesome.com freemaintenancesysforpcandmac.top
gaming-journal.com freenom.link
gdzkurokam.ru freesitetest.com
ge0ip.org free-social-buttons.xyz
geoads.com freeuploader.ml
gepezz.info fuckbuddybestgilf.info
gg.zzyjxs.com fxgallery.com
gigapeta.com galaxyflowers.ru
given2.com gamerextra.com
glogow.pl gay-file.com
gearcraft.us
germetiki.com.ua
gfaq.ru
girlspicsa.com
gk-atlant.info
glavtral.ru
globalsurfari.com
globatur.ru
globetrotting-culture.ru
gnuetella.com
gogalleryawesome.com
gonextmedia.com gonextmedia.com
googlemare.com googlemare.com
gopixdatabase.com goosefishpost.bid
gowreckdiving.com gopro-online.info
gox.com.ua greatfind-a.akamaihd.net
gpirate.com
gratis-sexkontakte.com
gsmtlf.ru gsmtlf.ru
guardlink.com guiadeserraazul.com
gungamesz.com hackers-crackers.tk
h2monline.com handicapbathtubarea.com
hamilton.ca hanwei.us
healing-dysplasia.ru harmonyglen.us
healthcarestore.info hem.passagen.se
heygidday.biz hobbyhuren24.net
high-speed1.net
homik.pw
hosting-tracker.com
hostnow.men hostnow.men
host-tracker.com hotgirlhdwallpaper.com
hoverboard360.de hoverboard360.de
https-legalrc.biz hoverboardforsaledirect.com
ideawheel.com hybrid.ru
imagui.eu ideibiznesa2015.ru
imgarit.pw ideoworld.org
indianmedicaltourismshop.com imediadesk.com
indo-export.ru interfucks.net
infodocsportal.com islandminingsupply.wordpress.com
internetproviderstucson.com istizanidinelikexanax.blogspot.com
investsuccess.org iwanttodeliver.com
iqupdatetmz.win iweblist.info
i-service.kz ixora.pro
isitpaleo.info jestr.org
izhevsk.zrus.org jikoman.info
jabimgo.pw jimmychoosale.online
jerseyswholesalechinalimited.com jus0wil.pp.ua
job.icivil.ir kambasoft.com
jolic2.com
justucalling32211123456789.tk
kamalsinha.com
kanimage.com kanimage.com
karpun-iris.ru karting196.ru
katushka.net keki.info
keyhantercume.com kerch.site
keywords-monitoring-your-success.com kinozapas.org
kino-ecran.ru klikbonus.com
kinofak.net klosetkitten.com
kochanelli.com kollekcioner.ru
kometars.xyz konturkrasoty.ru
koopilka.com kskjco.club
kosova.de landreferat.ru
kotaku.com laptop-4-less.com
krasula.pp.ua larose.jb2c.me
kumuk.info lecbter-relationships.ga
labelwater.se leftofcentrist.com
lacapilla.info legionalpha.com
ladsblue.com letmacwork.world
lampokrat.ws light.ifmo.ru
laserpen.club limads.men
lenvred.org lion.conboy.us
letolove.ru littlesunraiser.com
letslowbefast.site liveinternet.ro
letto.by livingcanarias.com
libertybilisim.com lkbennettoutlet.online
lietaer.com locatellicorretor.com.br
lineshops.biz locustdesign.co
linkrr.com lombia.com
livefixer.com low-format.ru
liver-chintai.org
livetsomudvekslingstudent.bloggersdelight.dk
liveu.infoteka.hu
livingroomdecor.info
lubetube.com
lyngdalhudterapi.no lyngdalhudterapi.no
machicon-akihabara.info magicalfind-a.akamaihd.net
magiadinamibia.blogspot.com mailemedicinals.com
manifestation.betteroffers.review malwareremovalcenter.com
mansiondelrio.co managerpak204.weebly.com
matrixalchemy.com manualterap.roleforum.ru
mebel-alait.ru marblestyle.ru
megahdporno.net marinetraffic.com
megaindex.ru matchpal-a.akamaihd.net
metascephe.com medicinacom.ru
microsoftportal.net medmajor.ru
microstatic.pl meds-online24.com
minyetki.ru meetlocalchicks.com
mir-limuzinov.ru mega-bony-2017.pl
missis.top message-warning.net
metaxalonevstizanidine.blogspot.com
mexicosleevegastrectomy.com
michaelkorssaleoutletonline.net
mikrobiologies.ru
mindbox.co.za
minegam.com
miniads.ca
mnogabukaff.net mnogabukaff.net
mobile-appster.ru mobilierland.com
modenamebel.ru mobplayer.ru
moesexy.com moncleroutletonline.xyz
mojpreskumanie.com moneytop.ru
monclercheap.xyz mountainstream.ms
moneyzzz.ru mrbitsandbytes.com
morepoweronmac.trade mriyadh.com
mowser.com musicspire.online
mrbojikobi4.biz mydirtyhobby.com
mrsdalloways.com myftpupload.com
mttwtrack.com myindospace.com
musicas.baixar-musicas-gratis.com myiptest.com
muycerdas.xxx myonlinepayday.co
muznachas-service.ru myplaycity.com
myanyone.net naval.jislaaik.com
myblogregistercm.tk nhl17coins.exblog.jp
myfreemp3.eu nicefloor.co.uk
myonigroup.com
mypets.by
myprintscreen.com
mystats.xyz
nakozhe.com
networkad.net
nextconseil.com
nextrent-crimea.ru
nikitabuch.com
nl.netlog.com nl.netlog.com
nomuos.it notebook-pro.ru
nrv.co.za notfastfood.ru
office-windows.ru obiavo.com
ok.ru odoratus.net
oktube.ru offer.wpsecurity.website
onblastblog.online office2web.com
onlinadverts.com onlythegames.com
online-x.ru openlibrary.org
o-o-6-o-o.ru orion-v.com
o-o-8-o-o.com osb.se11.ru
oops-cinema.ru page2rss.com
orgasmatrix.com panamaforbeginners.com
oxotl.com panouri-solare-acoperis.com
palvira.com.ua pc-virus-d0l92j2.pw
paparazzistudios.com.au pdn-4.com
petsblogroll.com petitions.whitehouse.gov
piccshare.com pharmacyincity.com
picsforkeywordsuggestion.com pictures-and-images.net
pintattoos.com pinstake.com
pixell.club piulatte.cz
platezhka.net piuminiita.com
playfortuna-play.ru pix-hd.com
popunder.ru plastgranar.nu
platesauto.com
platinumdeals.gr
playmsn.com
pl.id-forex.com
pojdelo.weebly.com
pokemongooo.ml
pokerniydom.ru
popmarker.com
popugauka.ru
popup-hgd.xyz
popup.matchmaker.com popup.matchmaker.com
pornobrazzers.biz pornhubforum.tk
pornhub-ru.com
pornodojd.ru pornodojd.ru
pornohd1080.online pornogad.com
porno-play.net pornosemki.info
printdirectforless.com posible.net
proekt-gaz.ru praisong.net
promoforum.ru priora-2.com
prostitutki-yaroslavlya.org privatefx.all4invest.info
pro-tec.kz projectforte.ru
putevka24.ru prombudpostach.com.ua
puzo2arbuza.ru promoheads.com
quickcashlimited.com pro-poly.ru
radiodigital.co prostitutki-kharkova.org
ragecash.com puserving.com
rangoman.date putitin.me
razyboard.com quickbuck.com
rcb101.ru quickloanbank.com
rainbowice.ru
rangjued.com
razleton.com
redirectme.net redirectme.net
rednise.com redirect.trafficreceiver.club
reeyanaturopathy.com research.ifmo.ru
rethinkwasteni.info responsive-test.net
ring4rhino.com reversing.cc
rockingclicks.com reyel1985.webnode.fr
ringporno.com
robertefuller.com
roleforum.ru
roofers.org.uk
rospromtest.ru rospromtest.ru
royalcar-ufa.ru rostov.xrus.org
ruclicks.com rukino.org
rusoft-zone.ru rus-pornuha.com
rusprostitute.com russian-postindex.ru
russia-tao.ru sakhboard.ru
russkie-gorki.ru
rvtv.ru
sady-urala.ru
safe-app.net
sa-live.com sa-live.com
saneitconsulting.com salutmontreal.com
saratov.xrus.org sbricur.com
savefrom.com scanspyware.net
scanner-alexa.top searchwebknow-a.akamaihd.net
scanner-john.top seminarygeorgia59.ga
score-ads.men semrush.com
sc-specialhost.com seoanalyses.com
sdsjweb.com seoheap.com
searchinterneat-a.akamaihd.net serw.clicksor.com
searchkut.com
securityallianceservices.com
sendearnings.com
servicecenter.co.ua
sexcamamateurchat.com
sexfreepornoxxx.com sexfreepornoxxx.com
sextracker.be sex-pr.net
sexy.babes.frontend-stack.top sex-sex-sex5.com
shariki-zuma-lines.ru sexyteens.hol.es
sexytrend.ru
sfd-chess.ru
sharebutton.net
shopperifymac.com shopperifymac.com
shop.xz618.com sildenafilcitratemed.com
shtaketniki.kz sims-sims.ru
similardeals.net site-auditor.online
simplepooltips.com siteheart.net
sim-service.net skincrate.net
sisiynas.ru slowmac.tech
sitevaluation.org
sklad-24.ru
slayerlife.com
slonechka.ru
slujbauborki.ru slujbauborki.ru
small-game.com snomer1.ru
sneakyboy.com snts.shell-pmr.ru
snip.tw socas.pluto.ro
socialbookmarksubmission.org social-button.xyz
social-buttons.com socialsignals24.com
socialmediasuggest.com softxaker.ru
socialmonkee.com solicita.info
softomix.com solinf.co
softonicads.com songplanet.ru
softwaretrend.net sovetogorod.ru
soserfis.com spb-plitka.ru
sport7777.net sport7777.net
spymac.net spywareit.com
spy-sts.com srgwebmail.nl
stairliftsarea.com start.myplaycity.com
standardchartered-forex.com steamoff.net
stats-collector.org sterva.cc
stillmiracle.com stevemonsen.com
suralink.com stockspmb.info
surffoundation.nl suhanpacktech.com
swinger-mobil.net sumo.com
syndicate.fun supers.com.ua
tattooreligion.ru support.nopeas.sk
susanholtphotography.com
svetodiodoff.ru
sweepstakes.rewardit.com
swinginwithme.ru
taaaak.com
taraz.xkaz.org
tasteidea.com
taxi-v-eisk.ru taxi-v-eisk.ru
telesvoboda.ru thaismartloan.com
telsis.com thebitcoincode.com
tgtclick.com thebluffs.com
thaisamkok.com thedownloadfreeonlinegames.blogspot.com
theautoprofit.ml the-torrent-tracker.blogspot.com
thebluenoodle.com the-usa-games.blogspot.com
tiandeural.ru
tilido.com tilido.com
titslove.yopoint.in tizanidine4mg.blogspot.com
tizanidinehcl2mgtablet.blogspot.com tizanidineandhydrocodone.blogspot.com
top10registrycleaners.com tizanidinedruginteractions.blogspot.com
top250movies.ru tizanidineforopiatewithdrawal.blogspot.com
topanasex.com tizanidinehcl4mgtab.blogspot.com
trackmedia101.com tizanidinesideeffectsweightloss.blogspot.com
tracxn.com tizanidinewithdrawal.blogspot.com
traffic100.com traffique.net
trafficgenius.xyz tri-slona.org
trafficmp.com trucri.me
traffpartners.com tubo360.com
trk-4.net
trkur.com
turist-strani.ru
turizm.bz
turkeyreport.tk turkeyreport.tk
twittruth.com tvnewsclips.info
twodollarshows.com tvteleport.ru
txxx.com tx41tclega.ru
tyumen.xrus.org u-cheats.ru
ukrtvory.in.ua uchetunet.su
unrealcommander.biz ukkala.xyz
upstore.me umityangin.net
urll.eu unblocksit.es
usbggettwku.ga uni.me
ustion.ru universals.com.ua
valuado.com uprour.com
v-doc.co uptimebot.net
veles.shop usiad.net
valmetrundan.se
vavilone.com
vesnatehno.ru
viagra.pp.ua viagra.pp.ua
via-gra.webstarts.com viberdownload10.com
viandpet.com videochaty.ru
videospornogratisx.net video--production.com
vigrx-original.ru
vilingstore.net
vipps.com.my vipps.com.my
vkmusics.ru vipsexfinders.com
vod.com.ua vkak.ru
voloo.ru wallpaperstock.net
vpnhowto.info we-are-gamers.com
vriel.batcave.net webadvance.club
vrotike.ru web-betting.ru
vroze.com website-analyzer.info
vsdshnik.com website-speed-check.site
vzglyadriv.kg weburlopener.com
wareseeker.com wemarketing.se
watsonrealtycorp.com wheelchairliftsarea.com
webmasters.stackexchange.com wineration.com
webpromotion.ae works.if.ua
welck.octopis.com wstroika.ru
wladimirpayen.com x-diesel.com
wleuaprpxuvr.ga xn--80aafb2a.xn--p1ai
woodyguthrie.se xn--b1addnj3cah.xn--p1ai
word-vorlagen.xyz xnxxandxvideos.com
wormix-cheats.ru xolodremont.ru
wurr.voila.net xsion.net
www.kabbalah-red-bracelets.com x-stars.ru
www.labves.ru
www.timer4web.com
xaylapdiendanang.com
xblog.in
x-diesel.info
xfluro.com
xgames-04.com
x-lime.net
xmronta.com
xn----8sbdbjgb1ap7a9c4czbh.xn--p1acf
xn----9sbebi2bvzr7h.xn--p1ai
xn--b1adccaf1bzj.xn--p1ai
xn----btbdvdh4aafrfciljm6k.xn--p1ai
xnxx699.com
xvideospornoru.com xvideospornoru.com
xxxasianporn.net
xxxtube69.com xxxtube69.com
yogamatsexpert.com yellowfootprints.com
youraticles.pl yellowproxy.net
yourserverisdown.com yougame.biz
zaimite.ru youjizz.vc
zakonobosago.ru yoursearch.me
zaloadi.ru youtuhe.com
zarabotat-na-sajte.ru ypmuseum.ru
zero1.it zaim-pod-zalog-krasnodar.ru
zeroredirect8.com zajm-zalog-krasnodar.ru
zeroredirect9.com zebradudka.com
zkjovpdgxivg.ga zebramart.ru
zojirushi-products.ru zetgie.com.pl
zone-kev717.info zhorapankratov7.blogspot.com
zoosexart.com zolotoy-lis.ru
zryydi.com zooggames.com
zoompegs.com
zootoplist.com

476
.dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
20pascals.nl 0912701309f8ce.com
2pxg8bcf.top 5ws.dating-app.ru
72-news.com 7a2rnuey1tw9ar.ru
777-club.ru 9med.net
a1security.com.ua abcdeg.xyz
activecampaign.dreamhosters.com admanaerofoil.com
admitad.com admeasures.com
advertisingtag.net adsland.men
aktivator-windows10.blogspot.com adventureparkcostarica.com
alert-hgd.xyz agreda.pluto.ro
allproblog.com alldubai.biz
alphacarolinas.com allpdfmags.net
animali.deagostinipassion.it alpinism.ru
apibrowsesmartne-a.akamaihd.net amazingpic.net
apiqualitinknet-a.akamaihd.net
articlesdirectoryme.info articlesdirectoryme.info
autowebmarket.com.ua atleticpharm.org
avtocredit-legko.ru autochoixspinelli.com
azbuka-mo.ru aviav.eu
bala.getenjoyment.net avitocars.ru
bensbargains.net avto-oligarh.ru
betonka.pro backlinkwatch.com
bigcareer.info baixar-musicas-gratis.com
bio-japan.net bear.gotcher.us
bitcoins-live.ru beauby.ru
bloggedporn.com best-deals-products.com
blog.remote-computer.de bet-prognoz.com
bnt-team.com blacktwhite.com
boc.kz blogrankers.com
bonky.biz bmwhighperformers.com
bristolhotel.com.ua board.f00d.de
brus.city bombla.org
buy-loft.ru btc4u.ru
buzzsumo.com buyessaynow.biz
candycrushshop.com bwlx.prepedu.cn
cartujano-pre.de cannibalcheerleader.com
caulderwoodkennels.com cartierlove.xyz
cbozhe.com cayado.snn.gr
cdncash.org cctva.tv
cellfun.mobi centrumcoachingu.com
cenokos.ru cezartabac.ro
cfacarrosserie74.com
cheapestjerseysonwholesale.com
cheapwebsitehoster.com cheapwebsitehoster.com
chelnytruck.ru clickintext.net
ciceros.co clicksor.com
classicakuhni.ru
clmforexeu.com clmforexeu.com
cpajunkies.com coolwallpapers-hd.com
crackguru.tk cracksplanet.com
crd.clan.su crackzplanet.com
davidovic.info daisye.top
delayreferat.ru descargar-musica-gratis.net
detalizaciya-tut.biz dfiles.me
dfwu1019.info digitalassetmanagement.site
digitalfaq.com digital-sale.su
digital-video-processing.com divatraffic.com
directivepub.com dnsrsearch.com
doctissimo.fr dojki-hd.com
drpornogratisx.xxx drugstoreforyou.com
earn-from-articles.com e2click.com
ecommerce-seo.org e-biznes.info
econom.co ecookna.com.ua
editmedios.com edelstahlschornstein-123.de
efkt.jp ednorxmed.com
edudocs.net
election.interferencer.ru election.interferencer.ru
enge-fotzen.info elektrischeziga.livejournal.com
exmasters.com elmifarhangi.com
femdom.twiclub.in empirepoker.com
filmi-onlain.info en.home-task.com
filunika.com.ru enternet.ee
firma-legion.ru erectile.bid
flagcounter.me eropho.com
erotik0049.com
etur.ru
exonline.info
expresstoplivo.ru
fashion-stickers.ru
fatfasts-4tmz.com
fettefrauen.net
fillmewithhappiness.com
fireads.men
footballfarrago.com
forms-mtm.ru
forodvd.com
franch.info
frankofficial.ru frankofficial.ru
free411games.com freeuploader.ml
freewebs.com freewebs.com
freshberry.com.ua freza-sverlo.ru
front.ru fsalas.com
frvo.alptandem.ru g33.org
fsakhalin.ru galaxys6manual.info
fxgallery.com
game-mmorpg.net
gamevalue7.weebly.com gamevalue7.weebly.com
germes-trans.com gamewrath.com
ghazel.ru gdebestkupit.ru
gkvector.ru getmyads24.com
gopro-online.info get-your-social-buttons.info
gosarhivrt.ru goo.ne.jp
gq-catalog.gq gq-catalog.gq
graphics8.info graphicwe.org
gribkovye-zabolevaniya.com gsmtlf.ru
harmonyglen.us hao123.com
healmytrauma.info hccoder.info
heroz.fr hdpixion.com
housemilan.ru hdwallpapers-free.com
ihc2015.info hdxnxxtube.mobi
inboxdollars.com headpress.ru
incolors.club histats.com
indiakino.net hitmuzik.ru
infobabki.ru hoverboard360.nl
intimshop-fantasy.ru hystersister.com
iqoption.com ico.re
irkutsk.zrus.org ido3.com
isistaylorporn.info isitwp.com
ivoiretechnocom.ci itag.pw
iwantmyfreecash.com jeremyeaton.co
izhevsk.xrus.org jpcycles.com
jmat.cn
jolic2.com
kaidalibor.de
kazinogames.lv
keenoutlet.online keenoutlet.online
keywordhut.com kinky-fetishes.com
kinofak.net kino-filmi.com
komputernaya-pomosh-moscow.ru kinoflux.net
konteiner24.com klosetkitten.com
kostenloser-sex.com knowsitall.info
kovesszucs.atw.hu kosmetyki.tm.pl
labvis.host.sk krasivoe-hd.com
ladov.ru kriokomora.info
lalalove.ru ktotut.net
landoftracking.com lapolis.it
lawyers.cafe leadn.pl
liumimgx.pw lechtaczka.net
lkbennettstore.online letsrepair.in
loadingpages.me lflash.ru
lodki-pvh.dp.ua likesdesign.com
mackeeper-land-672695126.us-east-1.elb.amazonaws.com limads.men
magicdiet.gq lion.bolegapakistan.com
marketingtechniques.info lomb.co
maslenka.kz lonely-mature.com
masturbate.co.uk lumb.co
mega-polis.biz.ua luxmagazine.cf
message-warning.net macrotek.ru
militarysale.pro mafa-free.com
mmgq.ru mediaoffers.click
moesonce.com metaxalonevstizanidine.blogspot.com
moroccosurfadventures.com microsearch.ru
mossmesi.com minharevisao.com
msk.afora.ru mobilemedia.md
mttwtrack.com mp3downloadhq.com
musicdaddy.net mp3films.ru
narkologiya-orel.ru musicas.baixar-musicas-gratis.com
nastroyke.net myanyone.net
nbsproject.ru myseoconsultant.com
newstraveller.ru myshopmatemac.com
niroo.info nailsimg.com
nrv.co.za news-readers.ru
nudo.ca nofreezingmac.work
nufaq.com no-fuel.org
obiavo.ru nucia.biz.ly
oconto.ru obiavo.com
offside2.5v.pl of-ireland.info
offtopic.biz onefilms.net
omoikiri-japan.ru onlineserialy.ru
onlinadverts.com panchro.co.uk
online-hd.pl phormchina.com
onlinemeetingnow.com pinkduck.ga
oz-offers.com plastgranar.nu
parvezmia.xyz playfortuna-play.ru
pc4download.co plohaya-kreditnaya-istoriya.ru
pc-services.ru pobeiranie.pl
peekyou.com pomoc-drogowa.cba.pl
pestomou.info popcash.net
piulatte.cz poptool.net
pix-hd.com pornstartits.xblog.in
pod-muzyku.club portside.xyz
poems.com.ua pr0fit-b0x.com
popup-hgd.xyz printie.com
pornmania.pl privetsochi.ru
pornoelita.info prizefestival.mobi
pornozhara.com profitsport.club
prchecker.info pssucai.info
prospekt-st.ru purplestats.com
push-ad.com putevka24.ru
quebec-bin.com rangoman.date
qwesa.ru rapidgator-porn.ga
redirect.trafficreceiver.club real-time-analytics.com
rootandroid.org refads.pro
rusoft-zone.ru registrysweeper.com
sabizonline.com remontvsamare.su
saddiechoua.com rff-cfal.info
samara.rosfirm.ru rfid-locker.co
scanner-don.top royalvegascasino.com
schoolfiles.net runofilms.ru
seemoreresultshu-a.akamaihd.net rvi.biz
sel-hoz.com sanatorrii.ru
seo-tools-optimizing.com sarafangel.ru
serptehnika.ru sashagreyblog.ga
sevenstars7.com sbdl.no
sexfreepornoxxx.com seasonvar.ru
shop-electron.ru selectads.men
sildenafilcitratemed.com seoexperimenty.ru
sildenafil-tadalafil.info seoheap.com
seorussian.ru
site3.free-share-buttons.com
siteexpress.co.il
siteripz.net siteripz.net
skladvaz.ru site.ru
smart-scripts.com sitevaluation.com
soft-program.com slomm.ru
soheavyblog.com snts.shell-pmr.ru
solicita.info sodexo.com
spl63.fr sonata-arctica.wz.cz
stair.registrydomainservices.com spidtest.space
students-cheapskate.ml sps-shop.com
talant-factory.ru sundrugstore.com
supermesta.ru
superstarfloraluk.com
surintech.ac.th
takeprofitsystem.com
tdsing.ru tdsing.ru
tecspb.ru techart24.com
telemetryverification.net template-kid.com
templates.radiodigital.co
thedownloadfromwarez.blogspot.com thedownloadfromwarez.blogspot.com
theplacetoupdating.pw thfox.com
tiandeural.ru thiegs.reco.ws
titangel-vietnam.com tizanidine4mgprice.blogspot.com
topsy.com tizanidinezanaflex.blogspot.com
torrent-to-magnet.com trafficmonetize.org
totu.info traffique.net
traderzplanet.in uogonline.com
trahvid.com uptime-alpha.net
turkeyreport.tk uptimechecker.com
ua.tc vapsy.com
upproar.com vip-file.com
uprour.com virtualbb.com
upupa.net wait3sec.org
vekzdorov.ru webmasterhome.cn
vielporno.net wingsofrefuge.net
vipps.com.my winx-play.ru
vksex.ru wma-x.com
vltai.com writersgroup580.web.fc2.com
vrnelectro.ru wygraj-teraz.com
webs.com xn--80ajbshivpvn2i.xn--p1ai
websiteaccountant.de xn----8sbhefaln6acifdaon5c6f4axh.xn--p1ai
websites-reviews.com xtremeeagles.net
westen-z.life y8games-free.com
westum.se yachts-cruise.info
whiteproduct.com yaminecraft.ru
wholesalenfljerseys.us.com yoopsie.com
whos.amung.us yopoint.in
wildworld.site yubikk.info
www.get-free-traffic-now.com zdesoboi.com
www.jbetting.com zoogdiesney.com
www.labves.ru zootravel.com
xkaz.org
xn----7sbho2agebbhlivy.xn--p1ai
xn--80ajjbdhgmudixfjc8c5a9df8b.xn--p1ai
xportvusbdriver8i.snack.ws
xxxrus.org
xxxsiterips.xyz
xz618.com
yuarra.pluto.ro
za-fun-offer.com
zvezdagedon.ru

BIN
.latest_release/bots.d.tar.gz
View file

Binary file not shown.

BIN
.latest_release/conf.d.tar.gz
View file

Binary file not shown.

4
AUTO-CONFIGURATION.md
View file

@ -4,8 +4,8 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2021.01.2248 #### Version: V4.2021.01.2249
#### Bad Referrers Blocked: [6910](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [6911](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [592](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [592](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)
____________________ ____________________

4
MANUAL-CONFIGURATION.md
View file

@ -4,8 +4,8 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2021.01.2248 #### Version: V4.2021.01.2249
#### Bad Referrers Blocked: [6910](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [6911](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [592](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [592](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)
____________________ ____________________

4
README.md
View file

@ -11,8 +11,8 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2021.01.2248 #### Version: V4.2021.01.2249
#### Bad Referrers Blocked: [6910](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [6911](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [592](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [592](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)
____________________ ____________________

10154
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

5
_generator_lists/bad-referrers.list
View file

@ -1,5 +1,3 @@
animalia-life.club
semxiu.com
000free.us 000free.us
007angels.com 007angels.com
00author.com 00author.com
@ -5149,6 +5147,7 @@ seminarykansas904.ml
semp.net semp.net
semprofile.com semprofile.com
semrush.com semrush.com
semxiu.com
sendearnings.com sendearnings.com
senger.atspace.co.uk senger.atspace.co.uk
seo-2-0.com seo-2-0.com
@ -6910,4 +6909,4 @@ zygophyceous.womanstars.site
zynax.ua zynax.ua
zytpirwai.net zytpirwai.net
zzbroya.com.ua zzbroya.com.ua
zzlgxh.com zzlgxh.com

4
_google_analytics_ghost_spam/README.md
View file

@ -3,8 +3,8 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2021.01.2248 #### Version: V4.2021.01.2249
#### Bad Referrers Blocked: [6910](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [6911](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [592](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [592](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)
____________________ ____________________

2
_google_analytics_ghost_spam/google-exclude-04.txt
View file

File diff suppressed because one or more lines are too long

1
_google_webmaster_disavow_links/google-disavow.txt
View file

@ -5147,6 +5147,7 @@ domain:seminarykansas904.ml
domain:semp.net domain:semp.net
domain:semprofile.com domain:semprofile.com
domain:semrush.com domain:semrush.com
domain:semxiu.com
domain:sendearnings.com domain:sendearnings.com
domain:senger.atspace.co.uk domain:senger.atspace.co.uk
domain:seo-2-0.com domain:seo-2-0.com

10161
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

10161
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

10161
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2021.01.2248 ### Version: V4.2021.01.2249
### Updated: Wed Jan 13 01:02:55 SAST 2021 ### Updated: Thu Jan 14 09:27:53 SAST 2021
### Bad Bot Count: 592 ### Bad Bot Count: 592
################################################### ###################################################
### Version Information ## ### Version Information ##