vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-03 19:20:16 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2021.03.2304 [ci skip]

Browse source
This commit is contained in:
Travis 2021-03-20 09:24:38 +02:00
parent d0f4bf74ec
commit 69afb33f2c
50 changed files with 73928 additions and 73905 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

8097
.dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

8097
.dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

8097
.dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

1
.dev-tools/beta_conf_files_whitelist/bots.d/custom-bad-referrers.conf
View file

@ -3048,6 +3048,7 @@
"~*(?:\b)islandminingsupply\.wordpress\.com(?:\b)" 0; "~*(?:\b)islandminingsupply\.wordpress\.com(?:\b)" 0;
"~*(?:\b)isotoner\.com(?:\b)" 0; "~*(?:\b)isotoner\.com(?:\b)" 0;
"~*(?:\b)isoveti\.ru(?:\b)" 0; "~*(?:\b)isoveti\.ru(?:\b)" 0;
"~*(?:\b)ispac\.org(?:\b)" 0;
"~*(?:\b)ispaniya\-costa\-blanca\.ru(?:\b)" 0; "~*(?:\b)ispaniya\-costa\-blanca\.ru(?:\b)" 0;
"~*(?:\b)istanbulit\.com(?:\b)" 0; "~*(?:\b)istanbulit\.com(?:\b)" 0;
"~*(?:\b)istizanidineacontrolledsubstance\.blogspot\.com(?:\b)" 0; "~*(?:\b)istizanidineacontrolledsubstance\.blogspot\.com(?:\b)" 0;

8097
.dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

8097
.dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

8097
.dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

1
.dev-tools/referrers-regex-format-whitelist-test.txt
View file

@ -3001,6 +3001,7 @@
"~*(?:\b)islandminingsupply\.wordpress\.com(?:\b)" 0; "~*(?:\b)islandminingsupply\.wordpress\.com(?:\b)" 0;
"~*(?:\b)isotoner\.com(?:\b)" 0; "~*(?:\b)isotoner\.com(?:\b)" 0;
"~*(?:\b)isoveti\.ru(?:\b)" 0; "~*(?:\b)isoveti\.ru(?:\b)" 0;
"~*(?:\b)ispac\.org(?:\b)" 0;
"~*(?:\b)ispaniya\-costa\-blanca\.ru(?:\b)" 0; "~*(?:\b)ispaniya\-costa\-blanca\.ru(?:\b)" 0;
"~*(?:\b)istanbulit\.com(?:\b)" 0; "~*(?:\b)istanbulit\.com(?:\b)" 0;
"~*(?:\b)istizanidineacontrolledsubstance\.blogspot\.com(?:\b)" 0; "~*(?:\b)istizanidineacontrolledsubstance\.blogspot\.com(?:\b)" 0;

1
.dev-tools/referrers-regex-format.txt
View file

@ -3001,6 +3001,7 @@
"~*(?:\b)islandminingsupply\.wordpress\.com(?:\b)" 1; "~*(?:\b)islandminingsupply\.wordpress\.com(?:\b)" 1;
"~*(?:\b)isotoner\.com(?:\b)" 1; "~*(?:\b)isotoner\.com(?:\b)" 1;
"~*(?:\b)isoveti\.ru(?:\b)" 1; "~*(?:\b)isoveti\.ru(?:\b)" 1;
"~*(?:\b)ispac\.org(?:\b)" 1;
"~*(?:\b)ispaniya\-costa\-blanca\.ru(?:\b)" 1; "~*(?:\b)ispaniya\-costa\-blanca\.ru(?:\b)" 1;
"~*(?:\b)istanbulit\.com(?:\b)" 1; "~*(?:\b)istanbulit\.com(?:\b)" 1;
"~*(?:\b)istizanidineacontrolledsubstance\.blogspot\.com(?:\b)" 1; "~*(?:\b)istizanidineacontrolledsubstance\.blogspot\.com(?:\b)" 1;

2
.dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
35.193.184.18 0; 104.154.182.187 0;

8097
.dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
.dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
104.154.182.187 1; 34.122.173.211 1;
127.0.0.1 1; 127.0.0.1 1;

2
.dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
104.154.182.187 0; 34.122.173.211 0;
127.0.0.1 0; 127.0.0.1 0;

8097
.dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
.dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
104.154.182.187 1; 34.122.173.211 1;
127.0.0.1 1; 127.0.0.1 1;

2
.dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
104.154.182.187 0; 34.122.173.211 0;
127.0.0.1 0; 127.0.0.1 0;

8097
.dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
.dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
104.154.182.187 1; 34.122.173.211 1;
127.0.0.1 1; 127.0.0.1 1;

1
.dev-tools/test1_conf_files_whitelist/bots.d/custom-bad-referrers.conf
View file

@ -3048,6 +3048,7 @@
"~*(?:\b)islandminingsupply\.wordpress\.com(?:\b)" 0; "~*(?:\b)islandminingsupply\.wordpress\.com(?:\b)" 0;
"~*(?:\b)isotoner\.com(?:\b)" 0; "~*(?:\b)isotoner\.com(?:\b)" 0;
"~*(?:\b)isoveti\.ru(?:\b)" 0; "~*(?:\b)isoveti\.ru(?:\b)" 0;
"~*(?:\b)ispac\.org(?:\b)" 0;
"~*(?:\b)ispaniya\-costa\-blanca\.ru(?:\b)" 0; "~*(?:\b)ispaniya\-costa\-blanca\.ru(?:\b)" 0;
"~*(?:\b)istanbulit\.com(?:\b)" 0; "~*(?:\b)istanbulit\.com(?:\b)" 0;
"~*(?:\b)istizanidineacontrolledsubstance\.blogspot\.com(?:\b)" 0; "~*(?:\b)istizanidineacontrolledsubstance\.blogspot\.com(?:\b)" 0;

2
.dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
104.154.182.187 0; 34.122.173.211 0;
127.0.0.1 0; 127.0.0.1 0;

8097
.dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

4
.dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,5 +45,5 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
34.122.208.80 0; 104.154.182.187 0;
35.193.184.18 0; 34.122.173.211 0;

8097
.dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

3
.dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,5 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
34.122.173.211 0; 34.122.208.80 0;
35.193.184.18 0;

8097
.dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

3
.dev-tools/test4_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,6 +45,5 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
34.122.208.80 0;
34.122.173.211 0;
104.154.182.187 0; 104.154.182.187 0;
34.122.208.80 0;

8097
.dev-tools/test4_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

4
.dev-tools/test5_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,5 +45,5 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
35.193.184.18 0; 34.122.208.80 0;
104.154.182.187 0; 34.122.173.211 0;

8097
.dev-tools/test5_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

1
.dev-tools/test_units/custom-bad-referrers.conf
View file

@ -3048,6 +3048,7 @@
"~*(?:\b)islandminingsupply\.wordpress\.com(?:\b)" 0; "~*(?:\b)islandminingsupply\.wordpress\.com(?:\b)" 0;
"~*(?:\b)isotoner\.com(?:\b)" 0; "~*(?:\b)isotoner\.com(?:\b)" 0;
"~*(?:\b)isoveti\.ru(?:\b)" 0; "~*(?:\b)isoveti\.ru(?:\b)" 0;
"~*(?:\b)ispac\.org(?:\b)" 0;
"~*(?:\b)ispaniya\-costa\-blanca\.ru(?:\b)" 0; "~*(?:\b)ispaniya\-costa\-blanca\.ru(?:\b)" 0;
"~*(?:\b)istanbulit\.com(?:\b)" 0; "~*(?:\b)istanbulit\.com(?:\b)" 0;
"~*(?:\b)istizanidineacontrolledsubstance\.blogspot\.com(?:\b)" 0; "~*(?:\b)istizanidineacontrolledsubstance\.blogspot\.com(?:\b)" 0;

20
.dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
Attach Aboundex
Badass Asterias
Curious AwarioRssBot
InterGET BatchFTP
Musobot coccocbot-web
Spbot FlashGet
Typhoeus LinkpadBot
VeriCiteCrawler MTRobot
Zermelo PHPCrawl
ZmEu RedesScrapy

300
.dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
01h4x.com Acunetix
360Spider
404enemy
80legs
Aboundex
ADmantX ADmantX
AfD-Verbotsverfahren AIBOT
AiHitBot AiHitBot
Anarchie Alexibot
Apexoo AllSubmitter
AlphaBot
Anarchy
Anarchy99
Ankit
archive.org_bot archive.org_bot
arquivo-web-crawler Aspiegel
ASPSeek AwarioSmartBot
BackDoorBot
Backlink-Ceck Backlink-Ceck
backlink-check Badass
BackStreet Barkrowler
BBBike BatchFTP
Battleztar Bazinga
BDCbot BDCbot
BetaBot BDFetch
BLEXBot Blackboard
BlowFish
BotALot BotALot
Brandwatch Brandprotect
Buck Buck
BuiltWith BuiltBotTough
Calculon CazoodleBot
CCBot
Cegbfeieh Cegbfeieh
check1.exe check1.exe
CheeseBot CheeseBot
Claritybot CherryPicker
CheTeam
Cliqzbot
Cloud mapping
Cocolyzebot Cocolyzebot
CODE87 CODE87
Cogentbot
cognitiveseo
CopyRightCheck CopyRightCheck
Craftbot CrazyWebCrawler
crawl.sogou.com Crescent
CyotekWebCopy CyotekWebCopy
DataCha0s Demon
DBLBot Dirbuster
demandbase-bot Disco
Digincore
DigitalPebble
Discobot Discobot
Discoverybot
Dispatch Dispatch
DittoSpyder DittoSpyder
DomainSigmaCrawler DnyzBot
DomainAppender
Domains Project
DomCopBot
Dotbot Dotbot
Dragonfly Download Wonder
EasyDL Ebingbong
eCatch eCatch
ECCP/1.0 ECCP/1.0
Ecxi
EirGrabber
EMail Siphon
evc-batch evc-batch
Exabot Express WebPictures
Extractor Extractor
ExtractorPro ExtractorPro
Extreme Picture Finder
EyeNetIE EyeNetIE
Flunky Ezooms
Freeuploader facebookscraper
FrontPage Firefox/7.0
Fuzz FlashGet
FyberSpider GalaxyBot
Genieo Genieo
GermCrawler
GetRight GetRight
Gigablast
Gigabot Gigabot
G-i-g-a-b-o-t G-i-g-a-b-o-t
Gotit Go-Ahead-Got-It
gopher
Go!Zilla
Grabber Grabber
GrabNet GrabNet
Grafula
GrapeFX GrapeFX
GridBot GridBot
Harvest GT::WWW
heritrix Haansoft
HaosouSpider
Havij
HEADMasterSEO
Heritrix Heritrix
HMView
HTTP::Lite HTTP::Lite
HTTrack Iblog
Humanlinks
IDBot IDBot
IDBTE4M
Id-search Id-search
IlseBot IlseBot
Image Sucker
Indy Library
InfoNaviRobot InfoNaviRobot
Internet Ninja InterGET
InternetSeer InternetSeer
Iria internetVista monitor
IRLbot IstellaBot
isitwp.com JennyBot
JamesBOT
Jbrofuzz
Jetty
JikeSpider
Joomla Joomla
JustView
Jyxobot Jyxobot
Kenjin Spider Kinza
Keyword Density Kozmosbot
LeechFTP LexiBot
LibWeb Lftp
Linkbot Libwhisker
Likse
Linkdexbot
LinkScan LinkScan
LinkWalker LinkWalker
LinqiaRSSBot LinqiaMetadataDownloaderBot
Lipperhey Spider LinqiaScrapeBot
Litemage_walker Lipperhey
Lmspider LNSpiderguy
lwp-request Ltx71
LWP::Simple magpie-crawler
lwp-trivial Mail.RU_Bot
MarkMonitor Majestic SEO
Majestic-SEO
MarkWatch
Masscan Masscan
MauiBot MauiBot
Mb2345Browser Mb2345Browser
mediawords meanpathbot
Meanpathbot
MFC_Tear_Sample
MIDown tool
MIIxpc MIIxpc
Mister PiX
MJ12bot MJ12bot
Mojeek
Morfeus Fucking Scanner
MQQBrowser MQQBrowser
MSFrontPage MSFrontPage
MSIECrawler Msrabot
NetAnts MTRobot
muhstik-scan
Musobot
Name Intelligence
Nessus
NetMechanic NetMechanic
Net Vampire NetSpider
Nibbler Nettrack
Niki-bot Niki-bot
Ninja Nimbostratus
Nmap oBot
NPbot Octopus
Nuclei
Offline Explorer
OnCrawl
Openfind Openfind
OpenLinkProfiler
Openvas
OpenVAS OpenVAS
OPPO A33
OrangeSpider OrangeSpider
OutfoxBot
PageAnalyzer
Page Analyzer
PageGrabber PageGrabber
page scorer
Panscient
PECL::HTTP PECL::HTTP
Petalbot Petalbot
PHPCrawl
Picscout Picscout
Picsearch
Piepmatz Piepmatz
Pimonster Pimonster
Pi-Monster Pi-Monster
plumanalytics
POE-Component-Client-HTTP POE-Component-Client-HTTP
polaris version polaris version
probe-image-size Probethenet
ProPowerBot ProPowerBot
ProWebWalker Pu_iN
Psbot PxBroker
RankActiveLinkBot PyCurl
RealDownload QueryN Metasearch
Reaper RankFlex
Rankivabot
RebelMouse RebelMouse
Recorder Recorder
RedesScrapy
RepoMonkey RepoMonkey
Re-re RocketCrawler
s1z.ru RSSingBot
scalaj-http SalesIntelligent
ScanAlert satoristudio.net
Scanbot Screaming
scan.lol
ScreenerBot
SearchmetricsBot
Semrush Semrush
SemrushBot SemrushBot
SentiBot SentiBot
SEOkicks
SEOlyticsCrawler SEOlyticsCrawler
Seomoz
SEOprofiler
seoscanners
SeoSiteCheckup SeoSiteCheckup
serpstatbot
Shodan
Siphon Siphon
SiteCheckerBotCrawler SISTRIX
SiteExplorer Siteimprove
SiteSnagger SiteLockSpider
SiteSucker siteripz
Site Sucker
Sitevigil
SlySearch SlySearch
SMTBot SMTBot
Snake Snake
Snapbot SocialRankIOBot
Spammen Sogou web spider
SpankBot SpankBot
Spinn3r
SputnikBot
spyfu spyfu
Sqlmap
Sqlworm
Sqworm Sqworm
Sucker Steeler
SuperBot
SuperHTTP
SurveyBot SurveyBot
Suzuran Suzuran
Swiftbot
T0PHackTeam T0PHackTeam
T8Abot TeleportPro
Teleport Telesoft
Telesphoreo
Telesphorep Telesphorep
The Intraformant The Intraformant
TheNomad Thumbor
TightTwatBot
Titan Titan
Toweyabot trendiction.de
Tracemyfile
Trendiction
Trendictionbot
TurnitinBot TurnitinBot
TwengaBot Twice
Typhoeus
UnisterBot UnisterBot
Upflow
URLy Warning URLy Warning
Vacuum VCI
Voil VidibleScraper
Wallpapers/3.0 VoidEYE
Voltron
WallpapersHD WallpapersHD
WASALive-Bot
WBSearchBot
Web Auto
WebCollage WebCollage
Web Collage
WebCopier WebCopier
WEBDAV WEBDAV
WebFuck Web Fetch
Web Fuck Web Fuck
WebGo IS
WebImageCollector WebImageCollector
webmeup-crawler
WebReaper
WebSauger WebSauger
Web Sauger
WebsiteExtractor WebsiteExtractor
Website Quester WeSEE
Whack Whack
Whatweb Whacker
Who.is Bot Widow
WISENutbot WiseGuys Robot
Woobot Wprecon
WPScan WWW-Collector-E
x22Mozilla
Xaldon WebSpider
Xaldon_WebSpider Xaldon_WebSpider
xpymep1.exe
YoudaoBot
Zade
Zermelo Zermelo
ZmEu ZoominfoBot
ZumBot ZyBorg

280
.dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
360Spider
404enemy
80legs
Aboundex Aboundex
AIBOT Aboundexbot
ADmantX
AfD-Verbotsverfahren
AiHitBot
Aipbot Aipbot
Alexibot
Alligator
AllSubmitter AllSubmitter
Anarchy Anarchie
Anarchy99 Anarchy99
Ankit Ankit
Anthill
Apexoo Apexoo
Aspiegel archive.org_bot
ASPSeek arquivo-web-crawler
Asterias Backlink-Ceck
Attach Bandit
AwarioRssBot
backlink-check
BacklinkCrawler
BBBike
BDFetch
BetaBot
Bitacle Bitacle
Blackboard
BlackWidow BlackWidow
BLEXBot BlowFish
Bolt
BotALot
Brandprotect Brandprotect
Buddy Brandwatch
Buck
BuiltBotTough
Bullseye Bullseye
BunnySlippers Calculon
CazoodleBot
CCBot
CensysInspect CensysInspect
CheeseBot CherryPicker
Chlooe CheTeam
Claritybot
Cliqzbot Cliqzbot
coccocbot-web Cloud mapping
cognitiveseo cognitiveseo
com.plumanalytics Collector
Copier CopyRightCheck
Cosmos Copyscape
crawler.feedback CrazyWebCrawler
Crescent CSHttp
CrunchBot CyotekWebCopy
DataCha0s DataCha0s
demandbase-bot DBLBot
Demon Demon
DigitalPebble Deusu
DIIbot DIIbot
Dirbuster
Discobot Discobot
Dispatch Discoverybot
DomainCrawler DomainSigmaCrawler
DomCopBot
Dotbot Dotbot
Download Wonder Download Wonder
Dragonfly Dragonfly
Drip DTS Agent
EasyDL EasyDL
EirGrabber
EMail Siphon
EroCrawler EroCrawler
ExtLinksBot Evil
FDM Exabot
FemtosearchBot Express WebPictures
FHscan Extractor
FlashGet Ezooms
Fuzz facebookscraper
Getintent Foobot
GetRight Genieo
Gigablast GermCrawler
GetWeb
Gigabot Gigabot
Go-Ahead-Got-It Go-Ahead-Got-It
gopher Gotit
Go!Zilla
Grabber Grabber
Grafula Grafula
Harvest HaosouSpider
Heritrix heritrix
Hloader Hloader
HTMLparser
Humanlinks
Iblog Iblog
IlseBot
Image Sucker Image Sucker
IndeedBot IndeedBot
instabid Indy Library
Intelliseek
Internet Ninja
InternetSeer InternetSeer
internetVista monitor
isitwp.com isitwp.com
Iskanie
IstellaBot IstellaBot
JamesBOT JamesBOT
Jbrofuzz
JetCar
Jetty Jetty
JikeSpider
JOC Web Spider
Joomla Joomla
JustView
Keyword Density Keyword Density
LeechGet Lanshanbot
Lftp LibWeb
LieBaoFast Libwhisker
Likse
Linkdexbot Linkdexbot
LinkextractorPro LinqiaMetadataDownloaderBot
LinqiaRSSBot LinqiaRSSBot
LinqiaScrapeBot
Lipperhey Lipperhey
Lipperhey Spider
Litemage_walker Litemage_walker
Lmspider Lmspider
MarkWatch LWP::Simple
Masscan lwp-trivial
Mata Hari Mag-Net
MauiBot Mail.RU_Bot
Majestic-SEO
Mass Downloader
meanpathbot
MeanPath Bot
Metauri Metauri
MFC_Tear_Sample
MicroMessenger MicroMessenger
Microsoft Data Access Microsoft Data Access
Mojeek MIDown tool
MIIxpc
MJ12bot
Mojolicious
Mozlila Mozlila
MQQBrowser
MSFrontPage MSFrontPage
muhstik-scan muhstik-scan
Musobot Musobot
Name Intelligence
Nameprotect
Navroad Navroad
NearSite
Needle
Nessus
netEstate NE Crawler netEstate NE Crawler
NetLyzer NetLyzer
NetMechanic NetMechanic
NetSpider
Net Vampire
Netvibes Netvibes
NextGenSearchBot NextGenSearchBot
Nibbler
NICErsPRO NICErsPRO
Niki-bot
Nikto Nikto
NimbleCrawler
Ninja Ninja
Nuclei Nutch
Octopus
Offline Navigator Offline Navigator
OPPO A33 Openfind
OrangeBot OrangeBot
PageAnalyzer OrangeSpider
PageScorer OutfoxBot
PageThing.com Page Analyzer
Panscient
Papa Foto Papa Foto
PECL::HTTP Pavuk
Picscout pcBrowser
PictureFinder PHPCrawl
Picsearch
Piepmatz Piepmatz
Pimonster
Pi-Monster Pi-Monster
POE-Component-Client-HTTP plumanalytics
polaris version
probe-image-size probe-image-size
Probethenet
ProPowerBot ProPowerBot
ProWebWalker ProWebWalker
Pump Psbot
QueryN Metasearch
Quick-Crawler Quick-Crawler
RankActive RankActive
RankFlex
RankingBot RankingBot
RankingBot2 RankingBot2
Rankivabot Rankivabot
RankurBot RealDownload
Reaper RebelMouse
Recorder Recorder
ReGet ReGet
RepoMonkey Re-re
ripz Rogerbot
RocketCrawler RSSingBot
SalesIntelligent s1z.ru
satoristudio.net
ScanAlert ScanAlert
scan.lol Scanbot
Semrush ScreenerBot
SEOkicks SentiBot
SEOlyticsCrawler
Seomoz
SEOprofiler SEOprofiler
seoscanners SISTRIX
SeoSiteCheckup Sitebeam
serpstatbot SiteExplorer
sexsearcher
Shodan
sitechecker.pro
SiteLockSpider SiteLockSpider
siteripz
SiteSnagger SiteSnagger
SiteSucker Sitevigil
Site Sucker
SlySearch SlySearch
SmartDownload Snake
Snoopy Snapbot
Sosospider SocialRankIOBot
Sociscraper
Sogou web spider
SpaceBison SpaceBison
Spammen
SpankBot SpankBot
sp_auditbot
Spbot Spbot
Sqlmap Spinn3r
Sqlworm
Sqworm Sqworm
Steeler Stripper
Sucker SurveyBot
Sucuri Szukacz
Surfbot T0PHackTeam
Swiftbot
T8Abot
TeleportPro TeleportPro
Telesoft Telesoft
Telesphorep Telesphorep
The Intraformant
TightTwatBot
Toata Toata
Tracemyfile Tracemyfile
Turnitin Trendictionbot
Typhoeus True_Robot
TurnitinBot
URLy.Warning
Vacuum
VB Project VB Project
VeriCiteCrawler
VidibleScraper
VoidEYE VoidEYE
Voil Voil
Voltron
Wallpapers/3.0 Wallpapers/3.0
WBSearchBot WASALive-Bot
Web Auto WebAuto
WebBandit
WEBDAV WEBDAV
Web Fetch Web Fetch
WebFuck WebFuck
WebImageCollector Web Fuck
webmeup-crawler webmeup-crawler
Web Pix WebSauger
WebsiteExtractor WebsiteExtractor
WebsiteQuester WebsiteQuester
Website Quester Website Quester
Webster Webster
WebStripper
WebSucker
Web Sucker Web Sucker
WebZIP WebWhacker
WeSEE WeSEE
Whatweb
Who.is Bot
Widow Widow
WinHTTrack WinHTTrack
Wotbox Woobot
Wprecon
WWW-Collector-E
WWW-Mechanize WWW-Mechanize
WWW::Mechanize WWWOFFLE
Xaldon_WebSpider Xaldon_WebSpider
Xenu
xpymep1.exe xpymep1.exe
Zade YoudaoBot
Zauba Zauba
zauba.io
Zeus
zgrab zgrab
Zitebot
ZmEu ZmEu
ZoomBot ZoominfoBot
ZumBot ZumBot
ZyBorg

20
.dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
00go.com adimmix.com
bayareaaeroclub.org biznesschat.net
compliance-elena.xyz haveinc.xyz
forex-procto.ru hermesbelts.xyz
iweblist.info lezbiyanki.net
kotaku.com lion.snapmap.us
movies-in-theaters.net playmsn.com
openlibrary.org sbtdesign.co.uk
rubanners.com sicfor.bcu.cc
voditeltrezviy.ru udayavani.com

934
.dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
007angels.com 00go.com
0n-line.tv 00it.com
123kuma.com 1008.su
1qingdao.com 100dollars-seo.com
4kpics.rocks 12masterov.com
7search.com 1314dh.com
83net.jp 13tabs.com
aab94f698f36684c5a852a2ef272e031bb.com 1j7740kd.website
abwa.tk 24-ak.ru
3th.co.in
51unlim.ru
6128786.com
991mostfm.co.id
9icmzvn6.website
acads.net
acunetix-referrer.com
adhome.biz adhome.biz
adinterax.com admitad.com
adktrailmap.com adnotbad.com
admatic.com.tr adrunnr.com
adobereader-free.ru adsfresh.men
adprotect.net adultfriendfinder.com
adsref.men a.frcls.fr
ads.tremorhub.com agardomains.com
adventureparkcostarica.com ageofclones.com
adviceforum.info aihelen.net
albamargroup.com akama.com
albumsuper.info aksonural.ru
alert-fjg.xyz alice.it
alert-jdh.xyz aliexpress.com
allboard.xobor.de all4wap.ru
allpdfmags.net alloysteel.ru
alphacarolinas.com alltheviews.com
alvtank.se amospalla.es
ameblo.jp amyfoxfitness.com
anaksma.info anal-acrobats.com
anal-acrobats.hol.es
analnoeporno.tv analnoeporno.tv
aosheng-tech.com animaltoplist.com
apartmentratings.com anniemation.com
apibetweenlinesn-a.akamaihd.net apelsinnik.website
api.stathat.com appiq.mobi
apparel-offer.com apps-analytics.net
aproposde.com arquivo.pt
apxeo.info artefakct.com
aruplighting.com asia-forum.ru
asiavirtualsolutions.com atleticpharm.org
asscenihotosidea.blogspot.co.za autobrennero.it
autochoixspinelli.com autogrep.ru
autoplate.info autoua.top
autowebmarket.com.ua avtointeres.ru
aversis.net azbukafree.com
azarttoto.com b2b-lounge.com
bablonow.ru babespcs.com
babs.com.ua babosas.com
backiee.com backuperwebcam.weebly.com
badavit.com.ua badavit.com.ua
bag77.ru balans.shahterworld.org
balitouroffice.com bannertesting.com
balkanfarma.ru bcmp.org
bambi.ck.ua beachfix.co
bamo.xsl.pt beauty-b0x.pl
bannerspace.com beget.tech
bbtec.net best-seo-software.xyz
beauty-bracelet.com bigames.online
beclean-nn.ru bigcities.org
bestcoin.cc
bestmobilityscooterstoday.com
bestwaystogetpaid.us
betonka.pro
bingo8888.com
bingoporno.com bingoporno.com
blagovest-med.ru bitnote.co
blogporn.in blackwitchcraft.ru
bluerobot.info blog.f00kclan.de
blue-square.biz blogig.org
bmw-ark.ru boazpower.com
boo-arts.com bolitgorlo.net
brainboosting.club buckspar.gq
brandbucket.com builtwith.com
bumskontakte.org business-suggested.tk
buynorxx.com buy-forum.ru
cablecar.us buytizanidineonline.blogspot.com
callcafe.info camdenmemorials.com
canacopegdl.com candlewooddentalcentre.com.au
canyougethighofftizanidine.blogspot.com canrole.com
capacitacionyaprendizaje.com cartierlovestore.com
carabela.com.do cbcseward.com
carloans.com cctva.tv
cartujano-pre.de cdncash.com
casinorewards.info cgi2.nintendo.co.jp
celejihad.info chatroulette.si
chatroulette.life cheapjerseysbizwholesale.us
chatroulette.world cheapmoncler.win
chatseo.com
cheap-pills-norx.com
cheap-trusted-backlinks.com cheap-trusted-backlinks.com
check-host.net checkhit.com
checkm8.com chelnytruck.ru
checkpagerank.net chelyabinsk.xrus.org
checktext.org chinaelitecheapjerseys.com
chidporn.com chocolateslim-original.com
clayvasedesigns.tk choice-credit.ru
coaching-netz.info cialisndbrx.com
coin-hive.com clickaider.com
compliance-checker.info clickpapa.com
compliance-elena.xyz clickprotects.com
compliance-john.top cl.s7.exct.net
compliance-julianna.top cmhomestayagency.com
collegeessay19.blogspot.ru
collegerentals.com
com-onlinesupport.site
compliance-donald.xyz
compliance-ivan.xyz
compliance-jess.top
compliance-julia.top
compliance-mark.top compliance-mark.top
concordexoticrentals.com cpajunkies.com
cookie-law-enforcement-ee.xyz crest-poloski.ru
coolwallpapers4k.info cryptoswap.biz
cranly.net customerguru.in
crest3d.ru dailystrength.org
customerpromos-a.akamaihd.net datadepths.com
cyprusbuyproperties.com data-mining.tk
dairyindia.in dating-app.ru
dame-ns.kz dating-time-now.com
dawlenie.com dekoration.us
dcj-nn.ru designdevise.com
deluxedumps.com dinosaurus.site
demon-tweeks.com domaincdn.xyz
dipstar.org dominateforex.ml
divatraffic.com dominterior.org
documentsite.net doyouknowtheword-flummox.ml
downloadkakaotalk.com duplicashapp.com
downloads-whatsapp.com dwomlink.info
doxyporno.com e-c.al
drev.biz ege-russian.ru
drunkenstepfather.com elektronischezigarette2.mex.tl
drupa.com elektronischezigarettekaufen1.beeplog.com
dscaas.website elitesportsadvisor.com
easync.io elmifarhangi.com
e-collantes.com embedle.com
edelstahlschornstein-123.de engines-usa.com
ednorxmed.com ero-advertising.com
ee77ee.com esopini.com
ekto.ee este-line.com.ua
election.interferencer.ru etenininrade.ga
elektir.ru etur.ru
elektrozigarettekaufen2.blogse.nl eu-cookie-law.info
elitedollars.com evaashop.ru
enskedesquashclub.se evening-dating-club.info
erotag.com exmasters.com
erotikchat-24.com exportshop.us
ertelecom.ru eyessurgery.ru
eupornstar.info ez8motelseaworldsandiego.com
euroskat.ru ezigaretteshop2.mywapblog.com
expertnaya-ocenka.ru f5mtrack.com
extremepornos.net fanpagerobot.com
f07.de feeriaclub.ru
familyphysician.ru fetlifeblog.com
fashion-mk.net filesdatabase.net
fba-mexico.com firesub.pl
felizporno.com flooringinstallation-edmonton.com
fetishinside.com fm-upgrade.ru
filkhbr.com forex-procto.ru
financeloan.us forminecrafters.ru
firma-legion.ru forum.poker4life.ru
firstdrugmall.ru forum.tvmir.org
fitfloponline.store frcls.fr
flauntyoursite.com
forex21.ru
forpackningsutveckling.se
forum20.smailik.org
fotosfotos.eu
foto-telok.net
foto-weinberger.at
foxjuegos.com
franklinfire.co
fr-bearings.ru
free411games.com
freecamdollars.com
freenode.info
freeseedsonline.com freeseedsonline.com
free-video-tool.com free-share-buttons.blogspot.com
freshsuperbloop.com freetangodownload.com
funnel.co.za freewareseek.com
gallery.rennlist.com freza-sverlo.ru
gamingspark.com fuck-paid-share-buttons.xyz
gazobeton-p.com.ua funtoonez.com
gcup.ru gagrasector.ru
gdcentre.ru gamevalue7.weebly.com
gepezz.info gaygalls.net
getlaid-xxxhookupdirect.com generousdeal-a.akamaihd.net
gigapeta.com girlsfuckdick.com
globatur.ru girlspicsa.com
globetrotting-culture.ru gk170.ru
globalscam.ga
go2album.com go2album.com
goodwriterssales.com gobongo.info
grand-chlen.ru graphid.com
greendream.com.ua gratis-sexkontakte.com
groupmoney.ru groupmoney.ru
hdfreeporno.net gwebtools.com
hdwallpapers-free.com hamilton.ca
headpress.ru hdapp1008-a.akamaihd.net
healthcarestore.info hermesbirkinhandbagoutlets.com
heatpower.ru highstairs-a.akamaihd.net
herehloadibs.cf hit-men.men
hermesreplica.pw hopeonthestreet.co.uk
historichometeam.com hostnow.men
hjaoopoa.top htmlcorner.com
honyaku.yahoofs.jp iamsport.org
hotgirlhdwallpaper.com ibb.com.ua
hotshoppymac.com ibmdatamanagement.co
howtowhitenteethfast.xyz ido3.com
icaseclub.ru iflycapetown.co.za
iccornacircri.cf igithab.com
idegenvezeto.eu igru-xbox.net
ideibiznesa2015.ru imk.com.ua
i-hobot.ru impisr.edunsk.ru
ikearugs.xyz infogame.name
ilovevitaly.xyz innoslicon.com
imgarcade.com instabid.tech
inboxdollars.com invitefashion.com
indo-export.ru io9.com
infokonkurs.ru iqoption.pro
ipornox.xxx iqupdatetmz.win
isitpaleo.info iscblog.info
isitwp.com istizanidineanarcoticdrug.blogspot.com
izoll.ru itis4you.com
jabimgo.pw ix20.ru
japan-bearings.ru javatex.co.id
jav-fetish.com jbl-charge.info
jerseychinabizwholesale.com jerseychinabizwholesale.us
jerseywholesalebizchina.com joingames.org
jewelryandfiligree.com jongose.ninja
jimmychoosale.online jose.mulinohouse.co
jobmarket.com.ua joy-penguin.com
justdating.online juliadiets.com
kamen-e.ru kalandranis.gr
katadhin.co kam-dom.ru
khafre.us karachev-city.ru
kino-ecran.ru kashubadesign.ru
kinomaniatv.pl kerei.ru
kino-rating.ru kinoduh.ru
kinozapas.com kiprinform.com
kirov.zrus.org kiskinhouse.com
knigonosha.net kit-opt.ru
kleine-titten.biz
kletkimehan.ru
kollesa.ru
kolotiloff.ru
kometars.xyz
komp-pomosch.ru
kongoultry.net
kosmetyki.tm.pl kosmetyki.tm.pl
kraljeva-sutjeska.com kostenloser-sex.com
kredit-pod-zalog-krasnodar.ru koversite.info
kovrenok.ru
krasivye-devushki.net
ktotut.net ktotut.net
ku6.com kvartiry-remont.ucoz.ru
kunstaktien.info kwzf.net
kvartir-remont.biz lafourmiliaire.com
lanasshop.ru lancheck.net
leftofcentrist.com leadwayau.com
lernur.net lecbter-relationships.ga
letsart.ru lexixxx.com
letslowbefast.site likrot.com
levaquin750mg.blogspot.com lincolntheatre.com
lifebyleese.com linkredirect.biz
lifeinsurancekb.com liquimondo.com
liffa.ru lirunet.ru
linksharingt.com livetsomudvekslingstudent.bloggersdelight.dk
locustdesign.co lizace.com
lombia.com lmrauction.com
longgreen.info lonfon.xyz
lottospring.com lookingglassemb.com
lyrster.com losangeles-ads.com
m3gadownload.pl lutherstable.org
magicplayer-s.acestream.net macotool.com
maladot.com magnetic-bracelets.ru
marcogrup.com mail.allnews24.in
marmitaco.cat mainhp.net
marsgatan.com mall.uk
mazda-roadsters.com manifestyourmillion.com
mbiologi.ru maranbrinfo.com.br
medmajor.ru mararoom.ru
med-zdorovie.com.ua marcoislandvacations.net
mega-bony2017.pl marktforschung-stuttgart.com
megakino.net marmotstore.online
matematikus.info
medicinacom.ru
meendo-free-traffic.ga
mex-annushka.ru
mezaruk.info mezaruk.info
mielec.pl miniads.ca
mindeyegames.com minneapoliscopiers.com
mirtorrent.net missclub.info
mister-shop.com misswell.net
mobioffertrck.com mobplayer.ru
mockupui.com
modenamebel.ru modenamebel.ru
moesexy.com moi-glazki.ru
moesonce.com monarhs.info
moinozhki.com moscow.xrus.org
moncleroutletonline.win moyaterapiya.ru
moneyzzz.ru mriyadh.com
morlat.altervista.org muz-shoes.ru
moscow-region.ru mwtpludn.review
most.gov.iq my-big-family.com
moyakuhnia.ru
mrlmedia.net
muycerdas.xxx
mykings.pw
mylesosibirsk.ru mylesosibirsk.ru
myonigroup.com myxdate.info
mywallpaper.top napalm51.nut.cc
na15.ru nardulan.com
narkologiya-orel.ru narkologiya-voronezh.ru
narosty.com narosty.com
national-today-winning-winner.club narutonaruto.ru
naturalbreakthroughsresearch.com netoil.no
newstaffadsshop.club newsperuse.com
newyorkhotelsmotels.info no-fuel.org
nfljerseysforsalewholesaler.com no-rx.info
nhl17coinsforps3.gratisblog.biz npoet.ru
nikitabuch.com nuker.com
nikkiewart.ru nzfilecloud.weebly.com
normalegal.ru oballergiya.ru
nudejapan.net
obiavo.uz
ochistka-stokov.ru ochistka-stokov.ru
offergroup.info ok-ua.info
okel.co
okmedia.sk
olgacvetmet.com olgacvetmet.com
onko-24.com omsk.xrus.org
onblastblog.online
onlinefilmz.net onlinefilmz.net
onlineserialy.ru onlinemegax.com
onlinetvseries.me onlywoman.org
onlythegames.com optitrade24.com
ooo-gotovie.ru oranga.host.sk
orgasmus-virtual.com
orhonit.com
origin-my.ru
orsonet.ru orsonet.ru
oxford-book.com.ua
ozoz.it
paclitor.com
paramountmarble.co.uk paramountmarble.co.uk
patol01.pw partnerworkroom.men
pattersonsweb.com pekori.to
pearlisland.ru picquery.com
pelfind.me picturesboss.com
perfection-pleasure.ru pierrehardysale.online
phelissota.xyz piuminiita.com
photo.houseofgaga.ru pivka.xyz
picphotos.net pizdeishn.com
picturesmania.com poem-paying.gq
pinapchik.com popander.mobi
piratecams.com popserve.adscpm.net
pizza-imperia.com poquoson.org
platezhka.net porndroids.com
pojdelo.weebly.com pornodojd.ru
polimga.pw pornolook.net
poppen-nw.net pornosexrolik.com
porndl.org pornoxxx.com.mx
pornhive.org portside.xyz
porno-dojki.net
porno.simple-image.com.ua
primedice.com
prizefestival.mobi
productarium.com productarium.com
profitkode.com produkto.net
progonrumarket.ru profit-opportunity.com
prom23.ru projectforte.ru
prostitutki-almata.org pronorm.fr
quickloanbank.com prosperent.com
rapidokbrain.com prostitutki-odessa.org
razyboard.com radiodigital.co
reklama1.ru rangoman.date
remont-ustanovka-tehniki.ru razorweb-a.akamaihd.net
saddiechoua.com repeatlogo.co.uk
sampleletters.net richinvestmonitor.com
sayyoethe.blogspot.co.za rightenergysolutions.com.au
scanmarine.info ring4rhino.com
scanner-don.top ringporno.com
scanner-nelson.top rixpix.ru
scanner-willy.top ros-ctm.ru
royalcar-ufa.ru
royal-investments.net
rubanners.com
rukino.org
ruscopybook.com
ruspdd.com
rvtv.ru
sack.net
salmonfishingsacramentoriver.com
samoiedo.it
sbetodiodnye-lampy.ru
sbf441.com
scanmyphones.com
scanner-elena.top
scanner-fred.top
sdrescher.net sdrescher.net
searchinquire.com seadragonherbery.com
seeingmeerkat.com searchimpression.com
selectads.men see-your-website-here.com
sell-fb-group-here.com semrush.com
semp.net
sendearnings.com
seoexperimenty.ru
seoheap.com
seorankinglinks.com seorankinglinks.com
seorankinglinks.xyz seorankinglinks.xyz
seo-smm.kz serdcenebolit.com
serving.adbetclickin.pink
sexcamamateurchat.com
sex-foto.pw sex-foto.pw
sexkontakte-seite.com sexkontakte-seite.com
sexspornotub.com
sexstream.pl sexstream.pl
sextracker.be sexystrippe.info
sexyebonyteen.com shisha-swag.de
shodanhq.com
shoppingmiracles.co.uk
shop.xz618.com shop.xz618.com
simon3.ru sierraapps.com
sitebeam.net site-auditor.online
site-speed-check.site siteripz.net
skuteczna-dieta.co.pl sizeplus.work
smartpet.ru skypasss.com
snts.shell-pmr.ru skytraf.xyz
socialmediasuggest.com slim.sellany.ru
socialsignals24.com smart-scripts.com
social-s-iii.xyz smichovbike.cz
softtor.com sneakyboy.com
solinf.co snip.tw
songoo.wz.cz soaksoak.ru
srecorder.com social-buttons.xyz
sstroy44.ru socialseet.ru
stardevine.com spb.ru
steame.ru splendorsearch-a.akamaihd.net
steebook.com spravka130.ru
stjamesschool.info sptslmtrafms.com
stockspmb.info starpages.net
sugarkun.com start.myplaycity.com
sundrugstore.com stillmiracle.com
superiends.org subj.ukr-lit.com
survival.betteroffers.review svnuppsalaorebro.se
svarkagid.com svtrd.com
svbur.ru
tacbelarus.ru
tam-gde-more.ru tam-gde-more.ru
tdsing.ru taranerymagesswa.blogspot.com
teenbbw.yopoint.in tasteidea.com
textads.men td-33.ru
themestotal.com tds-advert002.info
thenews-today.info tedy.su
thepantonpractice.co.uk templates.franklinfire.co
thetoiletpaper.com testingads.pro
tilido.com theheroes.ru
timeallnews.ru thejournal.ru
tizanidinehcl4mgtab.blogspot.com the-trader.net
tizanidinehcl4mgtablet.blogspot.com thewomenlife.com
tizanidinehclsideeffects.blogspot.com titan-ads.life
tizanidineingredients.blogspot.com tizanidinerestlesslegsyndrome.blogspot.com
tizanidinemusclerelaxant.blogspot.com
tizanidinesideeffectsweightloss.blogspot.com
tizanidinesleepaid.blogspot.com tizanidinesleepaid.blogspot.com
tizanidinewithdrawalsymptoms.blogspot.com tizanidinevsvalium.blogspot.com
tmm-kurs.ru tizanidinewithdrawal.blogspot.com
token-lab.org toloka.hurtom.com
toys.erolove.in tomck.com
traderzplanet.in top-l2.com
trafaret74.ru torontoplumbinggroup.com
traffic100.com torrents-tracker.com
trafficnetzwerk.de totu.us
traffique.net toyota.7zap.com
trailer.cinemaflix.website tracklead.net
truck-rece.life trackzapper.com
tsan.net traffixer.com
tvoystartup.ru tsstcorpcddvdwshbbdriverfb.aircus.com
uhodzalijami.ru tubo360.com
ukrtvir.com.ua tvand.ru
uogonline.com tvorozhnaja-zapekanka-recept.ru
upstore.me tvteleport.ru
uptime-alpha.net twiclub.in
uptimebot.net twu.com.ua
uptime.com u555u.info
usswrite.com uni.me
utrolive.ru ural-buldozer.ru
varbergsvind.se urengoy.pro
vchulkax.com userequip.com
v-doc.co vancleefreplica.pw
velen.io vapsy.com
viddyoze.com vasileostrovsky-rayon.ru
video-camer.com vegan-foods.us
videojam.tv vereo.eu
videonsk.com viagra.pp.ua
villacoloniale.com videochat.life
vinylvault.co.uk viven.host.sk
vip2ch.com vkgaleria.com
vip-file.com vkmusics.ru
vipromoffers.com vkontaktemusic.ru
vitalads.net
vltai.com vltai.com
vodkoved.ru volgograd.xrus.org
voloo.ru vonradio.com
vseigry.fun vse-pesni.com
vvon.co.uk vykup-avto-krasnodar.ru
warningwar.ru vzlom-na-zakaz.com
waterpurifier.club waterpurifier.club
website-speed-up.top waysbetter.cn
webtherapy.ru weblo.com
weburlopener.com webmasters.stackexchange.com
weburok.com weightatraining.com
wedding-salon.net westvilletowingservices.co.za
whatsappdownload10.com whosonmyserver.com
woman-h.ru winterclassichockeyjerseys.com
winwotgold.pl
womama.ru
woman-orgasm.ru
works.if.ua works.if.ua
worldinternetauthority.com worldmusicfests.com
worldlovers.ru woweb.com.ua
worst-sites.online writingservices17.blogspot.ru
wosik-dach.service-for-web.de ww2awards.info
wttavern.com xblognetwork.com
www.arenda-yeisk.ru xcombear.ru
www.souvenirua.com xmlinde.com
www.timer4web.com xn--24-glceagatoq7c2a6ioc.xn--p1ai
xchat26.myfreecams.com xn------7cdbapdecfd4ak1bn0amjffj7afu3y.xn--p1ai
xedserver.com xn--hxazdsfy.blogspot.com
xn--80abgj3a5acid6ghs.top xpresscare.ru
xn--80ahdheogk5l.xn--p1ai x-true.info
xn--80ahvj9e.xn--p1ai youjizz.com
xn----8sbhefaln6acifdaon5c6f4axh.xn--p1ai yourporn.com
xn--b1addnj3cah.xn--p1ai yur-p.ru
xn----dtbndd4ae7eub.top zapatosenventa.info
xnxxandxvideos.com zerocash.msk.ru
xxxtubesafari.com zeroredirect10.com
youtube-downloader.savetubevideo.com zigzog.ru
zaimhelp.ru znaturaloriginal.com
zazagames.org zoolubimets.ru
zdesoboi.com
zeroredirect11.com
zeroredirect7.com
zigarettenonlinekaufen2.bloog.pl
zog.link
zojirushi-products.ru
zoosexart.com

480
.dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
1-99seo.com 1001desert.com
1j7740kd.website 123kuma.com
1millionusd.xyz 12bet.com
2020iscoming.info 256bit.by
2728fb936f0.com 3rbseyes.com
2daytrendingnews.com 8kisses.eu
2kata.ru abclauncher.com
4replicawatch.net academiacsmendoza.org
7minuteworkout.com acads.net
adtech.fr adbetclickin.pink
adultactioncam.com adktrailmap.com
adzerg.com advokateg.xyz
affordablewebsitesandmobileapps.com advokat-grodno.by
ahhjf.com aerogo.com
algerianembassy.co.in agreda.pluto.ro
amazon-seo-service.com agysya.ru
apiluckyleapnet-a.akamaihd.net aimayangzhi.com
apimountainbikei-a.akamaihd.net alfa-medosmotr.ru
apioutoboxnet-a.akamaihd.net anmysite.com
arcteryxsale.online apartmentratings.com
autoblogger24.info apiallgeniusinfo-a.akamaihd.net
avirasecureserver.com apiqualitinknet-a.akamaihd.net
baksman.com apparel-offer.com
balois.worldbreak.com articlesdirectoryme.info
barnfurnituremart.com asdfz.pro
battle.net atelielembrancaqueencanta.com.br
bbtec.net aversis.net
bestmarriages.com avtochehli.by
binomo.kz ayanaspa.com
blacktwhite.com bambi.ck.ua
bochemit.com.ua batanga.net
bongiornos.info beachfix.co
brandehk.dk beauty-things.com
brewdom.ru berlininsl.com
buytizanidineonlinenoprescription.blogspot.com bestwaystogetpaid.us
callawaygolfstore.online bet-prognoz.com
cand.jp betterscooter.com
candy-glam-hp.com bg6s0.com
carina-sy.de blogqpot.com
carstrends2015.com bloke.com
cartierreplica.win bluejays-jerseys.us
catalogs-parts.com bluesman.nu
celebsopics.com boazpower.com
c-english.ru bonzybuddy.com
chocolateslim-en-espana.com bronzeaid-a.akamaihd.net
circlesl.com buzzzg.men
clickaider.com call-of-duty.info
clicksor.net cartierreplica.xyz
compliance-andrew.top cashonads.com
compliance-barak.xyz cdnanalytics.xyz
compliance-irvin.top cdncash.org
cenokos.ru
cfjump.com
c-gainsbourg.com
changde.58.com
cheap-trusted-backlinks.com
chelnytruck.ru
computernetworksonline.com
concealthyself.com concealthyself.com
coolwallpapers4k.info cookie-law-enforcement-aa.xyz
cordstrap.cc cookingmeat.ru
cornomase.win creatives.adbetclickin.pink
creativehutindia.com crirussian.ru
creditwell.ru cypernhuset.se
cvety24.by dealighted.com
dailystrength.org deluxedumps.com
dengi-pod-zalog-nedvizhimosti.ru dfiles.me
dev-seo.blog dikx.gdn
diamond-necklace.info
diegolopezcastan.com
dinkolove.ya.ru dinkolove.ya.ru
divatraffic.com domainsphoto.com
divku.ru donna7753191.ru
dneprsvet.com.ua downtuptv.gq
download-of-the-warez.blogspot.com dustyorate.com
easytuningshop.ru eduserver.net
ebonyporn.site emailaccountlogin.co
elektroniksigaraankara.info englate.com
enskedesquashclub.se eropho.com
etur.ru eropho.net
event-tracking.com everflora.ru
exchanges-bet.com feeriaclub.ru
famix.xyz filunika.com.ru
farmingworm.com findanysex.com
fashionavenuegame.com findsexguide.com
fast-wordpress-start.com fitness-video.net
felizporno.com forensicpsychiatry.ru
fil.ru free411games.com
fodelsedagspresenter.nu freeuploader.com
forum-engineering.ru fr.netlog.com
forums.toucharcade.com funnel.co.za
foxinsocks.ru funnymama.com
freewlan.info gagrasector.ru
frvo.alptandem.ru gateway.zscalertwo.net
fuel-gas.com gazporno.com
fullgirl.ru getyourimage.club
fz139.ttk.ru ggiaro.com
gemgrab-a.akamaihd.net girlporn.ru
generalporn.org gk170.ru
gepezz.info golfresa.lucania.se
getaclueamerica.com goodnightjournal.com
gov.yanao.ru guardlink.com
greatzip.com hccoder.info
gsasearchengineranker.space help.tpu.ru
happy.new.yeartwit.com hledejvshopech.cz
hebr.myddns-flir.com hothot.ru
hermesreplica.pw hotxnights.info
hermesreplica.win howopen.ru
hobbyhuren24.net
homik.pw
honyaku.yahoofs.jp
hotblognetwork.com
hotdl.in
hotkeys.com
hundejo.com
id-forex.com
i-hobot.ru i-hobot.ru
impotentik.com imadedinner.net
innodgfdriverhm.aircus.com immigrational.info
intim-uslugi.info indiasourcemart.in
inzn.ru insta-add.pro
iomoio.net intermesh.net
irunfar.com investzalog.ru
izhevsk.zrus.org isoveti.ru
javatex.co.id ix20.ru
juliadiets.com javidol.site
kashubadesign.ru jose.mulinohouse.co
kazan.zrus.org joy-penguin.com
kerei.ru justbcause.com
keyhantercume.com kaac.ru
keywordhut.com katushka.net
kliksaya.com keywordsuggest.org
kozhniebolezni.com kihi.gdn
kung-fu-ru.com kinogonew.ru
kupit-adenu.ru kinopolet.net
lacave.ntic.fr knigonosha.net
laptoper.net kriokomora.info
leftofcentrist.com kwzf.net
lego4x4.ru lapolis.it
letsart.ru lechenie-gemorroya.com
lider-zhaluzi.kiev.ua lescinq.com
light.ifmo.ru lincolntheatre.com
livingroomdecor.info livetsomudvekslingstudent.bloggersdelight.dk
lkbennettoutlet.online lodki-pvh.dp.ua
localmatchbook.com lotto6888.com
losangeles-ads.com louboutinreplica.pw
louboutinbooties.xyz luckyday.world
lyngdalhudterapi.no mactechinfo.info
m292.info magnetic-bracelets.ru
mac-shield.com makedo.ru
manifestation.betteroffers.review marsgatan.com
master-muznachas.ru mazda-roadsters.com
mb140.ru mb140.ru
minegam.com mesto-x.com
moesen-ficken.com mojpregled.com
monclerjacketsoutlet.win musezone.ru
most-kerch.org mustat.com
muabancantho.info my-cash-bot.co
myfreecams.com myplaycity.com
nakozhe.com namenectar.com
news-readers.ru nero-us.com
nextbackgroundcheck.gq nikhilbahl.com
nhl09.ru nikitabuch.com
nicefloor.co.uk nonameread45.live
normalegal.ru nosecret.com.ua
novosibirsk.xrus.org notebook-pro.ru
novosti-hi-tech.ru nucia.biz.ly
okout.ru nuup.info
onthemarch.co obsessionphrases.com
orsonet.ru okroshki.ru
ownshop.win onetravelguides.com
paceform.com online7777.com
paintingplanet.ru optikremont.ru
paydayloanslocal.com oz-offers.com
phelissota.xyz panchro.co.uk
picsforkeywordsuggestion.com partybunny.ru
picture-group.com pflexads.com
pomoc-drogowa.cba.pl phpdevops.com
pornoslive.net pintattoos.com
pourvous.info poems.com.ua
poptool.net
postclass.com
presleycollectibles.com
privatov-zapisi.ru
prod2016.com prod2016.com
prostitutki-kiev.org proekt-gaz.ru
pro-tec.kz pussyspace.net
rainbowice.ru referencemoi.com
real-time-analytics.com refererx.com
realtytimes.com reklamuss.ru
recipedays.com rfserial.net
redirect.trafficreceiver.club
restaurantlescampi.com
ringtonepartner.com ringtonepartner.com
royal-investments.net rn-to-bsn.com
rukino.org rusoft-zone.ru
rvtv.ru sawin.beth.webd.pl
sanatorrii.ru scanner-mary.top
santasgift.ml see-your-website-here.com
scanner-irvin.top semp.net
scanner-viktor.top sexuria.net
sdelai-prosto.ru shakhtar-doneck.ru
seo-2-0.com shopwme.ru
seocheki.net si-unique.com
seoprofiler.com skladvaz.ru
sexfreepornoxxx.com sledstvie-veli.net
sexystrippe.info smartshoppymac.com
sharpchallenge.com sneakyboy.com
small-game.com sockshares.tv
smsactivator.ru softwaretrend.net
special-porn.com solinf.co
spywarespy.com spyfu.com
steamoff.net starpages.net
stroiminsk.com stopnarco.ru
swimpool.ca svetodiodoff.ru
tackletarts.co szucs.ru
talant-factory.ru tattomedia.com
tarad.com teguh.info
tds-advert005.info thecoolimages.net
thaisamkok.com themeforest.net
thegalerie.eu timecrimea.ru
thegamerznetwork.com timetorelax.biz
thepantonpractice.co.uk tivolibasket.it
timer4web.com
titan-ads.life
tizanidine4mgstreetvalue.blogspot.com tizanidine4mgstreetvalue.blogspot.com
topbestgames.com tizanidine6mg.blogspot.com
torrent-newgames.com tomck.com
toxicwap.com toon-families.com
trafaret74.ru torrents-tracker.com
trafficfactory.biz tourcroatia.co.uk
trafficmp.com trafficnetzwerk.de
truebeauty.cc
tula.howotorg.ru
turbabitload.weebly.com turbabitload.weebly.com
tvand.ru u555u.info
twelvevisionspartyofcolorado.com ucoz.ru
uac.net.au udsgame.online
ukkala.xyz ukrobstep.com
ukkelberg.no unisexjewelry.org
upstore.me urccvfmc.bloger.index.hr
utiblog.fr
varikoz24.com
vbikse.com vbikse.com
videogamesecrets.com vchulkah.net
vitalads.net vchulkax.com
wallpapers-best.com vereo.eu
watch-movies.ru viandpet.com
webadvance.club videochat.ph
website-analyzer.info vsesubwaysurfers.com
weburlopener.com vykup-avto-krasnodar.ru
whatsappdownload10.com westsextube.com
wholinkstome.com wholesalejerseys-cheapest.com
wineration.com worldis.me
womensplay.net worldoffiles.ru
www.get-free-traffic-now.com
www.kabbalah-red-bracelets.com
wygraj-teraz.com wygraj-teraz.com
xtrafficplus.com xz618.com
yourmovies.pl yourporn.com
yuarra.pluto.ro youtubologia.it
zakonobosago.ru yugo-star.ru
za-music.mymobiplanet.com zarabotat-na-sajte.ru
zastenchivosti.net
zeroredirect5.com
zhongwenlink.com
znakomstvaonlain.ru
zzbroya.com.ua

BIN
.latest_release/bots.d.tar.gz
View file

Binary file not shown.

BIN
.latest_release/conf.d.tar.gz
View file

Binary file not shown.

4
AUTO-CONFIGURATION.md
View file

@ -4,8 +4,8 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2021.03.2303 #### Version: V4.2021.03.2304
#### Bad Referrers Blocked: [6949](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [6950](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [608](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [608](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)
____________________ ____________________

4
MANUAL-CONFIGURATION.md
View file

@ -4,8 +4,8 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2021.03.2303 #### Version: V4.2021.03.2304
#### Bad Referrers Blocked: [6949](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [6950](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [608](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [608](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)
____________________ ____________________

4
README.md
View file

@ -11,8 +11,8 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2021.03.2303 #### Version: V4.2021.03.2304
#### Bad Referrers Blocked: [6949](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [6950](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [608](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [608](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)
____________________ ____________________

8090
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

4
_generator_lists/bad-referrers.list
View file

@ -1,4 +1,3 @@
ispac.org
000free.us 000free.us
007angels.com 007angels.com
00author.com 00author.com
@ -3002,6 +3001,7 @@ islamtoday.co.za
islandminingsupply.wordpress.com islandminingsupply.wordpress.com
isotoner.com isotoner.com
isoveti.ru isoveti.ru
ispac.org
ispaniya-costa-blanca.ru ispaniya-costa-blanca.ru
istanbulit.com istanbulit.com
istizanidineacontrolledsubstance.blogspot.com istizanidineacontrolledsubstance.blogspot.com
@ -6948,4 +6948,4 @@ zygophyceous.womanstars.site
zynax.ua zynax.ua
zytpirwai.net zytpirwai.net
zzbroya.com.ua zzbroya.com.ua
zzlgxh.com zzlgxh.com

4
_google_analytics_ghost_spam/README.md
View file

@ -3,8 +3,8 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2021.03.2303 #### Version: V4.2021.03.2304
#### Bad Referrers Blocked: [6949](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [6950](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [608](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [608](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)
____________________ ____________________

2
_google_analytics_ghost_spam/google-exclude-02.txt
View file

File diff suppressed because one or more lines are too long

1
_google_webmaster_disavow_links/google-disavow.txt
View file

@ -3001,6 +3001,7 @@ domain:islamtoday.co.za
domain:islandminingsupply.wordpress.com domain:islandminingsupply.wordpress.com
domain:isotoner.com domain:isotoner.com
domain:isoveti.ru domain:isoveti.ru
domain:ispac.org
domain:ispaniya-costa-blanca.ru domain:ispaniya-costa-blanca.ru
domain:istanbulit.com domain:istanbulit.com
domain:istizanidineacontrolledsubstance.blogspot.com domain:istizanidineacontrolledsubstance.blogspot.com

8097
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

8097
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

8097
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2021.03.2303 ### Version: V4.2021.03.2304
### Updated: Fri Mar 19 01:19:41 SAST 2021 ### Updated: Sat Mar 20 09:15:09 SAST 2021
### Bad Bot Count: 608 ### Bad Bot Count: 608
################################################### ###################################################
### Version Information ## ### Version Information ##