vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-04 19:50:17 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2019.10.1879 [ci skip]

Browse source
This commit is contained in:
Travis 2019-10-27 20:54:04 +02:00
parent 61af4296c0
commit 90d6d0f040
52 changed files with 9481 additions and 9480 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

932
.dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
.dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
34.66.178.120 1; 35.184.226.236 1;
127.0.0.1 1; 127.0.0.1 1;

2
.dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
34.66.178.120 0; 35.184.226.236 0;
127.0.0.1 0; 127.0.0.1 0;

932
.dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
.dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
34.66.178.120 1; 35.184.226.236 1;
127.0.0.1 1; 127.0.0.1 1;

2
.dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
34.66.178.120 0; 35.184.226.236 0;
127.0.0.1 0; 127.0.0.1 0;

932
.dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
.dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
34.66.178.120 1; 35.184.226.236 1;
127.0.0.1 1; 127.0.0.1 1;

2
.dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
34.66.178.120 0; 35.184.226.236 0;
127.0.0.1 0; 127.0.0.1 0;

932
.dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

932
.dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

932
.dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
.dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
34.66.178.120 0; 35.224.112.202 0;

932
.dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
.dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
35.193.14.140 1; 35.184.226.236 1;
127.0.0.1 1; 127.0.0.1 1;

2
.dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
35.193.14.140 0; 35.184.226.236 0;
127.0.0.1 0; 127.0.0.1 0;

932
.dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
.dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
35.193.14.140 1; 35.184.226.236 1;
127.0.0.1 1; 127.0.0.1 1;

2
.dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
35.193.14.140 0; 35.184.226.236 0;
127.0.0.1 0; 127.0.0.1 0;

932
.dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
.dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
35.193.14.140 1; 35.184.226.236 1;
127.0.0.1 1; 127.0.0.1 1;

2
.dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
35.193.14.140 0; 35.184.226.236 0;
127.0.0.1 0; 127.0.0.1 0;

932
.dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

3
.dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,5 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
35.192.187.174 0; 35.184.226.236 0;
34.66.178.120 0;

932
.dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

4
.dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,5 +45,5 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
104.154.113.151 0; 35.193.7.13 0;
35.192.187.174 0; 35.188.1.99 0;

932
.dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

5
.dev-tools/test4_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,6 +45,5 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
34.68.144.114 0; 35.188.1.99 0;
35.193.14.140 0; 35.193.7.13 0;
35.192.187.174 0;

932
.dev-tools/test4_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

5
.dev-tools/test5_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,6 +45,5 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
35.193.14.140 0; 35.188.1.99 0;
35.192.187.174 0; 35.224.112.202 0;
34.68.144.114 0;

932
.dev-tools/test5_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
.dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
34.66.178.120 1; 35.184.226.236 1;
127.0.0.1 1; 127.0.0.1 1;

20
.dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
80legs Collector
DSearch Grabber
Evil HEADMasterSEO
LinqiaScrapeBot JOC Web Spider
MarkMonitor lwp-trivial
meanpathbot POE-Component-Client-HTTP
Mr.4x3 Psbot
MSIECrawler Turnitin
SEOkicks URLy Warning
Typhoeus WebAuto

278
.dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
360Spider
404checker
404enemy 404enemy
80legs 80legs
Aboundex AhrefsBot
Aboundexbot AiHitBot
Acunetix
ADmantX
Alexibot Alexibot
Alligator Alligator
AllSubmitter AllSubmitter
Apexoo AlphaBot
archive.org_bot
ASPSeek
Asterias Asterias
AwarioRssBot AwarioRssBot
AwarioSmartBot AwarioSmartBot
BackDoorBot BacklinkCrawler
BackStreet BackStreet
BackWeb Badass
Barkrowler BatchFTP
Battleztar Bazinga Battleztar Bazinga
BBBike BBBike
BDCbot
BetaBot
Bigfoot Bigfoot
Blackboard Blackboard
Black Hole BlackWidow
BlowFish BLEXBot
Boardreader Blow
Bolt Bolt
Brandwatch
Buddy Buddy
BuiltWith Bullseye
BunnySlippers BunnySlippers
BuzzSumo BuzzSumo
Calculon
CATExplorador CATExplorador
ChinaClaw Cegbfeieh
Chlooe Cliqzbot
coccocbot-web coccocbot-web
cognitiveseo Cogentbot
Collector Collector
Copier CopyRightCheck
Copyscape
Cosmos Cosmos
Craftbot Craftbot
crawler4j crawl.sogou.com
Crescent Custo
CrunchBot DBLBot
Curious
demandbase-bot demandbase-bot
Deusu
Devil Devil
Digincore Digincore
DIIbot DigitalPebble
Dirbuster Dirbuster
Discobot Discobot
Discoverybot
Dispatch
DnyzBot DnyzBot
DomainAppender
DomainSigmaCrawler DomainSigmaCrawler
DomainStatsBot DomainStatsBot
Dotbot
Download Wonder Download Wonder
Dragonfly Drip
DSearch
DTS Agent
Ebingbong Ebingbong
eCatch eCatch
EMail Siphon Ecxi
Evil EMail Wolf
EroCrawler
Exabot
Express WebPictures Express WebPictures
ExtLinksBot ExtLinksBot
Extractor ExtractorPro
Extreme Picture Finder
Ezooms Ezooms
facebookscraper
FDM
FHscan FHscan
Fimap FlashGet
Freeuploader Freeuploader
FrontPage FrontPage
Fyrebot FyberSpider
GetWeb GalaxyBot
GermCrawler
Getintent
Gigabot Gigabot
Go-Ahead-Got-It
Gotit
GoZilla
Go!Zilla Go!Zilla
Grabber
GrabNet GrabNet
GrapeFX
GrapeshotCrawler
GridBot GridBot
GT::WWW
Haansoft Haansoft
HaosouSpider Heritrix
Havij Hloader
HEADMasterSEO HTTP::Lite
HMView
HTMLparser
Humanlinks
HybridBot HybridBot
Image Fetch Iblog
Image Sucker IlseBot
InfoTekies IndeedBot
instabid
Internet Ninja Internet Ninja
InternetSeer InternetSeer
ips-agent
Iria Iria
IRLbot IRLbot
IstellaBot
Jbrofuzz Jbrofuzz
JennyBot
JetCar JetCar
Joomla
JustView JustView
Jyxobot Keyword Density
Kenjin Spider
Kozmosbot Kozmosbot
Lanshanbot LexiBot
Larbin Likse
Lftp LinkScan
LibWeb Lipperhey
LinkextractorPro Lipperhey Spider
LinksManager Litemage_walker
LinqiaRSSBot
LinqiaScrapeBot
Lmspider Lmspider
LNSpiderguy LNSpiderguy
Ltx71 Ltx71
lwp-request Magnet
Mag-Net Mail.RU_Bot
magpie-crawler Masscan
Majestic12 Mass Downloader
MarkMonitor MeanPath Bot
Mata Hari Metauri
Mediatoolkitbot
MFC_Tear_Sample MFC_Tear_Sample
MJ12bot Microsoft Data Access
Mojolicious Mister PiX
MSFrontPage Mr.4x3
MSIECrawler MSIECrawler
Msrabot Msrabot
Musobot
Name Intelligence
Nameprotect
Navroad Navroad
NearSite Needle
Nessus Netcraft
NetAnts NetLyzer
netEstate NE Crawler
NetMechanic NetMechanic
NetSpider
Nettrack Nettrack
Niki-bot Net Vampire
NimbleCrawler NetZIP
Ninja NextGenSearchBot
Nibbler
Octopus
Offline Explorer
Offline Navigator Offline Navigator
OnCrawl
Openfind Openfind
OpenLinkProfiler
Openvas Openvas
OpenVAS OpenVAS
OrangeBot OrangeSpider
OutclicksBot Page Analyzer
page scorer
PageScorer PageScorer
Pandalytics Pandalytics
Panscient
Pavuk Pavuk
PECL::HTTP PECL::HTTP
PeoplePal PeoplePal
Picscout
Picsearch Picsearch
PictureFinder Pi-Monster
Pixray Pixray
PleaseCrawl
Pockey
POE-Component-Client-HTTP POE-Component-Client-HTTP
QueryN Metasearch ProPowerBot
ProWebWalker
PyCurl
RankActive RankActive
RankActiveLinkBot RankFlex
RankingBot Rankivabot
RankurBot
RealDownload
Recorder Recorder
RedesScrapy
Ripper Ripper
Rogerbot Rogerbot
RSSingBot RSSingBot
SalesIntelligent
SBIder
ScanAlert
scan.lol
ScoutJet ScoutJet
Screaming Scrapy
Searchestate Searchestate
Semrush Semrush
SemrushBot SEOkicks
SEOkicks-Robot SEOlyticsCrawler
serpstatbot Seomoz
Shodan SEOprofiler
sexsearcher
Siphon
Sitebeam
Siteimprove
SiteLockSpider SiteLockSpider
SiteSucker SiteSnagger
Site Sucker
Sitevigil Sitevigil
SlySearch
Snake Snake
Snoopy
SocialRankIOBot
Sociscraper Sociscraper
sogouspider
Sogou web spider
Sosospider Sosospider
Sottopop
SpaceBison SpaceBison
Spanner Spanner
sp_auditbot Spinn3r
Spbot Sqworm
Sqlmap Steeler
Sqlworm
SuperBot SuperBot
Suzuran Surfbot
SurveyBot
Swiftbot Swiftbot
sysscan sysscan
Szukacz Szukacz
T0PHackTeam Teleport
tAkeOut
TeleportPro TeleportPro
Telesphoreo
TheNomad
TightTwatBot
Titan
Toata Toata
Tracemyfile Tracemyfile
Trendictionbot Trendiction
True_Robot trendiction.com
Turingos Turingos
TwengaBot Turnitin
Typhoeus UnisterBot
URLy.Warning Upflow
URLy Warning
Vacuum Vacuum
Vagabondo
VB Project VB Project
VCI VCI
Wallpapers/3.0 VeriCiteCrawler
WBSearchBot VidibleScraper
Virusdie
VoidEYE
Voltron
WebAuto WebAuto
Web Auto WebBandit
Web Collage
WebCopier
WEBDAV WEBDAV
WebEnhancer WebEnhancer
WebmasterWorldForumBot Web Enhancer
WebSauger Web Fuck
Web Sauger WebImageCollector
webmeup-crawler
Web Pix
Webshag Webshag
Website Quester Website Quester
WebSucker Webster
WebStripper
WebWhacker
WebZIP WebZIP
WeSEE
Whack Whack
Whacker
Whatweb Whatweb
WinHTTrack
WISENutbot WISENutbot
Wonderbot
Wotbox
Wprecon
WPScan
WWW-Collector-E
WWW-Mechanize
x22Mozilla x22Mozilla
Xaldon_WebSpider
Xenu Xenu
xpymep1.exe Zermelo
Zade zgrab
Zitebot
ZumBot

264
.dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
360Spider
404checker 404checker
404enemy
Abonti
ADmantX
AfD-Verbotsverfahren AfD-Verbotsverfahren
AhrefsBot AhrefsBot
AIBOT AIBOT
Aipbot Alexibot
AllSubmitter
AlphaBot AlphaBot
Anarchie Anarchie
archive.org_bot Apexoo
arquivo-web-crawler arquivo-web-crawler
autoemailspider
AwarioRssBot AwarioRssBot
AwarioSmartBot
BackDoorBot BackDoorBot
backlink-check Backlink-Ceck
BackStreet BackStreet
BackWeb BackWeb
Bandit Bandit
Bigfoot BBBike
Black Hole BDCbot
BLEXBot BDFetch
BetaBot
Bitacle
Blackboard
BlowFish
Boardreader Boardreader
Brandprotect BotALot
BuiltBotTough BuiltBotTough
BuiltWith
Bullseye
BunnySlippers BunnySlippers
BuzzSumo
Calculon Calculon
CATExplorador ChinaClaw
CherryPicker Claritybot
Cloud mapping Cliqzbot
coccocbot-web
Cogentbot Cogentbot
cognitiveseo cognitiveseo
Collector
Copier
CopyRightCheck CopyRightCheck
Copyscape
Cosmos
crawler.feedback
crawl.sogou.com
CrazyWebCrawler CrazyWebCrawler
CSHttp CSHttp
Curious DatabaseDriverMysqli
Custo
DataCha0s DataCha0s
Deusu DBLBot
Demon
Devil Devil
DIIbot
Dirbuster Dirbuster
Discobot Discoverybot
DnyzBot DittoSpyder
DomainAppender DomainSigmaCrawler
DomainStatsBot DomainStatsBot
Download Wonder Dotbot
Dragonfly
Drip
DSearch DSearch
EasyDL EasyDL
Ebingbong Ecxi
eCatch
ECCP/1.0
EMail Siphon EMail Siphon
EMail Wolf EMail Wolf
evc-batch evc-batch
Express WebPictures Express WebPictures
EyeNetIE ExtLinksBot
facebookscraper Extractor
Extreme Picture Finder
FHscan FHscan
Fimap Fimap
Firefox/7.0 FlashGet
Flunky Flunky
Foobot
Freeuploader
Fyrebot
GalaxyBot GalaxyBot
GermCrawler
GetRight GetRight
GetWeb
Gigablast Gigablast
Go-Ahead-Got-It Go-Ahead-Got-It
Gotit
GoZilla GoZilla
Grabber Grafula
GrabNet
GrapeFX GrapeFX
GridBot Harvest
GT::WWW Havij
HEADMasterSEO Heritrix
heritrix HMView
HTTrack HTMLparser
Humanlinks HTTP::Lite
HybridBot HybridBot
IlseBot Image Sucker
Image Fetch
IndeedBot IndeedBot
Indy Library Indy Library
InfoTekies InfoTekies
Intelliseek Intelliseek
Internet Ninja Internet Ninja
ips-agent
Iskanie Iskanie
JetCar Jbrofuzz
Jetty
JikeSpider
JOC Web Spider
Jorgee Jorgee
Jyxobot Jyxobot
Lightspeedsystems Kenjin Spider
Kozmosbot
Lanshanbot
Larbin
LeechFTP
LexiBot
LibWeb
Likse
Linkdexbot Linkdexbot
LinkextractorPro LinkScan
LinkpadBot
LinkWalker LinkWalker
LinqiaMetadataDownloaderBot
LinqiaRSSBot LinqiaRSSBot
LinqiaScrapeBot LinqiaScrapeBot
Lipperhey Litemage_walker
Lmspider
LNSpiderguy
Ltx71
lwp-request
lwp-trivial lwp-trivial
Magnet Magnet
Mail.RU_Bot Majestic SEO
Majestic-SEO
MarkMonitor MarkMonitor
Mass Downloader Mass Downloader
Mata Hari
meanpathbot meanpathbot
Meanpathbot
MeanPath Bot
mediawords
MegaIndex.ru MegaIndex.ru
Metauri Metauri
MFC_Tear_Sample
Microsoft Data Access Microsoft Data Access
Microsoft URL Control Mister PiX
MIDown tool MJ12bot
Mojeek Mojeek
Mr.4x3 Mojolicious
MSFrontPage Morfeus Fucking Scanner
MSIECrawler
muhstik-scan
Name Intelligence
Nameprotect Nameprotect
Nessus NearSite
Netcraft Needle
NetLyzer netEstate NE Crawler
NetSpider NetSpider
NetZIP Net Vampire
Netvibes
NextGenSearchBot NextGenSearchBot
Nibbler Nibbler
NICErsPRO
Niki-bot
Nikto Nikto
NimbleCrawler NimbleCrawler
Nutch Nimbostratus
Offline Explorer Ninja
Offline Navigator Nmap
OnCrawl NPbot
oBot
Octopus
Openfind
OpenLinkProfiler
OpenVAS
OrangeBot OrangeBot
OutclicksBot
PageGrabber PageGrabber
PageScorer page scorer
Pandalytics
Panscient Panscient
Pavuk Papa Foto
pcBrowser
PECL::HTTP PECL::HTTP
PeoplePal PeoplePal
Picscout Picsearch
Pimonster Pimonster
Pi-Monster plumanalytics
PleaseCrawl
Pockey
POE-Component-Client-HTTP
ProPowerBot ProPowerBot
ProWebWalker
Pump Pump
PxBroker
PyCurl PyCurl
QueryN Metasearch QueryN Metasearch
Quick-Crawler Quick-Crawler
RankActive RankActive
RankActiveLinkBot
RankFlex
RankurBot
RealDownload RealDownload
Reaper Reaper
RebelMouse
Recorder
RedesScrapy
RepoMonkey RepoMonkey
Ripper
Rogerbot
s1z.ru
SalesIntelligent SalesIntelligent
SBIder SBIder
ScanAlert
Scanbot Scanbot
ScreenerBot scan.lol
Scrapy
Screaming
Searchestate
Semrush Semrush
SemrushBot SEOkicks
SEOkicks-Robot
Seomoz
SEOprofiler
seoscanners
SEOstats
serpstatbot serpstatbot
Shodan Siphon
SISTRIX
Sitebeam
Siteimprove
SiteSucker SiteSucker
Site Sucker SMTBot
SmartDownload Snake
Sociscraper Snoopy
SocialRankIOBot
sogouspider
Sosospider Sosospider
Sottopop Sottopop
SpaceBison
SpankBot
Spinn3r
SputnikBot SputnikBot
spyfu Steeler
Sqlmap Sucker
Stripper
Sucuri Sucuri
SuperHTTP SuperHTTP
SurveyBot Suzuran
T0PHackTeam
T8Abot T8Abot
tAkeOut tAkeOut
TeleportPro TeleportPro
The Intraformant The Intraformant
Thumbor Thumbor
Tracemyfile Titan
Turingos Toata
Turnitin trendiction.de
TwengaBot TwengaBot
Typhoeus Typhoeus
UnisterBot
URLy.Warning
Vagabondo Vagabondo
VeriCiteCrawler Virusdie
Voil
Wallpapers/3.0 Wallpapers/3.0
WallpapersHD WallpapersHD
WASALive-Bot
WBSearchBot WBSearchBot
WebAuto
Web Auto Web Auto
WebBandit Web Collage
WebCollage WEBDAV
WebCopier Web Enhancer
WebFuck WebFuck
Web Fuck
WebGo IS WebGo IS
WebImageCollector WebImageCollector
webmeup-crawler WebSauger
Web Sauger Web Sauger
Webshag
WebsiteExtractor
WebsiteQuester WebsiteQuester
Website Quester Website Quester
WebStripper Webster
Web Sucker Web Sucker
WebZIP
Whack
Who.is Bot Who.is Bot
WinHTTrack WinHTTrack
WISENutbot Wonderbot
Woobot
Wotbox
Wprecon Wprecon
WWW-Mechanize WPScan
x09Mozilla WWW::Mechanize
x22Mozilla
Xaldon_WebSpider Xaldon_WebSpider
xpymep1.exe Zade
YoudaoBot
Zermelo
ZmEu ZmEu

20
.dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
irunfar.com amazon-adsystem.com
istizanidineanarcoticdrug.blogspot.com cheapmoncler.xyz
okuos.com freshwallpapers.info
rocketchange.ru kakadu-interior.com.ua
searchlock.com ldrtrack.com
tizanidineoral.blogspot.com nhl09.ru
vzlomfb.com sexreliz.com
wordpress-crew.net sinel.info
yaoguangdj.com telsis.com
zryydi.com xsion.net

926
.dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
00webcams.com 1000n1.ru
01apple.com 24videos.tv
0lovespells0.blogspot.com 5i2.net
101raccoon.ru
123kuma.com
24-ak.ru
24x7-server-support.site
2728fb936f0.com
5kstore.com 5kstore.com
991mostfm.co.id 7fon.ru
aa8b68101d388c446389283820863176e7.com 999webdesign.com
above.com a14download.com
academia-nsk.org aadroid.net
adcash.com abcdeg.xyz
addblueoff.com.ua abctoppictures.net
addray.pro acheterviagrafr24.com
adelly.bg acmebtn.ml
adman.se adidas.frwebs.fr
ads-cool.pro adpremium.org
adssafeprotected.com adrenalin-stk.ru
ads.tremorhub.com adzpower.com
agecheckadult.com aibolita.com
ageofclones.com aktivator-windows10.blogspot.com
aihelen.net alevinefesleri.com
alert-fdm.xyz alkoravto.ru
all4invest.ru alt-servis.ru
alphavisions.net angry-fermi-7633.arukascloud.io
amateurlivechat.org animal-drawings.com
amateurmatch.com anmysite.com
am-se.com aosexkontakte.net
apartmentratings.com apiitsthirteende-a.akamaihd.net
apelsinnik.website apple.com-webbrowsing-security.review
apiqualitinknet-a.akamaihd.net arabgirls.adultgalls.com
ap.senai.br as5000.com
aquarium-pro.ru asrvvv-a.akamaihd.net
aramaicmedia.org asscenihotosidea.blogspot.com
arcadepages.com atleticpharm.org
arendakvartir.kz autoblogger24.info
arkartex.ru autoseo-traffic.com
artel116.ru awency.com
artparquet.ru barbourjackets.online
arvut.org battleforupdating.site
asdfg.pro beauty-b0x.pl
asiengirls.net belinka.com.ua
aussie-prizes.com best-businessman.ru
auto-moto-elektronika.cz bestfortraders.com
aviapanda.ru best-mam.ru
awaybird.ru bestmouthwash.club
ayakino.net bestofupload.info
b2b-lounge.com best-seo-software.xyz
babespcs.com beta.hotkeys.com
backgroundpictures.net betwinservice.com
bambi.ck.ua bfz.biz
bannerconnect.net bigpenisguide.com
bcmp.org billiard-classic.com.ua
beclean-nn.ru biteg.xyz
becuo.com
besttorrentknifta.weebly.com
bet-prognoz.com
bif-ru.info
bingoporno.com
bio.trade-jp.net
bird1.ru
bjanshee.ru
bjetjt.com bjetjt.com
bjorkbacken.nu blackle.com
blockworld.ru blogrankers.com
blog.axant.it blue-square.biz
bmsco.co bolezniorganov.ru
bonux.nextview.ru bongiornos.info
bookmaker-bet.com bonky.biz
breget74.ru bonzbuddy.com
brg8.com bonzybuddy.com
briomotor.co bpro1.top
brk-rti.ru brateg.xyz
bum.com.ru brus.city
bupropion-sr-150-mg.us buyessayonline19.blogspot.ru
businescoop.men buyk.host.sk
camdenmemorials.com bvlgaribracelet.xyz
candypeople.se callawaygolfoutlet.online
canrioloadm.gq callawaygolfstore.online
cam-kontakte.org
candcstuccoandstone.com
cand.jp
candytiner.com
cartierjusteunclou.xyz
cartierloveringreplica.xyz
casinorewards.info casinorewards.info
cctva.tv catalogs-parts.com
cellfun.mobi caveavins.fr
cenokos.ru cdnanalytics.xyz
centrdebut.ru centre-indigo.org.ua
changde.58.com cezartabac.ro
chatroulette.si cheatcode-lita12.rhcloud.com
cheapcigarettesc.info cherrypointplace.ca
checkpagerank.net christianlouboutinoutlet.win
cialischstgerts.com citetick.com
ciceros.co ci.ua
cindymatches.com cleanersoft.com
cmhomestayagency.com club-samodelkin.ru
codysbbq.com cobaltpro.ru
coinsspb.com coderstate.com
coldfilm.ru compliance-george.top
communisave.co.za compliance-julia.top
compliance-ivan.xyz compliance-olga.top
concealthyself.com compliance-walt.top
credit-respect.ru compliance-willy.top
crest-poloski.ru contextualyield.com
culturevie.info converse.ddsoldes.fr
customergrowthsystems.com coolwallpapers4k.info
cypernhuset.se copblock.org
dame-ns.kz copenergo.ru
cornerstone-countertops.com
country-chic.ru
cryptoswap.biz
crystalslot.com
cupday.com
damedingel.ya.ru
danceuniverse.ru
danschawbel.com
daretodonate.co
data1.scopich.com data1.scopich.com
datract.com davebestdeals.com
dayibiao.com dcj-nn.ru
dbmkfhqk.bloger.index.hr detmebel.su
db.speedup.gdn diamond-necklace.info
decenttools.com diesel-parts28.ru
dfwu1013.info dieswaene.com
digest-project.ru dignitasdata.se
digitalfaq.com div.as
discountbarbour.online divatraffic.com
disruptingdinnerparties.com divisioncore.com
dms-sw.ru dogoimage.com
domashneeruporno.com download-of-the-warez.blogspot.com
domoysshop.ru drugstoreforyou.com
drugs-no-rx.info druzhininevgeniy63.blogspot.com
e2click.com dumpsmania24.com
e705.net dverimegapolis.ru
earl-brown.info dyt.net
ege-russian.ru eaplay.ru
elektir.ru ecxtracking.com
ednorxmed.com
elektrischezigarette2.devhub.com elektrischezigarette2.devhub.com
elektrischezigaretten2.beeplog.com elektronischezigarettekaufen2.tumblr.com
elektrozigaretten1.tumblr.com energydiet24.ru
elmacho.xyz enews.tech
embedle.com epngo.bz
emediate.eu erotik0049.com
emerson-rus.ru erotikchat-24.com
eredijovon.com erotikstories.ru
eropho.com escortplius.com
eshop4u.jp esnm.ru
etenininrade.ga etur.ru
evogarage.com everflora.ru
exchangeit.gq
exchanges-bet.com exchanges-bet.com
exlarseva.webblog.es exportshop.us
eyelike.com.ua extlinks.com
ezaz.info extstat.com
ezigarettekaufen.myblog.de eyes-on-you.ga
falllow.gq ezigaretteshop2.mywapblog.com
fashion-mk.net ezigaretteshop.webs.com
feel-planet.com falcoware.com
fetlifeblog.com fanoboi.com
fidelityfunding.com fanpagerobot.com
finuse.com fantasticpixcool.com
fix-website-errors.com farmingworm.com
floridahuntingfishingadventures.com filmidivx.com
forex-procto.ru firesub.pl
foto-weinberger.at flashahead.info
foxinsocks.ru flashlarevista.com
foxweber.com footbalive.org
franklinfire.co forodvd.com
frcls.fr forums.toucharcade.com
freecamdollars.com fr-bearings.ru
freenom.link free-fb-traffic.com
free-traffic.xyz freelifetimefuckbook.com
galaxyflowers.ru froggytube.com
gameplexcity.com fusoradio.info
gardene.ru fxtips.ru
gearcraft.us gelezki.com
geile-lelly.eu geoads.com
gemara.com germes-trans.com
gerhardhealer.com
get-free-social-traffic.com
getpopunder.com getpopunder.com
ggiaro.com given2.com
gilbertbanda.net golden-catalog.pro
girlspicsa.com googlepositions.com
gnuetella.com gotcher.us
gorabagrata.ru gribokstop.com
gorodservis.ru guge.io
graphics8.info handicapbathtubarea.com
growmyfunds.ca hdpixion.com
g.starmoe.xyz headpharmacy.com
hamptonoaks.ca hentaiheroes.com
happy.new.yeartwit.com hentai-manga.porn
hatedriveapart.com himazin.info
hazardky.net
hdpixent.com
helvetia.com.ua
hidefiles.org
histats.com
hmmm.cz hmmm.cz
hol.es hol.es
holidaypics.org homedo.fabpage.com
hollywoodactress.info home-task.com
host-protection.com hspline.com
hothot.ru humanorightswatch.org
hotshoppymac.com hydropump.su
houseofgaga.ru ibmdatamanagement.co
houston-vikings.com ideashome.id
hoverboardforsaledirect.com imk.com.ua
hoztorg-opt.ru imperia31.ru
hplaserjetpdriver8y.pen.io inboundlinks.win
hreade.com inclk.com
iamsport.org infodocsportal.com
ifirestarter.ru interferencer.ru
iloveitaly.ru interior-stickers.ru
images-free.net internetproviderstucson.com
images-graphics-pics.com investsuccess.org
imguramx.pw iqupdatetmz.win
incanto.in.ua iron-age.info
intim-uslugi.info istripper.com
investpamm.ru iwantedmoney.com
inzn.ru jagg.info
ip-guide.com javlibrary.cc
istanbulit.com jerseyswholesalechinalimited.com
ixora.pro jetsli.de
izismile.com jovencitas.gratis
japan-bearings.ru juliaworld.net
jav-fetish.com kaliningrad.zrus.org
jjbabskoe.ru karpun-iris.ru
jus0wil.pp.ua kazan.zrus.org
kaz.kz kiinomaniak.pl
keywordhouse.com kinky-fetishes.com
keywordsuggest.org kinobaks.com
keywordsuggests.com kiwi237au.tk
kino-key.info kongruan.com
kleine-titten.biz konica.kz
kol-energo.ru konpax.com
kollesa.ru krafte.ru
konkursov.net
koral.se
kostenlos-sexvideos.com
krassh.ru krassh.ru
ku6.com kredit-pod-zalog-krasnodar.ru
kunstaktien.info kursy-ege.ru
kurbappeal.info kwzf.net
kvartir-remont.biz laapp.com
laexotic.com laexotic.com
landscaping.center landscaping.center
laptoper.net laptoper.net
laserpen.club ldrtrack.com
lecbter-relationships.ga legionalpha.com
ledis.top
lernur.net
letslowbefast.today
lida-ru.com
likesdesign.com
likesuccess.com likesuccess.com
lion.conboy.us liverpool.gsofootball.com
ljusihus.se live-sexcam.tk
locustdesign.co lizace.com
lomza.info lkbennettstore.online
louboutinreplica.xyz lodki-pvh.dp.ua
m3gadownload.pl louisvuittonoutletstore.net
macfix.life mackeeper-center.club
mahnwachen-helfen.info macnewtech.com
mantramusic.ru mactechinfo.info
manualterap.roleforum.ru makedo.ru
manve.info mamasuper.prom.ua
marcoislandvacations.net mararoom.ru
maxthon.com massage-info.nl
mebel-alait.ru max-eclat.men
medanestesia.ru maximpartnerspr.com
medicinacom.ru mb140.ru
medkletki.ru mcadamssupplyco.com
mcnamaratech.com
mebel-vstroika.ru
mecash.ru
medicine-4u.org
medi-fitt.hu
meds-online24.com
meetingrainstorm.bid
megaapteka.ru
mega-polis.biz.ua
members.ghanaweb.com members.ghanaweb.com
menstennisforums.com mensandals.xyz
mere.host.sk mere.host.sk
mesbuta.info metalonly.info
mesto-x.com metaxalonevstizanidine.blogspot.com
micasainvest.com mex-annushka.ru
microsoftportal.net michaelkorssaleoutletonline.net
mobilemedia.md mirobuvi.com.ua
mobile.ok.ru mncrftpcs.com
monclercoats.xyz mnogolok.info
mole.pluto.ro
monclerjacketsoutlet.pw monclerjacketsoutlet.pw
moneymaster.ru money-every-day.com
mosdverka.ru monsterdivx.com
moyakuhnia.ru moomi-daeri.com
mrbitsandbytes.com morepoweronmac.trade
mtmtv.info morocco-nomad-excursions.com
muizre.ru mossmesi.com
moviemail-online.co.uk
moyaterapiya.ru
musflashtv.com musflashtv.com
musicktab.com
music.utrolive.ru
mustat.com mustat.com
mwtpludn.review muycerdas.xxx
mydownlodablefiles.com muz-tracker.net
mymobilemoneypages.com myanyone.net
myonigroup.com my-big-family.com
mysexpics.ru mydownloadengine.com
nacap.ru myfreecams.com
naperehresti.info myfreemp3.eu
national-today-winning-winner.club myfreetutorials.com
naturalpharm.com.ua mykings.pw
netanalytics.xyz myperiod.club
nextbackgroundcheck.gq myplaycity.com
next-dentists.tk mypornfree.ru
niroo.info navalwiki.info
nottyu.xyz neks.info
noumeda.com netpics.org
nrv.co.za news-readers.ru
nucia.biz.ly news-speaker.com
nvformula.ru newstaffadsshop.club
okmusic.jp newstraveller.ru
onlinemeetingnow.com nfljerseyscheapchinabiz.com
nikhilbahl.com
niki-mlt.ru
northfacestore.online
nudepatch.net
okayimage.com
oktube.ru
olgacvetmet.com
onclickpredictiv.com
oneclickfiles.com
onlinebay.ru
onlineslotmaschine.com
online-templatestore.com online-templatestore.com
o-o-11-o-o.com onlywoman.org
open-odyssey.org
optibuymac.com optibuymac.com
oren-cats.ru oranga.host.sk
ossmalta.com osnova3.ru
ovirus.ru ownshop.win
partnersafe.men pagesense.com
pavlodar.xkaz.org pateaswing.com
pb-dv.ru
pcgroup.com.uy pcgroup.com.uy
pekori.to percin.biz.ly
petitions.whitehouse.gov photosaga.info
phobia.us
phpdevops.com
picsforkeywordsuggestion.com
pijoto.net
piluli.info piluli.info
pisanieprac.info pinsdaddy.com
pixelrz.com piter.xrus.org
pizda.lol
pk-pomosch.ru pk-pomosch.ru
pkr1hand.com plastgranar.nu
playfortuna-play.ru play.leadzupc.com
poiskzakona.ru plugingeorgia.com
popunder.net pochtovyi-index.ru
pornhub-forum.ga popup-fdm.xyz
pornogratisdiario.com pornoklad.ru
porno-video-chati.ru pornosee.info
pornozhara.com pornoxxx.com.mx
potoideas.us portadd.men
predmety.in.ua portnoff.od.ua
pricheskaonline.ru privatefx-in.ru
priora-2.com prlog.ru
privatamateure.com prod2016.com
privat-girl.net prostitutki-tolyatti.org
prizefestival.mobi psa48.ru
prizestohandle.club psvita.ru
profolan.pl pukaporn.com
progonrumarket.ru purplesphere.in
projectforte.ru push-ad.com
promover.org qexyfu.bugs3.com
proprostatit.com quangcaons.com
prosmibank.ru quickbuck.com
purplestats.com radiodigital.co
pussyfleet.com rarbg.to
pussysaga.com realresultslist.com
pxhdwsm.com recinziireale.com
qualitymarketzone.com
quick-seeker.com
ragecash.com
rank-checker.online
rapidsites.pro
rcb101.ru
rcpmda.ikan1080.xyz
realizmobi.com
recordpage-a.akamaihd.net recordpage-a.akamaihd.net
reklama-i-rabota.ru redirectme.net
remontgruzovik.ru redirlock.com
rentehno.ru refudiatethissarah.info
registratciya-v-moskve.ru
remontvsamare.su
responsinator.com
restorator-msk.ru restorator-msk.ru
retailwith.com rock-cafe.info
rewardpoll.com ru-dety.ru
rfd-split.hr runtnc.net
ricorsogiustizia.org rusexy.xyz
rn-to-bsn.com rus-pornuha.com
rogervivierforsale.com russkoe-zdorovie.ru
rospromtest.ru rustic-quiver.win
rukino.org sakhboard.ru
rusoft-zone.ru sammyweaver.com
saecsa.co saneitconsulting.com
sajatvelemeny.com sbricur.com
saneyes.com scenicmissouri.us
sanidumps.com search.pch.com
saratov.xrus.org secretscook.ru
sa-rewards.co.za seeresultshub-a.akamaihd.net
satellite.maps.ilovevitaly.com segol.tv
savefrom.com serialsway.ucoz.ru
sbprabooks.com sexphoto.site
scanner-alex.top sexsaoy.com
scanner-mary.top sexy.babes.frontend-stack.top
searchencrypt.com sexy-screen-savers.com
searchlock.com shlyahten.ru
seasaltwithfood.com shmetall.com.ua
semp.net simple-image.com.ua
seofied.com simple-share-buttons.com
sergiorossistore.online siteaero.com
serpstat.com sizeplus.work
service.adtech.us skytraf.xyz
se-welding.ru smsactivator.ru
sex-foto.pw social-buttons.xyz
sharebutton.net socialmadesimple.com
sherlock.se sockshare.net
shivafurnishings.com soietvousmaime.fr
sientalyric.co sonata-arctica.wz.cz
signx.info sotkal.lark.ru
silverage.ru space-worry.ml
simplepooltips.com speechfoodie.com
s-iwantyou.com spy-app.info
sixcooler.de stauga.altervista.org
sledstvie-veli.net steame.ru
slomm.ru strana-solnca.ru
socialbookmarksubmission.org strangeduckfilms.com
socialsignals24.com students-cheapskate.ml
sodexo.com superlist.biz
soft-program.com support.nopeas.sk
sogimlecal.tk surflinksmedical.com
soheavyblog.com
sonnikforme.ru
space4updating.win
spitfiremusic.com
sprttrack.com
spymac.net
stard.shop
stariy-baku.com
staynplay.net
steelmaster.lv
stockspmb.info
stoki.ru
streetfire.net
stretchingabuckblog.com
studiofmp.com
styro.ru
suggest-keywords.com
sukarame.net
summerlinhomes411.info
sundrugstore.com
svetlotorg.ru svetlotorg.ru
tabletkinaodchudzanie.com.pl swinginwithme.ru
tackletarts.co symphonyintegratedhealthcare.com
tattooha.com telefonsexi.com
techart24.com telegramdownload10.com
tedxrj.com theheroes.ru
thedownloadfreeonlinegames.blogspot.com thepokertimer.com
thepantonpractice.co.uk thetoiletpaper.com
tizanidinehydrochloride2mg.blogspot.com the-trader.net
tooplay.com threecolumnblogger.com
tootoo.to tizanidinehcl4mgtablet.blogspot.com
torrentdownloadhub.com tizanidineinfo.blogspot.com
truck-addzilla.life tizanidinerecreationaluse.blogspot.com
truemfilelj.gq tizanidinewithdrawalsymptoms.blogspot.com
tsyndicate.com tonerbox.kz
tula.mdverey.ru toonfamilies.net
tvteleport.ru topcar-krasnodar.ru
topdownloads.ru
tozup.com
traffictrade.life
tubeline.biz
tuberkuleznik.ru
tubo360.com
turizm.bz
turkeyreport.tk
twiclub.in
u17795.netangels.ru
uac.net.au uac.net.au
ua-company.ru uchetunet.su
um-razum.ru ugogo.info
underthesite.com
unitygame3d.com
uogonline.com
uptime-alpha.net
uptimechecker.com uptimechecker.com
uptime.com urlopener.com
ussearche.cf vabasa.inwtrade.com
v720hd.ru
vacuumscleaner.com
valoresito.com valoresito.com
vandrie-ict.nl
vavilone.com vavilone.com
velpanex.ru vellings.info
versaut.xxx-cam.webcam ventelnos.com
videochat.mx viagra.pp.ua
videokrik.net video-chat.cn
videospornogratisx.net videochat.life
videochaty.ru
videositename.com
vipms.ru
viteonlusarezzo.it
vizag.kharkov.ua
vkak.ru vkak.ru
voluumtrk.com vkontarkte.com
voprosotvet24.ru vostoktrade.info
vtc.pw vucms.com
vvpg.ru
vzlom-na-zakaz.com vzlom-na-zakaz.com
w3data.co walkme.com
warning.or.kr wallpapers-best.com
warningzscaler.heraeus.com watchmygf.net
waterefficiency.co waterefficiency.co
webpromotion.ae webcamdevochka.com
websiteaccountant.de webix.me
webstatsdomain.org webnode.me
wesharepics.info whatsappdownload10.com
whengirlsgowild.com whatsupinfoley.com
white-truck.life whereverdesperate.gq
wholinkstome.com wholesalejerseychinashop.com
wildworld.site wholesalejerseys-cheapest.com
wjgony.com witherrom55.eklablog.fr
wonderfulflowers.biz worldhistory.biz
wordkeyhelper.com worldtraveler.world
worst-sites.online www.event-tracking.com
wpthemedetector.co.uk wzgyyq.com
xboxster.ru
x-diesel.org x-diesel.org
xn----ctbbcjd3dbsehgi.xn--p1ai xgftnlrt.bloger.index.hr
xn----itbeirbjbi7bc6bh2d.xn--p1ai xn-----6kcaacnblni5c5bicdpcmficy.xn--p1ai
yaaknaa.info xn----7sbaphztdjeboffeiof6c.xn--p1ai
yellowstonevisitortours.com xn--80aaagvmjabrs1aoc9luc.xn--p1ai
youbloodyripper.com xn--80ahdheogk5l.xn--p1ai
xn--90acenikpebbdd4f6d.xn--p1ai
xn--d1abj0abs9d.in.ua
xn--e1afanlbnfckd7c3d.xn--p1ai
xnxx-n.com
xxxguitars.com
xxx-treker.ru
yogamatsexpert.com
youdao.com youdao.com
zahvat.ru youraticles.pl
zakonobosago.ru zigarettenonlinekaufen1.bloog.pl
zarabotok--doma.ru
zeroredirect10.com
zeroredirect6.com
zeroredirect8.com
zhorapankratov7.blogspot.com
znakomstvaonlain.ru znakomstvaonlain.ru
zvezdagedon.ru znakomstva-piter78.ru
zs2vm.top
zvetki.ru

472
.dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
00author.com 03p.info
300richmond.co.nz 12masterov.com
9icmzvn6.website 24-ak.ru
a96527gi.beget.tech 34.gs
adcash.com 4pp13.com
adelly.bg 4ur.click
adzerg.com 57883.net
adzpower.com 8si.ru
afftrack001.com 98oi.ru
akama.com aaronabel.com
akvamaster.dp.ua abtasty.com
allblogroll.com abusora.com
allesohnegirls.net adhome.biz
amazon-seo-service.com adminshop.com
analytics-ads.xyz adnotbad.com
andpolice.com adultwebhosting.info
apccargo.com aerogo.com
arvut.org agahinameh.com
autonew.biz aihelen.net
aviapanda.ru alarmobninsk.ru
avitocars.ru allstatesugarbowl.org
avtochehli.by amateurgalls.com
azartclub.org amyfoxfitness.com
babieca.com angel1777.kz
bagsonsale.online anime.dougasouko.com
bannerconnect.net aosexkontakte.net
bannertesting.com apidigidocketnet-a.akamaihd.net
barnfurnituremart.com apiitsthirteende-a.akamaihd.net
besthoro.ru apiportalmorecom-a.akamaihd.net
bibys.com arcadeplayhouse.com
bigcities.org arcteryxsale.online
artparquet.ru
aruplighting.com
avtolombard-krasnodar.ru
azbaseimages.net
babyfactory.fr
beauty-b0x.pl
bedcapdealers.com
bestbuy.ca
bestempresas.es
bingoporno.com bingoporno.com
bio-japan.net boeuklad.com
biznesrealnost.ru boltalko.xyz
bloglag.com brandedleadgeneration.com
board.f00d.de bristolhotel.com.ua
boazpower.com brokergid.ru
bonanza-fortune.men b-styles.xyz
brains2.biz buy-cheap-pills-order-online.com
brakehawk.com cakesplus.com.au
browsepulse-a.akamaihd.net carmuffler.net
btc4u.ru casablancamanor.co.za
buron.pw catalogs-parts.com
buy-loft.ru centrdebut.ru
buzz-porno.info checktext.org
cand.jp christianlouboutinsaleonline.us
casinorewards.info christianlouboutinsaleoutletonline.us
cezartabac.ro cialischsrx.com
chocolateslim-original.com cialischstgerts.com
citizenclsdriveri7.pen.io cmhomestayagency.com
cocyq.inwtrade.com compliance-walter.top
colobit.biz conboy.us
compliance-alex.top costablue.xyz
compliance-elena.top countbertwistdisp26.soup.io
compliance-julianna.top
computernetworksonline.com
concordexoticrentals.com
customerpromos-a.akamaihd.net
d2jsp.org
dailyrank.net dailyrank.net
descargar-musica-gratis.net davidovic.info
dev.citetick.com decorazilla.com
discountbarbour.online demenageur.com
dmmspy.com de.zapmeta.com
domainsphoto.com doctormakarova.ru
doska-vsem.ru dogbreedspicture.net
dostavka-v-krym.com dominterior.org
dumpsmania24.com eachdayisagift.review
easytuningshop.ru ekobata.ru
e-collantes.com election.interferencer.ru
educontest.net elite-sex-finders.com
elstal.com.pl emediate.eu
etenininrade.ga englishdictionaryfree.com
excitacao.com exlarseva.webblog.es
eyes-on-you.ga exportshop.us
ezigarettenshop2.postbit.com filerockstar298.weebly.com
failingmarriege.blogspot.com filesdatabase.net
family1st.ca firma-legion.ru
faptitans.com firstdrugmall.ru
feeriaclub.ru fitnesspiks.com
fickluder69.com
finejewelryshop.ru
floridamhca.org floridamhca.org
footbalive.org footbalive.org
forpostlock.ru
foto-telok.net foto-telok.net
foxydeal.com fotoxxxru.com
frcls.fr freeuploader.ml
freecamdollars.com frustrated-favorable.gq
freshsuperbloop.com fungamelands.com
fullfileaccess.com funponsel.com
fxgallery.com geckoandfly.com
fz139.ttk.ru goodhousekeeping.com
gagrasector.ru gotorussia.com
geileweiber.tk gratis-sexkontakte.com
generalporn.org greatdealshop.com
genetworx.com gsasearchengineranker.pw
golden-praga.ru gsbs.com.ua
goodprotein.ru guildebzh.info
growmyfunds.ca hamilton.ca
handicapbathtubarea.com hanink.biz.ly
healing-dysplasia.ru hasshe.com
hitmuzik.ru hdimagelib.com
hotblognetwork.com hdwalls.xyz
hotblog.top hidefiles.org
hotsocialz.com highland-homes.com
hully.altervista.org hoholikik.club
i4track.net hyipmanager.in
iccornacircri.cf ictizanidinehcl4mg.blogspot.com
iloveitaly.ru ifirestarter.ru
ilovevitaly.com imagine-ex.co
incomekey.net i-midias.net.br
iqs.biz.ua inbabes.sexushost.com
jacago.com inet-traffic.com
job.icivil.ir in-tandem.co
kino-fun.ru intellekt21.ru
kiprinform.com interfucks.net
klin3952.ru irkutsk.zrus.org
klumba55.ru ispaniya-costa-blanca.ru
knogg.net iwanttodeliver.com
krasivoe-hd.net janettabridal.com
krasnodar.zrus.org jav-fetish.com
javspace.net
jbl-charge.info
justkillingti.me
jyvopys.com
kanimage.com
kemerovo.zrus.org
krassh.ru krassh.ru
kwzf.net lacasamorett.com
larchik.net likesdesign.com
lifebyleese.com luckyshop.net.ua
limtu.ifmo.ru marketingtechniques.info
linkdebrideur.xyz mecash.ru
locationdesaison.com mhi-systems.ru
lomb.co
lomza.info
m1media.net
macdamaged.tech
masturbate.co.uk
maximilitary.ru
meccadumps.net
mediawhirl.net
microsearch.ru microsearch.ru
morocco-nomad-excursions.com microsoftportal.net
minyetki.ru
mockupui.com
moncleronline.xyz
monetizationking.net
monetizer.com-01.site
moneyviking-a.akamaihd.net
montredemarque.nl
mosrif.ru mosrif.ru
multgo.ru mybinaryoptionsrobot.com
muznachas-service.ru naturtreenspicerx.pw
mydeathspace.com networkad.net
myfreecams.com newstraveller.ru
mygameplus.com nfljerseysforsalewholesaler.com
myhitmp3.club
mylesosibirsk.ru
needtosellmyhousefast.com
net-radar.com
nhl09.ru
no-rx.info
november-lax.com november-lax.com
o.light.d0t.ru nvformula.ru
online-hit.info okel.co
online-sbank.ru okonich.com.ua
ontargetseo.us onblastblog.online
panouri-solare-acoperis.com onetravelguides.com
parajumpersoutlet.online ozas.net
pawli.eu panchro.xyz
phelissota.xyz pandarastore.top
picsearch.com partnerline.men
piski.top pflexads.com
piter.xrus.org photo-clip.ru
pivka.xyz picturesify.com
pk-services.ru polimga.pw
pl-vouchers.com pornolook.net
polybuild.ru postclass.com
popander.mobi powc.r.ca.d.sendibm2.com
portside.cc productarium.com
praisong.net proposal-engine.com
preg.marketingvici.com prosmibank.ru
presleycollectibles.com prostitutki-kiev.org
profit-opportunity.com prostitutki-odessa.org
prostitutki-astana.org
psoriasis-file.trade psoriasis-file.trade
razorweb-a.akamaihd.net qld10000.net
reckonstat.info radiodigital.co
remontbiz.ru redirectingat.com
rentehno.ru remedyotc.com
rep-am.com rfid-locker.co
revistaindustria.com roma-kukareku.livejournal.com
rospromtest.ru rozalli.com
sabizonline.com ruex.org.ua
sakhboard.ru russintv.fr
savefrom.com scanner-brian.top
sbornik-zakonov.ru searchengineranker.email
scenicmissouri.us search-goo.com
sc-specialhost.com segol.tv
secret.xn--oogle-wmc.com seminarykansas904.ml
seofirmreviewsus.info seofirmreviewsus.info
sexystrippe.info seo-platform.com
shemale-sex.net sexkrasivo.net
shisha-swag.de shodanhq.com
sivs.ru shopvilleroyboch.com.ua
shymkent.xkaz.org
skachat-besplatno-obrazcy.ru
skladvaz.ru
skylta.com
skypasss.com
slkrm.ru slkrm.ru
smartadserver.com smailik.org
spaceshipad.com social-vestnik.ru
spravka-medosmotr.ru sortthemesitesby.com
stpolice.com spbchampionat.ru
stroicol.net srgwebmail.nl
stroyplus.ru stackthatbucks.com
sukarame.net statoutlook.info
surfbuyermac.com steamoff.net
tasteidea.com students-cheapskate.ml
tattoo33.ru superkanpo.com
tds-advert002.info supermama.top
thetardistimes.ovh swinon.site
tizanidinepills.blogspot.com taraz.xkaz.org
toloka.hurtom.com tattooreligion.ru
tonerbox.kz td-33.ru
topcar-krasnodar.ru tedxrj.com
tracksurf.daooda.com thebitcoincode.com
traffic100.com thebluenoodle.com
traffpartners.com thecounter.com
trahic.ru theendivechronicles.com
trichizobswiv.agddns.net tizanidinesleepaid.blogspot.com
trkdf.com top1-seo-service.com
trkur.com tuckpointingmasonrysystems.com
tubeline.biz twiclub.in
tvoystartup.ru udayavani.com
uchil.net umaseh.com
ugogo.info undergroundcityphoto.com
unpredictable.ga unpredictable.ga
uptimechecker.com uytmaster.ru
uptime-gamma.net valsalud.com
usiad.net vapomnoncri.tk
vegan-foods.us venerologiya.com
ventelnos.com vkonche.com
vesnatehno.com vltai.com
vip.51.la vote-up.ru
vipsiterip.org waycash.net
visa-pasport.ru webjam.com
wallpapersdesk.info webnode.me
watchdogs-2.ru weclipart.com
websites-reviews.com weprik.ru
webtherapy.ru wikes.20fr.com
wemarketing.se x-diesel.org
wingsoffury2.com xn--d1aifoe0a9a.top
woweb.com.ua
xn--1-8sbcpb0bdm8k6a.xn--p1ai
xn-----7kceclhb4abre1b4a0ccl2fxch1a.xn--p1ai
xn----dtbndd4ae7eub.top xn----dtbndd4ae7eub.top
zaim-pod-zalog-krasnodar.ru yougame.biz
zdesformula.ru yougotanewdomain.com
zed21.net yubikk.info
zeroredirect.com zaidia.xhost.ro
znakomstva-moskva77.ru zarenica.net
znaturaloriginal.com zs2vm.top
zoogdiesney.com
zryydi.com
zvetki.ru

35
.dev-tools/test_units/ratelimittest-beta.txt
View file

@ -1,13 +1,11 @@
<!DOCTYPE html> <html>
<html> <head><title>503 Service Temporarily Unavailable</title></head>
<head> <body>
<title>Welcome to NginX</title> <center><h1>503 Service Temporarily Unavailable</h1></center>
</head> <hr><center>nginx/1.16.1</center>
<body> </body>
<div align=center> </html>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> ody>
<p>This is merely used for testing !!!</p>
</body>
</html><html> </html><html>
<head><title>503 Service Temporarily Unavailable</title></head> <head><title>503 Service Temporarily Unavailable</title></head>
<body> <body>
@ -484,13 +482,6 @@
<hr><center>nginx/1.16.1</center> <hr><center>nginx/1.16.1</center>
</body> </body>
</html> </html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.16.1</center>
</body>
</html>
<!DOCTYPE html> <!DOCTYPE html>
<html> <html>
<head> <head>
@ -581,4 +572,14 @@
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html> </html>

115
.dev-tools/test_units/ratelimittest-master.txt
View file

@ -426,62 +426,65 @@ ody>
<hr><center>nginx/1.16.1</center> <hr><center>nginx/1.16.1</center>
</body> </body>
</html> </html>
<html> <!DOCTYPE html>
<head><title>503 Service Temporarily Unavailable</title></head> <html>
<body> <head>
<center><h1>503 Service Temporarily Unavailable</h1></center> <title>Welcome to NginX</title>
<hr><center>nginx/1.16.1</center> </head>
</body> <body>
</html> <div align=center>
<html> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<head><title>503 Service Temporarily Unavailable</title></head> <p>This is merely used for testing !!!</p>
<body> </body>
<center><h1>503 Service Temporarily Unavailable</h1></center> </html><html>
<hr><center>nginx/1.16.1</center> <head><title>503 Service Temporarily Unavailable</title></head>
</body> <body>
</html> <center><h1>503 Service Temporarily Unavailable</h1></center>
<html> <hr><center>nginx/1.16.1</center>
<head><title>503 Service Temporarily Unavailable</title></head> </body>
<body> </html>
<center><h1>503 Service Temporarily Unavailable</h1></center> <html>
<hr><center>nginx/1.16.1</center> <head><title>503 Service Temporarily Unavailable</title></head>
</body> <body>
</html> <center><h1>503 Service Temporarily Unavailable</h1></center>
<html> <hr><center>nginx/1.16.1</center>
<head><title>503 Service Temporarily Unavailable</title></head> </body>
<body> </html>
<center><h1>503 Service Temporarily Unavailable</h1></center> <html>
<hr><center>nginx/1.16.1</center> <head><title>503 Service Temporarily Unavailable</title></head>
</body> <body>
</html> <center><h1>503 Service Temporarily Unavailable</h1></center>
<html> <hr><center>nginx/1.16.1</center>
<head><title>503 Service Temporarily Unavailable</title></head> </body>
<body> </html>
<center><h1>503 Service Temporarily Unavailable</h1></center> <html>
<hr><center>nginx/1.16.1</center> <head><title>503 Service Temporarily Unavailable</title></head>
</body> <body>
</html> <center><h1>503 Service Temporarily Unavailable</h1></center>
<html> <hr><center>nginx/1.16.1</center>
<head><title>503 Service Temporarily Unavailable</title></head> </body>
<body> </html>
<center><h1>503 Service Temporarily Unavailable</h1></center> <html>
<hr><center>nginx/1.16.1</center> <head><title>503 Service Temporarily Unavailable</title></head>
</body> <body>
</html> <center><h1>503 Service Temporarily Unavailable</h1></center>
<html> <hr><center>nginx/1.16.1</center>
<head><title>503 Service Temporarily Unavailable</title></head> </body>
<body> </html>
<center><h1>503 Service Temporarily Unavailable</h1></center> <html>
<hr><center>nginx/1.16.1</center> <head><title>503 Service Temporarily Unavailable</title></head>
</body> <body>
</html> <center><h1>503 Service Temporarily Unavailable</h1></center>
<html> <hr><center>nginx/1.16.1</center>
<head><title>503 Service Temporarily Unavailable</title></head> </body>
<body> </html>
<center><h1>503 Service Temporarily Unavailable</h1></center> <html>
<hr><center>nginx/1.16.1</center> <head><title>503 Service Temporarily Unavailable</title></head>
</body> <body>
</html> <center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.16.1</center>
</body>
</html>
<!DOCTYPE html> <!DOCTYPE html>
<html> <html>
<head> <head>

2
.dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
34.66.178.120 0; 35.184.226.236 0;
127.0.0.1 0; 127.0.0.1 0;

BIN
.latest_release/bots.d.tar.gz
View file

Binary file not shown.

BIN
.latest_release/conf.d.tar.gz
View file

Binary file not shown.

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2019.10.1878 #### Version: V4.2019.10.1879
#### Bad Referrers Blocked: [6782](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [6782](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [562](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [562](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [214](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [214](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2019.10.1878 #### Version: V4.2019.10.1879
#### Bad Referrers Blocked: [6782](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [6782](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [562](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [562](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [214](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [214](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -11,7 +11,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2019.10.1878 #### Version: V4.2019.10.1879
#### Bad Referrers Blocked: [6782](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [6782](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [562](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [562](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [214](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [214](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

928
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2019.10.1878 #### Version: V4.2019.10.1879
#### Bad Referrers Blocked: [6782](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [6782](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [562](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [562](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [214](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [214](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

932
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

932
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

932
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2019.10.1878 ### Version: V4.2019.10.1879
### Updated: Fri Oct 25 20:44:38 SAST 2019 ### Updated: Sun Oct 27 20:44:10 SAST 2019
### Bad Bot Count: 562 ### Bad Bot Count: 562
################################################### ###################################################
### Version Information ## ### Version Information ##