vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-05 20:20:02 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2021.06.2371 [ci skip]

Browse source
This commit is contained in:
Travis 2021-06-05 13:55:06 +02:00
parent e211267f67
commit 84a887a962
47 changed files with 80528 additions and 80506 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

1
.dev-tools/_robots_input/robots-input.txt
View file

@ -439,6 +439,7 @@ Seomoz
SEOprofiler SEOprofiler
seoscanners seoscanners
SeoSiteCheckup SeoSiteCheckup
seostar
SEOstats SEOstats
serpstatbot serpstatbot
sexsearcher sexsearcher

8831
.dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

8831
.dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

8831
.dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

1
.dev-tools/beta_conf_files_whitelist/bots.d/blacklist-user-agents.conf
View file

@ -500,6 +500,7 @@
"~*(?:\b)SEOprofiler(?:\b|)" 0; "~*(?:\b)SEOprofiler(?:\b|)" 0;
"~*(?:\b)seoscanners(?:\b|)" 0; "~*(?:\b)seoscanners(?:\b|)" 0;
"~*(?:\b)SeoSiteCheckup(?:\b|)" 0; "~*(?:\b)SeoSiteCheckup(?:\b|)" 0;
"~*(?:\b)seostar(?:\b|)" 0;
"~*(?:\b)SEOstats(?:\b|)" 0; "~*(?:\b)SEOstats(?:\b|)" 0;
"~*(?:\b)serpstatbot(?:\b|)" 0; "~*(?:\b)serpstatbot(?:\b|)" 0;
"~*(?:\b)sexsearcher(?:\b|)" 0; "~*(?:\b)sexsearcher(?:\b|)" 0;

8831
.dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

8831
.dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

8831
.dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
.dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
34.122.173.211 0; 104.154.182.187 0;

8831
.dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
.dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
104.154.182.187 1; 34.122.208.80 1;
127.0.0.1 1; 127.0.0.1 1;

2
.dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
104.154.182.187 0; 34.122.208.80 0;
127.0.0.1 0; 127.0.0.1 0;

8831
.dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
.dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
104.154.182.187 1; 34.122.208.80 1;
127.0.0.1 1; 127.0.0.1 1;

2
.dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
104.154.182.187 0; 34.122.208.80 0;
127.0.0.1 0; 127.0.0.1 0;

8831
.dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
.dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
104.154.182.187 1; 34.122.208.80 1;
127.0.0.1 1; 127.0.0.1 1;

1
.dev-tools/test1_conf_files_whitelist/bots.d/blacklist-user-agents.conf
View file

@ -500,6 +500,7 @@
"~*(?:\b)SEOprofiler(?:\b|)" 0; "~*(?:\b)SEOprofiler(?:\b|)" 0;
"~*(?:\b)seoscanners(?:\b|)" 0; "~*(?:\b)seoscanners(?:\b|)" 0;
"~*(?:\b)SeoSiteCheckup(?:\b|)" 0; "~*(?:\b)SeoSiteCheckup(?:\b|)" 0;
"~*(?:\b)seostar(?:\b|)" 0;
"~*(?:\b)SEOstats(?:\b|)" 0; "~*(?:\b)SEOstats(?:\b|)" 0;
"~*(?:\b)serpstatbot(?:\b|)" 0; "~*(?:\b)serpstatbot(?:\b|)" 0;
"~*(?:\b)sexsearcher(?:\b|)" 0; "~*(?:\b)sexsearcher(?:\b|)" 0;

2
.dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
104.154.182.187 0; 34.122.208.80 0;
127.0.0.1 0; 127.0.0.1 0;

8831
.dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

4
.dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,5 +45,5 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
104.154.182.187 0; 35.193.184.18 0;
34.122.208.80 0; 34.122.173.211 0;

8831
.dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
.dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,5 +45,5 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
34.122.173.211 0; 35.193.184.18 0;
104.154.182.187 0; 104.154.182.187 0;

8831
.dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

1
.dev-tools/test4_conf_files/bots.d/whitelist-ips.conf
View file

@ -46,5 +46,4 @@
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
34.122.173.211 0; 34.122.173.211 0;
104.154.182.187 0;
34.122.208.80 0; 34.122.208.80 0;

8831
.dev-tools/test4_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
.dev-tools/test5_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,5 +45,5 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
104.154.182.187 0;
35.193.184.18 0; 35.193.184.18 0;
34.122.208.80 0;

8831
.dev-tools/test5_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

1
.dev-tools/test_units/blacklist-user-agents.conf
View file

@ -500,6 +500,7 @@
"~*(?:\b)SEOprofiler(?:\b|)" 0; "~*(?:\b)SEOprofiler(?:\b|)" 0;
"~*(?:\b)seoscanners(?:\b|)" 0; "~*(?:\b)seoscanners(?:\b|)" 0;
"~*(?:\b)SeoSiteCheckup(?:\b|)" 0; "~*(?:\b)SeoSiteCheckup(?:\b|)" 0;
"~*(?:\b)seostar(?:\b|)" 0;
"~*(?:\b)SEOstats(?:\b|)" 0; "~*(?:\b)SEOstats(?:\b|)" 0;
"~*(?:\b)serpstatbot(?:\b|)" 0; "~*(?:\b)serpstatbot(?:\b|)" 0;
"~*(?:\b)sexsearcher(?:\b|)" 0; "~*(?:\b)sexsearcher(?:\b|)" 0;

20
.dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
CyotekWebCopy BuiltWith
DBLBot GrabNet
lwp-trivial LinkScan
Mata Hari Lmspider
meanpathbot Musobot
OrangeBot Netcraft
Pandalytics ReGet
SMTBot SeobilityBot
URLy.Warning Shodan
WBSearchBot WebmasterWorldForumBot

300
.dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
01h4x.com 01h4x.com
360Spider Abonti
404checker Acunetix
80legs
Aboundexbot
ADmantX ADmantX
AfD-Verbotsverfahren AfD-Verbotsverfahren
AIBOT AhrefsBot
AiHitBot AllSubmitter
Alexibot Anarchie
AlphaBot Anarchy99
Ankit
Anthill
archive.org_bot
arquivo.pt arquivo.pt
arquivo-web-crawler
ASPSeek ASPSeek
Asterias
Attach Attach
AwarioRssBot autoemailspider
Backlink-Ceck AwarioSmartBot
BacklinkCrawler BacklinkCrawler
BackWeb BackWeb
Barkrowler
Battleztar Bazinga
BBBike BBBike
BDFetch
BetaBot BetaBot
BlackWidow Bigfoot
Blow Boardreader
BotALot Bolt
Brandwatch Calculon
BuiltBotTough
Bullseye
BunnySlippers
BuzzSumo
CATExplorador CATExplorador
CCBot CheTeam
check1.exe
Claritybot
Cloud mapping Cloud mapping
coccocbot-web CODE87
Cogentbot
cognitiveseo cognitiveseo
Collector
com.plumanalytics
Copyscape
Cosmos
crawler4j crawler4j
crawl.sogou.com crawler.feedback
CSHttp Crescent
Curious DatabaseDriverMysqli
CyotekWebCopy DBLBot
DataCha0s Deusu
demandbase-bot Discobot
DigitalPebble
Dirbuster
Disco
Discoverybot Discoverybot
DomainCrawler DittoSpyder
DomainSigmaCrawler DomainAppender
Domains Project Domains Project
DomainStatsBot
DomCopBot
Dotbot
Dragonfly Dragonfly
DSearch DSearch
DTS Agent EasyDL
Ebingbong Ebingbong
EirGrabber ECCP/1.0
EMail Siphon Ecxi
EMail Wolf
Evil
Exabot Exabot
ExtractorPro Express WebPictures
ExtLinksBot
Extreme Picture Finder Extreme Picture Finder
EyeNetIE EyeNetIE
facebookscraper facebookscraper
FHscan FemtosearchBot
FlashGet Fimap
Flunky Fuzz
Foobot Fyrebot
Freeuploader
GalaxyBot GalaxyBot
G-i-g-a-b-o-t Genieo
gopher Getintent
Gigabot
GoZilla
Go!Zilla Go!Zilla
GrapeshotCrawler GrabNet
GridBot Harvest
HEADMasterSEO
Heritrix Heritrix
Hloader Hloader
HTMLparser HMView
HybridBot HTTP::Lite
Iblog Iblog
IDBot IDBot
IDBTE4M Image Fetch
Id-search InfoNaviRobot
IlseBot InfoTekies
Image Sucker
Intelliseek Intelliseek
Internet Ninja
internetVista monitor internetVista monitor
Iria ips-agent
IstellaBot JikeSpider
Jbrofuzz
Jetty
JOC Web Spider JOC Web Spider
JustView Joomla
Jyxobot Jorgee
Kenjin Spider Keyword Density
LeechGet Larbin
LibWeb LeechFTP
LexiBot
Lftp
Lightspeedsystems Lightspeedsystems
Likse Likse
Linkbot Linkbot
Linkdexbot Linkdexbot
LinkextractorPro
LinkpadBot
LinkScan LinkScan
LinkWalker LinkWalker
LinqiaMetadataDownloaderBot LinqiaRSSBot
Lipperhey Lipperhey
Ltx71 Lipperhey Spider
Litemage_walker
Lmspider
LWP::Simple
lwp-trivial
Magnet Magnet
Mag-Net
Majestic12 Majestic12
Majestic-SEO Majestic-SEO
MarkMonitor
MarkWatch MarkWatch
Mass Downloader Mata Hari
MauiBot meanpathbot
Mediatoolkitbot MegaIndex.ru
mediawords MIDown tool
MFC_Tear_Sample
MicroMessenger
Microsoft URL Control
Mister PiX
MJ12bot
Moblie Safari
Mojeek Mojeek
Mojolicious Morfeus Fucking Scanner
Mozlila MQQBrowser
Mr.4x3
MSIECrawler
Msrabot
MTRobot MTRobot
Musobot
Name Intelligence Name Intelligence
NearSite Nameprotect
Nessus Navroad
NetLyzer
NetMechanic
Nettrack Nettrack
Net Vampire
Netvibes Netvibes
NetZIP NextGenSearchBot
Nibbler
NICErsPRO NICErsPRO
Niki-bot NimbleCrawler
Nutch oBot
Offline Navigator
OnCrawl OnCrawl
OrangeBot OpenVAS
OPPO A33
OrangeSpider
OutclicksBot
PageAnalyzer PageAnalyzer
Page Analyzer PageGrabber
page scorer PageThing.com
Pandalytics Panscient
Pavuk Pavuk
pcBrowser
PECL::HTTP PECL::HTTP
Petalbot PeoplePal
PHPCrawl PHPCrawl
Picscout Picscout
Picsearch Picsearch
Pi-Monster
Pixray
PleaseCrawl
plumanalytics plumanalytics
POE-Component-Client-HTTP polaris version
probe-image-size
ProPowerBot ProPowerBot
Psbot
Pu_iN
Pump Pump
PxBroker PxBroker
PyCurl PyCurl
QueryN Metasearch QueryN Metasearch
RankActive RankingBot
RankActiveLinkBot
RankFlex
RankingBot2
RebelMouse
RedesScrapy
ReGet
RepoMonkey RepoMonkey
Re-re
ripz ripz
Rogerbot
s1z.ru s1z.ru
SalesIntelligent SBIder
satoristudio.net
Scanbot
ScoutJet ScoutJet
Scrapy Scrapy
ScreenerBot ScreenerBot
SearchmetricsBot Semrush
SemrushBot
SentiBot
seobility seobility
SeobilityBot SeobilityBot
SEOkicks-Robot SEOkicks-Robot
SEOlyticsCrawler
Seomoz
SEOprofiler SEOprofiler
seoscanners seoscanners
Siphon
SISTRIX
Sitebeam
SiteCheckerBotCrawler SiteCheckerBotCrawler
SiteLockSpider sitechecker.pro
SiteSnagger Siteimprove
SiteSucker
Site Sucker Site Sucker
SmartDownload Sitevigil
Snake Snake
Snapbot
SocialRankIOBot SocialRankIOBot
Sogou web spider Sogou web spider
SpaceBison
SpankBot
Spanner
Spbot Spbot
Sqlworm SputnikBot
Sqworm Sqlmap
SuperHTTP Steeler
sysscan Stripper
SurveyBot
Swiftbot
Szukacz Szukacz
Teleport Teleport
Telesphoreo Telesphoreo
TheNomad Titan
TightTwatBot
Trendiction Trendiction
Trendictionbot
trendiction.com
trendiction.de
Turingos
Turnitin Turnitin
Typhoeus Twice
Upflow URLy.Warning
URLy Warning
Vagabondo Vagabondo
VeriCiteCrawler
Virusdie Virusdie
Voltron Voil
Wallpapers/3.0 WallpapersHD
WBSearchBot WBSearchBot
Web Collage Web Auto
WebBandit
WebCollage
WebCopier WebCopier
Web Enhancer WebLeacher
Web Fuck
WebmasterWorldForumBot WebmasterWorldForumBot
webmeup-crawler WebSauger
WebPix
Web Pix
Webshag Webshag
WebsiteExtractor WebsiteExtractor
Website Quester
Web Sucker
WebWhacker WebWhacker
WebZIP WebZIP
WeSEE WeSEE
Whack Whack
Whacker Whacker
Whatweb Who.is Bot
Widow Widow
WISENutbot WinHTTrack
Wonderbot WiseGuys Robot
Wotbox Wprecon
WWW-Collector-E WPScan
WWW::Mechanize WWW-Mechanize
Xenu WWWOFFLE
Xaldon_WebSpider
xpymep1.exe xpymep1.exe
Zauba zauba.io
Zeus
zgrab
Zitebot Zitebot
ZoomBot ZmEu
ZoominfoBot
ZumBot ZumBot
ZyBorg

284
.dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
01h4x.com
404enemy 404enemy
80legs 80legs
AfD-Verbotsverfahren
AIBOT
AiHitBot
Aipbot Aipbot
Alexibot
Alligator Alligator
AlphaBot AlphaBot
Anarchie Anarchie
Anarchy
Ankit Ankit
Anthill Apexoo
archive.org_bot Aspiegel
ASPSeek ASPSeek
Attach Asterias
AwarioRssBot Barkrowler
BackDoorBot
backlink-check
Badass
BBBike
BDCbot BDCbot
BDFetch BDFetch
Bitacle Bitacle
Blackboard Blackboard
BLEXBot
Bolt
Brandwatch
Buck
Buddy Buddy
BuiltBotTough
BunnySlippers BunnySlippers
BuzzSumo BuzzSumo
CATExplorador Calculon
CazoodleBot
Cegbfeieh Cegbfeieh
check1.exe CheeseBot
CherryPicker
ChinaClaw ChinaClaw
Chlooe
Claritybot
Cliqzbot Cliqzbot
coccocbot-web CODE87
com.plumanalytics com.plumanalytics
Copier
Copyscape
Cosmos Cosmos
crawler.feedback Craftbot
CSHttp crawler4j
CrazyWebCrawler
Custo Custo
CyotekWebCopy CyotekWebCopy
Deusu DBLBot
Demon
Digincore Digincore
DigitalPebble
DIIbot DIIbot
Dirbuster
Disco Disco
DittoSpyder Discoverybot
DomainStatsBot DomainCrawler
DomainSigmaCrawler
Dotbot Dotbot
DTS Agent eCatch
EasyDL Ecxi
ECCP/1.0 EirGrabber
ExtractorPro evc-batch
Evil
Exabot
Express WebPictures
ExtLinksBot
Extractor
Extreme Picture Finder Extreme Picture Finder
facebookscraper FDM
FemtosearchBot FlashGet
Flunky
Foobot Foobot
FrontPage Fuzz
GalaxyBot FyberSpider
Genieo Fyrebot
Getintent Getintent
Gotit GetRight
GoZilla Gigablast
Grafula G-i-g-a-b-o-t
GrapeshotCrawler GrapeshotCrawler
GT::WWW
HaosouSpider HaosouSpider
heritrix Havij
HEADMasterSEO
Hloader Hloader
HMView HTTrack
HTTP::Lite HybridBot
Humanlinks Iblog
IDBot
IDBTE4M IDBTE4M
IlseBot Id-search
Image Sucker Image Fetch
InfoNaviRobot
InfoTekies InfoTekies
instabid Intelliseek
Iria InternetSeer
IRLbot internetVista monitor
ips-agent
isitwp.com isitwp.com
IstellaBot
JennyBot
Jetty Jetty
JOC Web Spider
Joomla Joomla
JustView
Kenjin Spider Kenjin Spider
Keyword Density Keyword Density
Kinza Kozmosbot
Lanshanbot Lanshanbot
Larbin LeechFTP
LeechGet Linkdexbot
LexiBot LinkWalker
Lftp LinqiaMetadataDownloaderBot
LieBaoFast
Lightspeedsystems
Likse
Linkbot
LinkextractorPro
LinksManager
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey
Litemage_walker Litemage_walker
Lmspider LNSpiderguy
lwp-trivial Ltx71
Majestic12 Mag-Net
Mail.RU_Bot
Majestic SEO
Majestic-SEO Majestic-SEO
MarkMonitor MarkMonitor
MarkWatch Mb2345Browser
Mass Downloader
meanpathbot
MeanPath Bot
Mediatoolkitbot Mediatoolkitbot
mediawords
MegaIndex.ru MegaIndex.ru
Metauri
MFC_Tear_Sample MFC_Tear_Sample
MicroMessenger MicroMessenger
Microsoft Data Access Microsoft Data Access
MIDown tool Mister PiX
MIIxpc
Moblie Safari
MQQBrowser MQQBrowser
Mr.4x3 Nameprotect
MSFrontPage
muhstik-scan
Navroad Navroad
NearSite NearSite
netEstate NE Crawler Needle
Nessus
NetLyzer
Netvibes
NetZIP NetZIP
NICErsPRO Niki-bot
NimbleCrawler
Ninja Ninja
NPbot
Nutch Nutch
oBot oBot
Offline Navigator Offline Navigator
OnCrawl
Openfind Openfind
Openvas Openvas
OPPO A33 OpenVAS
OutclicksBot OrangeSpider
OutfoxBot
Page Analyzer Page Analyzer
page scorer page scorer
PageThing.com PageScorer
Pandalytics Pandalytics
Papa Foto Papa Foto
pcBrowser Pavuk
PECL::HTTP
Petalbot Petalbot
PHPCrawl
Picscout
Picsearch Picsearch
Pimonster
Pixray Pixray
plumanalytics plumanalytics
POE-Component-Client-HTTP Pockey
probe-image-size probe-image-size
Probethenet Probethenet
ProWebWalker ProWebWalker
Psbot Psbot
Pu_iN Pu_iN
PxBroker Pump
PyCurl
QueryN Metasearch QueryN Metasearch
RankingBot RankActiveLinkBot
RankurBot Reaper
RebelMouse RebelMouse
RedesScrapy RedesScrapy
RepoMonkey Re-re
Ripper Ripper
ripz ripz
RocketCrawler
RSSingBot RSSingBot
SBIder s1z.ru
Scanbot SalesIntelligent
ScoutJet satoristudio.net
Scrapy Semrush
ScreenerBot
seobility seobility
SEOkicks SEOkicks
SEOlyticsCrawler Seomoz
SEOprofiler
seoscanners seoscanners
SeoSiteCheckup SeoSiteCheckup
serpstatbot SEOstats
SISTRIX sexsearcher
Shodan
Sitebeam Sitebeam
SiteExplorer sitechecker.pro
SiteLockSpider SiteLockSpider
Sitevigil SlySearch
SMTBot SmartDownload
Snapbot Snake
SocialRankIOBot Snoopy
Sosospider Sociscraper
sogouspider
Sogou web spider
Spammen
Spanner Spanner
Spbot sp_auditbot
Spinn3r
Sqworm Sqworm
Steeler Steeler
Stripper Stripper
Sucker
SuperHTTP SuperHTTP
Suzuran Surfbot
SurveyBot
Swiftbot Swiftbot
sysscan
Szukacz Szukacz
T8Abot T0PHackTeam
Telesphoreo tAkeOut
Teleport
Telesoft
Telesphorep
The Intraformant
TheNomad
Thumbor
Titan
Toata Toata
Toweyabot
Tracemyfile Tracemyfile
Trendiction Trendiction
trendiction.com True_Robot
TurnitinBot Turnitin
TwengaBot
Twice Twice
VelenPublicWebCrawler UnisterBot
URLy Warning
Vagabondo
VB Project
VCI
VeriCiteCrawler VeriCiteCrawler
VidibleScraper
Virusdie
Voil Voil
WASALive-Bot Wallpapers/3.0
WBSearchBot
Webalta
WebAuto WebAuto
Web Auto
WebBandit
Web Collage Web Collage
WEBDAV
WebFetch
Web Fetch
WebFuck WebFuck
WebImageCollector WebLeacher
Web Pix Web Pix
WebReaper WebReaper
Webshag Web Sauger
WebsiteQuester
Website Quester
Webster
WebStripper
Whack Whack
Whacker Whatweb
Who.is Bot Widow
WinHTTrack WinHTTrack
WiseGuys Robot WiseGuys Robot
Wonderbot
Wotbox
Wprecon Wprecon
WWW-Mechanize WWWOFFLE
x22Mozilla Xenu
Xaldon WebSpider
xpymep1.exe xpymep1.exe
Zauba YoudaoBot
Zermelo zauba.io
Zeus
zgrab zgrab
Zitebot Zitebot
ZoomBot
ZyBorg

20
.dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
artavenuegardenstudios.com dekoration.us
dildofotzen.net eluxer.net
gq-catalog.gq goblacked.com
huimin764128.com golmau.host.sk
keyword-suggestions.com macdamaged.space
modnie-futbolki.net meltwater.com
panchro.xyz onstrapon.purplesphere.in
tuberkulezanet.ru ourtherapy.ru
uac.net.au tiandeural.ru
worst-sites.online whatistizanidine2mg.blogspot.com

924
.dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
00author.com 1000n1.ru
03p.info
101raccoon.ru
12u.info 12u.info
1flag.co.za 1kinobig.ru
2345.com 300richmond.co.nz
256bit.by 45en.ru
2728fb936f0.com 5000-cotydzien.com
3w24.com 51.la
4kplayer.pl 999webdesign.com
5i2.net aac500b7a15b2646968f6bd8c6305869d7.com
888.com aasoldes.fr
8kisses.eu absolute-s.ru
8lufu.com adconscious.com
aad1f4acb0a373420d9b0c4202d38d94fa.com adtech.de
abcguru.xyz aerogo.com
accessoires-mode.in affrh2015.com
actionnooz.com alert-jdh.xyz
adclickservice.com aliexpresscashback.club
adclickthru.net alkoravto.ru
admeasures.com allbizne.co.ua
adobereader-free.ru allcredits.su
adrenalin-stk.ru allmarketsnewdayli.gdn
adssafeprotected.com allornamenti.com
ads-seo.men allstatesugarbowl.org
adultwebhosting.info
adviceforum.info
adzpower.com
agahinameh.com
airmaxshoes-2016.com
alfabot.xyz
allnews.md
alpinism.ru
altamayoztourism.com
am15.net am15.net
amazingpic.net amoi.tn
anal-acrobats.com anaksma.info
ananumous.ru anime.dougasouko.com
angkortours.vn anlimebel.kiev.ua
anonymizeme.pro apiadanaknet-a.akamaihd.net
apilinkswiftco-a.akamaihd.net apimegabrowsebiz-a.akamaihd.net
apioasisspacenet-a.akamaihd.net apimossnetinfo-a.akamaihd.net
apiportalmorecom-a.akamaihd.net appearance-cool.com
appfastplay.com arenanews.com.ua
apple.com-webbrowsing-security.science
arendatora.ru arendatora.ru
arenda-yeisk.ru artdeko.info
arendovalka.xyz asociatia-tipografilor-transilvania.ro
artel116.ru audiofree.ru
asscenihotosidea.blogspot.co.za auto-moto-elektronika.cz
atlasvkusov.ru auto.rusvile.lt
ausergrubhof.info autowebmarket.com.ua
aussie-prizes.com aviav.eu
autodo.info avkzarabotok.com
autonew.biz
autoua.top
aviav.org
avon-ukraine.com avon-ukraine.com
azarttoto.com ayodhya.co
babyguns.ru azadnegar.com
bannerconnect.net azartmix.com
bestimagecoollibrary.com azazu.ru
betshuckclean.com azbaseimages.net
bharatdefencekavach.com azbukadiets.ru
bidbuy.co.kr b2b-lounge.com
binomo.com badavit.com.ua
bitnote.co bankmib.ru
biznesluxe.ru bard-real.com.ua
blackbabesporn.com battlecarnival.su
blacktwhite.com bcmp.org
blackwitchcraft.ru begalka.xyz
blavia.00author.com berdasovivan.ru
blogig.org bestofupload.info
bmsco.co best-seo-software.xyz
bmw.afora.ru bezcmexa.ru
boleznikogi.com bibys.com
bonux.nextview.ru bildsuche.ru
braip.com.br billiard-classic.com.ua
brendbutik.ru bin-brokers.com
businesn.men bjgugu.net.ua
buyessay3.blogspot.ru blackplanet.com
buyessayonline19.blogspot.ru blog.axant.it
blog.yam.com
bobba.dzaba.com
bonanza-fortune.men
bonkers.name
bracketsmackdown.com
bravegirlsclub.com
butstrap.space
buyantiviralwp.com
buyscabiescream.com
buytizanidineonline.blogspot.com buytizanidineonline.blogspot.com
cacheimages.com callawaygolfstore.online
canoncdriverq3.pen.io calvet.altervista.org
capacitacionyaprendizaje.com candiceloves.us
cardul.ru canrioloadm.gq
cartierreplica.pw canzoni.ru
castingbank.ru cartierring.xyz
cb.iphantom.com ccjp.eu
cfsrating.sonicwall.com cenokos.ru
chcu.net cenoval.ru
cheapestjerseys-wholesale.com checkm8.com
chimiver.info check-this-out-now.online
choice-credit.ru christianlouboutinsaleoutletonline.us
chuckguilford.com cialischsrx.com
cialisovercounteratwalmartusa.com cinemaflix.website
cigarpass.com cjs.com.ru
compliance-barak.top clickcash.com
clknsee.com
compliance-andrew.xyz
compliance-checker-7.info
compliance-donald.xyz compliance-donald.xyz
compliance-fred.top compucelunlock.net
consorzioilmosaico.org connectingsingles.com
copblock.org cornerstone-countertops.com
covid-schutzmasken.de cornomase.win
dalavia.ru cottageofgrace.com
damasarenai.info counter.yadro.ru
darodar.com crd.clan.su
data1.scopich.com culad.com
dbmkfhqk.bloger.index.hr custodieva.ru
dealwifi.com customerguru.in
delta-line.men cyprusbuyproperties.com
discountliv.com czeshop.info
dktr.ru darkages.info
doctissimo.fr darkbooks.org
domainsphoto.com dataloading.net
domini.cat dealitright.click
domznaniy.ru demon-tweeks.com
dostavimvdom.ru derevesendeco.com
doxyporno.com dieta-personalna.pl
drillsaw.ru dinkolove.ya.ru
dvd-famille.com discountbarbour.online
ebooknovel.club diy-handmade-ideas.com
e-commerce-seo.com djekxa.ru
econom.co djonwatch.ru
ege-essay.ru documentsite.net
elitepcgames.com dogsrun.net
emerson-rus.ru domain2008.com
energydiet24.ru domainanalyzing.xyz
epngo.bz domaincdn.xyz
etm-consult.de domcran.net
driving.kiev.ua
drivotracker.com
dtnlyss.com
duplicashapp.com
dvervmoskvu.ru
easytuningshop.ru
ee77ee.com
elektir.ru
enpolis.ru
erotag.com
esopini.com
essay-edu.biz
eurosamodelki.ru
evogarage.com evogarage.com
exlarseva.webblog.es exdocsfiles.com
exoneration-project.us exoneration-project.us
extads.net
extremal-blog.com extremal-blog.com
extremez.net extstat.com
f0815.de f0815.de
fearcrow.com fashionavenuegame.com
feorina.ru feorina.ru
fikasound.tk fidelityfunding.com
filesdatabase.net finuse.com
filesmonster.porn fivedwld.cf
filesvine.com flashbannernow.com
findanysex.com folowsite.com
flashlarevista.com footbalive.org
flirt4free.com forex-procto.ru
florida-tourism.net
flprog.com
forpostlock.ru forpostlock.ru
fortwosmartcar.pw forum69.info
free-today.com forum.doctissimo.fr
free-traffic.xyz forums.toucharcade.com
freshwallpapers.info fotosfotos.eu
fres-news.com foto-telok.net
freza-sverlo.ru franch.info
fun2cell.net franecki.net
fxund.us frankofficial.ru
gamerscorps.com free-fbook-traffic.com
gaming-journal.com freegamesplay.online
gavuer.ru freelifetimefuckbook.com
gay-site.store freemaintenancesysforpcandmac.top
freenom.link
freevpn.space
freewareseek.com
freewhatsappload.com
fxgallery.com
gallery.rennlist.com
gambarkatabaru.com
game300.ru
game-mmorpg.net
gaz-voshod.ru gaz-voshod.ru
genericviagrasildenafiled.net gcup.ru
get-seo-domain.com getmyads24.com
gidonline.one girlspicsa.com
globalsurfari.com globalscam.ga
gne8.com goldenggames.com
golmau.host.sk
goodwinmetals.co goodwinmetals.co
googlepositions.com googlsucks.com
gorabagrata.ru googst2.ru
gosarhivrt.ru gotcher.us
gotomontenegro.net
grand-chlen.ru
growshop.es growshop.es
grtyi.com gsasearchengineranker.xyz
hamilton.ca gsbs.com.ua
hatedriveapart.com hahashka.ru
hccoder.info hatdc.org
hd-filmy.net hayate.biz
hdseriale.pl hdwalls.xyz
heroz.fr help.tpu.ru
hifidesign.ru hifidesign.ru
hiwibyh.bugs3.com highstairs-a.akamaihd.net
hkdiiohi.skyrock.com home.myplaycity.com
hollywoodactress.info hothot.ru
homeandhealth.ru hptwaakw.blog.fc2.com
host-protection.com hybrid.ru
hoverboard360.de hyipmanager.in
hoverboardforsaledirect.com iframe-toloka.com
hystersister.com igithab.com
ico.re imagui.eu
idegenvezeto.eu immigrational.info
ifmo.ru incolors.club
igadgetsworld.com infowarcraft.ru
ihtec2019.org insider.pro
iklysha.ml interfucks.net
imabase.com iqoption.com
images-graphics-pics.com iqupdatetmz.win
imagez.co istanbulit.com
imgarcade.com istizanidineacontrolledsubstance.blogspot.com
iminent.com it-max.com.ua
immobiliaremassaro.com iwantmyfreecash.com
impotentik.com jabimgo.pw
inbabes.sexushost.com jackpotchances.com
infodocsportal.com jagg.info
infostatsvc.com james13prix.info
inmate-locator.us japfm.com
insurple.com jav-idol.com
intelhdgraphicsgtdrive6w.metroblog.com je7.us
intellekt21.ru jerseysbizwholesalecheap.com
int.search.mywebsearch.com jestr.org
iqs.biz.ua kaidalibor.de
i-service.kz kamagragelusa.net
isotoner.com kazrent.com
isoveti.ru ketrzyn.pl
istizanidinelikexanax.blogspot.com kleine-titten.biz
itis4you.com klikbonus.com
iweblist.info kmgamex.cf
jackwolfskinoutlet.online konoplisemena.com
janavibekken.no krasivoe-hd.net
javlibrary.cc ktotut.net
jeremyeaton.co ku6.com
jongose.ninja kvartir-remont.biz
j-times.ru kwzf.net
kalandranis.gr lacapilla.info
karadene.com lafriore.ru
kfon.eu lanadelreyfans.us
kimcurlrvsms.com lazy-z.com
klejonka.info leadwayau.com
koopilka.com
kopihijau.info
kosova.de
kreativperlen.ch
kumuk.info
kursy-ege.ru
ladov.ru
lampokrat.ws
leboard.ru leboard.ru
letslowbefast.today lexixxx.com
linkbuddies.com lflash.ru
lisque.batcave.net lifeinsurancekb.com
littlecity.ch liffa.ru
live-sexchat.ru linkarena.com
lockerz.com linkbolic.com
loginduepunti.it lomb.co
longgreen.info lombia.com
m1media.net lovasszovetseg.hu
m3gadownload.pl machicon-akihabara.info
macrotek.ru make-money-online.com
magnetpress.sk mantramusic.ru
manimpotence.com marcogrup.com
marketingvici.com marinetraffic.com
marwer.info maxthon.com
matematikus.info m.b00kmarks.com
max-eclat.men mebel-vstroika.ru
mebel-alait.ru medizinreisen.de
meddesk.ru meetingrainstorm.bid
medicinacom.ru meltwater.com
medicovi.com mesto-x.com
medispainstitute.com.au microstatic.pl
meduza-consult.ru millionare.com
metabar.ru moetomnenie.com
metalonly.info mojpreskumanie.com
metascephe.com monclerjacketsoutlet.win
middlerush-a.akamaihd.net monclervests.xyz
mirzonru.net money-every-day.com
missclub.info moyaterapiya.ru
mmgq.ru mrbitsandbytes.com
mobioffertrck.com mttwtrack.com
mompussy.net
moncleroutletonline.xyz
money-for-placing-articles.com
moscow-clining.ru
movpod.in
mrwhite.biz
msk-diplomat.com
muabancantho.info muabancantho.info
mygameplus.com music7s.me
myonigroup.com mustwineblog.com
myplaycity.com myhealthcare.com
mysex21.com myhitmp3.club
naturtreenspicerx.pw myonlinepayday.co
myra.top
mysexpics.ru
mystats.xyz
nailsimg.com
narco24.me
navalwiki.info
neobux-bg.info
netfacet.net
nfljerseys.online
ningessaybe.me
nisuturnetdgu.tk nisuturnetdgu.tk
nonameread45.live nottyu.xyz
november-lax.com novosti-hi-tech.ru
odesproperty.com nowtorrents.com
ohmyrings.com offer.camp
onefilms.net offergroup.info
online-hd.pl oivcvx.website
onlineslotmaschine.com okmusic.jp
onlythegames.com one-gear.com
ons-add.men onlinemegax.com
ourtherapy.ru onlyforemont.ru
o-o-6-o-o.com
openfrost.com
openmultipleurl.com
owohho.com
ozas.net
oz-offers.com oz-offers.com
paphoselectricianandplumber.com paradontozanet.ru
parajumpersoutlet.online partner-cdn.men
par-fallen.ga partnersafe.men
pathwhelp.org pattersonsweb.com
percin.biz.ly pb-dv.ru
perosan.com pekori.to
pestomou.info perederni.net
phobia.us pertlocogasilk.tk
photo-clip.ru piluli.info
picture-group.com
pinkduck.ga
pintattoos.com pintattoos.com
pixell.club piski.top
piuminiita.com
pk-pomosch.ru
play.leadzupc.com
plusnetwork.com
pochtovyi-index.ru
poems.com.ua poems.com.ua
poiskzakona.ru porndairy.in
pooleroadmedicalcentre.co.uk
popup.matchmaker.com
poquoson.org
pornhubforum.tk
pornodojd.ru
pornogratisdiario.com pornogratisdiario.com
pornokajf.com pornokorol.com
porto.abuilder.net pornosmola.info
portside.cc pornoted.com
postclass.com porodasobak.net
potolokelekor.ru pourvous.info
pravoholding.ru pricheskaonline.ru
prchecker.info primedice.com
producm.ru privatamateure.com
prokotov.com privetsochi.ru
pronekut.com prizestohandle.club
pulseonclick.com professionaldieselcare.com
professionalwritingservices15.blogspot.ru
progonrumarket.ru
pron.pro
prostitutki-kharkova.org
pr-ten.de
purplestats.com purplestats.com
pxhdwsm.com puzzleweb.ru
py100.ru quickbuck.com
randki-sex.com raavidesigns.com
ranksignals.com radiogambling.com
rasteniya-vs-zombi.ru rank-checker.online
realitykings.com ranksonic.com
realtytimes.com real-time-analytics.com
recordpage-a.akamaihd.net rednise.com
registratciya-v-moskve.ru remmling.de
registrationdomainsite.com
registrydomainservices.com
relatodelpresente.com.ar
remedyotc.com
remont-ustanovka-tehniki.ru
rentehno.ru rentehno.ru
repeatlogo.co.uk replicaclub.ru
rewardit.com restorator-msk.ru
rfid-locker.co rfid-locker.co
romhacking.ru rimedia.org
rospromtest.ru rn-to-bsn.com
ruclicks.com robotixix.com
rumamba.com rockingclicks.com
rusenvironmental.net rockma.se
rusexy.xyz rus-pornuha.com
s8-nowy-wygraj.comli.com salutmontreal.com
sabizonline.com savingsslider-a.akamaihd.net
saddiechoua.com sax-sex.com
sammlungfotos.online sbt-aqua.ru
saratov.xrus.org scalerite.co.za
sashagreyblog.ga scanner-andrew.top
sbdl.no scanner-julia.top
sbf441.com schalke04fc.info
scanner-margo.top scmor.ilxc.cc
scanner-marwin.top score-ads.men
schlampen-treffen.com scrnet.biz.ua
school-diplomat.ru seasaltwithfood.com
scrapinghub.com seinterface.com
seasonvar.ru semrush.com
seksotur.ru serialsway.ucoz.ru
seoboxes.com serving.adbetclickin.pink
seo-platform.com
se-welding.ru
sexcamamateurchat.com sexcamamateurchat.com
sex.hotblog.top sex-dating.co
sexreliz.com sextracker.be
sexy.babes.frontend-stack.top sextracker.com
sexytrend.ru sexystrippe.info
sfd-chess.ru sexyteens.hol.es
s-forum.biz sharebutton.net
shell-pmr.ru shariki-zuma-lines.ru
shymkent.xkaz.org sharpchallenge.com
sibvitr.ru shitmovs.com
simple-share-buttons.com shopvilleroyboch.com.ua
sisi-go.ru shtaketniki.kz
sideeffectsoftizanidine.blogspot.com
sierraapps.com
simpoed.ufop.br
sim-service.net
siteaero.com siteaero.com
siteheart.net sitevaluation.com
slowmacfaster.trade sixcooler.de
smstraf.ru sklad-24.ru
snsdeainavi.info sloopyjoes.com
socialbuttons.xyz smart-scripts.com
softomix.com snjatie-geroinovoy-lomki.ru
solmarket.by socialsignals24.com
space-worry.ml softonicads.com
sprttrack.com soundfrost.org
spyfu.com sport-video-obzor.ru
squidoo.com stair.registrydomainservices.com
srecorder.com steelmaster.lv
sribno.net sticken.co
standardchartered-forex.com stop-zavisimost.com
stariy-baku.com
staticfs.host
stockquotes.wooeb.com
stoki.ru
stopnarco.ru
stroiminsk.com
strongholdsb.ru
students-cheapskate.ml students-cheapskate.ml
suchenindeutschland.com sumo.com
supermama.top superkanpo.com
suralink.com svensk-poesi.com
swingerseiten.com swsociety.se
tacbelarus.ru
taqywu51.soup.io
tattooreligion.ru tattooreligion.ru
t-bygg.com td-33.ru
teesdaleflyballclub.co.uk td-l-market.ru
telefonsexsofort.tk telefonsexkostenlos.tk
thecoolimages.net telefonsex-ohne0900.net
thefotosgratis.eu tetracsaudi.com
theprofitsmaker.net textads.men
thfox.com thebitcoincode.com
timetorelax.biz thecounter.com
titelhelden.eu thruport.com
titslove.yopoint.in timdreby.com
tizanidine6mg.blogspot.com timer4web.com
tizanidinenarcotic.blogspot.com tizanidinecapsules.blogspot.com
tjkckpytpnje.com tizanidineonline.blogspot.com
tmtrck.com tizanidinepain.blogspot.com
toloka.hurtom.com tizanidinestreetprice.blogspot.com
tonerbox.kz tizanidineusedfor.blogspot.com
tooplay.com tizanidinevsvalium.blogspot.com
topvidos.ru topanasex.com
traffpartners.com tpu.ru
trainoffend.ml track112.site
truck-rece.life tracksurf.daooda.com
trudogolik.net trafficfactory.biz
trumpetedextremes.com trafficmania.com
try-rx.com trailer.cinemaflix.website
turist-strani.ru truck-land.life
turkeyreport.tk tuberkulezanet.ru
tvand.ru tubo360.com
twincitiescarservice.com tv-spoty.info
twittruth.com twu.com.ua
uchetunet.su udayavani.com
ukrtvir.com.ua ukrtvir.com.ua
ukrtvory.in.ua
uk-zheu20.ru uk-zheu20.ru
uroki.net uptime-alpha.net
usacasino.com urlopener.com
vacuumcleanerguru.com v24s.net
vancleefreplica.pw
vasileostrovsky-rayon.ru
vegan-foods.us
vekzdorov.ru
veles.shop veles.shop
vellings.info vintontech.info
venerologiya.com vip-parfumeria.ru
veopornogratis.xxx vizag.kharkov.ua
vertaform.com vk-mus.ru
video-production.com vkontarkte.com
vip.51.la voditeltrezviy.ru
vipsexfinders.com voluumtrk.com
virus-respirators.com w3data.co
viteonlusarezzo.it warezaccess.com
vitoriacabos.com
vkmusics.ru
vrnelectro.ru
vysigy.su
vzubah.com
waysbetter.cn waysbetter.cn
wdfdocando.com webjam.com
website-speed-up.top webs.com
weburok.com webscouter.net
wedding-salon.net webstatsdomain.org
welck.octopis.com weightatraining.com
weprik.ru wesharepics.site
whatistizanidine2mg.blogspot.com whatsappbot.flyland.ru
wholesalejerseys-cheapest.com wordkeyhelper.com
windowssearch-exp.com workle.website
wrz0iuebwhp5fg.freeddns.com worldhistory.biz
wtsindia.in writingservices17.blogspot.ru
www.888.com www.888.com
xboxster.ru www.jbetting.com
xedserver.com xn--80aaajbdbddwj2alwjieei2afr3v.xn--p1ai
xep.info xn--80ahdheogk5l.xn--p1ai
xingzi-vision.com xn--80ajbshivpvn2i.xn--p1ai
xitjw.info xn----ctbigni3aj4h.xn--p1ai
xmlinde.com xn--lifehacer-1rb.com
xn--80aafb2a.xn--p1ai xxxdatinglocal.us
xn--80atua3d.xn--p1ai yaoguangdj.com
xn----ctbbcjd3dbsehgi.xn--p1ai yatrk.xyz
xn--l1aengat.xn--p1ai
x-true.info
xvideosbay.com
yaaknaa.info
yebocasino.co.za yebocasino.co.za
yginekologa.com yginekologa.com
yottos.com ynymnwbm.bloger.index.hr
youghbould.wordpress.com yougame.biz
yourdesires.ru yougotanewdomain.com
yourserverisdown.com youraticles.pl
yourporngay.com
yugk.net
zahvat.ru zahvat.ru
zaimite.ru zaim-pod-zalog-krasnodar.ru
zawyna.ua zoosexart.com
zetmaster.ru
zigzog.ru
zixizop.net.ru
zrus.org

482
.dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
01apple.com 11pikachu.ru
101raccoon.ru 1kdailyprofit.me
1stat.ru 1qingdao.com
2girls1cup-free.com 2015god.org
5elementov.ru 202ch.com
aadroid.net 5i2.net
abcdeg.xyz aaa38852e886ac4af1a3cff9b47cab6272.com
adinterax.com above.com
adman.gr abusora.com
admitad.com adpremium.org
adnotbad.com aero2.ru
adsloads.com airlandsea.info
ads-seo.men ald2014.org
agapovdg.ru alibestsale.com
allblogroll.com amazingninja.com
alldownload.pw amospalla.es
amyfoxfitness.com an-donut.com
anal-acrobats.hol.es anti-virus-removal.info
analytics-ads.xyz apiappenableinfo-a.akamaihd.net
anime.dougasouko.com appfastplay.com
anmysite.com aproposde.com
apartment.ru arquapetrarca.info
apiwebwebgetcom-a.akamaihd.net avirasecureserver.com
app5.letmacworkfaster.world avtoarenda.by
apptester.tk
aquarium-pro.ru
asseenontvonline.ru
avtolombard-krasnodar.ru
ayakino.net ayakino.net
azartclub.org azbukafree.com
azarttoto.com backlinkwatch.com
babyfactory.fr baksman.com
backgroundpictures.net bankmib.ru
basedecor.ru beachdriveblog.com
berrymall.ru beauty-bracelet.com
betterhdporn.com beauty-clinic.ru
bioscorp.ru bestpriceninja.com
bizzliving.com bestserials.com
brus.city bestwrinklecreamnow.com
business-suggested.tk bgviagrachrx.com
businesxxl.com bigcities.org
buytizanidineonline.blogspot.com bkgr.se
bytimedance.ru blog.koorg.ru
cartierreplica.win blue-square.biz
cheapbelstaff.online bonvillan.com
cialischsrx.com brandimensions.com
cialisndbrx.com buybest1.biz
citizenclsdriveri7.pen.io buyviagraa.blogspot.com
click2pawn.com calcularpagerank.com
clickpapa.com carabela.com.do
constantaservice.net cartujano-pre.de
coprofam.org chiblackhawks-jerseys.com
chinese-amezon.com
cjmc.info
cleansearch.net
compliance-alexa.xyz
compliance-walt.top
coslab.club
cougfan.info
counterbot.com
cranly.net
crirussian.ru crirussian.ru
customerpromos-a.akamaihd.net cs-passion.pl
dailystrength.org culmimg.pw
datsun-do.com cv.wallhade.co
decenttools.com dame-ns.kz
discountbarbour.online daooda.com
dodlive.mil darkages.info
dogbreedspicture.net davidovic.info
dogclothing.store dcj-nn.ru
dpihatinh.gov.vn delitime.info
dstroy.su designdevise.com
edwinkonijn.com.au detoxmed24.ru
ekto.ee digital-sale.su
elektrozigaretten1.postbit.com directivepub.com
elstal.com.pl djstools.com
enge-fotzen.info dneprsvet.com.ua
escortslet.net econom.co
essayservicewriting.org edge.sharethis.com
evaashop.ru elektir.ru
expresstoplivo.ru elektronischezigarettekaufen1.myblog.de
eywords-monitoring-your-success.com energy-ua.com
fable.in.ua escort-russian.com
favorcosmetics.com eyelike.com.ua
filesvine.com eyessurgery.ru
fillmewithhappiness.com feeriaclub.ru
flashbannernow.com filefilter.weebly.com
forums.toucharcade.com financetip.eu
foto-basa.com flashlarevista.com
glavtral.ru flavors.me
globatur.ru games.kolossale.ru
greatdealshop.com gaz-voshod.ru
gribokstop.com geckoandfly.com
gsou.cf generic-pills-online.com
guiadeserraazul.com getdot.ru
hasfun.com gojiberriess.apishops.ru
hchha.com gourcy.altervista.org
heliko.no hdseriale.pl
hentai-manga.porn heartofpayne.xyz
herokuapp.com hoste.octopis.com
heroz.fr hostnow.men
hidemyass.com hotcore.info
hitsbox.info hotdl.in
hmywwogw.bloger.index.hr hplaserjetpdriver8y.pen.io
hostcritique.com ideashome.id
hustoon.over-blog.com ideawheel.com
images.gyffu.com id-forex.com
imagez.co inboundlinks.win
impisr.ru incanto.in.ua
insta-add.pro isotoner.com
interferencer.ru javidol.site
iopeninghours.co.uk
iplogger.org
iusstf.org
j33x.com
jaxcube.info jaxcube.info
journalhome.com kandidos.com
junketjuice.blogspot.com kartiniresto.com
keywordteam.net keenoutlet.online
kleine-titten.biz kino-filmi.com
kosynka-games.ru kochanelli.com
kskjco.club komp-pomosch.ru
lakomka.com.ua konkursov.net
ledpolice.ru krasivoe-hd.net
linkrr.com kunstaktien.info
luxmagazine.cf kutikomi.net
mackeeper-land-672695126.us-east-1.elb.amazonaws.com kvartira-sutochno.com
mailemedicinals.com lanadelreyfans.us
marmotstore.online leftofcentrist.com
mcar.in.ua lyngdalhudterapi.no
mediaoffers.click magda-gadalka.ru
medispainstitute.com.au marwer.info
medmajor.ru megagrabber.ru
mobifunapp.weebly.com metascephe.com
monetizationking.net mexicotravelnet.com
mrlmedia.net mhtr.be
mttwtrack.com middlerush-a.akamaihd.net
my-aladin.com militarysale.pro
my-cash-bot.co minharevisao.com
myhydros.org mobile-appster.ru
mymercy.info mozello.ru
myseoconsultant.com mzdish.site
mysex21.com narosty.com
najaden.no nbsproject.ru
naturalpharm.com.ua notfastfood.ru
naturtreenspicerx.pw nudepatch.net
net-radar.com nzfilecloud.weebly.com
nightvision746.weebly.com
novodigs.com
o333o.com o333o.com
obiavo.by obuv-kupit.ru
obiavo.com offers.bycontext.com
offergroup.info online-hd.pl
onescreen.cc onthemarch.co
onlinetvseries.me o-o-8-o-o.com
ontargetseo.us outpersonals.com
o-o-8-o-o.ru
owathemes.com
oynat.info
paphoselectricianandplumber.com paphoselectricianandplumber.com
partners-ship.pro parajumpersoutlet.online
pay2me.pl pepperstyle.ru
picquery.com picsforkeywordsuggestion.com
picturesfrom.com picture-group.com
pinstake.com pintattoos.com
plastgran.com plastweb.ru
playboyfiles.xblog.in
playfortuna-play.ru playfortuna-play.ru
plohaya-kreditnaya-istoriya.ru pokerniydom.ru
popugauka.ru popunder.net
pornoklad.ru praisong.net
porno-raskazy.ru printie.com
poshiv-chehol.ru privetsochi.ru
pr0fit-b0x.com profitwithalex.info
presleycollectibles.com prostitutki-yaroslavlya.org
productarium.com pufip.com
profitfx.online push-ad.com
ptr.ruvds.com rebrand.ly
qpypcx.com redbottomheels.xyz
qwesa.ru reelheroes.net
rcb101.ru remontvsamare.su
r-control.ru rfserial.net
refudiatethissarah.info rocketchange.ru
remedyotc.com sakhboard.ru
rentehno.ru sammlungfotos.online
riders.ro sanatorrii.ru
rique.host.sk saratov.xrus.org
royal-betting.net sarm.tk
runofilms.ru savememoney.co.za
s8-nowy-wygraj.comli.com saveriopiazza.it
safe-app.net sbdl.no
salmonfishingsacramentoriver.com sbornik-zakonov.ru
sardinie.us scanner-alexa.top
scanner-andrew.top scanner-elena.top
scopich.com scopich.com
search-error.com scrnet.biz.ua
semaltmedia.com security60-e.com
seocheki.net seo-platform.com
sharebutton.net sexad.net
site3.free-share-buttons.com sex-znakomstva.online
site-speed-checker.site sharpchallenge.com
skylta.com sherlock.se
sneakyboy.com shopcheermakeup.info
socialmediasuggest.com signoredom.com
sovetogorod.ru simpoed.ufop.br
stickers-market.ru site.ru
subj.ukr-lit.com si-unique.com
sugarkun.com skatestick.bid
superinterstitial.com skincrate.net
svetodiodoff.ru soheavyblog.com
taaaak.com speeddream.xyz
takethatad.com spinnerco.ca
taqywu51.soup.io sstroy44.ru
tedxrj.com stairliftsarea.com
theallgirlarcade.com t3chtonic.com
thenews-today.info tdsing.ru
teguh.info
theautoprofit.ml
thegameriders.com
thewebsitetemplate.info thewebsitetemplate.info
thfox.com ticketsys.inetwd.com
thruport.com tilido.com
tizanidine4mgstreetvalue.blogspot.com tizanidineduringpregnancy.blogspot.com
tizanidineandgabapentin.blogspot.com topcasinoratings.ru
tizanidinehydrochloride4mgstreetvalue.blogspot.com topquality.cf
tizanidineorflexeril.blogspot.com trustedhealthtips.com
topvidos.ru tula.mdverey.ru
tradedeals.biz turbodsp.com
traderzplanet.in twittrading.com
traffic100.com uhdtv.website
traffic2money.com ukrtextbook.com
traffique.net ultimateclassicrock.com
traffixer.com unblocksit.es
tvorozhnaja-zapekanka-recept.ru userequip.com
ua.tc vduplo.ru
urlopener.com vepad.com
vavilone.com videokrik.net
velen.io visa-china.ru
videochat.mx vkontaktemusic.ru
vip2ch.com vodaodessa.com
vipsexfinders.com voltrknc1.com
vzlomfb.com webalan.ru
watchmyfb.pl
webadvance.club
weblibrary.win
webmasterhome.cn webmasterhome.cn
websiteexplorer.info webscouter.net
workle.website websites-reviews.com
wowas31.ucoz.ru westvilletowingservices.co.za
x-musics.com whiteelephantwellington.com
xn--80aaaks3bbhabgbigamdr2h.xn--p1ai wholesalejerseysgaa.com
xn----8sblgmbj1a1bk8l.xn----161-4vemb6cjl7anbaea3afninj.xn--p1ai www.888.com
xn----ctbbcjd3dbsehgi.xn--p1ai www.bookmaker-bets.com
xn--d1abj0abs9d.in.ua wygraj-skiny.win
yourporn.com xitjw.info
yoursearch.me xn-----6kcaacnblni5c5bicdpcmficy.xn--p1ai
youthreaders.com xn--80aeahghtf8ac5i.xn--p1ai
zapiszto.pl xn----9sbebi2bvzr7h.xn--p1ai
zarabiaj-dzis.pl xxx-cam.webcam
zarajbuilders.com zazagames.org
zawyna.ua zeroredirect11.com
zryydi.com zeroredirect.com
zzlgxh.com zlatnajesen.com
z-master.ru
zone-kev717.info
zrelaya.pw

BIN
.latest_release/bots.d.tar.gz
View file

Binary file not shown.

BIN
.latest_release/conf.d.tar.gz
View file

Binary file not shown.

4
AUTO-CONFIGURATION.md
View file

@ -4,9 +4,9 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2021.06.2370 #### Version: V4.2021.06.2371
#### Bad Referrers Blocked: [7055](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7055](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [611](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [612](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)
____________________ ____________________

4
MANUAL-CONFIGURATION.md
View file

@ -4,9 +4,9 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2021.06.2370 #### Version: V4.2021.06.2371
#### Bad Referrers Blocked: [7055](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7055](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [611](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [612](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)
____________________ ____________________

4
README.md
View file

@ -11,9 +11,9 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2021.06.2370 #### Version: V4.2021.06.2371
#### Bad Referrers Blocked: [7055](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7055](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [611](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [612](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)
____________________ ____________________

8824
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_generator_lists/bad-user-agents.list
View file

@ -1,4 +1,3 @@
seostar
01h4x.com 01h4x.com
360Spider 360Spider
404checker 404checker
@ -440,6 +439,7 @@ Seomoz
SEOprofiler SEOprofiler
seoscanners seoscanners
SeoSiteCheckup SeoSiteCheckup
seostar
SEOstats SEOstats
serpstatbot serpstatbot
sexsearcher sexsearcher

4
_google_analytics_ghost_spam/README.md
View file

@ -3,9 +3,9 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2021.06.2370 #### Version: V4.2021.06.2371
#### Bad Referrers Blocked: [7055](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7055](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [611](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [612](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)
____________________ ____________________

8831
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

8831
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

8831
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

8
robots.txt/robots.txt
View file

@ -6,9 +6,9 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2021.06.2370 ### Version: V4.2021.06.2371
### Updated: Fri Jun 4 13:23:46 SAST 2021 ### Updated: Sat Jun 5 13:45:43 SAST 2021
### Bad Bot Count: 611 ### Bad Bot Count: 612
################################################### ###################################################
### Version Information ## ### Version Information ##
@ -897,6 +897,8 @@ User-agent: seoscanners
Disallow:/ Disallow:/
User-agent: SeoSiteCheckup User-agent: SeoSiteCheckup
Disallow:/ Disallow:/
User-agent: seostar
Disallow:/
User-agent: SEOstats User-agent: SEOstats
Disallow:/ Disallow:/
User-agent: serpstatbot User-agent: serpstatbot