vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-04 11:40:22 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2021.10.2645 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2021-10-11 22:08:44 +00:00
parent 7d05ebcc37
commit cf3aea150c
47 changed files with 78207 additions and 78217 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2021.10.2644 #### Version: V4.2021.10.2645
#### Bad Referrers Blocked: [7078](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7078](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [623](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [623](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2021.10.2644 #### Version: V4.2021.10.2645
#### Bad Referrers Blocked: [7078](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7078](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [623](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [623](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -11,7 +11,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2021.10.2644 #### Version: V4.2021.10.2645
#### Bad Referrers Blocked: [7078](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7078](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [623](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [623](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

9642
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2021.10.2644 #### Version: V4.2021.10.2645
#### Bad Referrers Blocked: [7078](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7078](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [623](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [623](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

9646
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

9646
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

9646
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

9646
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.84 1; 10.1.1.17 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.84 0; 10.1.1.17 0;
127.0.0.1 0; 127.0.0.1 0;

9646
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.84 1; 10.1.1.17 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.84 0; 10.1.1.17 0;
127.0.0.1 0; 127.0.0.1 0;

9646
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.84 1; 10.1.1.17 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.84 0; 10.1.1.17 0;
127.0.0.1 0; 127.0.0.1 0;

9646
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
2644 2645

9646
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

9646
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.94.205.253 0; 52.224.2.203 0;

9646
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.84 1; 10.1.1.17 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.84 0; 10.1.1.17 0;
127.0.0.1 0; 127.0.0.1 0;

9646
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.84 1; 10.1.1.17 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.84 0; 10.1.1.17 0;
127.0.0.1 0; 127.0.0.1 0;

9646
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.84 1; 10.1.1.17 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.84 0; 10.1.1.17 0;
127.0.0.1 0; 127.0.0.1 0;

9646
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.94.205.253 0; 52.224.2.203 0;

9646
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.94.205.253 0; 52.224.2.203 0;

9646
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.84 1; 10.1.1.17 1;
127.0.0.1 1; 127.0.0.1 1;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
Anarchy99 Anarchie
Asterias BatchFTP
Domains Project Nettrack
ExtractorPro ScoutJet
Image Fetch Teleport
Msrabot Trendictionbot
Siphon TurnitinBot
Titan probe-image-size
Web Sauger serpstatbot
Website Quester tAkeOut

288
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
01h4x.com
360Spider 360Spider
404checker 80legs
Abonti ADmantX
Aboundex AIBOT
ALittle Client
Aboundexbot Aboundexbot
Acunetix Acunetix
AfD-Verbotsverfahren
AhrefsBot AhrefsBot
AiHitBot Aipbot
AllSubmitter
Alligator Alligator
Anthill AlphaBot
Ankit
Apexoo
Aspiegel
Asterias
Attach Attach
AwarioRssBot BackStreet
AwarioSmartBot
BBBike
BDFetch
BackDoorBot
BackWeb BackWeb
Backlink-Ceck Backlink-Ceck
Battleztar Bazinga Badass
Bitacle Bandit
Black Hole Bigfoot
Blow
BlowFish BlowFish
Brandwatch Boardreader
Bullseye Bolt
BuzzSumo Brandprotect
Buck
BuiltWith
CODE87 CODE87
Calculon
CazoodleBot
CensysInspect CensysInspect
CheTeam
CherryPicker CherryPicker
Claritybot Chlooe
Cloud mapping Cloud mapping
Collector
Copier Copier
CopyRightCheck CopyRightCheck
Copyscape Copyscape
Cosmos
CrazyWebCrawler
Crescent
Custo Custo
CyotekWebCopy CyotekWebCopy
DBLBot DBLBot
DIIbot
DataCha0s DataCha0s
DatabaseDriverMysqli DatabaseDriverMysqli
Demon Demon
Deusu Deusu
Devil Devil
DittoSpyder
DnyzBot DnyzBot
DomCopBot
DomainAppender
DomainCrawler DomainCrawler
DomainStatsBot DomainSigmaCrawler
Domains Project Dotbot
Download Wonder Download Wonder
Dragonfly Dragonfly
Drip
ECCP/1.0 ECCP/1.0
EMail Siphon
EMail Wolf EMail Wolf
Ecxi Ebingbong
EirGrabber EirGrabber
ExtractorPro Evil
EyeNetIE Extractor
FemtosearchBot Extreme Picture Finder
Firefox/7.0 Firefox/7.0
Freeuploader Foobot
FrontPage
FyberSpider FyberSpider
Fyrebot
GT::WWW
Genieo
GetRight GetRight
GetWeb
Getintent Getintent
Go!Zilla Go!Zilla
Gotit GridBot
GrapeshotCrawler HTTrack
HTMLparser
Haansoft
HaosouSpider HaosouSpider
Harvest Heritrix
Havij Hloader
HybridBot IRLbot
IDBTE4M
Iblog
Id-search Id-search
IlseBot IndeedBot
InfoNaviRobot Indy Library
Intelliseek InfoTekies
InterGET
Internet Ninja
Iria
Iskanie Iskanie
IstellaBot JetCar
Jbrofuzz JikeSpider
JennyBot
Jetty
Jorgee Jorgee
Jyxobot Jyxobot
Kenjin Spider Keyword Density
LWP::Simple LNSpiderguy
Lanshanbot
Larbin
Lftp Lftp
Lightspeedsystems Libwhisker
LinkScan LinkScan
LinkpadBot LinkpadBot
LinqiaRSSBot
LinqiaScrapeBot LinqiaScrapeBot
MFC_Tear_Sample Lipperhey Spider
MIDown tool
MJ12bot MJ12bot
MQQBrowser
MSIECrawler
MTRobot
Mag-Net Mag-Net
Majestic12 MarkWatch
MarkMonitor Mata Hari
MauiBot MeanPath Bot
Mb2345Browser Mediatoolkitbot
MegaIndex.ru Metauri
Microsoft Data Access MicroMessenger
Microsoft URL Control Mister PiX
Msrabot Moblie Safari
Morfeus Fucking Scanner
Mozlila
Name Intelligence Name Intelligence
Nameprotect NearSite
Navroad
Needle Needle
Nessus
Net Vampire Net Vampire
NetAnts NetMechanic
NetLyzer
NetZIP NetZIP
Netvibes Netcraft
NextGenSearchBot
Niki-bot Niki-bot
NimbleCrawler
Nimbostratus Nimbostratus
Nutch Ninja
Nuclei
Octopus Octopus
Offline Explorer Offline Explorer
OnCrawl OpenLinkProfiler
OpenVAS OpenVAS
Openfind
Openvas
OrangeBot
OrangeSpider OrangeSpider
OutfoxBot
PECL::HTTP PECL::HTTP
PHPCrawl POE-Component-Client-HTTP
Page Analyzer PageGrabber
PageAnalyzer PageScorer
PageThing.com Papa Foto
Pandalytics
Panscient
PeoplePal PeoplePal
Picsearch
Pimonster Pimonster
Pockey Pixray
ProPowerBot ProPowerBot
Pu_iN Pu_iN
QueryN Metasearch PyCurl
RankActive Quick-Crawler
RankActiveLinkBot RankFlex
RankingBot RankingBot
RankingBot2
ReGet ReGet
Reaper RealDownload
RebelMouse
Recorder
Ripper Ripper
RocketCrawler SEOlyticsCrawler
SBIder Scanbot
SEOkicks-Robot Scrapy
SalesIntelligent ScreenerBot
Screaming
Searchestate Searchestate
Semrush Semrush
SeobilityBot SeobilityBot
Siphon Seomoz
SiteCheckerBotCrawler SiteCheckerBotCrawler
SiteLockSpider SiteLockSpider
SiteSnagger
Sitebeam Sitebeam
Sitevigil Sitevigil
SlySearch
Snake Snake
Snapbot Snoopy
Sociscraper SpaceBison
Sogou web spider SpankBot
Sottopop Spbot
Spanner SputnikBot
SuperHTTP Sqworm
Surfbot Steeler
SurveyBot
Szukacz Szukacz
T0PHackTeam
T8Abot
Telesoft
Telesphorep Telesphorep
The Intraformant
TheNomad
Thumbor Thumbor
TightTwatBot
Titan
Toata
True_Robot True_Robot
Turingos
TurnitinBot TurnitinBot
TwengaBot
URLy Warning
UnisterBot
VB Project
VCI VCI
Vagabondo Vagabondo
VelenPublicWebCrawler Virusdie
VeriCiteCrawler Voil
VidibleScraper WWWOFFLE
VoidEYE Wallpapers/3.0
Voltron Web Enhancer
WASALive-Bot
WBSearchBot
WPScan
WWW-Collector-E
WWW-Mechanize
WallpapersHD
Web Auto
Web Fetch Web Fetch
Web Fuck Web Pix
WebAuto
WebBandit WebBandit
WebEnhancer WebEnhancer
WebFetch WebFuck
WebImageCollector WebPix
WebStripper
WebSucker WebSucker
WebZIP WebZIP
Webalta Webalta
WebmasterWorldForumBot WebsiteExtractor
Whacker Webster
Who.is Bot Who.is Bot
Wonderbot WinHTTrack
Woobot Woobot
Xaldon_WebSpider Xaldon WebSpider
Zauba Zermelo
Zeus
ZmEu
ZoomBot ZoomBot
ZoominfoBot
ZumBot ZumBot
ZyBorg autoemailspider
backlink-check backlink-check
cah.io.community
check1.exe
coccocbot-web coccocbot-web
cognitiveseo
com.plumanalytics com.plumanalytics
crawl.sogou.com
crawler.feedback
dataforseo.com
demandbase-bot demandbase-bot
domainsproject.org domainsproject.org
eCatch
evc-batch evc-batch
instabid heritrix
ips-agent internetVista monitor
isitwp.com meanpathbot
lwp-trivial mediawords
magpie-crawler
netEstate NE Crawler
pcBrowser pcBrowser
plumanalytics
polaris version polaris version
ripz ripz
satoristudio.net satoristudio.net
scalaj-http scalaj-http
scan.lol
seoscanners seoscanners
seostar
serpstatbot
sexsearcher sexsearcher
sitechecker.pro sitechecker.pro
spyfu
sysscan
ubermetrics-technologies.com ubermetrics-technologies.com
voyagerx.com
webmeup-crawler webmeup-crawler
x22Mozilla xpymep1.exe
zauba.io
zgrab

284
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
01h4x.com
360Spider 360Spider
404checker 404checker
404enemy 404enemy
ASPSeek AIBOT
Aboundex ALittle Client
Acunetix AiHitBot
Aipbot Aipbot
Ankit Alexibot
Anarchy99
Apexoo Apexoo
Asterias Aspiegel
Attach
AwarioRssBot
AwarioSmartBot AwarioSmartBot
BBBike
BDCbot
BLEXBot
BackStreet
BackWeb BackWeb
Badass Backlink-Ceck
BacklinkCrawler
Barkrowler Barkrowler
BatchFTP BatchFTP
Bitacle Battleztar Bazinga
BlackWidow
BlowFish
Boardreader Boardreader
Brandprotect Brandwatch
Buck Buck
BuiltBotTough Buddy
Bullseye Bullseye
BunnySlippers
BuzzSumo
CATExplorador
CCBot
CODE87 CODE87
Cegbfeieh CSHttp
CheeseBot Calculon
Chlooe CazoodleBot
CheTeam
CherryPicker
Claritybot Claritybot
Cocolyzebot
Collector
CopyRightCheck CopyRightCheck
Copyscape
Cosmos Cosmos
Craftbot Craftbot
Crawling at Home Project Crawling at Home Project
Crescent Crescent
Curious Curious
DBLBot Custo
CyotekWebCopy
DSearch
DTS Agent DTS Agent
DataCha0s DatabaseDriverMysqli
Devil Demon
Discoverybot DigitalPebble
DomCopBot Dirbuster
DittoSpyder
DnyzBot
DomainAppender DomainAppender
DomainCrawler
DomainStatsBot
Domains Project Domains Project
Dotbot Dotbot
Download Wonder Drip
ECCP/1.0 EasyDL
Ebingbong
Ecxi Ecxi
Evil Express WebPictures
Exabot ExtLinksBot
Extractor
ExtractorPro ExtractorPro
FDM FDM
FHscan
FemtosearchBot FemtosearchBot
FlashGet
Flunky Flunky
Freeuploader Foobot
G-i-g-a-b-o-t FrontPage
Fuzz
GalaxyBot GalaxyBot
Genieo Genieo
GetRight Getintent
Go!Zilla Go!Zilla
Go-Ahead-Got-It Gotit
GoZilla
GrabNet GrabNet
Grafula Grafula
GridBot GrapeFX
HMView
HTMLparser HTMLparser
Haansoft Haansoft
HaosouSpider HaosouSpider
Harvest Harvest
Havij Humanlinks
Image Fetch IDBot
Indy Library Iblog
InfoNaviRobot Id-search
InterGET
Internet Ninja Internet Ninja
Iria
JamesBOT JamesBOT
Jbrofuzz
JennyBot
JetCar
JikeSpider JikeSpider
Joomla
Jorgee Jorgee
JustView JustView
Jyxobot Jyxobot
Kenjin Spider Kenjin Spider
Keyword Density
Kinza Kinza
Kozmosbot Lanshanbot
LWP::Simple
Leap
LeechFTP LeechFTP
LeechGet LexiBot
LibWeb Lftp
LieBaoFast LieBaoFast
Lightspeedsystems
Likse Likse
Linkbot LinkWalker
Linkdexbot
LinqiaScrapeBot LinqiaScrapeBot
Lipperhey Lipperhey Spider
Litemage_walker Litemage_walker
MJ12bot MIIxpc
MQQBrowser MSIECrawler
Mail.RU_Bot Mail.RU_Bot
Majestic12 Majestic12
MarkMonitor
MarkWatch
Mass Downloader
Masscan
MauiBot
Mb2345Browser Mb2345Browser
MeanPath Bot
MegaIndex.ru MegaIndex.ru
Metauri Metauri
Microsoft URL Control Microsoft URL Control
Mister PiX
Mojolicious
Mr.4x3 Mr.4x3
Msrabot Musobot
NPbot NPbot
Name Intelligence Nameprotect
Needle
Net Vampire Net Vampire
NetAnts
NetLyzer NetLyzer
NetMechanic NetSpider
NetZIP Netvibes
Nibbler NextGenSearchBot
Niki-bot
Nikto Nikto
Nimbostratus
Ninja Ninja
Octopus Nutch
Offline Explorer Offline Explorer
OpenVAS Offline Navigator
Openvas OnCrawl
OrangeSpider
OutclicksBot OutclicksBot
POE-Component-Client-HTTP OutfoxBot
PageAnalyzer PHPCrawl
Pandalytics Pandalytics
Panscient
Papa Foto
Pavuk
Petalbot Petalbot
PictureFinder Pi-Monster
PleaseCrawl Picscout
Pockey Piepmatz
Pu_iN Pimonster
ProPowerBot
ProWebWalker
Probethenet
PyCurl PyCurl
QueryN Metasearch
Quick-Crawler
RSSingBot
RankActive
RankActiveLinkBot RankActiveLinkBot
Reaper RebelMouse
RepoMonkey RocketCrawler
SEOkicks
SEOlyticsCrawler
SEOprofiler
SMTBot SMTBot
Scrapy Scanbot
Screaming
ScrepyBot ScrepyBot
Semrush
SemrushBot
SeoSiteCheckup SeoSiteCheckup
SeobilityBot
Seomoz Seomoz
Siphon Site Sucker
SiteCheckerBotCrawler Siteimprove
SiteExplorer Snake
SiteLockSpider
SiteSucker
Sitevigil
SlySearch
SmartDownload
SocialRankIOBot
Sociscraper Sociscraper
Sottopop Sosospider
SpaceBison SpankBot
Spammen
Spbot Spbot
Steeler Spinn3r
Stripper SputnikBot
Sucuri Sucuri
SuperBot SuperBot
SuperHTTP
Surfbot
Suzuran
Swiftbot
T8Abot T8Abot
Teleport Telesoft
Telesphoreo
Telesphorep
The Intraformant The Intraformant
TheNomad
Thumbor Thumbor
Trendiction TightTwatBot
True_Robot Tracemyfile
Turingos URLy.Warning
Upflow V-BOT
VB Project VB Project
Vagabondo Vacuum
VelenPublicWebCrawler Virusdie
VoidEYE
Voil
WASALive-Bot
WBSearchBot WBSearchBot
WISENutbot WEBDAV
WPScan
WWW-Collector-E WWW-Collector-E
WWWOFFLE WWW-Mechanize
WWW::Mechanize
WallpapersHD WallpapersHD
Web Auto
Web Collage Web Collage
Web Pix Web Enhancer
Web Fetch
Web Sucker Web Sucker
WebAuto WebAuto
WebFetch WebCopier
WebImageCollector WebImageCollector
WebLeacher
WebSucker WebSucker
WebWhacker
Webalta
Webshag
WebsiteQuester
Webster Webster
Whack Whack
Whacker Whatweb
Who.is Bot
WinHTTrack WinHTTrack
WiseGuys Robot
Wonderbot Wonderbot
Wotbox Wotbox
Xaldon WebSpider
Zade
Zauba
Zitebot
ZoomBot ZoomBot
ZoominfoBot ZoominfoBot
ZumBot ZumBot
arquivo.pt backlink-check
cah.io.community
check1.exe
clark-crawler
coccocbot-web coccocbot-web
com.plumanalytics com.plumanalytics
crawl.sogou.com eCatch
crawler.feedback
evc-batch
facebookscraper facebookscraper
instabid ips-agent
internetVista monitor isitwp.com
meanpathbot meanpathbot
mediawords mediawords
muhstik-scan muhstik-scan
oBot page scorer
ripz plumanalytics
s1z.ru probe-image-size
satoristudio.net
scalaj-http
scan.lol scan.lol
seobility seostar
serpstatbot
sexsearcher
sitechecker.pro sitechecker.pro
siteripz
sp_auditbot
sysscan sysscan
tAkeOut
trendiction.com trendiction.com
webpros.com
webprosbot
x09Mozilla x09Mozilla
x22Mozilla
zgrab

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
3xforum.ro djihispano.com
cardul.ru fealq.com
compliance-willy.top lyngdalhudterapi.no
coolwallpapers4k.info myfreetutorials.com
fotoxxxru.com onescreen.cc
hard-porn.mobi sexxdate.net
liran-locks.com thin.me.pn
macdamaged.space turizmus.us
navalwiki.info ublaze.ru
toy-shop.top videochat.mx

930
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
00go.com 0c47f8422d3f.com
08800.top 101raccoon.ru
1-free-share-buttons.com 123any.com
101flag.ru 123movies.love
1kdailyprofit.me 1bet.com
1pamm.ru
1qingdao.com 1qingdao.com
2345.com 273-fz.ru
28n2gl3wfyb0.ru 3w24.com
2girls1cup-free.com 40cg.com
5-steps-to-start-business.com 5elementov.ru
5u.com 5forex.ru
883zy.com 83net.jp
9icmzvn6.website abbanreddy.com
a14download.com abcdefh.xyz
acc.eu.org abctoppictures.net
absolutelyanalog.com
accessoires-mode.in
acortarurl.es acortarurl.es
addblueoff.com.ua adminshop.com
adf.ly ads.tremorhub.com
ads-seo.men adultactioncam.com
adverster.com
afftrack001.com
afslankpillen2017nl.eu afslankpillen2017nl.eu
agahinameh.com aktivator-windows10.blogspot.com
akita.kz albuteroli.com
albamargroup.com all4invest.info
alessandraleone.com alldubai.biz
allbizne.co.ua allknow.info
allmarketsnewdayli.gdn amazon-seo-service.com
apiluckyleapnet-a.akamaihd.net ameblo.jp
apisecretsaucebi-a.akamaihd.net amehdaily.com
appmsr.org anabolics.shop
arenanews.com.ua anaseracresar.tk
android4fun.org
animali.deagostinipassion.it
apartamentwroclaw.eu
apccargo.com
apibetweenlinesn-a.akamaihd.net
apple.com-cleaner.systems
approvedlocal.co.za
architecturebest.com
arendakvartir.kz arendakvartir.kz
asophoto.com asia-forum.ru
atlant-auto.info asiengirls.net
autonew.biz asrv-a.akamoihd.net
autotrends.today atdedinotuho.tk
aviav.co audiobangout.com
aviav.ru ausergrubhof.info
aviav.ru.com ausmepa.org.au
avon-ukraine.com aussie-prizes.com
ayanaspa.com autowebmarket.com.ua
ayerbo.xhost.ro aversis.net
azartclub.org aviav.eu
babieca.com avitocars.ru
backiee.com avtoarenda.by
banki76.ru avtocredit-legko.ru
beauty-bracelet.com azartmsl.com
belstaffstore.online azbaseimages.net
babyguns.ru
baltgem.com
bank.uz
bannerswap.com
barbourjackets.online
bard-real.com.ua
beachpics.com
belinka.com.ua
beremenyashka.com beremenyashka.com
best-mam.ru bestchoice.cf
best-seo-offer.com bg6s0.com
best-seo-software.xyz bimatoprost-careprost.com
bitcoinpile.com bingoporno.com
bjetjt.com bitcoins-live.ru
bongacams.com bizfly.info
bouda.kvalitne.cz bizlist.com.de
bpro1.top blackcurranthumidifiers.site
brainzpod.win blockety.co
breastaugmentation.co.za blog-hits.com
brg8.com blog.axant.it
brianhenry.co blogrankers.com
brillianty.info blogsfunky672.weebly.com
bristolhotel.com brakehawk.com
btc4u.ru bugshoot.cn
buehne-fuer-menschenrechte.de burn-fat.ga
buttons-for-website.com buybest1.biz
buzz-porno.info buytizanidineonlinenoprescription.blogspot.com
bycontext.com
callawaygolfstore.online
callcafe.info callcafe.info
callejondelpozo.es
cam-kontakte.org cam-kontakte.org
cartierlove.xyz cardiosport.com.ua
celejihad.info celejihad.info
chcu.net chatroulette.video
cheap-pills-norx.com cheapjerseysap.com
cheapbarbour.online christianlouboutinoutlet.win
cheapjerseysa.com
checkhit.com
chiptuninger.com
chocolateslim-en-espana.com
choosecuisine.com
christianlouboutinreplica.win christianlouboutinreplica.win
cleanpcnow.com chuckguilford.com
clickaider.com claytransformations.info
clickbanksites.info
clickhype.com
clknsee.com
clothesforcash.com clothesforcash.com
cobaltpro.ru club-samodelkin.ru
cocolyze.com compliance-brian.xyz
coinsspb.com cookie-law-enforcement-ee.xyz
collegeessay19.blogspot.ru
comeondog.info
compiko.info
compliance-alex.xyz
compliance-elena.xyz
compucelunlock.net
connectionstrenth.com
cookie-law-enforcement-hh.xyz cookie-law-enforcement-hh.xyz
cordstrap.cc coolwallpapers4k.info
costablue.xyz cornomase.win
cougfan.info
country-chic.ru
covadhosting.biz
creativehutindia.com creativehutindia.com
creatives.adbetclickin.pink creditwell.ru
cscwtalkto.site cubs-jerseys.us
customchocolate.business-for-home.com d2jsp.org
customcollegeessays.net darkbooks.org
damedingel.ya.ru ddlmega.net
datadepths.com dealwifi.com
ddsoldes.fr deanmoore.ie
decenttools.com derevesendeco.com
dentalpearls.com.au deshevo-nedorogo.ru
detki-opt.ru detsky-nabytek.info
dfwu1013.info dev78.dioniqlabb.se
diegolopezcastan.com digest-project.ru
discovertreasurenow.com diminishedvalueoforegon.com
domainanalyzing.xyz dimkino.ru
domaincdn.xyz dkvorota.ru
domznaniy.ru dmmspy.com
docstoc.com
doctissimo.fr
dodlive.mil
domain.webkeyit.com
domain2008.com
domini.cat
dosugrostov.site
dotnetdotcom.org dotnetdotcom.org
dscaas.website draniki.org
ebooknovel.club drunkmoms.net
ecookna.com.ua dustyorate.com
ednorxmed.com e-commerce-seo.com
eldiariodeguadalajara.com ec-file.info
electricwheelchairsarea.com ege-essay.ru
elektrischezigarette1.onsugar.com elektrischezigarette1.blog.pl
elektrozigarettekaufen2.blogse.nl elektrischezigarettekaufen2.cowblog.fr
elektrozigaretten1.tumblr.com elektronischezigarettekaufen1.beeplog.com
elitepcgames.com elektrozigaretten2.yn.lt
elvenar.com emergencyneeds.org
empirepoker.com empis.magix.net
englate.com englishdictionaryfree.com
enternet.ee eonpal.com
erectile.bid ereko.ru
ero-advertising.com es5.com
erotikstories.ru essay-writing.work
estibot.com etenininrade.ga
everflora.ru etotupo.ru
expresstoplivo.ru event-tracking.com
extlinks.com evogarage.com
ezigaretteshop.webs.com excitacion.info
factorynightclub.com exoneration-project.us
falcoware.com extractorandburner.com
fantasticpixcool.com ezaz.info
farm26.ru fashionavenuegame.com
farmprofi.net fealq.com
filesdatabase.net
filkhbr.com filkhbr.com
filmfanatic.com filmbokep69.com
financeloan.us filmi-onlain.info
financepoints.eu finejewelryshop.ru
flashlarevista.com fix-website-errors.com
floating-share-buttons.com flirt4free.com
flowwwers.com
flprog.com
forensicpsychiatry.ru
forex.osobye.ru forex.osobye.ru
forum.tvmir.org forexunion.net
forums.toucharcade.com forum20.smailik.org
forums.d2jsp.org
foto-weinberger.at
fotopop.club
fotoxxxru.com fotoxxxru.com
fr-bearings.ru franklinfire.co
free-share-buttons.blogspot.com free-share-buttons.com
free-today.com freemaintenancesysforpcandmac.top
funnymama.com freewebs.com
fym.com.ru freza-sverlo.ru
fz139.ttk.ru front.ru
getdot.ru fuck-paid-share-buttons.xyz
getoutofdebtfree.org gamewrath.com
glass-msk.ru gay.adultgalls.com
glavprofit.ru gemgrab-a.akamaihd.net
gogps.me genericlowlatencyasiodriverhq.aircus.com
goldenggames.com gg.zzyjxs.com
gotorussia.com ghostvisitor.com
gov.yanao.ru gidonline.one
gsasearchengineranker.space gifspics.com
gwebtools.com gloverid.site
hchha.com gombita.info
healthcarestore.info greenzaim.ru
hentaiheroes.com gsasearchengineranker.top
hermesbelts.xyz gwebtools.com.br
hetmanship.xyz hauleddes.com
hidefiles.org haveinc.xyz
homeart.space hd-film.pl
host-protection.com headpharmacy.com
hotgirlhdwallpaper.com headpress.ru
htmlcorner.com health-medical-portal.info
hunterboots.online heartofbeijing.blogspot.com
hunthillfarmtrust.org heliko.no
iamsport.org hitcpm.com
ideashome.id hkdiiohi.skyrock.com
ifirestarter.ru hobild.net
igadgetsworld.com homedecorpicture.us
iideaidekonkatu.info hoporno.com
ilmen.net hornymatches.com
importchinacoach-teach.com horoshieokna.com
infobabki.ru hotdl.in
insomniagamingfestival.com houdom.net
invitefashion.com housediz.com
inzn.ru hoverboard360.nl
ip-guide.com hoztorg-opt.ru
istizanidineanopiate.blogspot.com huimin764128.com
ivearchenceinflu.cf hully.altervista.org
jav-fetish.com ibb.com.ua
jo24news.com idegenvezeto.eu
jofucipiku.tk immigrational.info
joingames.org inboxdollars.com
kakablog.net inet-traffic.com
kamorel.com innoslicon.com
kanimage.com interferencer.ru
kicknights.gq irunfar.com
kinobaks.com islandminingsupply.wordpress.com
kinoplen.ru istizanidineacontrolledsubstance.blogspot.com
ivanstroi.ru
javspace.net
jerseywholesalechinabiz.com
katadhin.co
kazka.ru
kemerovo.zrus.org
keywords-monitoring-your-success.com
keywordsdoctor.com
kletkimehan.ru kletkimehan.ru
krasnodar-avtolombards.ru knigonosha.net
kvartir-remont.biz knowyournextmove.com
lakomka.com.ua kosova.de
landmania.ru kotaku.com
larose.jb2c.me krasnodar.xrus.org
larutti.ru kriokomora.info
leadwayau.com kunstaktien.info
lecbter-relationships.ga kutikomi.net
lechtaczka.net kvartira-sutochno.com
ledis.top lacloop.info
lemon-ade.site lasvegaslockandsafe.com
lernur.net laulini.soclog.se
letslowbefast.today leftofcentrist.com
lincolntheatre.com liky.co.ua
lineavabit.it
linkbux.ru
linksharingt.com linksharingt.com
littlesunraiser.com liran-locks.com
live-cam6.info livesex-amateure.info
livejasmin.com love-baby.cz
ljusihus.se
longadventure.com
lostfilm-online.ru
louboutinshoes.xyz
lovasszovetseg.hu
lovi-moment.com.ua lovi-moment.com.ua
m1media.net luchshie-topcasino.ru
m292.info luckyday.world
mafa-free.com lyrster.com
mararoom.ru machicon-akihabara.info
marblestyle.ru macnewtech.com
marcogrup.com macotool.com
martlinker.com mafcards.ru
massage-info.nl marktforschung-stuttgart.com
maxthon.com mecash.ru
mbiologi.ru meet-flirt-dating.com
meccadumps.net mega-bony2017.pl
meendo-free-traffic.ga memberty.com
megaindex.ru menhealed.net
mensandals.xyz mesto-x.com
message-warning.net microsearch.ru
metallosajding.ru mirmedinfo.ru
mexicosleevegastrectomy.com mjchamonix.org
mhtr.be mmstat.com
mielec.pl mobile.ok.ru
mikrobiologies.ru mobplayer.ru
mil-stak.com monclerjacketsoutlet.pw
minet.club
miniads.ca
mirobuvi.com.ua
moesonce.com
mojpregled.com
moncleronline.xyz moncleronline.xyz
moneyteam24.com moxo.com
moomi-daeri.com mrbitsandbytes.com
morefastermac.trade mrlmedia.net
moscow.online-podarki.com mundoaberrante.com
most-kerch.org musicstock.me
mostantikor.ru my-aladin.com
moviezbonkerssk.cf myhitmp3.club
mozello.ru myperiod.club
mp3downloadhq.com namecrumilchlet.tk
mp3ringtone.info national-today-winning-winner.club
msfsaar.de nero-us.com
mtmtv.info networkcheck.xyz
muabancantho.info nicefloor.co.uk
muizre.ru niroo.info
muschisexbilder.com nomuos.it
myonigroup.com nsatc.net
myshopmatemac.com nufaq.com
na-telefon.biz nvformula.ru
narco24.me nzfilecloud.weebly.com
nastydollars.com oakridgemo.com
nationalbreakdown.com obnal.org
naturalshair.site
netcheckcdn.xyz
new7ob.com
newstraveller.ru
next-dentists.tk
nfljerseysforsalewholesaler.com
ngps1.ru
nibbler.silktide.com
ningessaybe.me
nodding-passion.tk
nofreezingmac.work
npoet.ru
nrjmobile.fr
nw-servis.ru
o-o-8-o-o.com
odesproperty.com odesproperty.com
offer.wpsecurity.website ok.ru
ohmyrings.com okayimage.com
ok-ua.info onclickpredictiv.com
olvanto.ru onefilms.net
omoikiri-japan.ru onload.pw
onetravelguides.com onthemarch.co
online247.ml orgasmus-virtual.com
onlythegames.com papasdelivery.ru
open-odyssey.org paradontozanet.ru
openmediasoft.com photostudiolightings.com
osagonline.ru pic-re.blogspot.com
otbelivanie-zubov.com
ownshop.cf
paintingplanet.ru
paphoselectricianandplumber.com
partnerads.men
pendelprognos.se
perm-profnastil.ru
phpdevops.com
pictures-and-images.com
picturesboss.com
pintattoos.com
pinup-casino1.ru pinup-casino1.ru
pistonclasico.com pizdopletka.club
pix24x7.com plaff-go.ru
pochemychka.net plastgranar.nu
pochtovyi-index.ru polimga.pw
pokerniydom.ru popads.net
pomoc-drogowa.cba.pl pornhub-forum.ga
porno-raskazy.ru pornonik.com
porno-transsexuals.ru pornophoto.xyz
pornoforadult.com porto.abuilder.net
pornosexrolik.com pourvous.info
poshiv-chehol.ru pp-budpostach.com.ua
pozdrawleniya.com praisong.net
predmety.in.ua prefersurvey.net
preg.marketingvici.com
pretty-mart.com pretty-mart.com
privhosting.com princeadvantagesales.com
productarium.com profolan.pl
professionalwritingservices15.blogspot.ru promoforum.ru
profit-opportunity.com pufip.com
promalp-universal.ru qexyfu.bugs3.com
propranolol40mg.blogspot.com quebec-bin.com
prostitutki-kharkova.org raavidesigns.com
psoriasis-file.trade ragecash.com
pssucai.info rank-checker.online
ptr.ruvds.com ranksonic.com
pushdata.sendpulse.com rarbg.to
puzo2arbuza.ru razvratnoe.org
qpypcx.com realmonte.net
raschtextil.com.ua realnye-otzyvy.info
recipedays.ru refads.pro
redirectme.net registrydomainservices.com
reeyanaturopathy.com renecaovilla.online
responsinator.com renhacklids.tk
ring4rhino.com rennlist.com
rniaeba.ga rentalcarnavi.info
rocketchange.ru rezeptiblud.ru
rockingclicks.com rfd-split.hr
royal-betting.net ricorsogiustizia.org
rucrypt.com ringporno.com
rn-to-bsn.com
ros-ctm.ru
rozalli.com
running-line.ru
runstocks.com runstocks.com
ruscopybook.com ruscopybook.com
russia-tao.ru rusenvironmental.net
rusvideos.su s-iwantyou.com
rybalka-opt.ru sabaapress.com
sady-urala.ru sammyweaver.com
salmonfishingsacramentoriver.com
sanyuprojects.com sanyuprojects.com
saratov.xrus.org sape.top
sashagreyblog.ga sbdl.no
satoristudio.net sbricur.com
screpy.com scanner-don.top
se.bnt-team.com searchinquire.com
search.pch.com searchtooknow-a.akamaihd.net
securityallianceservices.com seemoreresultshu-a.akamaihd.net
seogadget.ru semxiu.com
seonetwizard.com
seorankinglinks.us
sergiorossistore.online sergiorossistore.online
service.adtech.us
servicecenter.co.ua
sevenstars7.com sevenstars7.com
sex-dating.co sexkontakteao.info
sex-tracker.de sexphoto.site
sex.hotblog.top sextracker.be
sexcamamateurchat.com sexxdate.net
sexpornotales.com
sfd-chess.ru
shakhtar-doneck.ru
sharebutton.org
shodanhq.com shodanhq.com
shoesonlinebuy.xyz sildenafilcitratemed.com
sideeffectsoftizanidine.blogspot.com simplepooltips.com
signal03.ru site-speed-check.site
siha.de site5.com
simplesite.com siteonomy.com
sitevalued.com
sitopreferito.it sitopreferito.it
skanninge.se skypasss.com
slonechka.ru slayerlife.com
snjack.info slim.sellany.ru
social-search.me smartadserver.com
soft-terminal.ru snjatie-geroinovoy-lomki.ru
songoo.wz.cz social-s-hhh.xyz
sotkal.lark.ru socialbookmarksubmission.org
splendorsearch-a.akamaihd.net sogimlecal.tk
sports-supplements.us sonnikforme.ru
spy-sts.com soviet-portal.do.am
ssconstruction.co spb.ru
stairliftstrue.com sportbetfair.com
starwars.wikia.com spywarespy.com
stathat.com statustroll.com
stromerrealty.com steebook.com
superkanpo.com steelmaster.lv
t3chtonic.com stevemonsen.com
tako3.com stpicks.com
stroicol.net
suchenindeutschland.com
sucsesofinspiration.com
sunflowerdrawingpaintings.blogspot.com
svarbit.com
swagbucks.com
taaaak.com
tam-gde-more.ru
td-l-market.ru td-l-market.ru
telefonsex-ohne0900.net tecnoteakviareggio.it
telefonsexi.com teenforporn.com
tgtclick.com tehngr.ru
the-torrent-tracker.blogspot.com templates.franklinfire.co
thecoolimages.net theautoprofit.ml
theguardlan.com thedownloadfromwarez.blogspot.com
thefotosgratis.eu
thepantonpractice.co.uk thepantonpractice.co.uk
thewebsitetemplate.info thetattoohut.com
thin.me.pn thewomenlife.com
tizanidine4mgprice.blogspot.com tilido.com
tizanidine4mguses.blogspot.com timdreby.com
tizanidineinteractions.blogspot.com tizanidinedruginteractions.blogspot.com
tizanidinepills.blogspot.com tizanidinedrugtest.blogspot.com
tnaionline.org tizanidinehydrochloride2mg.blogspot.com
tizanidinehydrochloride4mgstreetvalue.blogspot.com
tizanidinenarcotic.blogspot.com
tk-assortiment.ru
tnctrx.com
topdownloads.ru topdownloads.ru
topshef.ru topflownews.com
torrentdownloadhub.com topkarkas.com
torrnada.ru torrents.cd
toxicwap.com tour-line.net
traffic2cash.org trafficmonetize.org
tsan.net traffique.net
tuckpointingmasonrysystems.com trahic.ru
turn-up-life.life trailer.cinemaflix.website
tvnewsclips.info treasuretrack-a.akamaihd.net
tvoystartup.ru ttrraacckkrr.com
ua-company.ru tubo360.com
ufa.xrus.org tv-spoty.info
unisexjewelry.org tx41tclega.ru
unrealcommander.com ua.tc
uptime-alpha.net uprour.com
ural-buldozer.ru uytmaster.ru
usbggettwku.ga validdomain.xyz
valuado.com vclicks.net
vancleefreplica.pw vekzdorov.ru
vandrie-ict.nl vesnatehno.com
vchulkah.net video-chat.cn
velpanex.ru vintontech.info
videositename.com vipms.ru
videtubs.pl vipps.com.my
virtualbb.com vizitki.net
vkonche.com vksex.ru
vpnmouse.com vodkoved.ru
voloslove.ru
vsexkontakte.net vsexkontakte.net
vzlomtw.com vzube.com
w3data.co weblibrary.win
websites-reviews.com website-speed-up.top
weburok.com websiteexplorer.info
weprik.ru weddingdresses.xyz
whiteelephantwellington.com wemedinc.com
wildcattube.com winx-play.ru
wladimirpayen.com wiosenny-bon-1500.pl
worldhistory.biz witherrom55.eklablog.fr
wowas31.ucoz.ru woman-orgasm.ru
wttavern.com woman-tampon.ru
www.arenda-yeisk.ru wordpresscore.com
www.labves.ru world-mmo.com
www.solartek.ru worldtraveler.world
wyniki-lista.pl wrona.it
x-mix.info wstroika.ru
x69ty.ru www.kabbalah-red-bracelets.com
xclicks.net www.wohnkabinen-shop.de
xedserver.com x-stars.ru
xn-----7kceclhb4abre1b4a0ccl2fxch1a.xn--p1ai x-true.info
xn----7sbaphztdjeboffeiof6c.xn--p1ai xn----7sbahjd3btneuw1joc.xn--p1ai
xn--80aanaardaperhcem4a6i.com xn--80aaagvmjabrs1aoc9luc.xn--p1ai
xn--80ak6aa92e.com xn--l1aengat.xn--p1ai
xsfetish.org xn--q1a.xn--b1aube0e.xn--c1acygb.xn--p1ai
xxxhdvideo.site xtremeeagles.net
y8games-free.com yhit.press
yachts-cruise.info
yellocloud.be
youandcredit.ru youandcredit.ru
youbrainboost.asia youghbould.wordpress.com
youradexchange.com yousense.info
z-master.ru youtubologia.it
zebramart.ru zarabotat-na-sajte.ru
zed21.net zarajbuilders.com
zixizop.net.ru zarepta.com
zona-aqua.ru zawyna.ua
zrus.org zebradudka.com
zryydi.com zeroredirect7.com
zs2vm.top zoodrawings.com
zvetki.ru zoogdisany.com
zscalerone.net
zscalertwo.net
zverokruh-shop.cz

488
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
0c47f8422d3f.com 123kuma.com
100dollars-seo.com 12masterov.com
5ws.dating-app.ru 1688.com
70casino.online 1kdailyprofit.me
7fon.ru 1kinobig.ru
7minuteworkout.com 2000k.ru
8gold.com 23kw.ru
aarbur.com 57883.net
adnotbad.com 5i2.net
ads.tremorhub.com a1security.com.ua
advertisingtag.net abiente.ru
abtasty.com
adman.gr
adminshop.com
adzerg.com adzerg.com
afslankpillen2017nl.eu adzpower.com
amazingpic.net affrh2015.com
apccargo.com agroeconom.kz
apelsinnik.website akita.kz
apibrowsesmartne-a.akamaihd.net alert.scansafe.net
apimegabrowsebiz-a.akamaihd.net all4invest.ru
apiwoodensealcom-a.akamaihd.net alloysteel.ru
appmsr.org allpdfmags.net
artefakct.com allstatesugarbowl.org
articlesdirectoryme.info alpharma.net
artparquet.ru amanda-porn.ga
android-vsem.org
apartamentwroclaw.eu
apessay.com
arabseyes.com
artpicso.com
asiengirls.net asiengirls.net
autochoixspinelli.com aussie-prizes.com
autogrep.ru auto-zapchasti.org
b-styles.xyz autoua.top
backlinkwatch.com avtochehli.by
bala.getenjoyment.net avtointeres.ru
battle.net belinka.com.ua
bingoporno.com best-deals-products.com
biznesschat.net bestofpicture.com
blockworld.ru bosefux.esy.es
bloggers.nl bristolhotel.com
bmw-ark.ru buyk.host.sk
bochemit.com.ua buzzonclick.com
bolegapakistan.com buzzzg.men
bonzybuddy.com cercacamion.it
brainboostingsupplements.org cheapjerseysbizwholesale.us
braindaily.xyz cialischmrx.com
bugshoot.cn communisave.co.za
cdn.walkme.com compliance-jess.top
celejihad.info compucelunlock.net
cheap-pills-norx.com customboxes4less.com
coindirect.io dafatiri.com
compliance-george.xyz darodar.com
cookie-law-enforcement-hh.xyz datract.com
d-black.bz daymusam.com
damasarenai.info dcj-nn.ru
detskie-zabavi.ru dentalpearls.com.au
dfiles.me destinationrealestate.com
digitalassetmanagement.site detki-opt.ru
digitalfaq.com digital-sale.su
directrev.com downloads-whatsapp.com
djonwatch.ru dstroy.su
djstools.com ebonyporn.site
ednorxmed.com elektrozigarette2.wordpressy.pl
egvar.net elektrozigarettekaufen1.devhub.com
ekspresihati.info emergencyneeds.org
elektrischezi.canalblog.com exhibitionplus.eu
elitepcgames.com expertnaya-ocenka.ru
elitesportsadvisor.com ezigarettekaufen2.blox.pl
eshop4u.jp facebook-mobile.xyz
essayassist.com faithe.top
expertblog.info familyphysician.ru
extremepornos.net fenoyl.batcave.net
ezaz.info filmci.pro
fashion-mk.net forex.osobye.ru
fettefrauen.net forexunion.net
findpics.pw forums.d2jsp.org
finemanteam.com franecki.net
forpostlock.ru free-deals.faith
free-fb-traffic.com frequiry.com
freevpn.space front.ru
fuckingawesome.com fuel-gas.com
fx-brokers-review.com gambarxkata.co
g33.org genericlowlatencyasiodriverhq.aircus.com
gay-file.com get-seo-domain.com
gdebestkupit.ru getoutofdebtfree.org
ggiaro.com ghostvisitor.com
gne8.com gktt.ru
gok-kasten.net gorabagrata.ru
google-liar.ru
goroda-vsego-mira.ru
greatidea.marketing greatidea.marketing
gsasearchenginerankerhelp.com gsmtlf.ru
heliko.no hazardky.net
homedecorpicture.us hdimagegallery.net
host-protection.com hdpixion.com
host-tracker.com hmmm.cz
hotkeys.com homeart.space
hoverboard360.at iamsport.org
igithab.com images.gyffu.com
iinstalll-fii1leis.jus0wil.pp.ua infobabki.ru
imgata.com innoslicon.com
impisr.edunsk.ru intermesh.net
intimshop-fantasy.ru iscblog.info
ivanstroi.ru jamiembrown.com
iwantmyfreecash.com janettabridal.com
jackpotchances.com javrip.net
jasonpartington.com johnrobertsoninc.com
jav-fetish.com jolic2.com
kadashihotel.com katjimej.blog.fc2.com
kerwinandcariza.com kinofak.net
keywordhouse.com komp-pomosch.ru
kicknights.gq komputers-best.ru
kino-ecran.ru konica.kz
kino2018.club kredit-pod-zalog-krasnodar.ru
kiprinform.com lancheck.net
klikbonus.com letto.by
kotaku.com life-instyle.com
krynica.info lifebyleese.com
lennatin.info limads.men
listiseltemournlan.gq lion.playtap.us
littlesexdolls.com lisque.batcave.net
livejasmin.com liveinternet.ru
lkbennettoutlet.online loadopia.com
lodki-pvh.dp.ua lsex.xyz
longgreen.info magda-gadalka.ru
louboutinreplica.xyz malls.com
lovi-moment.com.ua manimpotence.com
mabdoola.blogspot.com massage-info.nl
mail.allnews24.in mebel-ekb.com
makemoneyonline.com medicovi.com
marblestyle.ru medkritika.ru
matrixalchemy.com mega-polis.biz.ua
me-ke.com megavolt.net.ua
med-zdorovie.com.ua minet.club
medi-fitt.hu misandesign.se
medizinreisen.de mixed-wrestling.ru
mega-bony2017.pl mmoguider.ru
megaapteka.ru music7s.me
mielec.pl muycerdas.xxx
missvietnam.org nationalbreakdown.com
moetomnenie.com naturalpharm.com.ua
moivestiy.biz nofreezingmac.click
morepoweronmac.trade noscrapleftbehind.co
moscow.online-podarki.com novosibirsk.xrus.org
mouselink.co nsatc.net
moxo.com olvanto.ru
mrsdalloways.com onclickpredictiv.com
mykings.pw oneclickfiles.com
namenectar.com oranga.host.sk
naperehresti.info osnova3.ru
narosty.com pagesense.com
nlfjjunb5.ru parvezmia.xyz
normalegal.ru pc-virus-d0l92j2.pw
obiavo.in photo-clip.ru
onetravelguides.com pk-pomosch.ru
onlythegames.com playfortuna-play.ru
ooomeru.ru popugaychiki.com
piluli.info pornobrazzers.biz
pinapchik.com pornoinn.com
piratecams.com portadd.men
pizza-imperia.com pr-ten.de
plohaya-kreditnaya-istoriya.ru pro-poly.ru
popunder.ru promoheads.com
popup-hgd.xyz prostitutki-yaroslavlya.org
pornokorol.com real-time-analytics.com
prefersurvey.net redirectingat.com
preparevideosafesystem4unow.site reimageplus.com
primedice.com relax.ru
printie.com rfserial.net
prom23.ru
prospekt-st.ru
psvita.ru
ptr.ruvds.com
puserving.com
py100.ru
quickcashlimited.com
r-e-f-e-r-e-r.com
rapevideosmovies.com
resant.ru
rezeptiblud.ru
ribieiendom.no ribieiendom.no
roll123.com robertefuller.com
rozalli.com rockma.se
saneyes.com rollercoin.com
sankt-peterburg.nodup.ru roma-kukareku.livejournal.com
scanner-jessica.top salut-camp.ru
searchinquire.com sarafangel.ru
seasonvar.ru sbprabooks.com
seccioncontrabajo.com scanner-fred.top
security60-e.com scanner-george.top
servisural.ru sdi-pme.com
sex-tracker.com search-error.com
searchengineranker.email
searchmywindow-a.akamaihd.net
seksvideoonlain.com
seojokes.net
sex-tracker.de sex-tracker.de
sexsaoy.com sexkvartal.com
sildenafilcitratemed.com sexyali.com
silvermature.net sexytrend.ru
simplesite.com sitechecker.pro
sitevalued.com siteexpress.co.il
skatestick.bid skytraf.xyz
songplanet.ru slavic-magic.ru
spb.afora.ru snjatie-geroinovoy-lomki.ru
starpages.net social-vestnik.ru
sterva.cc souvenir.cc
stpicks.com spy-sts.com
strag-invest.ru squidoo.com
strigkaomsk.ru staticfs.host
stroilka.info steame.ru
stroy-portal22.ru sticken.co
supernew.org store-rx.com
superoboi.com.ua stpolice.com
svetlotorg.ru strana-krasoty.ru
taqplayer.info sugvant.ru
tecspb.ru sygraem.com
thegalerie.eu symphonyintegratedhealthcare.com
tizanidineandhydrocodone.blogspot.com tastyfoodideas.com
toloka.hurtom.com tattomedia.com
topquality.cf tattoo33.ru
tourismvictoria.com teguh.info
track2.shop telegramdownload10.com
tvand.ru tizanidine4mgstreetprice.blogspot.com
twincitiescarservice.com tizanidineduringpregnancy.blogspot.com
udsgame.online tizanidineforopiatewithdrawal.blogspot.com
uggbootsoutletsale.us tonerbox.kz
unpredictable.ga torrentdownloadhub.com
urzedowski.eu traffic-club.info
vandrie-ict.nl trafficreceiver.club
vbabule.net trucri.me
vclicks.net tsan.net
viberdownload10.com tt-ipd.info
video-camer.com tuberkuleznik.ru
videochat.bz ucoz.ru
videospornogratisx.net urlopener.com
vykup-avto-krasnodar.ru vapeface.club
wahicbefa31.soup.io varikozdok.ru
wcb.su vduplo.ru
web.cvut.cz vgoloveboli.net
website-speed-checker.site warningwar.ru
wellcome2slovenia.ru weprik.ru
wesharepics.info wetgames.ru
westen-v.life where-toget.com
whatsupinfoley.com wholinkstome.com
winterclassichockeyjerseys.com winwotgold.pl
wnoz.de wpthemedetector.co.uk
wpsecurity.website xaijo.com
xfluro.com xn--24-glceagatoq7c2a6ioc.xn--p1ai
xn-----6kcaacnblni5c5bicdpcmficy.xn--p1ai xn--80aaafbn2bc2ahdfrfkln6l.xn--p1ai
xn----7sbbagbq7bd5aheftfllo4m.xn--p1ai xn--80ajbshivpvn2i.xn--p1ai
xuki.us xn--e1afanlbnfckd7c3d.xn--p1ai
xxx-cam.webcam xn--q1a.xn--b1aube0e.xn--c1acygb.xn--p1ai
yaminecraft.ru xxxrus.org
yellowstonesafaritours.com
youtubedownload.org youtubedownload.org
zatjmuzu.info zapatosenventa.info
zirondelli.it zarajbuilders.com
zoosexart.com zdesoboi.com
zvezdagedon.ru zigarettenonl.canalblog.com
zophim.me
zskdla.site

10
dev-tools/test_units/ratelimittest-master.txt
View file

@ -581,14 +581,4 @@
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html> </html>

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.84 0; 10.1.1.17 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2021.10.2644 ### Version: V4.2021.10.2645
### Updated: Mon Oct 11 10:12:41 UTC 2021 ### Updated: Mon Oct 11 22:02:52 UTC 2021
### Bad Bot Count: 623 ### Bad Bot Count: 623
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2021.10.2644 ### Version: V4.2021.10.2645
### Updated: Mon Oct 11 10:12:41 UTC 2021 ### Updated: Mon Oct 11 22:02:52 UTC 2021
### Bad Bot Count: 623 ### Bad Bot Count: 623
################################################### ###################################################
### Version Information ## ### Version Information ##