vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-03 19:20:16 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2022.06.3146 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2022-06-04 10:09:14 +00:00
parent bad832e50e
commit f9420cd3eb
47 changed files with 100752 additions and 100759 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.06.3145 #### Version: V4.2022.06.3146
#### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.06.3145 #### Version: V4.2022.06.3146
#### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -14,7 +14,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2022.06.3145 #### Version: V4.2022.06.3146
#### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

12456
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2022.06.3145 #### Version: V4.2022.06.3146
#### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

12460
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

12460
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

12460
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

12460
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.107 1; 10.1.0.17 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.107 0; 10.1.0.17 0;
127.0.0.1 0; 127.0.0.1 0;

12460
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.107 1; 10.1.0.17 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.107 0; 10.1.0.17 0;
127.0.0.1 0; 127.0.0.1 0;

12460
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.107 1; 10.1.0.17 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.107 0; 10.1.0.17 0;
127.0.0.1 0; 127.0.0.1 0;

12460
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
3145 3146

12460
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

12460
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.125.97.185 0; 20.228.163.102 0;

12460
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.107 1; 10.1.0.17 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.107 0; 10.1.0.17 0;
127.0.0.1 0; 127.0.0.1 0;

12460
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.107 1; 10.1.0.17 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.107 0; 10.1.0.17 0;
127.0.0.1 0; 127.0.0.1 0;

12460
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.107 1; 10.1.0.17 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.107 0; 10.1.0.17 0;
127.0.0.1 0; 127.0.0.1 0;

12460
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.125.97.185 0; 20.228.163.102 0;

12460
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.125.97.185 0; 20.228.163.102 0;

12460
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.107 1; 10.1.0.17 1;
127.0.0.1 1; 127.0.0.1 1;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
Badass BDFetch
Battleztar Bazinga Evil
Image Fetch ExtractorPro
InfoTekies Grabber
Lmspider LinkWalker
OnCrawl NetLyzer
SemrushBot SpankBot
Tracemyfile True_Robot
URLy.Warning WebFetch
pcBrowser seocompany.store

302
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
01h4x.com 01h4x.com
404checker
80legs
ADmantX ADmantX
ALittle Client
Aboundex Aboundex
Acunetix Acunetix
AfD-Verbotsverfahren
AhrefsBot AhrefsBot
AiHitBot
Aipbot Aipbot
AlphaBot AlphaBot
Anthill Apexoo
Asterias Aspiegel
AwarioRssBot Atomseobot
AwarioSmartBot
BBBike BBBike
BDFetch
BLEXBot BLEXBot
BackWeb BackDoorBot
Backlink-Ceck
BacklinkCrawler
Badass
Bandit
Barkrowler Barkrowler
BatchFTP BatchFTP
BetaBot Battleztar Bazinga
Bigfoot Bigfoot
Black Hole Bitacle
Blackboard Blackboard
BlowFish Blow
Boardreader
Bolt Bolt
BuiltWith Brandwatch
Buck
Bullseye
BuzzSumo
CODE87 CODE87
CherryPicker CensysInspect
Chlooe CheeseBot
Citoid Citoid
Claritybot Claritybot
Cliqzbot Cliqzbot
Cocolyzebot Copier
CopyRightCheck CopyRightCheck
Cosmos Cosmos
Craftbot Craftbot
Crawling at Home Project CrazyWebCrawler
Crescent
Curious Curious
CyotekWebCopy
DBLBot
DIIbot
DSearch DSearch
Demon
Deusu Deusu
Digincore Devil
Discoverybot DnyzBot
DittoSpyder DomCopBot
DomainCrawler DomainCrawler
Download Wonder
Dragonfly Dragonfly
Drip
EasyDL
Ebingbong Ebingbong
EirGrabber Ecxi
Evil EroCrawler
Express WebPictures
ExtLinksBot
ExtractorPro ExtractorPro
Ezooms EyeNetIE
FHscan FemtosearchBot
Firefox/7.0 Foobot
FlashGet
Flunky
Freeuploader Freeuploader
Fuzz FrontPage
GT::WWW FyberSpider
GalaxyBot G-i-g-a-b-o-t
Genieo GermCrawler
GetRight GetRight
Gotit Gigabot
Go!Zilla
GoZilla
GrabNet
Grabber Grabber
Grafula Grafula
GrapeFX GrapeshotCrawler
GridBot
HEADMasterSEO
HMView HMView
HTTP::Lite Haansoft
HTTrack HonoluluBot
Havij IDBot
Heritrix IRLbot
Humanlinks
Iblog Iblog
IlseBot Id-search
IndeedBot InfoNaviRobot
Indy Library
InfoTekies InfoTekies
Intelliseek
InterGET
Internet Ninja
Iria
Iskanie
JOC Web Spider JOC Web Spider
Jbrofuzz
Jetty
JikeSpider JikeSpider
Joomla Joomla
Jyxobot Jyxobot
Kenjin Spider Keybot Translation-Search-Machine
Kozmosbot
LNSpiderguy
LWP::Simple
Lanshanbot
Larbin Larbin
Leap
LeechGet LeechGet
LexiBot LieBaoFast
LibWeb Lightspeedsystems
Libwhisker
Likse Likse
LinkScan
LinkWalker
LinkextractorPro LinkextractorPro
LinkpadBot
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Lipperhey Lipperhey
MIDown tool
MIIxpc MIIxpc
MJ12bot MJ12bot
MQQBrowser Mag-Net
MTRobot Mail.RU_Bot
Magnet Majestic SEO
MarkWatch Majestic-SEO
Masscan
Mata Hari Mata Hari
Mb2345Browser Mb2345Browser
Meanpathbot Mediatoolkitbot
Metauri Microsoft Data Access
Minefield Moblie Safari
Mojolicious Mojolicious
MolokaiBot Mozlila
Morfeus Fucking Scanner
Mr.4x3 Mr.4x3
Musobot Msrabot
NICErsPRO NICErsPRO
NPbot NPbot
NearSite Navroad
Needle Nessus
Netcraft Net Vampire
Nettrack NetSpider
Niki-bot Nibbler
NimbleCrawler
Nimbostratus
Ninja Ninja
OpenLinkProfiler Nuclei
Nutch
Offline Explorer
Offline Navigator
OpenVAS
Openfind Openfind
Openvas
OrangeBot
OrangeSpider OrangeSpider
OutfoxBot
PHPCrawl
POE-Component-Client-HTTP POE-Component-Client-HTTP
PageAnalyzer PageScorer
PageGrabber
PageThing.com PageThing.com
Panscient
Papa Foto Papa Foto
PeoplePal Pi-Monster
Petalbot Picsearch
PictureFinder
Piepmatz Piepmatz
Pimonster Pimonster
Pixray PleaseCrawl
Pockey
ProPowerBot ProPowerBot
QueryN Metasearch ProWebWalker
Probethenet
Pu_iN
PxBroker
RSSingBot RSSingBot
RankActiveLinkBot
RankingBot RankingBot
RankingBot2
Rankivabot
RankurBot RankurBot
Recorder ReGet
RedesScrapy RealDownload
Ripper Rogerbot
SBIder SBIder
SEOkicks SEOkicks
SEOlyticsCrawler SEOprofiler
SISTRIX SISTRIX
ScanAlert
Scanbot
Scrapy
Screaming Screaming
ScreenerBot Semrush
Searchestate SemrushBot
SemanticJuice
SentiBot SentiBot
SeobilityBot SeobilityBot
Site Sucker Seomoz
SiteCheckerBotCrawler Siphon
SiteExplorer SiteExplorer
SiteSnagger SiteLockSpider
SmartDownload Siteimprove
Snake
Snapbot Snapbot
SocialRankIOBot SocialRankIOBot
Sociscraper Sociscraper
Sogou web spider Sogou web spider
SpaceBison SpaceBison
SpankBot SpankBot
Sqworm Spinn3r
Steeler
Stripper Stripper
Sucuri Sucuri
SuperBot SuperBot
SuperHTTP SurveyBot
T0PHackTeam Suzuran
T8Abot Swiftbot
Teleport Telesoft
TeleportPro TightTwatBot
Telesphoreo Tracemyfile
TheNomad
Toata
Trendiction Trendiction
Trendictionbot
TurnitinBot
TwengaBot
URLy Warning URLy Warning
URLy.Warning VCI
UnisterBot Vagabondo
V-BOT VoidEYE
VB Project Voil
Vacuum
Voltron Voltron
WASALive-Bot WASALive-Bot
WPScan WBSearchBot
WWW-Collector-E WWW-Collector-E
WWW-Mechanize
WWWOFFLE WWWOFFLE
Wallpapers Web Auto
WallpapersHD Web Enhancer
WeSEE Web Fetch
Web Collage
Web Pix Web Pix
WebGo IS Web Sauger
WebReaper Web Sucker
WebStripper WebCopier
Webalta WebWhacker
Webshag WebZIP
WebsiteExtractor Website Quester
Whack
Who.is Bot
WinHTTrack WinHTTrack
WiseGuys Robot
Woobot Woobot
Xaldon WebSpider Xaldon WebSpider
YoudaoBot Xaldon_WebSpider
Zauba Zauba
Zermelo Zermelo
Zitebot Zeus
ZmEu
ZoomBot ZoomBot
ZyBorg
adscanner
arquivo-web-crawler arquivo-web-crawler
arquivo.pt backlink-check
coccocbot cah.io.community
cognitiveseo cognitiveseo
crawl.sogou.com crawl.sogou.com
crawler.feedback crawler4j
demandbase-bot dataforseo.com
domainsproject.org domainsproject.org
eCatch
facebookscraper facebookscraper
instabid gopher
ips-agent heritrix
iubenda-radar internetVista monitor
lwp-request meanpathbot
mediawords netEstate NE Crawler
pcBrowser
plumanalytics
polaris version polaris version
seostar probe-image-size
sitechecker.pro spyfu
voyagerx.com sysscan
x22Mozilla webpros.com
zgrab x09Mozilla

298
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
01h4x.com 404checker
360Spider
404enemy
AIBOT
ASPSeek
Abonti Abonti
Aboundex Aboundex
Aboundexbot Acunetix
AiHitBot AiHitBot
Aipbot Aipbot
Anarchie Alligator
Anarchy AlphaBot
Aspiegel Anarchy99
Apexoo
Atomseobot Atomseobot
Attach
AwarioRssBot
AwarioSmartBot
BBBike
BDCbot
BLEXBot BLEXBot
BackDoorBot Backlink-Ceck
Barkrowler BacklinkCrawler
Bandit
BatchFTP BatchFTP
BetaBot Bigfoot
Bitacle Bitacle
Black Hole Bolt
Blackboard Brandprotect
BotALot BuiltBotTough
Brandwatch
Buck
BuiltWith
BunnySlippers BunnySlippers
CATExplorador BuzzSumo
CODE87 CCBot
CSHttp
Cegbfeieh Cegbfeieh
CensysInspect CensysInspect
Chlooe CheTeam
Cliqzbot CheeseBot
Claritybot
Cloud mapping
CopyRightCheck CopyRightCheck
Cosmos Copyscape
Crawling at Home Project Craftbot
CrunchBot DBLBot
DSearch DTS Agent
DatabaseDriverMysqli
Demon Demon
Dirbuster Deusu
Discobot Devil
DittoSpyder
DnBCrawler-Analytics
DomCopBot DomCopBot
DomainAppender DomainAppender
DomainSigmaCrawler DomainSigmaCrawler
Domains Project DomainStatsBot
ECCP/1.0 Dotbot
EMail Siphon Download Wonder
Dragonfly
Drip
EMail Wolf
EasyDL EasyDL
Ecxi Ebingbong
Evil Evil
Exabot
Express WebPictures Express WebPictures
ExtractorPro ExtLinksBot
EyeNetIE Extractor
Extreme Picture Finder
FDM FDM
Fimap
Firefox/7.0 Firefox/7.0
Flunky FlashGet
Foobot Foobot
Freeuploader FrontPage
FyberSpider FyberSpider
Fyrebot Fyrebot
GT::WWW GT::WWW
GetRight GalaxyBot
Genieo
GermCrawler
GetWeb GetWeb
Gotit Gigabot
GrapeFX Grabber
Grafula
GridBot
HEADMasterSEO HEADMasterSEO
HaosouSpider
Harvest Harvest
HonoluluBot Havij
Hloader
Humanlinks
HybridBot HybridBot
IDBTE4M
IRLbot IRLbot
Id-search Id-search
IlseBot
IndeedBot
InfoNaviRobot
InfoTekies
Intelliseek
Iskanie Iskanie
IstellaBot
JamesBOT JamesBOT
JetCar JennyBot
JikeSpider Jetty
JustView
Keyword Density Keyword Density
Kinza Kinza
Kozmosbot Kozmosbot
LNSpiderguy LNSpiderguy
LWP::Simple LWP::Simple
Larbin Lanshanbot
LeechGet Leap
LexiBot LeechFTP
LibWeb
LinkScan
Linkbot Linkbot
LinkpadBot LinkextractorPro
LinqiaMetadataDownloaderBot LinksManager
LinqiaRSSBot LinqiaRSSBot
LinqiaScrapeBot
Lipperhey Lipperhey
Lipperhey Spider
Litemage_walker Litemage_walker
Ltx71 Lmspider
MFC_Tear_Sample MIDown tool
MJ12bot MJ12bot
MTRobot Magnet
Majestic12 MauiBot
MarkWatch
Masscan
Mata Hari
Mb2345Browser Mb2345Browser
MeanPath Bot
MegaIndex.ru
Metauri
Microsoft Data Access Microsoft Data Access
Moblie Safari Minefield
Mojeek Mojeek
MolokaiBot MolokaiBot
Msrabot Mozlila
NICErsPRO Name Intelligence
Nameprotect
Navroad
Nessus
Net Vampire
NetLyzer NetLyzer
NetMechanic
NetZIP NetZIP
Nettrack Netvibes
NextGenSearchBot NextGenSearchBot
NimbleCrawler
Nimbostratus
Nmap Nmap
Nuclei Octopus
Offline Explorer
OnCrawl OnCrawl
OpenLinkProfiler OpenLinkProfiler
Openfind OpenVAS
Openvas OutfoxBot
PageAnalyzer PHPCrawl
Pandalytics PageThing.com
Papa Foto Panscient
Petalbot Petalbot
Pi-Monster Pi-Monster
Picsearch
PictureFinder PictureFinder
Piepmatz
Pimonster
Pixray Pixray
Pockey Pockey
ProPowerBot Pump
ProWebWalker PxBroker
Quick-Crawler PyCurl
RankActiveLinkBot RSSingBot
RankingBot RankingBot
RankingBot2 RankingBot2
RankurBot RocketCrawler
Re-re SEOkicks
ReGet SalesIntelligent
RealDownload Scrapy
RebelMouse
Rogerbot
SBIder
SMTBot
Screaming
ScrepyBot ScrepyBot
Searchestate
SearchmetricsBot SearchmetricsBot
Seekport SeoSiteCheckup
SiteCheckerBotCrawler Shodan
SiteExplorer
SiteLockSpider SiteLockSpider
SiteSucker SiteSnagger
Sitebeam
Sitevigil
SlySearch
Snake Snake
SocialRankIOBot Snapbot
Sociscraper Snoopy
Sogou web spider Sogou web spider
Sottopop
SpaceBison
SpankBot
Spbot
Sqlworm
Sqworm
Stripper Stripper
Sucker
Sucuri Sucuri
SuperHTTP SuperBot
SurveyBot SurveyBot
T8Abot Suzuran
T0PHackTeam
Teleport
Telesphorep Telesphorep
TheNomad TheNomad
Thumbor
Titan Titan
Trendictionbot Toweyabot
Turnitin Turnitin
Twice TurnitinBot
UnisterBot TwengaBot
URLy Warning
URLy.Warning
VB Project
VCI VCI
Vacuum Vacuum
Vagabondo
VelenPublicWebCrawler
VeriCiteCrawler VeriCiteCrawler
VidibleScraper
VoidEYE VoidEYE
Voil
WASALive-Bot
WBSearchBot
WISENutbot
WallpapersHD WallpapersHD
Web Pix WeSEE
Web Collage Web Collage
WebFetch Web Fuck
WebGo IS
WebImageCollector
WebLeacher
Web Pix Web Pix
Web Sauger Web Sauger
WebSucker WebBandit
WebFetch
WebReaper
WebWhacker WebWhacker
Webalta Website Quester
WebsiteExtractor
WebsiteQuester
Whack Whack
Whacker Whacker
Whatweb
Widow Widow
WiseGuys Robot
Woobot Woobot
Zauba
Zermelo Zermelo
Zitebot
ZoomBot ZoomBot
ZoominfoBot
ZumBot
ZyBorg
adscanner
arquivo-web-crawler arquivo-web-crawler
backlink-check arquivo.pt
cah.io.community
check1.exe check1.exe
coccocbot
cognitiveseo
com.plumanalytics com.plumanalytics
crawler4j crawl.sogou.com
demandbase-bot dataforseo.com
eCatch
evc-batch evc-batch
facebookscraper
gopher gopher
instabid heritrix
internetVista monitor
ips-agent ips-agent
isitwp.com linkdexbot
iubenda-radar lwp-trivial
meanpathbot meanpathbot
mediawords mediawords
muhstik-scan
oBot oBot
page scorer page scorer
pcBrowser plumanalytics
polaris version
probe-image-size probe-image-size
satoristudio.net s1z.ru
scalaj-http scan.lol
seobility seobility
seocompany.store seocompany.store
serpstatbot seostar
sitechecker.pro sexsearcher
ubermetrics-technologies.com sogouspider
voyagerx.com tAkeOut
trendiction.com
webpros.com webpros.com
webprosbot x09Mozilla
xpymep1.exe
zgrab

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
badavit.com.ua atelielembrancaqueencanta.com.br
baoxaydung.com.vn bala.getenjoyment.net
cheapestjerseysonwholesale.com burn-fat.ga
englishdictionaryfree.com cleanpcnow.com
hotsocialz.com cookie-law-enforcement-ff.xyz
languagecode.com hdpixion.com
sonata-arctica.wz.cz ruscoininvest.company
txxx.com semrush.com
umg-stroy.ru unrealcommander.biz
vzlom-na-zakaz.com website-speed-up.site

916
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
0912701309f8ce.com 0912701309f8ce.com
1-99seo.com
123any.com 123any.com
202ch.com 14b.info
1bet.com
20pascals.nl 20pascals.nl
214jaluwobapef.cf 2daytrendingnews.com
2345.com 4ur.click
3-letter-domains.net 5000-cotydzien.com
4ureyesonly.com 51.la
8jn.dating-app.ru 5tey7463.weebly.com
aa625d84f1587749c1ab011d6f269f7d64.com 5u.com
abwa.tk 7yue.org
addblueoff.com.ua aa81bf391151884adfa3dd677e41f94be1.com
adimmix.com aadroid.net
adman.gr adbetclickin.pink
adultgalls.com adclickthru.net
advancedcleaner.com adconscious.com
advancedsoftwaresupport.com adloads.com
advokateg.ru adrenalin-stk.ru
ageofclones.com adsfresh.men
air-edem.ru adtech.fr
akama.com adtology.com
albamargroup.com agecheckadult.com
alert.scansafe.net ahmedabadwebs.com
alf-img.com akita.kz
alkoravto.ru akvamaster.dp.ua
alldubai.biz alekseevec.ru
allornamenti.com allblogroll.com
alltheviews.com allfinweb.com
alot.com allknow.info
angel1777.kz allkrim.com
ap.senai.br alt-servis.ru
apiholdingmypage-a.akamaihd.net alveris.ru
appfastplay.com amoi.tn
appsecurityr.com animali.deagostinipassion.it
arabsexxxtube.com apiappenableinfo-a.akamaihd.net
arcadepages.com apimountainbikei-a.akamaihd.net
arendakvartir.kz app5.letmacworkfaster.world
artavenuegardenstudios.com appfixing.space
artdeko.info apple.com-cleaner.systems
asociatia-tipografilor-transilvania.ro arcteryxstore.online
astana.xxxkaz.org ardimobileinfo.ml
atdedinotuho.tk arendas.net
atout-energie-69.com arewater.com
auto.rusvile.lt arius.tech
autobudpostach.club autolombard-krasnodar.ru
automatic-seo.com
automobile-spec.com automobile-spec.com
aviav.co ayanaspa.com
avirasecureserver.com babyfactory.fr
azartmix.com
backuperwebcam.weebly.com
baixar-musicas-gratis.com baixar-musicas-gratis.com
banki76.ru balkanfarma.ru
basedecor.ru bangla-chat-uk-paralud.ga
basisches-wasser.net barnfurnituremart.com
bestdooz.com battlecarnival.su
bestfortraders.com belstaffstore.online
bestofpicture.com bestmouthwash.club
bestpornuha.com bestpriceninja.com
bestwrinklecreamnow.com betterhdporn.com
bet365.com bingoporno.com
beztuberkuleza.ru
bg6s0.com
bharatdefencekavach.com
billiard-classic.com.ua
bio-optomarket.ru
blackle.com
blog-hits.com
bloggedporn.com bloggedporn.com
blogrankers.com bobinoz.com
bookmaker-bet.com bonky.biz
brainzpod.win boole.onlinewebshop.net
brokergid.ru brus.city
brothers-smaller.ru bugof.gq
bscodecs.com burkesales.com
bukleteg.xyz businesxxl.com
buqayy0.livejournal.com buttons-for-your-website.com
buqyxa.rincian.info buyclomidonlaine.com
business-made-fun.com buyessay3.blogspot.ru
buy-cheap-pills-order-online.com buzzsumo.com
buytizanidineonlinenoprescription.blogspot.com buzzzg.men
bycontext.com bycontext.com
candcstuccoandstone.com cah.io.community
candelluxsklep.pl canacopegdl.com
carrauterie.be candlehandmade.com
cartierlovebracelet.xyz candytiner.com
cartierlovestore.xyz carina-sy.de
centrumcoachingu.com cartierlove2u.com
cfcl.co.uk cashkitten-a.akamaihd.net
cheap-trusted-backlinks.com celebsopics.com
cheapjerseysa.com chatroulette.life
check-host.net cheapbelstaff.online
cherubinimobili.it chelyabinsk.xrus.org
chidporn.com chimiver.info
chiptuninger.com cialiswithoutadoctor.net
coccoc.com citetick.com
comissionka.net cjmc.info
compliance-olga.top classiquebijoux.ru
compliance-viktor.top cleanersoft.com
concordexoticrentals.com clmforexeu.com
craftinsta.ru compliance-checker-7.info
credit.co.ua contextualyield.com
cwetochki.ru coolbar.pro
cxpromote.com coolingoods.com
d2jsp.org cordstrap.cc
dailyrank.net corta.co
data.vtc.pw cougfan.info
datsun-do.com counter.bloke.com
ddsoldes.fr crackguru.tk
credit-online.ws
crirussian.ru
custom-electric-guitar.com
customcatchcan.com
cutt.us
daooda.com
darmebel.com.ua
daydream-studio.ru
dealighted.com dealighted.com
decenttools.com detective01.ru
delitime.info
depositfiles-porn.ga
dev-seo.blog
dikqlyremy.info
dirtpics.pw
discovertreasure-a.akamaihd.net discovertreasure-a.akamaihd.net
discovertreasurenow.com div.as
dmmspy.com dogclothing.store
dneprsvet.com.ua domaincrawler.com
documentsite.net domination.ml
dojki365.online domznaniy.ru
domainsphoto.com dosugrostov.site
domashneeruporno.com drunkmoms.net
dominateforex.ml dynainbox.com
doxyporno.com eager-nash.188-93-233-196.plesk.page
dpihatinh.gov.vn easycommerce.cf
dprtb.com ekaterinburg.xrus.org
drupa.com elektrischezigarette2.onsugar.com
druzhininevgeniy63.blogspot.com elektrozigaretten1.tumblr.com
earl-brown.info elite-sex-finders.com
elektronischezigarettekaufen1.myblog.de en.altezza.travel
elektrozigarettekaufen2.blogse.nl enpolis.ru
elektrozigaretten1.postbit.com eralph.tk
emerson-rus.ru erot.co
enge-fotzen.info erotag.com
enternet.ee eshop4u.jp
epngo.bz everflora.ru
ewebarticle.info ezigarettekaufen2.mpbloggar.se
ezigarettenkaufen1.deviantart.com
ezigarettenkaufen1.pagina.gr ezigarettenkaufen1.pagina.gr
fable.in.ua ezigarettenkaufen2.dreamwidth.org
familyholiday.ml falcon-images.blogspot.com
faptitans.com family1st.ca
fastcrawl.com fanrto.com
fealq.com feeriaclub.ru
felizporno.com filmi-onlain.info
fellowshipoftheminds.com findclan.org
feorina.ru fix-website-errors.com
fickenprivat.info flashahead.info
fifa-coins.online forodvd.com
financehint.eu forum-engineering.ru
flavors.me forum.doctissimo.fr
food.dtu.dk foto-telok.net
forums.d2jsp.org foto-weinberger.at
foto-basa.com frankofficial.ru
franch.info frcls.fr
freetangodownload.com free-gluten.ru
funnymama.com free-share-buttons.com
fx-brokers-review.com freesitetest.com
fz139.ttk.ru fuel-gas.com
galaxyflowers.ru fun-mobi.pl
gambarkatabaru.com fungamelands.com
gamedayhouse.com fungirlsgames.net
gamezblox.com gamingspark.com
gaming-journal.com gate5.co.za
gcup.ru gayxperience.com
geileweiber.tk gazobeton-p.com.ua
gembird.com geoads.com
generalporn.org germes-trans.com
getlaid-xxxhookupdirect.com getmiro.com
ghostvisitor.com gg-arena.ru
gk170.ru glavtral.ru
gkvector.ru go2mike.ru
globalscam.ga gsasearchengineranker.pw
go2album.com hamptonoaks.ca
gotwebsite1.com handicapbathtubarea.com
gowreckdiving.com handicapvansarea.com
gpirate.com hasshe.com
greatdealshop.com havepussy.com
groupmoney.ru hazardky.net
gsmtlf.ru hdimagegallery.net
gungamesz.com hdpixion.com
hamacapty.com herehloadibs.cf
handicapvantoday.com hexpilot.com
harmonyglen.us highspeed5.net
hawaiielectriclight.com historichometeam.com
hccoder.info hjaoopoa.top
hdfreeporno.net hopeonthestreet.co.uk
hentai-manga.porn hothor.se
hermesreplica.pw hotloans.ru
hermesreplica.win houseofgaga.ru
heroz.fr huhn.altervista.org
himazin.info hydropump.su
hitmuzik.ru
hosting-tracker.com
hotxnights.info
houseofrose.com
hoverboard360.es
hreade.com
i-hobot.ru i-hobot.ru
ibb.com.ua i4track.net
iideaidekonkatu.info idegenvezeto.eu
ikearugs.xyz ideoworld.org
iflycapetown.co.za
ikritikimou.gr
ilo134uloh.com ilo134uloh.com
img.wallpaperstock.net impresagaia.it
immigrational.info infospot.pt
inboxdollars.com insta-add.pro
inspiring-desperate.tk internetartfair.com
iqs.biz.ua ipchicken.com
irkutsk.zrus.org iplusbit.blogspot.co.za
isoveti.ru ispaniya-costa-blanca.ru
ix20.ru istripper.com
jabimgo.pw iusstf.org
jav-idol.com iwantmyfreecash.com
jobmarket.com.ua iwanttodeliver.com
justkillingti.me jackpotchances.com
kamalsinha.com jasonpartington.com
karpun-iris.ru jav-fetish.com
kerei.ru jerseychinabizwholesale.com
kinogolos.ru johnnyhaley.top
kinogonew.ru junketjuice.blogspot.com
knigonosha.net jurajskie.info
knogg.net jus0wil.pp.ua
krasivoe-hd.com justucalling32211123456789.tk
kazinogames.lv
keywordsdoctor.com
kino2018.cc
kinosed.net
klumba55.ru
kol-energo.ru
koleso24.com.ua
kolotiloff.ru
kosova.de
kovesszucs.atw.hu
kozhniebolezni.com
krafte.ru
krasivye-devushki.net krasivye-devushki.net
krasula.pp.ua ku6.com
kustanay.kz
labelwater.se labelwater.se
lacapilla.info laexotic.com
lancheck.net legionalpha.com
laserpen.club lerporn.info
law-check-two.xyz lescinq.com
lazy-z.com letmacworkfaster.site
le-clos-des-alouettes.com lflash.ru
light.ifmo.ru lineshops.biz
link.ac linkdebrideur.xyz
linksharingt.com linksharingt.com
lion.conboy.us lion.conboy.us
live-cam6.info lionking-1994.blogspot.com
lkbennettoutlet.online lirunet.ru
lolnex.us live-sexcam.tk
lombardfinder.ru lob.com.ru
long-beach-air-conditioning.com locimge.pw
longadventure.com longadventure.com
lunamedia.co louboutinreplica.pw
mafcards.ru marmitaco.cat
magicplayer-s.acestream.net massage-info.nl
makis.nu mcadamssupplyco.com
managerpak204.weebly.com mebeldekor.com.ua
martlinker.com medanestesia.ru
masturbate.co.uk medicine-4u.org
mebel-vstroika.ru mensandals.xyz
meddesk.ru merryhouse.co.uk
mhi-systems.ru middlerush-a.akamaihd.net
mielec.pl millionare.com
mil-stak.com minecraft-rus.org
minharevisao.com mjchamonix.org
misslike.ru mmoguider.ru
mobplayer.ru mnimmigrantrights.net
moonci.ru mobile-appster.ru
morefastermac.trade monclerjacketsoutlet.pw
monclerjacketsoutlet.win
moncleroutletonline.xyz
monitorwebsitespeed.com
monthlywinners.com
mosrif.ru mosrif.ru
moviezbonkerssk.cf mrbojikobi4.biz
mozello.ru mriyadh.com
mrwhite.biz mturkcontent.com
mttwtrack.com
musicas.baixar-musicas-gratis.com
muz-shoes.ru muz-shoes.ru
myonigroup.com my-big-family.com
mystats.xyz mybackgroundlandscape.blogspot.com
nagdak.ru myseoconsultant.com
narkologiya-belgorod.ru mysex21.com
naughtyconnect.com neobux-bg.info
negociosdasha.com netvouz.com
new7ob.com networkad.net
nfljerseys.online new-post.tk
nfljerseyscheapbiz.us news-readers.ru
nikkiewart.ru newstaffadsshop.club
ningessaybe.me nmrk.ru
nootrino.com nomuos.it
northfacestore.online noumeda.com
novodigs.com of-ireland.info
nuker.com
o333o.com
obiavo.by
obiavo.in
office2web.com office2web.com
ok-ua.info
olvanto.ru
olympescort.com
onlinedomains.ru onlinedomains.ru
onlinemegax.com onload.pw
ordernorxx.com opinionreelle.com
page2rss.com panamaforbeginners.com
pagesense.com parlament.biz
partnerads.men partners-ship.pro
pcimforum.com pc4download.co
perfectplanned.com pdns.cz
pensplan.com
perl.dp.ua perl.dp.ua
perm-profnastil.ru
pertlocogasilk.tk pertlocogasilk.tk
pflexads.com pflexads.com
phelissota.xyz phormchina.com
phrcialiled.com picscout.com
picturesfrom.com picturesfrom.com
pio.polytopesexempt.com pirateday.ru
piski.top piuminiita.com
piter.xrus.org pizda.lol
piulatte.cz plastweb.ru
pix24x7.com playlott.com
play-mp3.com podshipniki-nsk.ru
ploenjitmedia.azurewebsites.net pogodnyyeavarii.gq
pontiacsolstice.info porno-home365.com
poppen-nw.net porno-raskazy.ru
porngalleries.top pornoplen.com
porno-play.net pornoslive.net
pornodojd.ru portnoff.od.ua
pornoforadult.com posible.net
pornosee.info pp-budpostach.com.ua
pornosemki.info
pornosmola.info
pornstartits.xblog.in
postclass.com
pr-ten.de pr-ten.de
prefersurvey.net predominant-invent.tk
pricheskaonline.ru prizeestates.cricket
prizestohandle.club producm.ru
pro-okis.ru prohoster.info
pro-poly.ru prostitutki-yaroslavlya.org
profitwithalex.info pst2017.onlinewebshop.net
proxyradar.com ptr.ruvds.com
psvita.ru purchasepillsnorx.com
puserving.com puserving.com
pyrodesigns.com.au pyrodesigns.com.au
qexyfu.bugs3.com quelle.ru
qwertty.net qwesa.ru
raschtextil.com.ua ragecash.com
reckonstat.info rankia.com
remont-comp-pomosh.ru razleton.com
rennlist.com rebelmouse.com
restorator-msk.ru recipedays.com
rockma.se recipedays.ru
rus-teh.narod.ru reklama1.ru
rustic-quiver.win relayblog.com
rvzr-a.akamaihd.net rent2spb.ru
saddiechoua.com ribieiendom.no
salmonfishingsacramentoriver.com rockingclicks.com
samoiedo.it royalads.net
saneitconsulting.com rumamba.com
runstocks.com
ruscoininvest.company
rusexy.xyz
s1z.ru
sady-urala.ru
sammyweaver.com
savingsslider-a.akamaihd.net savingsslider-a.akamaihd.net
sayyoethe.blogspot.co.za scanner-jess.top
sbetodiodnye-lampy.ru scanner-josh.top
scanner-alex.top scanner-mark.top
school-diplomat.ru schlampen-treffen.com
searchtooknow-a.akamaihd.net scrnet.biz.ua
see-your-website-here.com search-error.com
semp.net search.1and1.com
seogadget.ru search.xtconnect.com
serving.adbetclickin.pink searchimpression.com
sethrollins.net secret.xn--oogle-wmc.com
sexgalleries.top selectads.men
sexiporno.net seminarykansas904.ml
sexsearch.com semrush.com
sexyali.com seoheap.com
sharebutton.net
sharpchallenge.com
shikiso.info shikiso.info
shodanhq.com shopsellcardsdumps.com
shohanb.com siha.de
shopfishing.com.ua silktide.com
signoredom.com silverage.ru
siteheart.net simplepooltips.com
siteripz.net simplesite.com
sinel.info
site.ru
sitechecker.pro
siteonomy.com
sizeplus.work
skuteczna-dieta.co.pl
sladkoevideo.com
slavia.info slavia.info
slim.sellany.ru smokewithrabbits.com
smstraf.ru softwaretrend.net
snip.to spl63.fr
snip.tw sportbetfair.com
socialmediasuggest.com spy-sts.com
sodexo.com spyfu.com
sohoindia.net sribno.net
solmarket.by statustroll.com
songoo.wz.cz stevemonsen.com
spabali.org stroilka.info
space2019.top success-seo.com
space4updating.win sumo.com
spinazdrav.ru support.nopeas.sk
spymac.net swimpool.ca
spywarebegone.com swingerseiten.com
sr-rekneskap.no
srecorder.com
sstroy44.ru
statoutlook.info
stats-collector.org
stpicks.com
streetfooduncovered.com
streha-metalko.si
stroymonolit.su
stroyplus.ru
studiokamyk.com.pl
stuff-about-money.com
sugarlyflex.pw
superiends.org
supermama.top
superstats.com
survival.betteroffers.review
svbur.ru
svensk-poesi.com
svtrd.com
swsociety.se swsociety.se
t-bygg.com szamponrevita.pl
talant-factory.ru taihouse.ru
tarad.com takeprofitsystem.com
taranerymagesswa.blogspot.com tandvardshuset.net
technika-remont.ru td-33.ru
telefonsex-ohne0900.net
telefonsexkostenlos.tk
telemetryverification.net telemetryverification.net
tfxiq.com texbaza.by
thegioixekhach.com
thetattoohut.com
thexart.club
thruport.com
tizanidine4mg.blogspot.com
tizanidinecost.blogspot.com tizanidinecost.blogspot.com
tizanidinehydrochloride2mg.blogspot.com tizanidinehcl4mgtab.blogspot.com
tizanidineoral.blogspot.com tizanidinehcl4mgtablet.blogspot.com
tizanidinerecreationaluse.blogspot.com tonivedu.it
tizanidineshowupondrugtest.blogspot.com top1-seo-service.com
tizanidinewithdrawal.blogspot.com top10-online-games.com
top-karkas.ru topquality.cf
topkarkas.com tpu.ru
toy-shop.top trackzapper.com
toyota.7zap.com trafficcentr.xyz
tradedeals.biz
traffictrade.life
traxdom.ru traxdom.ru
truemfilelj.gq triumf-realty.ru
tsan.net try-rx.com
tupper-posuda.ru tubeoffline.com
tvand.ru tuckpointingmasonrysystems.com
twojebook.pl twittruth.com
tytoona.com u555u.info
uac.net.au
uamtrk.com
uggsale.online
uhdtv.website uhdtv.website
ukrtvory.in.ua ukrtvory.in.ua
unrealcommander.biz uogonline.com
url-extractor.xyz
uroki.net
usbggettwku.ga usbggettwku.ga
uzporno.mobi v720hd.ru
veerotech.com validdomain.xyz
vektorpress.ru valueclick.com
veles.shop vandrie-ict.nl
veopornogratis.xxx varbergsvind.se
via-energy-order.com ventelnos.com
video-chat.in vepad.com
video-chat.love viagengrarx.com
video-hollywood.ru video--production.com
videtubs.pl visionwell.com.cn
viktoria-center.ru vkmusics.ru
vipps.com.my vkontaktemusic.ru
vizitki.net vksaver-all.ru
vuclip.com vmnmvzsmn.over-blog.com
w3javascript.com vremya.eu
wahicbefa31.soup.io vse-pesni.com
warningzscaler.heraeus.com vvpg.ru
watracker.net vykup-avto-krasnodar.ru
webadvance.club vysigy.su
weblibrary.win wanker.us
website-analyzer.info wapsite.me
website-speed-checker.site watch-movies.ru
westum.se webjam.com
wfb.hatedriveapart.com webradiology.ru
whipme.yopoint.in webtherapy.ru
whosonmyserver.com wetgames.ru
winx-play.ru whereverdesperate.gq
workle.website wildworld.site
woman-h.ru
wpthemedetector.co.uk wpthemedetector.co.uk
wstroika.ru
www.event-tracking.com www.event-tracking.com
xblog.in x-diesel.biz
xfire.com x-lime.com
xitjw.info xbaboon.com
xn----7sbaphztdjeboffeiof6c.xn--p1ai xep.info
xn----7sbifcamovvfggw9d.xn--p1ai xgftnlrt.bloger.index.hr
xn----btbdvdh4aafrfciljm6k.xn--p1ai xjlottery.com
xn----itbkqkfiq.xn--p1ai xn-----7kceclhb4abre1b4a0ccl2fxch1a.xn--p1ai
xn--80aaajbdbddwj2alwjieei2afr3v.xn--p1ai xn--80aanaardaperhcem4a6i.com
xn--80ajjbdhgmudixfjc8c5a9df8b.xn--p1ai xn--80ahdheogk5l.xn--p1ai
xn--b1adccaf1bzj.xn--p1ai xn--80aodinpgi.xn--p1ai
xn--h1ahbi.com.ua xn--l1aengat.xn--p1ai
xn--q1a.xn--b1aube0e.xn--c1acygb.xn--p1ai xn--q1a.xn--b1aube0e.xn--c1acygb.xn--p1ai
xzlive.com xnxxandxvideos.com
yaminecraft.ru xwatt.ru
youradexchange.com xxxguitars.com
youtoner.it xxxmania.top
youtubologia.it yebocasino.com
yubikk.info yellowstonevisitortours.com
yugk.net yoluxuryevents.com
youdesigner.kz
yourads.website
youresponsive.com
yur-p.ru
yuweng.info
zakazvzloma.com zakazvzloma.com
zarabiaj-dzis.pl zeikopay.com
zarabotok--doma.ru zeroredirect1.com
zdesformula.ru zeroredirect2.com
zero1.it zeroredirect7.com
zeroredirect.com zetmaster.ru
zeroredirect10.com zhacker.net
zixizop.net.ru zlatnajesen.com
zryydi.com zoogdiesney.com
zscaler.net
zvezdagedon.ru

476
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
101lesbian.xyz 12u.info
4kepics.com 13tabs.com
8kisses.eu 202ch.com
aa9d046aab36af4ff182f097f840430d51.com 2rich4bitches.com
adexprts.com 70casino.online
adidas.frwebs.fr 777-club.ru
adloads.net adf.ly
adsfresh.men adman.se
allfinweb.com adprotect.net
allkrim.com ads.tremorhub.com
amazon-seo-service.com advancedsoftwaresupport.com
autochoixspinelli.com adventureparkcostarica.com
b2b-lounge.com affordablewebsitesandmobileapps.com
agroeconom.kz
ahhjf.com
alibestsale.com
apiluckyleapnet-a.akamaihd.net
appartement-stumm.at
arenda-avtoprokat-krasnodar.ru
artparquet.ru
arvut.org
asseenontvonline.ru
autoblogger24.info
autovideobroadcast.com
aviapanda.ru
azbaseimages.net
backlink4u.net
baixar-musicas-gratis.com
bankofthewext.com bankofthewext.com
bestdooz.com bensbargains.net
bestdraws.com bestchoice.cf
bestwaystogetpaid.us bet-prognoz.com
betwinservice.com betterscooter.com
bimatoprost-careprost.com.ua biznesschat.net
bimmerpost.com bjgugu.net.ua
bmsco.co blog.remote-computer.de
bonzibuddi.com braip.com.br
brothers-smaller.ru businescoop.men
buckspar.gq buy-meds24.com
builtwith.com bvlgaribracelet.xyz
butstrap.space bvlgariring.xyz
buzzsumo.com cand.jp
calvet.altervista.org capture-room.com
capacitacionyaprendizaje.com carfax.com.ua
catalogs-parts.com cartierlove2u.com
caveavins.fr cartierreplica.win
charmstroy.info cascadelink.org
cheapjerseysap.com cfcl.co.uk
check-this-out-now.online cheap-pills-norx.com
cialisovercounteratwalmartusa.com clickbank.net
civilwartheater.com clickbanksites.info
cjs.com.ru club-lukojl.ru
cl.s7.exct.net cookielawblog.wordpress.com
cocyq.inwtrade.com covadhosting.biz
compliance-jane.top cowblog.fr
countercrazy.com cranly.net
custom-electric-guitar.com
cutalltheshit.com cutalltheshit.com
d0t.ru cv.wallhade.co
dafatiri.com dairyindia.in
data-mining.tk db.speedup.gdn
dating-time-now.com dbmkfhqk.bloger.index.hr
dear-diary.ru demenageur.com
delayreferat.ru demian.kz
dieta-personalna.pl detmebel.su
digilander.libero.it digital-video-processing.com
discountbarbour.online dktr.ru
dotmass.top dneprsvet.com.ua
e-collantes.com domainroam.win
electricwheelchairsarea.com domcran.net
elmifarhangi.com doska-vsem.ru
eloxal.ru downloadme.life
ero-advertising.com downvids.net
ez8motelseaworldsandiego.com dvd-famille.com
ezigarettenshop1.yolasite.com e-c.al
f07.de envaseslotusama.com
f1nder.org europages.com.ru
fashionindeed.ml eyemagination.com
feel-planet.com familienzahnaerzte.com
ferretsoft.com fashion-mk.net
ff30236ddef1465f88547e760973d70a.com fil.ru
filmbokep69.com filesmonster.porn
filmidivx.com filmetricsasia.com
forum.poker4life.ru filunika.com.ru
frbizlist.com floridamhca.org
free-fb-traffic.com fotoxxxru.com
free-share-buttons.blogspot.com freefoto.ca
frustrated-favorable.gq freenom.link
fsalas.com fyxabomiw.ru
g7m.pl fz139.ttk.ru
gael-s.ru gabeshop.ru
galaxyflowers.ru gagrasector.ru
gameprimary.com game-mmorpg.net
get-free-traffic-now.com gay-file.com
gfaq.ru genericlowlatencyasiodriverhq.aircus.com
goatse.ru generousdeal-a.akamaihd.net
goldpanningtools.com getaclueamerica.com
gomusix.com go2album.com
googglet.com hasshe.com
gwebtools.com hd720kino.ru
handicapvantoday.com home-task.com
hannasolution.ru home.myplaycity.com
hdwallpapers-free.com hspline.com
hikesearch.net i-midias.net.br
homeart.space ilmexico.com
hoverboard360.at ilovevitaly.xyz
howtowhitenteethfast.xyz inbabes.sexushost.com
humanelydrew.com incanto.in.ua
i-service.kz infodocsportal.com
iamsport.org insomniagamingfestival.com
id-forex.com iplogger.org
ilovevitaly.com iqupdatetmz.win
impisr.edunsk.ru itag.pw
import-sales.com izoll.ru
inboxdollars.com javitas.info
infowarcraft.ru jjbabskoe.ru
interesnie-faktu.ru juliadiets.com
internet-apteka.ru kerwinandcariza.com
jamiembrown.com keyhantercume.com
javrip.net kino-ecran.ru
jaxcube.info kinocccp.net
jillepille.com kinogonew.ru
justbcause.com kleine-titten.biz
justdating.online klejonka.info
jyvopys.com komp-pomosch.ru
kam-dom.ru
karusel-market.ru
katushka.net
keywordsdoctor.com
kupit-adenu.ru
lanasshop.ru
lapolis.it lapolis.it
larose.jb2c.me law-check-nine.xyz
lecbter-relationships.ga lawyersinfo.org
lineavabit.it liquimondo.com
lordzfilmz.me liupis.com
lost-alpha.ru liveshoppersmac.com
mafcards.ru locatellicorretor.com.br
maranbrinfo.com.br locksmith.jp
marcogrup.com lombardfinder.ru
markjaybeefractal.com lumb.co
medicine-4u.org macotool.com
missvietnam.org macrotek.ru
moivestiy.biz mafa-free.com
mojpregled.com mall.uk
monarchfind-a.akamaihd.net manualterap.roleforum.ru
montredemarque.nl martlinker.com
moviezbonkerssk.cf mejoresfotos.eu
musicpro.monster meltwater.com
musirc.com mesbuta.info
muzaporn.com monarhs.info
myonlinepayday.co monclercheap.xyz
myra.top monclerjacketsoutlet.pw
mrbojikobi4.biz
myfreemp3.eu
mylesosibirsk.ru
mylida.org
mystats.xyz
naturalpharm.com.ua
netvouz.com netvouz.com
nrjmobile.fr newstaffadsshop.club
nucia.biz.ly nfljerseys.online
nudo.ca nofreezingmac.work
o-o-8-o-o.ru notaria-desalas.com
ochistka-stokov.ru nzfilecloud.weebly.com
onefilms.net obiavo.su
openlibrary.org okel.co
orion-v.com ooo-gotovie.ru
orsonet.ru ordernorxx.com
ownshop.cf parvezmia.xyz
pdamods.ru patterntrader-en.com
pekori.to pc-test.net
pelfind.me peekyou.com
phrcialiled.com
piratecams.com
pizza-tycoon.com pizza-tycoon.com
play-movie.pl plohaya-kreditnaya-istoriya.ru
pochemychka.net porndl.org
popugauka.ru porno-home365.com
pornosexrolik.com pornofeuer.com
potolokelekor.ru powc.r.ca.d.sendibm2.com
preg.marketingvici.com preg.marketingvici.com
pretty-mart.com priceg.com
pricheskaonline.ru privacyassistant.net
privatamateure.com
privatefx-in.ru
prize44.com prize44.com
proftests.net proposal-engine.com
progress-upakovka.ru prostitutki-tolyatti.org
prom23.ru prpops.com
purplestats.com pst2017.onlinewebshop.net
radiogambling.com rniaeba.ga
rank-checker.online romhacking.ru
razleton.com running-line.ru
renecaovillasale.online rus-pornuha.com
riralmolamsaca.tk ryetaw.com
robertefuller.com santasgift.ml
royal-betting.net sarf3omlat.com
rvtv.ru saveriopiazza.it
rvzr-a.akamaihd.net sbetodiodnye-lampy.ru
rybalka-opt.ru scanner-julianna.top
salutmontreal.com scenarii-1-sentyabrya.uroki.org.ua
scanner-donald.top seansonline24.pl
selectads.men searchmywindow-a.akamaihd.net
seoanalyses.com semprofile.com
seoheap.com seogadget.ru
seonetwizard.com sevendays.com.ua
seorank.info sexfreepornoxxx.com
sexreliz.com sexobzor.info
shinikiev.com.ua shillyourcoins.com
siteonomy.com shivafurnishings.com
skylta.com shohanb.com
sloopyjoes.com shoplvlv.us
snegozaderzhatel.ru simply.net
sodexo.com smstraf.ru
snjatie-geroinovoy-lomki.ru
snsdeainavi.info
socialsignals24.com
souvenir.cc souvenir.cc
space2019.top sport-video-obzor.ru
spammen.de
sps-shop.com sps-shop.com
stop-gepatit.te.ua stanthonyscatholicchurch.org
sugarkun.com sterva.cc
superlist.biz superoboi.com.ua
svolze.com thejournal.ru
swinger-mobil.net tizanidinehcl2mg.blogspot.com
taaaak.com tizanidinehydrochloride2mg.blogspot.com
taximytishi.ru tizanidinepills.blogspot.com
teastory.co tizanidinerecreationaluse.blogspot.com
teenfuck.tv tksn.ru
template-kid.com tobeyouday.win
templates.franklinfire.co topflownews.com
themeforest.net trubywriting.com
tizanidineformigraines.blogspot.com tsan.net
toxicwap.com turbo-suslik.org
track.deriv.com turn-up-life.life
tryrating.com twincitiescarservice.com
tubeline.biz urll.eu
tula.mdverey.ru
tv-spoty.info
twittruth.com
ukrtvir.com.ua
umnovocaminho.com
uptime-as.net
usacasino.com usacasino.com
vapeface.club utrolive.ru
versaut.xxx-cam.webcam valuado.com
videochat.life vapomnoncri.tk
videojam.tv vegascosmetics.ru
videooko.weebly.com videonsk.com
virtuagirl.com wallpaperstock.net
visa-china.ru webalan.ru
vmnmvzsmn.over-blog.com weightatraining.com
vodkoved.ru white-truck.life
vzlomtw.com
vzubah.com
w3javascript.com
website-stealer.nufaq.com
westen-z.life
westvilletowingservices.co.za
wholesalejerseysgaa.com
wingsofrefuge.net wingsofrefuge.net
www.souvenirua.com x-diesel.org
www.timer4web.com x-lime.com
xn----8sbdbjgb1ap7a9c4czbh.xn--p1acf xtubeporno.net
xn--80ajjbdhgmudixfjc8c5a9df8b.xn--p1ai yellowads.men
xn--e1afanlbnfckd7c3d.xn--p1ai yoopsie.com
xxart.ru you-shall-not-pass.is74.ru
yadro.ru
yaoguangdj.com
ynymnwbm.bloger.index.hr
youjizz.vc
youtubedownload.org
ypmuseum.ru ypmuseum.ru
zkjovpdgxivg.ga zaimite.ru
zreloeporno.tv zs2vm.top

69
dev-tools/test_units/ratelimittest-master.txt
View file

@ -8,6 +8,37 @@
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html>ml>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html><html> </html><html>
<head><title>503 Service Temporarily Unavailable</title></head> <head><title>503 Service Temporarily Unavailable</title></head>
<body> <body>
@ -463,34 +494,6 @@
<hr><center>nginx/1.18.0 (Ubuntu)</center> <hr><center>nginx/1.18.0 (Ubuntu)</center>
</body> </body>
</html> </html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<!DOCTYPE html> <!DOCTYPE html>
<html> <html>
<head> <head>
@ -581,14 +584,4 @@
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html> </html>

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.107 0; 10.1.0.17 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.06.3145 ### Version: V4.2022.06.3146
### Updated: Fri Jun 3 22:01:22 UTC 2022 ### Updated: Sat Jun 4 10:03:31 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.06.3145 ### Version: V4.2022.06.3146
### Updated: Fri Jun 3 22:01:22 UTC 2022 ### Updated: Sat Jun 4 10:03:31 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##