vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-17 02:29:49 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2022.03.2995 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2022-03-22 22:07:03 +00:00
parent 2818db1070
commit de9de5e300
47 changed files with 99228 additions and 99218 deletions
Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.03.2994 #### Version: V4.2022.03.2995
#### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.03.2994 #### Version: V4.2022.03.2995
#### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -14,7 +14,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2022.03.2994 #### Version: V4.2022.03.2995
#### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

12266
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2022.03.2994 #### Version: V4.2022.03.2995
#### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

12270
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

12270
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

12270
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

12270
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.170 1; 10.1.1.9 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.170 0; 10.1.1.9 0;
127.0.0.1 0; 127.0.0.1 0;

12270
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.170 1; 10.1.1.9 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.170 0; 10.1.1.9 0;
127.0.0.1 0; 127.0.0.1 0;

12270
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.170 1; 10.1.1.9 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.170 0; 10.1.1.9 0;
127.0.0.1 0; 127.0.0.1 0;

12270
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
2994 2995

12270
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

12270
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
13.64.144.225 0; 20.231.52.238 0;

12270
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.170 1; 10.1.1.9 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.170 0; 10.1.1.9 0;
127.0.0.1 0; 127.0.0.1 0;

12270
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.170 1; 10.1.1.9 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.170 0; 10.1.1.9 0;
127.0.0.1 0; 127.0.0.1 0;

12270
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.170 1; 10.1.1.9 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.170 0; 10.1.1.9 0;
127.0.0.1 0; 127.0.0.1 0;

12270
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
13.64.144.225 0; 20.231.52.238 0;

12270
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
13.64.144.225 0; 20.231.52.238 0;

12270
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.170 1; 10.1.1.9 1;
127.0.0.1 1; 127.0.0.1 1;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
Anarchy99 AiHitBot
CATExplorador Ecxi
CheeseBot MolokaiBot
Dispatch Nikto
HonoluluBot OutfoxBot
ProPowerBot Pixray
Web Sauger Sociscraper
adscanner Typhoeus
polaris version domainsproject.org
scan.lol meanpathbot

308
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
404checker 01h4x.com
360Spider
404enemy
80legs
AIBOT
ASPSeek ASPSeek
Abonti
Aboundex Aboundex
Aboundexbot
AhrefsBot
AiHitBot AiHitBot
Aipbot
Alexibot Alexibot
AllSubmitter Anarchie
Ankit Atomseobot
Anthill
Aspiegel
Asterias
Attach Attach
AwarioRssBot BBBike
AwarioSmartBot BDCbot
BDFetch
BLEXBot
BackDoorBot
BackWeb BackWeb
Backlink-Ceck BlackWidow
BacklinkCrawler
Bandit
Barkrowler
BatchFTP
Bitacle
Blow Blow
BlowFish BlowFish
Boardreader
Bolt Bolt
Brandprotect
Buddy Buddy
BuiltBotTough BuiltBotTough
BuiltWith Bullseye
BuzzSumo CATExplorador
CSHttp CODE87
Cegbfeieh Calculon
CensysInspect CheTeam
ChinaClaw CherryPicker
Citoid Chlooe
Claritybot Cogentbot
Cloud mapping Collector
Crescent CopyRightCheck
Custo Cosmos
Demon CrazyWebCrawler
CrunchBot
Curious
CyotekWebCopy
DBLBot
DSearch
DatabaseDriverMysqli
Deusu Deusu
Dirbuster DigitalPebble
Discobot Disco
Dispatch
DittoSpyder DittoSpyder
DnBCrawler-Analytics
DnyzBot DnyzBot
DomainStatsBot DomainCrawler
Domains Project
Download Wonder Download Wonder
Dragonfly Dragonfly
EMail Siphon ECCP/1.0
EMail Wolf EMail Wolf
EasyDL
Ebingbong Ebingbong
Ecxi Ecxi
EirGrabber Exabot
EroCrawler EyeNetIE
Extreme Picture Finder
FDM FDM
FHscan
Fimap Fimap
Firefox/7.0 Fuzz
Genieo FyberSpider
GermCrawler G-i-g-a-b-o-t
GalaxyBot
GetRight
GetWeb GetWeb
Getintent
Gigabot Gigabot
Gotit Go!Zilla
GrabNet Go-Ahead-Got-It
Grabber Grabber
Grafula
GrapeFX GrapeFX
GrapeshotCrawler
GridBot GridBot
HEADMasterSEO HEADMasterSEO
HMView HMView
HTTP::Lite
HTTrack
Harvest
Havij
Hloader
HonoluluBot HonoluluBot
Humanlinks Humanlinks
HybridBot HybridBot
IDBTE4M IDBot
Iblog Iblog
Id-search Id-search
Image Sucker IlseBot
IndeedBot
Indy Library Indy Library
InfoNaviRobot Iria
Iskanie
IstellaBot IstellaBot
JamesBOT JOC Web Spider
Jbrofuzz Jbrofuzz
JennyBot
Jetty
Jorgee
Jyxobot
LWP::Simple LWP::Simple
Lanshanbot
Larbin Larbin
Leap
LeechFTP LeechFTP
LeechGet Libwhisker
LibWeb
LieBaoFast LieBaoFast
Lightspeedsystems Likse
LinkWalker LinkWalker
LinkpadBot Linkdexbot
LinksManager LinqiaRSSBot
LinqiaScrapeBot Lipperhey
Lipperhey Spider
Litemage_walker Litemage_walker
Lmspider Lmspider
Ltx71
MIDown tool MIDown tool
MJ12bot MSFrontPage
MQQBrowser Magnet
Mag-Net Majestic-SEO
Mail.RU_Bot
MarkMonitor MarkMonitor
Masscan MarkWatch
Mata Hari Mata Hari
MauiBot MauiBot
MeanPath Bot Mb2345Browser
Mediatoolkitbot Mediatoolkitbot
MicroMessenger Microsoft Data Access
Mojeek Moblie Safari
MolokaiBot
Morfeus Fucking Scanner Morfeus Fucking Scanner
Mr.4x3 Nameprotect
Musobot Navroad
Nessus
Net Vampire Net Vampire
NetLyzer NetLyzer
Nettrack NetSpider
NetZIP
Netvibes Netvibes
NextGenSearchBot NextGenSearchBot
Nibbler Nibbler
Niki-bot Nmap
Octopus OpenLinkProfiler
OnCrawl
Openfind Openfind
Openvas
OrangeBot OrangeBot
OutfoxBot OrangeSpider
PageScorer PHPCrawl
PageThing.com POE-Component-Client-HTTP
Panscient Picsearch
Papa Foto
PeoplePal
Piepmatz Piepmatz
Pimonster Pixray
ProPowerBot
Psbot
Pu_iN Pu_iN
Pump Pump
PyCurl PyCurl
QueryN Metasearch RankActive
Quick-Crawler RankActiveLinkBot
RankFlex RankingBot2
RankingBot
Rankivabot
Re-re Re-re
ReGet RebelMouse
Recorder
RedesScrapy RedesScrapy
RepoMonkey
RocketCrawler RocketCrawler
SEOlyticsCrawler SBIder
SEOstats SEOkicks-Robot
SMTBot SMTBot
Scanbot ScanAlert
Scrapy ScoutJet
SemanticJuice Screaming
Seekport
Semrush Semrush
SentiBot SeoSiteCheckup
Shodan SeobilityBot
Site Sucker Siphon
SiteExplorer
SiteLockSpider
SiteSucker SiteSucker
Sitebeam Sitebeam
Siteimprove Siteimprove
Sitevigil Sitevigil
SmartDownload Snapbot
SocialRankIOBot
Sociscraper Sociscraper
Sosospider Spammen
Sottopop
SpankBot SpankBot
Spanner
Spinn3r Spinn3r
Steeler Sqlworm
Sucker Sucker
Sucuri
SuperBot
SuperHTTP SuperHTTP
Surfbot Suzuran
SurveyBot
T0PHackTeam
T8Abot
Teleport
Telesoft
Telesphorep Telesphorep
TheNomad Thumbor
TightTwatBot
Toata Toata
Toweyabot Tracemyfile
Turingos Turingos
Typhoeus Turnitin
TurnitinBot
Twice
UnisterBot UnisterBot
Upflow
VB Project VB Project
Vagabondo VCI
VidibleScraper VeriCiteCrawler
VoidEYE Virusdie
WASALive-Bot
WPScan WPScan
WWW-Mechanize WWW-Collector-E
WWWOFFLE
Wallpapers Wallpapers
WeSEE WallpapersHD
Web Auto Web Auto
Web Collage Web Collage
Web Enhancer
Web Pix
Web Sauger
WebBandit WebBandit
WebCollage
WebFetch WebFetch
WebFuck WebFuck
WebGo IS
WebImageCollector
WebLeacher WebLeacher
WebSauger
WebStripper
WebSucker WebSucker
WebZIP WebWhacker
WebsiteExtractor WebmasterWorldForumBot
Webshag
Webster Webster
Whack Whatweb
Widow Who.is Bot
Wonderbot WinHTTrack
Woobot Zermelo
Wotbox ZumBot
Wprecon ZyBorg
YoudaoBot adscanner
Zauba autoemailspider
Zitebot cah.io.community
ZmEu
ZoomBot
arquivo-web-crawler
arquivo.pt
backlink-check
coccocbot coccocbot
crawler.feedback
crawler4j crawler4j
demandbase-bot domainsproject.org
evc-batch
gopher gopher
ips-agent ips-agent
magpie-crawler isitwp.com
meanpathbot meanpathbot
plumanalytics mediawords
s1z.ru muhstik-scan
oBot
page scorer
polaris version
probe-image-size
ripz
scalaj-http
scan.lol scan.lol
seostar seoscanners
serpstatbot sitechecker.pro
sp_auditbot siteripz
sysscan trendiction.com
xpymep1.exe webgains-bot
webprosbot
zgrab zgrab

298
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
01h4x.com
404checker 404checker
404enemy ADmantX
AIBOT ALittle Client
ASPSeek
Abonti Abonti
Aboundex Aboundex
AfD-Verbotsverfahren Acunetix
Aipbot AhrefsBot
Alexibot Alexibot
AllSubmitter AllSubmitter
AlphaBot Ankit
Anthill Anthill
Asterias Aspiegel
Atomseobot
Attach
BBBike BBBike
BDCbot
BDFetch BDFetch
BackWeb BLEXBot
BackStreet
Backlink-Ceck Backlink-Ceck
Bandit Badass
Barkrowler
BatchFTP
BetaBot BetaBot
Black Hole Bitacle
Blow Blow
BlowFish
Boardreader
Bolt
BotALot
Brandwatch Brandwatch
Buck
Buddy Buddy
BuiltWith
CATExplorador CATExplorador
CSHttp CCBot
CazoodleBot
CensysInspect CensysInspect
CheeseBot
CherryPicker CherryPicker
ChinaClaw
Chlooe
Cocolyzebot Cocolyzebot
Collector Collector
Copyscape
Craftbot Craftbot
CrazyWebCrawler
Crescent
CrunchBot CrunchBot
Custo Custo
CyotekWebCopy
DTS Agent DTS Agent
DataCha0s DataCha0s
DatabaseDriverMysqli DatabaseDriverMysqli
Demon Demon
Devil
Digincore Digincore
DigitalPebble Dirbuster
Disco Discobot
Dispatch DomainAppender
DnyzBot ECCP/1.0
DomainStatsBot
Domains Project
EMail Siphon
EMail Wolf EMail Wolf
Ebingbong EirGrabber
EroCrawler
ExtLinksBot
Extractor Extractor
Extreme Picture Finder FHscan
Ezooms Fimap
FDM Firefox/7.0
FemtosearchBot FlashGet
Fuzz
Fyrebot Fyrebot
G-i-g-a-b-o-t GT::WWW
GetWeb GetRight
Getintent Getintent
Gigabot
Go!Zilla Go!Zilla
GoZilla
Gotit Gotit
GrabNet GridBot
HTTP::Lite HEADMasterSEO
HTMLparser
HTTrack
Haansoft
HaosouSpider HaosouSpider
Harvest IRLbot
HonoluluBot Indy Library
Humanlinks
IDBTE4M
IDBot
Iblog
Image Sucker
IndeedBot
InfoNaviRobot
InfoTekies InfoTekies
InternetSeer InterGET
Iria Iskanie
IstellaBot IstellaBot
JamesBOT
Jbrofuzz
JennyBot
JetCar JetCar
Joomla Jetty
Jorgee JikeSpider
Jyxobot
Kenjin Spider
Keybot Translation-Search-Machine
Keyword Density
Kinza
LNSpiderguy
LWP::Simple LWP::Simple
Lanshanbot Lanshanbot
LeechFTP Larbin
LeechGet Leap
Lftp
LibWeb LibWeb
Libwhisker LieBaoFast
LinkWalker LinkWalker
Linkbot
LinkextractorPro
LinkpadBot LinkpadBot
LinksManager LinqiaMetadataDownloaderBot
LinqiaScrapeBot LinqiaScrapeBot
Lipperhey
Lipperhey Spider
Litemage_walker Litemage_walker
MSFrontPage MFC_Tear_Sample
Magnet MJ12bot
Mail.RU_Bot MTRobot
Majestic SEO Mag-Net
MarkMonitor Majestic12
MarkWatch MarkWatch
MauiBot MauiBot
Mb2345Browser
MeanPath Bot MeanPath Bot
Mediatoolkitbot Mediatoolkitbot
MegaIndex.ru MegaIndex.ru
Microsoft Data Access Metauri
Microsoft URL Control NPbot
Minefield
Moblie Safari
Morfeus Fucking Scanner
Mozlila
Mr.4x3
Msrabot
Musobot
Name Intelligence
Nameprotect Nameprotect
NearSite Nessus
NetAnts
NetLyzer
NetSpider NetSpider
Nettrack NetZIP
Netcraft
Netvibes Netvibes
Nimbostratus Nibbler
Nmap Ninja
Not Offline Navigator
Nutch
OpenLinkProfiler OpenLinkProfiler
Openvas Openfind
OrangeSpider OutclicksBot
PageGrabber OutfoxBot
POE-Component-Client-HTTP
PageScorer PageScorer
Panscient Panscient
Papa Foto PeoplePal
Pavuk Petalbot
Picscout Picscout
Picsearch Pimonster
ProWebWalker Psbot
Pump
PyCurl PyCurl
RSSingBot QueryN Metasearch
RankActive RankActive
RankFlex RankFlex
RankingBot RankingBot
Rankivabot Rankivabot
RankurBot
Re-re
RealDownload RealDownload
Recorder Recorder
SEOkicks RepoMonkey
SEOkicks-Robot SEOkicks-Robot
SEOprofiler SMTBot
SalesIntelligent
ScanAlert ScanAlert
Screaming
ScrepyBot ScrepyBot
SearchmetricsBot SemanticJuice
SemrushBot SeobilityBot
Seomoz
Shodan
Siphon Siphon
SiteLockSpider SiteLockSpider
SiteSnagger
SiteSucker
Sitebeam Sitebeam
Siteimprove Sitevigil
SmartDownload SlySearch
Snake
Snapbot Snapbot
SocialRankIOBot SocialRankIOBot
Spammen Sociscraper
Sosospider
SpaceBison
Spanner Spanner
Spbot
Sqlmap
Sqworm
Steeler Steeler
Stripper
Sucker
SuperBot SuperBot
SurveyBot Surfbot
Swiftbot Swiftbot
Szukacz
T0PHackTeam
Telesoft Telesoft
Telesphorep The Intraformant
Thumbor Thumbor
TightTwatBot
Titan
Toata Toata
Tracemyfile Trendiction
Trendictionbot Trendictionbot
URLy.Warning Turnitin
V-BOT TurnitinBot
VB Project Typhoeus
VCI
VoidEYE VoidEYE
Voil Voil
WASALive-Bot
WBSearchBot WBSearchBot
WWW-Collector-E Wallpapers/3.0
WWW-Mechanize WallpapersHD
WWW::Mechanize WeSEE
Web Auto Web Sauger
Web Collage Web Sucker
Web Fetch
Web Pix
WebCopier WebCopier
WebFetch
WebFuck WebFuck
WebGo IS
WebLeacher WebLeacher
WebPix
WebReaper WebReaper
WebStripper WebSauger
WebSucker WebWhacker
WebZIP Webshag
WebsiteExtractor WebsiteQuester
Webster Webster
Whacker Whack
WinHTTrack WinHTTrack
WiseGuys Robot WiseGuys Robot
Wprecon Woobot
Xenu Xaldon WebSpider
YoudaoBot Zade
Zauba
Zermelo Zermelo
Zeus ZumBot
ZmEu ZyBorg
ZoomBot arquivo.pt
ZoominfoBot backlink-check
arquivo-web-crawler
clark-crawler
coccocbot
crawl.sogou.com
crawler.feedback crawler.feedback
crawler4j crawler4j
demandbase-bot eCatch
domainsproject.org facebookscraper
instabid heritrix
internetVista monitor internetVista monitor
ips-agent ips-agent
isitwp.com
lwp-trivial lwp-trivial
magpie-crawler magpie-crawler
meanpathbot meanpathbot
mediawords mediawords
oBot oBot
pcBrowser plumanalytics
ripz polaris version
scan.lol s1z.ru
seocompany.store satoristudio.net
siteripz scalaj-http
sogouspider seostar
serpstatbot
sp_auditbot sp_auditbot
spyfu sysscan
trendiction.de trendiction.com
webgains-bot voyagerx.com
webmeup-crawler
webpros.com
webprosbot
x09Mozilla x09Mozilla
zauba.io
zgrab zgrab

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
aloofly.com 3dracergames.com
avto-oligarh.ru cracksplanet.com
checkm8.com directivepub.com
golfresa.lucania.se iqupdatetmz.win
googlepositions.com ku6.com
hobbyhuren-datenbank.com mansiondelrio.co
hosting-tracker.com mmgq.ru
podshipniki-nsk.ru mmstat.com
uhdtv.website prointer.net.ua
watchmyfb.pl tamada69.com

936
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
00it.com
0912701309f8ce.com
1-free-share-buttons.com 1-free-share-buttons.com
1001watch.com.ua 1688.com
123kuma.com 178evakuator178.ru
1kinobig.ru
2000k.ru
2345.com
24x7-server-support.site
2daytrendingnews.com 2daytrendingnews.com
4senses.co 2x2fan.ru
4webmasters.org 4rent.ru
55wmz.ru 8xv8.com
57883.net DomainStatsBot
5forex.ru a.frcls.fr
883zy.com aa625d84f1587749c1ab011d6f269f7d64.com
8jn.dating-app.ru aab94f698f36684c5a852a2ef272e031bb.com
aa14ab57a3339c4064bd9ae6fad7495b5f.com accessoires-mode.in
aanapa.ru adtech.us
aasoldes.fr adtology.com
acads.net adultactioncam.com
acheterviagrafr24.com adultwebhosting.info
acunetix-referrer.com ageofclones.com
adrenalin-stk.ru aktobe.xkaz.org
adservme.com alfabot.xyz
adsref.men allblogroll.com
agroeconom.kz
aibolita.com
airlandsea.info
aksonural.ru
ald2014.org
alekseevec.ru
algarveglobal.com
algerianembassy.co.in
alldubai.biz alldubai.biz
allforminecraft.ru allornamenti.com
allpdfmags.net allpdfmags.net
ampower.me alltheviews.com
ananumous.ru alphahoverboards.com
amyfoxfitness.com
analytics-ads.xyz
android-vsem.org android-vsem.org
android4fun.org antons-transporte.de
animal-drawings.com apiholdingmypage-a.akamaihd.net
animebox.com.ua apioasisspacenet-a.akamaihd.net
anonymous-redirect.com app-ready.xyz
apishops.ru apper.de
apple.com-webbrowsing-security.review applyneedy.xyz
arenanews.com.ua approvedlocal.co.za
as5000.com arcadeplayhouse.com
asociatia-tipografilor-transilvania.ro arraty.altervista.org
atlant-auto.info artefakct.com
autogrep.ru artparquet.ru
avtoarenda.by asmxsatadriverin.aircus.com
azartclub.org asscenihotosidea.blogspot.com
bablonow.ru atlasvkusov.ru
baladur.ru auto-moto-elektronika.cz
bangla-chat-uk-paralud.ga autoloans.com
autolombard-krasnodar.ru
avon-severozapad.ru
avon-ukraine.com
avtovolop.ru
axbocz.net
b2b-lounge.com
bag77.ru
balois.worldbreak.com
bannerbank.ru
barnfurnituremart.com
battlecarnival.su
bayareaaeroclub.org bayareaaeroclub.org
bcmp.org bbtec.net
beachpics.com beachdriveblog.com
beauby.ru beatifullandscape.co
beclean-nn.ru
beetpics.pw
beget.tech beget.tech
beremenyashka.com best-coupon-offer.com
besthoro.ru best-deals-products.com
bestprofits-there.com best-seo-solution.com
betune.onlinewebshop.net bestadbid.com
bezcmexa.ru bestfortraders.com
bibys.com bestkfiledxd.cf
bigcareer.info bio.trade-jp.net
bioscorp.ru bird1.ru
bizlist.com.de bizcheapjerseyswholesalechina.com
bmw-ark.ru bjetjt.com
bmwhighperformers.com blogporn.in
boazpower.com bnt-team.com
bookhome.info bombla.org
buehne-fuer-menschenrechte.de book-bets.com
buigas.00it.com brainboosting.club
buqayy0.livejournal.com brainxs.us
buron.pw browserprotecter.com
buy-cheap-online.info buntube.net
buyessayonline19.blogspot.ru buqyxa.rincian.info
buyk.host.sk buy-loft.ru
buytizanidineonline.blogspot.com buynorxx.com
callawaygolfstore.online buypanicdisorderpill.com
cand.jp cah.io.community
candiceloves.us candiceloves.us
candytiner.com candytiner.com
canoncdriverq3.pen.io cartierjusteunclou.xyz
canrioloadm.gq cartierlovebraceletreplica.xyz
capacitacionyaprendizaje.com cartierring.xyz
carloans.com cashonads.com
cdncash.com castingbank.ru
censys.io chatroulette.si
cgi2.nintendo.co.jp cheap-trusted-backlinks.com
cheapbarbour.online cheapjerseysa.com
cheapjerseysfootballshop.com ci.ua
chlooe.com ciceros.co
chocoslim.pro clayvasedesigns.tk
cialischstgerts.com clickpapa.com
citetick.com com-onlinesupport.host
classicakuhni.ru com-onlinesupport.site
classiquebijoux.ru
cleanpcnow.com
clevernt.com
clothesforcash.com
club-lukojl.ru
coindirect.io
compliance-alexa.xyz
compliance-andrew.xyz compliance-andrew.xyz
compliance-george.xyz compliance-willy.top
compliance-jack.top consorzioilmosaico.org
compliance-walter.top cookie-law-enforcement-aa.xyz
compucelunlock.net cookie-law-enforcement-hh.xyz
conciergegroup.org coolgramgoods.com
concordexoticrentals.com coolwallpapers-hd.com
copro.pw corta.co
crackzplanet.com countbertwistdisp26.soup.io
crazyboost.pro counterbot.com
crazyprotocol.com creditnation.ru
cryptoswap.biz cs-passion.pl
culmimg.pw culturevie.info
customsua.com.ua customsua.com.ua
cutalltheshit.com cutt.us
damasarenai.info dayibiao.com
dataloading.net dellalimov.com
ddospanel.com demian.kz
demenageur.com dentfidemountpreach.tk
den-noch24.ru deshevo-nedorogo.ru
detskie-konstruktory.ru dev78.dioniqlabb.se
detskie-zabavi.ru digitalfaq.com
diamond-necklace.info dimfour.com
dieta-personalna.pl discovertreasurenow.com
diffbot.com dispo.de
digital-video-processing.com
diminishedvalueoforegon.com
div.as
dlya-android.org dlya-android.org
downloadeer.net dojki-hd.com
downloadkakaotalk.com dolohen.com
dprtb.com drugspowerstore.com
drupa.com drunkmoms.net
dumuelave.xyz dverimegapolis.ru
eaplay.ru dyshagi.ru
ec-file.info easytuningshop.ru
efnor-ac.com ecommerce-seo.com
el-nation.com edwinkonijn.com.au
eleimgo.pw elektrischezigarette2.onsugar.com
elexies.info emediate.eu
elmifarhangi.com empirepoker.com
encodable.com englate.com
epicbrogaming.com eredijovon.com
erectile.bid ereko.ru
essaypro.com erotische-geschichten-xxl.com
euromasterclass.ru es5.com
excitacion.info excitacao.com
extremez.net expertnaya-ocenka.ru
ez8motelseaworldsandiego.com ezigarettenkaufen2.dreamwidth.org
ezigarettenshop2.myblog.de face.hostingx.eu
f-online.de falopicm.pw
fable.in.ua fast-wordpress-start.com
falcoware.com feeriaclub.ru
fermersovet.ru femmesdenudees.com
fickkontaktehobbyhuren.com fetlifeblog.com
fidelityfunding.com fikasound.tk
finteks.ru film-one.ru
fitnesspiks.com filmi-onlain.info
flash4fun.com financehint.eu
fodelsedagspresenter.nu fishingwholesale.us
forensicpsychiatry.ru floridahuntingfishingadventures.com
forex21.ru floridamhca.org
forum20.smailik.org fortevidyoze.net
forum69.info forum-engineering.ru
foxjuegos.com foto-telok.net
foxydeal.com fotoxxxru.com
free-floating-buttons.com franklinfire.co
free-traffic.xyz freakycheats.com
free-video-tool.com free-social-buttons.com
freefoto.ca freshberry.com.ua
freemaintenancesysforpcandmac.top
freenom.link
freevpn.space
freshdz.com freshdz.com
frivgame250.com
front.to front.to
frustrated-favorable.gq
fuckbuddybestgilf.info fuckbuddybestgilf.info
g.starmoe.xyz funnymama.com
game-mmorpg.net g33.org
gabeshop.ru
gael-s.ru
gallerylisting.com
gambarkatabaru.com
gamebackyard.com gamebackyard.com
gamedayhouse.com gaytube.com
games.kolossale.ru gaz-voshod.ru
gamewrath.com ge0ip.org
gavuer.ru genericlowlatencyasiodriverhq.aircus.com
gay.adultgalls.com generousdeal-a.akamaihd.net
gdcentre.ru get-free-social-traffic.com
ge0ip.com getlaid-xxxhookupdirect.com
gfaq.ru gettpromos.com
gidonline.one ghernnqr.skyrock.com
gloverid.site gk170.ru
googlemare.com goldandcard.ru
gribkovye-zabolevaniya.com goldpanningtools.com
gungamesz.com googst2.ru
gwhwpxbw.bloger.index.hr greenzaim.ru
hayate.biz gribokstop.com
hdwalls.xyz gsasearchengineranker.xyz
healing-dysplasia.ru h2monline.com
healmytrauma.info hd-film.pl
heartofpayne.xyz headpress.ru
herehloadibs.cf hetmanship.xyz
hexpilot.com hildinghr.se
highstairs-a.akamaihd.net hit-kino.ru
histock.info hitmuzik.ru
hkdiiohi.skyrock.com hollywoodactress.info
hmywwogw.bloger.index.hr hotel-mkad.ru
hotdl.in hoverboard360.se
houtings.xyz ictizanidinehcl4mg.blogspot.com
hulfingtonpost.com idealtits.net
humanorightswatch.org ideoworld.org
humbmosquina.tk ilmen.net
hunterboots.online imabase.com
hustoon.over-blog.com imagecoolpub.com
hut1.ru imagerydatabase.com
ico.re interesnie-faktu.ru
ideibiznesa2015.ru interior-stickers.ru
ifmo.ru internetartfair.com
images.gyffu.com
iminent.com
imperia31.ru
impotentik.com
indetiske.ya.ru
infazavr.ru
infobabki.ru
internetproviderstucson.com
intimshop-fantasy.ru
investmac.com investmac.com
iopeninghours.co.uk iqupdatetmz.win
iplogger.org isotoner.com
iplusbit.blogspot.co.za ixora.pro
ipornox.xxx jav-way.site
ispaniya-costa-blanca.ru javidol.site
istizanidineanopiate.blogspot.com jerseywholesalechinabiz.com
ivanovo.zrus.org jolic2.com
javcoast.com jpcycles.com
jerseysbizwholesalecheap.com
jovencitas.gratis
kaac.ru kaac.ru
katushka.net kareliatobacco.ru
keywordbasket.com kellyonline.xyz
kinoduh.ru kerei.ru
kinogonew.ru keywordblocks.com
konoplisemena.com keywordteam.net
koopilka.com kichenaid.ru
kopihijau.info kino-rating.ru
koptims.tiu.ru kinosed.net
krasnodar-avtolombards.ru kit-opt.ru
kupit-adenu.ru kladrus.ru
kutikomi.net klitimg.pw
lacave.ntic.fr kmd-pto.ru
laptop-4-less.com knigonosha.net
lemon-ade.site kosmetyki.tm.pl
lifehacĸer.com kretpicf.pw
lifeinsurancekb.com kvartir-remont.biz
lignofix.ua kw21.org
linkdebrideur.xyz labafydjxa.su
linkredirect.biz ladsup.com
littlecity.ch languagecode.com
long-beach-air-conditioning.com larchik.net
louisvuittonoutletstore.net ledpolice.ru
lumb.co letslowbefast.today
machicon-ueno.info libertybilisim.com
macresource.co.uk lion.conboy.us
manifestation.betteroffers.review lionking-1994.blogspot.com
marketingvici.com live-sexchat.ru
marwer.info lkbennettoutlet.online
max-p.men lsex.xyz
maxxtor.eu lubetube.com
mcar.in.ua lunamedia.co
mcnamaratech.com lunchrock.co
mearns-tractors.co.uk luxmagazine.cf
lyngdalhudterapi.no
lyrics.home-task.com
macnewtech.com
madot.onlinewebshop.net
magiadinamibia.blogspot.com
managerpak204.weebly.com
mantramusic.ru
manuscript.su
marcogrup.com
massage-info.nl
matchpal-a.akamaihd.net
max-eclat.men
mebel-vstroika.ru mebel-vstroika.ru
mediaoffers.click medanestesia.ru
mega-bony2017.pl medicines-choice.com
megavolt.net.ua medicovi.com
metaxalonevstizanidine.blogspot.com memberty.com
mhi-systems.ru mere.host.sk
message-warning.net
mezaruk.info
michaelkorsoutletstore.net michaelkorsoutletstore.net
michaelkorssaleoutletonline.net microstatic.pl
mielec.pl mikrobiologies.ru
migente.com mirtorrent.net
milblueprint.com mobilierland.com
minet.club mobsfun.net
mini.7zap.com
mixtapetorrent.com
mmostrike.ru
mncrftpcs.com
mobicover.com.ua
mobifunapp.weebly.com
mobot.site
mokrayakiska.com
mompussy.net
monarhs.info monarhs.info
monclercheap.xyz monclerjacketsoutlet.pw
monclervests.xyz
monetizationking.net monetizationking.net
movpod.in monitorwebsitespeed.com
moxo.com muizre.ru
mp3ritm.top myfreetutorials.com
msk-diplomat.com mylida.org
muz-shoes.ru mywallpaper.top
my-cash-bot.co netfacet.net
mydeathspace.com networkcheck.xyz
myprintscreen.com nootrino.com
mzdish.site northfacestore.online
nationalbreakdown.com nudepatch.net
nhl17coinsforps3.gratisblog.biz o-o-6-o-o.ru
nisuturnetdgu.tk obiavo.com
nonameread45.live
nyfinance.ml
oballergiya.ru
obiavo.net
obiavo.ru
offtime.ru offtime.ru
okayimage.com olgacvetmet.com
oksrv.com onemantrip.com
oktube.ru oneshotdate.com
omgtnc.com onlyforemont.ru
one-gear.com optibuymac.com
oneminutesite.it
online-templatestore.com
online247.ml
onlinebay.ru
onlineserialy.ru
ordernorxx.com
orion-code-access.net orion-code-access.net
paleohub.info ossmalta.com
pavlodar.xkaz.org ostrovtaxi.ru
perfection-pleasure.ru ourville.info
owathemes.com
paintingplanet.ru
panicatack.com
paparazzistudios.com.au
paydayonlinecom.com
pdns.cz
pdns.download
perl.dp.ua perl.dp.ua
perm-profnastil.ru pestomou.info
perm.xrus.org petrovka-online.com
phelissota.xyz phobia.us
picscout.com phormchina.com
picsearch.com photo.houseofgaga.ru
picsfair.com photochki.com
pictures-and-images.com phuketscreen.com
picturesmania.com pics-group.com
pirateday.ru pihl.se
pistonclasico.com pinkduck.ga
pixell.club pipki.r.acdnpro.com
pl-vouchers.com plugingeorgia.com
play.leadzupc.com podshipniki-nsk.ru
poiskzakona.ru polska-poezja.com
pokemon-go-play.online poptool.net
pons-presse.com popugaychiki.com
popugauka.ru popup-fdm.xyz
popup.matchmaker.com pornhive.org
porn555.com pornogad.com
pornhub-forum.ga
porno-play.net
pornolook.net pornolook.net
powenlite24.ru pornowarp.info
pozvonim.com pornstartits.xblog.in
praisong.net pornzone.tv
prod2016.com preconnubial.usuby.site
progonrumarket.ru preparevideosafesystem4unow.space
proprostatit.com privatbank46.ru
qpypcx.com prize44.com
rapidokbrain.com profolan.pl
razamicroelectronics.com promover.org
realting-moscow.ru pronorm.fr
recipedays.ru prostitutki-astana.org
redhotfreebies.co.uk proxyradar.com
registrydomainservices.com psvita.ru
relax.ru qitt.ru
remont-ustanovka-tehniki.ru quit-smoking.ga
remote-dba.de rankia.com
remybutler.fr rankings-analytics.com
renecaovillasale.online ranksignals.com
resant.ru ranksonic.org
resellerclub.com rasteniya-vs-zombi.ru
resultshub-a.akamaihd.net reklama-i-rabota.ru
rfd-split.hr replica-watch.ru
robotixix.com reversing.cc
royalvegascasino.com revistaindustria.com
richinvestmonitor.com
royal-betting.net
rucrypt.com
ruex.org.ua ruex.org.ua
russkie-gorki.ru russia-today-video.ru
sad-torg.com.ua ryetaw.com
salutmontreal.com sack.net
sbwealthsolutions.ca sady-urala.ru
salmonfishingsacramentoriver.com
sankt-peterburg.nodup.ru
sarm.tk
savememoney.co.za
scalerite.co.za scalerite.co.za
scanner-ivan.top scanner-alexa.top
scenicmissouri.us scanner-brian.top
scrapinghub.com scanner-viktor.top
screpy.com sdsjweb.com
sdelatmebel.ru se-welding.ru
semalt.com searchimage.co
semaltmedia.com selectads.men
serialsway.ucoz.ru seo-2-0.com
sex-tracker.com seobility.net
sexpartygirls.net sexobzor.info
sexspornotub.com sextracker.com
shama-rc.net sexy-pings.com
shariki-zuma-lines.ru
shemalegalls.blogporn.in shemalegalls.blogporn.in
shillyourcoins.com shodanhq.com
ship-marvel.co.ua shopperifymac.com
sibecoprom.ru sibecoprom.ru
signal03.ru sibtest.ru
site.ru sildenafil-tadalafil.info
sledstvie-veli.net simul.co
smokewithrabbits.com siteripz.net
snowplanes.com sizeplus.work
soc-proof.su slavia.info
socialbookmarksubmission.org smallseotools.com
softonicads.com sofit-dmd.ru
songoo.wz.cz sortthemesitesby.com
souvenirua.com soserfis.com
spidtest.org spabali.org
spywareit.com spasswelt.xyz
stairliftstrue.com spb.afora.ru
start.myplaycity.com specialfinanceoffers.com
starwars.wikia.com spl63.fr
staticfs.host spywarebegone.com
statistici.ro stauga.altervista.org
stpicks.com steame.ru
strv.se stoki.ru
sumo.com stop-gepatit.te.ua
tabletkinaodchudzanie.com.pl stroicol.net
taboola.com stroiminsk.org
takeprofitsystem.com suchenindeutschland.com
tecnoteakviareggio.it sundrugstore.com
teenforporn.com taihouse.ru
tehngr.ru tampabaywatch.org
telesvoboda.ru tdsing.ru
teslathemes.com templates.radiodigital.co
thegioixekhach.com thecoral.com.br
theprofitsmaker.net thexart.club
thetardistimes.ovh thfox.com
thin.me.pn tilido.com
thruport.com time-japan.ru
timetorelax.biz tizanidine4mgtablets.blogspot.com
tizanidinecapsules.blogspot.com tizanidineandgabapentin.blogspot.com
tizanidinestreetvalue.blogspot.com tizanidinecost.blogspot.com
tjkckpytpnje.com tizanidinedruginteractions.blogspot.com
tomatis.gospartner.com tizanidineduringpregnancy.blogspot.com
top-deal.com.pl tizanidinenarcotic.blogspot.com
top10-way.com toolsky.com
toyota.7zap.com toon-families.com
tracxn.com tootoo.to
traffic2money.com trafficnetzwerk.de
trafficmania.com trkur.com
trailer.cinemaflix.website turizmus.us
turbodsp.com uk-zheu20.ru
tvnewsclips.info ukr-lit.com
twittrading.com ukrtvory.in.ua
tytoona.com ultimateclassicrock.com
ugogo.info underthesite.com
ukrtextbook.com unisexjewelry.org
unitexindia.com unitexindia.com
uogonline.com unpredictable.ga
userequip.com uptime-alpha.net
valuado.com uptimebot.net
varbergsvind.se ural-buldozer.ru
varikoz24.com url-img.link
verymes.xyz vacuumcleanerguru.com
via-energy-acquistare.com vegan-foods.us
video-camer.com venerologiya.com
vip-dom.in viandpet.com
vip.51.la viddyoze.com
voloomoney.com videochat.ph
vip-file.com
vitoriacabos.com
vksaver-all.ru
vodaodessa.com
voditeltrezviy.ru
volgograd.xrus.org
voloo.ru
vse-pesni.com
vseigru.one vseigru.one
vtc.pw vzlomfb.com
vykupavto-krasnodar.ru w3data.co
watsonrealtycorp.com we-are-gamers.com
webs.com web.cvut.cz
website-analyzer.info websitevaluebot.com
wedding-salon.net wejdz-tu.pl
wesharepics.com westen-v.life
wikes.20fr.com westum.se
wildcattube.com while.cheapwebsitehoster.com
wildnatureimages.com whipme.yopoint.in
wingsofrefuge.net wholesalecheapjerseysfree.com
wiosenny-bon-1500.pl wholesalenfljerseys.us.com
wrz0iuebwhp5fg.freeddns.com wineitudes.wordpress.com
xn----7sbbagbq7bd5aheftfllo4m.xn--p1ai wjgony.com
xn--80aagddcgkbcqbad7amllnejg6dya.xn--p1ai wordkeyhelper.com
xn--80ajjbdhgmudixfjc8c5a9df8b.xn--p1ai worst-sites.online
xportvusbdriver8i.snack.ws wufak.com
xuki.us www.arenda-yeisk.ru
yellowstonevisitortours.com www.wohnkabinen-shop.de
youraticles.pl wyniki-lista.pl
yourothersite.com x-musics.com
z-master.ru xmladserver.com
zacreditom.ru xn-----6kcaabbafhu7cskl7akvongwpo7hvjj.xn--p1ai
zaimhelp.ru xn--1-8sbcpb0bdm8k6a.xn--p1ai
zakonobosago.ru xn--80adaggc5bdhlfamsfdij4p7b.xn--p1ai
zapiszto.pl xn--h1ahbi.com.ua
zarenica.net xn--q1a.xn--b1aube0e.xn--c1acygb.xn--p1ai
zhongwenlink.com xpresscare.ru
znakomstvaonlain.ru yebocasino.com
zvetki.ru yginekologa.com
zvezdagedon.ru youandcredit.ru
zdesformula.ru
zeg-distribution.com
zeroredirect10.com
zeroredirect11.com
zone-kev717.info
zoogdinsney.com
zscalerone.net

482
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
0c47f8422d3f.com 1bet.com
2nt.ru 23kw.ru
404.mn 4kepics.com
55wmz.ru
7a2rnuey1tw9ar.ru 7a2rnuey1tw9ar.ru
a1security.com.ua 7fon.ru
abctoppictures.net 8lufu.com
adclickthru.net aarbur.com
aktivator-windows10.blogspot.com absolutelyanalog.com
alert-fdm.xyz adservme.com
all4invest.ru adtech.us
alvtank.se advokateg.ru
animalrank.com afftrack001.com
apessay.com albumsuper.info
approvedlocal.co.za alice.it
autoplate.info allpdfmags.net
babieca.com alphaforum.ru
babosas.com ananumous.ru
best-coupon-offer.com anatomiy.com
bigpenisguide.com apelsinnik.website
bimatoprost-careprost.com apimossnetinfo-a.akamaihd.net
bitnote.co apimountainbikei-a.akamaihd.net
bolegapakistan.com apishops.ru
buzz-porno.info appiq.mobi
byme.se appmsr.org
cand.jp arcadepages.com
checkm8.com arenda-avtoprokat-krasnodar.ru
chiblackhawks-jerseys.com asia-forum.ru
chocolateslim-en-espana.com asseenontv.ru
choice-credit.ru atmagroup.ru
cialis-samples.com autochoixspinelli.com
cialischsrx.com autoua.top
cityadspix.com avtovolop.ru
cocolyze.com babyfactory.fr
comeondog.info baersaratov.ru
companies-catalog.com banki76.ru
compliance-alex.top banksrf.ru
compliance-alex.xyz bannerpower.com
compliance-jess.top beauty-b0x.pl
cookie-law-enforcement-ff.xyz blockety.co
credit-online.ws blog.axant.it
dalavia.ru boazpower.com
decorazilla.com brewdom.ru
divisioncore.com bristolhotel.com.ua
dominterior.org brokergid.ru
dpihatinh.gov.vn bronzeaid-a.akamaihd.net
dstroy.su bwlx.prepedu.cn
e90post.com cartierjusteunclou.xyz
elektronischezigarette2.mex.tl cartierreplica.top
elvel.com.ua casinos4dummies.co.uk
extremez.net cfacarrosserie74.com
ezigarettekaufen2.blox.pl chatroulette.si
ezigaretteshop.webs.com chcu.net
ferretsoft.com cognitiveseo.com
fickenbumsen.net compliance-irvin.top
flooringinstallation-edmonton.com compliance-ivan.top
fm-upgrade.ru compliance-julia.top
fotosfotos.eu contextualyield.com
free-today.com copenergo.ru
freejabs.com craftinsta.ru
freewhatsappload.com cwetochki.ru
cyclobenzaprinevstizanidine.blogspot.com
data1.scopich.com
delfin-aqua.com.ua
demian.kz
depositfiles-porn.ga
detalizaciya-tut.biz
dgfitness.co
digilander.libero.it
dolohen.com
eets.net
empathica.com
erotag.com
evrotekhservis.ru
exhibitionplus.eu
exlarseva.webblog.es
f5mtrack.com
fable.in.ua
famix.xyz
farm26.ru
feeriaclub.ru
felizporno.com
fickluder69.com
finteks.ru
foxinsocks.ru
fuckmill.com
fullfileaccess.com fullfileaccess.com
game-top.su funcrushgames.com
glasof.es fx-brokers-review.com
glavprofit.ru g33.org
golaya.pw gamewrath.com
google-liar.ru ge0ip.net
gotorussia.com ghernnqr.skyrock.com
hasshe.com gombita.info
hayate.biz gomusix.com
healgastro.com goodhousekeeping.com
hem.passagen.se gotomontenegro.net
hop.clickbank.net gribokstop.com
hotblog.top growboxbl.ru
hyipmanager.in guardlink.com
i-midias.net.br guildebzh.info
hamilton.ca
happy.new.yeartwit.com
heartofpayne.xyz
hostingclub.lk
hotcore.info
i-service.kz
ido3.com ido3.com
interesnie-faktu.ru igithab.com
investsuccess.org ilbe.club
iopeninghours.co.uk infobanks.ru
iphantom.com inspiring-desperate.tk
iqoption-bin.com intim-uslugi.info
ivearchenceinflu.cf izoll.ru
izhevsk.xrus.org karting196.ru
journalhome.com kino-ecran.ru
junglenet-a.akamaihd.net la-fa.ru
keywordblocks.com labelwater.se
kinosed.net lankarns.com
kollekcioner.ru letmacworkfaster.world
komp-pomosch.ru lifeinsurancekb.com
krasivoe-hd.net
krassh.ru
ks1234.com
labvis.host.sk
lampokrat.ws
laptoper.net
larutti.ru
lechtaczka.net
likrot.com
live-sexchat.ru
lob.com.ru
losangeles-ads.com
lowephotos.info
mackeeper-land-672695126.us-east-1.elb.amazonaws.com
mactechinfo.info mactechinfo.info
makis.nu mediaoffers.click
mebel-alait.ru mesbuta.info
merryhouse.co.uk message-warning.net
metallosajding.ru metaxalonevstizanidine.blogspot.com
mezaruk.info miniature.io
minet.club missclub.info
miniads.ca mmoguider.ru
mobilemedia.md mobsfun.net
mobplayer.ru
moncleroutletonline.win
moomi-daeri.com moomi-daeri.com
mp3films.ru mossmesi.com
mrlmedia.net movpod.in
muabancantho.info moyaterapiya.ru
musicpro.monster mrmoneymustache.com
mycaf.it mrvideospornogratis.xxx
mydownloadengine.com mwtpludn.review
narosty.com mygameplus.com
negociosdasha.com na15.ru
netallergy.ru newsperuse.com
netpics.org
nhl17coins.exblog.jp
njpalletremoval.com
nl.netlog.com nl.netlog.com
novgorod.xrus.org nvformula.ru
obiavo.net nyfinance.ml
olgacvetmet.com o.light.d0t.ru
one.net.in o00.in
optom-deshevo.ru obesidadealgarve.com
ostroike.org office2web.com
partner-pop.men old-rock.com
pepperstyle.ru onlywoman.org
piccshare.com ooomeru.ru
pliks.pl ororodnik.goodbb.ru
pomoc-drogowa.cba.pl paphoselectricianandplumber.com
pornotubs.com par-fallen.ga
powc.r.ca.d.sendibm2.com parajumpersstore.online
pravoholding.ru pc-services.ru
princevc.com picture-group.com
prize44.com picurams.pw
prizefestival.mobi pirateday.ru
pro-tec.kz plaff-go.ru
prodess.ru pogodnyyeavarii.gq
profitwithalex.info pokemon-go-play.online
progonrumarket.ru porndairy.in
prombudpostach.com.ua pornoblood.com
qitt.ru pornoreino.com
quickbuck.com powenlite24.ru
randalljhoward.com predmety.in.ua
rating-casino2021.ru privatefx.all4invest.info
razamicroelectronics.com producm.ru
redirectingat.com prodvigator.ua
registry-clean-up.net rankia.com
reklama-i-rabota.ru rapidgator-porn.ga
remote-dba.de rebuildermedical.com
riralmolamsaca.tk remont-ustanovka-tehniki.ru
rocis.site resellerclub.com
rockprogblog.com rewardpoll.com
rubanners.com rfd-split.hr
runtnc.net rockingclicks.com
s1z.ru ros-ctm.ru
sammyweaver.com ruclicks.com
samo-soznanie.ru rusvideos.su
scanner-jack.top safe-app.net
seansonline24.pl salut-camp.ru
seccioncontrabajo.com scanner-ivan.top
security60-e.com scanner-nelson.top
sel-hoz.com sdsjweb.com
seo-prof1.xyz semalt.com
seocheckupx.com seocheki.net
seoexperimenty.ru service.adtech.fr
serviporno.com sevenstars7.com
sex-pr.net sex-pr.net
sexsaoy.com sexreliz.com
sherlock.se sextracker.de
site-speed-checker.site shakhtar-doneck.ru
soblaznu.net shtaketniki.ru
soc-proof.su silktide.com
soft-program.com siteonomy.com
sonnikforme.ru skypasss.com
splendorsearch-a.akamaihd.net slavic-magic.ru
sprttrack.com smartbalanceworld.com
stair.registrydomainservices.com sohoindia.net
stal-rulon.ru spabali.org
steame.ru spin2016.cf
stjamesschool.info stretchmate.net
stromerrealty.com students-cheapskate.ml
stroymonolit.su studworks.org
studiokamyk.com.pl supernew.org
suchenindeutschland.com surintech.ac.th
superstarfloraluk.com t-bygg.com
svtrd.com td-33.ru
td-l-market.ru tds-advert005.info
thecoral.com.br teguh.info
thedownloadfromwarez.blogspot.com telegraf.by
thefarmergame.com ticketsys.inetwd.com
thegioixekhach.com tizanidinedruginteractions.blogspot.com
thetoiletpaper.com tizanidinesleepaid.blogspot.com
thexart.club topcasinoratings.ru
tizanidineinfo.blogspot.com torrentdownloadhub.com
tksn.ru torrentred.games
toon-families.com tracxn.com
top-karkas.ru
top10-online-games.com
topclickguru.com
totu.info
tradgardspartner.se tradgardspartner.se
traffic2money.com trafficmonetize.org
trailer.cinemaflix.website traffictrade.life
tupper-shop.ru truck-addzilla.life
turvgori.ru trudogolik.net
twincitiescarservice.com tv-spoty.info
uamtrk.com twittruth.com
udsgame.online umnovocaminho.com
ukrtvir.com.ua unmaroll.ya.ru
uptime-delta.net vandrie-ict.nl
urccvfmc.bloger.index.hr vektorpress.ru
usiad.net vezuviy.su
v720hd.ru vielporno.net
ventelnos.com vodkoved.ru
viberdownload10.com warezkeeper.com
video-chat.love watchmygf.net
videochat.mx webmasters.stackexchange.com
videochaty.ru webpromotion.ae
vkontarkte.com webshoppermac.com
wallpapers-best.com wholesalejerseysgaa.com
warning.or.kr wholinkstome.com
welck.octopis.com womensplay.net
westen-v.life worldlovers.ru
whatistizanidine2mg.blogspot.com www.labves.ru
winner7777.net xn----7sbbahaq9bb5afgiqfliv4m.xn--p1ai
winx-play.ru xn----itbeirbjbi7bc6bh2d.xn--p1ai
wufak.com youbrainboost.asia
wyniki-lista.pl zapatosenventa.info
xclicks.net zebradudka.com
xmlinde.com
xn-----6kcaacnblni5c5bicdpcmficy.xn--p1ai
xn-----8kcatubaocd1bneepefojs1h2e.xn--p1ai
xn----7sbahjd3btneuw1joc.xn--p1ai
xn----dtbndd4ae7eub.top
xn--80aodinpgi.xn--p1ai
yun56.co
za-fun-offer.com
zeroredirect2.com zeroredirect2.com
zolotoy-lis.ru zone-kev717.info
zvetki.ru

14
dev-tools/test_units/ratelimittest-beta.txt
View file

@ -1,11 +1,21 @@
<html> <!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html><html>
<head><title>503 Service Temporarily Unavailable</title></head> <head><title>503 Service Temporarily Unavailable</title></head>
<body> <body>
<center><h1>503 Service Temporarily Unavailable</h1></center> <center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center> <hr><center>nginx/1.18.0 (Ubuntu)</center>
</body> </body>
</html> </html>
ml><html> <html>
<head><title>503 Service Temporarily Unavailable</title></head> <head><title>503 Service Temporarily Unavailable</title></head>
<body> <body>
<center><h1>503 Service Temporarily Unavailable</h1></center> <center><h1>503 Service Temporarily Unavailable</h1></center>

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.170 0; 10.1.1.9 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.03.2994 ### Version: V4.2022.03.2995
### Updated: Tue Mar 22 10:04:30 UTC 2022 ### Updated: Tue Mar 22 22:01:21 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.03.2994 ### Version: V4.2022.03.2995
### Updated: Tue Mar 22 10:04:30 UTC 2022 ### Updated: Tue Mar 22 22:01:21 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##