vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-03 19:20:16 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2021.10.2639 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2021-10-08 22:08:40 +00:00
parent 9117c7e840
commit e54377b77f
48 changed files with 72181 additions and 72178 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2021.10.2638 #### Version: V4.2021.10.2639
#### Bad Referrers Blocked: [7078](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7078](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [623](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [623](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2021.10.2638 #### Version: V4.2021.10.2639
#### Bad Referrers Blocked: [7078](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7078](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [623](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [623](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -11,7 +11,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2021.10.2638 #### Version: V4.2021.10.2639
#### Bad Referrers Blocked: [7078](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7078](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [623](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [623](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

8880
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2021.10.2638 #### Version: V4.2021.10.2639
#### Bad Referrers Blocked: [7078](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7078](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [623](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [623](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

8884
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

8884
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

8884
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

8884
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.58 1; 10.1.1.88 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.58 0; 10.1.1.88 0;
127.0.0.1 0; 127.0.0.1 0;

8884
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.58 1; 10.1.1.88 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.58 0; 10.1.1.88 0;
127.0.0.1 0; 127.0.0.1 0;

8884
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.58 1; 10.1.1.88 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.58 0; 10.1.1.88 0;
127.0.0.1 0; 127.0.0.1 0;

8884
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
2638 2639

8884
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

8884
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
137.117.107.223 0; 20.185.230.228 0;

8884
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.58 1; 10.1.1.88 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.58 0; 10.1.1.88 0;
127.0.0.1 0; 127.0.0.1 0;

8884
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.58 1; 10.1.1.88 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.58 0; 10.1.1.88 0;
127.0.0.1 0; 127.0.0.1 0;

8884
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.58 1; 10.1.1.88 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.58 0; 10.1.1.88 0;
127.0.0.1 0; 127.0.0.1 0;

8884
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
137.117.107.223 0; 20.185.230.228 0;

8884
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
137.117.107.223 0; 20.185.230.228 0;

8884
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.58 1; 10.1.1.88 1;
127.0.0.1 1; 127.0.0.1 1;

18
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
ChinaClaw Alligator
FHscan Apexoo
IDBTE4M BetaBot
MSFrontPage FemtosearchBot
NetMechanic InterGET
RankActiveLinkBot NextGenSearchBot
Sucker Sottopop
Web Fetch Web Fetch
evc-batch WebBandit
plumanalytics dataforseo.com

300
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
01h4x.com
360Spider 360Spider
404checker
80legs 80legs
AIBOT Acunetix
ALittle Client AfD-Verbotsverfahren
Abonti
AiHitBot AiHitBot
Aipbot Aipbot
AllSubmitter AllSubmitter
Alligator Alligator
Ankit AlphaBot
Apexoo Anarchie
AwarioSmartBot AwarioSmartBot
BBBike BDCbot
BLEXBot
BackDoorBot BackDoorBot
BackStreet Backlink-Ceck
Bitacle Bitacle
Black Hole BlackWidow
Boardreader Blackboard
Blow
Brandprotect Brandprotect
Buddy Buddy
BuiltBotTough BuiltBotTough
CATExplorador CODE87
Cegbfeieh CSHttp
CensysInspect CensysInspect
CheeseBot
CherryPicker CherryPicker
ChinaClaw ChinaClaw
Cloud mapping Chlooe
Cogentbot Copier
CopyRightCheck CopyRightCheck
Crescent Copyscape
CrunchBot Cosmos
CrazyWebCrawler
Curious Curious
Custo Custo
CyotekWebCopy CyotekWebCopy
DIIbot DIIbot
DSearch
DTS Agent DTS Agent
Demon DatabaseDriverMysqli
Devil Deusu
Dirbuster Digincore
Disco DigitalPebble
Discobot Discobot
Dispatch DomCopBot
DittoSpyder
DnyzBot
DomainCrawler
Domains Project
Dotbot Dotbot
Dragonfly Download Wonder
EMail Wolf Drip
Extractor EMail Siphon
Extreme Picture Finder EasyDL
EyeNetIE Ecxi
EroCrawler
Evil
Express WebPictures
Ezooms Ezooms
FDM FemtosearchBot
FHscan FlashGet
Fimap FyberSpider
Firefox/7.0 Fyrebot
Freeuploader
FrontPage
G-i-g-a-b-o-t G-i-g-a-b-o-t
GalaxyBot GT::WWW
GermCrawler GermCrawler
GetRight GetRight
GetWeb Gigabot
Go!Zilla Go!Zilla
Go-Ahead-Got-It Gotit
GoZilla
Grabber Grabber
Grafula Grafula
GrapeFX GridBot
HEADMasterSEO Haansoft
HMView
HaosouSpider HaosouSpider
Harvest HybridBot
IDBTE4M
IRLbot IRLbot
Iblog
Id-search Id-search
IlseBot IlseBot
Image Sucker Indy Library
IndeedBot InfoTekies
InterGET InterGET
JOC Web Spider JOC Web Spider
Jbrofuzz
JetCar JetCar
LWP::Simple JikeSpider
Libwhisker Joomla
LinkScan Kenjin Spider
Kinza
Kozmosbot
LeechFTP
LeechGet
LibWeb
LieBaoFast
Lightspeedsystems
LinkWalker LinkWalker
Linkdexbot Linkbot
LinkextractorPro
LinkpadBot
LinksManager LinksManager
Litemage_walker Lipperhey Spider
Ltx71 MFC_Tear_Sample
MJ12bot MIIxpc
MQQBrowser MQQBrowser
MTRobot MSIECrawler
Magnet Magnet
Mail.RU_Bot Mail.RU_Bot
Majestic SEO
Majestic-SEO
Majestic12
MarkMonitor
MarkWatch
Mass Downloader
Masscan Masscan
MauiBot MauiBot
Mb2345Browser Mb2345Browser
MeanPath Bot Mediatoolkitbot
Microsoft URL Control Metauri
Mister PiX Microsoft Data Access
Mr.4x3 Mojeek
Musobot Mojolicious
Mozlila
NPbot NPbot
Nameprotect
Navroad Navroad
NearSite
Needle Needle
Net Vampire Net Vampire
NetAnts NetAnts
NetZIP NetSpider
Netcraft
Nettrack
Netvibes
NextGenSearchBot
Nibbler
Nikto
NimbleCrawler NimbleCrawler
Nuclei Offline Navigator
Nutch OpenVAS
Openfind
Openvas Openvas
OrangeBot
OrangeSpider OrangeSpider
Page Analyzer OutclicksBot
PageGrabber PECL::HTTP
PHPCrawl
POE-Component-Client-HTTP
PageAnalyzer
PageScorer PageScorer
PageThing.com
Pandalytics Pandalytics
Panscient Papa Foto
Picscout Pavuk
Picsearch PeoplePal
Petalbot
PictureFinder
Pixray Pixray
Pockey
ProWebWalker ProWebWalker
Pump Probethenet
Psbot
QueryN Metasearch
Quick-Crawler Quick-Crawler
RankActive RankActive
RankingBot2 RankFlex
RankingBot
RankurBot
Re-re Re-re
Reaper Recorder
RedesScrapy RedesScrapy
RepoMonkey
RocketCrawler RocketCrawler
Rogerbot
SEOkicks SEOkicks
SEOlyticsCrawler
SEOprofiler
SMTBot
SalesIntelligent
Scanbot Scanbot
Scrapy
ScreenerBot ScreenerBot
SearchmetricsBot ScrepyBot
SemrushBot Searchestate
SentiBot
SeoSiteCheckup
SeobilityBot
Seomoz Seomoz
Siphon Site Sucker
SiteLockSpider SiteExplorer
Sitebeam
Siteimprove Siteimprove
Snapbot SmartDownload
Snoopy
Sociscraper Sociscraper
Sogou web spider Sosospider
Sottopop Sottopop
Spammen Sqlmap
Spanner
SputnikBot
Sqworm
Stripper
Sucker Sucker
SuperBot Sucuri
SuperHTTP
Surfbot Surfbot
SurveyBot SurveyBot
Suzuran Suzuran
Szukacz Swiftbot
T0PHackTeam T0PHackTeam
T8Abot
Teleport Teleport
Telesphorep Telesoft
The Intraformant Toata
Toweyabot Trendictionbot
Tracemyfile
Turingos Turingos
Turnitin
TurnitinBot TurnitinBot
UnisterBot URLy Warning
Upflow URLy.Warning
Vagabondo V-BOT
VelenPublicWebCrawler VCI
VeriCiteCrawler VeriCiteCrawler
VidibleScraper Voil
Virusdie WISENutbot
VoidEYE
WEBDAV
WPScan WPScan
WWW-Collector-E
WWW-Mechanize WWW-Mechanize
Wallpapers Wallpapers/3.0
WallpapersHD
WeSEE WeSEE
Web Auto Web Collage
Web Pix
Web Sucker
WebAuto WebAuto
WebBandit WebEnhancer
WebCopier WebFetch
WebLeacher WebGo IS
WebPix
WebReaper WebReaper
WebSauger WebWhacker
WebStripper
WebSucker
Webalta Webalta
WebsiteExtractor WebsiteExtractor
Webster WebsiteQuester
Whack WinHTTrack
WiseGuys Robot WiseGuys Robot
Wprecon Woobot
Xaldon_WebSpider Xaldon WebSpider
Zauba YoudaoBot
Zermelo Zitebot
ZmEu ZoomBot
ZoominfoBot ZoominfoBot
ZumBot
ZyBorg
arquivo-web-crawler
autoemailspider autoemailspider
backlink-check
cah.io.community cah.io.community
check1.exe com.plumanalytics
clark-crawler crawl.sogou.com
crawler.feedback
crawler4j
dataforseo.com
demandbase-bot demandbase-bot
lwp-request eCatch
lwp-trivial evc-batch
magpie-crawler heritrix
instabid
ips-agent
meanpathbot
muhstik-scan
pcBrowser pcBrowser
polaris version
s1z.ru s1z.ru
satoristudio.net satoristudio.net
scalaj-http
scan.lol scan.lol
seobility
serpstatbot
siteripz siteripz
sp_auditbot sp_auditbot
sysscan
trendiction.com trendiction.com
trendiction.de trendiction.de
ubermetrics-technologies.com voyagerx.com
webpros.com
x09Mozilla
xpymep1.exe xpymep1.exe
zauba.io zauba.io

296
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
01h4x.com 404enemy
360Spider
80legs
ALittle Client ALittle Client
Abonti
Aboundex Aboundex
Aboundexbot AhrefsBot
AiHitBot AiHitBot
AllSubmitter Aipbot
Alligator AlphaBot
Anarchie
Anarchy Anarchy
Anthill
Aspiegel Aspiegel
Attach Attach
AwarioRssBot
BBBike BBBike
BackStreet BDFetch
BackWeb BLEXBot
Backlink-Ceck
BacklinkCrawler
Badass
Bandit Bandit
Barkrowler BlackWidow
BatchFTP BlowFish
Battleztar Bazinga
Bigfoot
Black Hole
Boardreader
BotALot
Brandprotect Brandprotect
BuiltBotTough Buck
Buddy
BuiltWith
Bullseye
BunnySlippers BunnySlippers
CATExplorador
CODE87 CODE87
CazoodleBot CSHttp
Cegbfeieh Calculon
CensysInspect CensysInspect
CherryPicker
Chlooe Chlooe
Claritybot Cocolyzebot
Cloud mapping Cogentbot
Collector Collector
Copier Copier
CrazyWebCrawler CopyRightCheck
Cosmos
Crawling at Home Project
Crescent
CrunchBot CrunchBot
Custo DIIbot
DBLBot DSearch
DTS Agent DTS Agent
DatabaseDriverMysqli
Demon Demon
Digincore DigitalPebble
Dirbuster Dirbuster
Disco
Discobot Discobot
Discoverybot Dispatch
DomainAppender DnyzBot
Download Wonder DomainCrawler
Drip DomainStatsBot
EMail Siphon Dotbot
EMail Wolf ECCP/1.0
EasyDL EasyDL
Ebingbong Ecxi
Evil
Exabot Exabot
Extractor
Extreme Picture Finder
EyeNetIE EyeNetIE
Fimap Ezooms
Firefox/7.0 FDM
FlashGet FlashGet
Freeuploader Foobot
Fyrebot FrontPage
GermCrawler FyberSpider
GetRight G-i-g-a-b-o-t
GetWeb
Go!Zilla Go!Zilla
Grabber GoZilla
HTTP::Lite Grafula
HTTrack GrapeFX
HEADMasterSEO
HTMLparser
Haansoft Haansoft
Harvest Havij
Heritrix
Hloader Hloader
HybridBot
IDBTE4M IDBTE4M
Iblog IRLbot
Id-search
IlseBot IlseBot
Image Fetch Image Fetch
Image Sucker Image Sucker
IndeedBot IndeedBot
InfoTekies InfoNaviRobot
Internet Ninja
InternetSeer
JOC Web Spider JOC Web Spider
Jbrofuzz
JennyBot JennyBot
JetCar JustView
Joomla
Kenjin Spider
Keyword Density
Kinza Kinza
LNSpiderguy Kozmosbot
LeechGet Lanshanbot
Lftp LexiBot
LibWeb
Libwhisker
Likse
LinkScan LinkScan
Linkbot
LinkpadBot LinkpadBot
LinqiaMetadataDownloaderBot LinqiaRSSBot
Lipperhey Lipperhey Spider
Litemage_walker Litemage_walker
Lmspider MSFrontPage
MIIxpc
MQQBrowser
MTRobot
Mag-Net
Magnet Magnet
Mail.RU_Bot Majestic SEO
Majestic12 Majestic12
MarkMonitor MarkWatch
Mb2345Browser MeanPath Bot
Morfeus Fucking Scanner Microsoft URL Control
Mister PiX
Mr.4x3 Mr.4x3
Musobot
NICErsPRO NICErsPRO
NPbot Name Intelligence
Navroad
NearSite
Needle
Nessus
Net Vampire Net Vampire
NetAnts NetAnts
NetZIP NetZIP
Netcraft Nettrack
Netvibes
NextGenSearchBot
Nibbler Nibbler
Niki-bot
NimbleCrawler NimbleCrawler
Nimbostratus
Ninja Ninja
Nmap Nmap
Nuclei
Octopus Octopus
Offline Navigator
OnCrawl
OpenLinkProfiler OpenLinkProfiler
Openfind OrangeBot
Openvas
OrangeSpider OrangeSpider
OutclicksBot PECL::HTTP
PHPCrawl POE-Component-Client-HTTP
PageThing.com Page Analyzer
Pandalytics PageAnalyzer
Pavuk PageGrabber
Petalbot Papa Foto
Pi-Monster Picscout
Picsearch Picsearch
ProWebWalker
Probethenet Probethenet
PxBroker PxBroker
QueryN Metasearch Quick-Crawler
RankingBot RSSingBot
RankActiveLinkBot
RankingBot2 RankingBot2
RankurBot RealDownload
Re-re
Reaper Reaper
Recorder RebelMouse
Ripper RedesScrapy
Rogerbot Rogerbot
SBIder
SEOkicks-Robot SEOkicks-Robot
SMTBot SEOlyticsCrawler
SEOprofiler
SISTRIX
SalesIntelligent SalesIntelligent
ScanAlert Scanbot
ScoutJet ScoutJet
Scrapy Scrapy
ScrepyBot Screaming
Searchestate Searchestate
SearchmetricsBot SearchmetricsBot
Semrush SemrushBot
SentiBot
SeoSiteCheckup SeoSiteCheckup
Seomoz SeobilityBot
Shodan Shodan
Siphon Siphon
Site Sucker Sitebeam
SlySearch Snapbot
SmartDownload Sociscraper
SocialRankIOBot SpaceBison
Spinn3r
SputnikBot SputnikBot
Sqlmap Sqlmap
Sqworm Steeler
Stripper Stripper
SurveyBot Sucuri
SuperBot
Swiftbot Swiftbot
Szukacz Szukacz
T0PHackTeam T0PHackTeam
Teleport Teleport
Telesphoreo Telesphoreo
Telesphorep
The Intraformant The Intraformant
TheNomad Thumbor
Toata
Tracemyfile Tracemyfile
True_Robot Trendiction
Turnitin Turingos
URLy Warning TwengaBot
V-BOT
VCI
VelenPublicWebCrawler VelenPublicWebCrawler
VeriCiteCrawler VeriCiteCrawler
VidibleScraper Voil
Virusdie WASALive-Bot
Voltron WPScan
WBSearchBot WWW-Collector-E
WISENutbot
WWW-Mechanize
WWWOFFLE
Wallpapers/3.0
WallpapersHD WallpapersHD
Web Collage
Web Enhancer
Web Fuck Web Fuck
Web Pix Web Sauger
Web Sucker Web Sucker
WebAuto
WebBandit
WebCollage WebCollage
WebEnhancer WebFuck
WebGo IS
WebImageCollector WebImageCollector
WebLeacher WebReaper
WebSauger
WebWhacker
Webalta
WebmasterWorldForumBot WebmasterWorldForumBot
Website Quester WebsiteQuester
Whacker Whack
Widow Who.is Bot
WinHTTrack WinHTTrack
WiseGuys Robot WiseGuys Robot
Wonderbot
Woobot
Wotbox
Xenu Xenu
YoudaoBot YoudaoBot
Zauba Zauba
Zermelo ZmEu
Zeus arquivo-web-crawler
Zitebot arquivo.pt
ZumBot
autoemailspider
backlink-check
check1.exe check1.exe
clark-crawler
cognitiveseo cognitiveseo
eCatch crawler.feedback
demandbase-bot
facebookscraper
gopher gopher
instabid instabid
isitwp.com internetVista monitor
lwp-request
magpie-crawler magpie-crawler
meanpathbot
muhstik-scan muhstik-scan
netEstate NE Crawler plumanalytics
page scorer
pcBrowser
probe-image-size probe-image-size
seoscanners scalaj-http
seostar
serpstatbot
sexsearcher sexsearcher
sitechecker.pro sitechecker.pro
sogouspider
spyfu spyfu
tAkeOut
trendiction.de trendiction.de
webmeup-crawler voyagerx.com
x09Mozilla xpymep1.exe
x22Mozilla
zauba.io zauba.io

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
apccargo.com cartierbraceletsreplica.pw
bookmark4you.com.biz cibpenonptib.flu.cc
compliance-willy.top comissionka.net
ed-shop01.ru kinobaks.com
kaac.ru linerdrilling.com
pl.aasoldes.fr o.light.d0t.ru
quickchange.cc oddamzadarmo.eu
xn----8sblgmbj1a1bk8l.xn----161-4vemb6cjl7anbaea3afninj.xn--p1ai privacyassistant.net
zetmaster.ru telefonsexkostenlos.tk
zionstar.net vrotike.ru

936
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
101billion.com 10bet.com
123cha.com 1pamm.ru
178evakuator178.ru 2drittel.de
1kdailyprofit.me 3w24.com
1qingdao.com 4replicawatch.net
20pascals.nl 7xc4n.com
21h2o.com 83net.jp
2345.com abbanreddy.com
3rbseyes.com abcguru.xyz
4kpics.rocks abctoppictures.net
4pp13.com abiente.ru
4webmasters.com acmebtn.ml
5i2.net adexprts.com
883zy.com adman.se
8xv8.com adobereader-free.ru
9icmzvn6.website adservme.com
a.pr-cy.ru adsloads.com
aaa38852e886ac4af1a3cff9b47cab6272.com adzpower.com
abtasty.com
acc.eu.org
accessoires-mode.in
adconscious.com
adsland.men
adssafeprotected.com
adtech.us
advancedmassagebysara.com
ageofclones.com
agysya.ru
aihelen.net aihelen.net
aimayangzhi.com air-edem.ru
albuteroli.com aktivator-windows10.blogspot.com
all4wap.ru alkoravto.ru
allblogroll.com allfinweb.com
aloofly.com
alta-realestate.com
angigreene.com angigreene.com
animal36.com apccargo.com
anime.dougasouko.com app5.letmacworkfaster.world
apiholdingmypage-a.akamaihd.net arate.ru
apioutoboxnet-a.akamaihd.net arclk.net
appfixing.space ardimobileinfo.ml
aruplighting.com arendas.net
ausergrubhof.info asacopaco.tk
auto.rusvile.lt atout-energie-69.com
audiofree.ru
aussie-prizes.com
autogrep.ru autogrep.ru
avitocars.ru autolombard-krasnodar.ru
avramstroy.ru autotrends.today
ayakino.net aviav.ru.com
ayerbo.xhost.ro avtoarenda.by
babyguns.ru avtolombard-krasnodar.ru
badavit.com.ua axbocz.net
bala.getenjoyment.net azartmsl.com
balkanfarma.org azazaporn.com
bankcrediti.ru b00kmarks.com
bankmib.ru bagsonsale.online
basedecor.ru balans.shahterworld.org
beauty-clinic.ru balitouroffice.com
becuo.com bannertesting.com
bestadbid.com baoxaydung.com.vn
bestfortraders.com battleforupdating.site
bestmarriages.com beauby.ru
bestmouthwash.club begalka.xyz
betterscooter.com berrymall.ru
bif-ru.info best-deals-products.com
best-games.today
bestkfiledxd.cf
bestofferswalkmydogouteveryday.gq
bestwebsitesawards.com
bezlimitko.xyz
bfz.biz
bigames.online bigames.online
bin-brokers.com biglistofwebsites.com
binaryoptionscops.info bio.trade-jp.net
bitporno.sx bizru.info
bizcheapjerseyswholesalechina.com bkgr.se
bjgugu.net.ua blog.remote-computer.de
blogos.kz bloggers.nl
bmsco.co blogs.rediff.com
bonzibuddi.com bloke.com
bristolhostel.com bonvillan.com
builtwith.com bus-offer.com
buketeg.xyz bvlgariring.xyz
bytimedance.ru cactussoft.biz
bzero1jewelry.net californianews.cf
c-english.ru camdolls.com
callawaygolfoutlet.online candelluxsklep.pl
cam-kontakte.org carloans.com
camsex.xxx-cam.webcam carsdined.org
cand.jp cartierreplica.win
capture-room.com catalogs-parts.com
cartierlovebraceletreplica.xyz ceotrk.com
cashkitten-a.akamaihd.net cerev.info
casinos4dummies.co.uk chatroulette.si
cejewelry.xyz chatseo.com
centrumcoachingu.com cheapsergiorossi.online
cete.ru cheatcode-lita12.rhcloud.com
chatroulette.online checkpagerank.net
chatroulette.world chimiver.info
cheapjerseysbizwholesale.us chocolateslim-en-espana.com
check-host.net ciekawinki.pl
checkm8.com cindymatches.com
chiblackhawks-jerseys.com cineacademy.ru
chinacheapelitejerseys.com cinemaflix.website
cialisovercounteratwalmartusa.com clipartnew.com
cleanallvirus.com club-samodelkin.ru
coinsspb.com clubfashionista.com
compliance-ivan.xyz coin-hive.com
compliance-jane.top colobit.biz
compliance-julianna.top compliance-viktor.top
constantaservice.net coolyarddecorations.com
cornomase.win copblock.org
coslab.club
cowlmash.com
cpajunkies.com cpajunkies.com
cwetochki.ru cracksplanet.com
czat.wp.pl cscwtalkto.site
dbmkfhqk.bloger.index.hr danschawbel.com
dealitright.click darkages.info
decoratinghomes.ga data1.scopich.com
demon-tweeks.com datract.com
design-lands.ru davidovic.info
deutschland123.de ddospanel.com
diamond-necklace.info ddsoldes.fr
dildofotzen.net delitime.info
djstools.com dignitasdata.se
dktr.ru doctissimo.fr
dokfilms.net dollartree.info
domaincdn.xyz domaincdn.xyz
domaineaneblanc.com domination.ml
dosug-lux.ru donna7753191.ru
dosugrostov.site doxyporno.com
draniki.org droidlook.net
ekspertmed.com dvervmoskvu.ru
eleimgo.pw e-c.al
elektrozigarette2.webs.com e-collantes.com
elkacentr.ru ebonyporn.site
emailaccountlogin.co ecommerce-seo.com
en.altezza.travel edge.sharethis.com
en.home-task.com educontest.net
epicbrogaming.com ekosmetyki.net.pl
eropornosex.ru electricwheelchairsarea.com
erot.co elektrischeziga.livejournal.com
esnm.ru elektroniksigaraankara.info
esopini.com elektronischezigarettekaufen1.beeplog.com
eu-cookie-law.blogspot.com emerson-rus.ru
expresstoplivo.ru eng-lyrics.com
ezb.elvenmachine.com erotische-geschichten-xxl.com
familyphysician.ru errorfixing.space
fastcrawl.com etotupo.ru
fatmaelgarny.com eurosamodelki.ru
fenoyl.batcave.net event-tracking.com
fickenprivat.info everflora.ru
filmci.pro exoclick.com
filmetricsasia.com expolicenciaslatam.co
filmi-v.online extads.net
finemanteam.com extener.org
finstroy.net extlabs.io
finuse.com extstat.com
firma-legion.ru ezaz.info
flytourisme.org fanoboi.com
formularz-konkurs.tk fearcrow.com
foto-basa.com filesclub.net
foxjuegos.com filmania-x.ru
freakycheats.com finejewelryshop.ru
free-share-buttons.blogspot.com floridamobilebillboards.com
freeuploader.com formseo.com
freewlan.info forpackningsutveckling.se
frvo.alptandem.ru forums.d2jsp.org
franch.info
free-floating-buttons.com
freetangodownload.com
fsakhalin.ru
fuckmill.com
fusoradio.info
fxund.us
fyl.com.ru fyl.com.ru
gamebackyard.com fyxabomiw.ru
gamedayassist.com fz139.ttk.ru
gate5.co.za gabeshop.ru
geile-lelly.eu gamerextra.com
geilehausfrauen.net gamingspark.com
gerhardhealer.com gdzkurokam.ru
gigapeta.com gelezki.com
gk-atlant.info gemara.com
glasof.es genericviagrasildenafiled.net
gloverid.site gentamicineyedrops.blogspot.com
gonextmedia.com gfaq.ru
goodwriterssales.com glastecfilms.com.my
gosmeb.ru goldpanningtools.com
graphicwe.org graphicwe.org
gratuitbaise.com gratis-sexkontakte.com
gratuitxblcodes.com greamimgo.pw
greatfind-a.akamaihd.net growmyfunds.ca
greatidea.marketing grupografico-pilar.com.ar
gribkovye-zabolevaniya.com
gsasearchenginerankerhelp.com gsasearchenginerankerhelp.com
gsmlab.pl handicapbathtubarea.com
guidefs.ru hausfrauensex18.com
guod.me hdpixent.com
guruofcasino.com healbio.ru
hacktougroup.ru healgastro.com
hannasolution.ru heartofbeijing.blogspot.com
hebr.myddns-flir.com home.myplaycity.com
heygidday.biz homemade.gq
hol.es homik.pw
hotchatdate.com hotchatdate.com
howopen.ru houdom.net
https-legalrc.biz house.sieraddns.com
hvd-store.com hoverboardforsaledirect.com
ibb.com.ua hspline.com
ico.re hunthillfarmtrust.org
idealtits.net hyhj.info
ideoworld.org i-service.kz
iloveitaly.ru ihc2015.info
ilovevitaly.ru ilo134uloh.com
imgarit.pw ilte.info
imk.com.ua impisr.ru
in-tandem.co importchinacoach-teach.com
inboundlinks.win impotentik.com
increasewwwtraffic.info interesnie-faktu.ru
inet-traffic.com irkutsk.zrus.org
int.search.mywebsearch.com isitwp.com
intellekt21.ru istripper.com
intellektmedia.at itag.pw
interfucks.net ivanovo.zrus.org
investyb.com jerseychinabizwholesale.us
invivo.hu jerseywholesalebizchina.com
iplusbit.blogspot.co.za jmat.cn
isotoner.com job.icivil.ir
istizanidineanarcoticdrug.blogspot.com jrcigars.com
iwantedmoney.com junglenet-a.akamaihd.net
kaidalibor.de
kakablog.net
kamalsinha.com kamalsinha.com
kamen-e.ru kamorel.com
ketrzyn.pl karpun-iris.ru
keywordglobal.co.za kartiniresto.com
kihi.gdn kazinogames.lv
kazka.ru
keenoutlet.online
keywordsking.com
kimcurlrvsms.com kimcurlrvsms.com
kino-rf.ru kinocccp.net
kinobest.pl kinohit1.ru
kinogonew.ru kirov.zrus.org
kinomaniatv.pl kleine-titten.biz
kreativperlen.ch klitimg.pw
konica.kz
konoplisemena.com
kostenloser-sex.com
kriokomora.info kriokomora.info
lafriore.ru kunstaktien.info
landscaping.center kvartiry-remont.ucoz.ru
laptoper.net la-fa.ru
laexotic.com
lanasshop.ru
laparfumotec.com
larutti.ru
lashstudia.ru
lawyersinfo.org
laxob.com
lazy-z.com lazy-z.com
lazymanyoga.com lietaer.com
lechenie-gemorroya.com life.biz.ua
lego4x4.ru lion.bolegapakistan.com
lerporn.info lion.misba.us
letmacworkfaster.world listiseltemournlan.gq
lexaprogeneric.link
linkrr.com
liumimgx.pw
lkbennettstore.online
localmatchbook.com localmatchbook.com
lollypopgaming.com losangeles-ads.com
lombia.co love-baby.cz
louboutinshoes.xyz
lovi-moment.com.ua
lulea-auktionsverk.se lulea-auktionsverk.se
m-google.xyz m1media.net
madot.onlinewebshop.net mabdoola.blogspot.com
mafa-free.com magazintiande.ru
mafcards.ru
magazin-pics.ru
magento-crew.net
malls.com malls.com
manyresultshub-a.akamaihd.net maranbrinfo.com.br
map028.com marblestyle.ru
mararoom.ru med-zdorovie.com.ua
marcowebonyodziezowe.pl mediafresh.online
marketingvici.com mediawhirl.net
masserect.com medtherapy.ru
matpre.top megagrabber.ru
mb140.ru mere.host.sk
meble-bogart.info methodsmarketing.com
medanestesia.ru microstatic.pl
medicovi.com middlerush-a.akamaihd.net
meduza-consult.ru
meendo-free-traffic.ga
metarip.ru
mexicosleevegastrectomy.com
mexicotravelnet.com
minet.club minet.club
mlvc4zzw.space mistr-x.org
mobioffertrck.com moncleroutletonline.win
modenamebel.ru monclervests.xyz
moinozhki.com monsterdivx.com
mompussy.net mossmesi.com
moncleroutletonline.xyz mototsikl.org
money-every-day.com
montazhnic.ru
more-letom.ru
moscow.xrus.org
mowser.com mowser.com
mrsdalloways.com mrbojikobi4.biz
mturkcontent.com my-bc.ru
my-big-family.com myanyone.net
mybackgroundlandscape.blogspot.com mydownloadengine.com
mydearest.co mypets.by
myfreecams.com naperehresti.info
myghillie.info narkologiya-orel.ru
nakozhe.com naturalbreakthroughsresearch.com
napalm51.nut.cc nbsproject.ru
narkologiya-peterburg.ru nero-us.com
netallergy.ru
netpics.org netpics.org
nextbackgroundcheck.gq newsperuse.com
nfljerseys.online nikitabuch.com
nfvsz.com ningessaybe.me
nikhilbahl.com nippon-bearings.ru
njkmznnb.ru nodding-passion.tk
njpalletremoval.com nootrino.com
nlfjjunb5.ru nvformula.ru
notaria-desalas.com obiavo.by
novosibirsk.xrus.org obiavo.com
novosti-hi-tech.ru oconto.ru
obiavo.in oil-td.ru
office-windows.ru oklogistic.ru
offside2.5v.pl old-rock.com
ohmyrings.com onemantrip.com
onlythegames.com online-hd.pl
onstrapon.purplesphere.in online7777.com
ooomeru.ru onlineporno.site
ops.picscout.com par-fallen.ga
optitrade24.com partnerads.men
oralsexfilme.net parvezmia.xyz
orel-reshka.net
osb.se11.ru
pacificair.com
paclitor.com
pagesense.com
pathwhelp.org pathwhelp.org
patterntrader-en.com pdn-4.com
perosan.com picmoonco.pw
photo.houseofgaga.ru picturesmania.com
phpdevops.com pillscheap24h.com
pic2fly.com pix-hd.com
picture-group.com pizdopletka.club
pintattoos.com play.leadzupc.com
pinup-casino1.ru playboyfiles.xblog.in
piuminiita.com poem-paying.gq
pizza-imperia.com poppen-nw.net
pl.aasoldes.fr popugaychiki.com
playtap.us
podshipniki-ntn.ru
poffet.net
pogodnyyeavarii.gq
polytopesexempt.com
popander.mobi
popup-hgd.xyz popup-hgd.xyz
porndl.org pornhub-ru.com
porno-chaman.info pornodojd.ru
pornolook.net pornogratisdiario.com
printie.com pornohd1080.online
proekt-mos.ru pornokorol.com
pornonik.com
pornpost.in
portal-eu.ru
porto.abuilder.net
pr-ten.de
preconnubial.usuby.site
produkto.net
promoheads.com promoheads.com
prosmibank.ru psoriasis-file.trade
prostitutki-tolyatti.org pulseonclick.com
puserving.com py100.ru
pushdata.sendpulse.com quality-traffic.com
pussysaga.com ranksonic.org
puzo2arbuza.ru raschtextil.com.ua
qcstrtvt.bloger.index.hr rcpmda.ikan1080.xyz
queerspace.com realitykings.com
randalljhoward.com regionshop.biz
rapidgator-porn.ga
rating-bestcasino.com
redirlock.com
reimageplus.com reimageplus.com
remmling.de remybutler.fr
rentaremotecomputer.com rock-cafe.info
research.ifmo.ru roofers.org.uk
resellerclub.com ru-dety.ru
retailwith.com rubanners.com
retreatia.com rybalka-opt.ru
rfserial.net s-forum.biz
rniaeba.ga samolet.fr
royalads.net sarm.tk
rp9.ru saveindex.xyz
rukino.org scanmyphones.com
russintv.fr scanner-fred.top
rvi.biz scanner-george.top
sa-rewards.co.za scanner-marwin.top
saneitconsulting.com scanspyware.net
scanner-mark.top search-goo.com
school-diplomat.ru searchencrypt.com
scopich.com semrush.com
searchaddis.com seo-platform.com
seoanalyses.com seofirmreviewsus.info
seofied.com seomarketings.online
serving.adbetclickin.pink seonetwizard.com
sexgalleries.top serialsway.ucoz.ru
sexkontakte-seite.com sex-tracker.de
sexpornotales.com sexkvartal.com
sexxdate.net sexy.babes.frontend-stack.top
sfj-ror.no simul.co
shillyourcoins.com sisi-go.ru
shisha-swag.de site-analyzer.com
shodanhq.com sixcooler.de
shohanb.com small-game.com
shoppingmiracles.co.uk snow.nvr163.com
shtora66.ru social-buttons.xyz
si-unique.com sofit-dmd.ru
sitevaluation.org songoo.wz.cz
skincrate.net sosdepotdebilan.com
skuteczna-dieta.co.pl spabali.org
slavkokacunko.de sps-shop.com
sluganarodu.ru squidoo.com
smallseotools.com srdrvp.com
social-s-hhh.xyz srgwebmail.nl
sodexo.com sticken.co
softxaker.ru strana-krasoty.ru
sotkal.lark.ru stroy-portal22.ru
spidtest.org studiokamyk.com.pl
stair.registrydomainservices.com sukarame.net
stpicks.com sunflowerdrawingpaintings.blogspot.com
streha-metalko.si superlist.biz
stuff-about-money.com supermodni.com.ua
sundrugstore.com suralink.com
superinterstitial.com sureone.pro
survival.betteroffers.review svetodiodoff.ru
taqplayer.info sygraem.com
taranerymagesswa.blogspot.com tacbelarus.ru
tattoo33.ru
tattooreligion.ru tattooreligion.ru
taxi-v-eisk.ru telefonsex-ohne0900.net
technopellet.gr telegramdownload10.com
teenbbw.yopoint.in thegioixekhach.com
teenfuck.tv tiandeural.ru
tfxiq.com tilido.com
thebluffs.com tizanidinecapsules.blogspot.com
thedownloadfromwarez.blogspot.com tizanidinecost.blogspot.com
thewebsitetemplate.info tizanidinedosage.blogspot.com
tizanidineduringpregnancy.blogspot.com tizanidinefibromyalgia.blogspot.com
tizanidineforopiatewithdrawal.blogspot.com tizanidineinteractions.blogspot.com
tizanidinehcl2mg.blogspot.com tizanidinezanaflex.blogspot.com
tizanidinehydrochloride4mgstreetvalue.blogspot.com tjkckpytpnje.com
tizanidineinfo.blogspot.com tootoo.to
tnctrx.com topmira.com
tooplay.com topsiteminecraft.com
torrent-newgames.com torrentdownloadhub.com
tourcroatia.co.uk torrentred.games
tpu.ru torrents.cd
tracklead.net torrents.life
trafficgenius.xyz torture.ml
trafficreceiver.club traffic2cash.org
trainoffend.ml trubywriting.com
tvorozhnaja-zapekanka-recept.ru tubeline.biz
twodollarshows.com tubeoffline.com
ua.tc tv-spoty.info
ucoz.ru tvnewsclips.info
twittruth.com
twu.com.ua
ukrtvir.com.ua ukrtvir.com.ua
umityangin.net umg-stroy.ru
unblocksit.es unimodemhalfduplefw.pen.io
uni.me urlopener.blogspot.com.au
uptimechecker.com usacasino.com
url-img.link valuado.com
uroki.net varikoz24.com
uzungil.com vedomstvo.net
vclicks.net vekzdorov.ru
velobikestock.com
video-chat.cn
video-hollywood.ru
villacoloniale.com villacoloniale.com
vip-file.com vodaodessa.com
vipsexfinders.com vodkoved.ru
visa-china.ru vzglyadriv.kg
vitalads.net vzlomtw.com
vod.com.ua wahicbefa31.soup.io
voltrknc1.com
vroze.com
watchinf.com
webinstantservice.com webinstantservice.com
webix.biz
webradiology.ru webradiology.ru
website-analytics.online
website-speed-check.site
weburok.com weburok.com
weddingdresses.xyz wesharepics.info
whosonmyserver.com westum.se
wildworld.site whatzmyip.net
witclub.info wholesalecheapjerseysfree.com
wildcattube.com
winner7777.net
witherrom55.eklablog.fr
withstandingheartwarming.com
wladimirpayen.com
womama.ru
woman-orgasm.ru
womens-journal.net womens-journal.net
www.ehscloud.cn worldtraveler.world
www.timer4web.com worst-sites.online
x-diesel.info writingservices17.blogspot.ru
x69ty.ru wttavern.com
xn------7cdbapdecfd4ak1bn0amjffj7afu3y.xn--p1ai www.get-free-traffic-now.com
xn-----6kccaibs5cb8afhjrfmix2n.xn--p1ai wygraj-teraz.com
xboxster.ru
xkaz.org
xmnb.net
xn-----7kceclhb4abre1b4a0ccl2fxch1a.xn--p1ai
xn----7sbbahaq9bb5afgiqfliv4m.xn--p1ai
xn----8sbdbjgb1ap7a9c4czbh.xn--p1acf
xn----9sbebi2bvzr7h.xn--p1ai xn----9sbebi2bvzr7h.xn--p1ai
xn--80aaafbn2bc2ahdfrfkln6l.xn--p1ai xn--80ab4aa2g.xn--p1ai
xn--l1aengat.xn--p1ai xn--80adaggc5bdhlfamsfdij4p7b.xn--p1ai
xn--q1a.xn--b1aube0e.xn--c1acygb.xn--p1ai xn--80aodinpgi.xn--p1ai
xsion.net xn--b1adccaf1bzj.xn--p1ai
xxlargepop.com xn--b1addnj3cah.xn--p1ai
yellowfootprints.com xn--d1acah0c.xn--p1ai
yellowstonesafaritours.com xn--h1ahbi.com.ua
yougame.biz xxxhdvideo.site
yousense.info xxxmania.top
youtubologia.it xxxtube69.com
zakonobosago.ru xz618.com
zarabotat-na-sajte.ru yadro.ru
zatjmuzu.info yellocloud.be
zawyna.ua ynymnwbm.bloger.index.hr
zeroredirect10.com your-bearings.com
zeroredirect7.com yugo-star.ru
zeroredirect9.com zaimhelp.ru
zolotoy-lis.ru zarepta.com
zone-kev717.info zed21.net
zoosexart.com zetmaster.ru
zzlgxh.com zlatnajesen.com
znakomstva-moskva77.ru
znakomstvaonlain.ru
zophim.me
zrizvtrnpale.tk

482
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
1-99seo.com 03p.info
101raccoon.ru 123cha.com
1j7740kd.website
21h2o.com
256bit.by 256bit.by
4kepics.com actionnooz.com
aa8b68101d388c446389283820863176e7.com adprotect.net
adanih.com adverster.com
adclickthru.net afora.ru
adktrailmap.com airlandsea.info
adtech.us aktobe.xkaz.org
adult3dgames.com alfa9.com
akvamaster.dp.ua alfabot.xyz
ald2014.org allfinweb.com
alice.it amateurgalls.com
ananumous.ru amazon-seo-service.com
applyneedy.xyz amt-k.ru
asrv-a.akamaihd.net angkortours.vn
autoloans.com animal-drawings.com
autoua.top animalia-life.club
avon-novosib.ru ap.senai.br
avramstroy.ru apiluckyleapnet-a.akamaihd.net
azartclub.org apple.com-webbrowsing-security.science
b-styles.xyz applicationg29.com
bag77.ru apxeo.info
baikaleminer.com arclk.net
bannerconnect.net atlant-auto.info
belstaffstore.online beetpics.pw
best-seo-offer.com begalka.xyz
betune.onlinewebshop.net belinka.com.ua
bidr.trellian.com best-way.men
bigcareer.info
biznesluxe.ru biznesluxe.ru
blog.koorg.ru bloglag.com
boltalko.xyz board.f00d.de
bookhome.info bongiornos.info
btc4u.ru bosman.pluto.ro
bukleteg.xyz brains2.biz
buy-loft.ru buyparajumpers.online
buypillsorderonline.com carabela.com.do
cacheimages.com carson.getenjoyment.net
callcafe.info cartujano-pre.de
choosecuisine.com cascadelink.org
cleanallvirus.com centre-indigo.org.ua
cleanersoft.com cheapjerseysa.com
clickintext.net check-host.net
com-onlinesupport.host chinese-amezon.com
compliance-jane.top citysecurity.nu
conciergegroup.org cntravelre.com
counciltally.com coderstate.com
covadhosting.biz costablue.xyz
covid-schutzmasken.de credit-respect.ru
cpajunkies.com crystalslot.com
d-black.bz danashop.ru
dandiyabeats.in datadepths.com
darkages.info davidovic.info
decoratinghomes.ga de.zapmeta.com
dentalpearls.com.au derevesendeco.com
digitalassetmanagement.site descargar-musica-gratis.net
dktr.ru digest-project.ru
dnepropetrovsk.mistr-x.org dinosaurus.site
doctormakarova.ru docsportal.net
domcran.net dollartree.info
download-walpaperhd.blogspot.com domain-tracker.com
dscaas.website dtnlyss.com
e-c.al duawitchrarato.tk
eralph.tk eaplay.ru
evaashop.ru elidelcream.weebly.com
ezigarettenkaufen1.pagina.gr elmifarhangi.com
fashionindeed.ml empathica.com
fdzone.org eropho.net
fetishinside.com esnm.ru
fifa-coins.online essayservicewriting.org
forms-mtm.ru eurosamodelki.ru
formularz-konkurs.tk everypony.ru
franklinfire.co exchangeit.gq
free-laptop-reward.com excitacao.com
freelifetimefuckbook.com eyessurgery.ru
gamedayassist.com fandlr.com
gaming-journal.com fba-mexico.com
gamingspark.com findpics.pw
gearcraft.us fix-website-errors.com
get-free-social-traffic.com free-fb-traffic.com
getmyads24.com gamerscorps.com
gfaq.ru genericlowlatencyasiodriverhq.aircus.com
given2.com geoads.com
global-ics.co.za getlaid-xxxhookupdirect.com
golden-catalog.pro girlsfuckdick.com
grupografico-pilar.com.ar gpirate.com
guigyverpo.cf gsbs.com.ua
herehloadibs.cf homedo.fabpage.com
hildinghr.se homegardenlova.com
honyaku.yahoofs.jp houdom.net
hotcore.info hustoon.over-blog.com
iccornacircri.cf ibmdatamanagement.co
ideawheel.com ifirestarter.ru
idegenvezeto.eu igru-xbox.net
insomniagamingfestival.com impotentik.com
invitefashion.com indiasourcemart.in
ispac.org infodocsportal.com
jetsli.de istizanidinelikexanax.blogspot.com
jumptap.com ivanovo.zrus.org
keenoutlet.online ivearchenceinflu.cf
kinogonew.ru j33x.com
kosynka-games.ru jasonpartington.com
juliaworld.net
jyrxd.com
kakablog.net
kartiniresto.com
kenaba.su
keywordsuggest.org
kinofak.net
kiskinhouse.com
kmd-pto.ru
krasnodar.zrus.org
lacasamorett.com
landmania.ru
lankarns.com
lapolis.it
leadn.pl leadn.pl
legionalpha.com leboard.ru
likesdesign.com lincolntheatre.com
mackeeper-land-672695126.us-east-1.elb.amazonaws.com linkredirect.biz
makis.nu lonerangergames.com
manipulyator-peterburg.ru lsp-awak-perikanan.com
mararoom.ru luxmagazine.cf
marketingvici.com macdamaged.tech
marwer.info manimpotence.com
marcowebonyodziezowe.pl
massage-info.nl massage-info.nl
matrixalchemy.com mathgym.com.au
medicines-choice.com meddesk.ru
megaindex.ru megaapteka.ru
mensandals.xyz
mesto-x.com mesto-x.com
mlf.hordo.win mexicotravelnet.com
mmoguider.ru millionare.com
modabutik.ru mindeyegames.com
moivestiy.biz minneapoliscopiers.com
moscow-clining.ru mobile.ok.ru
moscow.online-podarki.com mojaocena.com
moyaterapiya.ru moje-recenze.cz
mp3s.club mojpregled.com
musicstock.me monarhs.info
muz-tracker.net monetizationking.net
myfreecams.com moskva.nodup.ru
naturalbreakthroughsresearch.com movies-in-theaters.net
netoil.no mtmtv.info
new7ob.com music.utrolive.ru
niroo.info mykings.pw
nisuturnetdgu.tk mylesosibirsk.ru
nofreezingmac.click narkologiya-peterburg.ru
nuker.com neobux-bg.info
nzfilecloud.weebly.com nikhilbahl.com
oakleyglassesonline.us nikitsyringedrivelg.pen.io
offside2.5v.pl ntic.fr
okayimage.com nudo.ca
oneclickfiles.com nufaq.com
onlinemeetingnow.com nyfinance.ml
onlythegames.com ofanda.com
online-x.ru
ons-add.men
ooomeru.ru ooomeru.ru
orgasmus-virtual.com pastaleads.com
ostrovtaxi.ru pechikamini.ru
partner-high.men penisvergrotendepillennl.ovh
pcgroup.com.uy percin.biz.ly
pensplan.com picturesboss.com
petedrummond.com picturesfrom.com
phrcialiled.com
picquery.com
picture-group.com
pictures-and-images.com
pila.pl
piter.xrus.org piter.xrus.org
pl-vouchers.com pivka.xyz
platesauto.com pl.aasoldes.fr
platezhka.net plastgranar.nu
ploenjitmedia.azurewebsites.net playlott.com
pod-muzyku.club plusnetwork.com
pogodnyyeavarii.gq pornmania.pl
pokemongooo.ml porno-video-chati.ru
prom23.ru pornolook.net
promover.org portnoff.od.ua
queerspace.com portside.xyz
quickcashlimited.com pozvonim.com
razyboard.com pp-budpostach.com.ua
relax.ru prizefestival.mobi
rfd-split.hr prod2016.com
rossmark.ru productarium.com
scottbywater.com profitfx.online
sdsjweb.com progonrumarket.ru
se.bnt-team.com projectforte.ru
semxiu.com qor360.com
seoheap.com rabot.host.sk
seomarketings.online rank-checker.online
serialsway.ucoz.ru rankia.com
servisural.ru ranksonic.com
sexy-pings.com rapidokbrain.com
shoesonlinebuy.xyz referencemoi.com
sildenafil-tadalafil.info remontvsamare.su
silvermature.net ritlweb.com
site.ru rozalli.com
slowmac.tech s8-nowy-wygraj.comli.com
smart-balancewheel.com saneitconsulting.com
sovetogorod.ru sbtdesign.co.uk
staynplay.net sbwealthsolutions.ca
stoki.ru scanner-john.top
streha-metalko.si searchengineranker.email
suggest-keywords.com seocdvig.ru
sundrugstore.com servingnotice.com
tackletarts.co sexiporno.net
taxi-v-eisk.ru sextracker.be
tecnoteakviareggio.it shitting.pro
telefonsexsofort.tk shtora66.ru
thefarmergame.com signx.info
thegalerie.eu slomm.ru
thepantonpractice.co.uk soblaznu.net
thepornsex.org social-s-ggg.xyz
thiegs.reco.ws sotechco.co
tizanidineformigraines.blogspot.com sovinsteel.ru
tizanidineonline.blogspot.com stackthatbucks.com
tizanidinepills.blogspot.com start.myplaycity.com
tizanidinesideeffectsweightloss.blogspot.com superstats.com
tooplay.com svetodiodoff.ru
traffic2money.com technika-remont.ru
trahic.ru thetattoohut.com
triplepanda.xyz tizanidinehydrochloride4mgstreetvalue.blogspot.com
tubeoffline.com tizanidinepain.blogspot.com
tula.mdverey.ru tracfone.com
uamtrk.com twinderbella.com
uhodzalijami.ru tyumen.xrus.org
uptime-alpha.net uchetunet.su
urccvfmc.bloger.index.hr utrolive.ru
usdx.us vbabule.net
ustion.ru via-energy-acquistare.com
v-doc.co vitalads.net
venerologiya.com voluumtrk.com
vereo.eu vrotike.ru
vinsit.ru vtcdns.com
vinylvault.co.uk wareseeker.com
vip-dom.in
visa-pasport.ru
vkontaktemusic.ru
voronezh.xrus.org
vpnmouse.com
wanker.us
weekes.biz.tc weekes.biz.tc
wholesalejerseychinaoutlet.com wholesalejerseychinaoutlet.com
wildcattube.com whosonmyserver.com
wildnatureimages.com wladimirpayen.com
witclub.info wovis.site
worldhistory.biz www.arenda-yeisk.ru
wygraj-teraz.com xn----9sbebi2bvzr7h.xn--p1ai
x-lime.net xn--d1acah0c.xn--p1ai
xcc24.pl xportvusbdriver8i.snack.ws
xgftnlrt.bloger.index.hr yellowstonevisitortours.com
xn--b1agm2d.net yoluxuryevents.com
yadro.ru yoopsie.com
yellowproxy.net you-shall-not-pass.is74.ru
yoshkarola.zrus.org zionstar.net
zajm-zalog-krasnodar.ru zscaler.net
zazagames.org
zed21.net
zeroredirect10.com
zigarettenonl.canalblog.com
zlatnajesen.com
zog.link
zx6.ru
zzbroya.com.ua

10
dev-tools/test_units/ratelimittest-beta.txt
View file

@ -581,4 +581,14 @@
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html> </html>

105
dev-tools/test_units/ratelimittest-master.txt
View file

@ -1,3 +1,52 @@
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<!DOCTYPE html> <!DOCTYPE html>
<html> <html>
<head> <head>
@ -435,62 +484,6 @@
<hr><center>nginx/1.18.0 (Ubuntu)</center> <hr><center>nginx/1.18.0 (Ubuntu)</center>
</body> </body>
</html> </html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<!DOCTYPE html> <!DOCTYPE html>
<html> <html>
<head> <head>

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.58 0; 10.1.1.88 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2021.10.2638 ### Version: V4.2021.10.2639
### Updated: Fri Oct 8 10:03:29 UTC 2021 ### Updated: Fri Oct 8 22:02:52 UTC 2021
### Bad Bot Count: 623 ### Bad Bot Count: 623
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2021.10.2638 ### Version: V4.2021.10.2639
### Updated: Fri Oct 8 10:03:29 UTC 2021 ### Updated: Fri Oct 8 22:02:52 UTC 2021
### Bad Bot Count: 623 ### Bad Bot Count: 623
################################################### ###################################################
### Version Information ## ### Version Information ##