vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-05 20:20:02 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2022.12.3521 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2022-12-16 22:07:12 +00:00
parent 6da9eb1e4b
commit ee70481771
47 changed files with 87238 additions and 87245 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.12.3520 #### Version: V4.2022.12.3521
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.12.3520 #### Version: V4.2022.12.3521
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -14,7 +14,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2022.12.3520 #### Version: V4.2022.12.3521
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

10760
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2022.12.3520 #### Version: V4.2022.12.3521
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

10764
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

10764
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

10764
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

10764
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.177 1; 10.1.0.153 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.177 0; 10.1.0.153 0;
127.0.0.1 0; 127.0.0.1 0;

10764
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.177 1; 10.1.0.153 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.177 0; 10.1.0.153 0;
127.0.0.1 0; 127.0.0.1 0;

10764
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.177 1; 10.1.0.153 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.177 0; 10.1.0.153 0;
127.0.0.1 0; 127.0.0.1 0;

10764
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
3520 3521

10764
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

10764
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.245.171.72 0; 40.122.125.119 0;

10764
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.177 1; 10.1.0.153 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.177 0; 10.1.0.153 0;
127.0.0.1 0; 127.0.0.1 0;

10764
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.177 1; 10.1.0.153 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.177 0; 10.1.0.153 0;
127.0.0.1 0; 127.0.0.1 0;

10764
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.177 1; 10.1.0.153 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.177 0; 10.1.0.153 0;
127.0.0.1 0; 127.0.0.1 0;

10764
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.245.171.72 0; 40.122.125.119 0;

10764
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.245.171.72 0; 40.122.125.119 0;

10764
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.177 1; 10.1.0.153 1;
127.0.0.1 1; 127.0.0.1 1;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
CrunchBot GT::WWW
GoZilla Mata Hari
HEADMasterSEO NextGenSearchBot
InfoTekies Nimbostratus
Pixray Rankivabot
Scanbot SISTRIX
Spammen ScreenerBot
WebEnhancer SiteLockSpider
polaris version Upflow
seoscanners internetVista monitor

302
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
ADmantX Aboundex
ASPSeek Aipbot
Acunetix
AiHitBot
Alexibot
Alligator
AlphaBot AlphaBot
Apexoo Anarchie
Atomseobot Anarchy
Anarchy99
Aspiegel
AwarioRssBot AwarioRssBot
AwarioSmartBot BackDoorBot
BDCbot BackWeb
BLEXBot Barkrowler
Backlink-Ceck BetaBot
BacklinkCrawler Bitacle
Badass Black Hole
Bandit
BatchFTP
Battleztar Bazinga
Bigfoot
BlackWidow BlackWidow
Blackboard
Blow Blow
Bolt BlowFish
Brandprotect Brandprotect
Buddy BuiltBotTough
Bullseye
BunnySlippers
BuzzSumo BuzzSumo
CCBot CCBot
CODE87
CensysInspect CensysInspect
Citoid CheTeam
Chlooe
Claritybot Claritybot
Cliqzbot Cocolyzebot
Copier
CopyRightCheck CopyRightCheck
Copyscape Craftbot
Cosmos CrazyWebCrawler
Crawling at Home Project Crescent
DIIbot CrunchBot
DTS Agent Curious
DBLBot
DataCha0s
Demon
Deusu
Devil Devil
Digincore Digincore
DigitalPebble DomainAppender
Dirbuster DomainCrawler
Disco DomainSigmaCrawler
Discoverybot Domains Project
DomCopBot
Dotbot Dotbot
Dragonfly
Drip Drip
ECCP/1.0 EMail Siphon
Ebingbong EasyDL
EirGrabber
EroCrawler EroCrawler
ExtLinksBot
Extractor Extractor
ExtractorPro ExtractorPro
Extreme Picture Finder Ezooms
FDM
FHscan FHscan
FemtosearchBot FemtosearchBot
Foobot Fimap
Freeuploader Firefox/7.0
Fyrebot Fuzz
FyberSpider
G-i-g-a-b-o-t G-i-g-a-b-o-t
GT::WWW
GetWeb GetWeb
Getintent
Gigabot Gigabot
Go-Ahead-Got-It
Grabber
Grafula Grafula
GrapeFX HEADMasterSEO
HMView HMView
HTMLparser HTTrack
Haansoft Haansoft
HonoluluBot Harvest
HybridBot Hloader
Humanlinks
IDBTE4M IDBTE4M
IDBot
IRLbot IRLbot
Iblog Id-search
IlseBot IlseBot
InfoTekies Image Fetch
InternetSeer Image Sucker
Iria Indy Library
InfoNaviRobot
InterGET
Iskanie Iskanie
IstellaBot IstellaBot
JOC Web Spider JennyBot
JetCar JetCar
Jetty
Joomla Joomla
Jorgee
JustView JustView
Keybot Translation-Search-Machine
Keyword Density Keyword Density
Kinza
Kozmosbot Kozmosbot
LNSpiderguy
LWP::Simple
LeechFTP LeechFTP
LexiBot
LibWeb LibWeb
Libwhisker Libwhisker
LieBaoFast
LinkWalker LinkWalker
LinkextractorPro Lipperhey
LinqiaMetadataDownloaderBot
LinqiaRSSBot
Litemage_walker
Lmspider
MIDown tool MIDown tool
MSIECrawler MIIxpc
Mag-Net MSFrontPage
MTRobot
Mail.RU_Bot
Majestic SEO
Majestic12 Majestic12
MarkWatch MarkMonitor
Mass Downloader Mass Downloader
Masscan
Mata Hari Mata Hari
Meanpathbot MauiBot
Metauri
MicroMessenger
Microsoft URL Control Microsoft URL Control
Minefield Minefield
Mister PiX Moblie Safari
MolokaiBot Morfeus Fucking Scanner
Mr.4x3 Mozlila
Musobot
NICErsPRO NICErsPRO
Name Intelligence Name Intelligence
Nameprotect Navroad
NearSite NearSite
Net Vampire Nessus
NetAnts NetSpider
NetLyzer Netcraft
NetMechanic
Nettrack
NextGenSearchBot
Nibbler
Niki-bot Niki-bot
Nikto
NimbleCrawler
Nmap Nmap
Nuclei Nuclei
Nutch OnCrawl
Octopus PECL::HTTP
Offline Navigator
OpenVAS
PHPCrawl PHPCrawl
Page Analyzer Page Analyzer
PageAnalyzer PageGrabber
PageThing.com
Panscient Panscient
Papa Foto
Petalbot Petalbot
Pi-Monster
Picscout
Picsearch Picsearch
PleaseCrawl Pimonster
ProPowerBot Pockey
ProWebWalker Psbot
Probethenet PyCurl
Pu_iN Quick-Crawler
PxBroker RankActive
QueryN Metasearch
RSSingBot
RankActiveLinkBot RankActiveLinkBot
RankFlex RankFlex
RankingBot2 RankurBot
Rankivabot RealDownload
Re-re
Reaper Reaper
Recorder Recorder
Ripper
RocketCrawler
Rogerbot Rogerbot
SEOkicks
SEOkicks-Robot SEOkicks-Robot
SalesIntelligent SEOlyticsCrawler
ScanAlert SEOstats
Screaming SISTRIX
Scrapy
ScreenerBot
Searchestate Searchestate
SemanticJuice SemanticJuice
Shodan SeoSiteCheckup
Seomoz
Siphon
Site Sucker Site Sucker
SiteCheckerBotCrawler SiteCheckerBotCrawler
SiteLockSpider SiteLockSpider
SiteSucker
Siteimprove Siteimprove
Sitevigil Snoopy
SlySearch
SocialRankIOBot
Sogou web spider Sogou web spider
SpaceBison Sosospider
Sottopop
Spammen Spammen
SpankBot SpankBot
SputnikBot SputnikBot
Stripper Sqlworm
Sqworm
Steeler
Sucker Sucker
Sucuri
SuperBot
SuperHTTP SuperHTTP
Suzuran Surfbot
T0PHackTeam T0PHackTeam
Telesoft TeleportPro
Telesphoreo
The Intraformant
TheNomad TheNomad
Thumbor
TightTwatBot TightTwatBot
Toweyabot Toweyabot
Tracemyfile Trendictionbot
TurnitinBot Turingos
URLy.Warning Turnitin
UnisterBot Typhoeus
V-BOT
VB Project VB Project
VeriCiteCrawler Virusdie
VoidEYE WASALive-Bot
Voltron WEBDAV
WISENutbot
WPScan WPScan
WWW-Mechanize
WWW::Mechanize WWW::Mechanize
Wallpapers/3.0 WWWOFFLE
WeSEE
Web Auto Web Auto
Web Fuck
Web Sucker Web Sucker
WebAuto WebAuto
WebCopier WebCopier
WebEnhancer WebEnhancer
WebFetch WebGo IS
WebImageCollector
WebPix WebPix
WebSauger WebReaper
WebZIP WebSucker
Whack Website Quester
Whacker WinHTTrack
Whatweb
WiseGuys Robot WiseGuys Robot
Wonderbot Wonderbot
Xaldon_WebSpider Woobot
Zauba Wotbox
ZoomBot Xenu
ZumBot YoudaoBot
Zade
Zermelo
ZyBorg
arquivo-web-crawler arquivo-web-crawler
autoemailspider autoemailspider
backlink-check coccocbot
cah.io.community cognitiveseo
clark-crawler dataforseo.com
com.plumanalytics
crawl.sogou.com
demandbase-bot
domainsproject.org domainsproject.org
gopher eCatch
instabid ips-agent
internetVista monitor
isitwp.com isitwp.com
linkdexbot
lwp-request lwp-request
meanpathbot
mediawords mediawords
plumanalytics polaris version
s1z.ru satoristudio.net
scalaj-http
scan.lol
seobility seobility
serpstatbot seostar
sitechecker.pro
siteripz siteripz
sogouspider
spyfu
trendiction.de trendiction.de
webgains-bot ubermetrics-technologies.com
webmeup-crawler
webpros.com webpros.com
xpymep1.exe
zgrab

322
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
404checker 404enemy
80legs ADmantX
AIBOT
ALittle Client
ASPSeek ASPSeek
Aboundex
Aboundexbot Aboundexbot
AhrefsBot AfD-Verbotsverfahren
AllSubmitter
AlphaBot
Anarchie
Anarchy Anarchy
Anarchy99
Anthill
Apexoo Apexoo
Asterias Aspiegel
Atomseobot Atomseobot
Attach AwarioRssBot
BBBike AwarioSmartBot
BDCbot BDCbot
BDFetch BDFetch
BLEXBot BLEXBot
BackDoorBot Backlink-Ceck
BackStreet BacklinkCrawler
Bandit Badass
Battleztar Bazinga BatchFTP
BetaBot BetaBot
Black Hole Bigfoot
Bitacle
BlackWidow
Blackboard Blackboard
Brandprotect Bolt
BotALot
Brandwatch
Buck
Buddy
BuiltBotTough
BuzzSumo BuzzSumo
CODE87 CATExplorador
Calculon CSHttp
ChinaClaw CazoodleBot
Cliqzbot CheTeam
Cloud mapping Chlooe
Citoid
Claritybot
Cocolyzebot Cocolyzebot
Cogentbot Cogentbot
Collector Collector
Copier Copier
Curious CopyRightCheck
CyotekWebCopy Copyscape
DBLBot Crescent
CrunchBot
DIIbot DIIbot
Deusu DTS Agent
Disco Digincore
Discobot Discobot
DittoSpyder Discoverybot
Dispatch
DnBCrawler-Analytics
DomCopBot DomCopBot
DomainSigmaCrawler DomainCrawler
Domains Project Download Wonder
Dragonfly Dragonfly
Drip Drip
EasyDL Ebingbong
Ecxi Ecxi
EroCrawler EroCrawler
Evil Evil
Exabot Extreme Picture Finder
Express WebPictures
Ezooms
FHscan
FemtosearchBot
Fimap
Firefox/7.0 Firefox/7.0
Foobot Foobot
Freeuploader
Fuzz
Fyrebot Fyrebot
G-i-g-a-b-o-t
GT::WWW GT::WWW
GalaxyBot
Genieo Genieo
GermCrawler GetRight
GetWeb GetWeb
Go!Zilla Getintent
GrabNet Go-Ahead-Got-It
GoZilla
Grabber
Grafula Grafula
GrapeshotCrawler GrapeshotCrawler
GridBot
HEADMasterSEO HEADMasterSEO
HMView
HTMLparser HTMLparser
HTTP::Lite
HTTrack HTTrack
HaosouSpider Harvest
Hloader
HonoluluBot HonoluluBot
IDBTE4M IDBTE4M
IRLbot
Iblog Iblog
Id-search
IlseBot IlseBot
Image Fetch Image Fetch
Image Sucker
IndeedBot IndeedBot
Intelliseek Intelliseek
Iria InternetSeer
IstellaBot IstellaBot
JamesBOT JamesBOT
JennyBot
JetCar
JikeSpider JikeSpider
Joomla LWP::Simple
JustView Larbin
Kenjin Spider Leap
Kinza
Kozmosbot
LNSpiderguy
LexiBot LexiBot
LibWeb
LieBaoFast LieBaoFast
LinkWalker LinkWalker
LinkpadBot LinkextractorPro
LinqiaRSSBot Lipperhey Spider
Ltx71 Litemage_walker
MIDown tool Lmspider
MIIxpc MIIxpc
MJ12bot MSIECrawler
MSFrontPage Magnet
Mag-Net
Mail.RU_Bot
Majestic SEO Majestic SEO
Majestic12
MarkMonitor MarkMonitor
Mb2345Browser Mass Downloader
MicroMessenger Mata Hari
Microsoft Data Access Meanpathbot
Minefield Mediatoolkitbot
MegaIndex.ru
Microsoft URL Control
Mister PiX Mister PiX
Morfeus Fucking Scanner MolokaiBot
NICErsPRO Musobot
NPbot
Nameprotect Nameprotect
Navroad Navroad
NearSite Needle
Nessus
NetLyzer NetLyzer
NetZIP NetZIP
Nettrack Netcraft
Netvibes Nikto
Nibbler NimbleCrawler
Nimbostratus Nimbostratus
Nmap Not
Offline Navigator Nuclei
Openvas Octopus
PHPCrawl Offline Explorer
OnCrawl
OpenVAS
OrangeBot
POE-Component-Client-HTTP POE-Component-Client-HTTP
PageAnalyzer
PageScorer
Pandalytics
Panscient Panscient
Papa Foto PeoplePal
Petalbot
Picscout Picscout
Pixray ProWebWalker
PleaseCrawl
ProPowerBot
Probethenet Probethenet
PyCurl Pu_iN
RSSingBot Pump
RankActive PxBroker
RankActiveLinkBot Quick-Crawler
RankingBot
RankingBot2 RankingBot2
Rankivabot ReGet
RealDownload
Reaper Reaper
RebelMouse RocketCrawler
RepoMonkey Rogerbot
Ripper SEOstats
SBIder
SEOkicks-Robot
SEOprofiler
SMTBot SMTBot
ScreenerBot ScanAlert
ScrepyBot
Searchestate
SearchmetricsBot SearchmetricsBot
SemanticJuice Seekport
Semrush SentiBot
Shodan SeobilityBot
SiteLockSpider Siphon
SiteSucker SiteCheckerBotCrawler
Siteimprove SiteExplorer
SiteSnagger
Sitevigil Sitevigil
SlySearch Snake
SmartDownload
Snapbot
Snoopy Snoopy
Sociscraper SocialRankIOBot
Sottopop
SpaceBison
Spammen
Spanner
Spbot
SputnikBot SputnikBot
Sqlworm Sqlworm
Sqworm Stripper
Steeler Sucuri
Sucker SuperBot
SuperHTTP Surfbot
SurveyBot Suzuran
T8Abot Swiftbot
Teleport Szukacz
TeleportPro Thumbor
Telesoft
Telesphoreo
TightTwatBot
Titan Titan
Toweyabot Toweyabot
Tracemyfile Trendictionbot
Turingos True_Robot
TurnitinBot TurnitinBot
TwengaBot TwengaBot
Typhoeus Typhoeus
UnisterBot URLy Warning
VCI Upflow
VeriCiteCrawler VB Project
Vagabondo
VidibleScraper VidibleScraper
VoidEYE
Voil Voil
Voltron
WASALive-Bot WASALive-Bot
WPScan WWW-Mechanize
WWWOFFLE WWWOFFLE
Wallpapers Wallpapers
Web Collage WeSEE
Web Fuck Web Enhancer
Web Pix WebFetch
WebBandit
WebCollage
WebCopier
WebEnhancer
WebFuck WebFuck
WebWhacker WebStripper
Webshag WebSucker
Webster WebmasterWorldForumBot
Website Quester
WebsiteExtractor
Whacker Whacker
Who.is Bot Whatweb
Widow Widow
Woobot WinHTTrack
WiseGuys Robot
Wonderbot
Wotbox
Wprecon Wprecon
Xaldon_WebSpider Zeus
Xenu ZyBorg
YoudaoBot
Zade
Zauba
Zermelo
ZumBot
adscanner adscanner
archive.org_bot backlink-check
cah.io.community
check1.exe check1.exe
clark-crawler
coccocbot
cognitiveseo
com.plumanalytics
crawl.sogou.com
crawler4j crawler4j
demandbase-bot domainsproject.org
gopher eCatch
linkdexbot evc-batch
lwp-request ips-agent
meanpathbot lwp-trivial
plumanalytics oBot
satoristudio.net
seocompany.store seocompany.store
seostar serpstatbot
sitechecker.pro
siteripz siteripz
spyfu trendiction.com
tAkeOut ubermetrics-technologies.com
webmeup-crawler voyagerx.com
webprosbot webprosbot
x09Mozilla
zgrab zgrab

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
cartierwatch.xyz bio-optomarket.ru
chorus.terakeet.com cymbaltaandtizanidine.blogspot.com
compliance-elena.top fun-mobi.pl
cxpromote.com juliadiets.com
fiuxy.com pogruztehnik.ru
labafydjxa.su scanmarine.info
lookingglassemb.com seccioncontrabajo.com
preg.marketingvici.com tizanidinesideeffectsweightloss.blogspot.com
sexsearch.com top-deal.com.pl
xn----7sbifcamovvfggw9d.xn--p1ai zeroredirect1.com

940
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
101raccoon.ru 007angels.com
11235813.webzdarma.cz 00webcams.com
4k-player.pl 101lesbian.xyz
4ureyesonly.com 12masterov.com
4webmasters.org 12u.info
14b.info
1millionusd.xyz
1qingdao.com
202ch.com
2345.com
23kw.ru
45en.ru
4rent.ru
57883.net
5i2.net
70casino.online 70casino.online
aac500b7a15b2646968f6bd8c6305869d7.com 83net.jp
abbanreddy.com 8kisses.eu
abiente.ru 991mostfm.co.id
abwa.tk a.pr-cy.ru
adman.se aac52006ec82a24e08b665f4db2b5013f7.com
adrunnr.com absolutelyanalog.com
adssafeprotected.com academiacsmendoza.org
accessoires-mode.in
admatic.com.tr
admitad.com
adultnet.in adultnet.in
advertex.info adultwebhosting.info
advokateg.ru aghanyna.com
alborzan.com akama.com
ald2014.org aksonural.ru
all-number.com albamargroup.com
all4wap.ru alessandraleone.com
alldownload.pw alibestsale.com
allesohnegirls.net all4invest.info
allforminecraft.ru alloysteel.ru
allsilver925.co.il allwomen.info
allstatesugarbowl.org amanda-porn.ga
alvtank.se apibatbrowsecom-a.akamaihd.net
am15.net apifasterlightin-a.akamaihd.net
animaltoplist.com apiqualitinknet-a.akamaihd.net
apimegabrowsebiz-a.akamaihd.net apple.com-webbrowsing-security.review
apioasisspacenet-a.akamaihd.net appsaurus.com
arcadeplayhouse.com appsecurityr.com
ardimobileinfo.ml apxeo.info
arewater.com arendovalka.xyz
arpelsreplica.xyz arkkivoltti.net
artdeko.info astana.xxxkaz.org
asrvvv-a.akamaihd.net astrochicks.com
atleticpharm.org auto.rusvile.lt
autodo.info autotrends.today
automobile-spec.com
availit.weebly.com availit.weebly.com
avitocars.ru aversis.net
azartclub.org avon-severozapad.ru
babespcs.com azte.ch
backlink4u.net balitouroffice.com
bagsonsale.online bang-hotties.com
baikaleminer.com bankofthewext.com
banki76.ru bannertesting.com
basedecor.ru bausparen.bz.it
berdasovivan.ru beatifullandscape.co
best-businessman.ru beauby.ru
best-seo-offer.com best-deals-products.com
bestwebsiteawards.com best-seo-solution.com
bfz.biz bestbrainprod.win
bif-ru.info bestofupload.info
bigcareer.info bestserials.com
bigpenisguide.com bestwrinklecreamnow.com
billiard-classic.com.ua bet365.com
binomo.com beta.hotkeys.com
bioscorp.ru beyan.host.sk
bitcoinpile.com beztuberkuleza.ru
bitcoinremote.com bio-japan.net
bizfly.info biteg.xyz
blog.koorg.ru biznesluxe.ru
bloggerads.net blagovest-med.ru
bloke.com blobar.org
bongacams.com bloggedporn.com
boobsimge.com bluesman.nu
bpro1.top board.f00d.de
bracketsmackdown.com bonkers.name
brainboostingsupplements.org bonzbuddy.com
brainxs.us bookmaker-bet.com
brandehk.dk brainsandeggs.blogspot.com
bravegirlsclub.com break-the-chains.com
briomotor.co buketeg.xyz
bristolhotel.com bukleteg.xyz
bumskontakte.org burn-fat.ga
burger-imperia.com buy-cheap-online.info
businescoop.men buy-forum.ru
buyessaynow.biz buyviagraa.blogspot.com
bvlgariwallet.xyz callcafe.info
c-english.ru calstaterealty.us
callmd5map.com candytiner.com
callstevens.com carabela.com.do
camdolls.com carson.getenjoyment.net
canacopegdl.com carstrends2015.com
canrole.com cartierlovestore.xyz
cartierlove2u.com cartierreplica.pw
celebsopics.com cashkitten-a.akamaihd.net
certifywebsite.win cayado.snn.gr
cfjump.com cbb1smartlist12.click
cheapjerseysa.com centre-indigo.org.ua
ceotrk.com
cheap-pills-norx.com
cheapmarmot.online cheapmarmot.online
cheapmoncler.win cheapmoncler.pw
check-this-out-now.online checkm8.com
checktext.org checktext.org
christianlouboutinsaleoutletonline.us chinacheapelitejerseys.com
citizenclsdriveri7.pen.io chiptuninger.com
cl.s7.exct.net chocolateslim-u-srbiji.com
clayvasedesigns.tk chocoslim.pro
clickaider.com chuckguilford.com
clickso.com cleanallspyware.com
clodo.ru compliance-barak.xyz
club-lukojl.ru constantaservice.net
colehaanoutlet.store converse.ddsoldes.fr
com-supportcenter.website coolgamechannel.com
comeondog.info copenergo.ru
compliance-brian.xyz culmimg.pw
contentsexpress.com customerpromos-a.akamaihd.net
cookielawblog.wordpress.com daneshetabiat.com
cornomase.win date-withme.com
covetnica.com datsun-do.com
cowlmash.com davidovic.info
credit-online.ws daymusam.com
credit.co.ua dealitright.click
dailyrank.net detskie-konstruktory.ru
dalavia.ru detskie-zabavi.ru
data.vtc.pw digital-sale.su
ddospanel.com dikx.gdn
defenderxtactical.com docstoc.com
dentalpearls.com.au dogbreedspicture.net
dichvuvesinhhanoi.com dojki-hd.com
dieswaene.com domain2008.com
dignitasdata.se domainsatcost.com
dikqlyremy.info doxysexy.com
dimaka.info doyouknowtheword-flummox.ml
diminishedvalueoforegon.com
dimkino.ru
directivepub.com
dirtpics.pw
discovertreasurenow.com
distver.ru
documentsite.net
dodlive.mil
dogsrun.net
domainsphoto.com
dscaas.website dscaas.website
e-biznes.info econom.co
e-buyeasy.com ecxtracking.com
e90post.com editmedios.com
education-cz.ru eduinfosite.com
ee77ee.com
egovaleo.it
ekosmetyki.net.pl
ekspertmed.com ekspertmed.com
ekspresihati.info elektronischezigarette2.mex.tl
elektir.ru elektrozigaretten1.postbit.com
elitepcgames.com elektrozigaretten1.tumblr.com
elvel.com.ua elite-sex-finders.com
en.altezza.travel embedle.com
enthuse.computernetworksonline.com empis.magix.net
epngo.bz envaseslotusama.com
eropho.net eralph.tk
eurosamodelki.ru eugenevaultstorage.com
excaliburfilms.com exoclick.com
exct.net expertblog.info
expolicenciaslatam.co exportshop.us
extlabs.io ezigarettekaufen2.blox.pl
ezigarettenshop1.yolasite.com ezigarettenkaufen1.deviantart.com
ezigaretteshop2.mywapblog.com ezigaretteshop2.mywapblog.com
f00kclan.de
f1nder.org f1nder.org
fast-torrent.ru fakehandbags.xyz
faz99.com falcon-images.blogspot.com
feargames.ru falopicm.pw
feel-planet.com fatfasts-4tmz.com
felizporno.com fickblock18.com
filefilter.weebly.com filkhbr.com
financeloan.us filmidivx.com
firma-legion.ru fishtauto.ru
floating-share-buttons.com flirt4free.com
flowwwers.com fok.nl
fortunejack.com formulaf1results.blogspot.com
foto-sisek.porngalleries.top forpackningsutveckling.se
fotopop.club foxtechfpv.com
fotzen-ficken.com free-stock-illustration.com
free-deals.faith free-today.com
freevpn.space freelinkbuilding.website.tk
fuck-paid-share-buttons.xyz frustrated-favorable.gq
fullgirl.ru fuckingawesome.com
funtoonez.com funnypica.com
fxtips.ru gallerylisting.com
fz139.ttk.ru gay-file.com
gael-s.ru gazobeton-p.com.ua
gateway.zscalerone.net geile-lelly.eu
gelezki.com germes-trans.com
genetworx.com gfaq.ru
germetiki.com.ua gigixo.com
getlamborghini.ga gk-atlant.info
getpopunder.com glass-msk.ru
girlgamerdaily.com googleseo.com.tr
glicol.kz gratuitxblcodes.com
goblacked.com greamimgo.pw
gogalleryawesome.com green-tea.tv
goodly.pro gribkovye-zabolevaniya.com
google-liar.ru groupmoney.ru
googlepositions.com growboxbl.ru
gotorussia.com guidefs.ru
growshop.es gunsvicceadadebt.tk
h2monline.com hanwei.us
hannasolution.ru hard-porn.mobi
hauleddes.com hasshe.com
hcate.com hayate.biz
heliko.no hazardky.net
historichometeam.com hd-filmy.net
homik.pw hdwalls.xyz
houseofrose.com hem.passagen.se
hjaoopoa.top
hoverboard360.at
hoverboard360.de hoverboard360.de
hubbble.com howmuchdoestizanidinecost.blogspot.com
hut1.ru hptwaakw.blog.fc2.com
hyipmanager.in https-legalrc.biz
iboss.com igtools.club
ideibiznesa2015.ru
iframe-toloka.com
iideaidekonkatu.info iideaidekonkatu.info
ilte.info increasewwwtraffic.info
imadedinner.net int.search.mywebsearch.com
imfamous.info interfucks.net
imgata.com investyb.com
insurple.com iopeninghours.co.uk
internetproviderstucson.com iqoption-bin.com
intim-uslugi.info isitwp.com
ip-guide.com itag.pw
ipchicken.com itronics.ca
ipornox.xxx jacago.com
iqoption.com janettabridal.com
isistaylorporn.info japfm.com
itbc.kiev.ua javlibrary.cc
izhevsk.xrus.org javspace.net
james13prix.info jerseywholesalebizchina.com
javstock.com jpcycles.com
jikoman.info justbcause.com
jillepille.com
justkillingti.me
jwcialislrt.com jwcialislrt.com
kadashihotel.com karaganda.xkaz.org
kambasoft.com ketrzyn.pl
karadene.com keywesthideaways.co
katjimej.blog.fc2.com keywords-monitoring-your-success.com
katushka.net keywordsuggests.com
kerch.site
kiinomaniak.pl kiinomaniak.pl
kinohall.ru kimcurlrvsms.com
kinohit1.ru kinoflux.net
knowsitall.info kiwe-analytics.com
konteiner24.com knogg.net
kopihijau.info
koronirealestate.gr koronirealestate.gr
kountrylife.com kraljeva-sutjeska.com
krasivye-devushki.net kursy-ege.ru
kw21.org landinez.co
ladsblue.com laudit.ru
law-check-seven.xyz lazymanyoga.com
laxob.com leadn.pl
legionalpha.com lecbter-relationships.ga
letslowbefast.site lernur.net
lidoradio.com lexaprogeneric.link
linksharingt.com lida-ru.com
linkwithin.com lifeinsurancekb.com
listiseltemournlan.gq lightinghomes.net
liumimgx.pw liveu.infoteka.hu
livesex-amateure.info livingroomdecor.info
lizace.com loftdigital.eu
loadopia.com lonerangergames.com
luckyshop.net.ua macnewtech.com
lulea-auktionsverk.se madot.onlinewebshop.net
mafcards.ru mailemedicinals.com
makedo.ru map028.com
marcoislandvacations.net maranbrinfo.com.br
marketingvici.com marketingtechniques.info
matsdale.com masthopehomes.com
mbiologi.ru medizinreisen.de
meble-bogart.info
medi-fitt.hu
meds-online24.com meds-online24.com
megagrabber.ru megagrabber.ru
megavolt.net.ua megahdporno.net
member-quiz.com
mesto-x.com mesto-x.com
missclub.info metallosajding.ru
misswell.net metaxalonevstizanidine.blogspot.com
mobile-appster.ru mhtr.be
monclervests.xyz middlerush-a.akamaihd.net
moscow-clining.ru migente.com
moscow.xrus.org missis.top
mouselink.co mlvc4zzw.space
moviemail-online.co.uk mobstarr.com
moz.com moesonce.com
mrbojikobi4.biz mojowhois.com
msfsaar.de musicstock.me
msk-diplomat.com my-big-family.com
muabancantho.info mydownlodablefiles.com
mulberryoutletonlineeu.com myftpupload.com
mural.co mypornfree.ru
muschisexbilder.com myseoconsultant.com
musezone.su
musicktab.com
mybinaryoptionsrobot.com
mygameplus.com
myliveblog.ru
mystats.xyz mystats.xyz
myyour.eu mzdish.site
naj-filmy24.pl nailsimg.com
naughtyconnect.com najaden.no
networkad.net namenectar.com
newstaffadsshop.club nardulan.com
newstudio.tv netcheckcdn.xyz
nikitsyringedrivelg.pen.io netfacet.net
ningessaybe.me new-post.tk
nisuturnetdgu.tk newstraveller.ru
npoet.ru nfljerseys.online
nuup.info nhl17coins.exblog.jp
o-o-8-o-o.com nina.az
oecnhs.info nodup.ru
online-hd.pl nomuos.it
onstrapon.purplesphere.in norththeface.store
ororodnik.goodbb.ru novgorod.xrus.org
oxotl.com ntic.fr
paclitor.com nuit-artisanale.com
painting-planet.com nw-servis.ru
panchro.xyz offer.wpsecurity.website
partner-trustworthy.men offergroup.info
pattersonsweb.com okel.co
pekori.to okmusic.jp
penisvergrotendepillennl.ovh online-zaymy.ru
perfection-pleasure.ru online.ktc45.ru
petsblogroll.com onlinefilmz.net
piccshare.com openstat.com
picmoonco.pw papasdelivery.ru
picswe.com parajumpersjakkesalgnorge.info
pijoto.net partnerads.men
pinsdaddy.com partnersafe.men
pinup-casino1.ru peekyou.com
pizza-imperia.com pendelprognos.se
pl-top.pl pflexads.com
phuketscreen.com
pic-re.blogspot.com
piccdata.com
picturesboss.com
pihl.se
plastjulgranar.se
platezhka.net platezhka.net
playtap.us poppen-nw.net
pochtovyi-index.ru poptool.net
pons-presse.com porno-home365.com
popander.mobi pornokajf.com
pornosemki.info pornosmola.info
pornotubs.com portadd.men
pornoxxx.com.mx positive2b.ru
pourvous.info
predmety.in.ua predmety.in.ua
preg.marketingvici.com
preparevideosafesystem4unow.space
primedice.com primedice.com
princeadvantagesales.com prizefestival.mobi
privacyassistant.net prizesbook.online
prize44.com prizestohandle.club
professionalwritingservices15.blogspot.ru prostitutki-yaroslavlya.org
pronorm.fr psoriasis-file.trade
puserving.com puteshestvennik.com
puzo2arbuza.ru
pwwysydh.com
py100.ru py100.ru
qwarckoine.com qwesa.ru
randalljhoward.com rangjued.com
randki-sex.com razyboard.com
rankings-analytics.com realizmobi.com
rating-casino2021.ru rebuildermedical.com
recipedays.ru recordpage-a.akamaihd.net
registrysweeper.com reeyanaturopathy.com
remybutler.fr refads.pro
rent2spb.ru rep-am.com
replicalouboutin.xyz reyel1985.webnode.fr
rightenergysolutions.com.au rfd-split.hr
ringporno.com
ringtonepartner.com
robertefuller.com robertefuller.com
robot-forex.biz romhacking.ru
rockprogblog.com rootandroid.org
ros-ctm.ru royal-betting.net
rosbalt.com.ua runofilms.ru
royalcar-ufa.ru rus-pornuha.com
rozalli.com rusprostitute.com
running-line.ru s1z.ru
sa-rewards.co.za sakhboard.ru
sadaholding.com samo-soznanie.ru
sajatvelemeny.com sbwealthsolutions.ca
saletool.ru
sanjosestartups.com
sanyuprojects.com
sbtdesign.co.uk
scanmarine.info
scanner-alexa.top scanner-alexa.top
scanner-marwin.top sdsjweb.com
sdi-pme.com seadragonherbery.com
se-welding.ru searchengineranker.email
search-error.com searchinquire.com
semalt.com searchkut.com
semrush.com serptehnika.ru
seo-smm.kz sexkontakteao.info
seokicks.de sexpartygirls.net
seozoom.it sexspornotub.com
servethis.com sexuria.net
serw.clicksor.com shama-rc.net
sethrollins.net sharpchallenge.com
sex-foto.pw shopperifymac.com
sexgalleries.top shoppingjequiti.com.br
sexreliz.com
sexsearch.com
sextracker.be
sexxdate.net
sibtest.ru
sildenafil-tadalafil.info sildenafil-tadalafil.info
sim-service.net silverage.ru
simply.net simple-image.com.ua
siteimprove.com site-speed-checker.site
siteonomy.com site.ru
skanninge.se sitechecker.pro
smokewithrabbits.com sixcooler.de
skladvaz.ru
slayerlife.com
social-s-ggg.xyz
socialbutton.xyz socialbutton.xyz
soheavyblog.com soft-program.com
songplanet.ru softomix.net
spasswelt.net softonicads.com
speeddream.xyz soietvousmaime.fr
spymac.net sortthemesitesby.com
starpages.net sotechco.co
startufa.ru soviet-portal.do.am
stats-collector.org specialfinanceoffers.com
stefanbakosab.se stanthonyscatholicchurch.org
stop-gepatit.te.ua strana-krasoty.ru
sukarame.net streha-metalko.si
sundrugstore.com strfls.com
superlist.biz stroiminsk.com
surffoundation.nl sudexpert66.ru
svolze.com support.nopeas.sk
swinginwithme.ru svtrd.com
talant-factory.ru swagbucks.com
taqywu51.soup.io swsociety.se
teenporn18.net tacbelarus.ru
tecnoteakviareggio.it
tedxrj.com
teencastingporn.com
telefonsexsofort.tk telefonsexsofort.tk
theguardlan.com textads.men
thewebsitetemplate.info the-usa-games.blogspot.com
thexart.club thedownloadfromwarez.blogspot.com
tizanidine4mgtablets.blogspot.com thetardistimes.ovh
tizanidinecapsules.blogspot.com thetattoohut.com
tizanidinehydrochloride2mg.blogspot.com tizanidine4mg.blogspot.com
tizanidinesleepaid.blogspot.com tizanidine6mg.blogspot.com
tizanidinestreetprice.blogspot.com tizanidinehydrochloride4mgstreetvalue.blogspot.com
torrents.life tizanidineingredients.blogspot.com
tourcroatia.co.uk tizanidinestreetvalue.blogspot.com
traffic-club.info tksn.ru
traffic2money.com token-lab.org
traxdom.ru tomatis.gospartner.com
turvgori.ru topads.men
tvteleport.ru topcasinoratings.ru
tyumen.xrus.org torrentred.games
ukr-lit.com tracxn.com
ukrtvory.in.ua trafficcentr.xyz
undergroundcityphoto.com trafficmonetize.org
unpredictable.ga trafficnetzwerk.de
usbggettwku.ga trafficstars.com
utiblog.fr traffixer.com
velpanex.ru trahvid.com
versaut.xxx-cam.webcam trainoffend.ml
vesnatehno.ru tsstcorpcddvdwshbbdriverfb.aircus.com
viagengrarx.com tuberkulezanet.ru
ua-company.ru
uggsale.online
uogonline.com
us-america.ru
usswrite.com
venerologiya.com
viagra.pp.ua viagra.pp.ua
viandpet.com video-chat.love
video-chat.in videojam.tv
videochat.tv.br videooko.weebly.com
villakohlanta.nu vipps.com.my
vip.51.la vitalads.net
virus-respirators.com vitanail.ru
voprosotvet24.ru volgograd.xrus.org
vriel.batcave.net vremya.eu
vrotike.ru vucms.com
vse-pesni.com w7s.ru
wahicbefa31.soup.io wallpapers-best.com
walkme.com wallpaperstock.net
warningwar.ru warningwar.ru
watracker.net we-are-gamers.com
web.cvut.cz webix.me
website-stealer.nufaq.com webmonetizer.net
whiteproduct.com webstatsdomain.org
wholesalecheapjerseysfree.com webtherapy.ru
whosonmyserver.com wedding0venues.tk
winwotgold.pl weekes.biz.tc
winx-play.ru works.if.ua
worldmusicfests.com xaylapdiendanang.com
worldoffiles.ru xfluro.com
www.jbetting.com xmronta.com
x-diesel.org xn--h1ahbi.com.ua
xchat26.myfreecams.com xsfetish.org
xn----7sbahjd3btneuw1joc.xn--p1ai
xn----dtbndd4ae7eub.top
xn--80ahdheogk5l.xn--p1ai
xn--b1adccaf1bzj.xn--p1ai
xn--e1aggki3c.xn--80adxhks
xn--hxazdsfy.blogspot.com
xtrafficplus.com
xvideosporn.biz xvideosporn.biz
xxlargepop.com yebocasino.co.za
xxxtubesafari.com yginekologa.com
y8games-free.com yogamatsexpert.com
yellowstonevisitortours.com yourtemplatefinder.com
youbloodyripper.com yuarra.pluto.ro
yourads.website yubikk.info
yoursearch.me yugk.net
zakazvzloma.com yuweng.info
zatjmuzu.info zahvat.ru
zetmaster.ru zarenica.net
zhacker.net zionstar.net
zlatnajesen.com zoodrawings.com
zoominfo.com zoomovies.org
zvezdagedon.ru zrus.org
zygophyceous.womanstars.site zs2vm.top

482
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
000free.us 2daytrendingnews.com
14b.info 2nt.ru
1688.com 2x2fan.ru
4replicawatch.net 991mostfm.co.id
777-club.ru 9icmzvn6.website
a96527gi.beget.tech all4invest.info
abcguru.xyz
actionnooz.com
adultfullhd.com
adultwebhosting.info
afslankpillen2017nl.eu
aimayangzhi.com
alert-hgd.xyz
alkoravto.ru
allforminecraft.ru
allproblog.com allproblog.com
anniemation.com allwomen.info
appfixing.space amospalla.es
applyneedy.xyz anaksma.info
arabgirls.adultgalls.com arcadepages.com
aramaicmedia.org arcteryxstore.online
arkkivoltti.net ardimobileinfo.ml
artel116.ru arpelsreplica.xyz
atlant-auto.info aversis.net
avon-ukraine.com baditri.com
azlex.uz baixar-musicas-gratis.com
back.dog balans.shahterworld.org
bangla-chat-uk-paralud.ga beauty-b0x.pl
blackbabesporn.com bedcapdealers.com
bloke.com bestmobilityscooterstoday.com
bocoarchives.org bestplacetobuyeriacta.jw.lt
brianhenry.co bestpriceninja.com
brus.city bestwaystogetpaid.us
bumble.cheapwebsitehoster.com binomo.kz
burn-fat.ga blacktwhite.com
buyessay3.blogspot.ru boazpower.com
buzzsumo.com boeuklad.com
cakemediahq.com.au brandov.ru
callejondelpozo.es bum.com.ru
candycrushshop.com buy-meds24.com
cayado.snn.gr buyfriend.ru
cgi2.nintendo.co.jp c-english.ru
chatroulette.online cakesplus.com.au
chimiver.info cartierloveringreplica.xyz
club-musics.ru cashkitten-a.akamaihd.net
conboy.us cheatcode-lita12.rhcloud.com
connectionstrenth.com checktext.org
coolbar.pro cialgenisrx.com
courtshipgift.com civilwartheater.com
cutalltheshit.com clubfashionista.com
datadepths.com coderstate.com
day-news.info compliance-don.xyz
compliance-margo.top
copenergo.ru
cosmetic.donna7753191.ru
crazyprotocol.com
cutt.us
deadlinkchecker.com deadlinkchecker.com
deplim.com dispo.de
designdevise.com dnsrsearch.com
digest-project.ru dogsrun.net
directivepub.com domoysshop.ru
dnepropetrovsk.mistr-x.org dostavimvdom.ru
docstoc.com dtnlyss.com
dollartree.info e-avon.ru
doublepimp.com e-buyeasy.com
drugspowerstore.com eas-seo.com
druzhininevgeniy63.blogspot.com ege-russian.ru
dyt.net elexies.info
easytuningshop.ru epicbrogaming.com
edwinkonijn.com.au ewebarticle.info
ekn-art.se falcon-images.blogspot.com
ekto.ee famix.xyz
elektronischezi.livejournal.com farm26.ru
empirepoker.com fickkontakte.org
eng-lyrics.com fighrofacciufreesig.ga
enternet.ee flowersbazar.com
escortplius.com free-today.com
exchanges-bet.com gamerextra.com
extener.org gamerscorps.com
extlinks.com gazoblok.net.ua
failingmarriege.blogspot.com getdot.ru
fiuxy.com gilsonchiro.xyz
flirt4free.com glicol.kz
fok.nl glogow.pl
formulaf1results.blogspot.com gowreckdiving.com
forpackningsutveckling.se gratuitxblcodes.com
franklinfire.co growshop.es
freemags.cc grupografico-pilar.com.ar
freesitetest.com gsasearchenginerankerhelp.com
frvo.alptandem.ru gsmlab.pl
gallery.rennlist.com hauleddes.com
gamewrath.com hccoder.info
gazporno.com hobild.net
geilehausfrauen.net hotchatdate.com
gilbertbanda.net hotcore.info
gobongo.info hotsocialz.com
goldpanningtools.com hully.altervista.org
goodwinmetals.co ideoworld.org
gorodservis.ru ilikevitaly.com
gotcher.us imgata.com
graphicwe.org imguramx.pw
greendream.com.ua incanto.in.ua
guidefs.ru inspiring-desperate.tk
gwebtools.com ipostroika.ru
hermesreplica.pw japfm.com
hit-men.men jaxcube.info
hiwibyh.bugs3.com joy-penguin.com
hotblog.top jwcialislrt.com
hubbble.com kareliatobacco.ru
humanorightswatch.org katushka.net
i-service.kz kaz.kz
iamsport.org kino-filmi.com
ictizanidinehcl4mg.blogspot.com kleine-titten.biz
id-forex.com klikbonus.com
imgarcade.com kolotiloff.ru
incomekey.net kopihijau.info
iplusbit.blogspot.co.za kredit-blog.ru
iscblog.info kvartir-remont.biz
itch.io lacapilla.info
jwss.cc laparfumotec.com
kenaba.su law-check-two.xyz
khadastoafarde.tk light.ifmo.ru
kihi.gdn linerdrilling.com
kinocccp.net linkdebrideur.xyz
kochanelli.com liumimgx.pw
komputernaya-pomosh-moscow.ru lost-alpha.ru
konturkrasoty.ru magiadinamibia.blogspot.com
krasivoe-hd.com malls.com
ks1234.com manyresultshub-a.akamaihd.net
ladsup.com maridan.com.ua
lapitec.eu medtherapy.ru
larutti.ru meetingrainstorm.bid
letslowbefast.today
lignofix.ua
liquimondo.com
longadventure.com
lostfilm-online.ru
m-google.xyz
macotool.com
manifestyourmillion.com
marketland.ml
meccadumps.net
minneapoliscopiers.com minneapoliscopiers.com
mirtorrent.net missis.top
mixtapetorrent.com moncleroutletonline.win
moviezbonkerssk.cf monclervests.xyz
mzdish.site monetizationking.net
na-telefon.biz monthlywinners.com
nagdak.ru mp3s.club
naj-filmy24.pl mrlmedia.net
narkologiya-belgorod.ru mydeathspace.com
natali-forex.com mylida.org
nationalbreakdown.com nacap.ru
nofreezingmac.work needtosellmyhousefast.com
nordvpn.com newfilmsonline.ru
nzfilecloud.weebly.com nibbler.silktide.com
o.light.d0t.ru nosecret.com.ua
oakleyglassesonline.us novatech.vn
odywpjtw.bloger.index.hr november-lax.com
onstrapon.purplesphere.in nuup.info
obiavo.uz
offergroup.info
oivcvx.website
omoikiri-japan.ru
onclkads.com
online7777.com
ooomeru.ru
orion-v.com
osb.se11.ru
outpersonals.com outpersonals.com
partner-trustworthy.men paccohichetoti.ml
picquery.com pavlodar.xkaz.org
pinapchik.com pdamods.ru
pinwallpaper.xyz pdns.cz
popup-hgd.xyz piccshare.com
porno.simple-image.com.ua picscout.com
pornokajf.com picswe.com
pio.polytopesexempt.com
pirateday.ru
pl-vouchers.com
pl.id-forex.com
pod-muzyku.club
poems.com.ua
polcin.de
porno-home365.com
pornoklad.ru pornoklad.ru
pornpost.in priceg.com
prointer.net.ua pro-tec.kz
prostitutki-tyumeni.org progress-upakovka.ru
pussyspace.net radiogambling.com
puzzleweb.ru ranksays.com
qor360.com remontgruzovik.ru
remont-komputerov-notebook.ru renhacklids.tk
remybutler.fr ringtonepartner.com
renewablewealth.com rockma.se
rentehno.ru roma-kukareku.livejournal.com
restaurantlescampi.com rozalli.com
rostov.xrus.org sayyoethe.blogspot.co.za
sabaapress.com sbt-aqua.ru
scanner-jane.top scanmyphones.com
scanner-julia.top scenarii-1-sentyabrya.uroki.org.ua
scottbywater.com
searchencrypt.com searchencrypt.com
searchimage.co see-your-website-here.com
searchinterneat-a.akamaihd.net sei80.com
seo-prof1.xyz semp.net
sexspornotub.com serpstat.com
sexstream.pl servingnotice.com
shop-electron.ru sexobzor.info
sextracker.be
shohanb.com
shoppingmiracles.co.uk
sideeffectsoftizanidine.blogspot.com sideeffectsoftizanidine.blogspot.com
signx.info slavic-magic.ru
skytraf.xyz socas.pluto.ro
snegozaderzhatel.ru solicita.info
soochi.co spaceshipad.com
sovinsteel.ru spamnuker.com
spb.afora.ru
specialfinanceoffers.com
spylog.com
stair.registrydomainservices.com stair.registrydomainservices.com
stariy-baku.com stopnarco.ru
superiends.org superlist.biz
superoboi.com.ua supers.com.ua
suralink.com tabakur77.com
surcentro.com taboola.com
td-33.ru taqplayer.info
teenbbw.yopoint.in tds-advert002.info
teenforporn.com thegamerznetwork.com
thetardistimes.ovh tizanidineforopiatewithdrawal.blogspot.com
tizanidinedosageforsleep.blogspot.com tizanidinehcl2mgsideeffects.blogspot.com
top-l2.com tizanidineshowupondrugtest.blogspot.com
topanasex.com tourcroatia.co.uk
trafficmania.com trumpetedextremes.com
trahvid.com trustaffs.com
treasuretrack-a.akamaihd.net turbo-suslik.org
trkur.com ukrup.com
ublaze.ru ultramart.biz
ugguk.online unacittaconte.org
uginekologa.com unlimitdocs.net
ukr-lit.com uptime.com
unpredictable.ga vabasa.inwtrade.com
videospornogratisx.net validdomain.xyz
vipcallsgirls.com via-energy-order.com
vipsiterip.org video-chat.love
vizag.kharkov.ua video-production.com
voprosotvet24.ru videochat.cafe
vostoktrade.info vip-parfumeria.ru
vuclip.com visa-china.ru
watchdogs-2.ru vitoriacabos.com
watracker.net vizitki.net
webads.co.nz websiteaccountant.de
webadvance.club westen-v.life
webcamtalk.net westsextube.com
webshoppermac.com wholesalejerseychinashop.com
wellcome2slovenia.ru wholesalejerseysgaa.com
whiteelephantwellington.com x-diesel.biz
williamrobsonproperty.com x-stars.ru
www.ehscloud.cn xn----7sbahjd3btneuw1joc.xn--p1ai
xboxster.ru xvideosbay.com
xjrul.com youtubedownload.org
xn----ctbigni3aj4h.xn--p1ai youtubologia.it
xn--80aagddcgkbcqbad7amllnejg6dya.xn--p1ai
xn--b1adccaf1bzj.xn--p1ai
xn--e1aggki3c.xn--80adxhks
xsion.net
xvideosporn.biz
yopoint.in
youporn-forum.ga
your-bearings.com
yourmovies.pl
yuarra.pluto.ro
zaimite.ru
zajm-pod-zalog-nedvizhimosti.ru
zawyna.ua
zdesoboi.com zdesoboi.com
znakomstvaonlain.ru zhacker.net
znakomstva-piter78.ru
zscalertwo.net
zvezdagedon.ru

125
dev-tools/test_units/ratelimittest-beta.txt
View file

@ -8,6 +8,65 @@
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html>ml>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html><html> </html><html>
<head><title>503 Service Temporarily Unavailable</title></head> <head><title>503 Service Temporarily Unavailable</title></head>
<body> <body>
@ -435,62 +494,6 @@
<hr><center>nginx/1.18.0 (Ubuntu)</center> <hr><center>nginx/1.18.0 (Ubuntu)</center>
</body> </body>
</html> </html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<!DOCTYPE html> <!DOCTYPE html>
<html> <html>
<head> <head>
@ -581,14 +584,4 @@
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html> </html>

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.177 0; 10.1.0.153 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.12.3520 ### Version: V4.2022.12.3521
### Updated: Fri Dec 16 10:03:53 UTC 2022 ### Updated: Fri Dec 16 22:01:11 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.12.3520 ### Version: V4.2022.12.3521
### Updated: Fri Dec 16 10:03:53 UTC 2022 ### Updated: Fri Dec 16 22:01:11 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##