vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-05 04:00:13 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2023.02.3584 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2023-02-21 10:09:27 +00:00
parent 6422287d88
commit 80e6bf8de8
48 changed files with 98386 additions and 98383 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2023.02.3583 #### Version: V4.2023.02.3584
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2023.02.3583 #### Version: V4.2023.02.3584
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -14,7 +14,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2023.02.3583 #### Version: V4.2023.02.3584
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

12150
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2023.02.3583 #### Version: V4.2023.02.3584
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

12154
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

12154
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

12154
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

12154
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.38.0 1; 10.1.1.87 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.38.0 0; 10.1.1.87 0;
127.0.0.1 0; 127.0.0.1 0;

12154
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.38.0 1; 10.1.1.87 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.38.0 0; 10.1.1.87 0;
127.0.0.1 0; 127.0.0.1 0;

12154
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.38.0 1; 10.1.1.87 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.38.0 0; 10.1.1.87 0;
127.0.0.1 0; 127.0.0.1 0;

12154
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
3583 3584

12154
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

12154
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
172.177.154.100 0; 13.87.244.197 0;

12154
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.38.0 1; 10.1.1.87 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.38.0 0; 10.1.1.87 0;
127.0.0.1 0; 127.0.0.1 0;

12154
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.38.0 1; 10.1.1.87 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.38.0 0; 10.1.1.87 0;
127.0.0.1 0; 127.0.0.1 0;

12154
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.38.0 1; 10.1.1.87 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.38.0 0; 10.1.1.87 0;
127.0.0.1 0; 127.0.0.1 0;

12154
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
172.177.154.100 0; 13.87.244.197 0;

12154
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
172.177.154.100 0; 13.87.244.197 0;

12154
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.38.0 1; 10.1.1.87 1;
127.0.0.1 1; 127.0.0.1 1;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
Barkrowler Aboundex
CODE87 OnCrawl
DSearch ScreenerBot
Image Sucker ScrepyBot
InfoTekies SentiBot
NICErsPRO Sitevigil
Pixray SputnikBot
URLy Warning Telesphoreo
ZyBorg eCatch
crawl.sogou.com pcBrowser

316
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
360Spider 360Spider
AIBOT 404enemy
AiHitBot ALittle Client
Aboundex
Acunetix
AfD-Verbotsverfahren
Alligator Alligator
AlphaBot Aspiegel
Ankit Atomseobot
Anthill BDFetch
Attach
BBBike
BLEXBot
BackStreet BackStreet
Backlink-Ceck
BacklinkCrawler
Bandit
Barkrowler
BatchFTP
Battleztar Bazinga
Black Hole Black Hole
BlackWidow BlackWidow
Blackboard Blackboard
BlowFish BlowFish
Boardreader Boardreader
BotALot
Brandprotect
Brandwatch Brandwatch
Buck
Buddy
Bullseye Bullseye
BunnySlippers BunnySlippers
CCBot CCBot
CSHttp CSHttp
Chlooe CazoodleBot
Cloud mapping CensysInspect
Copier CherryPicker
Craftbot ChinaClaw
Claritybot
Cliqzbot
Cocolyzebot
Collector
CopyRightCheck
Cosmos
Crawling at Home Project Crawling at Home Project
Crescent
CrunchBot CrunchBot
Curious CyotekWebCopy
DBLBot
DIIbot DIIbot
DTS Agent DSearch
DataCha0s DataCha0s
Devil DatabaseDriverMysqli
Dirbuster DigitalPebble
Disco
Discobot Discobot
DnBCrawler-Analytics Discoverybot
DnyzBot Dispatch
DomainAppender DomainCrawler
DomainSigmaCrawler
DomainStatsBot DomainStatsBot
Domains Project Domains Project
Dotbot
Download Wonder
Dragonfly
ECCP/1.0 ECCP/1.0
EMail Wolf
Ecxi
EirGrabber EirGrabber
Evil Exabot
Express WebPictures Express WebPictures
Extractor
ExtractorPro ExtractorPro
FHscan EyeNetIE
FemtosearchBot FDM
Fimap FyberSpider
Flunky
Freeuploader
Fuzz
GT::WWW GT::WWW
GetRight GetRight
GetWeb GetWeb
Go!Zilla Gigabot
GrabNet Gotit
Grabber Grafula
GrapeFX GrapeFX
GrapeshotCrawler HEADMasterSEO
GridBot HMView
HTMLparser HTMLparser
Haansoft HTTrack
HaosouSpider Havij
Harvest Heritrix
HonoluluBot Humanlinks
Id-search IDBot
IlseBot IlseBot
Image Sucker Image Sucker
IndeedBot
Indy Library Indy Library
InterGET InfoNaviRobot
Internet Ninja Internet Ninja
Iria Iria
IstellaBot
JOC Web Spider JOC Web Spider
JennyBot Jbrofuzz
Jetty
JikeSpider
Jorgee
JustView
Keybot Translation-Search-Machine Keybot Translation-Search-Machine
Keyword Density
Kozmosbot
LNSpiderguy LNSpiderguy
LWP::Simple
Larbin Larbin
Leap
LeechFTP
Lftp Lftp
LieBaoFast LieBaoFast
Lightspeedsystems Lightspeedsystems
Likse Likse
LinkScan LinkpadBot
LinkWalker
Linkbot
LinksManager LinksManager
LinqiaMetadataDownloaderBot Lipperhey
Lipperhey Spider MIIxpc
Litemage_walker
Lmspider
MIDown tool
MQQBrowser MQQBrowser
Mail.RU_Bot MSFrontPage
Mass Downloader MTRobot
Minefield Mag-Net
Magnet
Majestic SEO
MarkWatch
Masscan
MauiBot
MeanPath Bot
Meanpathbot
MicroMessenger
Microsoft Data Access
Microsoft URL Control
Mister PiX Mister PiX
Moblie Safari
Mojeek
Mojolicious
MolokaiBot MolokaiBot
Morfeus Fucking Scanner
Mr.4x3 Mr.4x3
Musobot Msrabot
NearSite NPbot
Name Intelligence
Nameprotect
Navroad
Needle
Nessus
Net Vampire Net Vampire
NetAnts
NetMechanic
NetSpider NetSpider
Netvibes NetZIP
NextGenSearchBot NextGenSearchBot
Nibbler Nimbostratus
NimbleCrawler
Ninja Ninja
Not Not
Nutch Nuclei
Offline Explorer
Offline Navigator
OpenLinkProfiler
Openfind Openfind
OrangeSpider OutclicksBot
POE-Component-Client-HTTP OutfoxBot
PHPCrawl
Page Analyzer Page Analyzer
PageGrabber Papa Foto
Pavuk
PeoplePal PeoplePal
Pi-Monster Pi-Monster
Picsearch Picsearch
PictureFinder Pixray
Piepmatz ProPowerBot
Pimonster Psbot
PleaseCrawl Pu_iN
Pockey Pump
Probethenet
PxBroker
QueryN Metasearch QueryN Metasearch
RankActive Quick-Crawler
RankActiveLinkBot RSSingBot
Rankivabot RealDownload
RankurBot RebelMouse
Reaper Ripper
RedesScrapy RocketCrawler
Rogerbot SEOprofiler
SBIder
SEOkicks
SEOstats SEOstats
Scrapy SISTRIX
Searchestate Scanbot
SearchmetricsBot ScrepyBot
Semrush Seekport
SemrushBot SemrushBot
Siphon SeoSiteCheckup
Site Sucker SeobilityBot
Shodan
SiteExplorer SiteExplorer
SiteLockSpider
SiteSnagger
Sitebeam
Siteimprove
Sitevigil Sitevigil
SmartDownload SlySearch
Snoopy Snapbot
SocialRankIOBot SocialRankIOBot
Sociscraper Sociscraper
Sosospider Sosospider
Spammen Spanner
Sqlworm SputnikBot
Steeler Sqlmap
Stripper
Sucker
Sucuri
SuperBot
SuperHTTP SuperHTTP
Surfbot Suzuran
Swiftbot Swiftbot
Teleport T0PHackTeam
TeleportPro
Telesoft
Telesphoreo
Telesphorep Telesphorep
Thumbor Thumbor
TightTwatBot TightTwatBot
Titan Toweyabot
True_Robot Trendictionbot
Turnitin
TurnitinBot TurnitinBot
TwengaBot TwengaBot
Typhoeus
URLy Warning URLy Warning
UnisterBot V-BOT
VB Project VidibleScraper
Vacuum Virusdie
Vagabondo Voil
VelenPublicWebCrawler WASALive-Bot
WEBDAV WEBDAV
WWW::Mechanize Wallpapers
Web Enhancer Wallpapers/3.0
Web Sucker Web Auto
WebBandit Web Fetch
Web Fuck
Web Pix
WebEnhancer WebEnhancer
WebFetch
WebFuck
WebGo IS
WebLeacher WebLeacher
WebsiteExtractor WebSucker
WebWhacker
WebmasterWorldForumBot
WebsiteQuester WebsiteQuester
Webster
Whacker
Widow Widow
WinHTTrack
WiseGuys Robot WiseGuys Robot
Xaldon WebSpider Woobot
Wotbox
Wprecon
Xaldon_WebSpider Xaldon_WebSpider
Xenu adscanner
Zade
Zitebot
ZoomBot
ZumBot
arquivo-web-crawler
arquivo.pt arquivo.pt
autoemailspider backlink-check
cah.io.community coccocbot
com.plumanalytics cognitiveseo
eCatch demandbase-bot
domainsproject.org
facebookscraper facebookscraper
gopher ips-agent
iubenda-radar linkdexbot
lwp-trivial lwp-request
magpie-crawler meanpathbot
mediawords mediawords
page scorer muhstik-scan
pcBrowser pcBrowser
plumanalytics polaris version
ripz
s1z.ru s1z.ru
seocompany.store satoristudio.net
seoscanners scalaj-http
seostar seostar
serpstatbot
sitechecker.pro sitechecker.pro
siteripz siteripz
sogouspider
sp_auditbot sp_auditbot
spyfu spyfu
sysscan
tAkeOut
trendiction.de
voyagerx.com voyagerx.com
webgains-bot
webmeup-crawler
zauba.io zauba.io

314
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
404checker 01h4x.com
404enemy 404enemy
80legs
AIBOT AIBOT
ASPSeek
Aboundexbot
AfD-Verbotsverfahren AfD-Verbotsverfahren
AhrefsBot Aipbot
AiHitBot Anarchy
Anarchie Anarchy99
Apexoo Ankit
Asterias Asterias
BLEXBot BDCbot
BackDoorBot BackDoorBot
BackWeb BacklinkCrawler
Bandit Badass
Barkrowler Bigfoot
BatchFTP Bitacle
Battleztar Bazinga Black Hole
BetaBot Blow
Blackboard BlowFish
Bolt
Buck Buck
Buddy Buddy
BuiltWith BuiltWith
Bullseye Bullseye
BunnySlippers
CODE87 CODE87
Calculon Calculon
CazoodleBot
Cegbfeieh Cegbfeieh
CensysInspect CheTeam
CheeseBot CherryPicker
ChinaClaw
Chlooe Chlooe
Citoid Citoid
Claritybot
Cliqzbot Cliqzbot
Cocolyzebot Cloud mapping
Collector
CopyRightCheck
Copyscape Copyscape
CrunchBot Curious
Custo
CyotekWebCopy
DBLBot DBLBot
DigitalPebble DIIbot
Dispatch DSearch
DittoSpyder DTS Agent
DataCha0s
DatabaseDriverMysqli
Devil
Digincore
Dirbuster
Disco
DnyzBot DnyzBot
DomainAppender
DomainSigmaCrawler DomainSigmaCrawler
DomainStatsBot Download Wonder
Domains Project ECCP/1.0
Dotbot
EMail Siphon EMail Siphon
EMail Wolf
Ebingbong Ebingbong
EirGrabber
EroCrawler
Exabot
Extreme Picture Finder
Ezooms Ezooms
FlashGet FDM
Foobot Firefox/7.0
Fyrebot FrontPage
GalaxyBot Fuzz
FyberSpider
Genieo
GermCrawler GermCrawler
Gigabot GetRight
Go-Ahead-Got-It GoZilla
Gotit Gotit
GrabNet Grabber
GrapeFX
GridBot
Harvest
Havij Havij
Heritrix
Hloader
Humanlinks Humanlinks
HybridBot IDBot
IDBTE4M
IRLbot
Id-search Id-search
Image Sucker Image Sucker
InfoTekies InfoTekies
Intelliseek InterGET
Internet Ninja Internet Ninja
InternetSeer
IstellaBot IstellaBot
JOC Web Spider JOC Web Spider
JamesBOT Jbrofuzz
JennyBot
JetCar
Jetty
Keybot Translation-Search-Machine
Keyword Density Keyword Density
Kozmosbot Kozmosbot
LNSpiderguy Lanshanbot
Larbin LeechGet
Leap LieBaoFast
LeechFTP Lightspeedsystems
Lftp LinkScan
LibWeb LinkextractorPro
Likse LinqiaRSSBot
LinqiaScrapeBot LinqiaScrapeBot
Lipperhey Lipperhey
Lipperhey Spider Lipperhey Spider
Lmspider
MFC_Tear_Sample MFC_Tear_Sample
MIIxpc MIIxpc
MQQBrowser
MSFrontPage
MSIECrawler MSIECrawler
MTRobot Mag-Net
Mail.RU_Bot Magnet
Majestic-SEO
MarkWatch
Masscan Masscan
MauiBot
MeanPath Bot MeanPath Bot
Meanpathbot MicroMessenger
MegaIndex.ru Microsoft URL Control
Morfeus Fucking Scanner Mojolicious
Msrabot MolokaiBot
Mr.4x3
Musobot Musobot
NICErsPRO Name Intelligence
NPbot Nameprotect
Navroad
Needle Needle
Nessus Net Vampire
NetZIP NextGenSearchBot
Netcraft Nibbler
Netvibes Nikto
NimbleCrawler Nmap
Nutch
Octopus Octopus
Offline Explorer OnCrawl
OpenLinkProfiler OutfoxBot
OpenVAS Page Analyzer
Openvas PageGrabber
PHPCrawl PageScorer
PageThing.com
Panscient
Papa Foto Papa Foto
Pavuk Pavuk
Picscout Picsearch
PictureFinder PictureFinder
Piepmatz Piepmatz
Pimonster Pimonster
PleaseCrawl Pixray
Pockey ProWebWalker
Probethenet Probethenet
Pump PyCurl
PxBroker Quick-Crawler
RankActive RSSingBot
RankActiveLinkBot
RankingBot2
Rankivabot
RankurBot RankurBot
RebelMouse RealDownload
Recorder Reaper
RedesScrapy Ripper
Rogerbot SBIder
SEOkicks SEOkicks
SEOkicks-Robot
SEOlyticsCrawler SEOlyticsCrawler
SEOstats SISTRIX
SMTBot SalesIntelligent
ScanAlert
Scanbot
ScoutJet
ScrepyBot
Searchestate
SearchmetricsBot SearchmetricsBot
SentiBot Seekport
SeoSiteCheckup SemanticJuice
Semrush
SeobilityBot SeobilityBot
Seomoz Seomoz
Shodan Shodan
Site Sucker
SiteLockSpider SiteLockSpider
SiteSnagger
Sitebeam
Siteimprove Siteimprove
Snapbot Sitevigil
SmartDownload
Snake
Snoopy Snoopy
SocialRankIOBot SocialRankIOBot
Sociscraper Sociscraper
SpaceBison Sosospider
Spammen Spammen
SpankBot
Spanner
Spbot Spbot
Spinn3r
SputnikBot SputnikBot
Sqlworm Sqlmap
Sqworm
Sucker Sucker
SuperBot Sucuri
SuperHTTP SurveyBot
Suzuran Szukacz
Swiftbot
T0PHackTeam
T8Abot T8Abot
Teleport Telesphorep
TightTwatBot TheNomad
Tracemyfile
TurnitinBot
TwengaBot
URLy Warning
UnisterBot
Upflow
V-BOT V-BOT
VB Project
Vagabondo Vagabondo
VeriCiteCrawler VelenPublicWebCrawler
VidibleScraper VidibleScraper
Virusdie Virusdie
VoidEYE Voil
Voltron
WBSearchBot WBSearchBot
WISENutbot WEBDAV
WPScan WWW-Collector-E
WWWOFFLE
Wallpapers Wallpapers
WeSEE WallpapersHD
Web Collage
Web Fetch Web Fetch
Web Fuck WebAuto
WebBandit WebBandit
WebEnhancer
WebFetch WebFetch
WebGo IS
WebImageCollector
WebLeacher WebLeacher
WebReaper WebZIP
WebStripper Webster
WebWhacker Whack
Webalta Widow
Webshag
Website Quester
WebsiteQuester
WinHTTrack
Wonderbot
Woobot Woobot
Wotbox Wotbox
Wprecon Xaldon_WebSpider
Xaldon WebSpider Xenu
YoudaoBot
Zermelo Zermelo
Zeus
Zitebot Zitebot
ZmEu archive.org_bot
ZoominfoBot arquivo-web-crawler
ZumBot arquivo.pt
backlink-check
cah.io.community
clark-crawler clark-crawler
crawl.sogou.com
crawler.feedback
crawler4j crawler4j
facebookscraper dataforseo.com
gopher
heritrix heritrix
internetVista monitor
ips-agent ips-agent
isitwp.com
iubenda-radar
linkdexbot linkdexbot
lwp-request lwp-request
lwp-trivial mediawords
meanpathbot
netEstate NE Crawler
oBot
page scorer
plumanalytics plumanalytics
polaris version ripz
probe-image-size scalaj-http
s1z.ru scan.lol
satoristudio.net seobility
serpstatbot
sexsearcher sexsearcher
trendiction.com sitechecker.pro
webgains-bot siteripz
sogouspider
trendiction.de
ubermetrics-technologies.com
voyagerx.com
webmeup-crawler webmeup-crawler
webpros.com webpros.com
x22Mozilla
xpymep1.exe
zgrab zgrab

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
centraletermice.us bradleylive.xyz
fenoyl.batcave.net cornerstone-countertops.com
front.ru drugs-no-rx.info
ge0ip.com falllow.gq
google-liar.ru harmonyglen.us
hetmanship.xyz jackpotchances.com
istizanidineacontrolledsubstance.blogspot.com kleine-titten.biz
sinestesia.host.sk mastershef.club
tsyndicate.com profitfx.online
website-analytics.online stickers-market.ru

920
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
10bet.com 00author.com
1millionusd.xyz 01apple.com
3weekdiet.com 1001desert.com
4kplayer.pl 123any.com
5000-cotydzien.com 4k-player.pl
57883.net 4kepics.com
777-club.ru 4webmasters.org
a.frcls.fr 5tey7463.weebly.com
abbanreddy.com 7a2rnuey1tw9ar.ru
actices.com 7makemoneyonline.com
adclickservice.com 8si.ru
addray.pro a96527gi.beget.tech
addtoadd.men aad1f4acb0a373420d9b0c4202d38d94fa.com
adhome.biz aadroid.net
adloads.com acmebtn.ml
adf.ly
adinterax.com
adnotbad.com
adservme.com adservme.com
adtech.fr adsland.men
advertisingtag.net advocatemsk.ru
airmaxshoes-2016.com aibolita.com
albuteroli.com albuteroli.com
alibestsale.com allforminecraft.ru
all4wap.ru
allnews.md allnews.md
alyeskaresort.com allstatesugarbowl.org
amospalla.es alltheviews.com
anabolics.shop alphacarolinas.com
angry-fermi-7633.arukascloud.io amateurgalls.com
apartment.ru amateurmatch.com
android-style.com
angigreene.com
animal-drawings.com
anjalika.co.in
apessay.com
apibatbrowsecom-a.akamaihd.net
apiitsthirteende-a.akamaihd.net apiitsthirteende-a.akamaihd.net
apimossnetinfo-a.akamaihd.net apilinkswiftco-a.akamaihd.net
apioutoboxnet-a.akamaihd.net apioutoboxnet-a.akamaihd.net
apple.com-webbrowsing-security.science appfixing.space
architecturebest.com asiavirtualsolutions.com
arendakvartir.kz atdedinotuho.tk
articlesdirectoryme.info ausmepa.org.au
atout-energie-69.com aussie-prizes.com
audiofree.ru
auto-zapchasti.org auto-zapchasti.org
autobrennero.it
autoloans.com
autoua.top
aviav.org
avon-ukraine.com
avtoarenda.by avtoarenda.by
avtocredit-legko.ru azbukadiets.ru
b-styles.xyz bad-stars.net
b2b-lounge.com baikaleminer.com
backlink4u.net balkanfarma.ru
bank.uz balook.com
bang-hotties.com
banksrf.ru
baoxaydung.com.vn baoxaydung.com.vn
bcmp.org beachtoday.ru
beachfix.co belinvestdom.by
berdasovivan.ru belsetirehafi.tk
best-way.men best-way.men
bget.ru bestprofits-there.com
big-boards.info bestwaystogetpaid.us
biteg.xyz bet365.com
bizcheapjerseyswholesalechina.com betshuckclean.com
biznesluxe.ru bezlimitko.xyz
bjorkbacken.nu bigpictures.club
blackhatworth.com bio.trade-jp.net
bloke.com birzha-truda.eu
boanonihaca.tk blackle.com
bmw-ark.ru
boc.kz boc.kz
bocoarchives.org brainsandeggs.blogspot.com
bolitgorlo.net brus.city
bonvillan.com bumascloset.com
boom-celebs.com buypuppies.ca
brateg.xyz bvlgaribracelet.xyz
bronzeaid-a.akamaihd.net
brothers-smaller.ru
builtwith.com
bukleteg.xyz
bumble.cheapwebsitehoster.com
businesxxl.com
cakemediahq.com.au
calcularpagerank.com
callmd5map.com callmd5map.com
camdenmemorials.com camdolls.com
canacopegdl.com candcstuccoandstone.com
candycrushshop.com candelluxsklep.pl
canzoni.ru carapics.com
cartierreplica.pw cartierlove2u.com
casinopinup-wins.com cartiertrinity.xyz
catalogs-parts.com cascadelink.org
cbcseward.com cashonads.com
cejewelry.xyz castingbank.ru
ccjp.eu
cdnnetwok.xyz
cenokos.ru
centre-indigo.org.ua
cercacamion.it cercacamion.it
check-this-out-now.online chastnoeporno.com
checktext.org chatroulette.online
cialis-samples.com chcu.net
claytransformations.info cheapmoncler.pw
clean-start.net chinaelitecheapjerseys.com
clickintext.net christianlouboutinsaleonline.us
club-lukojl.ru chuckguilford.com
coindirect.io cialisovercounteratwalmartusa.com
compliance-don.top clash-clans.ru
compliance-george.xyz compliance-donald.xyz
compliance-irvin.xyz compliance-elena.xyz
compliance-ivan.top compliance-olga.top
compliance-jack.top contentsexpress.com
compliance-jessica.top coop-gamers.ru
compliance-walter.top counciltally.com
conboy.us courtshipgift.com
coolwallpapers4k.info crest3d.ru
countbertwistdisp26.soup.io culturevie.info
countercrazy.com daptravel.com
cowblog.fr darkages.info
credit-online.ws dating-time-now.com
cv.wallhade.co datract.com
d0t.ru daymusam.com
dafatiri.com decoratinghomes.ga
danceuniverse.ru delayreferat.ru
dangphoto.trade den-noch24.ru
daretodonate.co depositfiles-porn.ga
darmebel.com.ua deshevo-nedorogo.ru
darodar.com design-ideas.info
data-mining.tk design-lands.ru
data.vtc.pw detki-opt.ru
dataloading.net detmebel.su
dbmkfhqk.bloger.index.hr deutschland123.de
dealwifi.com dieta-personalna.pl
detoxmed24.ru dignitasdata.se
detskie-konstruktory.ru
digest-project.ru
digital-sale.su
dikx.gdn
dimaka.info
diminishedvalueoforegon.com diminishedvalueoforegon.com
diusyawiga.tk discountliv.com
dneprsvet.com.ua discovertreasure-a.akamaihd.net
dominateforex.ml domain.webkeyit.com
dostavimvdom.ru donna7753191.ru
doublepimp.com downloadkakaotalk.com
downloadmefiranaratb1972.xpg.com.br doxyporno.com
drhomes.biz drillsaw.ru
droidlook.net dtm-spain.com
druzhbany.ru
dtnlyss.com dtnlyss.com
e-avon.ru duawitchrarato.tk
e-c.al dwomlink.info
eachdayisagift.review dynainbox.com
earncash.com.ua e-biznes.info
easycommerce.cf eandsgallery.com
educatemetv.com
eduserver.net
eets.net
eksprognoz.ru
elektrischezi.canalblog.com elektrischezi.canalblog.com
elektrischezigaretten2.beeplog.com elektrozigaretten1.postbit.com
elektronischezigarettekaufen1.beeplog.com elmifarhangi.com
englate.com empathica.com
eropho.net
erot.co erot.co
essayassist.com erotikstories.ru
exdocsfiles.com essayservicewriting.org
extremepornos.net etenininrade.ga
ezigarettenkaufen2.dreamwidth.org eupornstar.info
fanrto.com europages.com.ru
evaashop.ru
evening-dating-club.info
exoclick.com
expdom.com
expertnaya-ocenka.ru
extremal-blog.com
eywords-monitoring-your-success.com
ezaz.info
ezigarettekaufen1.hpage.com
face.hostingx.eu
faracontrol.ir faracontrol.ir
fashion.stellaconstance.co fast-wordpress-start.com
fashionavenuegame.com fermersovet.ru
favoritemoney.ru find1friend.com
fetroshok.ru findsexguide.com
filmetricsasia.com finstroy.net
fishingwholesale.us flirt4free.com
florida-tourism.net forum20.smailik.org
fok.nl foto-weinberger.at
forex21.ru franch.info
forum.doctissimo.fr free-floating-buttons.com
free-fb-traffic.com freecamdollars.com
free-traffic.xyz freefoto.ca
freenom.link fuckingawesome.com
froggytube.com funnel.co.za
g33.org funponsel.com
game300.ru
gamebackyard.com gamebackyard.com
gembird.com gameonasia.com
gettpromos.com gaz-voshod.ru
girlsatgames.ru gearcraft.us
gkvector.ru germes-trans.com
glopages.ru get-your-social-buttons.info
go2album.com getdot.ru
go2mike.ru getmyads24.com
googlefeud.com gigapeta.com
goroda-vsego-mira.ru girlsfuckdick.com
gorodservis.ru glcomputers.ru
greatfind-a.akamaihd.net gojiberriess.apishops.ru
greenshop.su goodprotein.ru
guidefs.ru greatgrace.ru
guildebzh.info greenidesign.co
gwebtools.com.br gribkovye-zabolevaniya.com
handicapvansarea.com grizzlysgrill.com
hawaiisurf.com habermetre.com
hdpixion.com hdseriale.pl
health-medical-portal.info hkladys.com
heartofpayne.xyz host-protection.com
help.tpu.ru hostnow.men
hitcpm.com hotkeys.com
hobbyhuren-datenbank.com hoverboard360.at
hotel-mkad.ru howlongdoestizanidinestayinyoursystem.blogspot.com
hotxnights.info htmlcorner.com
house.sieraddns.com hunterboots.online
hundejo.com hunthillfarmtrust.org
i-service.kz iamsport.org
i4track.net ico.re
ideashome.id ictizanidinehcl4mg.blogspot.com
ie.57883.net ie.57883.net
ifirestarter.ru ilte.info
igadgetsworld.com images.gyffu.com
inbabes.sexushost.com imagez.co
infazavr.ru impisr.edunsk.ru
infodocsportal.com inboxdollars.com
innoslicon.com infospot.pt
insta-add.pro infoupdate.org
instakink.com intermesh.net
intelhdgraphicsgtdrive6w.metroblog.com intimshop-fantasy.ru
intim-uslugi.info iplogger.org
investsuccess.org ivanstroi.ru
itag.pw ivearchenceinflu.cf
iwantmyfreecash.com izoll.ru
janavibekken.no janettabridal.com
javidol.site javrip.net
jovencitas.gratis jbl-charge.info
justprofit.xyz jerseyschinabizwholesale.us
kadashihotel.com joingames.org
kandidos.com justbcause.com
karaganda.xkaz.org kamalsinha.com
kazrent.com kamen-e.ru
keywordteam.net kanimage.com
kino-rf.ru karachev-city.ru
kinogolos.ru keywordsuggests.com
kinopolet.net khadastoafarde.tk
kleine-titten.biz
klitimg.pw
klosetkitten.com
kndxbkdx.bloger.index.hr kndxbkdx.bloger.index.hr
kollesa.ru knowsitall.info
konturkrasoty.ru kollekcioner.ru
kotaku.com koptims.tiu.ru
kumuk.info kovesszucs.atw.hu
kupiproday.com.ua krasivoe-hd.com
kvartir-remont.biz krasivoe-hd.net
lacapilla.info la-fa.ru
laxob.com laptop-4-less.com
laudit.ru
le-clos-des-alouettes.com le-clos-des-alouettes.com
letmacwork.world lineshops.biz
lexiangwan.com lion.conboy.us
liffa.ru liran-locks.com
limads.men liveinternet.ro
lincolntheatre.com loginduepunti.it
lion.snapmap.us ltvperf.com
liumimgx.pw
lkbennettoutlet.online
lkbennettstore.online
loadingpages.me
loadopia.com
lodki-pvh.dp.ua
loftdigital.eu
lolnex.us
lonfon.xyz
lordzfilmz.me
lost-alpha.ru
lunchrock.co
lyrster.com
m-google.xyz m-google.xyz
machicon-ueno.info m.b00kmarks.com
magazin-pics.ru magda-gadalka.ru
magiadinamibia.blogspot.com magnetic-bracelets.ru
magicdiet.gq masthopehomes.com
malwareremovalcenter.com meccadumps.net
manipulyator-peterburg.ru medicinacom.ru
marmotstore.online
mcnamaratech.com
mediafresh.online
mediawhirl.net
medkritika.ru
megaindex.ru megaindex.ru
metallosajding.ru menetie.ru
michellblog.online menstennisforums.com
mikozstop.com metafilter.com
misterjtbarbers.com methodsmarketing.com
mmgq.ru michaelkorsoutletstore.net
mowser.com minecraft-rus.org
mrlmedia.net miniature.io
mug-na-chas-moscow.ru missis.top
mixed-wrestling.ru
mjchamonix.org
mnimmigrantrights.net
mobile.ok.ru
moivestiy.biz
monclerjacketsoutlet.pw
monclervests.xyz
monitorwebsitespeed.com
moscow.xrus.org
mosdverka.ru
mouselink.co
mrbojikobi4.biz
muabancantho.info
mybackgroundlandscape.blogspot.com mybackgroundlandscape.blogspot.com
mydownloadengine.com myblogregistercm.tk
myfreecams.com myseoconsultant.com
myfreemp3.eu mywallpaper.top
nardulan.com naperehresti.info
neobux-bg.info narkologiya-belgorod.ru
newsperuse.com natali-forex.com
nisuturnetdgu.tk naturalpharm.com.ua
nofreezingmac.click neks.info
notebook-pro.ru netpics.org
nrjmobile.fr news-readers.ru
nyfinance.ml nicovideo.jp
o-o-11-o-o.com njpalletremoval.com
obiavo.kz nmrk.ru
oconto.ru nodding-passion.tk
odoratus.net nordstar.pro
offers.bycontext.com notfastfood.ru
one-gear.com noumeda.com
oneshotdate.com novgorod.xrus.org
onlywoman.org o-o-6-o-o.com
ontargetseo.us obnal.org
onthemarch.co offergroup.info
ok-ua.info
okmusic.jp
oksrv.com
onlinewritingjobs17.blogspot.ru
onlyporno.ru
ooomeru.ru
openmultipleurl.com
optibuymac.com
optom-deshevo.ru
oralsexfilme.net
orgasmatrix.com orgasmatrix.com
osnova3.ru ostroike.org
outrageousdeal-a.akamaihd.net paccohichetoti.ml
ozoz.it pagesense.com
paceform.com panchro.xyz
panchro.co.uk papasdelivery.ru
partner-cdn.men parajumpersoutlet.online
partner-high.men partnersafe.men
partner-host.men pc-virus-d0l92j2.pw
partner-pop.men perederni.net
partybunny.ru perosan.com
pc-services.ru perso.wanadoo.es
perm-profnastil.ru petitions.whitehouse.gov
petedrummond.com petrovka-online.com
photo-clip.ru
phuketscreen.com
picturesboss.com picturesboss.com
pinkduck.ga pio.polytopesexempt.com
pipki.r.acdnpro.com pizdeishn.com
pirateday.ru plastgran.com
piter.xrus.org platesauto.com
pizza-tycoon.com play-movie.pl
pk-pomosch.ru podshipniki-ntn.ru
plaff-go.ru popup.matchmaker.com
plastweb.ru porno-raskazy.ru
poffet.net pornoblood.com
popup-hgd.xyz pornoklad.net
porn555.com pornolook.net
porno-chaman.info pornzone.tv
pornoforadult.com postclass.com
pornoplen.com prefersurvey.net
pospr.waw.pl printie.com
powc.r.ca.d.sendibm2.com projectforte.ru
pp-budpostach.com.ua prom23.ru
priscilarodrigues.com.br prostitutki-tyumeni.org
prizeestates.cricket putevka24.ru
promoheads.com quickchange.cc
proposal-engine.com ranksonic.info
push-ad.com rcpmda.ikan1080.xyz
puteshestvennik.com reeyanaturopathy.com
putitin.me relatodelpresente.com.ar
quangcaons.com remote-dba.de
rabotaetvse.ru ringporno.com
randalljhoward.com robot-forex.biz
rankingchart.de rockprogblog.com
rankscanner.com rossmark.ru
ranksonic.com ru-dety.ru
razamicroelectronics.com ruscopybook.com
razyboard.com rusoft-zone.ru
rczhan.com ruspdd.com
registrationdomainsite.com saletool.ru
remmling.de sammlungfotos.online
replica-watch.ru sanyuprojects.com
restorator-msk.ru saugatuck.com
rocketchange.ru
rogervivierforsale.com
roleforum.ru
roll123.com
running-line.ru
rus-pornuha.com
rusvideos.su
saecsa.co
sajatvelemeny.com
santasgift.ml
sbf441.com sbf441.com
sbwealthsolutions.ca sbricur.com
scanner-willy.top sbt-aqua.ru
scanner-barak.top
scanner-elena.top
scanner-fred.top
scanner-jess.top
scanner-john.top
scanspyware.net scanspyware.net
sdelatmebel.ru sdsjweb.com
se-welding.ru se-welding.ru
seansonline24.pl search.xtconnect.com
segol.tv seasaltwithfood.com
semprofile.com seonetwizard.com
seo-prof1.xyz seorankinglinks.com
seoboxes.com sergiorossistore.online
seofirmreviewsus.info serialsway.ucoz.ru
seogadget.ru sevendays.com.ua
seokicks.de
sexcamamateurchat.com
sexflirtbook.com sexflirtbook.com
sexiporno.net sexphoto.site
sexvideo-sex.com sexvideo-sex.com
shemale-sex.net shemale-sex.net
shillyourcoins.com ship-marvel.co.ua
shoesonlinebuy.cn shop.acim.org
signal03.ru shopfishing.com.ua
sisi-go.ru shopsellcardsdumps.com
sisiynas.ru silvermature.net
site-analyzer.com sim-service.net
smallseotools.com site.ru
siteripz.net
sitevaluation.com
sitiz.club
slavia.info
sneakyboy.com
soc-econom-problems.ru soc-econom-problems.ru
social-buttons.com
social-s-iii.xyz
social-vestnik.ru social-vestnik.ru
socialbookmarksubmission.org sortthemesitesby.com
socialmonkee.com
soietvousmaime.fr
solinf.co
sosdepotdebilan.com sosdepotdebilan.com
soserfis.com sstroy44.ru
souvenirua.com stop-zavisimost.com
spitfiremusic.com stretchingabuckblog.com
spl63.fr stretchmate.net
stariy-baku.com stroy-portal22.ru
stmassage.ru students-cheapskate.ml
stpicks.com
stroimajor.ru
subj.ukr-lit.com
sudexpert66.ru
suhanpacktech.com suhanpacktech.com
sukarame.net supernew.org
summerlinhomes411.info svtrd.com
surintech.ac.th syndicate.fun
swinger-mobil.net t3chtonic.com
tacbelarus.ru taqplayer.info
tattooha.com theendivechronicles.com
tdsing.ru thejournal.ru
tedxrj.com theprofitsmaker.net
telefonsexsofort.tk thesmartsearch.net
theallgirlarcade.com
theguardlan.com
theporndude.com
thexart.club thexart.club
tiandeural.ru timecrimea.ru
tizanidineandhydrocodone.blogspot.com tizanidine4mgprice.blogspot.com
tizanidinedosage.blogspot.com tizanidineinteractions.blogspot.com
tizanidineshowupondrugtest.blogspot.com tobeyouday.win
tizanidinewithdrawalsymptoms.blogspot.com tootoo.to
toloka.hurtom.com touchmods.fr
topsiteminecraft.com tozup.com
topvidos.ru tradedeals.biz
tour-line.net trafficcentr.xyz
trafficshaper.com traffique.net
traffmonster.info tramadolandtizanidine.blogspot.com
truck-rece.life triumf-realty.ru
trucri.me truemfilelj.gq
tupper-shop.ru tt-ipd.info
ultimateclassicrock.com ttrraacckkrr.com
umg-stroy.ru tuberkulezanet.ru
undergroundcityphoto.com tuckpointingmasonrysystems.com
unisexjewelry.org tupper-posuda.ru
unmaroll.ya.ru typer.one
uptime.com umekana.ru
urengoy.pro underthesite.com
vabasa.inwtrade.com uptime-delta.net
vandrie-ict.nl upupa.net
varikozdok.ru url-extractor.xyz
vegascosmetics.ru urlcut.ru
velen.io urll.eu
veles.shop uzporno.mobi
venerologiya.com valsalud.com
veopornogratis.xxx vedomstvo.net
viddyoze.com vgoloveboli.net
video-hollywood.ru viagra.pp.ua
videochat.life villakohlanta.nu
videos-for-your-business.com vipps.com.my
virtuagirl.com vita.com.hr
vizitki.net vmnmvzsmn.over-blog.com
vonradio.com voloo.ru
vote-up.ru
vseigry.fun vseigry.fun
vtcdns.com vucms.com
vut.com.ru vzubah.com
wallpaperaccess.com w3javascript.com
wapsite.me we-are-gamers.com
webkeyit.com webinstantservice.com
website-analytics.online weekes.biz.tc
website-analyzer.info westen-z.life
wechatdownload10.com whatistizanidinehclusedfor.blogspot.com
weightatraining.com wholesalenfljerseys.us.com
wejdz-tu.pl wiosenny-bon-1500.pl
wholesalejerseychinaoutlet.com world-mmo.com
williamrobsonproperty.com woweb.com.ua
wonderfulflowers.biz wpsecurity.website
wordkeyhelper.com writersgroup580.web.fc2.com
wovis.site wrona.it
wufak.com wwwadultcheck.com
wzgyyq.com xclicks.net
x-mix.info xn----itbeirbjbi7bc6bh2d.xn--p1ai
xaijo.com xn--80aebbcbcdemfkhba4byaehoejh8dza3v.xn--p1ai
xn----8sbarihbihxpxqgaf0g1e.xn--80adxhks xn--80ajbshivpvn2i.xn--p1ai
xn----8sblgmbj1a1bk8l.xn----161-4vemb6cjl7anbaea3afninj.xn--p1ai xn--90acenikpebbdd4f6d.xn--p1ai
xn--80aaajbdbddwj2alwjieei2afr3v.xn--p1ai xtraffic.plus
xn--h1ahbi.com.ua xtrafficplus.com
xn--hxazdsfy.blogspot.com xtubeporno.net
xnxxandxvideos.com
xvideosbay.com xvideosbay.com
yebocasino.com yaoguangdj.com
youbloodyripper.com yatrk.xyz
youradexchange.com yes-com.com
ytmnd.com yogamatsexpert.com
yuarra.pluto.ro you-shall-not-pass.is74.ru
yunque.pluto.ro youbrainboost.asia
zakazvzloma.com youdesigner.kz
zaloro.com yur-p.ru
zarabotat-na-sajte.ru zarajbuilders.com
zigarettenonl.canalblog.com znakomstva-moskva77.ru
zirondelli.it
zkjovpdgxivg.ga
zolotoy-lis.ru zolotoy-lis.ru
zrus.org zoominfo.com

488
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
10bet.com
123movies.love
1adult.com
1hwy.com
214jaluwobapef.cf 214jaluwobapef.cf
24x7-server-support.site 3rbseyes.com
404.mn 3w24.com
991mostfm.co.id 4inn.ru
9med.net 5forex.ru
abcdefh.xyz 888.com
acheterviagrafr24.com adsland.men
adhome.biz adventureparkcostarica.com
adloads.net affordablewebsitesandmobileapps.com
advancedsoftwaresupport.com ahhjf.com
afmuseum.com air-edem.ru
alpharma.net alice.it
am-se.com amazingninja.com
am15.net anonymizeme.pro
amateurmatch.com apccargo.com
animalrank.com artparquet.ru
apiadanaknet-a.akamaihd.net atlant-auto.info
appfastplay.com atovh.local-finders.com
apxeo.info autoblogger24.info
arewater.com azartmsl.com
asseenontv.ru babosas.com
australia-opening-times.com bankofthewext.com
avtochehli.by beauty-bracelet.com
backuperwebcam.weebly.com belinka.com.ua
bad-stars.net bestpriceninja.com
bagcionderlab.com bio-optomarket.ru
bannerads.de bitcoin-ua.top
biglistofwebsites.com bjgugu.net.ua
bioca.org bristolhotel.com.ua
bloggedporn.com browserprotecter.com
bloglag.com burn-fat.ga
board.f00d.de buscarfoto.com
bolegapakistan.com candycrushshop.com
bonanza-fortune.men cardsharp1.ru
boobsimge.com cartierlove.xyz
brainzpod.win cheapjerseysfootballshop.com
brandimensions.com cialischmrx.com
brokergid.ru cialiswithoutadoctor.net
business-made-fun.com cineacademy.ru
buypuppies.ca citysecurity.nu
buzzzg.men clips.ua.ac.be
c1.onedmp.com compliance-barak.xyz
carmuffler.net compliance-checker-7.info
cartierjusteunclou.xyz compliance-george.top
ccjp.eu cookie-law-enforcement-aa.xyz
cdn.walkme.com counter.yadro.ru
centrumcoachingu.com covid-schutzmasken.de
ceotrk.com crest3d.ru
cercacamion.it cv.wallhade.co
chatroulette.online data.vtc.pw
chidporn.com directivepub.com
ci.ua dorratex.tn
cleanersoft.com download-wallpaper.net
clevernt.com droidlook.net
club-musics.ru drunkenstepfather.com
cocolyze.com e-poker-2005.com
compliance-josh.top edwinkonijn.com.au
cookie-law-enforcement-ff.xyz elmacho.xyz
counterbot.com enskedesquashclub.se
cryptoswap.biz etotupo.ru
demian.kz exoclick.com
design-lands.ru expolicenciaslatam.co
destinationrealestate.com ezigarettenkaufen1.deviantart.com
detective01.ru f07.de
diy-handmade-ideas.com factorynightclub.com
dlya-android.org famix.xyz
domik-derevne.ru fearcrow.com
downloads-whatsapp.com fermersovet.ru
eduinfosite.com filkhbr.com
electricwheelchairsarea.com filmania-x.ru
empirepoker.com fivedwld.cf
eralph.tk flex4launch.ru
evidencecleanergold.com foodgid.net
failingmarriege.blogspot.com foxjuegos.com
fandlr.com fym.com.ru
fbdownloader.com galaxy-family.ru
fetroshok.ru galeria-zdjec.com
filmi-v.online gate5.co.za
findanysex.com get-free-social-traffic.com
free-gluten.ru ggiaro.com
free-traffic.xyz given2.com
freenode.info glavprofit.ru
freshmac.space globetrotting-culture.ru
gallerylisting.com gogps.me
ge0ip.org gonextmedia.com
girlgamerdaily.com graphid.com
gkvector.ru greatdealshop.com
gloverid.site hauleddes.com
gnuetella.com hausfrauensex18.com
go2jump.org hccoder.info
gotomontenegro.net hentaiheroes.com
growboxbl.ru histats.com
gstatey.net hostnow.men
gta-top.ru hotblognetwork.com
gwagka.com hotenergy.ru
gwhwpxbw.bloger.index.hr
hentai-manga.porn
hit-men.men
hmmm.cz
home-task.com
hoste.octopis.com
hoverboardforsaledirect.com
hully.altervista.org
hustoon.over-blog.com
hydropump.su hydropump.su
hyhj.info ideawheel.com
i-hobot.ru ilovevitaly.ru
icaseclub.ru ilovevitaly.xyz
igithab.com imabase.com
igru-xbox.net indo-export.ru
iminent.com iron-age.info
infobanks.ru isistaylorporn.info
infokonkurs.ru istripper.com
investpamm.ru jerseywholesalechinabiz.com
istizanidineanarcoticdrug.blogspot.com jobmarket.com.ua
jrpmakati.com jpcycles.com
jwss.cc kaac.ru
kaidalibor.de kamagragelusa.net
keywordsdoctor.com keki.info
kichenaid.ru kongruan.com
kiinomaniak.pl kosynka-games.ru
klikbonus.com kotaku.com
klosetkitten.com kriokomora.info
konkursov.net lafriore.ru
kosmetyki.tm.pl ledis.top
lapitec.eu lenvred.org
leboard.ru liumimgx.pw
lecbter-relationships.ga lsex.xyz
levaquin750mg.blogspot.com luxmagazine.cf
lider-zhaluzi.kiev.ua magnetic-bracelets.ru
lineshops.biz malwareremovalcenter.com
lolnex.us
lookingglassemb.com
lovasszovetseg.hu
macresource.co.uk
magda-gadalka.ru
magicalfind-a.akamaihd.net
magicdiet.gq
manifestyourmillion.com manifestyourmillion.com
mcnamaratech.com mebel-vstroika.ru
mecash.ru metafilter.com
meccadumps.net miniature.io
medmajor.ru mriyadh.com
mexicosleevegastrectomy.com mttwtrack.com
middlerush-a.akamaihd.net music.utrolive.ru
mir-business-24.ru mydoctorok.ru
mir-limuzinov.ru myghillie.info
misandesign.se myxdate.info
mmofreegames.online narkologiya-peterburg.ru
mnogabukaff.net national-today-winning-winner.club
moinozhki.com next-dentists.tk
musirc.com notasprensa.info
mydearest.co nufaq.com
mydownloadengine.com o-o-6-o-o.ru
myiptest.com oconto.ru
myshopmatemac.com onlinedomains.ru
nash-krym.info onlyporno.ru
navalwiki.info onlywoman.org
neodownload.webcam outclicks.net
nootrino.com oynat.info
o-dachnik.ru paydayloanslocal.com
olvanto.ru photosaga.info
openstat.com photostudiolightings.com
optom-deshevo.ru picturesfrom.com
orhonit.com
ossmalta.com
oyster-green.com
palocco.it
paphoselectricianandplumber.com
pattersonsweb.com
pc4download.co
pcboa.se
pinwallpaper.top pinwallpaper.top
pirateday.ru pochtovyi-index.ru
piulatte.cz pons-presse.com
porngalleries.top popcash.net
pornofiljmi.com pornolook.net
portnoff.od.ua pornoslive.net
predominant-invent.tk pornpost.in
preventheadacheguide.info privacylocationforloc.com
prizesbook.online privat-girl.net
pro-okis.ru
prom23.ru
pronorm.fr
prostitutki-odessa.org
psa48.ru
pukaporn.com pukaporn.com
radiogambling.com qitt.ru
rapidsites.pro ragecash.com
refererx.com reimageplus.com
remmling.de rostov.xrus.org
renhacklids.tk royal-betting.net
rentehno.ru rrutw.com
riders.ro sabizonline.com
rn-to-bsn.com sack.net
rock-cafe.info satoristudio.net
runofilms.ru scanmyphones.com
sa-live.com scanner-elena.top
saletool.ru scanner-margo.top
savefrom.com scanner-walter.top
scmor.ilxc.cc school-diplomat.ru
searchwebknow-a.akamaihd.net sdelai-prosto.ru
seeingmeerkat.com secret.xn--oogle-wmc.com
sexflirtbook.com securesmrt-dt.com
sexkvartal.com selectads.men
shinikiev.com.ua semaltmedia.com
site-speed-check.site semxiu.com
skincrate.net sex-tracker.de
slavkokacunko.de sexfreepornoxxx.com
small-game.com shama-rc.net
small-games.biz shopcheermakeup.info
songplanet.ru shoppingmiracles.co.uk
sosdepotdebilan.com sirpornogratis.xxx
spin2016.cf site-auditor.online
stackthatbucks.com siteimprove.com
starpages.net siteripz.net
strigkaomsk.ru sizeplus.work
supernew.org slomm.ru
tackletarts.co smichovbike.cz
talant-factory.ru smsactivator.ru
telefonsexi.com social-button.xyz
thedownloadfromwarez.blogspot.com spammen.de
thefarmergame.com spanking.to
titelhelden.eu special-porn.com
tizanidineingredients.blogspot.com spy-sts.com
tjkckpytpnje.com stardevine.com
top-deal.com.pl staynplay.net
traffic100.com stefanbakosab.se
tt-ipd.info svolze.com
turbodsp.com svtrd.com
tv-spoty.info t3chtonic.com
tytoona.com taboola.com
tamada69.com
themestotal.com
tizanidinedrugtest.blogspot.com
tizanidineforopiatewithdrawal.blogspot.com
tizanidinerestlesslegsyndrome.blogspot.com
tizanidinevssoma.blogspot.com
tizanidinevsvalium.blogspot.com
top1-seo-service.com
topflownews.com
tozup.com
trafficfactory.biz
turist-strani.ru
ufa.xrus.org
ugogo.info ugogo.info
ukrtvir.com.ua unblocksit.es
ultimatesetnewfreeallsoftupgradesystems.pw unisexjewelry.org
unionmarkt.de uogonline.com
uroffer.link usacasino.com
usiad.net via-energy-order.com
valuado.com viagengrarx.com
videochat.mx vip.51.la
w3data.co vzlom-na-zakaz.com
warningwar.ru waterpurifier.club
we-are-gamers.com webmasterhome.cn
web-analytics.date weekes.biz.tc
websiteaccountant.de wholesalejerseychinaoutlet.com
whatistizanidine2mg.blogspot.com wholesalejerseychinashop.com
wonderfulflowers.biz winx-play.ru
x-porno.video woman-h.ru
xn----8sbarihbihxpxqgaf0g1e.xn--80adxhks wordpress-crew.net
xn--e1aggki3c.xn--80adxhks xn----7sbbagbq7bd5aheftfllo4m.xn--p1ai
xn--h1aakne2ba.xn--p1ai xxxasianporn.net
yoursite.com y8games-free.com
zaidia.xhost.ro yellowstonesafaritours.com
zskdla.site yourdesires.ru
zzbroya.com.ua yourothersite.com
zarabiaj-dzis.pl
zhacker.net

167
dev-tools/test_units/ratelimittest-beta.txt
View file

@ -8,6 +8,86 @@
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html>ml>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html><html> </html><html>
<head><title>503 Service Temporarily Unavailable</title></head> <head><title>503 Service Temporarily Unavailable</title></head>
<body> <body>
@ -414,83 +494,6 @@
<hr><center>nginx/1.18.0 (Ubuntu)</center> <hr><center>nginx/1.18.0 (Ubuntu)</center>
</body> </body>
</html> </html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<!DOCTYPE html> <!DOCTYPE html>
<html> <html>
<head> <head>
@ -581,14 +584,4 @@
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html> </html>

10
dev-tools/test_units/ratelimittest-master.txt
View file

@ -581,4 +581,14 @@
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html> </html>

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.38.0 0; 10.1.1.87 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2023.02.3583 ### Version: V4.2023.02.3584
### Updated: Mon Feb 20 22:01:18 UTC 2023 ### Updated: Tue Feb 21 10:03:29 UTC 2023
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2023.02.3583 ### Version: V4.2023.02.3584
### Updated: Mon Feb 20 22:01:18 UTC 2023 ### Updated: Tue Feb 21 10:03:29 UTC 2023
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##