vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-10 06:15:06 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2022.05.3121 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2022-05-22 22:07:14 +00:00
parent 5291a6adbf
commit 11eb7d6e37
47 changed files with 105288 additions and 105285 deletions
Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.05.3120 #### Version: V4.2022.05.3121
#### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.05.3120 #### Version: V4.2022.05.3121
#### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -14,7 +14,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2022.05.3120 #### Version: V4.2022.05.3121
#### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

13022
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2022.05.3120 #### Version: V4.2022.05.3121
#### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

13026
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

13026
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

13026
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

13026
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.134 1; 10.1.0.229 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.134 0; 10.1.0.229 0;
127.0.0.1 0; 127.0.0.1 0;

13026
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.134 1; 10.1.0.229 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.134 0; 10.1.0.229 0;
127.0.0.1 0; 127.0.0.1 0;

13026
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.134 1; 10.1.0.229 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.134 0; 10.1.0.229 0;
127.0.0.1 0; 127.0.0.1 0;

13026
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
3120 3121

13026
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

13026
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.246.10.203 0; 20.106.122.88 0;

13026
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.134 1; 10.1.0.229 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.134 0; 10.1.0.229 0;
127.0.0.1 0; 127.0.0.1 0;

13026
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.134 1; 10.1.0.229 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.134 0; 10.1.0.229 0;
127.0.0.1 0; 127.0.0.1 0;

13026
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.134 1; 10.1.0.229 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.134 0; 10.1.0.229 0;
127.0.0.1 0; 127.0.0.1 0;

13026
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.246.10.203 0; 20.106.122.88 0;

13026
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.246.10.203 0; 20.106.122.88 0;

13026
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.134 1; 10.1.0.229 1;
127.0.0.1 1; 127.0.0.1 1;

18
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
Bigfoot AwarioRssBot
Majestic12 CheTeam
MeanPath Bot Harvest
Shodan LexiBot
Spbot LinksManager
Swiftbot LinqiaMetadataDownloaderBot
VidibleScraper Quick-Crawler
Zauba
oBot oBot
probe-image-size seostar
sp_auditbot

318
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
01h4x.com
Abonti Abonti
Aboundex Aboundex
Aboundexbot Aboundexbot
Acunetix Alligator
AiHitBot
Aipbot
AlphaBot AlphaBot
Anarchy99
Anthill
Aspiegel Aspiegel
BDCbot Asterias
BDFetch Atomseobot
Attach
BBBike
BLEXBot BLEXBot
Backlink-Ceck BackDoorBot
BackStreet
BackWeb
Badass Badass
Bandit BatchFTP
Bitacle Battleztar Bazinga
BetaBot
Bigfoot
Black Hole
BlackWidow BlackWidow
Blow
BlowFish
Boardreader Boardreader
Brandwatch Bolt
BuiltBotTough
BunnySlippers
BuzzSumo
CATExplorador CATExplorador
CCBot CazoodleBot
CODE87
CSHttp
CensysInspect
CheTeam
CheeseBot
CherryPicker
ChinaClaw
Chlooe Chlooe
Claritybot Citoid
Cliqzbot Cliqzbot
Cloud mapping Cloud mapping
Cocolyzebot Cocolyzebot
Copier Copier
Copyscape Copyscape
CyotekWebCopy Cosmos
DBLBot Craftbot
Crescent
Curious
DIIbot
DTS Agent DTS Agent
DatabaseDriverMysqli DataCha0s
Demon Deusu
Devil
Digincore
DigitalPebble DigitalPebble
Dirbuster
Disco Disco
Discobot Discobot
DnBCrawler-Analytics Discoverybot
DnyzBot DittoSpyder
DomCopBot DomCopBot
DomainAppender DomainAppender
DomainCrawler Domains Project
DomainSigmaCrawler Dotbot
Ebingbong ECCP/1.0
Ecxi EMail Siphon
EroCrawler EMail Wolf
Evil EasyDL
Exabot Exabot
Express WebPictures Express WebPictures
ExtLinksBot ExtractorPro
Ezooms Fimap
FyberSpider FlashGet
Flunky
Fyrebot Fyrebot
G-i-g-a-b-o-t
GalaxyBot GalaxyBot
GermCrawler
GetRight
GetWeb
Gigabot Gigabot
Go!Zilla Go-Ahead-Got-It
GrabNet Gotit
HTMLparser Grabber
HTTP::Lite GrapeFX
Heritrix GridBot
HonoluluBot HMView
IDBTE4M Havij
Image Sucker HybridBot
IRLbot
Iblog
Image Fetch
InfoNaviRobot InfoNaviRobot
Intelliseek Intelliseek
InterGET
InternetSeer
Iskanie Iskanie
Jetty JennyBot
JetCar
JikeSpider
Jorgee
JustView JustView
Jyxobot
Keybot Translation-Search-Machine Keybot Translation-Search-Machine
Keyword Density
Kinza Kinza
Kozmosbot Kozmosbot
Larbin LWP::Simple
LeechFTP Lanshanbot
LeechGet
LibWeb
LieBaoFast LieBaoFast
LinkScan LinkpadBot
LinkWalker
LinkextractorPro
LinqiaMetadataDownloaderBot LinqiaMetadataDownloaderBot
LinqiaRSSBot LinqiaRSSBot
Lipperhey LinqiaScrapeBot
Lipperhey Spider
Litemage_walker Litemage_walker
Ltx71
MIDown tool MIDown tool
MJ12bot MQQBrowser
Magnet MSFrontPage
Mag-Net
Majestic-SEO
MarkMonitor MarkMonitor
Mata Hari Mass Downloader
Metauri Masscan
Microsoft URL Control Meanpathbot
Minefield Mediatoolkitbot
MegaIndex.ru
Microsoft Data Access
Mister PiX Mister PiX
Moblie Safari Moblie Safari
MolokaiBot MolokaiBot
Morfeus Fucking Scanner Morfeus Fucking Scanner
Mozlila Mr.4x3
Musobot
NICErsPRO
NPbot NPbot
Name Intelligence Navroad
Nameprotect
NearSite NearSite
Needle Needle
Nessus Nessus
NetLyzer Net Vampire
NetMechanic NetSpider
Nibbler Netcraft
Niki-bot
Nimbostratus Nimbostratus
Nmap Not
Offline Explorer OutclicksBot
OnCrawl OutfoxBot
OpenVAS PECL::HTTP
Openfind PHPCrawl
Openvas
OrangeBot
Page Analyzer Page Analyzer
PageGrabber PageGrabber
PageScorer PageScorer
Panscient Pavuk
Papa Foto PeoplePal
Picsearch Pi-Monster
Piepmatz Picscout
Pixray Pimonster
Pockey ProPowerBot
Psbot ProWebWalker
Pu_iN Probethenet
Pump PxBroker
QueryN Metasearch PyCurl
RSSingBot Quick-Crawler
RankActive
RankFlex RankFlex
RankingBot RankingBot
RankingBot2 Rankivabot
RankurBot RebelMouse
Re-re RepoMonkey
Ripper RocketCrawler
SBIder SBIder
SISTRIX SEOlyticsCrawler
SEOprofiler
SEOstats
SMTBot
SalesIntelligent
ScanAlert
Scanbot Scanbot
ScoutJet
Screaming
ScreenerBot
ScrepyBot ScrepyBot
SearchmetricsBot Searchestate
SemanticJuice Siphon
SentiBot SiteCheckerBotCrawler
Seomoz
SiteLockSpider SiteLockSpider
Siteimprove SiteSucker
SmartDownload SmartDownload
SocialRankIOBot
Sogou web spider Sogou web spider
Sosospider
Sottopop
SpaceBison
SpankBot
Spanner Spanner
SputnikBot Spbot
Sqlworm Spinn3r
Steeler Steeler
Stripper SuperBot
Surfbot SurveyBot
Szukacz Suzuran
T0PHackTeam
T8Abot T8Abot
TeleportPro
Telesoft Telesoft
Telesphoreo The Intraformant
Titan
Toata
Trendictionbot Trendictionbot
TurnitinBot
TwengaBot TwengaBot
URLy Warning Twice
Typhoeus
URLy.Warning
Upflow Upflow
V-BOT V-BOT
VB Project VB Project
VCI VCI
Vacuum VelenPublicWebCrawler
VidibleScraper
Virusdie
VoidEYE VoidEYE
Voil Voil
Voltron Voltron
WASALive-Bot WASALive-Bot
WEBDAV
WWW-Collector-E WWW-Collector-E
WWW::Mechanize WWW::Mechanize
Wallpapers/3.0
WallpapersHD WallpapersHD
WeSEE WeSEE
Web Auto
Web Collage Web Collage
Web Enhancer
Web Fetch
Web Pix
Web Sauger Web Sauger
Web Sucker WebCollage
WebBandit WebCopier
WebFetch WebFuck
WebGo IS
WebLeacher WebLeacher
WebReaper WebPix
WebStripper WebWhacker
WebZIP WebmasterWorldForumBot
Webshag Widow
WebsiteExtractor
WebsiteQuester
Webster
Who.is Bot
Wonderbot
Wprecon
Xaldon_WebSpider
Xenu Xenu
YoudaoBot YoudaoBot
Zade ZoomBot
ZumBot
adscanner
arquivo-web-crawler arquivo-web-crawler
cah.io.community arquivo.pt
coccocbot backlink-check
cognitiveseo check1.exe
com.plumanalytics clark-crawler
evc-batch crawl.sogou.com
crawler.feedback
crawler4j
eCatch
facebookscraper
heritrix
instabid instabid
ips-agent
isitwp.com isitwp.com
linkdexbot iubenda-radar
meanpathbot magpie-crawler
mediawords
muhstik-scan
page scorer page scorer
pcBrowser plumanalytics
polaris version
probe-image-size probe-image-size
ripz satoristudio.net
scalaj-http
seobility
seocompany.store seocompany.store
serpstatbot tAkeOut
sitechecker.pro ubermetrics-technologies.com
voyagerx.com
webmeup-crawler webmeup-crawler
webpros.com webprosbot
x22Mozilla x22Mozilla
zgrab xpymep1.exe
zauba.io

316
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
01h4x.com
ADmantX ADmantX
AIBOT ALittle Client
ASPSeek AhrefsBot
Abonti
Aboundex
Aboundexbot
Acunetix
Aipbot
AllSubmitter AllSubmitter
AlphaBot Anarchie
Anarchy Anarchy
Anarchy99 Anarchy99
Aspiegel Apexoo
BackStreet BBBike
BackWeb BDFetch
Badass BLEXBot
Backlink-Ceck
Bandit Bandit
Barkrowler Barkrowler
BatchFTP BatchFTP
Battleztar Bazinga
BetaBot
Bigfoot Bigfoot
Black Hole
Blow Blow
Boardreader
Bolt Bolt
BotALot BotALot
Brandprotect Brandwatch
Buck
BuiltWith BuiltWith
BuzzSumo BuzzSumo
CATExplorador CATExplorador
CCBot
CODE87 CODE87
CSHttp CazoodleBot
Cegbfeieh Cegbfeieh
CensysInspect CheeseBot
CheTeam CherryPicker
ChinaClaw
Citoid
Claritybot
Cloud mapping Cloud mapping
CopyRightCheck Cocolyzebot
Copyscape Cogentbot
Cosmos
Craftbot Craftbot
Crescent
Curious Curious
CyotekWebCopy CyotekWebCopy
DSearch DBLBot
DTS Agent DTS Agent
DataCha0s
DatabaseDriverMysqli DatabaseDriverMysqli
Deusu Demon
DigitalPebble
Disco Disco
Discobot
Discoverybot
Dispatch
DittoSpyder DittoSpyder
DnBCrawler-Analytics
DomainAppender DomainAppender
Download Wonder DomainStatsBot
Domains Project
Dotbot
Drip Drip
ECCP/1.0
EMail Siphon
EMail Wolf
Ecxi Ecxi
EirGrabber
Evil Evil
ExtLinksBot Exabot
Extractor Express WebPictures
Extreme Picture Finder FHscan
EyeNetIE Fimap
Firefox/7.0 Foobot
Freeuploader
FrontPage
GalaxyBot
GetWeb
Getintent Getintent
Gigabot Gigabot
Go-Ahead-Got-It GoZilla
Gotit
GrabNet GrabNet
Grabber
Grafula Grafula
GrapeshotCrawler GridBot
HTTP::Lite HTMLparser
HybridBot HaosouSpider
Heritrix
IDBTE4M IDBTE4M
IDBot IDBot
Iblog IRLbot
Id-search
IlseBot IlseBot
Image Fetch
Image Sucker
Indy Library Indy Library
Intelliseek InfoNaviRobot
InterGET JamesBOT
InternetSeer JennyBot
Iskanie JetCar
JOC Web Spider Jetty
Jorgee JikeSpider
JustView
Jyxobot
Kenjin Spider Kenjin Spider
Keybot Translation-Search-Machine
Keyword Density
Kinza Kinza
Kozmosbot
LNSpiderguy LNSpiderguy
LeechGet Larbin
LibWeb Leap
LeechFTP
Libwhisker Libwhisker
LieBaoFast Lightspeedsystems
LinkWalker Likse
LinkScan
Linkbot Linkbot
LinkextractorPro LinqiaMetadataDownloaderBot
LinkpadBot
LinksManager
LinqiaRSSBot LinqiaRSSBot
LinqiaScrapeBot Lipperhey Spider
Lipperhey Litemage_walker
Ltx71 Ltx71
MIDown tool
MIIxpc MIIxpc
MQQBrowser
MSIECrawler MSIECrawler
Mag-Net MTRobot
Magnet
Mail.RU_Bot Mail.RU_Bot
Majestic12 Majestic SEO
MarkMonitor Majestic-SEO
MarkWatch
Mass Downloader
Masscan Masscan
Mata Hari
Mb2345Browser
MeanPath Bot MeanPath Bot
Mediatoolkitbot
MicroMessenger MicroMessenger
Minefield Microsoft URL Control
Mister PiX Mojolicious
Mojeek Morfeus Fucking Scanner
Mr.4x3 Msrabot
NICErsPRO NICErsPRO
Nameprotect Name Intelligence
Needle Navroad
Nessus Nessus
NetLyzer Net Vampire
Netcraft NetAnts
Nettrack NetMechanic
Netvibes Netvibes
NextGenSearchBot NimbleCrawler
Niki-bot Nuclei
Nmap Nutch
Not
Octopus Octopus
Offline Explorer OpenLinkProfiler
OpenVAS OrangeBot
Openvas
OrangeSpider OrangeSpider
OutclicksBot OutclicksBot
PageScorer PHPCrawl
PageThing.com POE-Component-Client-HTTP
PageGrabber
Pandalytics Pandalytics
Pavuk Panscient
Papa Foto
PeoplePal
Pi-Monster Pi-Monster
Pimonster Picsearch
ProPowerBot Pixray
Probethenet Pockey
Pu_iN
Pump Pump
Quick-Crawler
RSSingBot RSSingBot
RankActive
RankFlex RankFlex
RankingBot2 RankingBot2
Rankivabot
RankurBot
Re-re
ReGet ReGet
Reaper Reaper
RebelMouse RebelMouse
RepoMonkey Ripper
Rogerbot SMTBot
SBIder ScanAlert
SEOkicks-Robot ScreenerBot
Scrapy Searchestate
SearchmetricsBot SearchmetricsBot
Seekport SiteCheckerBotCrawler
SemanticJuice SiteSnagger
Shodan Sitevigil
SiteExplorer Sogou web spider
SiteLockSpider Spanner
Sitebeam Sqlmap
SmartDownload Steeler
Sociscraper Sucker
Sosospider Suzuran
Sottopop
Sqworm
SuperBot
Swiftbot Swiftbot
Teleport T0PHackTeam
T8Abot
TeleportPro TeleportPro
Telesphoreo
Telesphorep Telesphorep
The Intraformant The Intraformant
Titan
Toata Toata
Tracemyfile Toweyabot
Trendictionbot Turnitin
Turingos
TurnitinBot TurnitinBot
TwengaBot Typhoeus
Twice URLy Warning
Upflow
VB Project
VCI VCI
VidibleScraper VeriCiteCrawler
Virusdie WEBDAV
WBSearchBot WISENutbot
WWW-Collector-E WWW::Mechanize
WWWOFFLE Wallpapers
WallpapersHD Wallpapers/3.0
Web Auto
Web Enhancer
Web Pix Web Pix
Web Sucker Web Sucker
WebAuto
WebCollage
WebCopier
WebFuck
WebImageCollector WebImageCollector
WebSauger WebPix
WebStripper WebReaper
WebSucker WebZIP
WebmasterWorldForumBot
Webshag
Website Quester Website Quester
Widow WebsiteQuester
Webster
Whacker
Whatweb
WinHTTrack
Woobot Woobot
YoudaoBot Wotbox
Zauba Wprecon
Xaldon WebSpider
Xenu
Zade
Zermelo Zermelo
Zeus Zeus
Zitebot ZoomBot
ZmEu
ZumBot ZumBot
ZyBorg ZyBorg
backlink-check archive.org_bot
cah.io.community cah.io.community
check1.exe
clark-crawler clark-crawler
com.plumanalytics com.plumanalytics
crawler4j
demandbase-bot demandbase-bot
domainsproject.org
evc-batch evc-batch
facebookscraper facebookscraper
internetVista monitor heritrix
ips-agent linkdexbot
isitwp.com lwp-trivial
lwp-request magpie-crawler
meanpathbot
mediawords mediawords
muhstik-scan muhstik-scan
oBot
pcBrowser
plumanalytics
probe-image-size probe-image-size
s1z.ru satoristudio.net
scan.lol seocompany.store
sitechecker.pro sp_auditbot
spyfu spyfu
trendiction.de sysscan
webgains-bot tAkeOut
webprosbot trendiction.com
x09Mozilla webmeup-crawler
xpymep1.exe webpros.com
zauba.io x22Mozilla
zgrab zgrab

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
afslankpillen2017nl.eu ibmdatamanagement.co
bumskontakte.org izismile.com
filesclub.net jav-way.site
gsasearchenginerankerhelp.com mturkcontent.com
kerch.site paighambot.com
lafourmiliaire.com rukino.org
porn555.com semaltmedia.com
prchecker.info soblaznu.net
rczhan.com specialfinanceoffers.com
xmronta.com westermarkanjou.se

936
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
1008.su 108shot.com
101flag.ru 11pikachu.ru
13tabs.com 123kuma.com
1hwy.com 123locker.com
2drittel.de 12masterov.com
4webmasters.com 4istoshop.com
4webmasters.org 4rent.ru
5ws.dating-app.ru 5-steps-to-start-business.com
999webdesign.com 7a2rnuey1tw9ar.ru
absolute-s.ru 7xc4n.com
acgs.tk 91abcw.com
acortarurl.es a.pr-cy.ru
adimmix.com aa14ab57a3339c4064bd9ae6fad7495b5f.com
adman.gr aa8780bb28a1de4eb5bff33c28a218a930.com
admanaerofoil.com abclauncher.com
adtech.fr acunetix-referrer.com
affiliate-fr.com adhome.biz
aksonural.ru adloads.com
aktobe.xkaz.org adserver-e7.com
alevinefesleri.com adtech.de
alibestsale.com adzerg.com
alienwheel.es afora.ru
alldownload.pw alfapro.ru
allwomen.info alldezservice.kz
alvtank.se allproblog.com
amazingpic.net amanda-porn.ga
anapa-inns.ru amazingninja.com
angry-fermi-7633.arukascloud.io amt-k.ru
apilinkswiftco-a.akamaihd.net amyfoxfitness.com
appiq.mobi android-systems.ru
appleid-verification.com angigreene.com
apptester.tk animalia-life.club
artdeko.info anjalika.co.in
artefakct.com anonymizeme.pro
asdfg.pro apiholdingmypage-a.akamaihd.net
asdfz.pro apiitsthirteende-a.akamaihd.net
asrv-a.akamaihd.net apiluckyleapnet-a.akamaihd.net
asseenontvonline.ru app-ready.xyz
astrochicks.com arate.ru
autochoixspinelli.com arcadeplayhouse.com
autoloans.com arendovalka.xyz
autorn.ru arius.tech
autoua.top arquivo.pt
avon-novosib.ru arraty.altervista.org
azbuka-mo.ru asiavirtualsolutions.com
azbukadiets.ru asmxsatadriverin.aircus.com
azte.ch asrvrep-a.akamaihd.net
babyguns.ru asscenihotosidea.blogspot.co.za
baksman.com autogrep.ru
bannerspace.com autovideobroadcast.com
bbsoldes.fr autowebmarket.com.ua
begalka.xyz aviav.ru.com
avtoarenda.by
avtochehli.by
b00kmarks.com
b2b-lounge.com
backlinkwatch.com
bad-stars.net
bala.getenjoyment.net
bankmib.ru
bard-real.com.ua
berdasovivan.ru berdasovivan.ru
best-seo-offer.com best-coupon-offer.com
bestcoin.cc best-mam.ru
bestdooz.com besthomemadepornsites.com
bestmarriages.com betwinservice.com
bestmobilityscooterstoday.com biketank.ga
bestsexyblog.com billiard-classic.com.ua
bet-prognoz.com binomo.kz
beta.hotkeys.com bio-market.kz
bezsporno.ru blackwitchcraft.ru
bidr.trellian.com blavia.00author.com
big-cash.net bookmark4you.com.biz
bildsuche.ru bosefux.esy.es
bjanshee.ru brains2.biz
blackplanet.com brainzpod.win
blog.f00kclan.de brandbucket.com
blogig.org brateg.xyz
bloglag.com bravegirlsclub.com
bmw-ark.ru brk-rti.ru
boanonihaca.tk businescoop.men
boeuklad.com businesn.men
boltalko.xyz buynorxx.com
bombla.org buypanicdisorderpill.com
brandedleadgeneration.com byme.se
brus-vsem.ru
btvn.ru
builtwith.com
buy-cheap-online.info
bvlgariwallet.xyz
cah.io.community cah.io.community
carfax.com.ua cam-kontakte.org
carloans.com cand.jp
cars-modification.net
cartechnic.ru cartechnic.ru
cartierjusteunclou.xyz cartierbracelet.xyz
cartierlovebracelet.xyz casinorewards.info
cbox.ws ccbill.com
celebsopics.com cellfun.mobi
censys.io cfjump.com
centrdebut.ru changde.58.com
cheap-trusted-backlinks.com cheapbelstaff.online
checkhit.com chinajerseyswholesalecoupons.com
checkm8.com choice-credit.ru
chee-by.biz cialisovercounteratwalmartusa.com
chinaelitecheapjerseys.com cibpenonptib.flu.cc
chocolateslim-original.com citetick.com
clickbank.net cjs.com.ru
clickprotects.com
clips.ua.ac.be clips.ua.ac.be
cmhomestayagency.com cmhomestayagency.com
cobaltpro.ru codq.info
communisave.co.za colehaanoutlet.store
companies-catalog.com
compliance-andrew.top
compliance-julianna.top compliance-julianna.top
compliance-margo.top connectingsingles.com
compliance-walt.top conocer-sanabria.com
contextualyield.com cookingmeat.ru
cookie-law-enforcement-aa.xyz coop-gamers.ru
coolwallpapers4k.info cowblog.fr
copyrightclaims.org crazyboost.pro
counciltally.com creativehutindia.com
crackzplanet.com credit-respect.ru
crest-poloski.ru cryptoswap.biz
cvety24.by cs-passion.pl
czeshop.info cubs-jerseys.us
d2jsp.org cupday.com
dame-ns.kz custodieva.ru
daretodonate.co cutt.us
data-ox.com daooda.com
date-withme.com darodar.com
den-noch24.ru dating-time-now.com
descargar-musica-gratis.net deda-moroza-zakaz.ru
dikqlyremy.info dildofotzen.net
djekxa.ru directrev.com
docs4all.com docstoc.com
dokfilms.net dojki-hd.com
domaineaneblanc.com dollartree.info
domoysshop.ru domain-tracker.com
download-wallpaper.net dorratex.tn
drivotracker.com dostavka-v-krym.com
drunkmoms.net dotmass.top
dyt.net download-of-the-warez.blogspot.com
easyukraine.com dptaughtme.com
ecookna.com.ua dustyorate.com
edwinkonijn.com.au e-commerce-seo.com
efkt.jp e-kwiaciarz.pl
earthmagic.info
easyshoppermac.com
educatemetv.com
ekobata.ru ekobata.ru
elektrischezigarette1.blog.pl elektrozigaretten1.webs.com
elvenar.com
embedle.com
enge-fotzen.info enge-fotzen.info
engines-usa.com erectile.bid
ereko.ru erotiktreff24.info
eropho.com escortslet.net
event-tracking.com estelight.ru
exonline.info etur.ru
expertnaya-ocenka.ru
expolicenciaslatam.co expolicenciaslatam.co
expresstoplivo.ru expresstoplivo.ru
extads.net
ezb.elvenmachine.com ezb.elvenmachine.com
ezigarettekaufen1.hpage.com ezrvrentals.com
ezigaretteshop2.mywapblog.com fable.in.ua
ezigaretteshop2.vefblog.net falcon-images.blogspot.com
f00kclan.de familienzahnaerzte.com
faracontrol.ir family1st.ca
fashion-stickers.ru
fashionindeed.ml
fastfixing.tech fastfixing.tech
fdzone.org feorina.ru
fertilitetsradgivningen.se fetishinside.com
fickblock18.com fifa-coins.online
fillmewithhappiness.com filkhbr.com
filmci.pro filmania-x.ru
financetip.eu filmfanatic.com
findpics.pw filmgo.ru
finstroy.net financehint.eu
fireads.men fitness-video.net
fishtauto.ru flavors.me
flashlarevista.com forpackningsutveckling.se
flauntyoursite.com forpostlock.ru
forum.poker4life.ru forum-engineering.ru
forum69.info foto-sisek.porngalleries.top
foxjuegos.com foto-weinberger.at
fr.netlog.com fr-bearings.ru
freelinkbuilding.website.tk freegamesplay.online
freemags.cc freelifetimefuckbook.com
freshmac.space freevpn.space
freshwallpapers.info freshwallpapers.info
ftns.ru ftns.ru
g.starmoe.xyz fuck-paid-share-buttons.xyz
fun-mobi.pl
gabeshop.ru
gallictures.com
gambarxkata.co gambarxkata.co
gamezblox.com gameprimary.com
ge0ip.com gamerscorps.com
getoutofdebtfree.org gamevalue7.weebly.com
getridofstretchmarks.org gateway.zscalerone.net
gidonline.one geckoandfly.com
gne8.com gkvector.ru
gobongo.info globetrotting-culture.ru
goldadpremium.com gloverid.site
goldandcard.ru go2jump.org
goodly.pro golaya.pw
googleseo.com.tr gombita.info
gowreckdiving.com googlepositions.com
graphics8.info gorabagrata.ru
guitar-master.org gosarhivrt.ru
gz2.bbsoldes.fr gpirate.com
handsandlegs.ru hatedriveapart.com
harmonyglen.us hauleddes.com
haveinc.xyz hdfreeporno.net
hcate.com help.tpu.ru
hdpixion.com hermesbirkinhandbagoutlets.com
headpress.ru heroz.fr
heliko.no hitmuzik.ru
herehloadibs.cf homelygarden.com
hiwibyh.bugs3.com hotkeys.com
hmywwogw.bloger.index.hr house.sieraddns.com
honyaku.yahoofs.jp houston-vikings.com
houseofrose.com hoverboard360.at
houtings.xyz hoverboard360.de
howopen.ru hybrid.ru
iloveitaly.ru hyiphunter.org
ilte.info iamsport.org
imagui.eu igtools.club
in-tandem.co ihc2015.info
infostatsvc.com ilovevitaly.com
intellego.info imagerydatabase.com
interesnie-faktu.ru images.gyffu.com
investingclub.ru imagez.co
iphantom.com imfamous.info
iptool.xyz inboundlinks.win
ispac.org indo-export.ru
istripper.com infokonkurs.ru
ivanstroi.ru iplusbit.blogspot.co.za
ixora.pro
izhevsk.xrus.org izhevsk.xrus.org
izismile.com j-times.ru
janavibekken.no je7.us
javatex.co.id jjbabskoe.ru
jerseyssportsshop.com jobmarket.com.ua
jo24news.com johnnyhaley.top
jpcycles.com kalb.ru
justdating.online kanimage.com
kam-dom.ru kerwinandcariza.com
kamagragelusa.net kimcurlrvsms.com
kandidos.com kino-fun.ru
kaz.kz kinohall.ru
kazan.xrus.org kinomaniatv.pl
kemerovo.zrus.org kinostorm.net
keywords-monitoring-success.com klumba55.ru
kiskinhouse.com kmgamex.cf
klikbonus.com kosmetyki.tm.pl
knowyournextmove.com kostenloser-sex.com
kometars.xyz kozhniebolezni.com
la-fa.ru krasnodar-avtolombards.ru
labafydjxa.su krynica.info
labelwater.se kw21.org
lapitec.eu lacasamorett.com
laxdrills.com landinez.co
laxob.com lankarns.com
leadn.pl law-check-eight.xyz
lerporn.info life.biz.ua
letmacworkfaster.site lifeinsurancekb.com
letolove.ru liky.co.ua
libertybilisim.com linkbuddies.com
lifehacĸer.com lol-smurfs.com
liffa.ru lolnex.us
lignofix.ua louboutinreplica.pw
lineavabit.it love-baby.cz
linerdrilling.com lutherstable.org
lionking-1994.blogspot.com lyngdalhudterapi.no
liveinternet.ru m3gadownload.pl
lodki-pvh.dp.ua macnewtech.com
lovasszovetseg.hu maglid.ru
low-format.ru maju.bluesalt.co
luckyday.world manualterap.roleforum.ru
macresource.co.uk mb140.ru
marblestyle.ru mbiologi.ru
mastershef.club medictube.ru
matrixalchemy.com midst.eu
mazda-roadsters.com minharevisao.com
mebel-ekb.com mitrasound.ru
mebeldekor.com.ua mixtapetorrent.com
med-zdorovie.com.ua mmog-play.ru
medi-fitt.hu modabutik.ru
meds-online24.com modenamebel.ru
megakino.net
menhealed.net
menstennisforums.com
mesto-x.com
metafilter.com
metallosajding.ru
mindbox.co.za
mindeyegames.com
mirtorrent.net
missclub.info
mlvc4zzw.space
mmofreegames.online
mnogabukaff.net
mobifunapp.weebly.com
mockupui.com
moesonce.com moesonce.com
monsterdivx.tv monclerjacketsoutlet.pw
moonci.ru moneyteam24.com
mototsikl.org moscow-clining.ru
moxo.com mttwtrack.com
moyaterapiya.ru muabancantho.info
mrinsidesales.com mwtpludn.review
muycerdas.xxx myanyone.net
muztops.ru
my-bc.ru
myhitmp3.club myhitmp3.club
mysex21.com myhydros.org
naj-filmy24.pl myonigroup.com
namenectar.com myphotopipe.com
natali-forex.com myra.top
national-today-winning-winner.club myseoconsultant.com
naturtreenspicerx.pw na-telefon.biz
nero-us.com nalogovyy-kodeks.ru
no-fuel.org neobux-bg.info
nuit-artisanale.com nerudlogistik.ru
obiavo.su networkcheck.xyz
ochistka-stokov.ru news-readers.ru
okmedia.sk next-dentists.tk
okroshki.ru nrv.co.za
omgtnc.com o-o-6-o-o.ru
onblastblog.online oconto.ru
one-gear.com oklogistic.ru
onetravelguides.com oktube.ru
online247.ml olvanto.ru
onlineserialy.ru olympescort.com
orgasmus-virtual.com onlinetvseries.me
ostrovtaxi.ru onload.pw
paintingplanet.ru orion-code-access.net
par-fallen.ga outrageousdeal-a.akamaihd.net
park.above.com oz-offers.com
pcgroup.com.uy pb-dv.ru
perosan.com peekyou.com
physfunc.ru pepperstyle.ru
picsearch.com picture-group.com
pierrehardysale.online picurams.pw
pigrafix.at
pillscheap24h.com pillscheap24h.com
piulatte.cz pinapchik.com
pix24x7.com pio.polytopesexempt.com
pizda.lol pipki.r.acdnpro.com
plastgranar.nu platesauto.com
pobeiranie.pl popunder.ru
podshipniki-nsk.ru pornmania.pl
poisk-zakona.ru porno-dojki.net
popcash.net potoideas.us
porndl.org potolokelekor.ru
pornhub-ru.com powitania.pl
porno-raskazy.ru pricheskaonline.ru
pornogig.com printie.com
pornokorol.com progonrumarket.ru
pornonik.com progress-upakovka.ru
pornophoto.xyz prostitutki-kiev.org
preventheadacheguide.info putevka24.ru
primedice.com putitin.me
princevc.com qcstrtvt.bloger.index.hr
privacylocationforloc.com quit-smoking.ga
prlog.ru quizzitch.net
proekt-mos.ru rating-casino2021.ru
pronekut.com realresultslist.com
prostitutki-rostova.org rebrand.ly
pxhdwsm.com regdefense.com
quebec-bin.com remont-ustanovka-tehniki.ru
rada.ru remote-dba.de
rankia.com renewablewealth.com
ranksonic.com rethinkwasteni.info
rczhan.com
realizmobi.com
rebuildermedical.com
regionshop.biz
relayblog.com
rewardpoll.com rewardpoll.com
rique.host.sk rfd-split.hr
rniaeba.ga riralmolamsaca.tk
roma-kukareku.livejournal.com rockprogblog.com
rus-teh.narod.ru rootandroid.org
rvi.biz ru-mediaget.ru
rybalka-opt.ru ruf777.com
sale-japan.com sabaapress.com
saltspray.ru scanmyphones.com
saveriopiazza.it scanner-mary.top
sax-sex.com schlampen-treffen.com
sbetodiodnye-lampy.ru scrapy.org
sbt-aqua.ru scrnet.biz.ua
scanner-julianna.top seansonline24.pl
scrapinghub.com searchlock.com
screentoolkit.com seminarykansas904.ml
sdi-pme.com semp.net
search-goo.com seo-platform.com
searchimage.co seocheckupx.com
seocheki.net seoprofiler.com
seogadget.ru service-core.ru
sergiorossistore.online sexiporno.net
sexphoto.site sexphoto.site
sexsearch.com sexvideo-sex.com
shikiso.info sexystrippe.info
sharebutton.net
shivafurnishings.com shivafurnishings.com
shoesonlinebuy.cn shopcheermakeup.info
shopperifymac.com sildenafil-tadalafil.info
sim-service.net site5.com
skypasss.com soc-proof.su
snjack.info socas.pluto.ro
snomer1.ru social-s-ggg.xyz
snworks.com social-vestnik.ru
social-s-hhh.xyz soft1.ru
softlinesolutions.me souvenir.cc
softonicads.com spaceshipad.com
softwaretrend.net spammen.de
soviet-portal.do.am spb.ru
spbchampionat.ru spbchampionat.ru
speedup-my.site sports-supplements.us
splendorsearch-a.akamaihd.net spravka130.ru
spywarebegone.com srgwebmail.nl
ssconstruction.co start.myplaycity.com
stanthonyscatholicchurch.org staticfs.host
stmassage.ru steamoff.net
stpicks.com stjamesschool.info
strana-solnca.ru strfls.com
susanholtphotography.com stroimajor.ru
tagil.zrus.org studworks.org
td-33.ru suhanpacktech.com
tds-advert002.info supervesti.ru
technika-remont.ru svetodiodoff.ru
templates.radiodigital.co svtrd.com
tengohydar.tk sweepstakes.rewardit.com
tetracsaudi.com tarad.com
thebestphotos.eu thebitcoincode.com
thefds.net thegameriders.com
thegalerie.eu thepantonpractice.co.uk
thepokertimer.com thetardistimes.ovh
timetorelax.biz thetoiletpaper.com
titan-cloud.life tizanidine4mgstreetvalue.blogspot.com
tizanidineshowupondrugtest.blogspot.com tizanidineandhydrocodone.blogspot.com
tooplay.com tizanidinedosageforsleep.blogspot.com
tizanidinehcl2mgsideeffects.blogspot.com
tizanidinehcl4mgtab.blogspot.com
tizanidinenarcotic.blogspot.com
tizanidinezanaflex.blogspot.com
toondinsey.com
top-deal.com.pl top-deal.com.pl
topcar-krasnodar.ru top10registrycleaners.com
torrents-tracker.com torrentdownloadhub.com
touchmods.fr touchmods.fr
track-rankings.online trackzapper.com
trackmedia101.com tracxn.com
trubywriting.com trafaret74.ru
truck-rece.life traffic-club.info
tt-ipd.info trichizobswiv.agddns.net
ttsq.fr trkur.com
tube8.com trucri.me
u555u.info trustedmaccleaner.com
ucsol.ru try-rx.com
tubo360.com
tula.mdverey.ru
turbabitload.weebly.com
tvorozhnaja-zapekanka-recept.ru
tzritel.tk
ua.tc
uac.net.au
uasb.ru
uginekologa.com
ultramart.biz
umg-stroy.ru
underthesite.com underthesite.com
universals.com.ua unimodemhalfduplefw.pen.io
uprour.com urdoot.win
uptime.com userequip.com
url2image.com
us-america.ru
v720hd.ru
vapeface.club vapeface.club
vapsy.com varikozdok.ru
velobikestock.com vbabule.net
vesnatehno.com vgoloveboli.net
vitanail.ru via-energy-acquistare.com
vkonche.com viagra.pp.ua
vladimir.xrus.org videochaty.ru
vltai.com videooko.weebly.com
vostoktrade.info vinylvault.co.uk
vsdshnik.com voprosotvet24.ru
vseigru.one vremya.eu
vsesubwaysurfers.com vzubah.com
vut.com.ru watchmygf.net
watch-movies.ru webadvance.club
wdrake.com webnode.me
we-are-gamers.com webscouter.net
website-datenbank.de website-speed-checker.site
wholesalecheapjerseysfree.com weburlopener.com
wholesalenfljerseys.us.com wejdz-tu.pl
whosonmyserver.com westum.se
wineration.com whatistizanidine2mg.blogspot.com
wingsofrefuge.net whatsupinfoley.com
wikes.20fr.com
wleuaprpxuvr.ga wleuaprpxuvr.ga
wordpresscore.com woman-orgasm.ru
workle.website
wpsecurity.website wpsecurity.website
wpthemedetector.co.uk wttavern.com
wsgames.ru www.ehscloud.cn
wstroika.ru xn-----6kcaabbafhu7cskl7akvongwpo7hvjj.xn--p1ai
www.bookmaker-bets.com xn----7sbifcamovvfggw9d.xn--p1ai
www.get-free-traffic-now.com
xchangetrak.com
xchat26.myfreecams.com
xlolitka.com
xn----7sbbagbq7bd5aheftfllo4m.xn--p1ai
xn----ctbbcjd3dbsehgi.xn--p1ai xn----ctbbcjd3dbsehgi.xn--p1ai
xn--80adaggc5bdhlfamsfdij4p7b.xn--p1ai xn--80aaafbn2bc2ahdfrfkln6l.xn--p1ai
xn--80atua3d.xn--p1ai xn--80ab4aa2g.xn--p1ai
xportvusbdriver8i.snack.ws xn--80ajbshivpvn2i.xn--p1ai
yellowstonesafaritours.com xn--b1adccaf1bzj.xn--p1ai
youbrainboost.asia xn--d1abj0abs9d.in.ua
xtremeeagles.net
y8games-free.com
yhit.press
youdesigner.kz youdesigner.kz
your-bearings.com youjizz.com
youresponsive.com youradexchange.com
youtoner.it yourtemplatefinder.com
zastenchivosti.net ytmnd.com
zeleznobeton.ru zahvat.ru
zigarettenonlinekaufen1.blox.pl zakonobosago.ru
zirondelli.it zebramart.ru
zmoda.hostreo.com zeikopay.com
zoomovies.org zeroredirect12.com
zigarettenonlinekaufen1.bloog.pl
zrus.org zrus.org
zryydi.com zvezdagedon.ru
zynax.ua

482
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
0c47f8422d3f.com 00go.com
0daymusic.org 1688.com
14b.info 24videos.tv
2000k.ru 2kata.ru
24x7-server-support.site 51unlim.ru
2nt.ru adnotbad.com
2x2fan.ru adssafeprotected.com
5u.com affrh2015.com
6128786.com ahrntal.verymes.xyz
8lufu.com albamargroup.com
9med.net alice.it
abovetherivernc.com anime.dougasouko.com
academia-nsk.org apparel-offer.com
accessoires-mode.in appfixing.space
actulite.com
adamoads.com
adclickthru.net
adloads.net
adsland.men
adtiger.tk
adultnet.in
alert-hgd.xyz
alphaforum.ru
amazon-adsystem.com
anal-acrobats.hol.es
ap.senai.br
apishops.ru
apiwoodensealcom-a.akamaihd.net
appiq.mobi appiq.mobi
articlesdirectoryme.info appleid-verification.com
asophoto.com arenda-yeisk.ru
asscenihotosidea.blogspot.com artdeko.info
atovh.local-finders.com asrv-a.akamoihd.net
autoloans.com atelielembrancaqueencanta.com.br
autotrends.today azinoofficial777.ru
aviav.ru backuperwebcam.weebly.com
avtolombard-krasnodar.com balla-boo.se
avtolombard-krasnodar.ru bannerpower.com
ayeartoforget.com bestimagecoollibrary.com
barbourjackets.online binomo.kz
best-seo-software.xyz bitnote.co
biznesluxe.ru blockworld.ru
blockety.co blog.f00kclan.de
blogrankers.com bloke.com
bongiornos.info bodybuilding-shop.biz
bonzybuddy.com boleznikogi.com
braip.com.br bongacams.com
brillianty.info break-the-chains.com
buehne-fuer-menschenrechte.de btnativenav.com
butstrap.space budilneg.xyz
bvlgariring.xyz buyessay3.blogspot.ru
bvlgaribracelet.xyz
call-of-duty.info call-of-duty.info
camdolls.com carsplate.com
candlehandmade.com cbozhe.com
cdn.walkme.com celebsopics.com
cerev.info cezartabac.ro
cheapjerseysfootballshop.com
cleanersoft.com cleanersoft.com
clodo.ru clicksor.com
compliance-andrew.xyz coolwallpapers4k.info
compliance-julianna.top counter.yadro.ru
cookingmeat.ru crazyprotocol.com
coolgramgoods.com crystalslot.com
copro.pw cymbaltaandtizanidine.blogspot.com
crackguru.tk dailystrength.org
craftburg.ru danashop.ru
cwetochki.ru daretodonate.co
dailyrank.net descargar-musica-gratis.net
dangphoto.trade dimkino.ru
dawlenie.com dkvorota.ru
decoratinghomes.ga doctissimo.fr
dev-seo.blog doctormakarova.ru
dichvuvesinhhanoi.com dotmass.top
diminishedvalueoforegon.com download-walpaperhd.blogspot.com
dinosaurus.site elektrischezi.canalblog.com
divku.ru elektronischezigarettekaufen2.tumblr.com
dojki365.online elidelcream.weebly.com
domaineaneblanc.com eloconcream.blogspot.com
download-wallpaper.net empirepoker.com
ekobata.ru energydiet24.ru
epicbrogaming.com engines-usa.com
europages.com.ru espaceinventoristes.com
este-line.com.ua
eugenevaultstorage.com
euroskat.ru
excitacao.com
ezigarettenshop2.myblog.de
ezigaretteshop.webs.com ezigaretteshop.webs.com
f012.de f00kclan.de
fdzone.org familyholiday.ml
fefo.gdn filmidivx.com
firesub.pl findpics.pw
firstsiteguide.com
fitfloponline.store
fortunejack.com
free-floating-buttons.com free-floating-buttons.com
freenode.info freelotto.com
fxgallery.com frequiry.com
galaxyflowers.ru freshberry.com.ua
getoutofdebtfree.org fullfileaccess.com
getyourimage.club gdcentre.ru
gkvector.ru getaclueamerica.com
gnuetella.com gfaq.ru
gopixdatabase.com gktt.ru
heartofbeijing.blogspot.com goodhumor24.com
hesteel.pl gosreg.amchs.ru
hitmuzik.ru grtyi.com
horoshieokna.com gstatey.net
immigrational.info hanink.biz.ly
impotentik.com hoverboard360.se
incep.imagine-ex.co howtoclean.club
instabid.tech humanelydrew.com
iqoption.com i-service.kz
jav-idol.com iccornacircri.cf
joy-penguin.com ilo134uloh.com
keywordbasket.com inboundlinks.win
keywordblocks.com incanto.in.ua
keywords-monitoring-success.com infostatsvc.com
kichenaid.ru int.search.tb.ask.com
koral.se intermesh.net
kunstaktien.info io9.com
lanasshop.ru ipchicken.com
larose.jb2c.me ipostroika.ru
larutti.ru istizanidineanarcoticdrug.blogspot.com
linerdrilling.com istizanidinelikexanax.blogspot.com
live-cam6.info izismile.com
liveu.infoteka.hu jikoman.info
locksmith.jp jimmychoosale.online
lovi-moment.com.ua jofucipiku.tk
lsex.xyz kabbalah-red-bracelets.com
marcoislandvacations.net kaidalibor.de
meddesk.ru keywordspay.com
methodsmarketing.com kinotorka.ru
mindbox.co.za knigonosha.net
mobilierland.com knowyournextmove.com
moivestiy.biz krasula.pp.ua
moscow-clining.ru larger.io
msk-diplomat.com law-check-seven.xyz
musicvidz.ru lego4x4.ru
myghillie.info lincolntheatre.com
mypets.by louboutinreplica.pw
mypornfree.ru lubetube.com
nardulan.com luchshie-topcasino.ru
nastydollars.com luciddiagnostics.in
news-speaker.com luckyday.world
nikkiewart.ru macnewtech.com
nofreezingmac.work makenahartlin.com
notebook-pro.ru managerpak204.weebly.com
nvformula.ru manve.info
offergroup.info map028.com
onlinadverts.com marblestyle.ru
onlineserialy.ru medizinreisen.de
onload.pw meduza-consult.ru
ooo-gotovie.ru misandesign.se
openstat.com mobile.ok.ru
optitrade24.com monthlywinners.com
orel-reshka.net mwtpludn.review
oren-cats.ru mydirtyhobby.com
otbelivanie-zubov.com myindospace.com
ownshop.cf nailsimg.com
painting-planet.com naturalpharm.com.ua
palvira.com.ua nerudlogistik.ru
pammik.ru nudejapan.net
paphoselectricianandplumber.com nudo.ca
partner-cdn.men oballergiya.ru
partner-high.men oddamzadarmo.eu
pcgroup.com.uy onclkads.com
photochki.com openmultipleurl.com
picquery.com ororodnik.goodbb.ru
pixshark.com ossmalta.com
plastgranar.nu par-fallen.ga
platinumdeals.gr parajumpersoutlet.online
porndroids.com picsearch.com
porno-chaman.info pihl.se
potoideas.us play-mp3.com
privatamateure.com pornhubforum.tk
pst2017.onlinewebshop.net pornoslive.net
radiogambling.com pozdravleniya-c.ru
ranking2017.ga pregnant.guru
ranksonic.com profitsport.club
ranksonic.info prointer.net.ua
recordpage-a.akamaihd.net prospekt-st.ru
remont-komputerov-notebook.ru rapidgator-porn.ga
replica-watch.ru realitykings.com
retreatia.com regionshop.biz
rique.host.sk registrationdomainsite.com
romhacking.ru repeatlogo.co.uk
royalcar-ufa.ru responsinator.com
savingsslider-a.akamaihd.net rusvideos.su
scanner-jane.top sashagreyblog.ga
scrapy.org scanhub.ru
screentoolkit.com scanner-margo.top
serptehnika.ru sei80.com
servethis.com seocheckupx.com
service.adtech.fr sexkvartal.com
sexpornotales.com sexpornotales.com
sexvporno.ru sexytrend.ru
shakhtar-doneck.ru shop.acim.org
shikiso.info sibecoprom.ru
shodanhq.com silvercash.com
shoppingjequiti.com.br siteheart.net
shymkent.xkaz.org siteripz.net
sisiynas.ru snomer1.ru
smartshoppymac.com socialtrade.biz
sophang8.com soft1.ru
spasswelt.net spylog.com
speechfoodie.com ssconstruction.co
spidtest.org stard.shop
stair.registrydomainservices.com stockquotes.wooeb.com
startufa.ru strangeduckfilms.com
suggest-keywords.com studentguide.ru
supernew.org superstats.com
teenporn18.net svarkagid.com
terrafootwear.us swsociety.se
thepokertimer.com taranerymagesswa.blogspot.com
tizanidinepills.blogspot.com tattoo33.ru
tizanidinerestlesslegsyndrome.blogspot.com thebitcoincode.com
thebluenoodle.com
thefotosgratis.eu
tiens2010.ru
tizanidinewithdrawalsymptoms.blogspot.com tizanidinewithdrawalsymptoms.blogspot.com
toon-families.com toonfamilies.net
torrentdownloadhub.com topbestgames.com
tozup.com torontoplumbinggroup.com
traffic2cash.org tour-line.net
trafficgenius.xyz track112.site
trafficjunky.net traffique.net
traffixer.com tri-slona.org
tubeline.biz tripper.de
videos-for-your-business.com tubo360.com
vielporno.net uggbootsoutletsale.us
vinsit.ru unmaroll.ya.ru
vipsexfinders.com validccseller.com
visa-pasport.ru validdomain.xyz
viven.host.sk vavilone.com
viveresaniesnelli.it vchulkax.com
vereo.eu
viddyoze.com
vizag.kharkov.ua
vkonche.com
vksaver-all.ru
vksex.ru
vsexkontakte.net
vzube.com vzube.com
w3javascript.com webs.com
wanker.us wellcome2slovenia.ru
wdfdocando.com whiteelephantwellington.com
wfb.hatedriveapart.com witherrom55.eklablog.fr
whatsupinfoley.com woweb.com.ua
windowssearch-exp.com ww2awards.info
womens-journal.net www.get-free-traffic-now.com
wordpress-crew.net www.timer4web.com
wwwadultcheck.com xn----itbeirbjbi7bc6bh2d.xn--p1ai
xep.info xn--80aagddcgkbcqbad7amllnejg6dya.xn--p1ai
xn----8sbarihbihxpxqgaf0g1e.xn--80adxhks xn--q1a.xn--b1aube0e.xn--c1acygb.xn--p1ai
xn----8sbhefaln6acifdaon5c6f4axh.xn--p1ai youdao.com
xn--1-8sbcpb0bdm8k6a.xn--p1ai youresponsive.com
xn--80aikhbrhr.net youtubedownload.org
xxxhdvideo.site zastroyka.org
xxxsiterips.xyz zawyna.ua
xz618.com zdesformula.ru
you-shall-not-pass.is74.ru
yourporn.com
zaloadi.ru
zarabiaj-dzis.pl
zhacker.net
zhuravlev.info
zmoda.hostreo.com zmoda.hostreo.com
zscalerone.net zoomovies.org

19
dev-tools/test_units/ratelimittest-beta.txt
View file

@ -8,14 +8,7 @@
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html><html> </html>ml>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head> <head><title>503 Service Temporarily Unavailable</title></head>
<body> <body>
<center><h1>503 Service Temporarily Unavailable</h1></center> <center><h1>503 Service Temporarily Unavailable</h1></center>
@ -581,4 +574,14 @@
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html> </html>

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.134 0; 10.1.0.229 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.05.3120 ### Version: V4.2022.05.3121
### Updated: Sun May 22 10:03:18 UTC 2022 ### Updated: Sun May 22 22:01:26 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.05.3120 ### Version: V4.2022.05.3121
### Updated: Sun May 22 10:03:18 UTC 2022 ### Updated: Sun May 22 22:01:26 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##