vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-15 17:49:49 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2022.06.3151 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2022-06-06 22:07:12 +00:00
parent 85bf17d332
commit 55de843352
48 changed files with 106134 additions and 106154 deletions
Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.06.3150 #### Version: V4.2022.06.3151
#### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.06.3150 #### Version: V4.2022.06.3151
#### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -14,7 +14,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2022.06.3150 #### Version: V4.2022.06.3151
#### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

13132
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2022.06.3150 #### Version: V4.2022.06.3151
#### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

13136
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

13136
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

13136
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

13136
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.173 1; 10.1.0.45 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.173 0; 10.1.0.45 0;
127.0.0.1 0; 127.0.0.1 0;

13136
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.173 1; 10.1.0.45 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.173 0; 10.1.0.45 0;
127.0.0.1 0; 127.0.0.1 0;

13136
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.173 1; 10.1.0.45 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.173 0; 10.1.0.45 0;
127.0.0.1 0; 127.0.0.1 0;

13136
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
3150 3151

13136
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

13136
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
104.214.93.149 0; 20.110.187.78 0;

13136
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.173 1; 10.1.0.45 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.173 0; 10.1.0.45 0;
127.0.0.1 0; 127.0.0.1 0;

13136
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.173 1; 10.1.0.45 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.173 0; 10.1.0.45 0;
127.0.0.1 0; 127.0.0.1 0;

13136
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.173 1; 10.1.0.45 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.173 0; 10.1.0.45 0;
127.0.0.1 0; 127.0.0.1 0;

13136
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
104.214.93.149 0; 20.110.187.78 0;

13136
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
104.214.93.149 0; 20.110.187.78 0;

13136
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.173 1; 10.1.0.45 1;
127.0.0.1 1; 127.0.0.1 1;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
BBBike Dotbot
Backlink-Ceck IDBot
Drip Jorgee
LinkScan Leap
Nessus Seekport
SemrushBot Stripper
WebEnhancer Telesphoreo
Whatweb VB Project
adscanner arquivo.pt
com.plumanalytics domainsproject.org

298
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
01h4x.com 01h4x.com
360Spider
404checker 404checker
AIBOT
ALittle Client
ASPSeek ASPSeek
Aboundex Aboundex
Aboundexbot Aipbot
AfD-Verbotsverfahren AllSubmitter
Alligator Anarchy
AlphaBot
Anarchy99 Anarchy99
Anthill Apexoo
Atomseobot
AwarioRssBot AwarioRssBot
BackDoorBot BDFetch
BackStreet BackStreet
Backlink-Ceck BackWeb
BlackWidow Battleztar Bazinga
Blow Bolt
BlowFish
Brandprotect Brandprotect
BuiltBotTough Brandwatch
Buck
Buddy
BuiltWith
Bullseye Bullseye
CATExplorador CATExplorador
CCBot ChinaClaw
CheTeam Citoid
CheeseBot Claritybot
Cloud mapping Cogentbot
Collector Collector
Copier
CopyRightCheck CopyRightCheck
Copyscape Custo
Cosmos DIIbot
Craftbot
Crawling at Home Project
CrazyWebCrawler
Curious
DBLBot
DSearch DSearch
DataCha0s DTS Agent
Digincore Demon
DigitalPebble
Dirbuster
Disco Disco
Discoverybot Dispatch
DittoSpyder
DnBCrawler-Analytics DnBCrawler-Analytics
DomCopBot DnyzBot
DomainAppender DomainAppender
DomainCrawler DomainSigmaCrawler
EasyDL Domains Project
EroCrawler Download Wonder
Dragonfly
Exabot Exabot
ExtLinksBot Express WebPictures
Extractor ExtractorPro
Extreme Picture Finder Extreme Picture Finder
EyeNetIE
Ezooms
FHscan FHscan
FemtosearchBot
Firefox/7.0 Firefox/7.0
Foobot Foobot
Fuzz FyberSpider
Genieo Fyrebot
G-i-g-a-b-o-t
GT::WWW
GetRight GetRight
GetWeb
Gigabot Gigabot
Go!Zilla Go!Zilla
Gotit Gotit
Grabber Grafula
HEADMasterSEO GrapeshotCrawler
HMView
HTMLparser HTMLparser
HTTP::Lite HaosouSpider
Haansoft
Harvest
Hloader
HonoluluBot HonoluluBot
Humanlinks HybridBot
IDBTE4M
IRLbot IRLbot
Iblog Id-search
IlseBot Image Fetch
Indy Library Indy Library
Intelliseek
InterGET InterGET
Internet Ninja Internet Ninja
InternetSeer
Iria
Iskanie
IstellaBot
JennyBot JennyBot
Jyxobot JetCar
JikeSpider
Joomla
Kenjin Spider
Keyword Density Keyword Density
Kinza
Kozmosbot Kozmosbot
LWP::Simple
Lanshanbot Lanshanbot
LexiBot
LibWeb
Libwhisker Libwhisker
LieBaoFast
Lightspeedsystems Lightspeedsystems
LinksManager LinkScan
Lmspider LinqiaMetadataDownloaderBot
LinqiaRSSBot
Lipperhey Spider
Litemage_walker
MFC_Tear_Sample MFC_Tear_Sample
MIIxpc MIIxpc
MJ12bot MTRobot
MSIECrawler
Mag-Net
Magnet Magnet
Majestic-SEO Mail.RU_Bot
MauiBot MarkMonitor
MarkWatch
Mass Downloader
Mb2345Browser Mb2345Browser
Mediatoolkitbot MeanPath Bot
Meanpathbot
MegaIndex.ru MegaIndex.ru
MicroMessenger
Microsoft Data Access
Microsoft URL Control
Minefield Minefield
Moblie Safari
Mojeek
Mojolicious Mojolicious
Mozlila MolokaiBot
Mr.4x3 Mr.4x3
NICErsPRO Msrabot
Name Intelligence NearSite
Navroad
Nessus Nessus
NetAnts
NetLyzer NetLyzer
NetSpider NetZIP
Nettrack Netcraft
Niki-bot Nibbler
Nikto
NimbleCrawler
Nimbostratus
Ninja
Nmap Nmap
Not Offline Navigator
Nutch
OnCrawl OnCrawl
OpenLinkProfiler
OpenVAS
Openfind Openfind
OrangeBot
OrangeSpider OrangeSpider
OutclicksBot OutclicksBot
OutfoxBot OutfoxBot
PECL::HTTP PECL::HTTP
POE-Component-Client-HTTP
Page Analyzer
PageScorer
PageThing.com PageThing.com
PeoplePal
Petalbot
Pi-Monster
Picsearch
Piepmatz Piepmatz
Pimonster Pockey
Pixray ProPowerBot
Probethenet Pump
PxBroker Quick-Crawler
RSSingBot
RankFlex
Rankivabot Rankivabot
Recorder
RedesScrapy RedesScrapy
SEOkicks RepoMonkey
SISTRIX SISTRIX
SalesIntelligent SMTBot
ScanAlert
Scanbot Scanbot
Scrapy Scrapy
ScrepyBot ScrepyBot
Searchestate Seekport
SemanticJuice Semrush
SemrushBot SeobilityBot
SeoSiteCheckup Shodan
Seomoz
Siphon
Site Sucker Site Sucker
SiteSnagger SiteLockSpider
Sitevigil Sitebeam
Snake SlySearch
Snoopy Sociscraper
Sogou web spider Sottopop
Spammen Spammen
Spinn3r Spanner
SputnikBot SputnikBot
Sqlmap
Sqlworm Sqlworm
Sqworm Sqworm
Stripper
Sucuri
SuperHTTP SuperHTTP
Szukacz Szukacz
T0PHackTeam T0PHackTeam
T8Abot T8Abot
Telesoft Telesphorep
TightTwatBot The Intraformant
TheNomad
Titan Titan
Toweyabot
Tracemyfile Tracemyfile
Trendiction Trendiction
Turingos Turingos
Turnitin Turnitin
Twice TurnitinBot
Typhoeus URLy.Warning
URLy Warning Upflow
Vacuum VCI
VelenPublicWebCrawler
VeriCiteCrawler VeriCiteCrawler
Virusdie Virusdie
VoidEYE
Voil
Voltron Voltron
WWW-Collector-E WEBDAV
WWW::Mechanize WISENutbot
Wallpapers Wallpapers
Wallpapers/3.0 Wallpapers/3.0
WallpapersHD
WeSEE
Web Enhancer
Web Fetch
Web Fuck
Web Pix
Web Sauger
Web Sucker
Web Auto Web Auto
Web Collage Web Collage
WebAuto
WebBandit
WebCollage
WebCopier
WebFetch WebFetch
WebFuck WebFuck
WebImageCollector WebImageCollector
WebLeacher
WebPix WebPix
WebSauger WebReaper
WebSucker WebWhacker
WebZIP
Webalta Webalta
Webster Website Quester
WebsiteQuester
Whatweb
Who.is Bot
Widow Widow
WiseGuys Robot WinHTTrack
Wonderbot
Woobot Woobot
Wotbox
Wprecon Wprecon
Xaldon WebSpider Xenu
Xaldon_WebSpider YoudaoBot
Zeus Zeus
Zitebot Zitebot
ZmEu
ZoomBot ZoomBot
ZyBorg arquivo.pt
archive.org_bot
autoemailspider
backlink-check backlink-check
check1.exe cah.io.community
crawler4j coccocbot
gopher crawl.sogou.com
internetVista monitor crawler.feedback
isitwp.com eCatch
mediawords ips-agent
iubenda-radar
lwp-trivial
meanpathbot
oBot
page scorer page scorer
pcBrowser
plumanalytics
polaris version polaris version
ripz probe-image-size
s1z.ru
satoristudio.net
seocompany.store
seostar seostar
serpstatbot serpstatbot
siteripz sogouspider
sp_auditbot
spyfu spyfu
tAkeOut
trendiction.com
trendiction.de trendiction.de
webprosbot voyagerx.com
zauba.io webgains-bot
x09Mozilla
xpymep1.exe
zgrab

302
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
404checker ADmantX
404enemy
AIBOT
ALittle Client
Aboundex
Aboundexbot Aboundexbot
Aipbot Acunetix
AllSubmitter AhrefsBot
Alligator AiHitBot
AlphaBot AlphaBot
Anarchy
Anthill Anthill
Apexoo
Aspiegel
Asterias
AwarioRssBot
AwarioSmartBot
BBBike BBBike
BDCbot BDCbot
BackDoorBot
BackWeb BackWeb
Backlink-Ceck Backlink-Ceck
BacklinkCrawler BetaBot
Bandit
Barkrowler
BatchFTP
Bitacle
BlackWidow
Blow Blow
Boardreader
Brandwatch Brandwatch
Buck Buddy
BuiltBotTough
BuzzSumo BuzzSumo
CODE87 CATExplorador
CSHttp CSHttp
Calculon Calculon
CensysInspect CazoodleBot
CheeseBot Cegbfeieh
ChinaClaw CheTeam
Chlooe Cliqzbot
Claritybot
Cloud mapping Cloud mapping
Cogentbot Collector
Copier
CopyRightCheck CopyRightCheck
Cosmos Copyscape
Crescent Crawling at Home Project
CrazyWebCrawler
CrunchBot CrunchBot
Curious CyotekWebCopy
Custo DataCha0s
DatabaseDriverMysqli
Deusu
Devil Devil
Disco
Discobot Discobot
Discoverybot DittoSpyder
DomainAppender DomCopBot
DomainCrawler Domains Project
Dotbot Dragonfly
Download Wonder Drip
EasyDL EMail Wolf
Ebingbong
Ecxi
EroCrawler
Exabot Exabot
Extractor ExtLinksBot
Extreme Picture Finder ExtractorPro
FHscan Ezooms
FemtosearchBot FemtosearchBot
FlashGet FlashGet
Flunky Flunky
Foobot
Fuzz Fuzz
FyberSpider FyberSpider
Fyrebot G-i-g-a-b-o-t
GT::WWW GT::WWW
Genieo Genieo
GermCrawler GermCrawler
Getintent GetWeb
Gigabot GoZilla
Go-Ahead-Got-It Grabber
GrabNet GrapeshotCrawler
HEADMasterSEO HaosouSpider
HTMLparser
HTTP::Lite
Harvest Harvest
Havij Havij
HonoluluBot Heritrix
Humanlinks IDBTE4M
HybridBot IRLbot
IDBot Id-search
IlseBot
Image Fetch
Image Sucker Image Sucker
InfoTekies IndeedBot
Indy Library
InterGET
Internet Ninja Internet Ninja
JOC Web Spider InternetSeer
Jbrofuzz Iskanie
JennyBot JamesBOT
Jetty JetCar
JustView JustView
Keyword Density
Kinza Kinza
LWP::Simple
Lanshanbot Lanshanbot
Larbin Larbin
LeechGet
Libwhisker Libwhisker
Likse Lightspeedsystems
LinkScan LinkScan
Linkbot LinkextractorPro
Lipperhey Spider LinqiaMetadataDownloaderBot
Lmspider LinqiaScrapeBot
Lipperhey
Ltx71 Ltx71
MJ12bot MSFrontPage
Mag-Net Majestic SEO
Magnet Majestic-SEO
Mail.RU_Bot
Majestic12 Majestic12
MarkWatch MarkMonitor
Mass Downloader Mass Downloader
MauiBot MauiBot
Mb2345Browser MeanPath Bot
Meanpathbot Meanpathbot
Minefield Metauri
Mister PiX Mister PiX
MolokaiBot Moblie Safari
Mojeek
Mr.4x3
Msrabot Msrabot
Musobot
NICErsPRO
Name Intelligence Name Intelligence
Nameprotect
Navroad Navroad
NetLyzer NetLyzer
NetMechanic NetMechanic
NetSpider NetSpider
NetZIP NetZIP
Netvibes Netcraft
Niki-bot
Nikto Nikto
NimbleCrawler
Nimbostratus
Ninja
Nuclei Nuclei
Nutch OpenLinkProfiler
OnCrawl
OpenVAS OpenVAS
Openfind Openvas
OrangeBot
OrangeSpider OrangeSpider
OutclicksBot PHPCrawl
PageAnalyzer POE-Component-Client-HTTP
Pandalytics PageGrabber
Panscient PageThing.com
Pavuk Papa Foto
PeoplePal
Piepmatz Piepmatz
Psbot Pimonster
Pixray
PleaseCrawl
ProPowerBot
Pu_iN Pu_iN
PyCurl Pump
RSSingBot
RankFlex
Rankivabot Rankivabot
ReGet RealDownload
RebelMouse Recorder
RedesScrapy RedesScrapy
Ripper RepoMonkey
Rogerbot RocketCrawler
SBIder SBIder
Scanbot SEOkicks-Robot
SEOstats
ScanAlert
Scrapy Scrapy
Screaming Screaming
ScreenerBot
ScrepyBot ScrepyBot
Searchestate
Seekport
SemanticJuice
Semrush
SemrushBot SemrushBot
SeoSiteCheckup SentiBot
Seomoz
Shodan Shodan
Siphon Siphon
Site Sucker
SiteCheckerBotCrawler SiteCheckerBotCrawler
Siteimprove SiteSucker
Sitebeam
Sitevigil Sitevigil
Snoopy Snake
Snapbot
SocialRankIOBot
Sogou web spider Sogou web spider
Sosospider Sosospider
Sottopop
SpaceBison SpaceBison
SpankBot Spammen
Spanner
Spbot Spbot
Sqlmap
Steeler Steeler
Stripper Stripper
Surfbot Sucker
Suzuran Sucuri
SuperBot
SurveyBot
Swiftbot
T0PHackTeam T0PHackTeam
T8Abot
Teleport Teleport
Telesphoreo TeleportPro
TheNomad Telesoft
Titan
Toata
Toweyabot Toweyabot
Tracemyfile Tracemyfile
Trendictionbot True_Robot
TurnitinBot URLy.Warning
TwengaBot UnisterBot
VCI Vacuum
Vagabondo Vagabondo
VeriCiteCrawler
Virusdie Virusdie
Voltron Voltron
WASALive-Bot WPScan
WEBDAV WWW-Mechanize
WWW-Collector-E WWW::Mechanize
Wallpapers WallpapersHD
Wallpapers/3.0
WeSEE
Web Collage Web Collage
Web Enhancer
Web Fuck
Web Sauger
WebAuto
WebBandit
WebCopier
WebGo IS
WebImageCollector
WebLeacher
Web Pix Web Pix
WebSauger WebBandit
WebFuck
WebGo IS
WebmasterWorldForumBot WebmasterWorldForumBot
Webshag Webshag
WebsiteExtractor Website Quester
Whack Whack
WinHTTrack Whacker
Widow
WiseGuys Robot
Wonderbot Wonderbot
Woobot Woobot
Xaldon WebSpider YoudaoBot
Zauba Zeus
ZoomBot ZmEu
ZoominfoBot
ZyBorg
archive.org_bot
arquivo-web-crawler
backlink-check backlink-check
cah.io.community cah.io.community
clark-crawler clark-crawler
com.plumanalytics com.plumanalytics
crawl.sogou.com crawl.sogou.com
crawler.feedback eCatch
evc-batch
facebookscraper
heritrix heritrix
internetVista monitor
ips-agent ips-agent
lwp-trivial iubenda-radar
mediawords lwp-request
magpie-crawler
muhstik-scan
pcBrowser pcBrowser
ripz ripz
s1z.ru
satoristudio.net satoristudio.net
scalaj-http
scan.lol scan.lol
seobility serpstatbot
seostar
sexsearcher
sitechecker.pro
siteripz siteripz
ubermetrics-technologies.com sp_auditbot
sysscan
trendiction.com
voyagerx.com
webgains-bot
webmeup-crawler
webpros.com webpros.com
x09Mozilla
x22Mozilla
xpymep1.exe
zgrab

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
approvedlocal.co.za adinterax.com
cindymatches.com conocer-sanabria.com
coccoc.com el-nation.com
facecup.top electrik-avenue.com
holidaypics.org free-floating-buttons.com
kostenloser-sex.com livetsomudvekslingstudent.bloggersdelight.dk
meteostate.com oakleyglassesonline.us
moneyzzz.ru of-ireland.info
playmsn.com petitions.whitehouse.gov
tracfone.com searchencrypt.com

924
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
03p.info 1000n1.ru
123movies.love 101raccoon.ru
178evakuator178.ru
1j7740kd.website
2itech.ru 2itech.ru
2x2fan.ru 4webmasters.com
3xforum.ro 5000-cotydzien.com
5-steps-to-start-business.com 8xv8.com
57883.net 98oi.ru
8gold.com aa9d046aab36af4ff182f097f840430d51.com
9icmzvn6.website aac500b7a15b2646968f6bd8c6305869d7.com
adimmix.com abcdefh.xyz
admanaerofoil.com adinterax.com
ads.tremorhub.com ads-cool.pro
adsfresh.men adservme.com
adtology.com adultactioncam.com
adzpower.com adultgalls.com
afslankpillen2017nl.eu advancedcleaner.com
akama.com advertex.info
alert-fdm.xyz advokateg.ru
alf-img.com agecheckadult.com
algerianembassy.co.in ahhjf.com
alif-ba-ta.com airlandsea.info
aksonural.ru
alert-jdh.xyz
alevinefesleri.com
all4invest.ru all4invest.ru
alldubai.biz all4wap.ru
alpharma.net allwidewallpapers.com
android-systems.ru alphavisions.net
animalrank.com amoi.tn
apartmentbay.ru amung.us
arenda-yeisk.ru animali.deagostinipassion.it
arvut.org anjalika.co.in
asdfg.pro anmysite.com
asrv-a.akamaihd.net apiluckyleapnet-a.akamaihd.net
asrvrep-a.akamaihd.net appsaurus.com
atley.eu.pn appsecurityr.com
aviav.org aquarium-pro.ru
aviva-limoux.com arcadeplayhouse.com
awency.com arkartex.ru
azbaseimages.net asia-forum.ru
babespcs.com autochoixspinelli.com
bamo.xsl.pt b00kmarks.com
bankofthewext.com babyfactory.fr
battle.net bagsonsale.online
bear.gotcher.us balkanfarma.ru
bedcapdealers.com bank.uz
best-coupon-offer.com bankcrediti.ru
bestbuy.ca banki76.ru
bestdooz.com beauby.ru
bestdraws.com bedandbreakfast.com
bet365.com begalka.xyz
bio-market.kz best-deals-products.com
betterhdporn.com
billiard-classic.com.ua
bitnote.co bitnote.co
biznesluxe.ru bjorkbacken.nu
biznesschat.net
bizru.info
blog.yam.com blog.yam.com
bmsco.co bloggen.be
bodybuilding-shop.biz blogig.org
bonkers.name blogporn.in
brandbucket.com blogs.rediff.com
break-the-chains.com bluesalt.co
brillianty.info bmw-ark.ru
bscodecs.com bolezniorganov.ru
btnativenav.com brandedleadgeneration.com
buy-forum.ru brandehk.dk
buy-loft.ru bravegirlsclub.com
buydissertation.net brianhenry.co
buyessayonline19.blogspot.ru briomotor.co
bvlgariwallet.xyz buchananshardware.com
bytimedance.ru bumble.cheapwebsitehoster.com
callejondelpozo.es bumskontakte.org
callmd5map.com burger-imperia.com
calstaterealty.us business-made-fun.com
camel-beach.com buyessay3.blogspot.ru
carsdined.org buyessaynow.biz
cctva.tv calvet.altervista.org
cdnnetwok.xyz cdncash.org
cfsrating.sonicwall.com cheap-pills-norx.com
chatroulette.video check-this-out-now.online
cheapbarbour.online chocolateslim-en-espana.com
cheapbelstaff.online chocolateslim-original.com
cheapmoncler.win chorus.terakeet.com
cheapsergiorossi.online christianlouboutinsaleonline.us
chelyabinsk.xrus.org cialgenisrx.com
cherrypointplace.ca ciceros.co
cineacademy.ru ciekawinki.pl
circlesl.com cleanallspyware.com
citizenclsdriveri7.pen.io clickcash.com
clickpapa.com
clickso.com
clothesforcash.com
coaching-netz.info
coccoc.com
coderstate.com
colehaanoutlet.store
compliance-checker.info
compliance-don.top
compliance-george.top
compliance-jack.top
compliance-jane.top compliance-jane.top
compliance-nelson.top contentsexpress.com
continent-e.tv converse.ddsoldes.fr
copblock.org copenergo.ru
counciltally.com counciltally.com
credit-online.ws crd.clan.su
creditmoney.com.ua crest3d.ru
cryptoswap.biz crynet.cc
cubs-jerseys.us cubs-jerseys.us
culmimg.pw customergrowthsystems.com
customchocolate.business-for-home.com cyclobenzaprinevstizanidine.blogspot.com
cxpromote.com cyse.tk
czat.wp.pl d-black.bz
daooda.com danashop.ru
data-mining.tk datract.com
data.vtc.pw dealwifi.com
deluxedumps.com decenttools.com
designdevise.com decorazilla.com
digitalfaq.com defenderxtactical.com
disruptingdinnerparties.com delta-line.men
documentbase.net derevesendeco.com
domainsatcost.com diminishedvalueoforegon.com
download-of-the-warez.blogspot.com dinkolove.ya.ru
downloadeer.net directivepub.com
doyouknowtheword-flummox.ml discovertreasurenow.com
drupa.com divatraffic.com
duawitchrarato.tk divku.ru
dumuelave.xyz doctormakarova.ru
e-biznes.info dogoimage.com
ecommerce-seo.com dolohen.com
econom.co domain.webkeyit.com
editmedios.com domainanalyzing.xyz
domaineaneblanc.com
domainsphoto.com
dorratex.tn
dostavka-v-krym.com
dotmass.top
drev.biz
e-avon.ru
earl-brown.info
eas-seo.com
eets.net
ekspresihati.info
ekto.ee
el-nation.com el-nation.com
eldiariodeguadalajara.com election.interferencer.ru
elektrischezigaretten1.blogse.nl elektrischezigarette2.devhub.com
elektrischezigaretten2.beeplog.com elektrischezigarettekaufen2.cowblog.fr
elektronischezigarette2.mex.tl elektrozigaretten1.webs.com
elidelcream.weebly.com eloconcream.blogspot.com
empathica.com eluxer.net
empis.magix.net en.altezza.travel
en.home-task.com energydiet-info.ru
ereko.ru englate.com
erotikchat-24.com eropho.com
exchanges-bet.com escortplius.com
essaypro.com
evrotekhservis.ru
excitacion.info excitacion.info
eyemagination.com expdom.com
eyessurgery.ru extener.org
ezb.elvenmachine.com ezigarettekaufen2.yolasite.com
ezigarettekaufen2.mpbloggar.se ezigarettenshop2.postbit.com
ezigarettenshop1.yolasite.com ezigaretteshop2.mywapblog.com
ezrvrentals.com f012.de
falllow.gq fable.in.ua
familienzahnaerzte.com
fanoboi.com
fanrto.com fanrto.com
fastcrawl.com fastfixing.tech
fearcrow.com fdzone.org
feeriaclub.ru
fetishinside.com fetishinside.com
fetlifeblog.com fifa-coins.online
fikasound.tk
fillmewithhappiness.com fillmewithhappiness.com
film-one.ru findacheaplawyers.com
findanysex.com findanysex.com
findclan.org floating-share-buttons.com
fishtauto.ru flooringinstallation-edmonton.com
formseo.com flytourisme.org
forum69.info forum20.smailik.org
forums.d2jsp.org free-deals.faith
fototravel.eu free-fbook-traffic.com
fr.netlog.com freewhatsappload.com
franecki.net frustrated-favorable.gq
free-share-buttons.com funtoonez.com
freegamesplay.online fxund.us
freetangodownload.com gallerily.com
funnel.co.za gameprimary.com
fusoradio.info gdebestkupit.ru
gallery.rennlist.com ge0ip.org
game-mmorpg.net
game-top.su
gateway.zscalertwo.net
gentamicineyedrops.blogspot.com
gepezz.info gepezz.info
germes-trans.com getdot.ru
get-free-social-traffic.com getlamborghini.ga
get-free-traffic-now.com getprismatic.com
gettpromos.com getyourimage.club
girlsfuckdick.com gidonline.one
given2.com girlspicsa.com
glcomputers.ru go2album.com
gloverid.site goblacked.com
gobongo.info gogps.me
goldandcard.ru golaya.pw
golden-catalog.pro
gosreg.amchs.ru gosreg.amchs.ru
graphicwe.org gotcher.us
greamimgo.pw green-tea.tv
gribkovye-zabolevaniya.com greenshop.su
gsasearchenginerankerdiscount.com groupmoney.ru
handicapvansarea.com guge.io
hao123.com gunsvicceadadebt.tk
hccoder.info guruofcasino.com
hdwalls.xyz gyffu.com
hermesbirkinhandbagoutlets.com hanink.biz.ly
hermesreplica.pw hayate.biz
hikesearch.net hdapp1008-a.akamaihd.net
hit-kino.ru hdimagelib.com
hkladys.com hidemyass.com
homelygarden.com hitcpm.com
hotcore.info hmmm.cz
hotgirlhdwallpaper.com host-protection.com
housemilan.ru hotxnights.info
howlongdoestizanidinestayinyoursystem.blogspot.com howlongdoestizanidinestayinyoursystem.blogspot.com
ideawheel.com howopen.ru
ideibiznesa2015.ru howtoclean.club
imagerydatabase.com hspline.com
imperia31.ru huhn.altervista.org
impotentik.com hundejo.com
increasewwwtraffic.info hunterboots.online
inmate-locator.us igrovyeavtomaty777.ru
isitpaleo.info incest-ru.com
itbc.kiev.ua indetiske.ya.ru
iwantmyfreecash.com indo-export.ru
iyasimasennka.com infokonkurs.ru
j-times.ru infoupdate.org
jagg.info innoslicon.com
japfm.com insta-add.pro
jav-fetish.site instakink.com
jmat.cn internetproviderstucson.com
justkillingti.me investmac.com
justprofit.xyz iopeninghours.co.uk
itrevolution.cf
ix20.ru
izhevsk.zrus.org
javcoast.com
javxxx18.com
jo24news.com
kadashihotel.com
kamalsinha.com kamalsinha.com
kellyonline.xyz
kerwinandcariza.com kerwinandcariza.com
keywordhouse.com kevblog.top
kinofak.net keywordsuggest.org
kiskinhouse.com kino2018.cc
klejonka.info kinomaniatv.pl
kndxbkdx.bloger.index.hr konpax.com
knogg.net konturkrasoty.ru
knowyournextmove.com koral.se
konteiner24.com laparfumotec.com
kovrenok.ru laxdrills.com
kredit-pod-zalog-krasnodar.ru letslowbefast.site
ktotut.net levaquin750mg.blogspot.com
kupit-adenu.ru li-er.ru
labvis.host.sk
larchik.net
law-check-nine.xyz
letsart.ru
life.biz.ua life.biz.ua
liky.co.ua limtu.ifmo.ru
lineavabit.it linkarena.com
lineshops.biz linkpulse.com
linkredirect.biz livingroomdecor.info
lionking-1994.blogspot.com
lirunet.ru
listiseltemournlan.gq
liverpool.gsofootball.com
ljusihus.se
lkbennettoutlet.online lkbennettoutlet.online
loftdigital.eu lol-smurfs.com
longlifelomilomi.info longgreen.info
lookingglassemb.com lovi-moment.com.ua
louisvuittonoutletstore.net lrac.info
lovasszovetseg.hu luckyshop.net.ua
lubetube.com lulea-auktionsverk.se
m1media.net lunamedia.co
macfix.life m292.info
machicon-ueno.info macdamaged.space
magicdiet.gq magazin-pics.ru
mahnwachen-helfen.info mastershef.club
manipulyator-peterburg.ru mathgym.com.au
manuscript.su meetlocalchicks.com
marblestyle.ru megaapteka.ru
marcogrup.com meget.co.za
marktforschung-stuttgart.com metascephe.com
medkritika.ru michellblog.online
mega-bony-2017.pl microsearch.ru
memberty.com milblueprint.com
metarip.ru miniads.ca
mexicosleevegastrectomy.com modabutik.ru
misslike.ru mrpornogratis.xxx
misswell.net music.utrolive.ru
mixed-wrestling.ru musicstock.me
mncrftpcs.com mustwineblog.com
mobilierland.com muznachas-service.ru
mokrayakiska.com mygameplus.com
monclercheap.xyz myghillie.info
moncleroutletonline.win mysex21.com
mvpicton.co.uk nardulan.com
myiptest.com narkologiya-penza.ru
mymercy.info narkologiya-voronezh.ru
mymobilemoneypages.com national-today-winning-winner.club
naperehresti.info naturalshair.site
narkologiya-peterburg.ru navalwiki.info
natali-forex.com newhairstylesformen2014.com
naturtreenspicerx.pw nodding-passion.tk
negociosdasha.com nofreezingmac.work
nerudlogistik.ru
netcheckcdn.xyz
nfljerseys.online
ngps1.ru
nikitabuch.com
nisuturnetdgu.tk
nmrk.ru
northfacestore.online northfacestore.online
norththeface.store notaria-desalas.com
notebook-pro.ru npoet.ru
nucia.biz.ly o-o-6-o-o.com
nudejapan.net offers.bycontext.com
obiavo.com offf.info
obiavo.net office2web.com
oda.as offside2.5v.pl
offergroup.info onclkads.com
ok-ua.info one-gear.com
ok.ru onlainbesplatno.ru
okroshki.ru online-hit.info
onemactrckr.com ordernorxx.com
oxotl.com osagonline.ru
pagesense.com partner-stop.men
paintingplanet.ru pawli.eu
parajumpersjakkesalgnorge.info percin.biz.ly
pattersonsweb.com perfection-pleasure.ru
pendelprognos.se perl.dp.ua
peugeot-club.org phpdevops.com
phuketscreen.com piccdata.com
picturesfrom.com picsearch.com
pigrafix.at picswe.com
pills24h.com pinsdaddy.com
pinapchik.com pix24x7.com
piski.top pizda.lol
pladform.ru plaff-go.ru
platesauto.com pogosh.com
plusnetwork.com popugaychiki.com
podshipniki-ntn.ru popunder.ru
porn555.com porno-home365.com
pornoslive.net pornodojd.ru
pornozhara.com pornosexrolik.com
pozdrawleniya.ru pornotubexxx.name
prchecker.info positive2b.ru
pricheski-video.com potoideas.us
princevc.com printie.com
privatefx.all4invest.info privatov-zapisi.ru
prizesbook.online proftests.net
promoforum.ru projefrio.com.br
prostitutki-astana.org prostitutki-rostova.org
prostitutki-tolyatti.org prostitutki-tolyatti.org
proxyradar.com q-moto.ru
psvita.ru
pyramidlitho.webs.com
quebec-bin.com quebec-bin.com
quick-seeker.com raisedseo.com
rcb101.ru rating-casino2021.ru
realizmobi.com realtytimes.com
rebuildermedical.com redirectme.net
remontbiz.ru regionshop.biz
remontvsamare.su responsinator.com
renewablewealth.com rfserial.net
renhacklids.tk risparmiocasa.bz.it
replicaclub.ru ritlweb.com
revistaindustria.com roleforum.ru
roznica.com.ua
rubanners.com rubanners.com
russintv.fr ruclicks.com
rybalka-opt.ru rucrypt.com
rumamba.com
rvtv.ru
sady-urala.ru sady-urala.ru
safe-app.net sanyuprojects.com
sampleletters.net saveindex.xyz
sax-sex.com scanner-julia.top
sbwealthsolutions.ca scripted.com
scanner-brian.top sdi-pme.com
scanner-george.top search-goo.com
scanner-julianna.top
scmor.ilxc.cc
screpy.com
sdelatmebel.ru
searchimpression.com searchimpression.com
see-your-website-here.com searchinterneat-a.akamaihd.net
sergiorossistore.online semalt.com
service-core.ru semrush.com
sevendays.com.ua semxiu.com
sexvideo-sex.com seocheckupx.com
sexy-pings.com seokicks.de
sexyteens.hol.es servisural.ru
shariki-zuma-lines.ru serw.clicksor.com
shmetall.com.ua sexgalleries.top
shopperifymac.com sharebutton.to
shtora66.ru shareyards.com
shisha-swag.de
similardeals.net
sindragosa.comxa.com sindragosa.comxa.com
site5.com sitechecker.pro
siteripz.net siteheart.net
sitevaluation.org siteimprove.com
slowmac.tech skyway24.ru
snts.shell-pmr.ru smart-scripts.com
soft-terminal.ru social-vestnik.ru
softtor.com socialbutton.xyz
soietvousmaime.fr spacash.com
solitaire-game.ru
sophang8.com
space2019.top
spaceshipad.com spaceshipad.com
spasswelt.net special-porn.com
spidtest.space
spinazdrav.ru
spinnerco.ca spinnerco.ca
splendorsearch-a.akamaihd.net splendorsearch-a.akamaihd.net
spravka-medosmotr.ru sport-video-obzor.ru
srgwebmail.nl srecorder.com
ssconstruction.co stard.shop
stariy-baku.com steame.ru
staticfs.host stillmiracle.com
stpicks.com stop-gepatit.te.ua
strag-invest.ru strana-solnca.ru
streha-metalko.si stroiminsk.org
styro.ru studiofaca.com
suggest-keywords.com sucsesofinspiration.com
supermama.top sugarlyflex.pw
svensk-poesi.com suhanpacktech.com
sweepstakes.rewardit.com sumo.com
swinger-mobil.net superkanpo.com
t-bygg.com superstarfloraluk.com
surflinksmedical.com
svarkagid.com
svbur.ru
svnuppsalaorebro.se
swsociety.se
syvertsen-da.no
tabakur77.com tabakur77.com
tampabaywatch.org tagil.zrus.org
tedy.su tamada69.com
telefonsexi.com tanieaukcje.com.pl
terraclicks.com tasteidea.com
testingads.pro td-33.ru
teesdaleflyballclub.co.uk
telefonsexsofort.tk
templates.franklinfire.co
terrafootwear.us
thecoolimages.net thecoolimages.net
thesmartsearch.net
timeallnews.ru timeallnews.ru
titan-ads.life tizanidinedosageforsleep.blogspot.com
tizanidineformigraines.blogspot.com tizanidinedruginteractions.blogspot.com
tizanidinehydrochloride4mgstreetvalue.blogspot.com tizanidineduringpregnancy.blogspot.com
tizanidineinfo.blogspot.com tkanorganizma.ru
tizanidinesideeffects.blogspot.com todohr.com
tizanidinevscyclobenzaprine.blogspot.com torture.ml
tjkckpytpnje.com toursmaps.com
tongkatmadura.info track2.shop
top10-online-games.com tracksz.co
topbestgames.com traffixer.com
torrentgamer.net truck-addzilla.life
toys.erolove.in trumpetedextremes.com
trackmedia101.com trustedhealthtips.com
trafficshaper.com
tsstcorpcddvdwshbbdriverfb.aircus.com
tuberkulezanet.ru
tuberkuleznik.ru
tula.mdverey.ru
turvgori.ru
txxx.com txxx.com
tyumen.xrus.org tytoona.com
u17795.netangels.ru u17795.netangels.ru
ukkelberg.no u555u.info
ukrobstep.com umekana.ru
unrealcommander.com upupa.net
urdoot.win urengoy.pro
uvozdeckych.info urlcut.ru
varikozdok.ru usdx.us
venerologiya.com ustion.ru
ventelnos.com vapomnoncri.tk
vertaform.com vapsy.com
video-chat.cn vasileostrovsky-rayon.ru
videochat.tv.br veerotech.com
videosbox.ru vektorpress.ru
videositename.com veles.shop
volume-pills.biz vereo.eu
vtc.pw vesnatehno.com
watch-movies.ru viagroid.ru
viteonlusarezzo.it
voprosotvet24.ru
vpnhowto.info
vzglyadriv.kg
vzlom-na-zakaz.com
vzlomsn.org
walkme.com
wallpapersdesk.info
waterpurifier.club
web.cvut.cz
webix.me webix.me
webradiology.ru website-stealer.nufaq.com
weekes.biz.tc
wemedinc.com
wesharepics.info
whatsappbot.flyland.ru whatsappbot.flyland.ru
whatzmyip.net where-toget.com
whereverdesperate.gq whereverdesperate.gq
worldlovers.ru whipme.yopoint.in
worldtraveler.world whiteproduct.com
wormix-cheats.ru windowssearch-exp.com
wrona.it wjgony.com
wrz0iuebwhp5fg.freeddns.com wleuaprpxuvr.ga
wstroika.ru worldoffiles.ru
www.pinnacle-bets.com www.888.com
xblognetwork.com xlolitka.com
xn-----7kceclhb4abre1b4a0ccl2fxch1a.xn--p1ai xn-----8kcatubaocd1bneepefojs1h2e.xn--p1ai
xn----7sbaaabaei0cc8aj5bj0bncejx.xn--p1ai xn--b1addnj3cah.xn--p1ai
xn----7sbahjd3btneuw1joc.xn--p1ai xnxx699.com
xn----9sbebi2bvzr7h.xn--p1ai xxlargepop.com
xn--24-glceagatoq7c2a6ioc.xn--p1ai xxx-treker.ru
xn--hxazdsfy.blogspot.com xxxnatelefon.ru
xpresscare.ru yhit.press
xrus.org youbrainboost.asia
xsfetish.org youjizz.vc
xtrafficplus.com yurgorod.ru
xxxhdvideo.site zarenica.net
xxxmania.top zatjmuzu.info
xxxtube69.com zdesformula.ru
yebocasino.com zeleznobeton.ru
youtube-downloader.savetubevideo.com zkjovpdgxivg.ga
yuweng.info znakomstva-piter78.ru
za-fun-offer.com zoogdisany.com
zebradudka.com zscaler.net
zebramart.ru zvetki.ru
zeg-distribution.com
zeroredirect10.com
zeroredirect7.com
zhorapankratov7.blogspot.com
zigarettenonlinekaufen1.blox.pl
zmoda.hostreo.com
znaturaloriginal.com

482
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
20pascals.nl 2itech.ru
3weekdiet.com 3-letter-domains.net
40cg.com 5elementov.ru
4istoshop.com aanapa.ru
4ur.click admanaerofoil.com
8si.ru adssafeprotected.com
91abcw.com advancedcleaner.com
aad1f4acb0a373420d9b0c4202d38d94fa.com agreda.pluto.ro
adrenalin-stk.ru ahmedabadwebs.com
ads.gold aihelen.net
adultfriendfinder.com aksonural.ru
adventureparkcostarica.com alfapro.ru
alphavisions.net alienwheel.es
amehdaily.com amateurgalls.com
animalrank.com anmysite.com
animebox.com.ua app-ready.xyz
anti-virus-removal.info apple.com-webbrowsing-security.review
apimountainbikei-a.akamaihd.net aquarium-pro.ru
appearance-cool.com ardimobileinfo.ml
apple.com-webbrowsing-security.science autonew.biz
arabseyes.com awaybird.ru
arclk.net baikaleminer.com
arenda-yeisk.ru bankmib.ru
arvut.org bayareaaeroclub.org
asrv-a.akamaihd.net beauty-b0x.pl
aucoinhomes.com berdasovivan.ru
ausmepa.org.au bestserials.com
ayodhya.co bestwebsiteawards.com
badavit.com.ua bestwebsitesawards.com
besthomemadepornsites.com bif-ru.info
betwinservice.com bimatoprost-careprost.com
bigpenisguide.com bnt-team.com
bioca.org boltalko.xyz
board.f00d.de boo-arts.com
btvn.ru breastaugmentation.co.za
buy-cheap-online.info brus.city
callejondelpozo.es budpost.com.ua
canzoni.ru buynorxx.com
centraletermice.us buzzzg.men
ceotrk.com cartiertrinity.xyz
cfjump.com cascadelink.org
cheapmoncler.pw cashonads.com
cialischsrx.com casinopinup-wins.com
cjmc.info chcu.net
cleanpcnow.com cheap-trusted-backlinks.com
clmforexeu.com cheapsergiorossi.online
club-samodelkin.ru christianlouboutinreplica.win
compliance-willy.top cialischmrx.com
compucelunlock.net citizenclsdriveri7.pen.io
coslab.club civilwartheater.com
cosmetic.donna7753191.ru cleanallvirus.com
costablue.xyz clickcash.com
crystalslot.com cntravelre.com
cupday.com comissionka.net
cyclobenzaprinevstizanidine.blogspot.com compliance-walter.top
dafatiri.com conocer-sanabria.com
dandiyabeats.in cool-wedding.net
darmebel.com.ua cordstrap.cc
cubs-jerseys.us
customergrowthsystems.com
dailyfinancefix.com
data-ox.com
dcj-nn.ru
delfin-aqua.com.ua delfin-aqua.com.ua
dengi-pod-zalog-nedvizhimosti.ru dev-seo.blog
design-ideas.info dieta-personalna.pl
dinosaurus.site digilander.libero.it
domainsphoto.com disruptingdinnerparties.com
dolohen.com
domain.webkeyit.com
domination.ml
downtuptv.gq downtuptv.gq
e-avon.ru dtm-spain.com
eas-seo.com eas-seo.com
ekosmetyki.net.pl easycommerce.cf
elektrozigaretten2.yn.lt ebooknovel.club
elmacho.xyz efnor-ac.com
erotikchat-24.com ekn-art.se
errorfixing.space elvenar.com
esnm.ru en.home-task.com
esopini.com eupornstar.info
essay-writing.work exoneration-project.us
exlarseva.webblog.es expresstoplivo.ru
extremez.net fidelityfunding.com
f00kclan.de financetip.eu
fapgon.com findacheaplawyers.com
felizporno.com fingerprintjs.com
filerockstar298.weebly.com fitfloponline.store
findanysex.com fok.nl
flowwwers.com formseo.com
forodvd.com g33.org
forums.d2jsp.org galleryawesome.com
franklinfire.co gamezblox.com
free-social-buttons.xyz gemara.com
freshberry.com.ua
fuckingawesome.com
funnymama.com
funponsel.com
gamebackyard.com
gay-site.store
gay.adultgalls.com
gdcentre.ru
generic-pills-online.com generic-pills-online.com
get-free-traffic-now.com girls-ufa.ru
getlamborghini.ga glass-msk.ru
goldadpremium.com gsasearchengineranker.site
graphics8.info hatedriveapart.com
gsasearchengineranker.top headpress.ru
handicapvansarea.com heartofbeijing.blogspot.com
hanink.biz.ly heroz.fr
heliko.no highland-homes.com
hentaiheroes.com hotelcrocenzi.sm
highspeed5.net hully.altervista.org
highstairs-a.akamaihd.net ifirestarter.ru
hitsbox.info igru-xbox.net
hledejvshopech.cz imicrovision.com
hobbyhuren-datenbank.com inboxdollars.com
hopeonthestreet.co.uk interior-stickers.ru
houston-vikings.com invest-pamm.ru
hybrid.ru iqbazar.ru
i-midias.net.br iqs.biz.ua
imfamous.info istanbulit.com
impotentik.com itag.pw
intellektmedia.at itservicesthatworkforyou.com
intermesh.net ivanstroi.ru
internetartfair.com javxxx18.com
istmira.ru journeydownthescale.info
itrevolution.cf jyrxd.com
jeremyeaton.co kanimage.com
joyceblog.top katadhin.co
jwss.cc kazinogames.lv
keywordblocks.com koleso24.com.ua
kletkimehan.ru ktotut.net
komp-pomosch.ru kutikomi.net
konpax.com kuzinsp.ru
kumuk.info labelwater.se
laparfumotec.com laexotic.com
linkpulse.com lafourmiliaire.com
liver-chintai.org lalalove.ru
lombardfinder.ru lechtaczka.net
longadventure.com letmacworkfaster.site
lostaruban.com linkrr.com
m.b00kmarks.com lirunet.ru
masserect.com liveinternet.ru
master-muznachas.ru lombia.com
mcar.in.ua m1media.net
medicinacom.ru malwareremovalcenter.com
mhtr.be marcowebonyodziezowe.pl
microsearch.ru maridan.com.ua
miniature.io max-eclat.men
mountainstream.ms mensandals.xyz
microstatic.pl
mmostrike.ru
moesonce.com
moi-glazki.ru
monarchfind-a.akamaihd.net
moonci.ru
mulberryoutletonlineeu.com
muz-shoes.ru muz-shoes.ru
mybackgroundlandscape.blogspot.com mybackgroundlandscape.blogspot.com
myhealthcare.com mydoctorok.ru
myxdate.info myprintscreen.com
narkologiya-voronezh.ru newstraveller.ru
natali-forex.com newstudio.tv
naturtreenspicerx.pw newtechspb.ru
naughtyconnect.com nucia.biz.ly
nbsproject.ru obiavo.in
no-fuel.org oklogistic.ru
nomuos.it omoikiri-japan.ru
noumeda.com onlinemeetingnow.com
nudo.ca ozas.net
nyfinance.ml panchro.co.uk
odesproperty.com pandarastore.top
okmedia.sk partnerads.men
online-podarki.com photokitchendesign.com
onlineku.com photorepair.ru
onlinemegax.com pic2fly.com
ooo-gotovie.ru picture-group.com
oralsexfilme.net play-movie.pl
ororodnik.goodbb.ru
parajumpersjakkesalgnorge.info
pathwhelp.org
pc-virus-d0l92j2.pw
perederni.net
php-market.ru
pinapchik.com
plastjulgranar.se
polcin.de polcin.de
porno-home365.com popugaychiki.com
pornosmola.info pornhub-forum.ga
pornoxxx.com.mx pozdrawleniya.com
pornstartits.xblog.in priceg.com
portadd.men prize44.com
presleycollectibles.com produkto.net
priora-2.com prostitutki-kharkova.org
prostitutki-yaroslavlya.org prostitutki-kiev.org
pussyfleet.com pushdata.sendpulse.com
rangjued.com pxhdwsm.com
redbottomheels.xyz qcstrtvt.bloger.index.hr
responsinator.com renecaovilla.online
rethinkwasteni.info rennlist.com
rockma.se rfserial.net
royalcar-ufa.ru ringtonepartner.com
rusexy.xyz royalvegascasino.com
s1z.ru rus-pornuha.com
saddiechoua.com rusprostitute.com
scanner-nelson.top sa-live.com
search-goo.com scanner-willy.top
sexphoto.site scat.porn
screpy.com
securesmrt-dt.com
seofirmreviewsus.info
sexuria.net sexuria.net
sexyali.com sexyteens.hol.es
shemalegalls.blogporn.in sexytrend.ru
shoplvlv.us shell-pmr.ru
sicfor.bcu.cc siteimprove.com
sizeplus.work sitevalued.com
skanninge.se slomm.ru
social-s-hhh.xyz social-buttons.xyz
social-s-iii.xyz solmarket.by
speedup-my.site sosdepotdebilan.com
storehouse.ua spacash.com
strag-invest.ru spymac.net
streha-metalko.si squidoo.com
suggest-keywords.com standardchartered-forex.com
supermama.top stmassage.ru
tds-advert002.info stopnarco.ru
thfox.com streetfooduncovered.com
tizanidinehcl2mgtablet.blogspot.com takeprofitsystem.com
torture.ml thegolfclub.info
traffixer.com themestotal.com
try-rx.com tonerbox.kz
tytoona.com trafficgenius.xyz
tzritel.tk trion.od.ua
ua.tc truck-addzilla.life
umekana.ru tsyndicate.com
umnovocaminho.com tuberkuleznik.ru
unlimitdocs.net unisexjewelry.org
utrolive.ru upstore.me
veselokloun.ru uvozdeckych.info
video-chat.cn uzungil.com
vapomnoncri.tk
vesnatehno.com
vip-dom.in vip-dom.in
vizag.kharkov.ua vitoriacabos.com
vkmusics.ru vseigru.one
vladimir.xrus.org wallpaperaccess.com
vse-pesni.com wallpapers-best.com
vykup-avto-krasnodar.ru webmonetizer.net
vzubah.com webs.com
wait3sec.org weburok.com
we-are-gamers.com weddingdresses.xyz
webenlace.com.ar wingsoffury2.com
wedding0venues.tk wnoz.de
whiteelephantwellington.com x-lime.net
wholesalejerseysgaa.com xvideosbay.com
wineration.com y8games-free.com
wleuaprpxuvr.ga youjizz.com
www.kabbalah-red-bracelets.com youporn-ru.com
xmlinde.com youtoner.it
xn----7sbifcamovvfggw9d.xn--p1ai ypmuseum.ru
xn--e1aggki3c.xn--80adxhks zebramart.ru
yachts-cruise.info zoolubimets.ru
youghbould.wordpress.com zrelaya.pw
yuweng.info zvuker.net
za-fun-offer.com
zajm-zalog-krasnodar.ru
zarajbuilders.com
zeroredirect.com

10
dev-tools/test_units/ratelimittest-beta.txt
View file

@ -581,14 +581,4 @@
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html> </html>

10
dev-tools/test_units/ratelimittest-master.txt
View file

@ -581,14 +581,4 @@
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html> </html>

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.173 0; 10.1.0.45 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.06.3150 ### Version: V4.2022.06.3151
### Updated: Mon Jun 6 10:03:40 UTC 2022 ### Updated: Mon Jun 6 22:01:20 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.06.3150 ### Version: V4.2022.06.3151
### Updated: Mon Jun 6 10:03:40 UTC 2022 ### Updated: Mon Jun 6 22:01:20 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##