vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-03 19:20:16 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2022.06.3152 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2022-06-07 10:09:29 +00:00
parent 55de843352
commit 52cf7c2b06
48 changed files with 108146 additions and 108126 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.06.3151 #### Version: V4.2022.06.3152
#### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.06.3151 #### Version: V4.2022.06.3152
#### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -14,7 +14,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2022.06.3151 #### Version: V4.2022.06.3152
#### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

13380
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2022.06.3151 #### Version: V4.2022.06.3152
#### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

13384
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

13384
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

13384
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

13384
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.45 1; 10.1.1.69 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.45 0; 10.1.1.69 0;
127.0.0.1 0; 127.0.0.1 0;

13384
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.45 1; 10.1.1.69 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.45 0; 10.1.1.69 0;
127.0.0.1 0; 127.0.0.1 0;

13384
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.45 1; 10.1.1.69 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.45 0; 10.1.1.69 0;
127.0.0.1 0; 127.0.0.1 0;

13384
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
3151 3152

13384
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

13384
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.110.187.78 0; 20.245.112.238 0;

13384
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.45 1; 10.1.1.69 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.45 0; 10.1.1.69 0;
127.0.0.1 0; 127.0.0.1 0;

13384
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.45 1; 10.1.1.69 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.45 0; 10.1.1.69 0;
127.0.0.1 0; 127.0.0.1 0;

13384
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.45 1; 10.1.1.69 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.45 0; 10.1.1.69 0;
127.0.0.1 0; 127.0.0.1 0;

13384
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.110.187.78 0; 20.245.112.238 0;

13384
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.110.187.78 0; 20.245.112.238 0;

13384
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.45 1; 10.1.1.69 1;
127.0.0.1 1; 127.0.0.1 1;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
Dotbot ECCP/1.0
IDBot MFC_Tear_Sample
Jorgee MQQBrowser
Leap MegaIndex.ru
Seekport QueryN Metasearch
Stripper WPScan
Telesphoreo Wprecon
VB Project arquivo-web-crawler
arquivo.pt linkdexbot
domainsproject.org sitechecker.pro

310
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
01h4x.com 360Spider
404checker 404enemy
AIBOT 80legs
ALittle Client ADmantX
ASPSeek ASPSeek
Aboundex AiHitBot
Aipbot
AllSubmitter AllSubmitter
Alligator
Anarchy Anarchy
Anarchy99 Anarchy99
Ankit
Anthill
Apexoo Apexoo
Aspiegel
Atomseobot Atomseobot
AwarioRssBot AwarioRssBot
BDCbot
BDFetch BDFetch
BackStreet BackDoorBot
BackWeb BackWeb
Backlink-Ceck
Barkrowler
Battleztar Bazinga Battleztar Bazinga
Bigfoot
Bitacle
BlackWidow
Blackboard
Blow
Bolt Bolt
Brandprotect Brandprotect
Brandwatch
Buck
Buddy
BuiltWith BuiltWith
Bullseye BuzzSumo
CATExplorador CCBot
ChinaClaw Cegbfeieh
Citoid CherryPicker
Claritybot Chlooe
Cogentbot Cliqzbot
Collector Cocolyzebot
Copier Copier
CopyRightCheck Cosmos
Crawling at Home Project
Curious
Custo Custo
CyotekWebCopy
DIIbot DIIbot
DSearch DSearch
DTS Agent DTS Agent
DatabaseDriverMysqli
Demon Demon
Disco Dirbuster
Discobot
Dispatch Dispatch
DnBCrawler-Analytics DittoSpyder
DnyzBot DomCopBot
DomainAppender DomainCrawler
DomainSigmaCrawler DomainStatsBot
Domains Project ECCP/1.0
Download Wonder EMail Siphon
Dragonfly EasyDL
Exabot Ecxi
Express WebPictures Evil
ExtractorPro ExtractorPro
Extreme Picture Finder EyeNetIE
FHscan FemtosearchBot
Fimap
Firefox/7.0 Firefox/7.0
Foobot Flunky
FyberSpider FrontPage
Fyrebot GalaxyBot
G-i-g-a-b-o-t GermCrawler
GT::WWW Getintent
GetRight Go-Ahead-Got-It
GetWeb
Gigabot
Go!Zilla
Gotit
Grafula Grafula
GrapeshotCrawler GrapeshotCrawler
HMView
HTMLparser HTMLparser
HaosouSpider HTTrack
HonoluluBot Harvest
HybridBot Havij
Heritrix
IDBot
IRLbot IRLbot
Id-search Iblog
IlseBot
Image Fetch Image Fetch
Indy Library IndeedBot
InfoNaviRobot
Intelliseek Intelliseek
InterGET InterGET
Internet Ninja Internet Ninja
JennyBot IstellaBot
JetCar JOC Web Spider
JikeSpider JamesBOT
Jbrofuzz
Jetty
Joomla Joomla
Jorgee
JustView
Jyxobot
Kenjin Spider Kenjin Spider
Keyword Density Keybot Translation-Search-Machine
Kozmosbot LWP::Simple
Lanshanbot Lanshanbot
LexiBot Leap
LibWeb LeechGet
Libwhisker LieBaoFast
Lightspeedsystems Lightspeedsystems
LinkScan Likse
LinkWalker
Linkbot
LinksManager
LinqiaMetadataDownloaderBot LinqiaMetadataDownloaderBot
LinqiaRSSBot Lipperhey
Lipperhey Spider Ltx71
Litemage_walker MIDown tool
MFC_Tear_Sample MJ12bot
MIIxpc MSFrontPage
MTRobot MSIECrawler
Magnet Magnet
Mail.RU_Bot Majestic-SEO
MarkMonitor MarkMonitor
MarkWatch Masscan
Mass Downloader Mata Hari
Mb2345Browser
MeanPath Bot
Meanpathbot Meanpathbot
MegaIndex.ru
MicroMessenger
Microsoft Data Access Microsoft Data Access
Microsoft URL Control Microsoft URL Control
Minefield Minefield
Moblie Safari Morfeus Fucking Scanner
Mojeek
Mojolicious
MolokaiBot
Mr.4x3
Msrabot Msrabot
NearSite Musobot
Nessus NPbot
Needle
Net Vampire
NetLyzer NetLyzer
NetZIP Nettrack
Netcraft Nimbostratus
Nibbler Nuclei
Nmap Openvas
Offline Navigator OrangeBot
OnCrawl
Openfind
OrangeSpider
OutclicksBot OutclicksBot
OutfoxBot Page Analyzer
PECL::HTTP
PageThing.com PageThing.com
PeoplePal PeoplePal
Petalbot
Pi-Monster Pi-Monster
Picsearch Picsearch
Piepmatz Pimonster
PleaseCrawl
Pockey Pockey
ProPowerBot ProWebWalker
Pump Probethenet
Psbot
PxBroker
Quick-Crawler Quick-Crawler
RSSingBot RSSingBot
RankFlex RankingBot
Rankivabot ReGet
Recorder Recorder
RedesScrapy RocketCrawler
RepoMonkey Rogerbot
SISTRIX SEOkicks-Robot
SMTBot SEOprofiler
Scanbot SEOstats
ScoutJet
Scrapy Scrapy
ScrepyBot Screaming
Seekport SearchmetricsBot
SemanticJuice
Semrush Semrush
SeobilityBot SeoSiteCheckup
Seomoz
Shodan Shodan
Site Sucker Site Sucker
SiteLockSpider SiteLockSpider
Sitebeam SiteSnagger
SiteSucker
Siteimprove
SlySearch SlySearch
Sociscraper Sociscraper
Sogou web spider
Sosospider
Sottopop Sottopop
Spammen SpaceBison
SpankBot
Spanner Spanner
Spinn3r
SputnikBot SputnikBot
Sqlmap Sqlmap
Sqlworm SuperBot
Sqworm
SuperHTTP SuperHTTP
SurveyBot
Swiftbot
Szukacz Szukacz
T0PHackTeam TeleportPro
T8Abot Telesoft
Telesphorep Telesphoreo
The Intraformant TightTwatBot
TheNomad
Titan Titan
Tracemyfile Tracemyfile
Trendiction
Turingos
Turnitin
TurnitinBot TurnitinBot
TwengaBot
Twice
URLy Warning
URLy.Warning URLy.Warning
Upflow
VCI
VelenPublicWebCrawler VelenPublicWebCrawler
VeriCiteCrawler VeriCiteCrawler
Virusdie VidibleScraper
Voltron WBSearchBot
WEBDAV
WISENutbot WISENutbot
Wallpapers Web Pix
Wallpapers/3.0
Web Auto
Web Collage
WebAuto
WebBandit
WebCollage WebCollage
WebCopier WebCopier
WebFetch
WebFuck
WebImageCollector
WebPix WebPix
WebReaper WebSauger
WebStripper
WebWhacker WebWhacker
Webalta WebmasterWorldForumBot
Website Quester Webshag
WebsiteQuester WebsiteQuester
Whatweb Webster
Who.is Bot
Widow Widow
WinHTTrack Wonderbot
Woobot
Wprecon
Xenu
YoudaoBot YoudaoBot
Zeus
Zitebot
ZmEu ZmEu
ZoomBot ZoominfoBot
ZumBot
arquivo-web-crawler
arquivo.pt arquivo.pt
autoemailspider
backlink-check backlink-check
cah.io.community cah.io.community
coccocbot
crawl.sogou.com crawl.sogou.com
crawler.feedback crawler.feedback
eCatch
ips-agent ips-agent
iubenda-radar iubenda-radar
lwp-request
lwp-trivial lwp-trivial
magpie-crawler
meanpathbot meanpathbot
oBot mediawords
page scorer netEstate NE Crawler
pcBrowser ripz
plumanalytics scalaj-http
polaris version seoscanners
probe-image-size
s1z.ru
satoristudio.net
seocompany.store
seostar seostar
serpstatbot
sogouspider sogouspider
sp_auditbot
spyfu spyfu
tAkeOut
trendiction.com trendiction.com
trendiction.de trendiction.de
voyagerx.com
webgains-bot webgains-bot
x09Mozilla x22Mozilla
xpymep1.exe zauba.io
zgrab

300
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
80legs
ADmantX ADmantX
Abonti
Aboundexbot Aboundexbot
Acunetix Acunetix
AhrefsBot Alligator
AiHitBot Anarchy
AlphaBot Anarchy99
Ankit
Anthill Anthill
Apexoo
Aspiegel Aspiegel
Asterias Attach
AwarioRssBot
AwarioSmartBot AwarioSmartBot
BBBike
BDCbot BDCbot
BackDoorBot BackDoorBot
BackWeb
Backlink-Ceck Backlink-Ceck
Barkrowler
Battleztar Bazinga
BetaBot BetaBot
Blow Bigfoot
Boardreader Black Hole
Blackboard
BotALot
Brandwatch Brandwatch
Buddy BuiltWith
BuzzSumo Bullseye
CATExplorador BunnySlippers
CSHttp CCBot
CODE87
Calculon Calculon
CazoodleBot
Cegbfeieh Cegbfeieh
CheTeam CheeseBot
Cliqzbot CherryPicker
ChinaClaw
Cloud mapping Cloud mapping
Collector Collector
Copier
CopyRightCheck CopyRightCheck
Copyscape Copyscape
Cosmos
Crawling at Home Project Crawling at Home Project
CrazyWebCrawler CrazyWebCrawler
CrunchBot Custo
CyotekWebCopy CyotekWebCopy
DataCha0s DTS Agent
Devil DatabaseDriverMysqli
Disco Demon
Discobot Deusu
Dirbuster
Discoverybot
Dispatch
DittoSpyder DittoSpyder
DomCopBot DomCopBot
Domains Project DomainStatsBot
Dragonfly Dotbot
Download Wonder
Drip Drip
EMail Wolf EMail Wolf
Ebingbong EirGrabber
Ecxi Evil
EroCrawler FHscan
Exabot Fimap
ExtLinksBot
ExtractorPro
Ezooms
FemtosearchBot
FlashGet
Flunky Flunky
Foobot
Freeuploader
Fuzz Fuzz
FyberSpider FyberSpider
G-i-g-a-b-o-t G-i-g-a-b-o-t
GT::WWW GalaxyBot
Genieo Genieo
GermCrawler
GetWeb GetWeb
Getintent
Gigabot
GoZilla GoZilla
Grabber GrapeFX
GrapeshotCrawler GrapeshotCrawler
HMView
HTMLparser
HTTP::Lite
HaosouSpider HaosouSpider
Harvest HybridBot
Havij
Heritrix
IDBTE4M IDBTE4M
IRLbot IRLbot
Id-search Id-search
IlseBot
Image Fetch
Image Sucker
IndeedBot IndeedBot
Indy Library Intelliseek
InterGET
Internet Ninja Internet Ninja
InternetSeer IstellaBot
Iskanie JOC Web Spider
JamesBOT JamesBOT
JetCar Jbrofuzz
JustView JennyBot
Jetty
JikeSpider
Joomla
Jorgee
Kenjin Spider
Keyword Density
Kinza Kinza
Lanshanbot Kozmosbot
LWP::Simple
Larbin Larbin
Libwhisker LeechFTP
LeechGet
LieBaoFast
Lightspeedsystems Lightspeedsystems
LinkScan LinkScan
LinkextractorPro LinksManager
LinqiaMetadataDownloaderBot LinqiaRSSBot
LinqiaScrapeBot LinqiaScrapeBot
Lipperhey Lipperhey
Ltx71 Litemage_walker
MSFrontPage MJ12bot
MSIECrawler
MTRobot
Majestic SEO Majestic SEO
Majestic-SEO Masscan
Majestic12 MegaIndex.ru
MarkMonitor
Mass Downloader
MauiBot
MeanPath Bot
Meanpathbot
Metauri
Mister PiX
Moblie Safari Moblie Safari
Mojeek
Mr.4x3 Mr.4x3
Msrabot Musobot
Name Intelligence Name Intelligence
Nameprotect Nessus
Navroad NetAnts
NetLyzer NetLyzer
NetMechanic NetMechanic
NetSpider
NetZIP
Netcraft Netcraft
Niki-bot Netvibes
Nikto Nikto
NimbleCrawler NimbleCrawler
Nimbostratus Nimbostratus
Ninja Ninja
Nmap
Nuclei Nuclei
OnCrawl
OpenLinkProfiler OpenLinkProfiler
OpenVAS OpenVAS
Openfind
Openvas Openvas
OrangeBot
OrangeSpider OrangeSpider
PHPCrawl OutfoxBot
POE-Component-Client-HTTP PECL::HTTP
PageGrabber PageScorer
PageThing.com PageThing.com
Papa Foto Pandalytics
Piepmatz PeoplePal
Petalbot
Pimonster Pimonster
Pixray
PleaseCrawl PleaseCrawl
Pockey
ProPowerBot ProPowerBot
ProWebWalker
Probethenet
Pu_iN Pu_iN
Pump Quick-Crawler
RSSingBot RSSingBot
RankFlex RankActive
Rankivabot RankurBot
RealDownload Reaper
RebelMouse
Recorder Recorder
RedesScrapy RedesScrapy
RepoMonkey RepoMonkey
RocketCrawler Rogerbot
SBIder
SEOkicks-Robot SEOkicks-Robot
SEOstats SEOlyticsCrawler
SISTRIX
SMTBot
SalesIntelligent
ScanAlert ScanAlert
Scrapy Scrapy
Screaming
ScrepyBot ScrepyBot
SemrushBot Seekport
SentiBot SeoSiteCheckup
Seomoz
Shodan Shodan
Siphon Siphon
Site Sucker SiteSnagger
SiteCheckerBotCrawler
SiteSucker
Sitebeam Sitebeam
Sitevigil Sitevigil
Snake SmartDownload
Snapbot Snapbot
SocialRankIOBot Snoopy
Sogou web spider Sottopop
Sosospider
SpaceBison SpaceBison
Spammen
Spbot Spbot
Steeler Sqlworm
Sqworm
Stripper Stripper
Sucker Sucker
Sucuri Suzuran
SuperBot
SurveyBot
Swiftbot Swiftbot
T0PHackTeam T0PHackTeam
T8Abot
Teleport
TeleportPro TeleportPro
Telesoft TheNomad
Titan TightTwatBot
Toata Trendictionbot
Toweyabot
Tracemyfile
True_Robot True_Robot
URLy.Warning Twice
UnisterBot URLy Warning
V-BOT
Vacuum Vacuum
Vagabondo VelenPublicWebCrawler
VeriCiteCrawler VidibleScraper
Virusdie Voil
Voltron Voltron
WPScan WASALive-Bot
WWW-Mechanize WBSearchBot
WWW::Mechanize WWWOFFLE
Wallpapers
WallpapersHD WallpapersHD
Web Collage Web Sucker
Web Pix WebCopier
WebBandit WebReaper
WebFuck WebStripper
WebGo IS WebSucker
WebmasterWorldForumBot Webalta
Webshag Webshag
Website Quester WebsiteExtractor
Whack Whatweb
Whacker Who.is Bot
Widow Xaldon WebSpider
WiseGuys Robot Xenu
Wonderbot Zade
Woobot Zermelo
YoudaoBot
Zeus Zeus
ZmEu ZmEu
backlink-check ZoominfoBot
cah.io.community arquivo.pt
autoemailspider
check1.exe
clark-crawler clark-crawler
com.plumanalytics
crawl.sogou.com crawl.sogou.com
eCatch crawler4j
heritrix domainsproject.org
evc-batch
instabid
ips-agent ips-agent
iubenda-radar linkdexbot
lwp-request lwp-trivial
magpie-crawler polaris version
muhstik-scan seocompany.store
pcBrowser sexsearcher
ripz sogouspider
satoristudio.net
scan.lol
serpstatbot
siteripz
sp_auditbot sp_auditbot
sysscan trendiction.de
trendiction.com
voyagerx.com voyagerx.com
webgains-bot
webmeup-crawler
webpros.com
x09Mozilla x09Mozilla
x22Mozilla x22Mozilla
xpymep1.exe zauba.io
zgrab

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
adinterax.com 2drittel.de
conocer-sanabria.com aac52006ec82a24e08b665f4db2b5013f7.com
el-nation.com custom-product-labels.com
electrik-avenue.com hotgirlhdwallpaper.com
free-floating-buttons.com lawyers.cafe
livetsomudvekslingstudent.bloggersdelight.dk mathgym.com.au
oakleyglassesonline.us optikremont.ru
of-ireland.info secretscook.ru
petitions.whitehouse.gov sex-tracker.com
searchencrypt.com wholesalejerseysgaa.com

930
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
1000n1.ru 00author.com
101raccoon.ru 00webcams.com
178evakuator178.ru 1008.su
1j7740kd.website 11235813.webzdarma.cz
2itech.ru 1adult.com
4webmasters.com 1bet.com
5000-cotydzien.com 1flag.co.za
8xv8.com 1stat.ru
98oi.ru 24videos.tv
aa9d046aab36af4ff182f097f840430d51.com 2ads.co.uk
aac500b7a15b2646968f6bd8c6305869d7.com 2pxg8bcf.top
abcdefh.xyz 3dracergames.com
adinterax.com 40cg.com
ads-cool.pro 7a2rnuey1tw9ar.ru
adservme.com 883zy.com
adultactioncam.com aa14ab57a3339c4064bd9ae6fad7495b5f.com
adultgalls.com aaa38852e886ac4af1a3cff9b47cab6272.com
advancedcleaner.com above.com
advertex.info acads.net
advokateg.ru acheterviagrafr24.com
addray.pro
adktrailmap.com
adrunnr.com
advancedsoftwaresupport.com
afslankpillen2017nl.eu
agardomains.com
agecheckadult.com agecheckadult.com
ahhjf.com ageofclones.com
airlandsea.info air-edem.ru
aksonural.ru airmaxshoes-2016.com
alert-jdh.xyz akvamaster.dp.ua
alevinefesleri.com allknow.info
all4invest.ru allmarketsnewdayli.gdn
all4wap.ru allwomen.info
allwidewallpapers.com alpinism.ru
alphavisions.net animalrank.com
amoi.tn
amung.us
animali.deagostinipassion.it
anjalika.co.in
anmysite.com anmysite.com
apiluckyleapnet-a.akamaihd.net api.stathat.com
appsaurus.com apimossnetinfo-a.akamaihd.net
appsecurityr.com arquivo.pt
aquarium-pro.ru artel116.ru
arcadeplayhouse.com asociatia-tipografilor-transilvania.ro
arkartex.ru atdedinotuho.tk
asia-forum.ru ausmepa.org.au
auto-moto-elektronika.cz
autochoixspinelli.com autochoixspinelli.com
b00kmarks.com autowebmarket.com.ua
availit.weebly.com
aviapanda.ru
aviav.org
avirasecureserver.com
azartmsl.com
babyfactory.fr babyfactory.fr
back.dog
baersaratov.ru
bagsonsale.online bagsonsale.online
balkanfarma.ru baltgem.com
bank.uz baoxaydung.com.vn
bankcrediti.ru beachtoday.ru
banki76.ru belinvestdom.by
beauby.ru beremenyashka.com
bedandbreakfast.com best-businessman.ru
begalka.xyz best-coupon-offer.com
best-deals-products.com bestchoice.cf
besthomemadepornsites.com
bestimagecoollibrary.com
bestwebsiteawards.com
betterhdporn.com betterhdporn.com
billiard-classic.com.ua betune.onlinewebshop.net
bitnote.co beztuberkuleza.ru
bjorkbacken.nu bildsuche.ru
blog.yam.com bioca.org
bloggen.be bitcoinremote.com
blogig.org bizfly.info
blogporn.in bjanshee.ru
blogs.rediff.com bkns.vn
bloggedporn.com
bluesalt.co bluesalt.co
bmw-ark.ru bnt-team.com
bolezniorganov.ru bodybuilding-shop.biz
brandedleadgeneration.com bonzibuddi.com
brandehk.dk boobsimge.com
bravegirlsclub.com braintobe.win
brianhenry.co brandov.ru
briomotor.co bronzeaid-a.akamaihd.net
buchananshardware.com brus-vsem.ru
bumble.cheapwebsitehoster.com brus.city
bumskontakte.org btc4u.ru
burger-imperia.com btnativenav.com
business-made-fun.com budpost.com.ua
buyessay3.blogspot.ru buttons-for-your-website.com
buyessaynow.biz calcularpagerank.com
calvet.altervista.org camsex.xxx-cam.webcam
cdncash.org cartierloveringreplica.xyz
cheap-pills-norx.com cbozhe.com
check-this-out-now.online cfjump.com
chocolateslim-en-espana.com changde.58.com
chocolateslim-original.com chatroulette.life
chorus.terakeet.com cheap-trusted-backlinks.com
christianlouboutinsaleonline.us cheapbarbour.online
cialgenisrx.com cherubinimobili.it
ciceros.co cicaki.net
ciekawinki.pl circlesl.com
cleanallspyware.com citizenclsdriveri7.pen.io
clickcash.com coin-hive.com
compliance-jane.top coldfilm.ru
contentsexpress.com commoncrawl.org
converse.ddsoldes.fr compliance-checker.info
copenergo.ru compliance-irvin.top
counciltally.com compliance-jessica.top
crd.clan.su compliance-nelson.top
crest3d.ru computernetworksonline.com
crynet.cc coolingoods.com
cubs-jerseys.us cordstrap.cc
customergrowthsystems.com covadhosting.biz
custom-product-labels.com
customcatchcan.com
cyclobenzaprinevstizanidine.blogspot.com cyclobenzaprinevstizanidine.blogspot.com
cyse.tk
d-black.bz
danashop.ru danashop.ru
datract.com data.vtc.pw
dealwifi.com
decenttools.com
decorazilla.com decorazilla.com
defenderxtactical.com deda-moroza-zakaz.ru
delta-line.men design-ideas.info
derevesendeco.com design-lands.ru
diminishedvalueoforegon.com designdevise.com
dinkolove.ya.ru digital-video-processing.com
directivepub.com directivepub.com
discovertreasurenow.com disruptingdinnerparties.com
divatraffic.com dktr.ru
divku.ru dlya-android.org
doctormakarova.ru dnepr-avtospar.com.ua
dogoimage.com dodlive.mil
dolohen.com dojki365.online
domain.webkeyit.com domain-submit.info
domainanalyzing.xyz dostavimvdom.ru
domaineaneblanc.com dvr.biz.ua
domainsphoto.com easync.io
dorratex.tn ed-shop01.ru
dostavka-v-krym.com edwinkonijn.com.au
dotmass.top egovaleo.it
drev.biz ekn-art.se
e-avon.ru ekosmetyki.net.pl
earl-brown.info electro-prom.com
eas-seo.com elektronischezi.livejournal.com
eets.net elektronischezigarette2.mex.tl
ekspresihati.info empis.magix.net
ekto.ee eorogo.top
el-nation.com erectile.bid
election.interferencer.ru etur.ru
elektrischezigarette2.devhub.com evaashop.ru
elektrischezigarettekaufen2.cowblog.fr evening-dating-club.info
elektrozigaretten1.webs.com event-tracking.com
eloconcream.blogspot.com exdocsfiles.com
eluxer.net exhibitionplus.eu
en.altezza.travel eyemagination.com
energydiet-info.ru facebook-mobile.xyz
englate.com familienzahnaerzte.com
eropho.com fashion.stellaconstance.co
escortplius.com finansov.info
essaypro.com footbalive.org
evrotekhservis.ru forexgb.ru
excitacion.info forums.d2jsp.org
expdom.com foxweber.com
extener.org freelinkbuilding.website.tk
ezigarettekaufen2.yolasite.com freesitetest.com
ezigarettenshop2.postbit.com friendflnder.com
ezigaretteshop2.mywapblog.com front.to
f012.de futbolkisales.ru
fable.in.ua gdcentre.ru
fanrto.com gemgrab-a.akamaihd.net
fastfixing.tech genetworx.com
fdzone.org
fetishinside.com
fifa-coins.online
fikasound.tk
fillmewithhappiness.com
findacheaplawyers.com
findanysex.com
floating-share-buttons.com
flooringinstallation-edmonton.com
flytourisme.org
forum20.smailik.org
free-deals.faith
free-fbook-traffic.com
freewhatsappload.com
frustrated-favorable.gq
funtoonez.com
fxund.us
gallerily.com
gameprimary.com
gdebestkupit.ru
ge0ip.org
gepezz.info
getdot.ru
getlamborghini.ga
getprismatic.com
getyourimage.club getyourimage.club
gidonline.one gheus.altervista.org
girlspicsa.com glall.ru
go2album.com goo.ne.jp
goblacked.com googglet.com
gogps.me googlemare.com
golaya.pw gorabagrata.ru
gosreg.amchs.ru gorodservis.ru
gotcher.us gotcher.us
green-tea.tv gpirate.com
graphid.com
gratuitxblcodes.com
greenshop.su greenshop.su
groupmoney.ru groupmoney.ru
guge.io gsasearchengineranker.top
gunsvicceadadebt.tk gta-top.ru
guruofcasino.com guitar-master.org
gyffu.com gwebtools.com
hanink.biz.ly hahashka.ru
hayate.biz hannasolution.ru
hard-porn.mobi
hcate.com
hdapp1008-a.akamaihd.net hdapp1008-a.akamaihd.net
hdimagelib.com hdfreeporno.net
hidemyass.com health-medical-portal.info
hitcpm.com hermesbelts.xyz
hmmm.cz hitsbox.info
host-protection.com home.myplaycity.com
hotxnights.info homedecoguide.info
howlongdoestizanidinestayinyoursystem.blogspot.com homemature.net
howopen.ru hotkeys.com
howtoclean.club huimin764128.com
hspline.com
huhn.altervista.org
hundejo.com
hunterboots.online hunterboots.online
igrovyeavtomaty777.ru hvd-store.com
incest-ru.com hystersister.com
indetiske.ya.ru ibmdatamanagement.co
indo-export.ru ifirestarter.ru
infokonkurs.ru iflycapetown.co.za
infoupdate.org images-graphics-pics.com
innoslicon.com imitex-plus.ru
insta-add.pro imk.com.ua
instakink.com immobiliaremassaro.com
internetproviderstucson.com imperia31.ru
investmac.com inbabes.sexushost.com
iopeninghours.co.uk interfucks.net
itrevolution.cf intervsem.ru
ix20.ru iskalko.ru
izhevsk.zrus.org iwantedmoney.com
jav-way.site
javcoast.com javcoast.com
javxxx18.com javitas.info
jo24news.com javrip.net
kadashihotel.com javstock.com
kamalsinha.com jerseywholesalechinabiz.com
kellyonline.xyz jetsli.de
kerwinandcariza.com jobgirl24.ru
kevblog.top joessmogtestonly.com
keywordsuggest.org kabbalah-red-bracelets.com
kino2018.cc kam-dom.ru
kinomaniatv.pl kasino-money.pw
konpax.com katjimej.blog.fc2.com
kazan.xrus.org
kchaxton.com
kerei.ru
keywordsking.com
kiinomaniak.pl
kiprinform.com
kiskinhouse.com
kongruan.com
konturkrasoty.ru konturkrasoty.ru
koral.se koronirealestate.gr
koversite.info
kraljeva-sutjeska.com
ladsblue.com
lampokrat.ws
lankarns.com
laparfumotec.com laparfumotec.com
laxdrills.com lapitec.eu
lawyersinfo.org
layola.biz.tc
ldrtrack.com
letsart.ru
letslowbefast.site letslowbefast.site
levaquin750mg.blogspot.com lexiangwan.com
li-er.ru lincolntheatre.com
life.biz.ua link.ac
limtu.ifmo.ru liquimondo.com
linkarena.com liveinternet.ro
linkpulse.com livesex-amateure.info
livingroomdecor.info lockerz.com
lkbennettoutlet.online lomb.co
lol-smurfs.com lunchrock.co
longgreen.info machicon-ueno.info
lovi-moment.com.ua mactechinfo.info
lrac.info madot.onlinewebshop.net
luckyshop.net.ua magiadinamibia.blogspot.com
lulea-auktionsverk.se mail.allnews24.in
lunamedia.co mebel-alait.ru
m292.info mediawhirl.net
macdamaged.space meet-flirt-dating.com
magazin-pics.ru mhi-systems.ru
mastershef.club michaelkorsoutletstore.net
mathgym.com.au militarysale.pro
meetlocalchicks.com mixx.com
megaapteka.ru mobifunapp.weebly.com
meget.co.za mobplayer.net
metascephe.com monclerjacketsoutlet.pw
michellblog.online morefastermac.trade
microsearch.ru moskva.nodup.ru
milblueprint.com mosrif.ru
miniads.ca mp3s.club
modabutik.ru mttwtrack.com
mrpornogratis.xxx myblogregistercm.tk
music.utrolive.ru mydeathspace.com
musicstock.me nalogovyy-kodeks.ru
mustwineblog.com nastydollars.com
muznachas-service.ru naturalpharm.com.ua
mygameplus.com naturtreenspicerx.pw
myghillie.info neks.info
mysex21.com nevansk.ru
nardulan.com nibbler.silktide.com
narkologiya-penza.ru nippon-bearings.ru
narkologiya-voronezh.ru nodup.ru
national-today-winning-winner.club nomuos.it
naturalshair.site nordvpn.com
navalwiki.info nowtorrents.com
newhairstylesformen2014.com
nodding-passion.tk
nofreezingmac.work
northfacestore.online
notaria-desalas.com
npoet.ru
o-o-6-o-o.com o-o-6-o-o.com
offers.bycontext.com oballergiya.ru
offf.info oktube.ru
office2web.com one.net.in
offside2.5v.pl online-x.ru
onclkads.com onlineserialy.ru
one-gear.com onlinetvseries.me
onlainbesplatno.ru onlinewritingjobs17.blogspot.ru
online-hit.info onthemarch.co
ordernorxx.com openfrost.net
osagonline.ru opinionreelle.com
partner-stop.men oranga.host.sk
pawli.eu ororodnik.goodbb.ru
percin.biz.ly ovirus.ru
perfection-pleasure.ru pandarastore.top
perl.dp.ua panouri-solare-acoperis.com
phpdevops.com partnerads.men
piccdata.com parvezmia.xyz
picsearch.com patol01.pw
picswe.com patterntrader-en.com
pinsdaddy.com pavlodar.xkaz.org
pix24x7.com paydayloanslocal.com
pizda.lol pepperstyle.ru
plaff-go.ru perfectpracticeweb.com
perosan.com
photokitchendesign.com
picture-group.com
pl-vouchers.com
pogosh.com pogosh.com
popugaychiki.com popmarker.com
popunder.ru popup-fdm.xyz
porno-home365.com pornoblood.com
pornodojd.ru pornogad.com
pornosexrolik.com pornoinn.com
pornotubexxx.name pornstartits.xblog.in
positive2b.ru porto.abuilder.net
potoideas.us pr0fit-b0x.com
printie.com princevc.com
privatov-zapisi.ru prod2016.com
proftests.net progonrumarket.ru
projefrio.com.br prostitutki-novgoroda.org
prostitutki-rostova.org
prostitutki-tolyatti.org prostitutki-tolyatti.org
q-moto.ru prostitutki-yaroslavlya.org
quebec-bin.com prpops.com
raisedseo.com radiodigital.co
rating-casino2021.ru ranking2017.ga
realtytimes.com ranksonic.com
redirectme.net rapidokbrain.com
regionshop.biz rebuildermedical.com
responsinator.com recinziireale.com
rfserial.net recipedays.ru
risparmiocasa.bz.it redhotfreebies.co.uk
ritlweb.com reklamuss.ru
roleforum.ru resant.ru
roznica.com.ua rique.host.sk
rubanners.com riralmolamsaca.tk
ruclicks.com rock-cafe.info
rucrypt.com ros-ctm.ru
rumamba.com ru-mediaget.ru
rvtv.ru russian-postindex.ru
sady-urala.ru sad-torg.com.ua
sanyuprojects.com saletool.ru
saveindex.xyz saugatuck.com
scanner-julia.top savingsslider-a.akamaihd.net
scripted.com sayyoethe.blogspot.co.za
sdi-pme.com sbornik-zakonov.ru
scalerite.co.za
scanner-alex.top
scanner-ivan.top
scanner-olga.top
scenarii-1-sentyabrya.uroki.org.ua
schlampen-treffen.com
scoopquest.com
sdelai-prosto.ru
sdelatmebel.ru
search-goo.com search-goo.com
searchimpression.com searchinquire.com
searchinterneat-a.akamaihd.net seo-2-0.com
semalt.com seocheki.net
semrush.com seomarketings.online
semxiu.com seorankinglinks.us
seocheckupx.com serdcenebolit.com
seokicks.de sex-pr.net
servisural.ru sex-znakomstva.online
serw.clicksor.com sexuria.net
sexgalleries.top sexy-pings.com
sharebutton.to sfd-chess.ru
shareyards.com sharebutton.org
shisha-swag.de ship-marvel.co.ua
similardeals.net shopcheermakeup.info
sindragosa.comxa.com shoppingjequiti.com.br
sitechecker.pro shopvilleroyboch.com.ua
siteheart.net shtora66.ru
siteimprove.com sibdevice.ru
skyway24.ru sim-service.net
smart-scripts.com sitebeam.net
social-vestnik.ru sitevaluation.com
socialbutton.xyz sky-mine.ru
spacash.com smartbalanceworld.com
snjack.info
socialbuttons.xyz
soietvousmaime.fr
solnplast.ru
spaceshipad.com spaceshipad.com
special-porn.com spamnuker.com
spidtest.space spravka130.ru
spinazdrav.ru
spinnerco.ca
splendorsearch-a.akamaihd.net
sport-video-obzor.ru
srecorder.com
stard.shop stard.shop
steame.ru start.myplaycity.com
stillmiracle.com stats-collector.org
stop-gepatit.te.ua stats-public.grammarly.io
strana-solnca.ru staynplay.net
stroiminsk.org sticken.co
studiofaca.com stpicks.com
sucsesofinspiration.com streamin.to
sugarlyflex.pw suchenindeutschland.com
suhanpacktech.com sugvant.ru
sumo.com sukarame.net
superkanpo.com sukirgenk.dvrlists.com
superstarfloraluk.com
surflinksmedical.com surflinksmedical.com
svarkagid.com surintech.ac.th
svbur.ru svolze.com
svnuppsalaorebro.se taboola.com
swsociety.se tacbibirfa.tk
syvertsen-da.no
tabakur77.com
tagil.zrus.org tagil.zrus.org
tamada69.com tandvardshuset.net
tanieaukcje.com.pl taximytishi.ru
tasteidea.com tds-advert002.info
td-33.ru template-kid.com
teesdaleflyballclub.co.uk testbotprocessor44.com
telefonsexsofort.tk textads.men
templates.franklinfire.co themestotal.com
terrafootwear.us thesmartsearch.net
thecoolimages.net thewebsitetemplate.info
timeallnews.ru thexart.club
tizanidinedosageforsleep.blogspot.com thruport.com
tizanidinedruginteractions.blogspot.com timetorelax.biz
tizanidineduringpregnancy.blogspot.com titan-cloud.life
tkanorganizma.ru tizanidinefibromyalgia.blogspot.com
todohr.com tizanidinehydrochloride4mgstreetvalue.blogspot.com
tizanidineonline.blogspot.com
tizanidinesideeffects.blogspot.com
tobeyouday.win
topcasinoratings.ru
torture.ml torture.ml
toursmaps.com tovaroboom.vast.ru
track2.shop toys.erolove.in
tracksz.co track-rankings.online
traffixer.com trafaret74.ru
truck-addzilla.life traffic2cash.org
trumpetedextremes.com trafficcentr.xyz
trustedhealthtips.com trichizobswiv.agddns.net
txxx.com truebeauty.cc
tytoona.com trustaffs.com
u17795.netangels.ru tuberkulezanet.ru
u555u.info turbo-suslik.org
umekana.ru turizm.bz
turn-up-life.life
uasb.ru
ultimatesetnewfreeallsoftupgradesystems.pw
unblocksit.es
uprour.com
uptime-alpha.net
uptime-as.net
upupa.net upupa.net
urengoy.pro ussearche.cf
urlcut.ru v24s.net
usdx.us
ustion.ru
vapomnoncri.tk
vapsy.com
vasileostrovsky-rayon.ru
veerotech.com
vektorpress.ru
veles.shop veles.shop
vereo.eu versaut.xxx-cam.webcam
vesnatehno.com videonsk.com
viagroid.ru villacoloniale.com
viteonlusarezzo.it vizitki.net
voprosotvet24.ru vksex.ru
vpnhowto.info voloo.ru
vzglyadriv.kg voloomoney.com
vzlom-na-zakaz.com
vzlomsn.org
walkme.com walkme.com
wallpapersdesk.info warezaccess.com
waterpurifier.club watchdogs-2.ru
web.cvut.cz website-speed-up.top
webix.me wemarketing.se
website-stealer.nufaq.com westum.se
weekes.biz.tc
wemedinc.com
wesharepics.info
whatsappbot.flyland.ru whatsappbot.flyland.ru
where-toget.com
whereverdesperate.gq
whipme.yopoint.in
whiteproduct.com
windowssearch-exp.com
wjgony.com
wleuaprpxuvr.ga wleuaprpxuvr.ga
worldoffiles.ru wnoz.de
www.888.com wordkeyhelper.com
xlolitka.com wrz0iuebwhp5fg.freeddns.com
xn-----8kcatubaocd1bneepefojs1h2e.xn--p1ai wtsindia.in
xn--b1addnj3cah.xn--p1ai ww1943.ru
xnxx699.com x-diesel.info
xxlargepop.com xaijo.com
xxx-treker.ru xaylapdiendanang.com
xxxnatelefon.ru xn----9sbubg3ambdfl1j.xn--p1ai
yhit.press xsion.net
youbrainboost.asia xtremeeagles.net
youjizz.vc yougotanewdomain.com
yurgorod.ru youporn-forum.ga
zarenica.net yourserverisdown.com
zatjmuzu.info youtube-downloader.savetubevideo.com
zdesformula.ru ypmuseum.ru
zeleznobeton.ru za-music.mymobiplanet.com
zkjovpdgxivg.ga zaidia.xhost.ro
znakomstva-piter78.ru zaloadi.ru
zoogdisany.com zebramart.ru
zscaler.net zooggames.com
zvetki.ru

480
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
2itech.ru 108shot.com
3-letter-domains.net 24x7-server-support.site
5elementov.ru 28n2gl3wfyb0.ru
aanapa.ru 3rbseyes.com
admanaerofoil.com 4kpics.rocks
adssafeprotected.com 4pp13.com
advancedcleaner.com 4rent.ru
agreda.pluto.ro absolutelyanalog.com
ahmedabadwebs.com acmebtn.ml
aihelen.net adobereader-free.ru
aksonural.ru ads.tremorhub.com
alfapro.ru adsloads.com
alienwheel.es adverster.com
amateurgalls.com advokateg.xyz
anmysite.com agapovdg.ru
app-ready.xyz alert-fjg.xyz
apple.com-webbrowsing-security.review allboard.xobor.de
aquarium-pro.ru allesohnegirls.net
ardimobileinfo.ml amazon-adsystem.com
autonew.biz ample-awards-today.us
awaybird.ru an-donut.com
baikaleminer.com apartamentwroclaw.eu
bankmib.ru apparel-offer.com
bayareaaeroclub.org appiq.mobi
beauty-b0x.pl aviav.eu
berdasovivan.ru avtolombard-krasnodar.com
bestserials.com balkanfarma.org
bestwebsiteawards.com battle.net
bestwebsitesawards.com bausparen.bz.it
bif-ru.info beachdriveblog.com
bimatoprost-careprost.com beachpics.com
bnt-team.com bizzliving.com
boltalko.xyz bjetjt.com
boo-arts.com bloke.com
breastaugmentation.co.za blue-square.biz
brus.city boc.kz
budpost.com.ua boole.onlinewebshop.net
buynorxx.com bouda.kvalitne.cz
buzzzg.men brandimensions.com
cartiertrinity.xyz btvn.ru
cascadelink.org bumascloset.com
cashonads.com bvlgariwallet.xyz
casinopinup-wins.com cacheimages.com
chcu.net camsex.xxx-cam.webcam
cheap-trusted-backlinks.com canrole.com
cheapsergiorossi.online cartierlove2u.com
christianlouboutinreplica.win cartierlovebracelet.xyz
cialischmrx.com cartierreplica.top
citizenclsdriveri7.pen.io cheapjerseysa.com
civilwartheater.com cherrypointplace.ca
cialisovercounteratwalmartusa.com
cleanallvirus.com cleanallvirus.com
clickcash.com clipartnew.com
cntravelre.com cognitiveseo.com
comissionka.net cometorussia.net
compliance-walter.top confib.ifmo.ru
conocer-sanabria.com converse.ddsoldes.fr
cool-wedding.net cowblog.fr
cordstrap.cc date-withme.com
cubs-jerseys.us dfwu1013.info
customergrowthsystems.com divci-hry.info
dailyfinancefix.com dmmspy.com
data-ox.com dosug-lux.ru
dcj-nn.ru drugspowerstore.com
delfin-aqua.com.ua
dev-seo.blog
dieta-personalna.pl
digilander.libero.it
disruptingdinnerparties.com
dolohen.com
domain.webkeyit.com
domination.ml
downtuptv.gq
dtm-spain.com dtm-spain.com
duawitchrarato.tk
dynainbox.com
eas-seo.com eas-seo.com
easycommerce.cf easycommerce.cf
ebooknovel.club ebonyporn.site
efnor-ac.com ekspertmed.com
ekn-art.se eleimgo.pw
elvenar.com elitepcgames.com
en.home-task.com eralph.tk
eupornstar.info esopini.com
exoneration-project.us etm-consult.de
expresstoplivo.ru evening-dating-club.info
fidelityfunding.com extener.org
financetip.eu extremepornos.net
findacheaplawyers.com eywords-monitoring-your-success.com
fingerprintjs.com f07.de
fitfloponline.store falcon-images.blogspot.com
fok.nl fashion.stellaconstance.co
formseo.com financehint.eu
g33.org flowwwers.com
galleryawesome.com focalink.com
gamezblox.com forex-procto.ru
gemara.com freewlan.info
generic-pills-online.com fuckingawesome.com
girls-ufa.ru funcrushgames.com
glass-msk.ru fx-brokers-review.com
gsasearchengineranker.site gamewrath.com
hatedriveapart.com gdcentre.ru
headpress.ru ge0ip.org
heartofbeijing.blogspot.com gobongo.info
heroz.fr gonextmedia.com
highland-homes.com goo.ne.jp
hotelcrocenzi.sm gratis-sexkontakte.com
hully.altervista.org hanwei.us
hawaiielectriclight.com
hccoder.info
hd720kino.ru
health-medical-portal.info
housekuba.org
humbmosquina.tk
idegenvezeto.eu
ifirestarter.ru ifirestarter.ru
igru-xbox.net interferencer.ru
imicrovision.com istmira.ru
inboxdollars.com janettabridal.com
interior-stickers.ru jaxcube.info
invest-pamm.ru jbl-charge.info
iqbazar.ru jerseyswholesalechinalimited.com
iqs.biz.ua jetsli.de
istanbulit.com jwcialislrt.com
itag.pw
itservicesthatworkforyou.com
ivanstroi.ru
javxxx18.com
journeydownthescale.info
jyrxd.com jyrxd.com
kanimage.com katjimej.blog.fc2.com
katadhin.co kihi.gdn
kazinogames.lv kol-energo.ru
koleso24.com.ua krasnodar.zrus.org
ktotut.net la-fa.ru
kutikomi.net lashstudia.ru
kuzinsp.ru letmacwork.world
labelwater.se lexaprogeneric.link
laexotic.com lider-zhaluzi.kiev.ua
lafourmiliaire.com lineshops.biz
lalalove.ru lmrauction.com
lechtaczka.net luciddiagnostics.in
letmacworkfaster.site lulea-auktionsverk.se
linkrr.com lumb.co
lirunet.ru manifestation.betteroffers.review
liveinternet.ru marketingtechniques.info
lombia.com mearns-tractors.co.uk
m1media.net menetie.ru
malwareremovalcenter.com microsoftportal.net
marcowebonyodziezowe.pl mil-stak.com
maridan.com.ua mompussy.net
max-eclat.men moneyteam24.com
mensandals.xyz morefastermac.trade
microstatic.pl mp3ritm.top
mmostrike.ru
moesonce.com
moi-glazki.ru
monarchfind-a.akamaihd.net
moonci.ru
mulberryoutletonlineeu.com
muz-shoes.ru
mybackgroundlandscape.blogspot.com
mydoctorok.ru mydoctorok.ru
myprintscreen.com nastroyke.net
newstraveller.ru naturalbreakthroughsresearch.com
newstudio.tv naturtreenspicerx.pw
newtechspb.ru navalwiki.info
nucia.biz.ly needtosellmyhousefast.com
obiavo.in nevansk.ru
oklogistic.ru nextrent-crimea.ru
omoikiri-japan.ru ngps1.ru
onlinemeetingnow.com ningessaybe.me
ozas.net nofreezingmac.click
panchro.co.uk nrv.co.za
pandarastore.top nudo.ca
nzfilecloud.weebly.com
offer.wpsecurity.website
okuos.com
onlinebay.ru
ontargetseo.us
orgasmatrix.com
ourville.info
paintingplanet.ru
partnerads.men partnerads.men
photokitchendesign.com pathwhelp.org
photorepair.ru pawli.eu
pic2fly.com paydayloanslocal.com
picture-group.com picswe.com
play-movie.pl pictures-and-images.net
polcin.de pio.polytopesexempt.com
popugaychiki.com pogosh.com
pornhub-forum.ga poptool.net
pozdrawleniya.com posible.net
priceg.com pp-budpostach.com.ua
prize44.com privat-girl.net
produkto.net prod2016.com
prostitutki-kharkova.org prokotov.com
prostitutki-kiev.org quickloanbank.com
pushdata.sendpulse.com qwertty.net
pxhdwsm.com randki-sex.com
qcstrtvt.bloger.index.hr rating-bestcasino.com
renecaovilla.online realtytimes.com
rennlist.com remont-ustanovka-tehniki.ru
rfserial.net renewablewealth.com
ringtonepartner.com resultshub-a.akamaihd.net
royalvegascasino.com russintv.fr
rus-pornuha.com s-forum.biz
rusprostitute.com sabaapress.com
sa-live.com saltspray.ru
scanner-willy.top samolet.fr
scat.porn satoristudio.net
screpy.com sbricur.com
securesmrt-dt.com sbt-aqua.ru
scanner-olga.top
seo-smm.kz
seofirmreviewsus.info seofirmreviewsus.info
sexuria.net seogadget.ru
sexyteens.hol.es seomarketings.online
sexytrend.ru service.adtech.us
shell-pmr.ru sevendays.com.ua
siteimprove.com sexvideo-sex.com
sitevalued.com shillyourcoins.com
slomm.ru sibvitr.ru
social-buttons.xyz signal03.ru
solmarket.by sildenafil-tadalafil.info
simul.co
slimcdn.com
slowmac.tech
social-search.me
socialbuttons.xyz
sosdepotdebilan.com sosdepotdebilan.com
spacash.com soundfrost.org
spymac.net space-worry.ml
squidoo.com stardevine.com
standardchartered-forex.com staticfs.host
stmassage.ru suhanpacktech.com
stopnarco.ru swinger-mobil.net
streetfooduncovered.com szamponrevita.pl
takeprofitsystem.com takethatad.com
thegolfclub.info titelhelden.eu
themestotal.com tizanidinenarcotic.blogspot.com
tonerbox.kz tizanidineorflexeril.blogspot.com
trafficgenius.xyz tizanidinepain.blogspot.com
trion.od.ua tksn.ru
truck-addzilla.life trafficjunky.net
tsyndicate.com truebeauty.cc
tuberkuleznik.ru tupper-shop.ru
unisexjewelry.org tvorozhnaja-zapekanka-recept.ru
upstore.me unece.org
uvozdeckych.info unrealcommander.com
uzungil.com uptimebot.net
vapomnoncri.tk url2image.com
vesnatehno.com wallpapersist.com
vip-dom.in webshoppermac.com
vitoriacabos.com website-speed-check.site
vseigru.one wemarketing.se
wallpaperaccess.com westen-z.life
wallpapers-best.com wonderfulflowers.biz
webmonetizer.net x-diesel.biz
webs.com xn----9sbebi2bvzr7h.xn--p1ai
weburok.com xn--80adaggc5bdhlfamsfdij4p7b.xn--p1ai
weddingdresses.xyz xn--oogle-wmc.com
wingsoffury2.com xportvusbdriver8i.snack.ws
wnoz.de xpresscare.ru
x-lime.net xsion.net
xvideosbay.com youdao.com
y8games-free.com youtuhe.com
youjizz.com zaimite.ru
youporn-ru.com zawyna.ua
youtoner.it zirondelli.it
ypmuseum.ru zoogdinsney.com
zebramart.ru zvetki.ru
zoolubimets.ru
zrelaya.pw
zvuker.net

10
dev-tools/test_units/ratelimittest-beta.txt
View file

@ -581,4 +581,14 @@
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html> </html>

10
dev-tools/test_units/ratelimittest-master.txt
View file

@ -581,4 +581,14 @@
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html> </html>

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.45 0; 10.1.1.69 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.06.3151 ### Version: V4.2022.06.3152
### Updated: Mon Jun 6 22:01:20 UTC 2022 ### Updated: Tue Jun 7 10:03:41 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.06.3151 ### Version: V4.2022.06.3152
### Updated: Mon Jun 6 22:01:20 UTC 2022 ### Updated: Tue Jun 7 10:03:41 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##