vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-03 02:59:57 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2022.09.3341 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2022-09-10 10:09:07 +00:00
parent cbe285fbad
commit e81fab6faf
47 changed files with 84481 additions and 84380 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.09.3340 #### Version: V4.2022.09.3341
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.09.3340 #### Version: V4.2022.09.3341
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -14,7 +14,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2022.09.3340 #### Version: V4.2022.09.3341
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

10412
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2022.09.3340 #### Version: V4.2022.09.3341
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

10416
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

10416
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

10416
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

10416
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.196 1; 10.1.0.77 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.196 0; 10.1.0.77 0;
127.0.0.1 0; 127.0.0.1 0;

10416
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.196 1; 10.1.0.77 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.196 0; 10.1.0.77 0;
127.0.0.1 0; 127.0.0.1 0;

10416
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.196 1; 10.1.0.77 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.196 0; 10.1.0.77 0;
127.0.0.1 0; 127.0.0.1 0;

10416
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
3340 3341

10416
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

10416
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.29.115.225 0; 20.12.54.124 0;

10416
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.196 1; 10.1.0.77 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.196 0; 10.1.0.77 0;
127.0.0.1 0; 127.0.0.1 0;

10416
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.196 1; 10.1.0.77 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.196 0; 10.1.0.77 0;
127.0.0.1 0; 127.0.0.1 0;

10416
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.196 1; 10.1.0.77 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.196 0; 10.1.0.77 0;
127.0.0.1 0; 127.0.0.1 0;

10416
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.29.115.225 0; 20.12.54.124 0;

10416
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.29.115.225 0; 20.12.54.124 0;

10416
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.196 1; 10.1.0.77 1;
127.0.0.1 1; 127.0.0.1 1;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
Copyscape Alligator
DatabaseDriverMysqli Fimap
GalaxyBot Fuzz
Jorgee Mail.RU_Bot
Moblie Safari MarkWatch
PictureFinder Offline Explorer
RankingBot WebZIP
Siteimprove arquivo-web-crawler
Trendiction crawler4j
pcBrowser seobility

282
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
01h4x.com 404checker
360Spider ALittle Client
ASPSeek
Abonti
AfD-Verbotsverfahren
Alexibot
AllSubmitter AllSubmitter
Anarchy
Anarchy99 Anarchy99
Ankit
Apexoo Apexoo
Asterias Attach
Atomseobot AwarioRssBot
AwarioSmartBot AwarioSmartBot
BDCbot BDCbot
BDFetch
BLEXBot BLEXBot
BackWeb BackStreet
Barkrowler Battleztar Bazinga
BetaBot BetaBot
Bitacle Bigfoot
Black Hole Blow
BlackWidow Bolt
Boardreader Brandwatch
BotALot Bullseye
Brandprotect CCBot
Buddy Cegbfeieh
BunnySlippers CensysInspect
BuzzSumo CheTeam
CATExplorador CheeseBot
CSHttp
CazoodleBot
CherryPicker
ChinaClaw ChinaClaw
Chlooe Claritybot
Cliqzbot Cloud mapping
Collector Collector
Copier Copier
CopyRightCheck
Copyscape Copyscape
Craftbot Crawling at Home Project
CrazyWebCrawler CrazyWebCrawler
Crescent Crescent
CyotekWebCopy CrunchBot
DataCha0s
DatabaseDriverMysqli DatabaseDriverMysqli
Demon Devil
Deusu DigitalPebble
Disco Dispatch
DittoSpyder DittoSpyder
DnBCrawler-Analytics DnBCrawler-Analytics
DomainAppender DomCopBot
Domains Project
Dotbot Dotbot
Download Wonder Dragonfly
EMail Wolf ECCP/1.0
EMail Siphon
EasyDL
Ebingbong
EroCrawler
Evil
Exabot Exabot
ExtLinksBot EyeNetIE
ExtractorPro Firefox/7.0
Fimap Flunky
Freeuploader Freeuploader
FrontPage FrontPage
Fuzz FyberSpider
Fyrebot Fyrebot
G-i-g-a-b-o-t G-i-g-a-b-o-t
GetRight Genieo
GetWeb GetWeb
Getintent
Gigabot
Go!Zilla Go!Zilla
Go-Ahead-Got-It GoZilla
Gotit Gotit
GrapeshotCrawler Grabber
HMView HEADMasterSEO
HTTrack HTMLparser
Haansoft Haansoft
Havij
Heritrix Heritrix
Humanlinks Humanlinks
HybridBot HybridBot
IDBTE4M
IndeedBot IndeedBot
InfoNaviRobot Indy Library
InterGET InfoTekies
InternetSeer Intelliseek
IstellaBot Iria
JamesBOT Jyxobot
JikeSpider
Jorgee
JustView
Kenjin Spider
Kinza Kinza
LWP::Simple LWP::Simple
Lanshanbot Leap
LeechFTP LeechFTP
LeechGet
Lftp Lftp
LibWeb
LieBaoFast LieBaoFast
Lightspeedsystems Lightspeedsystems
Likse
LinkScan LinkScan
Linkbot Linkbot
LinkextractorPro LinkextractorPro
LinkpadBot LinqiaMetadataDownloaderBot
LinksManager
Lipperhey Spider Lipperhey Spider
Lmspider
MIIxpc MIIxpc
MJ12bot MSFrontPage
MSIECrawler
Mail.RU_Bot Mail.RU_Bot
Majestic-SEO MauiBot
Majestic12 MeanPath Bot
Metauri
MicroMessenger MicroMessenger
Microsoft Data Access Mister PiX
Minefield
Moblie Safari
MolokaiBot
Morfeus Fucking Scanner
Mr.4x3
Msrabot Msrabot
Musobot
Nameprotect Nameprotect
Navroad Net Vampire
NearSite
NetAnts NetAnts
NetZIP NetMechanic
Netcraft
Netvibes
NextGenSearchBot NextGenSearchBot
Nibbler
Nikto Nikto
NimbleCrawler NimbleCrawler
Nmap Nimbostratus
Not
Nuclei Nuclei
Octopus
Offline Explorer Offline Explorer
Offline Navigator Offline Navigator
OpenLinkProfiler
OpenVAS OpenVAS
Openfind
OutclicksBot OutclicksBot
OutfoxBot
PECL::HTTP PECL::HTTP
PHPCrawl PHPCrawl
Page Analyzer
PageAnalyzer
PageGrabber
PageScorer PageScorer
PageThing.com PageThing.com
Pandalytics Pandalytics
Papa Foto Panscient
Picscout Pavuk
ProPowerBot Petalbot
Pixray
PleaseCrawl
ProWebWalker
Probethenet Probethenet
Psbot
Pu_iN
Pump Pump
PxBroker
PyCurl PyCurl
QueryN Metasearch RankActiveLinkBot
RSSingBot RankFlex
RankingBot
Rankivabot Rankivabot
RankurBot RankurBot
RealDownload Re-re
ReGet
RepoMonkey
Rogerbot Rogerbot
SBIder SEOkicks-Robot
SEOlyticsCrawler
SISTRIX SISTRIX
ScanAlert SalesIntelligent
ScoutJet ScoutJet
Scrapy Scrapy
Screaming Screaming
ScrepyBot
Searchestate Searchestate
SearchmetricsBot Seomoz
Seekport Siphon
Semrush SiteLockSpider
SeobilityBot
Shodan
Site Sucker
SiteExplorer
SiteSnagger
Sitevigil Sitevigil
SlySearch
SmartDownload
Snake
Snoopy
SocialRankIOBot
Sosospider Sosospider
Spammen Spammen
SpankBot
Spanner
Spinn3r
SputnikBot
Sqlmap Sqlmap
Sqworm
Steeler Steeler
Sucuri Sucuri
SuperBot SuperBot
SurveyBot Surfbot
T0PHackTeam
Teleport Teleport
Telesphorep TeleportPro
TightTwatBot TheNomad
Titan
Toata
Trendictionbot Trendictionbot
Turingos
TurnitinBot
TwengaBot TwengaBot
Twice Twice
URLy Warning
URLy.Warning
Upflow
V-BOT V-BOT
VB Project
VCI
Vacuum Vacuum
VoidEYE Vagabondo
Voil VelenPublicWebCrawler
VidibleScraper
Voltron Voltron
WASALive-Bot WASALive-Bot
WEBDAV
WISENutbot WISENutbot
WPScan
WWWOFFLE
WeSEE
Web Auto Web Auto
Web Collage
Web Enhancer
Web Fetch
Web Pix Web Pix
WebBandit Web Sucker
WebCollage
WebCopier WebCopier
WebFetch
WebGo IS
WebImageCollector WebImageCollector
WebPix WebSucker
WebSauger
WebZIP WebZIP
Webalta WebmasterWorldForumBot
Webshag Webshag
Website Quester Website Quester
Whatweb WebsiteExtractor
Woobot Whack
Xaldon WebSpider
Xenu
YoudaoBot YoudaoBot
Zade Zauba
Zermelo Zermelo
Zeus Zeus
ZmEu
ZumBot ZumBot
adscanner arquivo.pt
arquivo-web-crawler
autoemailspider
cah.io.community cah.io.community
cognitiveseo clark-crawler
crawler4j crawl.sogou.com
evc-batch facebookscraper
gopher
instabid instabid
internetVista monitor ips-agent
iubenda-radar
magpie-crawler magpie-crawler
meanpathbot meanpathbot
netEstate NE Crawler mediawords
oBot page scorer
pcBrowser plumanalytics
probe-image-size ripz
s1z.ru s1z.ru
satoristudio.net satoristudio.net
scalaj-http
scan.lol scan.lol
seobility
seocompany.store seocompany.store
seoscanners
serpstatbot serpstatbot
siteripz sexsearcher
sitechecker.pro
sp_auditbot
sysscan sysscan
trendiction.com tAkeOut
ubermetrics-technologies.com webgains-bot
webprosbot webpros.com
x09Mozilla x09Mozilla
x22Mozilla
xpymep1.exe
zauba.io zauba.io
zgrab

320
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
404enemy 01h4x.com
ADmantX 360Spider
80legs
ALittle Client ALittle Client
Aboundex
Aboundexbot Aboundexbot
Acunetix
AfD-Verbotsverfahren AfD-Verbotsverfahren
AhrefsBot
Aipbot Aipbot
Alexibot Alexibot
Alligator AllSubmitter
Anarchy AlphaBot
Anarchy99
Ankit Ankit
Apexoo BBBike
AwarioRssBot BDFetch
BDCbot
BLEXBot BLEXBot
Backlink-Ceck Badass
Bandit Bandit
BatchFTP Battleztar Bazinga
BlackWidow Bigfoot
Black Hole
Boardreader
Bolt Bolt
Brandwatch Brandprotect
Buck CATExplorador
BuiltBotTough
BunnySlippers
CODE87 CODE87
CSHttp CSHttp
CazoodleBot Calculon
Cegbfeieh Cegbfeieh
CensysInspect ChinaClaw
CheTeam Citoid
Cocolyzebot Claritybot
Cogentbot Cloud mapping
Collector Collector
CopyRightCheck Crawling at Home Project
Copyscape CrunchBot
Cosmos CyotekWebCopy
Craftbot DSearch
CrazyWebCrawler DTS Agent
Crescent
Curious
Custo
DataCha0s DataCha0s
DatabaseDriverMysqli DatabaseDriverMysqli
Demon
Devil
Digincore Digincore
Dirbuster
DittoSpyder
DnBCrawler-Analytics
DnyzBot DnyzBot
DomCopBot DomCopBot
DomainSigmaCrawler DomainAppender
DomainCrawler
DomainStatsBot DomainStatsBot
Dotbot Domains Project
Dragonfly Dragonfly
EMail Siphon EMail Siphon
Ebingbong EMail Wolf
EirGrabber EroCrawler
Evil Evil
ExtLinksBot Exabot
Extreme Picture Finder Express WebPictures
EyeNetIE
Ezooms Ezooms
FDM
Fimap
Firefox/7.0
FlashGet FlashGet
Flunky Foobot
Freeuploader Freeuploader
FrontPage FrontPage
Fyrebot
GalaxyBot GalaxyBot
Genieo Genieo
GermCrawler
GetRight GetRight
Go-Ahead-Got-It GetWeb
Grafula Grabber
GrapeFX
GrapeshotCrawler GrapeshotCrawler
HTTP::Lite HMView
HaosouSpider Haansoft
Harvest Harvest
Havij Havij
Humanlinks Heritrix
IDBTE4M IDBTE4M
IDBot Image Sucker
Iblog
Id-search
IlseBot
Image Fetch
Indy Library
InfoNaviRobot InfoNaviRobot
InternetSeer IstellaBot
JamesBOT JamesBOT
JennyBot JennyBot
JikeSpider JetCar
Jorgee Jorgee
Jyxobot
Keybot Translation-Search-Machine Keybot Translation-Search-Machine
Keyword Density
LNSpiderguy LNSpiderguy
Larbin Lanshanbot
LeechFTP LeechFTP
LeechGet
LexiBot LexiBot
Lftp Lftp
LieBaoFast LibWeb
LinkScan Libwhisker
LinkWalker Lightspeedsystems
LinksManager LinkpadBot
LinqiaMetadataDownloaderBot
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey Lipperhey
Litemage_walker
MFC_Tear_Sample
MIIxpc MIIxpc
MSFrontPage Mail.RU_Bot
Majestic12 Majestic-SEO
MarkMonitor Masscan
MarkWatch MeanPath Bot
Mass Downloader Meanpathbot
MauiBot Mediatoolkitbot
Mb2345Browser Metauri
MicroMessenger MicroMessenger
Microsoft Data Access Microsoft URL Control
Minefield
Mister PiX Mister PiX
Mojeek Moblie Safari
Mojolicious
MolokaiBot MolokaiBot
Musobot
NICErsPRO NICErsPRO
Nameprotect NPbot
NearSite Name Intelligence
NetSpider Nessus
NetZIP NetAnts
Netcraft Netvibes
Nibbler Nibbler
Niki-bot
Nikto Nikto
NimbleCrawler Nmap
Nimbostratus
Nuclei
Nutch Nutch
Offline Explorer Octopus
Offline Navigator Offline Navigator
OnCrawl
OpenVAS
Openvas
OrangeBot OrangeBot
OrangeSpider OutfoxBot
PECL::HTTP PHPCrawl
POE-Component-Client-HTTP
PageAnalyzer
PageScorer
PageThing.com
Pandalytics
Panscient
PeoplePal PeoplePal
Pi-Monster Pi-Monster
Picscout
Picsearch Picsearch
Pu_iN Piepmatz
Pockey
PxBroker
QueryN Metasearch QueryN Metasearch
RSSingBot RankurBot
RankFlex
RankingBot
Rankivabot
RealDownload RealDownload
RebelMouse Recorder
RepoMonkey RepoMonkey
Ripper Rogerbot
SBIder SBIder
SEOkicks-Robot SEOkicks
SEOprofiler SEOstats
Scrapy Scanbot
Searchestate ScoutJet
Seekport ScreenerBot
ScrepyBot
SemanticJuice
SemrushBot SemrushBot
SentiBot SiteCheckerBotCrawler
Seomoz
Siphon
Site Sucker
SiteExplorer SiteExplorer
SiteLockSpider
SiteSnagger
SiteSucker SiteSucker
Siteimprove
Sitevigil Sitevigil
SmartDownload SlySearch
Snake Snapbot
Sociscraper Snoopy
SpaceBison SocialRankIOBot
Spammen Sottopop
Spbot
Spinn3r
SputnikBot
Sqlmap Sqlmap
Sqlworm Steeler
Sqworm Stripper
SuperBot SuperBot
SuperHTTP
Suzuran Suzuran
Swiftbot
Szukacz
T0PHackTeam
T8Abot T8Abot
Teleport Telesoft
TheNomad Telesphorep
The Intraformant
Thumbor Thumbor
TightTwatBot
Titan Titan
Toata Toweyabot
Tracemyfile Trendictionbot
Trendiction Turingos
TwengaBot Typhoeus
Upflow
VB Project VB Project
VCI
Vacuum Vacuum
Vagabondo
VeriCiteCrawler VeriCiteCrawler
Voil Virusdie
Voltron
WEBDAV WEBDAV
WISENutbot
WPScan
WWW-Mechanize WWW-Mechanize
Wallpapers/3.0 WWW::Mechanize
Web Enhancer Web Enhancer
Web Pix Web Fetch
WebCollage WebAuto
WebImageCollector
WebLeacher WebLeacher
WebSauger WebSucker
WebStripper Webalta
WebWhacker WebmasterWorldForumBot
Webshag Webster
Website Quester
WebsiteExtractor
Whacker Whacker
Widow
Wonderbot Wonderbot
Woobot
Wprecon Wprecon
Xenu
YoudaoBot YoudaoBot
Zauba Zade
Zermelo Zeus
Zitebot
ZmEu ZmEu
arquivo.pt ZoomBot
autoemailspider ZoominfoBot
backlink-check ZyBorg
arquivo-web-crawler
coccocbot coccocbot
crawler.feedback dataforseo.com
crawler4j demandbase-bot
eCatch domainsproject.org
evc-batch
facebookscraper facebookscraper
gopher
heritrix heritrix
isitwp.com internetVista monitor
ips-agent
iubenda-radar iubenda-radar
linkdexbot magpie-crawler
lwp-request
meanpathbot meanpathbot
mediawords
muhstik-scan muhstik-scan
oBot oBot
seoscanners page scorer
seostar pcBrowser
sexsearcher plumanalytics
ubermetrics-technologies.com polaris version
seobility
seocompany.store
sitechecker.pro
siteripz
sogouspider
sp_auditbot
sysscan
tAkeOut
trendiction.com
trendiction.de
voyagerx.com voyagerx.com
webpros.com webgains-bot
zgrab webprosbot
xpymep1.exe
zauba.io

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
bscodecs.com candiceloves.us
filesvine.com cbozhe.com
hledejvshopech.cz compliance-fred.xyz
igru-xbox.net fakehandbags.xyz
jurajskie.info imagez.co
na-telefon.biz lignofix.ua
responsinator.com movpod.in
seeingmeerkat.com sexkontakte-seite.com
space4updating.win vitanail.ru
xn--80aodinpgi.xn--p1ai xn----7sbho2agebbhlivy.xn--p1ai

926
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
007angels.com 00it.com
00webcams.com 101flag.ru
13tabs.com 101lesbian.xyz
1xbet4you.com 1qingdao.com
2020iscoming.info 2020iscoming.info
2girls1cup-free.com 2345.com
45en.ru 4istoshop.com
4kplayer.pl 4k-player.pl
4rent.ru 7zap.com
51unlim.ru 991mostfm.co.id
55wmz.ru acortarurl.es
5tey7463.weebly.com adidas.frwebs.fr
999webdesign.com adloads.com
a.frcls.fr
aa14ab57a3339c4064bd9ae6fad7495b5f.com
adexprts.com
adloads.net
admanaerofoil.com
admatic.com.tr
admeasures.com
adnotbad.com adnotbad.com
adprotect.net adultfullhd.com
adultwebhosting.info ahrefs.com
advancedmassagebysara.com aksonural.ru
affiliate-fr.com aktivator-windows10.blogspot.com
agreda.pluto.ro allboard.xobor.de
akama.com allcredits.su
alfabot.xyz allesohnegirls.net
algerianembassy.co.in allnews.md
alive-ua.com amanda-porn.ga
alt-servis.ru amoi.tn
alveris.ru anapa-inns.ru
amazingpic.net animalia-life.club
amazon-adsystem.com anjalika.co.in
anabolics.shop apioasisspacenet-a.akamaihd.net
animalrank.com appfastplay.com
anime.dougasouko.com apptester.tk
animenime.ru as5000.com
anlimebel.kiev.ua atelielembrancaqueencanta.com.br
antons-transporte.de atleticpharm.org
aosexkontakte.net ausergrubhof.info
aosheng-tech.com autobudpostach.club
apidiamondatanet-a.akamaihd.net autodo.info
apimountainbikei-a.akamaihd.net aviav.eu
apiqualitinknet-a.akamaihd.net avitocars.ru
apispringsmartne-a.akamaihd.net azarttoto.com
apiwebwebgetcom-a.akamaihd.net bannerpower.com
app5.letmacworkfaster.world bannerswap.com
appiq.mobi besthomemadepornsites.com
arius.tech bestmobilityscooterstoday.com
artel116.ru bestsexyblog.com
aruplighting.com
asophoto.com
asrv-a.akamaihd.net
asscenihotosidea.blogspot.com
asseenontv.ru
azbukadiets.ru
b00kmarks.com
baladur.ru
balkanfarma.ru
balois.worldbreak.com
baltgem.com
bbsoldes.fr
beachdriveblog.com
bidr.trellian.com
binaryoptionscops.info binaryoptionscops.info
bioscorp.ru bitcoinremote.com
bjetjt.com bjanshee.ru
bkns.vn blackhatworth.com
blackcurranthumidifiers.site blogig.org
blobar.org bloke.com
blockety.co board.f00d.de
blogsfunky672.weebly.com boazpower.com
bonanza-fortune.men bobinoz.com
bochemit.com.ua
bongacams.com
bracketsmackdown.com bracketsmackdown.com
brainboosting.club breastaugmentation.co.za
brainboostingsupplements.org brillianty.info
brandedleadgeneration.com brokergid.ru
brandehk.dk bukleteg.xyz
brateg.xyz buyfriend.ru
brewdom.ru buzzsumo.com
briomotor.co bvlgariwallet.xyz
bryansk.zrus.org c-gainsbourg.com
buketeg.xyz c1.onedmp.com
bumascloset.com candlewooddentalcentre.com.au
burkesales.com cannibalcheerleader.com
bus-offer.com capacitacionyaprendizaje.com
candypeople.se capsderfudd.tk
cartierlove2u.xyz cartierlovebracelet.xyz
cartierring.xyz
cartierwatch.xyz
casablancamanor.co.za casablancamanor.co.za
cdnanalytics.xyz ceotrk.com
cdnnetwok.xyz checkm8.com
celejihad.info chelyabinsk.xrus.org
chatroulette.video chidporn.com
cheapestjerseys-wholesale.com chimiver.info
cheapjerseysap.com choosecuisine.com
cherubinimobili.it christianlouboutinreplica.win
christianlouboutinreplica.pw cialisovercounteratwalmartusa.com
christianlouboutinshoes.xyz ciceros.co
civilwartheater.com clash-clans.ru
cleanersoft.com cleanmypc.com
clevernt.com clickcash.com
clickintext.net
clippingphotoindia.com clippingphotoindia.com
coccoc.com
codq.info codq.info
cognitiveseo.com colobit.biz
collegeessay19.blogspot.ru com-onlinesupport.site
collegerentals.com compiko.info
compliance-don.top compliance-alex.top
compliance-jess.top compliance-andrew.top
compliance-julia.top compliance-checker.info
comsysnet.com connectingsingles.com
craftinsta.ru cookingmeat.ru
cubook.supernew.org counciltally.com
cv.wallhade.co cranly.net
czat.wp.pl crd.clan.su
daooda.com creativehutindia.com
darkbooks.org creatives.adbetclickin.pink
dataloading.net cyclobenzaprinevstizanidine.blogspot.com
dbmkfhqk.bloger.index.hr dailyrank.net
dealighted.com daisye.top
dms-sw.ru dating-time-now.com
dogclothing.store daydream-studio.ru
domain.webkeyit.com dayibiao.com
domik-derevne.ru ddospanel.com
dominterior.org ddpills.com
donna7753191.ru decenttools.com
doska-vsem.ru demian.kz
dostavka-v-ukrainu.ru design-ideas.info
doublepimp.com dieswaene.com
drivotracker.com directrev.com
duawitchrarato.tk discountliv.com
dumuelave.xyz discovertreasurenow.com
e-c.al dispo.de
eandsgallery.com dnepropetrovsk.mistr-x.org
ekto.ee doctormakarova.ru
electrik-avenue.com dojki-hd.com
electro-prom.com domaincheck.io
elektrozigarette2.webs.com dptaughtme.com
elektrozigaretten1.webs.com driving.kiev.ua
emailaccountlogin.co drunkenstepfather.com
eachdayisagift.review
eaplay.ru
easycommerce.cf
easync.io
ecxtracking.com
ed-shop01.ru
edwinkonijn.com.au
elstal.com.pl
elvel.com.ua
embedle.com embedle.com
emerson-rus.ru enternet.ee
empathica.com eralph.tk
en.altezza.travel erectile.bid
enginebay.ru eropho.com
eropornosex.ru eshop.md
etm-consult.de essayassist.com
excitacion.info estibot.com
expertnaya-ocenka.ru etotupo.ru
eywords-monitoring-your-success.com ezigarettenshop1.yolasite.com
ezigarettekaufen2.blox.pl f-loaded.de
f0815.de falllow.gq
facebook-mobile.xyz fanpagerobot.com
falcoware.com farmingworm.com
famix.xyz fealq.com
fanrto.com felizporno.com
filmidivx.com fetlifeblog.com
firstdrugmall.ru fickkontaktehobbyhuren.com
fitness-video.net fifa-coins.online
flirt4free.com filmbokep69.com
floridahuntingfishingadventures.com filmetricsasia.com
filmi-v.online
findacheaplawyers.com
fingerprintjs.com
firma-legion.ru
fivedwld.cf
flash4fun.com
flowwwers.com
fok.nl
fordsonmajbor.cf fordsonmajbor.cf
fortwosmartcar.pw forum20.smailik.org
forum.poker4life.ru forums.toucharcade.com
forum69.info frameimage.org
free-deals.faith free-share-buttons.com
free-video-tool.com freecamdollars.com
freemaintenancesysforpcandmac.top froggytube.com
freewareseek.com fuckbuddybestgilf.info
freewhatsappload.com
fres-news.com
fuckmill.com
g33.org g33.org
gamewrath.com g7m.pl
gamezblox.com gambarxkata.co
gameplexcity.com
gameprimary.com
games.kolossale.ru
gardene.ru
gateway.zscalerone.net gateway.zscalerone.net
gay-file.com gay.adultgalls.com
genericlowlatencyasiodriverhq.aircus.com gdcentre.ru
gepezz.info gentamicineyedrops.blogspot.com
getmyads24.com gidonline.one
getpopunder.com girlgamerdaily.com
gigixo.com gkvector.ru
girlspicsa.com glastecfilms.com.my
gk170.ru glavtral.ru
glall.ru globalsurfari.com
globalscam.ga gok-kasten.net
goodwriterssales.com google-liar.ru
googleseo.com.tr gopixdatabase.com
gosarhivrt.ru
greatdealshop.com greatdealshop.com
greenidesign.co guge.io
gsmlab.pl gymi.name
gstatey.net hahashka.ru
gta-club.ru hamptonoaks.ca
guitar-master.org handicapvantoday.com
h2monline.com hannasolution.ru
harmonyglen.us hawaiielectriclight.com
hatdc.org hdimagegallery.net
hayate.biz help.tpu.ru
hchha.com hermesbirkinhandbagoutlets.com
hdapp1008-a.akamaihd.net heroz.fr
healbio.ru hit-men.men
healgastro.com hitmuzik.ru
heliko.no hkladys.com
hiwibyh.bugs3.com houseofrose.com
hotel-mkad.ru houtings.xyz
hptwaakw.blog.fc2.com howtoclean.club
hyhj.info humanelydrew.com
ico.re hvd-store.com
iinstalll-fii1leis.jus0wil.pp.ua hybrid.ru
ikearugs.xyz ideashome.id
ilmen.net igrovyeavtomaty777.ru
imagerydatabase.com iklysha.ml
imk.com.ua inboundlinks.win
insider.pro inet-traffic.com
insta-add.pro interior-stickers.ru
intimshop-fantasy.ru intimshop-fantasy.ru
investzalog.ru iplogger.org
invivo.hu islamtoday.co.za
ip-guide.com ivanstroi.ru
itbc.kiev.ua japan-bearings.ru
itsdp3.com jav-way.site
iwanttodeliver.com javcoast.com
jerseyschinabizwholesale.us javlibrary.cc
jerseyswholesalechinalimited.com jobgirl24.ru
jerseywholesalebizchina.com jofucipiku.tk
jestr.org johnrobertsoninc.com
kaidalibor.de joyceblog.top
kaliningrad.zrus.org jumptap.com
karachev-city.ru junglenet-a.akamaihd.net
kartiniresto.com jyrxd.com
kenaba.su keywords-monitoring-success.com
keywordsking.com
keywordsuggests.com keywordsuggests.com
kidd.reunionwatch.com klejonka.info
kino-key.info klitimg.pw
kino-rf.ru kmd-pto.ru
kinobaks.com knowyournextmove.com
kinogolos.ru kol-energo.ru
klikbonus.com komputers-best.ru
koleso24.com.ua konkursowo-24.pl
konoplisemena.com koopilka.com
konpax.com ks1234.com
kretpicf.pw kung-fu-ru.com
kskjco.club kupiproday.com.ua
landscaping.center lancheck.net
letsart.ru laudit.ru
likesuccess.com leadn.pl
linkrr.com ledis.top
listiseltemournlan.gq lenvred.org
lernur.net
lescinq.com
letmacwork.world
letmacworkfaster.site
lidoradio.com
lion.bolegapakistan.com
lion.playtap.us
littlesexdolls.com littlesexdolls.com
littlesunraiser.com live-sexchat.ru
lob.com.ru lomza.info
localmatchbook.com lonfon.xyz
lol-smurfs.com lowephotos.info
lolnex.us lsex.xyz
lonely-mature.com luckyshop.net.ua
losangeles-ads.com lulea-auktionsverk.se
lottospring.com mamasuper.prom.ua
louboutinreplica.pw mantramusic.ru
louboutinreplica.xyz maridan.com.ua
lovi-moment.com.ua marmotstore.online
m.b00kmarks.com
macdamaged.space
macotool.com
magicdiet.gq
matpre.top matpre.top
me-ke.com matrixalchemy.com
medicine-4u.org max-p.men
megagrabber.ru meccadumps.net
menhealed.net medanestesia.ru
mil-stak.com mediafresh.online
mir-limuzinov.ru medicovi.com
mirmedinfo.ru medkletki.ru
mirobuvi.com.ua meget.co.za
missis.top menstennisforums.com
misslike.ru michaelkorssaleoutletonline.net
misterjtbarbers.com migente.com
mistr-x.org miniads.ca
mmstat.com misandesign.se
monclerboots.xyz mobilemedia.md
monitorwebsitespeed.com mole.pluto.ro
moroccosurfadventures.com montazhnic.ru
moscow-region.ru most-kerch.org
most.gov.iq most.gov.iq
moviemail-online.co.uk muschisexbilder.com
mowser.com musicpro.monster
mp3ringtone.info muz-tracker.net
mrinsidesales.com mydoctorok.ru
mrvideospornogratis.xxx myfreetutorials.com
musirc.com myhealthcare.com
myblogregistercm.tk
mydirtystuff.com
myindospace.com
mylesosibirsk.ru mylesosibirsk.ru
najaden.no myplaycity.com
nac-bearings.ru
naperehresti.info
narco24.me narco24.me
narkologiya-voronezh.ru naval.jislaaik.com
narutonaruto.ru navalwiki.info
naturtreenspicerx.pw netpics.org
nbsproject.ru newhairstylesformen2014.com
nelc.edu.eg news-speaker.com
newstraveller.ru nextconseil.com
nfljerseyscheapchinabiz.com nikkiewart.ru
nlfjjunb5.ru niroo.info
njkmznnb.ru
nmrk.ru nmrk.ru
northfacestore.online no-fuel.org
november-lax.com novosibirsk.xrus.org
odesproperty.com nowtorrents.com
ohmyrings.com o-o-8-o-o.com
okayimage.com oconto.ru
offf.info
okmusic.jp
okout.ru okout.ru
oktube.ru oksrv.com
onlinemeetingnow.com okuos.com
onstrapon.purplesphere.in omgtnc.com
open-odyssey.org onclickpredictiv.com
oralsexfilme.net onload.pw
onlywoman.org
openfrost.net
openmultipleurl.com
orel-reshka.net orel-reshka.net
osagonline.ru origin-my.ru
ourtherapy.ru pagesense.com
oyster-green.com palvira.com.ua
papasdelivery.ru parajumpersoutlet.online
partnerline.men parvezmia.xyz
pattersonsweb.com patol01.pw
pdn-4.com pavlodar.xkaz.org
penisvergrotendepillennl.ovh paydayloanslocal.com
perm-profnastil.ru petitions.whitehouse.gov
pharmacyincity.com
photo.houseofgaga.ru
piccshare.com piccshare.com
pl.id-forex.com picscout.com
podshipniki-ntn.ru pinwallpaper.top
pokemongooo.ml pizda.lol
pooleroadmedicalcentre.co.uk pizza-imperia.com
popander.mobi ploenjitmedia.azurewebsites.net
popunder.net pontiacsolstice.info
popup-jdh.xyz poppen-nw.net
porn555.com popunder.ru
pornophoto.xyz porno.simple-image.com.ua
privatefx-in.ru pornodojd.ru
professionaldieselcare.com pornoforadult.com
pron.pro pornoreino.com
pronorm.fr pornoslive.net
propranolol40mg.blogspot.com pozdrawleniya.com
prostitutki-almata.org prchecker.info
prostitutki-yaroslavlya.org princeadvantagesales.com
proxyelite.biz privacylocationforloc.com
pyrodesigns.com.au profitsport.club
qitt.ru pulse33.ru
rabot.host.sk pulseonclick.com
rapidgator-porn.ga quickchange.cc
razvratnoe.org registrationdomainsite.com
remont-mobile-phones.ru registry-cleaner.net
renewablewealth.com registrysweeper.com
rentehno.ru repeatlogo.co.uk
replicalouboutin.xyz ruex.org.ua
respublica-otel.ru runtnc.net
ringporno.com ruspdd.com
rocis.site ryetaw.com
rollercoin.com s8-nowy-wygraj.comli.com
rome2rio.com saletool.ru
rossanasaavedra.net sardinie.us
rozalli.com sax-sex.com
roznica.com.ua sayyoethe.blogspot.co.za
running-line.ru scanner-alexa.top
ruscoininvest.company scanner-donald.top
s1z.ru scansafe.net
safe-app.net scottbywater.com
sajatvelemeny.com sdelatmebel.ru
salutmontreal.com se-welding.ru
scanner-john.top se.bnt-team.com
searchtooknow-a.akamaihd.net seansonline24.pl
serpstat.com searchengineranker.email
sexpornotales.net seasonvar.ru
secretscook.ru
seo-2-0.com
seo-traffic-ranking.info
seorank.info
seotoolsagency.com
sexgalleries.top
sextracker.com sextracker.com
sexy-pings.com sexystrippe.info
sexytrend.ru
shama-rc.net shama-rc.net
shitting.pro share-buttons-for-free.com
sierraapps.com shoesonlinebuy.cn
sim-service.net si-unique.com
sibecoprom.ru
simplepooltips.com
simpoed.ufop.br simpoed.ufop.br
sirpornogratis.xxx siteexpress.co.il
site-analyzer.com slavic-magic.ru
sklad-24.ru slowmac.tech
skladvaz.ru smart-scripts.com
smailik.org
smokewithrabbits.com smokewithrabbits.com
snip.tw soc-proof.su
socialbookmarksubmission.org socas.pluto.ro
soft-program.com sovinsteel.ru
softxaker.ru spaceshipad.com
sohoindia.net sports-supplements.us
solnplast.ru star61.de
sonata-arctica.wz.cz streetfooduncovered.com
sortthemesitesby.com stretchingabuckblog.com
spinazdrav.ru
sprttrack.com
spyfu.com
stackthatbucks.com
stair.registrydomainservices.com
stathat.com
stillmiracle.com
stmassage.ru
stpicks.com
stretchmate.net stretchmate.net
stroiminsk.com stuff-about-money.com
superfish.com sweepstakes.rewardit.com
superstats.com tamada69.com
swsociety.se tandvardshuset.net
takeflyte.com
tarad.com tarad.com
td-l-market.ru telefonsexi.com
teletype.in tengohydar.tk
templates.franklinfire.co thenetinfo.com
thebluenoodle.com thetattoohut.com
thecoolimages.net titslove.yopoint.in
thefds.net tizanidineandhydrocodone.blogspot.com
thegioixekhach.com tizanidineforopiatewithdrawal.blogspot.com
thewomenlife.com tizanidineshowupondrugtest.blogspot.com
thiegs.reco.ws topanasex.com
timdreby.com topbestgames.com
tizanidinedrugtest.blogspot.com topclickguru.com
tizanidinehcl2mgtablet.blogspot.com tracklead.net
tizanidinemusclerelaxant.blogspot.com trackzapper.com
tomatis.gospartner.com
tomck.com
tonivedu.it
toonfamilies.net
torrentgamer.net
toy-shop.top
trafficjunky.net
trafficnetzwerk.de trafficnetzwerk.de
traffixer.com trafficstars.com
traxdom.ru trahvid.com
trichizobswiv.agddns.net trichizobswiv.agddns.net
truck-land.life trion.od.ua
tyumen.xrus.org trucri.me
uamtrk.com truebeauty.cc
uchebavchehii.ru trustaffs.com
ugguk.online trustedhealthtips.com
um-razum.ru trustl.life
uni.me tzritel.tk
univerfiles.com ua.tc
urdoot.win ucsol.ru
usbggettwku.ga uggsale.online
vabasa.inwtrade.com ultimatesetnewfreeallsoftupgradesystems.pw
vapomnoncri.tk uptimechecker.com
vchulkax.com urccvfmc.bloger.index.hr
vegascosmetics.ru vadimkravtcov.ru
video--production.com vclicks.net
videochat.world versaut.xxx-cam.webcam
virtualbb.com via-energy-acquistare.com
virus-schutzmasken.de viberdownload10.com
visitcambridge.org video-chat.love
vodaodessa.com video-hollywood.ru
w3data.co videotuber.ru
webalan.ru virtuagirl.com
vykupavto-krasnodar.ru
vysigy.su
vzube.com
warezkeeper.com
webcamdevochka.com
webinstantservice.com
weblo.com
webnode.me webnode.me
weboptimizes.com
webpromotion.ae webpromotion.ae
website-speed-up.site websiteaccountant.de
weburok.com weburlopener.com
wejdz-tu.pl
wemedinc.com
westen-z.life
westermarkanjou.se westermarkanjou.se
white-truck.life wjgony.com
wholinkstome.com wnoz.de
woman-h.ru workle.website
word-vorlagen.net worldlovers.ru
worldinternetauthority.com worldoffiles.ru
worldmusicfests.com
wovis.site
woweb.com.ua
ws.ampower.me
www.888.com www.888.com
wzgyyq.com www.kabbalah-red-bracelets.com
x-stars.ru www.timer4web.com
x-true.info x-rates.ru
xcc24.pl xerox-douglas.cf
xchat26.myfreecams.com xfire.com
xjlottery.com xn--c1acygb.xn--p1ai
xn-----7kcabaipgeakzcss7bjdqdwpfnhv.xn--p1ai xvideospornoru.com
xn-----8kcatubaocd1bneepefojs1h2e.xn--p1ai xz618.com
xn--80abgj3a5acid6ghs.top y8games-free.com
xn--80atua3d.xn--p1ai yadro.ru
xolodremont.ru yellocloud.be
xxxnatelefon.ru
ynymnwbm.bloger.index.hr ynymnwbm.bloger.index.hr
youandcredit.ru yoshkarola.zrus.org
youtube-downloader.savetubevideo.com youradulthosting.com
yourothersite.com
yourtemplatefinder.com
youtoner.it
yuarra.pluto.ro
yugk.net yugk.net
zajm-pod-zalog-nedvizhimosti.ru yuweng.info
zarabiaj-dzis.pl zagadki.in.ua
zazagames.org zaidia.xhost.ro
zdesformula.ru zaimhelp.ru
zeroredirect7.com zerocash.msk.ru
zmoda.hostreo.com zeroredirect.com
zoogdinsney.com znakomstva-piter78.ru
zytpirwai.net zverokruh-shop.cz

488
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
1001desert.com 0daymusic.org
202ch.com 1000n1.ru
4ureyesonly.com 123movies.love
4webmasters.com 2daytrendingnews.com
8gold.com 2drittel.de
aa81bf391151884adfa3dd677e41f94be1.com 2rich4bitches.com
aaa38852e886ac4af1a3cff9b47cab6272.com 5-steps-to-start-business.com
adelly.bg 7search.com
advancedcleaner.com addblueoff.com.ua
aibolita.com adult-shop.com.ua
alert.scansafe.net allkrim.com
allknow.info apiwebwebgetcom-a.akamaihd.net
allwidewallpapers.com approved.su
angkortours.vn arabgirls.adultgalls.com
animaltoplist.com arcadepages.com
anniemation.com arendatora.ru
anonymousfox.co arkartex.ru
appsaurus.com asscenihotosidea.blogspot.co.za
arcadeplayhouse.com atlant-auto.info
artdestshop.eu ausergrubhof.info
asseenontv.ru autobrennero.it
atdedinotuho.tk aviav.eu
atelielembrancaqueencanta.com.br azbuka-mo.ru
atley.eu.pn bagsonsale.online
backiee.com bank.uz
bagcionderlab.com bayareaaeroclub.org
baoxaydung.com.vn beachdriveblog.com
bear.gotcher.us beauty-things.com
belinka.com.ua beclean-nn.ru
bestadbid.com bestplacetobuyeriacta.jw.lt
binaryoptionscops.info bestserials.com
bharatdefencekavach.com
bigcities.org
blackbabesporn.com
bloggedporn.com
blogos.kz
bloke.com
bluerobot.info
bluesalt.co bluesalt.co
bmw-ark.ru bmsco.co
boanonihaca.tk brateg.xyz
boeuklad.com briomotor.co
bonzibuddi.com browserprotecter.com
burger-tycoon.com camsex.xxx-cam.webcam
buypillsorderonline.com cardsharp1.ru
calc-for-credit.ru cezartabac.ro
callstevens.com christianlouboutinsaleonline.us
cam-kontakte.org chuckguilford.com
cartierreplica.top ciproandtizanidine.blogspot.com
cartiertrinity.xyz cleanallvirus.com
civilwartheater.com collegerentals.com
classiquebijoux.ru communisave.co.za
clickcash.com conboy.us
clippingphotoindia.com cowlmash.com
club-lukojl.ru creativehutindia.com
codq.info
coldfilm.ru
coop-gamers.ru
cottageofgrace.com
countercrazy.com
cyprusbuyproperties.com
d2jsp.org d2jsp.org
ddpills.com dawlenie.com
delayreferat.ru db.speedup.gdn
demon-tweeks.com discountbarbour.online
devochki.top dktr.ru
dichvuvesinhhanoi.com dkvorota.ru
dickssportinggoods.com domain-tracker.com
dieswaene.com domain.webkeyit.com
dikqlyremy.info download-walpaperhd.blogspot.com
domaincheck.io drpornogratisx.xxx
duawitchrarato.tk dtnlyss.com
eachdayisagift.review e-commerce-seo1.com
eets.net easycommerce.cf
elektrischezigarette2.devhub.com ecommerce-seo.com
enews.tech elvenar.com
epicbrogaming.com emerson-rus.ru
erectile.bid englishdictionaryfree.com
es5.com exmasters.com
excaliburfilms.com exoneration-project.us
extads.net faptitans.com
ezigarettenshop2.myblog.de fast-torrent.ru
ezigaretteshop2.mywapblog.com fbdownloader.com
filmgo.ru fettefrauen.net
find1friend.com filmbokep69.com
flagcounter.me filmi-v.online
floridamobilebillboards.com freshmac.space
fortevidyoze.net fuckingawesome.com
forum.tvmir.org fym.com.ru
foto-basa.com gael-s.ru
freegamesplay.online gameprimary.com
fun-mobi.pl gamezblox.com
g7m.pl gdcentre.ru
gamblingnerd.com gg.zzyjxs.com
games.kolossale.ru girlspicsa.com
gaming-journal.com glall.ru
generic-pills-online.com glasof.es
getaclueamerica.com greatidea.marketing
hdxnxxtube.mobi greenshop.su
heartofbeijing.blogspot.com guidefs.ru
histats.com hamilton.ca
hit-kino.ru histock.info
hitsbox.info host-tracker.com
hollywoodactress.info hoste.octopis.com
housekuba.org hotdl.in
hut1.ru housemilan.ru
id-forex.com hreade.com
ihc2015.info husky-shop.cz
ilovevitaly.com iamsport.org
immobiliaremassaro.com iflycapetown.co.za
inboxdollars.com igadgetsworld.com
indo-export.ru ilovevitaly.xyz
instabid.tech imicrovision.com
japfm.com intellego.info
jikoman.info interior-stickers.ru
kamagragelusa.net intermesh.net
kazinogames.lv iphantom.com
kino2018.club istizanidineanopiate.blogspot.com
kinotorka.ru iyasimasennka.com
komputernaya-pomosh-moscow.ru javatex.co.id
jose.mulinohouse.co
junglenet-a.akamaihd.net
jurajskie.info
kareliatobacco.ru
keywordspay.com
kino-rf.ru
kinoplen.ru
kosynka-games.ru kosynka-games.ru
kreativperlen.ch linkredirect.biz
lacave.ntic.fr liverpool.gsofootball.com
lafriore.ru lomza.info
landscaping.center mafcards.ru
legalrc.biz magiadinamibia.blogspot.com
link.ac marmotstore.online
lion.playtap.us masthopehomes.com
ljusihus.se maximpartnerspr.com
lolnex.us maxxtor.eu
long-beach-air-conditioning.com mebelcomplekt.ru
lost-alpha.ru medkritika.ru
lutherstable.org megakino.net
maladot.com metascephe.com
masterseek.com moneyviking-a.akamaihd.net
mebel-ekb.com musicstock.me
microstatic.pl nhl09.ru
mnimmigrantrights.net nicefloor.co.uk
mobplayer.ru nowtorrents.com
mobstarr.com omsk.xrus.org
mojaocena.com oneclickfiles.com
moncleroutletonline.pw online-zaymy.ru
moonci.ru onlywoman.org
muz-tracker.net onstrapon.purplesphere.in
my-bc.ru oranga.host.sk
my-cash-bot.co ordernorxx.com
my-floor.in.ua outpersonals.com
mydearest.co oyster-green.com
myindospace.com perl.dp.ua
nalogovyy-kodeks.ru pflexads.com
nastydollars.com pharmacyincity.com
netpics.org piratecams.com
newyorkhotelsmotels.info poligon.com
no-rx.info pornolook.net
nofreezingmac.work praisong.net
nomuos.it priceg.com
nuup.info
o-o-6-o-o.ru
ochistka-stokov.ru
online247.ml
openfrost.com
ownshop.cf
paperwritingservice17.blogspot.ru
partner-high.men
perfectplanned.com
php-market.ru
pipki.r.acdnpro.com
pixelrz.com
pk-pomosch.ru
pourvous.info
printingpeach.com printingpeach.com
pxhdwsm.com privacyassistant.net
qualitymarketzone.com producm.ru
redirectme.net profitfx.online
reklama1.ru pssucai.info
relatodelpresente.com.ar psvita.ru
remontgruzovik.ru quebec-bin.com
rennlist.com rabot.host.sk
rff-cfal.info ranksonic.com
rfserial.net rasteniya-vs-zombi.ru
rubanners.com registrationdomainsite.com
relax.ru
renhacklids.tk
responsinator.com
rethinkwasteni.info
ringtonepartner.com
rockprogblog.com
rrutw.com
rumamba.com rumamba.com
runofilms.ru ruscopybook.com
saveindex.xyz s-forum.biz
scanner-walt.top sabizonline.com
searchlock.com safe-app.net
seccioncontrabajo.com scanner-fred.top
sexfreepornoxxx.com scanner-marwin.top
sexsaoy.com scanner-walter.top
sharebutton.net schalke04fc.info
sharpchallenge.com search-error.com
shivafurnishings.com selectads.men
sierraapps.com shakhtar-doneck.ru
similardeals.net simon3.ru
site5.com simpoed.ufop.br
siteaero.com sogimlecal.tk
siteripz.net sotkal.lark.ru
sixcooler.de souvenirua.com
smart-scripts.com sprttrack.com
sobecjvuwa.com.ru spyfu.com
sockshare.net stard.shop
sotechco.co stariy-baku.com
strv.se starpages.net
subj.ukr-lit.com steamoff.net
superfish.com sterva.cc
superstarfloraluk.com stevemonsen.com
surflinksmedical.com stoki.ru
svetlotorg.ru streetfooduncovered.com
svtrd.com stroy-portal22.ru
terrafootwear.us supernew.org
thegalerie.eu svolze.com
themestotal.com swiped.su
thetardistimes.ovh tako3.com
tizanidine4mg.blogspot.com techart24.com
tizanidinehcl4mgtablet.blogspot.com telegramdownload10.com
tizanidinestreetprice.blogspot.com templates.franklinfire.co
tengohydar.tk
thebluenoodle.com
thefarmergame.com
thepantonpractice.co.uk
theporndude.com
timhost.ru
tizanidinerecreationaluse.blogspot.com
topappspro.com topappspro.com
topsiteminecraft.com truebeauty.cc
tourismvictoria.com txxx.com
traffic-club.info ucoz.ru
trafficgenius.xyz uhdtv.website
treasuretrack-a.akamaihd.net urlopener.blogspot.com.au
ttsq.fr us-america.ru
tubeoffline.com vabasa.inwtrade.com
tversvet.ru vapeface.club
ua.tc varbergsvind.se
unrealcommander.biz vereo.eu
ural-buldozer.ru vinylvault.co.uk
vashsvet.com vksaver-all.ru
vbtracker.net vzlomfb.com
video-chat.love w7s.ru
videogamesecrets.com waterefficiency.co
vids18.site website-stealer.nufaq.com
vkgaleria.com websitevaluebot.com
voluumtracker1.com webstatsdomain.org
voronezh.xrus.org while.cheapwebsitehoster.com
website-datenbank.de whiteelephantwellington.com
weekes.biz.tc whos.amung.us
whatistizanidinehclusedfor.blogspot.com whosonmyserver.com
wholesalejerseychinaoutlet.com worldoffiles.ru
winx-play.ru xn----9sbubg3ambdfl1j.xn--p1ai
xn----7sbho2agebbhlivy.xn--p1ai xn--80ak6aa92e.com
xtrafficplus.com yachts-cruise.info
xvideospornoru.com yoopsie.com
youjizz.com zacreditom.ru
youjizz.vc zaobao.com.sg
yourads.website zetgie.com.pl
youraticles.pl zoolubimets.ru
yourothersite.com zreloeporno.tv
youtube-downloader.savetubevideo.com
zakazfutbolki.com
zaloadi.ru
zastenchivosti.net
zeroredirect8.com
zhongwenlink.com
zoogdisany.com
zzbroya.com.ua

101
dev-tools/test_units/ratelimittest-beta.txt
View file

@ -1,3 +1,104 @@
<!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html><html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html> <html>
<head><title>503 Service Temporarily Unavailable</title></head> <head><title>503 Service Temporarily Unavailable</title></head>
<body> <body>

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.196 0; 10.1.0.77 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.09.3340 ### Version: V4.2022.09.3341
### Updated: Fri Sep 9 10:03:26 UTC 2022 ### Updated: Sat Sep 10 10:03:20 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.09.3340 ### Version: V4.2022.09.3341
### Updated: Fri Sep 9 10:03:26 UTC 2022 ### Updated: Sat Sep 10 10:03:20 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##