vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-02 18:50:13 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2022.09.3382 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2022-09-30 22:06:56 +00:00
parent 0aaf8c3031
commit d288ae20f6
47 changed files with 95340 additions and 95350 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.09.3381 #### Version: V4.2022.09.3382
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.09.3381 #### Version: V4.2022.09.3382
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -14,7 +14,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2022.09.3381 #### Version: V4.2022.09.3382
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

11782
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2022.09.3381 #### Version: V4.2022.09.3382
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

11786
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

11786
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

11786
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

11786
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.110 1; 10.1.0.56 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.110 0; 10.1.0.56 0;
127.0.0.1 0; 127.0.0.1 0;

11786
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.110 1; 10.1.0.56 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.110 0; 10.1.0.56 0;
127.0.0.1 0; 127.0.0.1 0;

11786
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.110 1; 10.1.0.56 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.110 0; 10.1.0.56 0;
127.0.0.1 0; 127.0.0.1 0;

11786
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
3381 3382

11786
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

11786
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
13.84.162.182 0; 4.227.203.197 0;

11786
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.110 1; 10.1.0.56 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.110 0; 10.1.0.56 0;
127.0.0.1 0; 127.0.0.1 0;

11786
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.110 1; 10.1.0.56 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.110 0; 10.1.0.56 0;
127.0.0.1 0; 127.0.0.1 0;

11786
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.110 1; 10.1.0.56 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.110 0; 10.1.0.56 0;
127.0.0.1 0; 127.0.0.1 0;

11786
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
13.84.162.182 0; 4.227.203.197 0;

11786
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
13.84.162.182 0; 4.227.203.197 0;

11786
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.110 1; 10.1.0.56 1;
127.0.0.1 1; 127.0.0.1 1;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
AiHitBot Download Wonder
BackWeb Fuzz
DomainAppender Mata Hari
Grafula Mozlila
InternetSeer Nessus
NetSpider Sqworm
WASALive-Bot Turnitin
WebGo IS WWWOFFLE
WebmasterWorldForumBot Xaldon WebSpider
WiseGuys Robot lwp-request

302
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,184 +1,180 @@
360Spider
404checker 404checker
ALittle Client AIBOT
ASPSeek Abonti
Acunetix Aboundex
Aboundexbot
AfD-Verbotsverfahren AfD-Verbotsverfahren
AllSubmitter AhrefsBot
AiHitBot
Anarchie
Anarchy99 Anarchy99
Anthill Asterias
Apexoo Atomseobot
AwarioSmartBot AwarioSmartBot
BBBike BDCbot
BLEXBot BDFetch
BackStreet BackStreet
BackWeb
Backlink-Ceck
Bandit Bandit
Barkrowler
Battleztar Bazinga Battleztar Bazinga
BetaBot Brandprotect
Blackboard
BlowFish
Bolt
Buck
Buddy
BuiltWith BuiltWith
BuzzSumo CATExplorador
CSHttp Cegbfeieh
Calculon
CheTeam CheTeam
CheeseBot CherryPicker
ChinaClaw ChinaClaw
Citoid Cliqzbot
Cloud mapping
Cocolyzebot
Collector Collector
Copier
Copyscape Copyscape
Cosmos Crescent
Craftbot CrunchBot
Curious CyotekWebCopy
DBLBot DIIbot
DSearch DTS Agent
DataCha0s
DatabaseDriverMysqli
Demon Demon
Deusu Devil
Digincore DigitalPebble
Dirbuster Dirbuster
Discobot Discobot
Dispatch
DittoSpyder
DnBCrawler-Analytics DnBCrawler-Analytics
DomainCrawler DomainAppender
DomainStatsBot
Dotbot Dotbot
EMail Wolf Download Wonder
Ebingbong Drip
Ecxi EMail Siphon
Express WebPictures EasyDL
ExtLinksBot
Extractor Extractor
ExtractorPro EyeNetIE
Extreme Picture Finder
Ezooms Ezooms
FemtosearchBot FHscan
Fimap
Firefox/7.0
FlashGet FlashGet
Flunky Freeuploader
FrontPage Fuzz
GT::WWW G-i-g-a-b-o-t
GetWeb GalaxyBot
GetRight
Gigabot
GoZilla
Gotit
GrapeFX
GrapeshotCrawler GrapeshotCrawler
HEADMasterSEO HMView
HTMLparser
HTTP::Lite HTTP::Lite
HTTrack
Haansoft
Harvest Harvest
Heritrix Havij
IDBTE4M HonoluluBot
IDBot IDBot
Id-search IRLbot
IlseBot Image Fetch
Image Sucker Indy Library
InfoTekies InfoTekies
InterGET InterGET
Internet Ninja Internet Ninja
InternetSeer
Iria Iria
Iskanie JOC Web Spider
JetCar
Jetty
Joomla Joomla
Jyxobot
LNSpiderguy
LWP::Simple LWP::Simple
Leap Larbin
LeechFTP LeechFTP
LexiBot LexiBot
Lftp Likse
LinkpadBot LinkWalker
Linkbot
LinqiaRSSBot
Lipperhey Lipperhey
Lipperhey Spider Ltx71
Lmspider MFC_Tear_Sample
MIDown tool MIDown tool
MIIxpc MQQBrowser
MSFrontPage MSFrontPage
MSIECrawler MSIECrawler
MTRobot Majestic SEO
Magnet
Mail.RU_Bot
Majestic-SEO
MarkWatch
Mass Downloader Mass Downloader
Masscan
Mata Hari
Mb2345Browser
Mediatoolkitbot
Metauri
MicroMessenger MicroMessenger
Minefield Mister PiX
Mojeek Mojolicious
Morfeus Fucking Scanner Nessus
NPbot Net Vampire
Name Intelligence
Navroad
NetAnts NetAnts
NetLyzer NetLyzer
Netcraft NetSpider
Nettrack
Nibbler
Niki-bot Niki-bot
Nimbostratus Nikto
Nmap Offline Explorer
Nuclei OpenVAS
Nutch Openfind
Openvas OrangeSpider
OutclicksBot
PECL::HTTP PECL::HTTP
PHPCrawl
POE-Component-Client-HTTP
Page Analyzer Page Analyzer
PageAnalyzer PageAnalyzer
PageGrabber PageGrabber
PageThing.com
Pandalytics
Papa Foto
Pavuk Pavuk
PeoplePal
Petalbot Petalbot
Pi-Monster Pi-Monster
Picscout Picsearch
Piepmatz Piepmatz
Pixray Pixray
Pockey PleaseCrawl
ProWebWalker RankActive
Probethenet RankFlex
Quick-Crawler
RSSingBot
RankingBot RankingBot
RankingBot2 ReGet
Rankivabot RebelMouse
RealDownload RedesScrapy
RepoMonkey RocketCrawler
SEOkicks-Robot SEOkicks-Robot
SEOprofiler SEOstats
SISTRIX SISTRIX
SalesIntelligent SMTBot
ScanAlert ScanAlert
ScoutJet Scrapy
ScreenerBot
ScrepyBot ScrepyBot
Searchestate
SearchmetricsBot SearchmetricsBot
SemanticJuice
SentiBot
SeoSiteCheckup
Seomoz Seomoz
Shodan
Siphon Siphon
SiteCheckerBotCrawler SiteCheckerBotCrawler
SiteExplorer
SiteLockSpider
SiteSucker SiteSucker
Sitebeam SlySearch
Sitevigil
SmartDownload SmartDownload
Snake Snapbot
Snoopy Sociscraper
SocialRankIOBot SpaceBison
Sosospider Spammen
Spinn3r SpankBot
Spanner
SputnikBot SputnikBot
Sqworm Sqworm
Stripper Steeler
T0PHackTeam Sucker
Teleport SuperBot
TeleportPro Szukacz
Telesoft Thumbor
TightTwatBot TightTwatBot
Toata Toata
Tracemyfile
Trendictionbot
Turingos Turingos
Turnitin Turnitin
TurnitinBot TurnitinBot
@ -186,65 +182,69 @@ TwengaBot
Twice Twice
Typhoeus Typhoeus
URLy.Warning URLy.Warning
VB Project Upflow
V-BOT
VCI
Vacuum Vacuum
Vagabondo
VeriCiteCrawler
VidibleScraper VidibleScraper
Virusdie Voil
VoidEYE Voltron
WBSearchBot WEBDAV
WWW-Mechanize WPScan
WWW::Mechanize
WWWOFFLE
Wallpapers Wallpapers
Wallpapers/3.0
Web Auto
Web Enhancer Web Enhancer
Web Fetch
Web Fuck Web Fuck
Web Pix WebAuto
Web Sucker
WebCollage WebCollage
WebEnhancer WebEnhancer
WebFuck WebFuck
WebSucker WebGo IS
WebZIP WebSauger
Webalta Webalta
WebmasterWorldForumBot WebmasterWorldForumBot
Webshag WebsiteQuester
Whacker
Who.is Bot Who.is Bot
Widow
WinHTTrack WinHTTrack
Wotbox WiseGuys Robot
Wprecon Woobot
Zitebot Xaldon_WebSpider
YoudaoBot
Zade
Zauba
Zermelo
Zeus
ZmEu ZmEu
ZumBot ZoominfoBot
autoemailspider autoemailspider
backlink-check
cah.io.community
check1.exe
clark-crawler
coccocbot
crawl.sogou.com crawl.sogou.com
crawler.feedback
crawler4j crawler4j
demandbase-bot
domainsproject.org domainsproject.org
eCatch eCatch
facebookscraper
gopher gopher
heritrix heritrix
instabid
internetVista monitor internetVista monitor
ips-agent
isitwp.com isitwp.com
iubenda-radar iubenda-radar
lwp-request linkdexbot
lwp-trivial muhstik-scan
netEstate NE Crawler
oBot oBot
polaris version page scorer
seobility plumanalytics
seoscanners
seostar
sitechecker.pro sitechecker.pro
siteripz tAkeOut
trendiction.de trendiction.com
voyagerx.com voyagerx.com
webgains-bot
webmeup-crawler
webpros.com webpros.com
webprosbot zauba.io
x09Mozilla zgrab

304
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
404checker 404checker
404enemy 404enemy
ADmantX 80legs
AIBOT
ALittle Client
ASPSeek ASPSeek
Abonti Alligator
Acunetix
AiHitBot
Aipbot
AlphaBot
Anarchie Anarchie
Anarchy99
Ankit Ankit
Anthill Anthill
Apexoo
Aspiegel Aspiegel
Atomseobot
AwarioRssBot
AwarioSmartBot
BBBike BBBike
BLEXBot BackStreet
Backlink-Ceck Badass
BacklinkCrawler Barkrowler
Bandit BetaBot
Bigfoot
Bitacle Bitacle
BlackWidow BlackWidow
Blow
Boardreader
Bolt Bolt
Brandprotect BotALot
Buddy Buddy
BuiltWith BunnySlippers
Bullseye CATExplorador
CCBot CCBot
CODE87 CSHttp
Calculon CazoodleBot
Cegbfeieh Cegbfeieh
CensysInspect
CheTeam CheTeam
CherryPicker CherryPicker
ChinaClaw Collector
Chlooe
Claritybot
Cloud mapping
Cocolyzebot
Cogentbot
CopyRightCheck
Copyscape
Cosmos
Craftbot Craftbot
Crawling at Home Project
Crescent Crescent
CrunchBot CrunchBot
Custo
CyotekWebCopy
DBLBot DBLBot
DIIbot DSearch
DataCha0s
Demon Demon
Deusu
Devil Devil
Digincore
DigitalPebble
Dirbuster Dirbuster
Disco Disco
Discobot Discobot
Dispatch Dispatch
DittoSpyder
DomainAppender
DomainSigmaCrawler DomainSigmaCrawler
Download Wonder Domains Project
Dragonfly Dragonfly
Drip
ECCP/1.0 ECCP/1.0
Evil EirGrabber
Express WebPictures Express WebPictures
Extractor Extractor
Ezooms ExtractorPro
Extreme Picture Finder
EyeNetIE
FDM FDM
Fimap
Flunky
Freeuploader Freeuploader
FrontPage FrontPage
Fuzz FyberSpider
GT::WWW G-i-g-a-b-o-t
GalaxyBot
Genieo Genieo
GermCrawler GetRight
Go!Zilla GetWeb
GrapeFX Go-Ahead-Got-It
GoZilla
Gotit
GrabNet
Grafula
GridBot
HMView
HTTP::Lite
Haansoft Haansoft
HaosouSpider
Harvest Harvest
Heritrix Hloader
HonoluluBot
Humanlinks
HybridBot
IDBTE4M IDBTE4M
IRLbot IlseBot
Image Fetch
Image Sucker Image Sucker
Indy Library
InfoTekies
Intelliseek Intelliseek
InternetSeer Iria
JamesBOT Iskanie
JennyBot Jetty
JetCar JikeSpider
Joomla Joomla
Kenjin Spider Jorgee
Kozmosbot Jyxobot
LWP::Simple LWP::Simple
Larbin Leap
LeechGet LexiBot
Libwhisker
LieBaoFast LieBaoFast
LinkScan LinkScan
LinkWalker
LinkextractorPro
LinkpadBot
LinksManager
LinqiaRSSBot
LinqiaScrapeBot LinqiaScrapeBot
Lipperhey Lipperhey
Lipperhey Spider Litemage_walker
Lmspider
Ltx71
MFC_Tear_Sample MFC_Tear_Sample
MIIxpc MIDown tool
MJ12bot
MSFrontPage
MTRobot MTRobot
Mail.RU_Bot Mag-Net
Majestic-SEO
MauiBot MauiBot
Mb2345Browser
MeanPath Bot MeanPath Bot
MegaIndex.ru Mediatoolkitbot
Microsoft URL Control Metauri
Minefield MicroMessenger
Moblie Safari Mozlila
Mojeek
Mojolicious
MolokaiBot
Msrabot Msrabot
Musobot NICErsPRO
NPbot
Nameprotect Nameprotect
Navroad
NearSite NearSite
Needle Nessus
NetAnts
NetLyzer
NetSpider
Netcraft Netcraft
Nettrack Netvibes
NimbleCrawler Nikto
Nimbostratus Nimbostratus
Ninja
Nuclei
Octopus
Offline Explorer Offline Explorer
OnCrawl Offline Navigator
PHPCrawl OpenLinkProfiler
POE-Component-Client-HTTP Openfind
Page Analyzer OrangeSpider
OutfoxBot
PageThing.com PageThing.com
Pavuk Pandalytics
PeoplePal Panscient
Pixray Papa Foto
PleaseCrawl Pi-Monster
ProPowerBot Picscout
ProWebWalker Picsearch
PictureFinder
Pimonster
Probethenet Probethenet
Pump
PxBroker PxBroker
Quick-Crawler
RSSingBot
RankActive RankActive
RankActiveLinkBot
Rankivabot Rankivabot
RealDownload Reaper
RebelMouse RebelMouse
Ripper
RocketCrawler RocketCrawler
SBIder SMTBot
SEOkicks-Robot
SEOlyticsCrawler
SEOprofiler
SalesIntelligent SalesIntelligent
ScreenerBot ScrepyBot
Searchestate SearchmetricsBot
SemrushBot SeoSiteCheckup
Seomoz Shodan
Site Sucker Siphon
SiteExplorer SiteExplorer
SiteLockSpider SiteLockSpider
SiteSnagger SiteSnagger
Sitevigil
Sogou web spider Sogou web spider
Sosospider Sosospider
Spammen Spammen
SpankBot SpankBot
Spanner Spanner
Sqworm Spinn3r
SputnikBot
Steeler Steeler
Stripper SurveyBot
Sucuri Suzuran
Swiftbot Teleport
T8Abot TeleportPro
Telesphoreo Telesphoreo
Telesphorep TheNomad
Tracemyfile UnisterBot
Trendiction VB Project
True_Robot
Turnitin
Typhoeus
URLy Warning
URLy.Warning
Upflow
Vacuum Vacuum
Vagabondo Vagabondo
Virusdie VoidEYE
Voil
Voltron Voltron
WASALive-Bot WWW-Collector-E
WEBDAV
WISENutbot
WPScan
WWW::Mechanize WWW::Mechanize
WWWOFFLE
Wallpapers Wallpapers
Wallpapers/3.0 WallpapersHD
Web Enhancer WeSEE
Web Auto
Web Fetch
Web Fuck
Web Sauger Web Sauger
WebAuto WebBandit
WebCollage
WebEnhancer
WebFetch WebFetch
WebGo IS WebPix
WebImageCollector
WebReaper WebReaper
WebStripper WebSucker
WebWhacker
WebZIP
Webshag Webshag
WebsiteExtractor Website Quester
WebsiteQuester WebsiteQuester
Whatweb Webster
WinHTTrack Whack
Wonderbot WiseGuys Robot
Woobot Woobot
Zauba Wotbox
Zeus Wprecon
Xaldon WebSpider
Zermelo
Zitebot Zitebot
ZoomBot ZoomBot
ZoominfoBot
ZumBot ZumBot
adscanner
archive.org_bot
arquivo-web-crawler arquivo-web-crawler
arquivo.pt arquivo.pt
crawl.sogou.com autoemailspider
check1.exe
cognitiveseo
demandbase-bot demandbase-bot
facebookscraper
gopher
heritrix heritrix
isitwp.com internetVista monitor
lwp-request iubenda-radar
meanpathbot
mediawords mediawords
page scorer muhstik-scan
plumanalytics ripz
probe-image-size seostar
s1z.ru sexsearcher
scalaj-http
scan.lol
seoscanners
serpstatbot
sitechecker.pro sitechecker.pro
siteripz
spyfu
tAkeOut tAkeOut
trendiction.com
trendiction.de
ubermetrics-technologies.com
webgains-bot
webmeup-crawler webmeup-crawler
webpros.com webpros.com
webprosbot
x09Mozilla x09Mozilla
x22Mozilla zauba.io

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
analytics-ads.xyz cacheimages.com
bumskontakte.org cartierring.xyz
elektrozigaretten1.tumblr.com jav-fetish.site
imgarcade.com palvira.com.ua
investmac.com scanner-john.top
kerch.site sexuria.net
roofers.org.uk sibtest.ru
studentguide.ru tattomedia.com
tomatis.gospartner.com titan-cloud.life
tupper-shop.ru ua-company.ru

930
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
1001watch.com.ua 100searchengines.com
101raccoon.ru 123locker.com
12bet.com 13tabs.com
4webmasters.com 1688.com
5elementov.ru 1j7740kd.website
7makemoneyonline.com 1qingdao.com
8kisses.eu 23kw.ru
abbanreddy.com 4kepics.com
acads.net 51.la
actionnooz.com 5forex.ru
adanih.com 7minuteworkout.com
adhome.biz 98oi.ru
adimmix.com aa14ab57a3339c4064bd9ae6fad7495b5f.com
advertisingtag.net aab94f698f36684c5a852a2ef272e031bb.com
affiliate-fr.com absolute-s.ru
academia-nsk.org
academiacsmendoza.org
addtoadd.men
adexprts.com
adtiger.tk
adultgalls.com
aerogo.com
afora.ru
ageofclones.com
ahrntal.verymes.xyz ahrntal.verymes.xyz
aimayangzhi.com air-edem.ru
albuteroli.com alert.scansafe.net
alfa-medosmotr.ru alfa-img.com
alfa9.com
allnews.md
allpdfmags.net allpdfmags.net
allstatesugarbowl.org amateurlivechat.org
alphahoverboards.com android-style.com
alveris.ru
alvtank.se
ameblo.jp
amt-k.ru
androids-store.com
anime.dougasouko.com
anonymousfox.co
apiadanaknet-a.akamaihd.net apiadanaknet-a.akamaihd.net
apiwebwebgetcom-a.akamaihd.net apiappenableinfo-a.akamaihd.net
approved.su appearance-cool.com
arabgirls.adultgalls.com arcadeplayhouse.com
arendatora.ru arkkivoltti.net
artpicso.com artdeko.info
as5000.com artefakct.com
atofilms.com asrv-a.akamaihd.net
autodo.info astrochicks.com
availit.weebly.com auspolice.com
avek.ru aussie-prizes.com
aviav.org auto-moto-elektronika.cz
avon-severozapad.ru avitocars.ru
avto-oligarh.ru avon-ukraine.com
azte.ch avtovolop.ru
badavit.com.ua awency.com
baikaleminer.com bannerads.de
bambi.ck.ua basedecor.ru
bannertesting.com
batanga.net
battleforupdating.site
bayareaaeroclub.org bayareaaeroclub.org
beachtoday.ru beclean-nn.ru
belsetirehafi.tk begalka.xyz
beremenyashka.com best-coupon-offer.com
best-businessman.ru bestchoice.cf
bestwaystogetpaid.us besthomemadepornsites.com
bet365.com besthoro.ru
bitcoinremote.com betterhdporn.com
biznesluxe.ru bingo8888.com
bmsco.co blackhatworth.com
bonky.biz bocoarchives.org
bookhome.info bodybuilding-shop.biz
bosman.pluto.ro
bpro1.top
brakehawk.com brakehawk.com
break-the-chains.com bristolhostel.com
brokergid.ru browsepulse-a.akamaihd.net
brus.city bugof.gq
buy-forum.ru buy-cheap-pills-order-online.com
buyk.host.sk buynorxx.com
buypanicdisorderpill.com
c1.onedmp.com c1.onedmp.com
californianews.cf cand.jp
callcafe.info canvas.gloverid.site
camdolls.com cartierlove2u.xyz
capsderfudd.tk cashkitten-a.akamaihd.net
carloans.com
casinopinup-wins.com casinopinup-wins.com
ccbill.com cbb1smartlist12.click
cementaresearch.se celebsopics.com
cerev.info cheapbarbour.online
cigarpass.com cheapestjerseys-wholesale.com
claytransformations.info cheapjerseysap.com
club-musics.ru cheapsergiorossi.online
cmd.kz checkpagerank.net
colehaanoutlet.store christianlouboutinoutlet.win
com-supportcenter.website cialischsrx.com
compliance-jack.top cialisovercounteratwalmartusa.com
connectingsingles.com cienum.fr
construmac.com.mx circlesl.com
cornomase.win clarithromycin500mg.com
counterbot.com clean-start.net
credit.co.ua clicksotrk.com
cubook.supernew.org clodo.ru
cxpromote.com coinsspb.com
d-black.bz coldfilm.ru
danceuniverse.ru compliance-barak.top
dandiyabeats.in compliance-checker-7.info
danschawbel.com compliance-josh.top
daooda.com comsysnet.com
db.speedup.gdn concealthyself.com
delitime.info concordexoticrentals.com
converse.ddsoldes.fr
coop-gamers.ru
copro.pw
crazyboost.pro
creditmoney.com.ua
cryptoswap.biz
culturevie.info
cupday.com
cwetochki.ru
dafatiri.com
daretodonate.co
dealighted.com
degerlund.net
delta-line.men delta-line.men
demon-tweeks.com demon-tweeks.com
deniven.1bb.ru deplim.com
deshevo-nedorogo.ru detoxmed24.ru
detective01.ru dichvuvesinhhanoi.com
devochki.top digital-video-processing.com
diegolopezcastan.com dignitasdata.se
diminishedvalueoforegon.com diminishedvalueoforegon.com
dimkino.ru directivepub.com
diusyawiga.tk divisioncore.com
doctissimo.fr
doeco.ru doeco.ru
dojki365.online dokumentalkino.net
domain2008.com domaincheck.io
domainsatcost.com download-walpaperhd.blogspot.com
doublepimp.com downloaddy.net
download-of-the-warez.blogspot.com drev.biz
downloads-whatsapp.com drugspowerstore.com
downtuptv.gq dscaas.website
doxysexy.com e-collantes.com
dumuelave.xyz eduinfosite.com
e2click.com ee77ee.com
easycommerce.cf elektrischezigarette1.blog.pl
ecommerce-seo.com elektrozigaretten1.tumblr.com
ednorxmed.com elmifarhangi.com
educatemetv.com enskedesquashclub.se
ege-essay.ru etm-consult.de
eldiariodeguadalajara.com evrotekhservis.ru
electrik-avenue.com ezigarettekaufen2.mpbloggar.se
electro-prom.com
elektrozigarette2.webs.com
elektrozigarettekaufen1.devhub.com
elvenmachine.com
empirepoker.com
englishgamer.com
enternet.ee
enthuse.computernetworksonline.com
eropho.com
eu-cookie-law.info
eugenevaultstorage.com
expdom.com
expolicenciaslatam.co
extremez.net
eyelike.com.ua
factorynightclub.com factorynightclub.com
farmingworm.com fapgon.com
fashion-stickers.ru fashion-stickers.ru
fastfixing.tech favoritemoney.ru
fefo.gdn
fermersovet.ru
ferretsoft.com
fifa-coins.online fifa-coins.online
fikasound.tk filesmonster.porn
filesdatabase.net filmania-x.ru
filmgo.ru financepoints.eu
findacheaplawyers.com finejewelryshop.ru
findanysex.com flauntyoursite.com
flirt4free.com flex4launch.ru
forum20.smailik.org foodcrafts.website
freelinkbuilding.website.tk formulaantiuban.com
forsex.info
forum69.info
free-deals.faith
free-share-buttons.blogspot.com
free-traffic.xyz
freenode.info freenode.info
frighteningremain.cf freetangodownload.com
ftns.ru fsakhalin.ru
fuck-paid-share-buttons.xyz game-top.su
fungirlsgames.net gamerextra.com
fym.com.ru gaming-journal.com
g33.org gamingspark.com
gael-s.ru gdcentre.ru
galleryawesome.com gdzkurokam.ru
gamevalue7.weebly.com gemgrab-a.akamaihd.net
gamezblox.com genetworx.com
gaz-voshod.ru getpopunder.com
gelezki.com gfaq.ru
girlspicsa.com glall.ru
gk170.ru globalsurfari.com
glavprofit.ru gojiberriess.apishops.ru
gorabagrata.ru goldenggames.com
gratuitbaise.com goroda-vsego-mira.ru
greenzaim.ru gosreg.amchs.ru
groupmoney.ru graphics8.info
gsasearchengineranker.top greatfind-a.akamaihd.net
habermetre.com hackers-crackers.tk
haikuware.com handsandlegs.ru
haveinc.xyz headpharmacy.com
hd-filmy.net hermesbelts.xyz
hexpilot.com hermesbirkinhandbagoutlets.com
hledejvshopech.cz heroz.fr
homeart.space hikesearch.net
homedo.fabpage.com himgaws.pw
honyaku.yahoofs.jp hitmuzik.ru
hotdl.in homelygarden.com
hotshoppymac.com hoporno.com
howlongdoestizanidinestayinyoursystem.blogspot.com hostnow.men
howtoclean.club hostsshop.ru
howtowhitenteethfast.xyz houdom.net
hspline.com howmuchdoestizanidinecost.blogspot.com
humanelydrew.com hybrid.ru
hundejo.com i4track.net
iamsport.org iboss.com
idealtits.net ico.re
igru-xbox.net imadedinner.net
imitex-plus.ru images-graphics-pics.com
insomniagamingfestival.com iminent.com
insta-add.pro imperia31.ru
instasexyblog.com inboundlinks.win
infokonkurs.ru
intellego.info intellego.info
internetartfair.com invivo.hu
iopeninghours.co.uk ispac.org
iqupdatetmz.win izoll.ru
isitwp.com jackpotchances.com
itsdp3.com
iwantedmoney.com
jamiembrown.com jamiembrown.com
jbl-charge.info jav-way.site
jerseychinabizwholesale.com javlibrary.cc
jerseywholesalebizchina.com
jewelryandfiligree.com
joingames.org joingames.org
kamagragelusa.net joy-penguin.com
kamen-e.ru jwss.cc
kanimage.com kalandranis.gr
ketrzyn.pl karadene.com
kevblog.top kaz.kz
keyhantercume.com kellyonline.xyz
kichenaid.ru ketoanhanoi.info
kidskunst.info keywordsdoctor.com
kino-key.info keywordsking.com
kinobest.pl kiinomaniak.pl
kinocccp.net kinobaks.com
kinozapas.com klikbonus.com
koopilka.com kmd-pto.ru
koronirealestate.gr knowsitall.info
kovesszucs.atw.hu knowyournextmove.com
labelwater.se kolotiloff.ru
lacave.ntic.fr koptims.tiu.ru
lapolis.it kosova.de
laxdrills.com kreativperlen.ch
lexaprogeneric.link krynica.info
likesuccess.com ktotut.net
lionking-1994.blogspot.com kunstaktien.info
littlesunraiser.com kvartiry-remont.ucoz.ru
live-sexcam.tk lacapilla.info
lordzfilmz.me laserpen.club
lostfilm-online.ru lawyers.cafe
luchshie-topcasino.ru legalrc.biz
m.b00kmarks.com lenvred.org
lider-zhaluzi.kiev.ua
lietaer.com
lonerangergames.com
longadventure.com
losangeles-ads.com
lsex.xyz
lunamedia.co
luxmagazine.cf
m1media.net m1media.net
m4ever.net mackeeper-center.club
machicon-ueno.info mactechinfo.info
magicplayer-s.acestream.net mafa-free.com
marcoislandvacations.net makenahartlin.com
mastershef.club manifestation.betteroffers.review
matb3aa.com markjaybeefractal.com
mathgym.com.au mature.free-websites.com
me-ke.com mazda-roadsters.com
mecash.ru mb140.ru
mediawhirl.net medi-fitt.hu
medkletki.ru
medkritika.ru medkritika.ru
meendo-free-traffic.ga meet-flirt-dating.com
mega-polis.biz.ua megavolt.net.ua
megaindex.ru mere.host.sk
mexicotravelnet.com michaelkorsoutletstore.net
mhtr.be mielec.pl
minecraft-rus.org migente.com
mixx.com militarysale.pro
mmoguider.ru miniads.ca
mobplayer.ru mirzonru.net
morocco-nomad-excursions.com misterjtbarbers.com
morpicert.pw mncrftpcs.com
mossmesi.com mnogolok.info
moxo.com mobstarr.com
mtmtv.info moesexy.com
multgo.ru monclerjacketsoutlet.win
musicvidz.ru moneytop.ru
mwtpludn.review mydearest.co
mycouponizemac.com myphotopipe.com
mydeathspace.com mypornfree.ru
myprintscreen.com na15.ru
mysexpics.ru neks.info
mywallpaper.top nerudlogistik.ru
myxdate.info netcheckcdn.xyz
naval.jislaaik.com next-dentists.tk
networkcheck.xyz nhl17coinsforps3.gratisblog.biz
ningessaybe.me nlfjjunb5.ru
no-fuel.org nordstar.pro
o-o-8-o-o.com noscrapleftbehind.co
odywpjtw.bloger.index.hr novatech.vn
omgtnc.com obiavo.su
onblastblog.online of-ireland.info
onclkads.com offer.camp
oneclickfiles.com offers.bycontext.com
onescreen.cc office-windows.ru
online-hd.pl offside2.5v.pl
online-templatestore.com olgacvetmet.com
olympescort.com
onlinadverts.com
online247.ml
onlinetvseries.me onlinetvseries.me
ontargetseo.us oralsexfilme.net
onthemarch.co orhonit.com
orel-reshka.net painting-planet.com
osoznanie-narkotikam.net papasdelivery.ru
outshop.ru paphoselectricianandplumber.com
paccohichetoti.ml paradontozanet.ru
paceform.com partner-cdn.men
paidonlinesites.com partner-high.men
paparazzistudios.com.au partner-print.men
par-fallen.ga parvezmia.xyz
paramountmarble.co.uk paydayloanslocal.com
parfusale.se pdn-4.com
park.above.com perfection-pleasure.ru
partner-host.men pestomou.info
partybunny.ru peugeot-club.org
patol01.pw phormchina.com
pb-dv.ru picanalyzer.data-ox.com
picquery.com
picsforkeywordsuggestion.com
pictures-and-images.com pictures-and-images.com
pinstake.com pillscheap24h.com
pl-top.pl pirateday.ru
pladform.ru pizda.lol
podshipniki-ntn.ru pobeiranie.pl
poffet.net poiskzakona.ru
popmarker.com popunder.ru
popugaychiki.com
porndairy.in
porno-video-chati.ru
pornogad.com pornogad.com
pornokorol.com pornohd1080.online
pornosemki.info pornotubs.com
pornotubexxx.name poshiv-chehol.ru
pornzone.tv preg.marketingvici.com
portadd.men
praisong.net
pravoholding.ru
pretty-mart.com
pricheski-video.com pricheski-video.com
privacyassistant.net
prodvigator.ua
promgirldresses.xyz
prostitutki-belgoroda.org prostitutki-belgoroda.org
prostitutki-odessa.org pukaporn.com
prostitutki-tolyatti.org purchasepillsnorx.com
pshare.biz purplestats.com
ptr.ruvds.com putevka24.ru
pts163.ru qwarckoine.com
purplesphere.in rada.ru
pushdata.sendpulse.com rankia.com
qitt.ru realnye-otzyvy.info
quality-traffic.com rebrand.ly
quangcaons.com
quick-offer.com
qwesa.ru
raisedseo.com
ranksonic.info
razleton.com
recipedays.ru recipedays.ru
registrationdomainsite.com reckonstat.info
relatodelpresente.com.ar refads.pro
remont-fridge-tv.ru refererx.com
remontbiz.ru relax.ru
resant.ru renecaovilla.online
restaurantlescampi.com rentalcarnavi.info
reyel1985.webnode.fr repeatlogo.co.uk
richinvestmonitor.com resultshub-a.akamaihd.net
roleforum.ru rethinkwasteni.info
rollercoin.com rique.host.sk
royalads.net rniaeba.ga
rubbed.us russkie-gorki.ru
ruspdd.com sabaapress.com
rutor.group sabizonline.com
rvi.biz sarf3omlat.com
rybalka-opt.ru satellite.maps.ilovevitaly.com
s8-nowy-wygraj.comli.com savetubevideo.com
sad-torg.com.ua sbwealthsolutions.ca
saletool.ru scanner-nelson.top
sarahmilne.top scanner-olga.top
sashagreyblog.ga seadragonherbery.com
saveindex.xyz seansonline24.pl
sawin.beth.webd.pl searchtooknow-a.akamaihd.net
sbdl.no seo-tools-optimizing.com
sbricur.com seoboxes.com
scanner-julianna.top seofirmreviewsus.info
scanner-margo.top seoholding.com
searchmywindow-a.akamaihd.net
securesmrt-dt.com
seeresultshub-a.akamaihd.net
semp.net
sendearnings.com
seojokes.net seojokes.net
sex-pr.net serialsway.ucoz.ru
sex-sex-sex5.com servethis.com
sex-watch.com sexy-screen-savers.com
sexsearch.com sexy.babes.frontend-stack.top
sextracker.de shemale-sex.net
shillyourcoins.com shopwme.ru
shop.acim.org silvercash.com
silktide.com
site-speed-check.site
sitechecker.pro
siteimprove.com
skanninge.se skanninge.se
sklad-24.ru skypasss.com
sladkoevideo.com small-game.com
slimcdn.com sms2x2.ru
small-games.biz snjatie-geroinovoy-lomki.ru
soblaznu.net socialbutton.xyz
social-button.xyz
social-s-iii.xyz
social-search.me
sockshare.net sockshare.net
sofit-dmd.ru sogimlecal.tk
soft-program.com solmarket.by
soft1.ru space2019.top
softomix.com spidtest.space
softtor.com splendorsearch-a.akamaihd.net
speechfoodie.com spy-app.info
spin2016.cf starwars.wikia.com
sport-video-obzor.ru stathat.com
stardevine.com stillmiracle.com
stats-collector.org stroiminsk.org
stats-public.grammarly.io stroy-portal22.ru
staynplay.net studworks.org
stmassage.ru superinterstitial.com
stockquotes.wooeb.com superkanpo.com
sugarkun.com superlist.biz
superiends.org surflinksmedical.com
swagbucks.com svbur.ru
swingerseiten.com taraz.xkaz.org
sygraem.com tecnoteakviareggio.it
tandvardshuset.net templates.franklinfire.co
taqywu51.soup.io the-usa-games.blogspot.com
testingads.pro thebestphotos.eu
thenetinfo.com thebluffs.com
thepokertimer.com thegamerznetwork.com
tizanidineforopiatewithdrawal.blogspot.com thegioixekhach.com
thepantonpractice.co.uk
theplacetoupdating.pw
timeallnews.ru
titan-ads.life
titan-cloud.life
tizanidinedosageforsleep.blogspot.com
tizanidinehcl2mg.blogspot.com tizanidinehcl2mg.blogspot.com
tizanidinehcl4mgtabinfo.blogspot.com tizanidinehclsideeffects.blogspot.com
tizanidinevssoma.blogspot.com tizanidinenarcotic.blogspot.com
topappspro.com tizanidinewithdrawalsymptoms.blogspot.com
torrents.cd tjkckpytpnje.com
top10registrycleaners.com
torrent-newgames.com
toxicwap.com toxicwap.com
tracfone.com
track-rankings.online
tracksurf.daooda.com
tradedeals.biz
trafficjunky.com trafficjunky.com
traffmonster.info trafficmonetize.org
truck-rece.life trafficnetzwerk.de
trudogolik.net trk-4.net
tv-spoty.info ttrraacckkrr.com
twodollarshows.com turizmus.us
txxx.com turn-up-life.life
tytoona.com tyumen.xrus.org
ucoz.ru uac.net.au
ufa.xrus.org underthesite.com
ultimatesetnewfreeallsoftupgradesystems.pw uprour.com
unacittaconte.org uptime-alpha.net
uni.me usbggettwku.ga
upstore.me vellings.info
usswrite.com versaut.xxx-cam.webcam
ustion.ru vesnatehno.com
valsalud.com videochat.world
veles.shop videosbox.ru
vertaform.com videositename.com
veselokloun.ru vikistars.com
villacoloniale.com vintontech.info
visionwell.com.cn voditeltrezviy.ru
vkontaktemusic.ru voloo.ru
vsdshnik.com voloomoney.com
vseigru.one voluumtrk.com
w-journal.ru vucms.com
wareseeker.com walkme.com
webinstantservice.com waterpurifier.club
webjam.com webads.co.nz
weburok.com webadvance.club
welck.octopis.com weprik.ru
westvilletowingservices.co.za whatsupinfoley.com
whiteelephantwellington.com
whiteproduct.com
wineitudes.wordpress.com wineitudes.wordpress.com
worldtraveler.world wingsofrefuge.net
www.get-free-traffic-now.com wma-x.com
www.kabbalah-red-bracelets.com woman-tampon.ru
x-lime.net x-mix.info
xcombear.ru xaijo.com
xev.ru xclicks.net
xgftnlrt.bloger.index.hr xgftnlrt.bloger.index.hr
xn-----7kcabaipgeakzcss7bjdqdwpfnhv.xn--p1ai xn------7cdbapdecfd4ak1bn0amjffj7afu3y.xn--p1ai
xn----7sbho2agebbhlivy.xn--p1ai xn----8sbdbjgb1ap7a9c4czbh.xn--p1acf
xn----8sbarihbihxpxqgaf0g1e.xn--80adxhks xn--80aikhbrhr.net
xn--80aagddcgkbcqbad7amllnejg6dya.xn--p1ai xn--d1acah0c.xn--p1ai
xn--80ab4aa2g.xn--p1ai xn--e1afanlbnfckd7c3d.xn--p1ai
xn--80aeahghtf8ac5i.xn--p1ai xxlargepop.com
xn--80aodinpgi.xn--p1ai xxx-treker.ru
xxxguitars.com xxxdatinglocal.us
xz618.com xxxrus.org
xzlive.com yadro.ru
youbrainboost.asia yogamatsexpert.com
yousense.info you-shall-not-pass.is74.ru
youtube-downloader.savetubevideo.com youjizz.com
youtuhe.com youporn-forum.ga
yubikk.info yourmovies.pl
zagadki.in.ua zambini.ru
zaidia.xhost.ro zapatosenventa.info
zaim-pod-zalog-krasnodar.ru zarabotat-na-sajte.ru
zajm-zalog-krasnodar.ru zero1.it
zaobao.com.sg
zawyna.ua
zebramart.ru
zeroredirect1.com
zeroredirect2.com zeroredirect2.com
zirondelli.it zigarettenonlinekaufen1.bloog.pl
zoogdisany.com zvezdagedon.ru
zynax.ua

480
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
18ps.ru 51unlim.ru
2nt.ru 888.com
404.mn adtiger.tk
aac500b7a15b2646968f6bd8c6305869d7.com advancedmassagebysara.com
abclauncher.com advocatemsk.ru
actionnooz.com allpdfmags.net
adelly.bg aloofly.com
agecheckadult.com am-se.com
air-edem.ru amoi.tn
airmaxshoes-2016.com apartmentbay.ru
alltheviews.com arenanews.com.ua
amazon-seo-service.com arendovalka.xyz
android-systems.ru arkkivoltti.net
apidiamondatanet-a.akamaihd.net aucoinhomes.com
asmxsatadriverin.aircus.com avtochehli.by
asseenontv.ru b-styles.xyz
avramstroy.ru balois.worldbreak.com
b2b-lounge.com bank.uz
battleforupdating.site bdsmgalls.net
berlininsl.com beachdriveblog.com
betshuckclean.com best-games.today
bjetjt.com best-way.men
blog.axant.it bestmouthwash.club
blogqpot.com bestwaystogetpaid.us
boazpower.com biketank.ga
bookhome.info binaryoptionscops.info
browserprotecter.com bjorkbacken.nu
bryansk.zrus.org bkns.vn
bugshoot.cn blogsfunky672.weebly.com
burger-imperia.com brains2.biz
buyessayonline19.blogspot.ru bristolhotel.com
buytizanidineonline.blogspot.com bumskontakte.org
bupropion-sr-150-mg.us
butstrap.space
buynorxx.com
bzero1jewelry.net bzero1jewelry.net
c-gainsbourg.com cand.jp
canrioloadm.gq capsderfudd.tk
cartierreplica.top centrdebut.ru
cb.iphantom.com centrumcoachingu.com
cheap-trusted-backlinks.com cezartabac.ro
citetick.com cherrypointplace.ca
citysecurity.nu cialisovercounteratwalmartusa.com
club-lukojl.ru clean-start.net
compliance-andrew.top cleansearch.net
comsysnet.com coindirect.io
conboy.us colobit.biz
coolwallpapers4k.info compliance-george.top
cowlmash.com credit.co.ua
d2jsp.org cwetochki.ru
daooda.com daretodonate.co
date-withme.com destinationrealestate.com
datract.com divatraffic.com
decoratinghomes.ga doktoronline.no
dekorkeramik.ru domini.cat
detki-opt.ru dostavka-v-ukrainu.ru
dieta-personalna.pl dotmass.top
dinosaurus.site dpihatinh.gov.vn
dtm-spain.com dustyorate.com
e-c.al dverimegapolis.ru
econom.co eandsgallery.com
elektrischezigarette1.blog.pl eduinfosite.com
elektrischezigaretten1.blogse.nl elektrischeziga.livejournal.com
elektrozigarette2.webs.com erotikstories.ru
elitedollars.com eu-cookie-law.info
eonpal.com exdocsfiles.com
essay-edu.biz eyes-on-you.ga
estibot.com ezigarettekaufen2.blox.pl
expdom.com fealq.com
ezigarettenkaufen1.deviantart.com fillmewithhappiness.com
ezigarettenshop2.myblog.de findclan.org
familyphysician.ru fitfloponline.store
fandlr.com fitness-video.net
ferretsoft.com flashbannernow.com
finejewelryshop.ru food.dtu.dk
firma-legion.ru footbalive.org
floridahuntingfishingadventures.com foto-basa.com
fok.nl fototravel.eu
frameimage.org free-deals.faith
franecki.net freegamesplay.online
free-share-buttons.blogspot.com freelotto.com
freesitetest.com freshwallpapers.info
gg-arena.ru gambarkatabaru.com
gifspics.com game-mmorpg.net
global-ics.co.za gamesprite.me
go2jump.org gavuer.ru
gotcher.us gdebestkupit.ru
gov.yanao.ru girlgamerdaily.com
gsasearchengineranker.space girls-ufa.ru
guiadeserraazul.com groupmoney.ru
handicapvansarea.com growboxbl.ru
hauleddes.com harmonyglen.us
headpress.ru hawaiisurf.com
heroz.fr highspeed5.net
himazin.info histock.info
hotshoppymac.com hkladys.com
hoverboard360.de holidaypics.org
hoverboard360.nl homelygarden.com
huimin764128.com hothor.se
hustoon.over-blog.com howlongdoestizanidinestayinyoursystem.blogspot.com
i-service.kz howmuchdoestizanidinecost.blogspot.com
ihtec2019.org hyipmanager.in
imagecoolpub.com iframe-toloka.com
impisr.edunsk.ru iloveitaly.ru
infospot.pt imagez.co
int.search.tb.ask.com impresagaia.it
interesnie-faktu.ru insider.pro
intim-uslugi.info instakink.com
iqoption-bin.com investsuccess.org
isistaylorporn.info iplogger.org
istizanidineanarcoticdrug.blogspot.com itag.pw
izhevsk.xrus.org izhevsk.zrus.org
jerseysbizwholesalecheap.com jerseyswholesalechinalimited.com
kalb.ru jobmarket.com.ua
kartiniresto.com jyvopys.com
kazan.zrus.org kanimage.com
keywordhut.com ketrzyn.pl
keywordspay.com keywordsuggest.org
khafre.us kiwe-analytics.com
kino2018.cc kosynka-games.ru
kiprinform.com kovesszucs.atw.hu
klejonka.info krasnodar.zrus.org
kw21.org kunstaktien.info
labelwater.se lacapilla.info
ladsblue.com layola.biz.tc
lakomka.com.ua lineshops.biz
lankarns.com lollypopgaming.com
larose.jb2c.me long-beach-air-conditioning.com
lechenie-gemorroya.com lovasszovetseg.hu
legionalpha.com lrac.info
lenpipet.ru mamasuper.prom.ua
lineavabit.it marcowebonyodziezowe.pl
linkbux.ru martlinker.com
lolnex.us meds-online24.com
mall.uk mmoguider.ru
marcoislandvacations.net mnogolok.info
mastershef.club moi-glazki.ru
medicinacom.ru moneyviking-a.akamaihd.net
mesto-x.com morlat.altervista.org
missvietnam.org musicas.baixar-musicas-gratis.com
mojowhois.com mydeathspace.com
moneymaster.ru myiptest.com
mriyadh.com myplaycity.com
my-cash-bot.co naj-filmy24.pl
mydirtystuff.com narkologiya-peterburg.ru
mydoctorok.ru
myhydros.org
naperehresti.info
naturtreenspicerx.pw naturtreenspicerx.pw
netallergy.ru newstudio.tv
networkcheck.xyz nextconseil.com
newhairstylesformen2014.com nhl09.ru
nibbler.silktide.com ningessaybe.me
norththeface.store
o.light.d0t.ru o.light.d0t.ru
oivcvx.website offer.wpsecurity.website
okmedia.sk okeinfo.online
onlinebay.ru onescreen.cc
onlinemeetingnow.com oren-cats.ru
oops-cinema.ru ownshop.cf
osoznanie-narkotikam.net paighambot.com
page2rss.com park.above.com
pagesense.com partner-cdn.men
panamaforbeginners.com partner-host.men
partnerworkroom.men partnerworkroom.men
pb-dv.ru pcimforum.com
picture-group.com perosan.com
plugingeorgia.com phelissota.xyz
polcin.de php-market.ru
popugauka.ru piratecams.com
popugaychiki.com pochemychka.net
pornohd1080.online pochtovyi-index.ru
portadd.men
poshiv-chehol.ru
predmety.in.ua
preparevideosafesystem4unow.site preparevideosafesystem4unow.site
printie.com pro-okis.ru
privacylocationforloc.com promalp-universal.ru
profit-opportunity.com prostitutki-astana.org
proftests.net prpops.com
proprostatit.com purchasepillsnorx.com
prostitutki-novgoroda.org quick-seeker.com
prostitutki-tolyatti.org r-e-f-e-r-e-r.com
rapidokbrain.com radiodigital.co
razamicroelectronics.com rednise.com
ringtonepartner.com registratciya-v-moskve.ru
rixpix.ru ruf777.com
rniaeba.ga rutor.group
romhacking.ru saltspray.ru
royalcar-ufa.ru samoiedo.it
rozalli.com scansafe.net
sankt-peterburg.nodup.ru schlampen-treffen.com
scanner-alexa.top scopich.com
scanner-jess.top screpy.com
scanner-margo.top scripted.com
seemoreresultshu-a.akamaihd.net seminarygeorgia59.ga
sexkrasivo.net seoboxes.com
ship-marvel.co.ua sexfreepornoxxx.com
shisha-swag.de shtaketniki.ru
signoredom.com sicfor.bcu.cc
siha.de sirpornogratis.xxx
simple-share-buttons.com sitopreferito.it
skuteczna-dieta.co.pl sladkoevideo.com
snegozaderzhatel.ru socialbutton.xyz
spy-app.info sockshare.net
startwp.org sofit-dmd.ru
spb.ru
statistici.ro statistici.ro
stjamesschool.info stjamesschool.info
strigkaomsk.ru studiokamyk.com.pl
sugvant.ru sundrugstore.com
support.nopeas.sk swingerseiten.com
t3chtonic.com syvertsen-da.no
thebestphotos.eu tdsing.ru
thecoolimages.net the-trader.net
thenews-today.info thegioixekhach.com
thetoiletpaper.com thepantonpractice.co.uk
thiegs.reco.ws timdreby.com
titan-ads.life timer4web.com
titan-cloud.life tizanidinedrugtest.blogspot.com
tizanidinehcl4mgisitanarcotic.blogspot.com tnctrx.com
tizanidinerestlesslegsyndrome.blogspot.com
tomatis.gospartner.com tomatis.gospartner.com
traffpartners.com torrent-newgames.com
trainoffend.ml torrnada.ru
tripper.de tracksz.co
truck-rece.life tytoona.com
tube8.com u17795.netangels.ru
turbo-suslik.org ublaze.ru
tyumen.xrus.org ukrobstep.com
u-cheats.ru universals.com.ua
ukrtextbook.com uptimechecker.com
unitygame3d.com urccvfmc.bloger.index.hr
v720hd.ru
varbergsvind.se varbergsvind.se
vashsvet.com via-energy-cumpara.com
viddyoze.com viberdownload10.com
visa-china.ru vkonche.com
voluumtrk.com voronezh.xrus.org
w3data.co weboptimizes.com
waycash.net wholesalejerseysgaa.com
web-betting.ru winx-play.ru
webcamdevochka.com www.timer4web.com
webjam.com xkaz.org
webkeyit.com xn------7cdbapdecfd4ak1bn0amjffj7afu3y.xn--p1ai
wordpress-crew.net xn----7sbaaabaei0cc8aj5bj0bncejx.xn--p1ai
xmnb.net xn----7sbifcamovvfggw9d.xn--p1ai
xn-----6kcaacnblni5c5bicdpcmficy.xn--p1ai xn--80aikhbrhr.net
xn--80abgj3a5acid6ghs.top xn--lifehacer-1rb.com
xxxsiterips.xyz xtremeeagles.net
yogamatsexpert.com youdesigner.kz
youresponsive.com zapatosenventa.info
youtubologia.it zhongwenlink.com
zojirushi-products.ru zojirushi-products.ru
zoogdisany.com zooggames.com
zoolubimets.ru
zoosexart.com
zryydi.com

10
dev-tools/test_units/ratelimittest-master.txt
View file

@ -581,14 +581,4 @@
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html> </html>

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.110 0; 10.1.0.56 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.09.3381 ### Version: V4.2022.09.3382
### Updated: Fri Sep 30 10:04:31 UTC 2022 ### Updated: Fri Sep 30 22:01:12 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.09.3381 ### Version: V4.2022.09.3382
### Updated: Fri Sep 30 10:04:31 UTC 2022 ### Updated: Fri Sep 30 22:01:12 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##