vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-03 19:20:16 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2022.12.3524 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2022-12-21 22:07:35 +00:00
parent 794e251b48
commit 51e691009b
47 changed files with 93760 additions and 93767 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.12.3523 #### Version: V4.2022.12.3524
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.12.3523 #### Version: V4.2022.12.3524
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -14,7 +14,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2022.12.3523 #### Version: V4.2022.12.3524
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

11580
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2022.12.3523 #### Version: V4.2022.12.3524
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

11584
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

11584
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

11584
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

11584
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.88 1; 10.1.0.24 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.88 0; 10.1.0.24 0;
127.0.0.1 0; 127.0.0.1 0;

11584
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.88 1; 10.1.0.24 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.88 0; 10.1.0.24 0;
127.0.0.1 0; 127.0.0.1 0;

11584
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.88 1; 10.1.0.24 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.88 0; 10.1.0.24 0;
127.0.0.1 0; 127.0.0.1 0;

11584
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
3523 3524

11584
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

11584
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.119.180.194 0; 13.86.156.32 0;

11584
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.88 1; 10.1.0.24 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.88 0; 10.1.0.24 0;
127.0.0.1 0; 127.0.0.1 0;

11584
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.88 1; 10.1.0.24 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.88 0; 10.1.0.24 0;
127.0.0.1 0; 127.0.0.1 0;

11584
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.88 1; 10.1.0.24 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.88 0; 10.1.0.24 0;
127.0.0.1 0; 127.0.0.1 0;

11584
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.119.180.194 0; 13.86.156.32 0;

11584
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.119.180.194 0; 13.86.156.32 0;

11584
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.88 1; 10.1.0.24 1;
127.0.0.1 1; 127.0.0.1 1;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
BDFetch BatchFTP
BuiltBotTough Flunky
EasyDL InternetSeer
InterGET Masscan
PleaseCrawl PictureFinder
PxBroker ScoutJet
ZoomBot Semrush
crawler.feedback Xaldon WebSpider
seobility gopher
xpymep1.exe sexsearcher

300
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
AhrefsBot ADmantX
AIBOT
ASPSeek
Aboundexbot
AiHitBot AiHitBot
Alexibot
AllSubmitter
Alligator Alligator
Anarchy99 Anarchy
Aspiegel Aspiegel
Asterias Asterias
AwarioRssBot Atomseobot
BBBike
BDCbot
BLEXBot BLEXBot
Backlink-Ceck
BacklinkCrawler BacklinkCrawler
Bandit Badass
BatchFTP BatchFTP
BetaBot BlackWidow
Bigfoot Blackboard
Bitacle
Blow Blow
Boardreader
Bolt
BotALot BotALot
Buck Brandprotect
Buddy Brandwatch
BuzzSumo Bullseye
BunnySlippers
CODE87 CODE87
CSHttp
CazoodleBot CazoodleBot
CensysInspect
CheTeam
ChinaClaw
Chlooe Chlooe
Citoid
Cocolyzebot Cocolyzebot
CopyRightCheck
Copyscape
Cosmos Cosmos
Craftbot Crawling at Home Project
Crescent Curious
Custo
CyotekWebCopy CyotekWebCopy
DBLBot DBLBot
DIIbot DSearch
Demon DTS Agent
Deusu DatabaseDriverMysqli
DigitalPebble Discoverybot
DittoSpyder DnBCrawler-Analytics
DnyzBot
DomainCrawler DomainCrawler
Domains Project DomainStatsBot
Dotbot
Dragonfly
Drip
ECCP/1.0 ECCP/1.0
EMail Siphon
EMail Wolf
EasyDL EasyDL
Ecxi
EirGrabber EirGrabber
Evil
Exabot Exabot
Express WebPictures Express WebPictures
Extractor
ExtractorPro ExtractorPro
Extreme Picture Finder Extreme Picture Finder
Ezooms EyeNetIE
FDM Firefox/7.0
FHscan Flunky
FemtosearchBot FyberSpider
Fimap
Freeuploader
G-i-g-a-b-o-t
GT::WWW GT::WWW
GalaxyBot
Genieo Genieo
GermCrawler GermCrawler
GetRight Go!Zilla
GetWeb GoZilla
Go-Ahead-Got-It
Gotit
GrabNet GrabNet
Grabber Grabber
Grafula HEADMasterSEO
HMView HTTrack
HTMLparser
Heritrix Heritrix
Hloader Hloader
HonoluluBot HonoluluBot
Humanlinks
IDBot IDBot
IRLbot
Id-search Id-search
Image Sucker
Indy Library
Internet Ninja Internet Ninja
InternetSeer Iria
IstellaBot JamesBOT
JOC Web Spider JennyBot
Joomla Jetty
Jorgee
Jyxobot Jyxobot
Kenjin Spider
Keybot Translation-Search-Machine
Keyword Density Keyword Density
Kinza Kinza
Kozmosbot
LNSpiderguy
Larbin
Leap Leap
LibWeb LeechFTP
Likse Lftp
LinksManager Libwhisker
LieBaoFast
Lightspeedsystems
LinkScan
Linkbot
LinkextractorPro
LinqiaMetadataDownloaderBot LinqiaMetadataDownloaderBot
LinqiaRSSBot Lmspider
Lipperhey Ltx71
MFC_Tear_Sample
MIDown tool
MSFrontPage MSFrontPage
Mail.RU_Bot MSIECrawler
MarkWatch Mag-Net
Masscan Majestic12
MeanPath Bot MauiBot
Mediatoolkitbot Meanpathbot
Mister PiX
Moblie Safari
Mojeek
Morfeus Fucking Scanner
Msrabot
NICErsPRO NICErsPRO
NPbot NPbot
Nameprotect Nameprotect
Navroad
NearSite NearSite
Nessus Needle
NetAnts NetAnts
NetZIP Netvibes
Netcraft NextGenSearchBot
Nibbler Niki-bot
Nikto Nuclei
Nimbostratus
Ninja
Nmap
Not
Nutch Nutch
Offline Explorer Octopus
OnCrawl OpenLinkProfiler
Openfind Openvas
OrangeSpider
OutclicksBot OutclicksBot
Page Analyzer OutfoxBot
PECL::HTTP
POE-Component-Client-HTTP
PageAnalyzer PageAnalyzer
PageGrabber
PageScorer PageScorer
Pandalytics Pandalytics
Petalbot Petalbot
Pi-Monster
Picsearch
Pimonster Pimonster
Pixray Pixray
Pockey Psbot
ProWebWalker
Pu_iN Pu_iN
Pump Pump
PxBroker
PyCurl PyCurl
QueryN Metasearch
Quick-Crawler
RankActive RankActive
RankActiveLinkBot RankActiveLinkBot
RankingBot
RankurBot RankurBot
Recorder ReGet
RealDownload
RebelMouse
RedesScrapy RedesScrapy
Ripper
SBIder SBIder
SEOkicks SEOkicks
SEOlyticsCrawler
SMTBot SMTBot
ScoutJet Scanbot
SearchmetricsBot Scrapy
Seekport Screaming
SemanticJuice ScrepyBot
Semrush Semrush
SeobilityBot SeoSiteCheckup
Site Sucker Seomoz
SiteCheckerBotCrawler
Sitebeam Sitebeam
SmartDownload Siteimprove
Snapbot Sitevigil
SocialRankIOBot SlySearch
Sogou web spider
Sottopop Sottopop
SpaceBison Spammen
SpankBot
Spbot
Spinn3r Spinn3r
Steeler SputnikBot
Sqlmap
Sqworm
Stripper
Sucker Sucker
Sucuri
SuperHTTP SuperHTTP
SurveyBot
Szukacz Szukacz
T0PHackTeam
T8Abot
Teleport Teleport
TeleportPro Telesoft
Telesphoreo
The Intraformant The Intraformant
TheNomad TheNomad
Thumbor Titan
Toata Toata
Tracemyfile Tracemyfile
True_Robot Trendictionbot
Turingos
TurnitinBot TurnitinBot
TwengaBot URLy Warning
Twice URLy.Warning
Typhoeus
UnisterBot UnisterBot
VCI Upflow
V-BOT
VB Project
Vagabondo Vagabondo
VelenPublicWebCrawler
VeriCiteCrawler
VidibleScraper VidibleScraper
Virusdie Virusdie
VoidEYE
Voltron Voltron
WEBDAV WASALive-Bot
WWW-Mechanize Web Auto
WWWOFFLE Web Pix
WeSEE WebCopier
Web Collage WebStripper
Web Fetch WebSucker
Web Sauger WebWhacker
WebAuto
WebFuck
WebImageCollector
WebPix
Webalta Webalta
WebmasterWorldForumBot
Webshag
Website Quester
WebsiteExtractor WebsiteExtractor
WebsiteQuester WebsiteQuester
Webster
Whack Whack
Whacker
Widow Widow
WiseGuys Robot Wonderbot
Xaldon WebSpider Xaldon WebSpider
Xaldon_WebSpider Zermelo
Zauba
Zeus
Zitebot Zitebot
ZoomBot ZmEu
adscanner ZumBot
autoemailspider backlink-check
crawler4j check1.exe
clark-crawler
coccocbot
cognitiveseo
crawler.feedback
dataforseo.com dataforseo.com
demandbase-bot demandbase-bot
domainsproject.org eCatch
evc-batch instabid
gopher
ips-agent ips-agent
linkdexbot linkdexbot
lwp-request lwp-request
lwp-trivial magpie-crawler
meanpathbot mediawords
muhstik-scan
netEstate NE Crawler
pcBrowser pcBrowser
plumanalytics ripz
polaris version s1z.ru
seobility scalaj-http
seocompany.store seocompany.store
seoscanners seoscanners
sogouspider serpstatbot
spyfu sexsearcher
sysscan
ubermetrics-technologies.com ubermetrics-technologies.com
voyagerx.com webpros.com
x09Mozilla webprosbot
x22Mozilla x22Mozilla
xpymep1.exe
zauba.io
zgrab zgrab

308
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
01h4x.com 01h4x.com
360Spider
404checker 404checker
80legs 80legs
ADmantX ASPSeek
AIBOT Abonti
AhrefsBot Aboundex
AiHitBot AfD-Verbotsverfahren
Alexibot Alligator
AllSubmitter AlphaBot
Anarchy Anarchy
Anthill Ankit
Aspiegel Aspiegel
BDCbot Asterias
BDFetch BDFetch
BackDoorBot BLEXBot
BackStreet BackStreet
BackWeb
Barkrowler Barkrowler
Battleztar Bazinga Battleztar Bazinga
Blackboard Blackboard
Blow Blow
Brandprotect BlowFish
Buddy Brandwatch
Bullseye BuiltWith
BuzzSumo CODE87
CSHttp CSHttp
Calculon
CazoodleBot
Cegbfeieh
CensysInspect CensysInspect
CheeseBot CheTeam
CherryPicker CherryPicker
ChinaClaw
Chlooe Chlooe
Claritybot Claritybot
Collector Cogentbot
Copier CopyRightCheck
Cosmos CrazyWebCrawler
Crescent Crescent
CrunchBot
Custo Custo
DIIbot DIIbot
Devil Demon
Digincore Deusu
DittoSpyder DigitalPebble
DnyzBot Dirbuster
Discobot
DnBCrawler-Analytics
DomainSigmaCrawler
Domains Project
Download Wonder Download Wonder
Drip Drip
ECCP/1.0 EMail Siphon
EMail Wolf EMail Wolf
Ecxi Ecxi
ExtLinksBot EroCrawler
ExtractorPro Evil
Extreme Picture Finder Extractor
EyeNetIE EyeNetIE
FDM Ezooms
Fimap FemtosearchBot
FrontPage Firefox/7.0
FyberSpider Freeuploader
Genieo Fyrebot
Gigabot GT::WWW
Go!Zilla GermCrawler
Go-Ahead-Got-It GetRight
GoZilla Getintent
Gotit GrabNet
Grabber
GrapeFX GrapeFX
GridBot GrapeshotCrawler
HMView
HTMLparser
HTTP::Lite HTTP::Lite
Heritrix HTTrack
Harvest
HonoluluBot
Humanlinks
HybridBot
IRLbot IRLbot
Iblog Image Fetch
Id-search Image Sucker
IndeedBot
InfoNaviRobot InfoNaviRobot
Intelliseek InterGET
Iria Internet Ninja
Iskanie
JOC Web Spider
JamesBOT JamesBOT
JetCar Jbrofuzz
JennyBot
Jetty Jetty
Jorgee JustView
Keyword Density Jyxobot
Kozmosbot Kinza
LeechFTP LNSpiderguy
LeechGet LexiBot
LibWeb LibWeb
Libwhisker Libwhisker
Lightspeedsystems LinkpadBot
LinkWalker
LinqiaMetadataDownloaderBot LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Lipperhey Lipperhey
Litemage_walker Ltx71
MFC_Tear_Sample
MIDown tool
MIIxpc MIIxpc
MQQBrowser
MSFrontPage MSFrontPage
MSIECrawler
MTRobot
Mag-Net Mag-Net
Majestic-SEO
Majestic12 Majestic12
MarkMonitor MarkWatch
Masscan Mass Downloader
Mata Hari
MeanPath Bot MeanPath Bot
Meanpathbot
MegaIndex.ru MegaIndex.ru
Metauri Microsoft Data Access
Mister PiX Minefield
Moblie Safari Moblie Safari
Mojeek Mojolicious
MolokaiBot Mr.4x3
Morfeus Fucking Scanner Msrabot
Mozlila
Musobot
NICErsPRO NICErsPRO
Name Intelligence Name Intelligence
Nameprotect Navroad
NearSite
Needle Needle
NetAnts NetAnts
NetLyzer NetLyzer
NetMechanic NetMechanic
NetSpider NetSpider
Netcraft NetZIP
Nettrack
Nibbler Nibbler
NimbleCrawler Nikto
Nimbostratus
Nmap Nmap
Offline Explorer Not
OnCrawl Nuclei
OpenVAS Octopus
OrangeSpider OrangeBot
OutclicksBot OutfoxBot
POE-Component-Client-HTTP PageAnalyzer
Page Analyzer
PageGrabber PageGrabber
PageScorer
Panscient Panscient
Papa Foto Papa Foto
Pavuk
PeoplePal PeoplePal
Picscout Petalbot
PleaseCrawl Picsearch
Pockey Pixray
ProPowerBot ProPowerBot
Pu_iN Probethenet
PyCurl Psbot
Quick-Crawler Pump
RSSingBot PxBroker
RankingBot2 RankActiveLinkBot
RebelMouse RankFlex
Rankivabot
ReGet
RedesScrapy
Ripper
Rogerbot Rogerbot
SBIder
SEOkicks-Robot
SEOlyticsCrawler
SEOprofiler SEOprofiler
SEOstats SEOstats
Scanbot SISTRIX
SMTBot
ScanAlert
ScoutJet
Scrapy
Screaming Screaming
ScreenerBot ScreenerBot
SearchmetricsBot SearchmetricsBot
Seekport
SemanticJuice
SentiBot SentiBot
Shodan
SiteCheckerBotCrawler SiteCheckerBotCrawler
Sitebeam SiteLockSpider
SiteSnagger
SiteSucker
Sitevigil
SlySearch SlySearch
Sosospider Snake
SocialRankIOBot
Spammen Spammen
Spanner
Spbot Spbot
Sqlworm Spinn3r
Sqworm Sqworm
Stripper
Sucker Sucker
Sucuri SuperBot
SurveyBot
Suzuran Suzuran
Swiftbot
Szukacz
T0PHackTeam T0PHackTeam
TeleportPro Teleport
Telesphoreo The Intraformant
Toata TheNomad
Turingos TightTwatBot
Titan
Tracemyfile
Turnitin Turnitin
URLy.Warning TwengaBot
Upflow V-BOT
Vacuum
VidibleScraper
Virusdie Virusdie
VoidEYE
Voil Voil
Voltron WASALive-Bot
WEBDAV WBSearchBot
WISENutbot
WPScan WPScan
WWW-Mechanize WWW-Collector-E
WWWOFFLE Web Enhancer
Wallpapers Web Fuck
WallpapersHD
Web Pix Web Pix
Web Sucker WebEnhancer
WebFuck WebFuck
WebImageCollector
WebPix WebPix
WebReaper
WebSauger
WebStripper WebStripper
WebSucker
WebWhacker WebWhacker
WebZIP
Webalta Webalta
WebmasterWorldForumBot
Webshag Webshag
WebsiteExtractor Webster
WebsiteQuester
Whack Whack
Whacker Whacker
Whatweb Widow
Wonderbot
Woobot Woobot
Wotbox Zade
Wprecon
Xaldon_WebSpider
Zauba
Zitebot Zitebot
ZoomBot ZoomBot
ZoominfoBot
ZyBorg ZyBorg
adscanner adscanner
archive.org_bot arquivo-web-crawler
arquivo.pt arquivo.pt
autoemailspider
backlink-check backlink-check
cah.io.community cah.io.community
check1.exe coccocbot
crawl.sogou.com
crawler.feedback
demandbase-bot demandbase-bot
evc-batch isitwp.com
facebookscraper lwp-request
gopher lwp-trivial
heritrix
iubenda-radar
linkdexbot
magpie-crawler
meanpathbot meanpathbot
pcBrowser probe-image-size
polaris version ripz
s1z.ru
satoristudio.net satoristudio.net
seostar seobility
seoscanners
serpstatbot
sexsearcher sexsearcher
siteripz sitechecker.pro
spyfu sp_auditbot
trendiction.de sysscan
webpros.com webgains-bot
webprosbot webmeup-crawler
x09Mozilla
zauba.io zauba.io
zgrab

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
bitcoins-live.ru brewdom.ru
cleanpcnow.com fz139.ttk.ru
hacktougroup.ru phpdevops.com
infodocsportal.com sa-rewards.co.za
pornhive.org sexy.babes.frontend-stack.top
qor360.com social-search.me
rangjued.com top10registrycleaners.com
seogadget.ru topsiteminecraft.com
snts.shell-pmr.ru virtuagirl.com
whatistizanidinehclusedfor.blogspot.com webextract.profound.net

932
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
01apple.com
03e.info 03e.info
0c47f8422d3f.com
0n-line.tv 0n-line.tv
1qingdao.com 1-free-share-buttons.com
2345.com 123any.com
300richmond.co.nz 1688.com
4inn.ru 178evakuator178.ru
4ureyesonly.com 3w24.com
4webmasters.org 4ur.click
5-steps-to-start-business.com 55wmz.ru
70casino.online 5elementov.ru
6128786.com
7makemoneyonline.com
8lufu.com
8xv8.com
a.frcls.fr
a1security.com.ua a1security.com.ua
aa14ab57a3339c4064bd9ae6fad7495b5f.com above.com
aa9d046aab36af4ff182f097f840430d51.com
aaa38852e886ac4af1a3cff9b47cab6272.com
abiente.ru
abwa.tk
accessoires-mode.in
actices.com actices.com
actulite.com
add-add.men add-add.men
addblueoff.com.ua admatic.com.tr
addray.pro adobereader-free.ru
admanaerofoil.com adprotect.net
adpremium.org adtiger.tk
adtech.de advancedcleaner.com
adultgalls.com
advokateg.ru advokateg.ru
ahmedabadwebs.com aimayangzhi.com
aktivator-windows10.blogspot.com airlandsea.info
alf-img.com allfinweb.com
alibestsale.com alphavisions.net
allblogroll.com am15.net
alphahoverboards.com animalia-life.club
am-se.com ap.senai.br
amateurgalls.com apessay.com
anonymizeme.pro apibrowsesmartne-a.akamaihd.net
apimossnetinfo-a.akamaihd.net apiitsthirteende-a.akamaihd.net
apioutoboxnet-a.akamaihd.net apxeo.info
app-ready.xyz arcteryxstore.online
apparel-offer.com arius.tech
applicationg29.com aruplighting.com
aquarium-pro.ru asiavirtualsolutions.com
architecturebest.com asiengirls.net
arendas.net auto.rusvile.lt
artefakct.com autoua.top
asia-forum.ru aviav.eu
asrvvv-a.akamaihd.net avtochehli.by
asscenihotosidea.blogspot.com back.dog
atlant-auto.info backlinkwatch.com
aviav.org bang-hotties.com
axbocz.net banki76.ru
babosas.com battleforupdating.site
babyguns.ru bbsoldes.fr
baersaratov.ru
balook.com
bank.uz
bankcrediti.ru
bannerswap.com
bashtime.ru
basisches-wasser.net
battle.net
bdsmgalls.net bdsmgalls.net
beauby.ru beauty-bracelet.com
best-way.men beetpics.pw
bestbuy.ca
bestdraws.com
besthoro.ru besthoro.ru
bestpornuha.com bestprofits-there.com
bestserials.com bestwaystogetpaid.us
bestssaker.com bibys.com
betune.onlinewebshop.net
bildsuche.ru bildsuche.ru
binaryoptionscops.info bio-japan.net
bitnote.co bitcoins-live.ru
blog-hits.com bizfly.info
blog.axant.it biznesluxe.ru
bocoarchives.org blogqpot.com
bongiornos.info blogs.rediff.com
bonkers.name bonanza-fortune.men
bookmaker-bet.com boobsimge.com
bookmark4you.com brewdom.ru
bpro1.top buketeg.xyz
brianhenry.co
brk-rti.ru
bryansk.zrus.org
bscodecs.com
bumble.cheapwebsitehoster.com bumble.cheapwebsitehoster.com
buydissertation.net buqyxa.rincian.info
buyfriend.ru business-made-fun.com
buypuppies.ca buy-meds24.com
cacheimages.com buyantiviralwp.com
callmd5map.com buyessay3.blogspot.ru
camdenmemorials.com buyviagraa.blogspot.com
canacopegdl.com calcularpagerank.com
cars-modification.net callejondelpozo.es
cezartabac.ro callstevens.com
chatroulette.si camsex.xxx-cam.webcam
cinemaenergy-hd.ru candcstuccoandstone.com
citysecurity.nu candlewooddentalcentre.com.au
clarithromycin500mg.com canzoni.ru
cleanallspyware.com cardiosport.com.ua
cleanallvirus.com cardsdumps.com
clipartnew.com cartierreplica.top
coccoc.com cascadelink.org
colehaanoutlet.store caveavins.fr
compliance-alexa.top cellfun.mobi
compliance-barak.top cheapcigarettesc.info
compliance-josh.top checkpagerank.net
compliance-walt.top chelnytruck.ru
compliance-willy.top chocolateslim-original.com
computernetworksonline.com chorus.terakeet.com
contentsexpress.com cjmc.info
cookie-law-enforcement-ee.xyz clean-virus-mac.com
cleanpcnow.com
clickzzs.nl
clubfashionista.com
compliance-andrew.top
compliance-olga.top
confib.ifmo.ru
connectingsingles.com
coolingoods.com
coolwallpapers4k.info
cosmetic.donna7753191.ru cosmetic.donna7753191.ru
costablue.xyz covetnica.com
countbertwistdisp26.soup.io craftinsta.ru
cowblog.fr crd.clan.su
customboxes4less.com crest-poloski.ru
customerguru.in crynet.cc
cutalltheshit.com cubook.supernew.org
cvety24.by cxpromote.com
dalavia.ru czeshop.info
damedingel.ya.ru daooda.com
dating-time-now.com daretodonate.co
datsun-do.com data-ox.com
ddospanel.com db.speedup.gdn
delitime.info dealighted.com
dev78.dioniqlabb.se dear-diary.ru
defenderxtactical.com
depositfiles-porn.ga
descargar-musica-gratis.net
detki-opt.ru
dgfitness.co dgfitness.co
dieta-personalna.pl digitalassetmanagement.site
discovertreasure-a.akamaihd.net dinosaurus.site
divisioncore.com dogoimage.com
divku.ru dogsrun.net
djonwatch.ru domcran.net
downloads-whatsapp.com dpihatinh.gov.vn
drev.biz
droidlook.net droidlook.net
dyt.net dynainbox.com
eager-nash.188-93-233-196.plesk.page e2click.com
eaplay.ru ebooknovel.club
easycommerce.cf ee77ee.com
edge.sharethis.com ege-essay.ru
editmedios.com eleimgo.pw
eksprognoz.ru elektir.ru
elektronischezigarettekaufen1.myblog.de elektronischezigarette2.mex.tl
elidelcream.weebly.com
elmifarhangi.com
eluxer.net
emailaccountlogin.co
embedle.com
empis.magix.net empis.magix.net
ero-advertising.com energydiet24.ru
errorfixing.space errorfixing.space
ertelecom.ru etenininrade.ga
eupornstar.info euromasterclass.ru
exoclick.com extractorandburner.com
ezigarettekaufen.myblog.de ezigarettekaufen1.hpage.com
ezigarettenkaufen1.deviantart.com falopicm.pw
familyphysician.ru familyphysician.ru
farmprofi.net faracontrol.ir
fenoyl.batcave.net fearcrow.com
feorina.ru femdom.twiclub.in
fertilitetsradgivningen.se ferretsoft.com
fickblock18.com filmi-v.online
fickluder69.com findthe.pet
filkhbr.com finejewelryshop.ru
fillmewithhappiness.com firstsiteguide.com
finemanteam.com fishtauto.ru
fiuxy.com fitness-video.net
flagcounter.me flex4launch.ru
flowersbazar.com floating-share-buttons.com
footballfarrago.com forexgb.ru
forex-indextop20.ru forodvd.com
forsex.info forpostlock.ru
forumprofi.de foto-weinberger.at
foxtechfpv.com free-share-buttons.top
franecki.net free-social-buttons.xyz
freejabs.com frequiry.com
freeseedsonline.com freza-sverlo.ru
friendflnder.com friendflnder.com
fungirlsgames.net funnel.co.za
gabeshop.ru gallerily.com
gagrasector.ru gallery.rennlist.com
gamedayassist.com gamevalue7.weebly.com
gay-file.com geilehausfrauen.net
germes-trans.com genetworx.com
getaclueamerica.com get-seo-domain.com
getridofstretchmarks.org getmyads24.com
gg.zzyjxs.com girls-ufa.ru
gigapeta.com glall.ru
glavtral.ru glicol.kz
gobongo.info glopages.ru
gsasearchengineranker.top goatse.ru
gsbs.com.ua googlemare.com
gwebtools.com googleseo.com.tr
hazardky.net gpms.org.my
hdimagegallery.net greatzip.com
hebr.myddns-flir.com gsou.cf
herehloadibs.cf guiadeserraazul.com
heroz.fr guigyverpo.cf
hetmanship.xyz guildebzh.info
hobbyhuren24.net guod.me
hoholikik.club haikuware.com
hollywoodactress.info hasshe.com
homeandhealth.ru hdapp1008-a.akamaihd.net
homeart.space hdwalls.xyz
homemature.net heartofbeijing.blogspot.com
hoporno.com helpmymacfaster.trade
hotel-mkad.ru hidemyass.com
hoverboard360.es himgaws.pw
hoverboard360.se homedecoguide.info
howopen.ru homeinns.com
hptwaakw.blog.fc2.com homemade.gq
hreade.com hotkeys.com
huimin764128.com hulfingtonpost.com
ictizanidinehcl4mg.blogspot.com hunterboots.online
idealtits.net ido3.com
igithab.com
igrovyeavtomaty777.ru igrovyeavtomaty777.ru
ikritikimou.gr images-graphics-pics.com
ilbe.club imperiafilm.ru
imagine-ex.co infoupdate.org
imperia31.ru
inclk.com
incomekey.net
infostatsvc.com
insomniagamingfestival.com insomniagamingfestival.com
interesnie-faktu.ru investingclub.ru
internetproviderstucson.com investmac.com
inzn.ru io9.com
iqoption.com
iqs.biz.ua
iron-age.info iron-age.info
irunfar.com ispaniya-costa-blanca.ru
isitpaleo.info itag.pw
islandminingsupply.wordpress.com
itbc.kiev.ua
itrevolution.cf itrevolution.cf
ivoiretechnocom.ci ivanstroi.ru
ix20.ru izhevsk.zrus.org
japfm.com izoll.ru
jikoman.info j-times.ru
joyceblog.top janavibekken.no
justkillingti.me jerseyschinabizwholesale.us
jyvopys.com jetsli.de
kabbalah-red-bracelets.com jjbabskoe.ru
katushka.net jofucipiku.tk
ketrzyn.pl jovencitas.gratis
keywordsuggests.com jus0wil.pp.ua
keywordteam.net jwss.cc
kinky-fetishes.com kalandranis.gr
kinocccp.net kam-dom.ru
kinotorka.ru kamagragelusa.net
klitimg.pw karaganda.xkaz.org
klosetkitten.com keenoutlet.online
kol-energo.ru keywordspay.com
komputernaya-pomosh-moscow.ru konica.kz
krasula.pp.ua koopilka.com
kretpicf.pw kretpicf.pw
kutikomi.net ks1234.com
labafydjxa.su la-fa.ru
ladsup.com lacapilla.info
laserpen.club law-check-eight.xyz
lasvegaslockandsafe.com lexaprogeneric.link
lazy-z.com live-cam6.info
lechtaczka.net livefixer.com
legalrc.biz livejasmin.com
legionalpha.com liver-chintai.org
lego4x4.ru lmrauction.com
limads.men loginduepunti.it
linerdrilling.com louboutinreplica.pw
link.ac lovelycraftyhome.com
liveinternet.ru lsp-awak-perikanan.com
livingcanarias.com lubetube.com
llastbuy.ru m1media.net
lob.com.ru mabdoola.blogspot.com
locatellicorretor.com.br magda-gadalka.ru
lol-smurfs.com mainhp.net
lombia.co mainlinehobby.net
lost-alpha.ru mall.uk
lovasszovetseg.hu mansiondelrio.co
lsex.xyz mantramusic.ru
lutherstable.org
m.b00kmarks.com
m3gadownload.pl
macdamaged.space
makis.nu
manve.info manve.info
mararoom.ru marmotstore.online
marinetraffic.com master-muznachas.ru
masturbate.co.uk masturbate.co.uk
matb3aa.com mbiologi.ru
matpre.top mebelcomplekt.ru
mediafresh.online
medicovi.com medicovi.com
medictube.ru
medizinreisen.de medizinreisen.de
meds-online24.com medosmotr-ufa.ru
mega-bony-2017.pl megakino.net
microstatic.pl menhealed.net
miniads.ca metascephe.com
miniature.io michellblog.online
missvietnam.org mil-stak.com
mobilemedia.md minecraft-rus.org
mobplayer.ru mirtorrent.net
modenamebel.ru mjchamonix.org
mojowhois.com mmog-play.ru
mountainstream.ms mobioffertrck.com
mrvideospornogratis.xxx modnie-futbolki.net
mtmtv.info monclerjacketsoutlet.win
musicvidz.ru money-every-day.com
myanyone.net montredemarque.nl
mossmesi.com
mrbojikobi4.biz
mriyadh.com
mydownloadengine.com mydownloadengine.com
mydownlodablefiles.com nagdak.ru
myftpupload.com najaden.no
myiptest.com narkologiya-voronezh.ru
myliveblog.ru netanalytics.xyz
mypets.by newstudio.tv
mywallpaper.top nicefloor.co.uk
nacap.ru nonameread45.live
naphukete.ru o-o-6-o-o.ru
net-profits.xyz oecnhs.info
newtechspb.ru omoikiri-japan.ru
nextrent-crimea.ru onlythegames.com
nfljerseyscheapbiz.us ooomeru.ru
ningessaybe.me oops-cinema.ru
nodup.ru ops.picscout.com
northfacestore.online optom-deshevo.ru
nosecret.com.ua orgasmus-virtual.com
notaria-desalas.com orsonet.ru
notasprensa.info osagonline.ru
nowtorrents.com oxford-book.com.ua
nsatc.net partner-cdn.men
nyfinance.ml parvezmia.xyz
o333o.com perfection-pleasure.ru
odoratus.net petsblogroll.com
onlinadverts.com piccshare.com
onlinemegax.com pinsdaddy.com
optikremont.ru
oren-cats.ru
orenburg-gsm.ru
ourtherapy.ru
ovirus.ru
parajumpersoutlet.online
pattersonsweb.com
perederni.net
pflexads.com
picsearch.com
pirateday.ru pirateday.ru
pochtovyi-index.ru pisanieprac.info
podshipniki-nsk.ru pixelrz.com
podshipniki-ntn.ru pizda.lol
popander.mobi plugingeorgia.com
pornobrazzers.biz poffet.net
pourvous.info pooleroadmedicalcentre.co.uk
pp-budpostach.com.ua popunder.ru
presleycollectibles.com popup-hgd.xyz
privat-girl.net porn555.com
privatamateure.com pornoinn.com
professionalwritingservices15.blogspot.ru pornosemki.info
profit-opportunity.com pornosok.ru
proprostatit.com pozdrawleniya.com
prostitutki-kharkova.org pregnant.guru
qor360.com princevc.com
quality-traffic.com privatov-zapisi.ru
quelle.ru promgirldresses.xyz
ranksays.com promodj.com
rarbg.to pshare.biz
rczhan.com pushdata.sendpulse.com
rebelmouse.com ranksignals.com
regionshop.biz realmonte.net
registrydomainservices.com realnye-otzyvy.info
registrysweeper.com relax.ru
reklamuss.ru rennlist.com
ringtonepartner.com resellerclub.com
rockingclicks.com reversing.cc
rogervivierforsale.com risparmiocasa.bz.it
rospromtest.ru robotixix.com
royal-investments.net rp9.ru
ruclicks.com rucrypt.com
saddiechoua.com ruscopybook.com
sanatorrii.ru rusenvironmental.net
sbetodiodnye-lampy.ru sa-live.com
sbf441.com sabaapress.com
scenarii-1-sentyabrya.uroki.org.ua sack.net
schoolfiles.net sakhboard.ru
scoopquest.com sbornik-zakonov.ru
scrapinghub.com scenicmissouri.us
sdelai-prosto.ru se.bnt-team.com
seeingmeerkat.com seasaltwithfood.com
sendearnings.com securityallianceservices.com
sel-hoz.com
seo-prof1.xyz seo-prof1.xyz
servingnotice.com seocdvig.ru
seryeznie-znakomstva.ru sex.hotblog.top
sevenstars7.com sexuria.net
sex-pr.net sfd-chess.ru
sex-sex-sex5.com shama-rc.net
sexvideo-sex.com shemalegalls.blogporn.in
shillyourcoins.com shoppingmiracles.co.uk
shoppytoolmac.com sibtest.ru
silverage.ru simply.net
simpoed.ufop.br site-speed-checker.site
site-auditor.online sivs.ru
sitevaluation.org smichovbike.cz
sky-mine.ru snow.nvr163.com
skypasss.com snworks.com
slowmacfaster.trade sobecjvuwa.com.ru
smartadserver.com soc-econom-problems.ru
smokewithrabbits.com sofit-dmd.ru
social-buttons.com softomix.net
socialbookmarksubmission.org songoo.wz.cz
soft-program.com space4updating.win
softomix.com spitfiremusic.com
solmarket.by sr-rekneskap.no
special-porn.com
stal-rulon.ru
stariy-baku.com stariy-baku.com
steebook.com stjamesschool.info
stickers-market.ru strag-invest.ru
stockspmb.info strigkaomsk.ru
stopnarco.ru stroyhelp-dv.ru
store-rx.com superfish.com
sumo.com swinginwithme.ru
superstats.com sygraem.com
svbur.ru taxi-v-eisk.ru
takethatad.com td-l-market.ru
teenbbw.yopoint.in templates.franklinfire.co
tetracsaudi.com terraclicks.com
tgtclick.com
theallgirlarcade.com theallgirlarcade.com
thedownloadfromwarez.blogspot.com thebluenoodle.com
thepantonpractice.co.uk thelottosecrets.com
thin.me.pn timetorelax.biz
tizanidineandhydrocodone.blogspot.com titan-cloud.life
tizanidineusedfor.blogspot.com toloka.hurtom.com
tjkckpytpnje.com tomatis.gospartner.com
tobeyouday.win toolsky.com
token-lab.org
toon-families.com toon-families.com
topads.men torrent-newgames.com
topbestgames.com tourismvictoria.com
topclickguru.com toursmaps.com
topsiteminecraft.com trafficreceiver.club
torrentdownloadhub.com traffmonster.info
torrnada.ru trudogolik.net
totu.info turizmus.us
toys.erolove.in twelvevisionspartyofcolorado.com
tracksz.co twinderbella.com
trackzapper.com twittruth.com
tradgardspartner.se ublaze.ru
traffic100.com uchetunet.su
traffic2cash.org unacittaconte.org
trafficcentr.xyz unmaroll.ya.ru
trafficmonetize.org uptime-as.net
trailer.cinemaflix.website userequip.com
trkdf.com
trubywriting.com
tula.howotorg.ru
turn-up-life.life
ucsol.ru
ukrup.com
upstore.me
uzporno.mobi uzporno.mobi
v24s.net v720hd.ru
vedomstvo.net valsalud.com
veles.shop vandrie-ict.nl
varikoz24.com
vbikse.com
vektorpress.ru
velobikestock.com
venerologiya.com venerologiya.com
venta-prom.ru vereo.eu
viagra.pp.ua videokrik.net
videochat.life videos-for-your-business.com
videochat.ph videotuber.ru
viel.su vipps.com.my
vitoriacabos.com visionwell.com.cn
vladimir.zrus.org vita.com.hr
vodaodessa.com viveresaniesnelli.it
vtcdns.com vizag.kharkov.ua
wallpaperstock.net vksex.ru
watchdogs-2.ru vltai.com
wdfdocando.com vmnmvzsmn.over-blog.com
webix.me vriel.batcave.net
webmonetizer.net warning.or.kr
whatsappdownload10.com watchmyfb.pl
wholesalecheapjerseysfree.com watracker.net
windowssearch-exp.com web.cvut.cz
wma-x.com webads.co.nz
wpthemedetector.co.uk webkeyit.com
wrz0iuebwhp5fg.freeddns.com websiteaccountant.de
www.888.com websitevaluebot.com
www.pinnacle-bets.com webtherapy.ru
x-lime.net westen-v.life
xblog.in winx-play.ru
xmlinde.com womensplay.net
xn----7sbaphztdjeboffeiof6c.xn--p1ai wowcasinoonline.ooo
xn----btbdvdh4aafrfciljm6k.xn--p1ai woweb.com.ua
xn----ctbbcjd3dbsehgi.xn--p1ai writingservices17.blogspot.ru
xn--24-glceagatoq7c2a6ioc.xn--p1ai wstroika.ru
xn--90acenikpebbdd4f6d.xn--p1ai www.bookmaker-bets.com
xolodremont.ru www.solartek.ru
xrus.org wygraj-skiny.win
yaderenergy.ru x-diesel.biz
youbloodyripper.com x-musics.com
yourserverisdown.com xclicks.net
yousense.info xev.ru
youtubologia.it xn----7sbbahaq9bb5afgiqfliv4m.xn--p1ai
yunque.pluto.ro xn----8sblgmbj1a1bk8l.xn----161-4vemb6cjl7anbaea3afninj.xn--p1ai
zeroredirect2.com xn--80ahvj9e.xn--p1ai
zeroredirect7.com xsfetish.org
znakomstva-piter78.ru yogamatsexpert.com
zoompegs.com yopoint.in
zryydi.com yougetsignal.com
zscalerone.net youtuhe.com
yubikk.info
yun56.co
yuweng.info
zaimhelp.ru
zajm-pod-zalog-nedvizhimosti.ru
zakazvzloma.com
zambini.ru
zero1.it
zeroredirect9.com
zigarettenonlinekaufen1.bloog.pl
znakomstva-moskva77.ru
zocaparj.kz
zooggames.com
zoominfo.com
zvuker.net

486
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
0n-line.tv 0912701309f8ce.com
1001desert.com 100searchengines.com
1xbet4you.com 1millionusd.xyz
5elementov.ru 1qingdao.com
7fon.ru 2015god.org
7xc4n.com 21h2o.com
98oi.ru 72-news.com
adclickservice.com activepr.ru
adconscious.com actulite.com
adktrailmap.com adultnet.in
admanaerofoil.com agroeconom.kz
adssafeprotected.com albamargroup.com
affiliate-fr.com all4wap.ru
ahrefs.com allblogroll.com
alarmobninsk.ru alldubai.biz
allnews24.in anaksma.info
alphahoverboards.com anal-acrobats.com
android4fun.org animenime.ru
animaltoplist.com app5.letmacworkfaster.world
apartmentbay.ru aproposde.com
appfixing.space asrv-a.akamoihd.net
appleid-verification.com auto.rusvile.lt
applyneedy.xyz avek.ru
autoseo-traffic.com babyfactory.fr
awency.com balois.worldbreak.com
azbukafree.com bannerads.de
azinoofficial777.ru bashtime.ru
b00kmarks.com bestserials.com
backlinkwatch.com besttorrentknifta.weebly.com
balitouroffice.com big-boards.info
bannerswap.com bimatoprost-careprost.com
bausparen.bz.it bingo8888.com
bestdraws.com bitcoinremote.com
bigcareer.info bmw-ark.ru
bitcoin-ua.top bonzybuddy.com
blavia.00author.com bracketsmackdown.com
blobar.org break-the-chains.com
bongacams.com btvn.ru
bonky.biz bupropion-sr-150-mg.us
brains2.biz buqyxa.rincian.info
breastaugmentation.co.za byme.se
bus-offer.com calcularpagerank.com
buttons-for-website.com calstaterealty.us
buyessaynow.biz candlewooddentalcentre.com.au
buzzurl.jp cbox.ws
buzzzg.men censys.io
cardul.ru ceotrk.com
carsdined.org children-learningreading.info
chastnoeporno.com clickhype.com
checkpagerank.net clickzzs.nl
chinese-amezon.com compliance-willy.top
cl.s7.exct.net corta.co
clayvasedesigns.tk creditmoney.com.ua
clodo.ru dame-ns.kz
cocolyze.com date-withme.com
coderstate.com dichvuvesinhhanoi.com
compliance-barak.top djonwatch.ru
compliance-margo.top dlya-android.org
coolgamechannel.com dnsrsearch.com
coolingoods.com docs4all.com
cosmeticswomens-womensports.rhcloud.com doyouknowtheword-flummox.ml
crazyboost.pro dyt.net
crd.clan.su e-c.al
culturevie.info earl-brown.info
darkbooks.org edudocs.net
deda-moroza-zakaz.ru ekn-art.se
deluxedumps.com elektrozigarette2.webs.com
dengi-pod-zalog-nedvizhimosti.ru eloxal.ru
devochki.top enthuse.computernetworksonline.com
divatraffic.com
dogbreedspicture.net
domain-tracker.com
doreenblog.online
dostavka-v-krym.com
download-wallpaper.net
downtuptv.gq
drillsaw.ru
duawitchrarato.tk
dvr.biz.ua
ekto.ee
elektrozigaretten2.yn.lt
enge-fotzen.info
epngo.bz epngo.bz
erotische-geschichten-xxl.com eralph.tk
extlinks.com erotag.com
falcoware.com ertelecom.ru
finstroy.net essay-edu.biz
flauntyoursite.com estibot.com
freefoto.ca etm-consult.de
freevpn.space event-tracking.com
freewebs.com ewebarticle.info
freshwallpapers.info fealq.com
gamewrath.com feargames.ru
gazporno.com felizporno.com
genericviagrasildenafiled.net firstsiteguide.com
ggiaro.com fitfloponline.store
glicol.kz fortunejack.com
glogow.pl forum20.smailik.org
gotcher.us franecki.net
gq-catalog.gq fsakhalin.ru
guiadeserraazul.com fxgallery.com
hcate.com game-mmorpg.net
hchha.com gateway.zscalerone.net
heygidday.biz glavtral.ru
highstairs-a.akamaihd.net googlsucks.com
grizzlysgrill.com
hd-film.pl
hidemyass.com
highland-homes.com
hotblog.top
hotxnights.info hotxnights.info
hreade.com hundejo.com
ie.57883.net hyipmanager.in
inet-traffic.com ibmdatamanagement.co
istanbulit.com idc.com.ua
itrevolution.cf igtools.club
itronics.ca ilovevitaly.ru
ivearchenceinflu.cf ilte.info
izhevsk.xrus.org indianmedicaltourismshop.com
junglenet-a.akamaihd.net intermesh.net
kadashihotel.com itbc.kiev.ua
izoll.ru
je7.us
jjbabskoe.ru
kalandranis.gr kalandranis.gr
keywordglobal.co.za kalb.ru
keywordsuggests.com keywords-monitoring-your-success.com
koral.se khafre.us
kosynka-games.ru kiinomaniak.pl
krynica.info kino-filmi.com
kvartir-remont.biz kinocccp.net
li-er.ru kleine-titten.biz
linkpulse.com knogg.net
linkwithin.com kostenloser-sex.com
lmrauction.com krasnodar-avtolombards.ru
loginduepunti.it krasnodar.zrus.org
lost-alpha.ru kursy-ege.ru
mackeeper-land-672695126.us-east-1.elb.amazonaws.com lesbian.xyz
magazin-pics.ru lineavabit.it
magda-gadalka.ru lirunet.ru
mailemedicinals.com lisque.batcave.net
manve.info livefixer.com
m1media.net
m292.info
macnewtech.com
mail.allnews24.in
mainhp.net
mainlinehobby.net
maju.bluesalt.co
make-money-online.com
manualterap.roleforum.ru
marwer.info marwer.info
memberty.com max-p.men
mere.host.sk mearns-tractors.co.uk
michellblog.online mediaoffers.click
minecraft-rus.org mesbuta.info
mirzonru.net more-letom.ru
mixtapetorrent.com morf.snn.gr
moje-recenze.cz mp3ringtone.info
moneymaster.ru myfreemp3.eu
montredemarque.nl myyour.eu
msfsaar.de narkologiya-belgorod.ru
msk.afora.ru natali-forex.com
mturkcontent.com nerudlogistik.ru
musicktab.com newstraveller.ru
musicstock.me niroo.info
narkologiya-orel.ru nofreezingmac.work
nomuos.it nonews.co
norththeface.store nullrefer.com
novgorod.xrus.org old-rock.com
odesproperty.com olgacvetmet.com
oksrv.com online7777.com
omoikiri-japan.ru origin-my.ru
openlibrary.org ororodnik.goodbb.ru
pavlodar.xkaz.org osagonline.ru
pensplan4u.com paramountmarble.co.uk
perm-profnastil.ru paydayloanslocal.com
perso.wanadoo.es pendelprognos.se
pictures-and-images.com pepperstyle.ru
pochemychka.net peugeot-club.org
pinapchik.com
pinwallpaper.top
pipki.r.acdnpro.com
pladform.ru
poisk-zakona.ru poisk-zakona.ru
popcash.net poligon.com
pornohub.me pravoholding.ru
pricheskaonline.ru primedice.com
profitfx.online privat-girl.net
prom23.ru producm.ru
pronekut.com profitsport.club
randki-sex.com promoheads.com
rapidsites.pro pushdata.sendpulse.com
rebuildermedical.com py100.ru
relayblog.com quickloanbank.com
remmling.de raschtextil.com.ua
registratciya-v-moskve.ru
remont-komputerov-notebook.ru
renecaovillasale.online renecaovillasale.online
restaurantlescampi.com resultshub-a.akamaihd.net
rumamba.com rockma.se
ruspdd.com romhacking.ru
sc-specialhost.com scanner-jane.top
scrapy.org seocdvig.ru
searchlock.com sergiorossistore.online
selectads.men sethrollins.net
seoprofiler.com sex.hotblog.top
seorussian.ru shitmovs.com
sexpornotales.net shmetall.com.ua
sextracker.com silvercash.com
sexuria.net sispe.com.br
sibtest.ru site3.free-share-buttons.com
sim-service.net skincrate.net
skytraf.xyz snip.to
slavkokacunko.de
sledstvie-veli.net
snjatie-geroinovoy-lomki.ru snjatie-geroinovoy-lomki.ru
sonata-arctica.wz.cz sobecjvuwa.com.ru
spamnuker.com social-vestnik.ru
spidtest.org spb-plitka.ru
squidoo.com steelmaster.lv
sucsesofinspiration.com stickers-market.ru
syndicate.fun sugarlyflex.pw
taboola.com superiends.org
taraz.xkaz.org supers.com.ua
teslathemes.com suture.co
tgtclick.com teenporn18.net
tizanidine4mgprice.blogspot.com textads.men
tizanidinedosageforsleep.blogspot.com theendivechronicles.com
tizanidinedruginteractions.blogspot.com tizanidinehclsideeffects.blogspot.com
tizanidineonline.blogspot.com torrentgamer.net
tizanidineoral.blogspot.com torrents-tracker.com
tizanidineorflexeril.blogspot.com traffic2cash.org
tizanidinesideeffectsweightloss.blogspot.com trafficjunky.net
tmm-kurs.ru triumf-realty.ru
tonerbox.kz ukkala.xyz
top250movies.ru ultimatesetnewfreeallsoftupgradesystems.pw
torture.ml unitygame3d.com
trafficgenius.xyz unrealcommander.com
trahic.ru usacasino.com
turkeyreport.tk via-energy-acquistare.com
ucoz.ru viagraneggrx.com
uk-zheu20.ru viddyoze.com
v-doc.co video-chat.cn
vbikse.com vipsiterip.org
vclicks.net whosonmyserver.com
vektorpress.ru worldoffiles.ru
vip2ch.com writingservices17.blogspot.ru
voronezh.xrus.org www.kabbalah-red-bracelets.com
vozbujdenie.com x-diesel.info
vzlom-na-zakaz.com x-lime.com
warningzscaler.heraeus.com xfluro.com
webcamtalk.net xn----itbeirbjbi7bc6bh2d.xn--p1ai
whatsupinfoley.com xn--80aanaardaperhcem4a6i.com
wieseversa.no xn--80ak6aa92e.com
writersgroup580.web.fc2.com xn--lifehacer-1rb.com
wyniki-lista.pl xxart.ru
x-diesel.org xxxmania.top
x5market.ru xxxsiterips.xyz
xaijo.com youdao.com
xn----7sbahjd3btneuw1joc.xn--p1ai yunque.pluto.ro
xn--80ahvj9e.xn--p1ai zakon-ob-obrazovanii.ru
xn--80aikhbrhr.net zarabiaj-dzis.pl
xn--80ajjbdhgmudixfjc8c5a9df8b.xn--p1ai zed21.net
xn--q1a.xn--b1aube0e.xn--c1acygb.xn--p1ai zygophyceous.womanstars.site
xxxdatinglocal.us
yellowstonesafaritours.com
yugk.net
za-music.mymobiplanet.com
zaobao.com.sg
zastenchivosti.net
zerocash.msk.ru
zetmaster.ru

69
dev-tools/test_units/ratelimittest-master.txt
View file

@ -8,6 +8,37 @@
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html>ml>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html><html> </html><html>
<head><title>503 Service Temporarily Unavailable</title></head> <head><title>503 Service Temporarily Unavailable</title></head>
<body> <body>
@ -463,34 +494,6 @@
<hr><center>nginx/1.18.0 (Ubuntu)</center> <hr><center>nginx/1.18.0 (Ubuntu)</center>
</body> </body>
</html> </html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<!DOCTYPE html> <!DOCTYPE html>
<html> <html>
<head> <head>
@ -581,14 +584,4 @@
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html> </html>

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.88 0; 10.1.0.24 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.12.3523 ### Version: V4.2022.12.3524
### Updated: Tue Dec 20 22:01:37 UTC 2022 ### Updated: Wed Dec 21 22:01:25 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.12.3523 ### Version: V4.2022.12.3524
### Updated: Tue Dec 20 22:01:37 UTC 2022 ### Updated: Wed Dec 21 22:01:25 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##