vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-02 10:40:36 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2021.08.2509 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2021-08-07 22:06:52 +00:00
parent 89e4dbdc90
commit 33ae7b6e6b
46 changed files with 83402 additions and 83402 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2021.08.2508 #### Version: V4.2021.08.2509
#### Bad Referrers Blocked: [7077](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7077](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [618](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [618](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2021.08.2508 #### Version: V4.2021.08.2509
#### Bad Referrers Blocked: [7077](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7077](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [618](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [618](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -11,7 +11,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2021.08.2508 #### Version: V4.2021.08.2509
#### Bad Referrers Blocked: [7077](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7077](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [618](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [618](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

10292
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2021.08.2508 #### Version: V4.2021.08.2509
#### Bad Referrers Blocked: [7077](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7077](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [618](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [618](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

10296
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

10296
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

10296
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

10296
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.92 1; 10.1.0.44 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.92 0; 10.1.0.44 0;
127.0.0.1 0; 127.0.0.1 0;

10296
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.92 1; 10.1.0.44 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.92 0; 10.1.0.44 0;
127.0.0.1 0; 127.0.0.1 0;

10296
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.92 1; 10.1.0.44 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.92 0; 10.1.0.44 0;
127.0.0.1 0; 127.0.0.1 0;

10296
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
2508 2509

10296
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

10296
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.191.70.3 0; 52.224.104.170 0;

10296
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.92 1; 10.1.0.44 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.92 0; 10.1.0.44 0;
127.0.0.1 0; 127.0.0.1 0;

10296
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.92 1; 10.1.0.44 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.92 0; 10.1.0.44 0;
127.0.0.1 0; 127.0.0.1 0;

10296
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.92 1; 10.1.0.44 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.92 0; 10.1.0.44 0;
127.0.0.1 0; 127.0.0.1 0;

10296
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.191.70.3 0; 52.224.104.170 0;

10296
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.191.70.3 0; 52.224.104.170 0;

10296
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.92 1; 10.1.0.44 1;
127.0.0.1 1; 127.0.0.1 1;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
Boardreader AwarioRssBot
BotALot Backlink-Ceck
Meanpathbot Digincore
SBIder Dragonfly
Scanbot JOC Web Spider
Twice NetLyzer
WallpapersHD Scrapy
Whatweb Shodan
check1.exe SiteSucker
sitechecker.pro Turingos

296
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
360Spider 404enemy
80legs 80legs
Aboundexbot AIBOT
ASPSeek
Acunetix Acunetix
AfD-Verbotsverfahren AiHitBot
Alexibot
AllSubmitter AllSubmitter
Alligator
AlphaBot AlphaBot
Anarchy99 Anarchy99
Ankit
Anthill Anthill
Apexoo AwarioSmartBot
Asterias BBBike
AwarioRssBot BLEXBot
BDCbot
BDFetch
BackStreet BackStreet
BackWeb BackWeb
Badass Badass
Barkrowler Bandit
BatchFTP BatchFTP
Battleztar Bazinga Battleztar Bazinga
BetaBot BetaBot
Bitacle Bigfoot
Black Hole
BlackWidow
Blackboard Blackboard
Bolt Boardreader
Brandprotect BotALot
Buddy BunnySlippers
BuzzSumo BuzzSumo
CATExplorador
CCBot
CSHttp
Calculon
CherryPicker
Chlooe Chlooe
Claritybot Cliqzbot
Cloud mapping
Collector
Copier Copier
CopyRightCheck Cosmos
Crescent
CrunchBot CrunchBot
Custo Custo
CyotekWebCopy DBLBot
DTS Agent DSearch
Demon Demon
Digincore Devil
DigitalPebble Discoverybot
Discobot
DittoSpyder DittoSpyder
DomainAppender DomainCrawler
DomainSigmaCrawler
DomainStatsBot
Domains Project
Dotbot Dotbot
Download Wonder EMail Siphon
ECCP/1.0
EasyDL
Ebingbong Ebingbong
EirGrabber Ecxi
Extractor EroCrawler
Extreme Picture Finder Exabot
Firefox/7.0 ExtLinksBot
Flunky FDM
Foobot FHscan
FrontPage Fimap
Fuzz FlashGet
Freeuploader
Fyrebot Fyrebot
Gigablast GermCrawler
Gigabot GetWeb
Go!Zilla GoZilla
Go-Ahead-Got-It Gotit
GrabNet GrabNet
Grabber GrapeshotCrawler
GrapeFX
GridBot GridBot
HEADMasterSEO HTTP::Lite
HMView
HTMLparser
HTTrack HTTrack
Harvest Havij
Heritrix Hloader
Humanlinks IDBTE4M
IRLbot IDBot
Iblog
IlseBot IlseBot
Indy Library Image Fetch
InfoTekies IndeedBot
InterGET Internet Ninja
InternetSeer
Iria Iria
JOC Web Spider
JamesBOT
JennyBot JennyBot
Jorgee Kozmosbot
Kinza
LWP::Simple LWP::Simple
Lanshanbot Lanshanbot
LeechGet LeechGet
Libwhisker LexiBot
Likse LibWeb
LinksManager LieBaoFast
Lightspeedsystems
LinkWalker
Linkdexbot
LinqiaMetadataDownloaderBot
LinqiaRSSBot
Lipperhey Lipperhey
MFC_Tear_Sample Litemage_walker
Ltx71
MIDown tool
MJ12bot MJ12bot
Majestic SEO MQQBrowser
Mag-Net
MarkMonitor
Mata Hari
MauiBot MauiBot
MeanPath Bot MeanPath Bot
Mediatoolkitbot
MegaIndex.ru
Metauri
Mister PiX
Moblie Safari
Mojeek Mojeek
Mojolicious
Mozlila Mozlila
Musobot Mr.4x3
Navroad Msrabot
NICErsPRO
Name Intelligence
NearSite NearSite
Net Vampire Needle
Nessus
NetAnts NetAnts
NetMechanic NetMechanic
NetSpider Netcraft
Netvibes NextGenSearchBot
Nibbler NimbleCrawler
Niki-bot Nimbostratus
Nikto
Nmap Nmap
Nuclei
Octopus
Offline Navigator
OpenLinkProfiler
Openfind Openfind
Openvas Openvas
OrangeBot
OrangeSpider OrangeSpider
OutclicksBot OutclicksBot
OutfoxBot OutfoxBot
PECL::HTTP PageGrabber
PageScorer PageScorer
Pandalytics PageThing.com
Pavuk Panscient
Petalbot Picscout
Pixray Picsearch
Piepmatz
PleaseCrawl PleaseCrawl
ProWebWalker Pu_iN
Probethenet
Pump Pump
PxBroker PxBroker
Quick-Crawler Quick-Crawler
RSSingBot
RankActive
RankingBot RankingBot
RankingBot2
Rankivabot Rankivabot
RankurBot
Re-re Re-re
RealDownload
Reaper
RebelMouse
Recorder Recorder
Ripper RepoMonkey
SBIder Rogerbot
SEOprofiler SEOkicks-Robot
SISTRIX SEOlyticsCrawler
SalesIntelligent SalesIntelligent
ScanAlert
ScoutJet
Searchestate Searchestate
SearchmetricsBot SemrushBot
Semrush SeobilityBot
SeoSiteCheckup
SiteCheckerBotCrawler
SiteExplorer
SiteSnagger SiteSnagger
Sitebeam Sitebeam
Sitevigil
SlySearch
SmartDownload SmartDownload
Snake
Snoopy Snoopy
SocialRankIOBot
Sogou web spider Sogou web spider
SpaceBison Sosospider
Spammen Spammen
Spinn3r SpankBot
SputnikBot SputnikBot
Sqlmap Sqlmap
Sqworm Steeler
Stripper Stripper
Sucker Sucker
Sucuri
SuperBot
SuperHTTP
Surfbot
Szukacz Szukacz
Teleport T8Abot
Telesoft Telesoft
Telesphoreo Telesphoreo
Telesphorep TheNomad
Thumbor Thumbor
Toata Toata
Toweyabot Turingos
Trendictionbot Turnitin
True_Robot Typhoeus
TwengaBot
Twice
URLy Warning URLy Warning
URLy.Warning UnisterBot
Upflow Upflow
V-BOT VB Project
VCI Vagabondo
Vacuum VelenPublicWebCrawler
VidibleScraper VidibleScraper
VoidEYE
Voil Voil
Voltron
WASALive-Bot WASALive-Bot
WEBDAV WISENutbot
WPScan WWW-Collector-E
WWW-Mechanize
WWW::Mechanize
Wallpapers/3.0 Wallpapers/3.0
WeSEE WallpapersHD
Web Fetch Web Auto
Web Fuck Web Fuck
Web Sauger WebAuto
Web Sucker WebCopier
WebBandit
WebFetch
WebFuck
WebPix
WebReaper
WebSauger
WebSucker WebSucker
WebWhacker WebWhacker
WebmasterWorldForumBot
Webshag Webshag
Website Quester
WebsiteExtractor
Whack
Whacker Whacker
WinHTTrack Whatweb
Woobot Xaldon WebSpider
YoudaoBot Xaldon_WebSpider
Zade Zade
Zermelo
Zitebot Zitebot
ZoominfoBot
archive.org_bot archive.org_bot
arquivo-web-crawler
arquivo.pt
autoemailspider
backlink-check
coccocbot-web coccocbot-web
crawl.sogou.com crawl.sogou.com
demandbase-bot demandbase-bot
domainsproject.org
eCatch
evc-batch
facebookscraper facebookscraper
gopher gopher
heritrix
instabid instabid
lwp-request internetVista monitor
ips-agent
lwp-trivial
mediawords mediawords
netEstate NE Crawler
oBot oBot
pcBrowser pcBrowser
plumanalytics
polaris version polaris version
satoristudio.net probe-image-size
scalaj-http ripz
scan.lol scan.lol
seobility seobility
seostar seostar
serpstatbot siteripz
sitechecker.pro sp_auditbot
spyfu
trendiction.de
ubermetrics-technologies.com
webmeup-crawler webmeup-crawler
x09Mozilla x22Mozilla
xpymep1.exe
zgrab zgrab

280
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
80legs 01h4x.com
ADmantX 360Spider
Abonti AIBOT
Aboundexbot ALittle Client
AhrefsBot Aboundex
AiHitBot Acunetix
Alexibot Alexibot
Alligator AllSubmitter
Anarchie Anarchy99
Anarchy Ankit
Aspiegel Anthill
Attach AwarioRssBot
AwarioSmartBot BDCbot
BLEXBot
BackWeb BackWeb
BacklinkCrawler Backlink-Ceck
Badass Badass
Bandit
Barkrowler Barkrowler
Battleztar Bazinga Black Hole
BetaBot
Bigfoot
BlackWidow BlackWidow
Boardreader
Bolt Bolt
BotALot BotALot
Brandwatch
Buck Buck
BuzzSumo BuzzSumo
CATExplorador CATExplorador
CCBot CCBot
CODE87
Cegbfeieh Cegbfeieh
CheeseBot ChinaClaw
CherryPicker Chlooe
Claritybot Cliqzbot
Cloud mapping Cogentbot
Cocolyzebot Collector
Copier Copier
CopyRightCheck CopyRightCheck
Cosmos Craftbot
Custo CrazyWebCrawler
Curious
DBLBot
DSearch DSearch
DTS Agent DTS Agent
Deusu DataCha0s
Devil DatabaseDriverMysqli
Digincore
DigitalPebble DigitalPebble
Dirbuster Dirbuster
Disco
Discoverybot Discoverybot
DomainAppender DittoSpyder
DnyzBot
DomCopBot
DomainSigmaCrawler
Domains Project
Dotbot Dotbot
Download Wonder Drip
ECCP/1.0 ECCP/1.0
EMail Siphon Ebingbong
EMail Wolf
Ecxi
EroCrawler EroCrawler
Evil Evil
ExtractorPro Extreme Picture Finder
EyeNetIE
Ezooms Ezooms
FHscan FHscan
FlashGet Firefox/7.0
Freeuploader
FrontPage FrontPage
Fuzz Fuzz
Fyrebot Fyrebot
GT::WWW
GermCrawler
Getintent Getintent
Gigablast Gigablast
GoZilla
GrabNet GrabNet
GrapeFX Grabber
HaosouSpider GridBot
HEADMasterSEO
HTTrack
Harvest Harvest
Hloader Hloader
HybridBot HybridBot
Id-search IDBTE4M
IlseBot IDBot
IndeedBot Image Sucker
Intelliseek Intelliseek
InternetSeer InternetSeer
Iskanie Iskanie
IstellaBot JOC Web Spider
Jbrofuzz Jbrofuzz
JetCar Jetty
Jorgee JustView
Jyxobot Keyword Density
Kenjin Spider
LNSpiderguy LNSpiderguy
LWP::Simple
Lanshanbot Lanshanbot
Larbin
Leap Leap
LeechFTP
LeechGet LeechGet
LexiBot LieBaoFast
Likse LinkScan
LinkWalker LinksManager
Linkbot
LinqiaMetadataDownloaderBot LinqiaMetadataDownloaderBot
LinqiaScrapeBot LinqiaRSSBot
Lipperhey Lipperhey
Lipperhey Spider Litemage_walker
MSIECrawler Ltx71
Majestic SEO MFC_Tear_Sample
MIDown tool
MIIxpc
MJ12bot
MQQBrowser
Mag-Net
Majestic-SEO
Majestic12
MarkMonitor
Mass Downloader Mass Downloader
MauiBot Mata Hari
MeanPath Bot MeanPath Bot
Meanpathbot Meanpathbot
MegaIndex.ru
Microsoft URL Control Microsoft URL Control
Moblie Safari
Mojeek Mojeek
Mojolicious
Mr.4x3
Msrabot Msrabot
Musobot
NICErsPRO
NPbot NPbot
Nameprotect Navroad
NearSite Net Vampire
Needle
Nessus
NetAnts
NetMechanic NetMechanic
Netcraft NetSpider
Nettrack
Netvibes Netvibes
NextGenSearchBot NimbleCrawler
Nimbostratus OnCrawl
Nuclei OpenLinkProfiler
Offline Explorer
Offline Navigator
OpenVAS OpenVAS
OrangeSpider OrangeBot
OutclicksBot
OutfoxBot OutfoxBot
PECL::HTTP
PHPCrawl PHPCrawl
POE-Component-Client-HTTP POE-Component-Client-HTTP
PageScorer PageScorer
Petalbot PageThing.com
Pandalytics
Pavuk
Picsearch Picsearch
Pimonster PictureFinder
ProPowerBot ProWebWalker
Probethenet Probethenet
Psbot Pu_iN
Pump Pump
PxBroker PxBroker
PyCurl
QueryN Metasearch QueryN Metasearch
RSSingBot
RankActive
RankActiveLinkBot
RankFlex RankFlex
RankingBot Reaper
Rankivabot RedesScrapy
ReGet
RealDownload
RebelMouse
RocketCrawler
Rogerbot Rogerbot
SBIder SBIder
SEOlyticsCrawler SEOkicks
SISTRIX SEOstats
SMTBot SalesIntelligent
ScanAlert Screaming
ScrepyBot ScrepyBot
SearchmetricsBot SearchmetricsBot
SentiBot
SeoSiteCheckup
Siphon Siphon
Site Sucker
SiteCheckerBotCrawler
SiteExplorer SiteExplorer
SiteLockSpider SiteLockSpider
SiteSnagger
Sitebeam Sitebeam
SlySearch Siteimprove
Snake SocialRankIOBot
Spammen Sociscraper
Spanner Sogou web spider
Sosospider
Sottopop
Spinn3r
Sqlmap Sqlmap
Sqlworm
Sqworm
Steeler Steeler
Sucuri Sucuri
SuperBot
SuperHTTP SuperHTTP
Surfbot
SurveyBot
Suzuran Suzuran
TeleportPro T0PHackTeam
Telesphorep Teleport
Tracemyfile Telesphoreo
The Intraformant
Thumbor
TightTwatBot
Titan
Toweyabot
Trendictionbot
True_Robot True_Robot
Turnitin Turnitin
TwengaBot URLy Warning
UnisterBot V-BOT
Upflow VB Project
VCI VCI
Vacuum Vacuum
Vagabondo
VelenPublicWebCrawler
VeriCiteCrawler VeriCiteCrawler
VidibleScraper VidibleScraper
Virusdie Virusdie
VoidEYE
WBSearchBot
WPScan
WWW-Collector-E
WWW::Mechanize
Wallpapers
Wallpapers/3.0 Wallpapers/3.0
WallpapersHD
Web Auto Web Auto
Web Collage Web Collage
Web Fetch
Web Sucker Web Sucker
WebEnhancer WebAuto
WebFetch
WebFuck
WebImageCollector WebImageCollector
WebLeacher WebLeacher
WebPix
WebReaper WebReaper
WebSauger
WebWhacker WebWhacker
Webalta Webalta
WebmasterWorldForumBot WebmasterWorldForumBot
Webshag
Website Quester Website Quester
WebsiteExtractor
Whack Whack
Whacker Who.is Bot
Whatweb WinHTTrack
WiseGuys Robot
Wprecon Wprecon
Zade YoudaoBot
Zermelo ZoominfoBot
Zeus coccocbot-web
ZmEu crawl.sogou.com
archive.org_bot evc-batch
autoemailspider instabid
crawler.feedback internetVista monitor
demandbase-bot
facebookscraper
ips-agent
isitwp.com isitwp.com
lwp-request lwp-request
lwp-trivial
magpie-crawler magpie-crawler
meanpathbot
mediawords mediawords
muhstik-scan muhstik-scan
oBot
plumanalytics plumanalytics
s1z.ru probe-image-size
satoristudio.net
scalaj-http
scan.lol scan.lol
seobility seobility
seostar seostar
sexsearcher sexsearcher
sitechecker.pro sogouspider
siteripz sysscan
tAkeOut tAkeOut
trendiction.com trendiction.de
voyagerx.com voyagerx.com
x09Mozilla
xpymep1.exe
zauba.io zauba.io
zgrab

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
2drittel.de 2pxg8bcf.top
docstoc.com battle.net
elektir.ru bensbargains.net
naj-filmy24.pl cheapwebsitehoster.com
putevka24.ru healmytrauma.info
remedyotc.com members.ghanaweb.com
remont-ustanovka-tehniki.ru nowtorrents.com
whatistizanidinehclusedfor.blogspot.com verymes.xyz
xn----9sbebi2bvzr7h.xn--p1ai webalan.ru
zscaler.net x-stars.ru

918
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
0daymusic.org 00author.com
1001watch.com.ua 12u.info
123any.com 18ps.ru
1314dh.com 1qingdao.com
1adult.com 2itech.ru
1j7740kd.website 4webmasters.org
2daytrendingnews.com aa9d046aab36af4ff182f097f840430d51.com
2kata.ru above.com
3-letter-domains.net abwa.tk
3w24.com
72-news.com
a96527gi.beget.tech
abcguru.xyz
actices.com
ad-words.ru
adclickservice.com
addtoadd.men
adloads.net
adman.se adman.se
adssafeprotected.com adobereader-free.ru
adultgalls.com adult-shop.com.ua
adviceforum.info advancedcleaner.com
advocatemsk.ru adventureparkcostarica.com
afftrack001.com
afmuseum.com afmuseum.com
aimayangzhi.com agapovdg.ru
airlandsea.info agroeconom.kz
aksonural.ru
aktivator-windows10.blogspot.com aktivator-windows10.blogspot.com
alekseevec.ru
alibestsale.com alibestsale.com
allwidewallpapers.com all-number.com
alphaforum.ru all-streaming-media.com
alvtank.se allboard.xobor.de
amazingninja.com allwomen.info
amazon-seo-service.com aludecor.info
amazon-adsystem.com
ameblo.jp ameblo.jp
angigreene.com ananumous.ru
angkortours.vn animal36.com
apibrowsesmartne-a.akamaihd.net anonymousfox.co
apishops.ru anti-virus-removal.info
appfixing.space apple.com-webbrowsing-security.review
appleid-verification.com arabseyes.com
arabgirls.adultgalls.com arkkivoltti.net
asseenontvonline.ru aruplighting.com
australia-opening-times.com asscenihotosidea.blogspot.com
autotrends.today aussie-prizes.com
avon-novosib.ru auto-moto-elektronika.cz
avramstroy.ru autoseo-traffic.com
axbocz.net aviav.ru
ayeartoforget.com avtointeres.ru
b00kmarks.com b-styles.xyz
b2b-lounge.com battlecarnival.su
babyguns.ru bcmp.org
baikaleminer.com berdasovivan.ru
banki76.ru besttorrentknifta.weebly.com
bannerads.de bg6s0.com
belinka.com.ua bif-ru.info
beremenyashka.com bimatoprost-careprost.com
bestdraws.com biznesschat.net
bestimagecoollibrary.com bloggers.nl
bet365.com blogos.kz
bharatdefencekavach.com bmw-ark.ru
bin-brokers.com
blackwitchcraft.ru
blog.yam.com
bloggen.be
bloglag.com
bobinoz.com
boc.kz boc.kz
brainsandeggs.blogspot.com bochemit.com.ua
briomotor.co bocoarchives.org
brus.city braintobe.win
btc4u.ru butstrap.space
buchananshardware.com buy-meds24.com
buzz-porno.info buytizanidineonline.blogspot.com
c-gainsbourg.com camsex.xxx-cam.webcam
calvet.altervista.org candiceloves.us
candlehandmade.com carapics.com
carabela.com.do cardsharp1.ru
carloans.com carmuffler.net
castingbank.ru cartierlovestore.xyz
caveavins.fr cdn.walkme.com
ccjp.eu cdncash.net
chastnoeporno.com celejihad.info
cheapcigarettesc.info cementaresearch.se
checkm8.com cheapmoncler.pw
chocolateslim-original.com cherrypointplace.ca
citizenclsdriveri7.pen.io chiptuninger.com
compliance-barak.xyz chocolateslim-en-france.com
compliance-george.xyz cialgenisrx.com
compliance-john.top ciproandtizanidine.blogspot.com
computernetworksonline.com clickbanksites.info
concealthyself.com clickcash.com
connectingsingles.com clothesforcash.com
contentlook.co club-samodelkin.ru
cougfan.info coldfilm.ru
com-supportcenter.website
compliance-irvin.top
compliance-julia.top
compliance-nelson.top
construmac.com.mx
continent-e.tv
copro.pw
coslab.club
country-chic.ru
cowblog.fr
cpajunkies.com cpajunkies.com
crirussian.ru crackguru.tk
culturevie.info crynet.cc
customchocolate.business-for-home.com crystalslot.com
cxpromote.com custodieva.ru
cyprusbuyproperties.com dangphoto.trade
d-black.bz darkbooks.org
dafatiri.com date-withme.com
darodar.com
dating-app.ru
dayibiao.com
decoratinghomes.ga
descargar-musica-gratis.net
detmebel.su
dev78.dioniqlabb.se
dfwu1019.info
dieswaene.com dieswaene.com
digest-project.ru dieta-personalna.pl
digitalfaq.com dipstar.org
discovertreasure-a.akamaihd.net doktoronline.no
discovertreasurenow.com domain.webkeyit.com
djihispano.com dominateforex.ml
dogsrun.net dosugrostov.site
domaineaneblanc.com
domznaniy.ru
download-of-the-warez.blogspot.com download-of-the-warez.blogspot.com
downloaddy.net dumpsmania24.com
downloads-whatsapp.com duplicashapp.com
drugstoreforyou.com
dtm-spain.com
dustyorate.com
dverimegapolis.ru dverimegapolis.ru
eachdayisagift.review e-avon.ru
ecxtracking.com e-buyeasy.com
edge.sharethis.com eldiariodeguadalajara.com
eduserver.net electro-prom.com
ekspertmed.com elektronischezigarettekaufen2.tumblr.com
election.interferencer.ru elektrozigarette2.webs.com
elitedollars.com elektrozigaretten1.tumblr.com
elvenmachine.com elidelcream.weebly.com
englate.com elvenar.com
erotik0049.com eng-lyrics.com
engines-usa.com
erectile.bid
erotische-geschichten-xxl.com
ertelecom.ru
escort-russian.com
essay-writing.work essay-writing.work
evaashop.ru essayservicewriting.org
ezofest.sk european-torches.ru
ezrvrentals.com evehemming.blogspot.com.au
f1nder.org excaliburfilms.com
fanpagerobot.com exct.net
fetroshok.ru exlarseva.webblog.es
fidelityfunding.com ezigarettenshop1.yolasite.com
filmetricsasia.com facebook-mobile.xyz
filmi-v.online factorynightclub.com
finemanteam.com falcoware.com
firma-legion.ru fanrto.com
flashbannernow.com favorcosmetics.com
fok.nl fba-mexico.com
fbdownloader.com
fearcrow.com
feargames.ru
fickenprivat.info
fickluder69.com
fil.ru
find1friend.com
findpik.com
fiuxy.com
flagcounter.me
flash4fun.com
floating-share-buttons.com
focalink.com
folowsite.com
forex-indextop20.ru
forum.doctissimo.fr forum.doctissimo.fr
fotosfotos.eu forum69.info
foxydeal.com foto-weinberger.at
free-gluten.ru fototravel.eu
freemags.cc foxweber.com
freenode.info freakycheats.com
fuel-gas.com fuckmill.com
gamerextra.com game-mmorpg.net
gaming-journal.com gemara.com
gardene.ru germetiki.com.ua
gcup.ru
getoutofdebtfree.org getoutofdebtfree.org
gk170.ru getprismatic.com
globatur.ru glicol.kz
goldandcard.ru gne8.com
greatdealshop.com go2album.com
gta-club.ru goo.ne.jp
gyffu.com google-liar.ru
hacktougroup.ru googlsucks.com
hasfun.com gosmeb.ru
hawaiisurf.com gotwebsite1.com
hdwallpapers-free.com gowreckdiving.com
greenzaim.ru
growboxbl.ru
gsasearchengineranker.pw
guardlink.com
hayate.biz
hd720kino.ru
hdseriale.pl
heartofpayne.xyz
heatpower.ru
helicalpile.us
help.tpu.ru help.tpu.ru
hermesreplica.pw hentaiheroes.com
hidefiles.org hexpilot.com
high-speed1.net highland-homes.com
hoholikik.club hildinghr.se
homemade.gq hitsbox.info
hostingclub.lk holidaypics.org
hotshoppymac.com homeandhealth.ru
houtings.xyz homedo.fabpage.com
hustoon.over-blog.com hornymatches.com
hydropump.su hotel-mkad.ru
hystersister.com hotelcrocenzi.sm
i4track.net hotgirlhdwallpaper.com
igtools.club hoverboardforsaledirect.com
ikearugs.xyz hully.altervista.org
ikritikimou.gr hyiphunter.org
ilovevitaly.com i-hobot.ru
ilovevitaly.xyz ideibiznesa2015.ru
imgarcade.com iflycapetown.co.za
impisr.ru ilo134uloh.com
infektsii.com iloveitaly.ru
infoupdate.org imagerydatabase.com
instabid.tech imguramx.pw
instasexyblog.com inboundlinks.win
insurple.com infogame.name
intimshop-fantasy.ru insomniagamingfestival.com
investingclub.ru interesnie-faktu.ru
investmac.com interfucks.net
investzalog.ru investsuccess.org
ipchicken.com io9.com
iqbazar.ru iopeninghours.co.uk
irkutsk.zrus.org iron-age.info
it-max.com.ua
iwantmyfreecash.com iwantmyfreecash.com
jacago.com izoll.ru
james13prix.info jabimgo.pw
jerseyswholesalechinalimited.com jackwolfskinoutlet.online
jovencitas.gratis janavibekken.no
jus0wil.pp.ua jav-fetish.site
justkillingti.me javatex.co.id
jyrxd.com javstock.com
kaac.ru je7.us
kevblog.top joessmogtestonly.com
khafre.us jumptap.com
kihi.gdn justprofit.xyz
kinoplen.ru jwss.cc
kambasoft.com
kamen-e.ru
kasino-money.pw
keenoutlet.online
keki.info
keywordhouse.com
keywordteam.net
kino-filmi.com
kinobaks.com
kinomaniatv.pl
kinosed.net
kinostorm.net
kirov.zrus.org
kiskinhouse.com
kleine-titten.biz kleine-titten.biz
koleso24.com.ua klejonka.info
kosova.de komputers-best.ru
kovrenok.ru koptims.tiu.ru
kumuk.info kotaku.com
kung-fu-ru.com kursy-ege.ru
kw21.org kuzinsp.ru
lampokrat.ws kwzf.net
laudit.ru laptoper.net
ldrtrack.com larger.io
leboard.ru lawyersinfo.org
lazy-z.com
leadn.pl
legalrc.biz
lennatin.info lennatin.info
letslowbefast.today lexaprogeneric.link
lezbiyanki.net link.ac
lida-ru.com linkbolic.com
limads.men littlesunraiser.com
linkredirect.biz louisvuittonoutletstore.net
liran-locks.com luckyday.world
littlecity.ch lyrics.home-task.com
ljusihus.se mac-shield.com
locustdesign.co madot.onlinewebshop.net
louboutinbooties.xyz magda-gadalka.ru
lovasszovetseg.hu mainlinehobby.net
lulea-auktionsverk.se malls.com
lumb.co marcowebonyodziezowe.pl
lunamedia.co marinetraffic.com
lutherstable.org mature.free-websites.com
m.b00kmarks.com me-ke.com
mabdoola.blogspot.com mebel-alait.ru
magnetpress.sk
makemoneyonline.com
manuscript.su
markjaybeefractal.com
maximpartnerspr.com
mediafresh.online
meduza-consult.ru
megaapteka.ru megaapteka.ru
merryhouse.co.uk menetie.ru
michaelkorsoutlet.store mensandals.xyz
microstatic.pl mesto-x.com
milblueprint.com micasainvest.com
minecraft-neo.ru miniads.ca
minecraft-rus.org mirmedinfo.ru
missis.top
mnogabukaff.net mnogabukaff.net
mobilierland.com mobifunapp.weebly.com
moesexy.com mockupui.com
mojpregled.com mojpreskumanie.com
monarhs.info mompussy.net
moncleroutletonline.pw monclercheap.xyz
monitorwebsitespeed.com moneyviking-a.akamaihd.net
more-letom.ru monsterdivx.com
morpicert.pw moonci.ru
moscow-clining.ru mountainstream.ms
moz.com moz.com
mrinsidesales.com muz-tracker.net
mrvideospornogratis.xxx mydirtystuff.com
mtmtv.info myfreemp3.eu
mydownlodablefiles.com myhealthcare.com
myliveblog.ru naval.jislaaik.com
myyour.eu nextrent-crimea.ru
nalogovyykodeks.ru nicovideo.jp
naturalbreakthroughsresearch.com nonews.co
naughtyconnect.com norththeface.store
nevansk.ru novodigs.com
nextlnk12.com
nfljerseyscheapchinabiz.com
nibbler.silktide.com
nikitsyringedrivelg.pen.io
nikkiewart.ru
nina.az
njpalletremoval.com
notebook-pro.ru
novosibirsk.xrus.org novosibirsk.xrus.org
nucia.biz.ly oecnhs.info
nullrefer.com okonich.com.ua
nw-servis.ru okroshki.ru
o.light.d0t.ru online-zaymy.ru
obiavo.uz onlinedomains.ru
offtime.ru onlyforemont.ru
offtopic.biz ons-add.men
onclickpredictiv.com ossmalta.com
oneminutesite.it pammik.ru
onetravelguides.com partner-high.men
onstrapon.purplesphere.in partnerads.men
ontargetseo.us perfectpracticeweb.com
ooo-olni.ru perm-profnastil.ru
openmediasoft.com petitions.whitehouse.gov
oren-cats.ru peugeot-club.org
orenburg-gsm.ru pewit.pw
origin-my.ru phobia.us
pandroid.co pizda.lol
parajumpersjakkesalgnorge.info pizza-tycoon.com
parajumpersstore.online poisk-zakona.ru
partner-cdn.men
pateaswing.com
pcboa.se
perl.dp.ua
pharmacyincity.com
photorepair.ru
physfunc.ru
picsearch.com
pipki.r.acdnpro.com
pkr1hand.com
play-mp3.com
playlott.com
playtap.us
pobeiranie.pl
podshipniki-ntn.ru
pokemon-go-play.online pokemon-go-play.online
pomoc-drogowa.cba.pl poppen-nw.net
popmarker.com porndl.org
popup-hgd.xyz porno.simple-image.com.ua
poquoson.org pornoelita.info
porno-video-chati.ru pornoklad.ru
pornokorol.com pornosmola.info
portnoff.od.ua pornozhara.com
positive2b.ru positive2b.ru
preg.marketingvici.com powc.r.ca.d.sendibm2.com
pregnant.guru pozdrawleniya.com
privacylocationforloc.com pr0fit-b0x.com
privatefx-in.ru privatefx-in.ru
prizefestival.mobi privetsochi.ru
pronorm.fr proekt-mos.ru
propranolol40mg.blogspot.com promodj.com
prostitutki-almata.org promoforum.ru
prostitutki-novgoroda.org
proxyradar.com
pukaporn.com
purchasepillsnorx.com
pussysaga.com
pyrodesigns.com.au pyrodesigns.com.au
quick-seeker.com qwesa.ru
quickloanbank.com rankscanner.com
rapidgator-porn.ga redirlock.com
rating-bestcasino.com refererx.com
realitykings.com relax.ru
recordpage-a.akamaihd.net remont-fridge-tv.ru
reelheroes.net remont-komputerov-notebook.ru
regionshop.biz remontvsamare.su
registrydomainservices.com remybutler.fr
remont-ustanovka-tehniki.ru
renhacklids.tk
resant.ru resant.ru
responsive-test.net research.ifmo.ru
resultshub-a.akamaihd.net ric.info
robertefuller.com rique.host.sk
robotixix.com roll123.com
ros-ctm.ru rubbed.us
rusenvironmental.net runtnc.net
saecsa.co russkie-gorki.ru
sady-urala.ru
saltspray.ru
sanidumps.com sanidumps.com
sarf3omlat.com sarafangel.ru
sawin.beth.webd.pl savingsslider-a.akamaihd.net
scanner-alex.top sax-sex.com
scanner-jessica.top sayyoethe.blogspot.co.za
scanner-john.top scanmyphones.com
scanner-margo.top scanner-ivan.top
scanner-marwin.top scanner-jane.top
scansafe.net search-error.com
scrapy.org search.1and1.com
sdelatmebel.ru search.pch.com
seasaltwithfood.com searchmywindow-a.akamaihd.net
servisural.ru semprofile.com
sex-watch.com semxiu.com
sexyteens.hol.es senger.atspace.co.uk
sfj-ror.no seorankinglinks.com
sharebutton.to seorankinglinks.us
ship-marvel.co.ua seorussian.ru
simple-share-buttons.com sex-znakomstva.online
sexsaoy.com
sextracker.be
shivafurnishings.com
shopperifymac.com
signx.info
silvercash.com
sindragosa.comxa.com sindragosa.comxa.com
skachat-besplatno-obrazcy.ru sisi-go.ru
skylta.com site5.com
slayerlife.com sloopyjoes.com
smart-scripts.com sneakyboy.com
snjatie-geroinovoy-lomki.ru social-buttons.xyz
solmarket.by soft-terminal.ru
spywarenuker.com spamnuker.com
speeddream.xyz
sportbetfair.com
sptslmtrafms.com
spy-app.info
srdrvp.com srdrvp.com
star61.de sticken.co
statoutlook.info stpicks.com
staynplay.net strana-solnca.ru
streetfooduncovered.com stretchingabuckblog.com
sugarkun.com suggest-keywords.com
superoboi.com.ua supernew.org
swiped.su support.nopeas.sk
sygraem.com surfbuyermac.com
surffoundation.nl
swingerseiten.com
tackletarts.co
taraz.xkaz.org
taxi-v-eisk.ru taxi-v-eisk.ru
telefonsexkostenlos.tk td-33.ru
templates.radiodigital.co tds-advert002.info
tengohydar.tk thegioixekhach.com
thelottosecrets.com titelhelden.eu
theplacetoupdating.pw tizanidine4mgstreetprice.blogspot.com
thesmartsearch.net tizanidinecapsules.blogspot.com
titslove.yopoint.in tizanidineforopiatewithdrawal.blogspot.com
tizanidine6mg.blogspot.com toproadrunner5.info
tizanidinedrugtest.blogspot.com topvidos.ru
tizanidinehcl2mgtablet.blogspot.com
tizanidinehydrochloride4mgstreetvalue.blogspot.com
tizanidineoral.blogspot.com
tizanidinesleepaid.blogspot.com
tmearegion26.com
tnctrx.com
toonfamilies.net
tooplay.com
topquality.cf
tracfone.com
track.deriv.com
traffic-club.info traffic-club.info
trafficgenius.xyz
trafficreceiver.club
traffique.net traffique.net
tripper.de traxdom.ru
trkdf.com truebeauty.cc
truck-rece.life trustl.life
trustedhealthtips.com tuberkuleznik.ru
tupper-shop.ru
turbo-suslik.org
turbodsp.com
turist-strani.ru
turizm.bz
turvgori.ru
tvand.ru
tvorozhnaja-zapekanka-recept.ru tvorozhnaja-zapekanka-recept.ru
tvory.predmety.in.ua txxx.com
ua.tc tytoona.com
uchebavchehii.ru unimodemhalfduplefw.pen.io
ucsol.ru unmaroll.ya.ru
ugogo.info unrealcommander.com
uhod-za-sobakoj.ru urll.eu
umekana.ru urlopener.com
unitygame3d.com userequip.com
uprour.com
uroki.net
varikozdok.ru
vedomstvo.net vedomstvo.net
vellings.info vesnatehno.ru
vgoloveboli.net vgoloveboli.net
via-gra.webstarts.com viagraneggrx.com
vilingstore.net viagroid.ru
visa-china.ru videochat.tv.br
visitcambridge.org vinsit.ru
voronezh.xrus.org vladhistory.com
vod.com.ua
vodaodessa.com
vozbujdenie.com
vrotike.ru
vsexkontakte.net vsexkontakte.net
vtcdns.com vtc.pw
vysigy.su vucms.com
wahicbefa31.soup.io wallpapersdesk.info
wait3sec.org watchdogs-2.ru
wallpapers-best.com webjam.com
wardreapptokone.tk webmonetizer.net
warningzscaler.heraeus.com webpromotion.ae
web-betting.ru website-speed-check.site
webads.co.nz
webalan.ru
websites-reviews.com
westen-v.life
westermarkanjou.se
wetgames.ru
wfb.hatedriveapart.com
whatsupinfoley.com whatsupinfoley.com
whatzmyip.net whipme.yopoint.in
whengirlsgowild.com wholesalejerseychinashop.com
wholesalejerseychinaoutlet.com wieseversa.no
wildnatureimages.com winx-play.ru
woman-orgasm.ru wjgony.com
world-mmo.com www.pinnacle-bets.com
wormix-cheats.ru x-musics.com
www.wohnkabinen-shop.de x-true.info
xkaz.org x69ty.ru
xlovecam.com xedserver.com
xmladserver.com xep.info
xn--80aaajbdbddwj2alwjieei2afr3v.xn--p1ai xfire.com
xn--80aanaardaperhcem4a6i.com xn-----7kceclhb4abre1b4a0ccl2fxch1a.xn--p1ai
xn--80aodinpgi.xn--p1ai xn----8sbarihbihxpxqgaf0g1e.xn--80adxhks
xn--80atua3d.xn--p1ai xn--80aebbcbcdemfkhba4byaehoejh8dza3v.xn--p1ai
xn--d1abj0abs9d.in.ua xn--90acenikpebbdd4f6d.xn--p1ai
xn--l1aengat.xn--p1ai xn--d1acah0c.xn--p1ai
xolodremont.ru xsion.net
xtremeeagles.net yoshkarola.zrus.org
yellowstonevisitortours.com youjizz.com
youporn-forum.ga youporn-forum.ga
your-bearings.com
yoursearch.me
yugk.net
zambini.ru
zebradudka.com zebradudka.com
zebramart.ru zeroredirect12.com
zhacker.net zirondelli.it
znakom.sibtest.ru znakom.sibtest.ru
zone-kev717.info
zophim.me zophim.me
zx6.ru zscalertwo.net
zytpirwai.net
zzbroya.com.ua

486
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
1001desert.com 2345.com
10bet.com 2daytrendingnews.com
12masterov.com 991mostfm.co.id
14b.info a1security.com.ua
28n2gl3wfyb0.ru aab94f698f36684c5a852a2ef272e031bb.com
4k-player.pl aad1f4acb0a373420d9b0c4202d38d94fa.com
7minuteworkout.com actulite.com
9icmzvn6.website adamoads.com
aa08daf7e13b6345e09e92f771507fa5f4.com ads.gold
aa8b68101d388c446389283820863176e7.com adtiger.tk
academiacsmendoza.org adultmeetonline.info
adssafeprotected.com ahmedabadwebs.com
advertex.info
allforminecraft.ru allforminecraft.ru
amanda-porn.ga alta-realestate.com
apiwoodensealcom-a.akamaihd.net appartement-stumm.at
apple.com-cleaner.systems apple.com-cleaner.systems
appsaurus.com aproposde.com
appsecurityr.com avek.ru
asacopaco.tk bazaronline24.ru
astana.xxxkaz.org bestofupload.info
auto-zapchasti.org betterhdporn.com
aviva-limoux.com bezlimitko.xyz
avto-oligarh.ru blacktwhite.com
backgroundpictures.net boeuklad.com
banki76.ru bristolhotel.com
basedecor.ru bscodecs.com
bestbrainprod.win budpost.com.ua
bestmobilityscooterstoday.com bvlgariwallet.xyz
bestsexyblog.com cascadelink.org
bizru.info casite-513049.cloudaccess.net
bocoarchives.org castingbank.ru
bonkers.name cdn.walkme.com
bracketsmackdown.com cdncash.net
braip.com.br cementaresearch.se
buckspar.gq cete.ru
budilneg.xyz cheapmoncler.pw
byme.se cherubinimobili.it
cactussoft.biz chocoslim.pro
calvet.altervista.org cleansearch.net
cars-modification.net clmforexeu.com
caveavins.fr clodo.ru
chocolateslim-en-france.com compliance-jessica.top
cialgenisrx.com compliance-john.top
cialischsrx.com compliance-olga.top
cibpenonptib.flu.cc conboy.us
classicakuhni.ru cornerstone-countertops.com
cognitiveseo.com countbertwistdisp26.soup.io
comeondog.info counterbot.com
compliance-irvin.xyz creditmoney.com.ua
compliance-margo.top customcollegeessays.net
coolgramgoods.com daisye.top
cryptoswap.biz danceuniverse.ru
cymbaltaandtizanidine.blogspot.com de.zapmeta.com
daneshetabiat.com dealwifi.com
darkbooks.org derevesendeco.com
data1.scopich.com dev.citetick.com
dating-app.ru diffbot.com
dekorkeramik.ru digital-video-processing.com
dgfitness.co discountbarbour.online
dichvuvesinhhanoi.com documentsite.net
directrev.com domaincheck.io
dokfilms.net domashneeruporno.com
dolohen.com download-wallpaper.net
domaincrawler.com druzhbany.ru
donna7753191.ru dumpsmania24.com
doxysexy.com electricwheelchairsarea.com
e-buyeasy.com eloconcream.blogspot.com
educatemetv.com embedle.com
efnor-ac.com englishdictionaryfree.com
ekspresihati.info englishgamer.com
elektronischezigarettekaufen2.tumblr.com essayassist.com
elidelcream.weebly.com eu-cookie-law.info
eshop.md exoclick.com
esopini.com ezigarettekaufen.myblog.de
eugenevaultstorage.com fbdownloader.com
extremez.net
fakehandbags.xyz
familyphysician.ru
fearcrow.com fearcrow.com
fidelityfunding.com financeloan.us
fil.ru formulaf1results.blogspot.com
findacheaplawyers.com foto-sisek.porngalleries.top
forex.osobye.ru game-top.su
forexgb.ru geckoandfly.com
freelotto.com get-free-social-traffic.com
freshmac.space glopages.ru
gamedayassist.com golfresa.lucania.se
gameonasia.com goodwinmetals.co
getresponse.com googlefeud.com
ghernnqr.skyrock.com googleseo.com.tr
girlsatgames.ru greenzaim.ru
goodhousekeeping.com guildebzh.info
google-liar.ru hdwallpapers-free.com
gorodservis.ru healing-dysplasia.ru
graphics8.info healmytrauma.info
growboxbl.ru hermesreplica.win
growshop.es hexpilot.com
gta-top.ru hobbyhuren-datenbank.com
highland-homes.com hoverboard360.de
hildinghr.se howopen.ru
hitsbox.info igadgetsworld.com
ifmo.ru ihc2015.info
images-free.net iinstalll-fii1leis.jus0wil.pp.ua
imagine-ex.co iminent.com
imfamous.info importchinacoach-teach.com
javstock.com infoupdate.org
jillepille.com inzn.ru
ketrzyn.pl io9.com
kfon.eu james13prix.info
kinocccp.net jerseychinabizwholesale.us
koversite.info keywords-monitoring-success.com
laparfumotec.com kinobaks.com
ldrtrack.com kladrus.ru
lion.conboy.us klin3952.ru
lion.playtap.us krasivoe-hd.net
m292.info kursy-ege.ru
manifestyourmillion.com lechenie-gemorroya.com
manualterap.roleforum.ru letslowbefast.today
manyresultshub-a.akamaihd.net lida-ru.com
marcowebonyodziezowe.pl littlesunraiser.com
marketingvici.com livingcanarias.com
mediafresh.online m.b00kmarks.com
medizinreisen.de mackeeper-center.club
megaapteka.ru mall.uk
memberty.com maridan.com.ua
message-warning.net me-ke.com
mezaruk.info meetlocalchicks.com
michaelkorsoutletstore.net menstennisforums.com
mir-limuzinov.ru mere.host.sk
mmostrike.ru mojpregled.com
moneymaster.ru motherboard.vice.com
monthlywinners.com moviemail-online.co.uk
mosrif.ru mtmtv.info
moz.com multgo.ru
mug-na-chas-moscow.ru musicvidz.ru
myfreemp3.eu myshopmatemac.com
myonigroup.com namecrumilchlet.tk
myxdate.info narosty.com
naj-filmy24.pl
new-post.tk new-post.tk
officedocuments.net newhairstylesformen2014.com
okayimage.com newsperuse.com
okuos.com nfljerseyscheapbiz.us
onlainbesplatno.ru nhl17coinsforps3.gratisblog.biz
onlineku.com nicovideo.jp
oralsexfilme.net nordvpn.com
ourville.info nufaq.com
partner-pop.men obiavo.net
pc-virus-d0l92j2.pw oecnhs.info
pelfind.me onclickpredictiv.com
perl.dp.ua onlinefilmz.net
pic2fly.com ooo-olni.ru
pl-top.pl osagonline.ru
pl.id-forex.com paleohub.info
poiskzakona.ru panchro.co.uk
popunder.ru pendelprognos.se
pornonik.com perfectplanned.com
pozdrawleniya.ru piccdata.com
prosperent.com picsearch.com
prostitutki-novgoroda.org pictures-and-images.com
psoriasis-file.trade piuminiita.com
quelle.ru pornodojd.ru
rabotaetvse.ru pravoholding.ru
radiodigital.co pshare.biz
referencemoi.com py100.ru
relayblog.com quickbuck.com
rep-am.com quizzitch.net
reversing.cc qwarckoine.com
roznica.com.ua realizmobi.com
ryetaw.com redhotfreebies.co.uk
sadaholding.com renecaovilla.online
sanatorrii.ru renhacklids.tk
saneyes.com replicaclub.ru
scanner-donald.top restaurantlescampi.com
sdi-pme.com ringtonepartner.com
sexkvartal.com rosbalt.com.ua
sextracker.be ruf777.com
sextracker.de russkoe-zdorovie.ru
sherlock.se s1z.ru
shmetall.com.ua sale-japan.com
shop-electron.ru samolet.fr
shymkent.xkaz.org scenarii-1-sentyabrya.uroki.org.ua
sdrescher.net
searchencrypt.com
sell-fb-group-here.com
semaltmedia.com
semp.net
seoboxes.com
seoholding.com
sexad.net
sexvporno.ru
shop.acim.org
sigmund-freud.co.uk
simul.co simul.co
siteimprove.com sivs.ru
skyway24.ru smartadserver.com
slayerlife.com smsactivator.ru
sloopyjoes.com socialmediasuggest.com
small-game.com softwaretrend.net
spywarenuker.com space-worry.ml
strfls.com students-cheapskate.ml
stroy-portal22.ru susanholtphotography.com
sugarlyflex.pw swinger-mobil.net
svtrd.com swinon.site
tamada69.com swiped.su
teastory.co tacbibirfa.tk
telemetryverification.net tanieaukcje.com.pl
thecoral.com.br taqplayer.info
thetoiletpaper.com teenporn18.net
thewomenlife.com thaisamkok.com
tilido.com thetardistimes.ovh
titangel-vietnam.com titan-ads.life
tizanidinedosageforsleep.blogspot.com tizanidineinteractions.blogspot.com
tizanidineoral.blogspot.com tizanidinenarcotic.blogspot.com
tizanidinevsvalium.blogspot.com topmira.com
topquality.cf track112.site
topvidos.ru
torture.ml
toursmaps.com
track2.shop
trafficjunky.com trafficjunky.com
trahic.ru traffictrade.life
tramadolandtizanidine.blogspot.com trailer.cinemaflix.website
tsyndicate.com trkdf.com
ttsq.fr turizmus.us
tvand.ru twittruth.com
uni.me typimga.pw
urengoy.pro unmaroll.ya.ru
urlcut.ru validccseller.com
urlopener.blogspot.com.au validdomain.xyz
uroki.net valmetrundan.se
uzungil.com varikoz24.com
varbergsvind.se vodaodessa.com
vbabule.net vse-pesni.com
vintontech.info wardreapptokone.tk
vip-parfumeria.ru weblo.com
voloomoney.com webscouter.net
warningzscaler.heraeus.com whatistizanidine2mg.blogspot.com
webcamtalk.net winner7777.net
wejdz-tu.pl worldmusicfests.com
wesharepics.info www.event-tracking.com
westsextube.com xchangetrak.com
wildworld.site xn----7sbahjd3btneuw1joc.xn--p1ai
womensplay.net xn----8sbhefaln6acifdaon5c6f4axh.xn--p1ai
www.ehscloud.cn xn--1-8sbcpb0bdm8k6a.xn--p1ai
x-rates.ru xn--80aanaardaperhcem4a6i.com
xn----7sbbahaq9bb5afgiqfliv4m.xn--p1ai xn--d1acah0c.xn--p1ai
xxart.ru xpresscare.ru
yatrk.xyz xvideosbay.com
yottos.com y8games-free.com
ynymnwbm.bloger.index.hr
youdao.com youdao.com
yugo-star.ru yuarra.pluto.ro
zajm-zalog-krasnodar.ru zajm-pod-zalog-nedvizhimosti.ru
zeroredirect11.com zastroyka.org
zhongwenlink.com zionstar.net
zigzog.ru zoosexart.com
zona-aqua.ru zskdla.site
zoolubimets.ru
zoomovies.org
zytpirwai.net

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.92 0; 10.1.0.44 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2021.08.2508 ### Version: V4.2021.08.2509
### Updated: Sat Aug 7 11:01:17 UTC 2021 ### Updated: Sat Aug 7 22:01:08 UTC 2021
### Bad Bot Count: 618 ### Bad Bot Count: 618
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2021.08.2508 ### Version: V4.2021.08.2509
### Updated: Sat Aug 7 11:01:17 UTC 2021 ### Updated: Sat Aug 7 22:01:08 UTC 2021
### Bad Bot Count: 618 ### Bad Bot Count: 618
################################################### ###################################################
### Version Information ## ### Version Information ##