vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-05 12:09:57 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2022.10.3401 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2022-10-10 10:09:33 +00:00
parent 4049034473
commit df3acda9ae
46 changed files with 92708 additions and 92708 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.10.3400 #### Version: V4.2022.10.3401
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.10.3400 #### Version: V4.2022.10.3401
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -14,7 +14,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2022.10.3400 #### Version: V4.2022.10.3401
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

11452
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2022.10.3400 #### Version: V4.2022.10.3401
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

11456
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

11456
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

11456
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

11456
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.150 1; 10.1.0.86 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.150 0; 10.1.0.86 0;
127.0.0.1 0; 127.0.0.1 0;

11456
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.150 1; 10.1.0.86 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.150 0; 10.1.0.86 0;
127.0.0.1 0; 127.0.0.1 0;

11456
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.150 1; 10.1.0.86 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.150 0; 10.1.0.86 0;
127.0.0.1 0; 127.0.0.1 0;

11456
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
3400 3401

11456
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

11456
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.9.48.53 0; 20.232.101.218 0;

11456
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.150 1; 10.1.0.86 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.150 0; 10.1.0.86 0;
127.0.0.1 0; 127.0.0.1 0;

11456
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.150 1; 10.1.0.86 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.150 0; 10.1.0.86 0;
127.0.0.1 0; 127.0.0.1 0;

11456
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.150 1; 10.1.0.86 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.150 0; 10.1.0.86 0;
127.0.0.1 0; 127.0.0.1 0;

11456
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.9.48.53 0; 20.232.101.218 0;

11456
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.9.48.53 0; 20.232.101.218 0;

11456
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.150 1; 10.1.0.86 1;
127.0.0.1 1; 127.0.0.1 1;

18
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
AllSubmitter BackDoorBot
Cosmos CheTeam
Moblie Safari DnBCrawler-Analytics
Octopus EroCrawler
OpenLinkProfiler
OpenVAS
PageAnalyzer
PictureFinder PictureFinder
SBIder SalesIntelligent
tAkeOut Sosospider
Steeler
Turingos
VelenPublicWebCrawler

320
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
01h4x.com
360Spider
404checker 404checker
404enemy ADmantX
ALittle Client AIBOT
ASPSeek Acunetix
Abonti AllSubmitter
Aboundex
AfD-Verbotsverfahren
AhrefsBot
AiHitBot
Alligator Alligator
Anarchy Aspiegel
Apexoo
Asterias Asterias
Attach
BDCbot BDCbot
BDFetch BDFetch
BackDoorBot BackStreet
BacklinkCrawler BackWeb
Badass Backlink-Ceck
Barkrowler Bigfoot
BatchFTP Bitacle
Battleztar Bazinga BlackWidow
Blow Blackboard
BlowFish BlowFish
Bolt Boardreader
Brandprotect Brandwatch
CATExplorador BuiltWith
CCBot BunnySlippers
CSHttp CazoodleBot
Calculon Cegbfeieh
ChinaClaw CensysInspect
Chlooe CheTeam
CheeseBot
Claritybot Claritybot
Cloud mapping
Cocolyzebot Cocolyzebot
Cogentbot Collector
Copier
CopyRightCheck CopyRightCheck
Copyscape Copyscape
Crawling at Home Project Craftbot
CrazyWebCrawler CrunchBot
Crescent
DBLBot
DIIbot DIIbot
DatabaseDriverMysqli DataCha0s
Devil Devil
Dirbuster DigitalPebble
DnBCrawler-Analytics Disco
Discoverybot
DnyzBot
DomCopBot DomCopBot
DomainAppender DomainAppender
DomainStatsBot DomainSigmaCrawler
Domains Project EMail Wolf
EMail Siphon Ecxi
Evil EroCrawler
ExtractorPro Exabot
Express WebPictures
Extractor
FDM FDM
FHscan FemtosearchBot
Freeuploader Fimap
Firefox/7.0
Foobot
FyberSpider FyberSpider
G-i-g-a-b-o-t
Genieo Genieo
GermCrawler GermCrawler
GetRight GetWeb
Getintent Getintent
Go!Zilla Go-Ahead-Got-It
Gotit Gotit
Grabber Grabber
Grafula
GrapeFX
GridBot
HEADMasterSEO
HMView HMView
HTMLparser
HTTP::Lite HTTP::Lite
HaosouSpider HTTrack
Harvest Haansoft
Havij
Heritrix
Hloader
Humanlinks
IDBTE4M
IRLbot IRLbot
Id-search
IlseBot
Image Fetch Image Fetch
Image Sucker Indy Library
IndeedBot
InfoNaviRobot InfoNaviRobot
InterGET InterGET
Iskanie Iria
JOC Web Spider JOC Web Spider
JamesBOT JetCar
Jbrofuzz Joomla
Jorgee Keyword Density
Jyxobot Kozmosbot
Keybot Translation-Search-Machine
Kinza
LWP::Simple
Lanshanbot
Larbin Larbin
Leap LexiBot
Lftp
LibWeb LibWeb
Lightspeedsystems
LinkWalker LinkWalker
Lipperhey Spider Lmspider
Ltx71 Ltx71
MIIxpc MQQBrowser
MTRobot
Mag-Net
Magnet Magnet
Majestic-SEO
Majestic12 Majestic12
MarkMonitor Mass Downloader
MarkWatch
Mata Hari
Mb2345Browser
MeanPath Bot
Meanpathbot
Mediatoolkitbot Mediatoolkitbot
Metauri MegaIndex.ru
MicroMessenger Microsoft Data Access
Minefield Minefield
Moblie Safari Moblie Safari
Morfeus Fucking Scanner MolokaiBot
Mozlila Mozlila
NICErsPRO Musobot
NPbot Name Intelligence
Nameprotect
Navroad Navroad
NearSite NearSite
Needle
Net Vampire Net Vampire
Netvibes NetAnts
Nimbostratus Netcraft
Nibbler
Nikto
NimbleCrawler
Ninja Ninja
Not
Nuclei Nuclei
Octopus Nutch
Offline Explorer
Offline Navigator Offline Navigator
OnCrawl OpenVAS
Openfind OutclicksBot
Openvas
OutfoxBot OutfoxBot
PageAnalyzer PECL::HTTP
Page Analyzer
PageGrabber
PageScorer PageScorer
PageThing.com
Pandalytics
Panscient Panscient
Picscout Petalbot
Pimonster Pi-Monster
ProPowerBot Picsearch
PictureFinder
PleaseCrawl
Pockey
ProWebWalker ProWebWalker
Probethenet Probethenet
Psbot Pu_iN
PyCurl
QueryN Metasearch
RSSingBot RSSingBot
RankActive RankingBot2
Re-re
ReGet
Reaper
RebelMouse RebelMouse
RedesScrapy RedesScrapy
RepoMonkey Ripper
RocketCrawler
Rogerbot Rogerbot
SEOkicks
SEOkicks-Robot SEOkicks-Robot
ScreenerBot SalesIntelligent
ScrepyBot Searchestate
SearchmetricsBot
Seekport
Semrush
SemrushBot
SeoSiteCheckup
SeobilityBot SeobilityBot
Shodan Siphon
SiteCheckerBotCrawler SiteCheckerBotCrawler
SiteExplorer SiteLockSpider
Sitebeam
Siteimprove
Sitevigil
SlySearch
Snake
Snapbot
Snoopy
SocialRankIOBot
Sogou web spider Sogou web spider
Sottopop Sosospider
Spammen Spammen
Spinn3r Spinn3r
SputnikBot
Sqlmap
Sqlworm Sqlworm
Sqworm
Steeler Steeler
Sucuri Sucuri
SuperHTTP SuperBot
Swiftbot TightTwatBot
Szukacz Toata
T8Abot
Telesphoreo
Telesphorep
The Intraformant
Toweyabot
Trendiction Trendiction
Trendictionbot Trendictionbot
Turingos Turnitin
TurnitinBot
Twice Twice
URLy Warning Typhoeus
URLy.Warning V-BOT
Upflow
VB Project
VCI
Vacuum
Vagabondo Vagabondo
VelenPublicWebCrawler VelenPublicWebCrawler
VeriCiteCrawler Virusdie
VidibleScraper
VoidEYE VoidEYE
Voltron Voltron
WASALive-Bot WEBDAV
WBSearchBot
WWW-Collector-E WWW-Collector-E
WWW::Mechanize WWWOFFLE
Wallpapers/3.0 Wallpapers/3.0
WeSEE Web Auto
Web Collage Web Enhancer
Web Fuck
Web Pix
Web Sauger Web Sauger
WebAuto WebCopier
WebEnhancer WebEnhancer
WebFetch
WebGo IS
WebImageCollector
WebLeacher WebLeacher
WebReaper WebPix
WebStripper WebSauger
WebSucker WebSucker
WebWhacker WebWhacker
Webalta
WebmasterWorldForumBot WebmasterWorldForumBot
Webshag
Whack Whack
Whacker Whatweb
Widow Widow
WinHTTrack Wonderbot
WiseGuys Robot Woobot
Wprecon
Xaldon WebSpider Xaldon WebSpider
Xaldon_WebSpider
Xenu
YoudaoBot
Zade Zade
Zauba Zeus
Zitebot
ZmEu
ZoomBot ZoomBot
ZoominfoBot
ZumBot
adscanner
arquivo-web-crawler arquivo-web-crawler
autoemailspider
backlink-check backlink-check
check1.exe clark-crawler
crawler.feedback coccocbot
com.plumanalytics
crawl.sogou.com
crawler4j
dataforseo.com
demandbase-bot
eCatch
facebookscraper
gopher gopher
linkdexbot internetVista monitor
lwp-trivial ips-agent
magpie-crawler magpie-crawler
mediawords mediawords
muhstik-scan pcBrowser
ripz probe-image-size
satoristudio.net
scan.lol
seoscanners seoscanners
seostar
serpstatbot serpstatbot
siteripz sexsearcher
sogouspider webgains-bot
ubermetrics-technologies.com webpros.com
x09Mozilla
x22Mozilla x22Mozilla
zauba.io xpymep1.exe
zgrab

304
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
01h4x.com 360Spider
404checker 404checker
80legs 404enemy
ADmantX AIBOT
ASPSeek ALittle Client
Abonti Abonti
Alligator AllSubmitter
Anarchie Aspiegel
Anarchy Atomseobot
Anarchy99
Ankit
Attach Attach
AwarioRssBot AwarioRssBot
AwarioSmartBot AwarioSmartBot
BDCbot
BLEXBot
BackWeb
Backlink-Ceck
BacklinkCrawler BacklinkCrawler
BetaBot Badass
Blow Bandit
BlowFish BatchFTP
Boardreader Boardreader
BotALot Brandprotect
Brandwatch Buck
BuiltBotTough
Bullseye
BunnySlippers
BuzzSumo
CCBot CCBot
CensysInspect Calculon
Chlooe CheTeam
Claritybot ChinaClaw
Cloud mapping
Copier Copier
CopyRightCheck CyotekWebCopy
Craftbot DIIbot
Crawling at Home Project Demon
CrazyWebCrawler Discoverybot
DataCha0s DittoSpyder
DigitalPebble DnyzBot
Dirbuster
Disco
DnBCrawler-Analytics
DomCopBot
DomainAppender DomainAppender
DomainCrawler
Dotbot Dotbot
Download Wonder Download Wonder
Drip Drip
ECCP/1.0 ECCP/1.0
EMail Siphon EMail Siphon
EirGrabber EasyDL
Evil Ecxi
Exabot Express WebPictures
ExtLinksBot ExtractorPro
Extractor EyeNetIE
Ezooms
FDM FDM
FHscan
Fimap
Firefox/7.0
Flunky
Foobot Foobot
Fuzz Fyrebot
G-i-g-a-b-o-t GetRight
GermCrawler
GetWeb
Go-Ahead-Got-It Go-Ahead-Got-It
Gotit Grabber
GrabNet
Grafula Grafula
GrapeFX GridBot
HMView Harvest
HTTP::Lite Havij
HTTrack Hloader
Haansoft HonoluluBot
IDBTE4M
Iblog Iblog
Image Fetch IlseBot
Image Sucker Image Sucker
InfoNaviRobot InfoTekies
InterGET InterGET
Internet Ninja Internet Ninja
InternetSeer
Iskanie
JOC Web Spider JOC Web Spider
Jbrofuzz JamesBOT
JennyBot JikeSpider
JustView
Jyxobot Jyxobot
Kenjin Spider
Keybot Translation-Search-Machine Keybot Translation-Search-Machine
Keyword Density
Kinza
LWP::Simple
Larbin Larbin
LexiBot LeechFTP
Lftp
LieBaoFast LieBaoFast
Likse Likse
LinkWalker LinkScan
Linkbot LinqiaMetadataDownloaderBot
LinkextractorPro
LinkpadBot
LinqiaRSSBot LinqiaRSSBot
Lipperhey
Lipperhey Spider Lipperhey Spider
Lmspider Litemage_walker
MIDown tool MIDown tool
MIIxpc MIIxpc
MJ12bot MJ12bot
MQQBrowser
MTRobot MTRobot
Mag-Net Mag-Net
Magnet Majestic SEO
Mail.RU_Bot MarkMonitor
Masscan Mass Downloader
Metauri MeanPath Bot
Microsoft Data Access Mediatoolkitbot
Microsoft URL Control Microsoft URL Control
Minefield
Moblie Safari
Mojolicious Mojolicious
Mr.4x3 Musobot
Name Intelligence NPbot
Navroad NearSite
NetAnts Needle
Nettrack Nessus
NetLyzer
Netvibes Netvibes
NextGenSearchBot NextGenSearchBot
Nikto Nibbler
NimbleCrawler Nimbostratus
Ninja Ninja
Nmap
Not
Nuclei Nuclei
Octopus Octopus
OutclicksBot OpenVAS
OutfoxBot PECL::HTTP
PHPCrawl
POE-Component-Client-HTTP
PageAnalyzer PageAnalyzer
PageGrabber PageGrabber
PageScorer
PageThing.com PageThing.com
Panscient Papa Foto
Pavuk Pavuk
PeoplePal Picscout
Pi-Monster Picsearch
Pixray PictureFinder
PleaseCrawl Piepmatz
Pimonster
Probethenet Probethenet
Psbot Pu_iN
Pump
PxBroker PxBroker
RankActive PyCurl
QueryN Metasearch
Quick-Crawler
RankActiveLinkBot RankActiveLinkBot
RankFlex
RankingBot RankingBot
RankingBot2 RankingBot2
Rankivabot Rankivabot
RankurBot Re-re
ReGet ReGet
RedesScrapy Reaper
RepoMonkey
Ripper
RocketCrawler
Rogerbot Rogerbot
SBIder SBIder
SEOkicks-Robot SEOkicks-Robot
SEOlyticsCrawler
SEOprofiler SEOprofiler
SEOstats SISTRIX
ScanAlert SMTBot
Scanbot
Scrapy Scrapy
Screaming ScrepyBot
ScreenerBot Searchestate
SearchmetricsBot SearchmetricsBot
SemanticJuice
Semrush Semrush
SentiBot SemrushBot
SeoSiteCheckup Shodan
Siphon
Site Sucker Site Sucker
SiteLockSpider SiteExplorer
SiteSnagger
Sitebeam Sitebeam
Siteimprove
SlySearch SlySearch
SmartDownload
Snoopy
SocialRankIOBot SocialRankIOBot
Sogou web spider Sociscraper
SpankBot Sottopop
Spanner Spanner
Spbot Spbot
SputnikBot Spinn3r
Sqlmap
Sqworm
Stripper Stripper
SuperBot Sucuri
SurveyBot
Suzuran Suzuran
T0PHackTeam Swiftbot
Telesoft T8Abot
Teleport
Telesphorep Telesphorep
Thumbor
TightTwatBot TightTwatBot
Titan Toata
Toweyabot Turnitin
Tracemyfile TwengaBot
Trendictionbot Twice
True_Robot
Typhoeus Typhoeus
URLy.Warning VB Project
UnisterBot
Upflow
V-BOT
VCI
Vagabondo Vagabondo
Voltron Virusdie
WASALive-Bot
WEBDAV
WISENutbot WISENutbot
WPScan WPScan
WWW-Collector-E
Wallpapers/3.0
WallpapersHD WallpapersHD
WeSEE
Web Auto
Web Collage Web Collage
Web Fuck
Web Pix
Web Sauger Web Sauger
Web Sucker WebEnhancer
WebFetch
WebFuck WebFuck
WebImageCollector WebImageCollector
WebLeacher WebZIP
Webalta
Website Quester
WebsiteExtractor WebsiteExtractor
WebsiteQuester WebsiteQuester
Whacker Whacker
Whatweb Whatweb
Widow Widow
WinHTTrack
WiseGuys Robot WiseGuys Robot
Wotbox Xaldon WebSpider
Wprecon Xenu
Zauba YoudaoBot
Zitebot ZoomBot
archive.org_bot ZyBorg
arquivo.pt arquivo.pt
autoemailspider
backlink-check backlink-check
cah.io.community clark-crawler
com.plumanalytics coccocbot
cognitiveseo
crawl.sogou.com crawl.sogou.com
crawler.feedback
crawler4j
dataforseo.com
demandbase-bot demandbase-bot
domainsproject.org
eCatch
evc-batch evc-batch
heritrix internetVista monitor
ips-agent
isitwp.com isitwp.com
iubenda-radar
linkdexbot linkdexbot
lwp-request lwp-trivial
oBot meanpathbot
page scorer muhstik-scan
netEstate NE Crawler
probe-image-size probe-image-size
scalaj-http ripz
scan.lol s1z.ru
satoristudio.net
seobility
seocompany.store seocompany.store
seoscanners seoscanners
webmeup-crawler sexsearcher
spyfu
tAkeOut
trendiction.com
trendiction.de
ubermetrics-technologies.com
voyagerx.com
webprosbot webprosbot
x09Mozilla
x22Mozilla x22Mozilla
zauba.io xpymep1.exe

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
alert-fjg.xyz acc.eu.org
bdsmgalls.net cenokos.ru
bum.com.ru extlinks.com
buybest1.biz galeria-zdjec.com
gazporno.com ipchicken.com
magento-crew.net kopihijau.info
nerudlogistik.ru pijoto.net
s.lollypopgaming.com playfortuna-play.ru
sinel.info prizestohandle.club
tovaroboom.vast.ru ticketsys.inetwd.com

928
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
007angels.com 1008.su
11235813.webzdarma.cz 123kuma.com
1kdailyprofit.me 18ps.ru
1millionusd.xyz 3rbseyes.com
2015god.org 4ureyesonly.com
24videos.tv 4webmasters.org
2girls1cup-free.com 51.la
3-letter-domains.net 7fon.ru
51unlim.ru actionnooz.com
55wmz.ru adamoads.com
5elementov.ru adrenalin-stk.ru
5ws.dating-app.ru adrunnr.com
a14download.com adultmeetonline.info
abusora.com advancedcleaner.com
accessoires-mode.in advertex.info
actulite.com aero2.ru
admeasures.com akita.kz
adpremium.org alborzan.com
akvamaster.dp.ua alert-fdm.xyz
alarmobninsk.ru alienwheels.de
ald2014.org alive-ua.com
alfa-img.com allboard.xobor.de
allpdfmags.net amazingninja.com
allwidewallpapers.com amazon-adsystem.com
aosexkontakte.net ameblo.jp
apartmentbay.ru ameblo.top
apimossnetinfo-a.akamaihd.net anal-acrobats.com
apiwoodensealcom-a.akamaihd.net anaseracresar.tk
arendakvartir.kz anniemation.com
asiavirtualsolutions.com anticrawler.org
asiengirls.net appsaurus.com
asrvrep-a.akamaihd.net apxeo.info
asseenontvonline.ru atley.eu.pn
atleticpharm.org autolombard-krasnodar.ru
atofilms.com aviav.co
azazaporn.com avtoarenda.by
babyfactory.fr avtovolop.ru
backgroundpictures.net awency.com
backlink4u.net b00kmarks.com
baersaratov.ru bannerpower.com
bagcionderlab.com baoxaydung.com.vn
bankcrediti.ru beachtoday.ru
bashtime.ru beauby.ru
beatifullandscape.co best-coupon-offer.com
belsetirehafi.tk
best-deals-products.com best-deals-products.com
best-seo-software.xyz best-games.today
besthomemadepornsites.com bestfortraders.com
bestwaystogetpaid.us bestpornuha.com
betterhdporn.com bestsexyblog.com
bestssaker.com
bget.ru bget.ru
bigpictures.club bharatdefencekavach.com
bingo8888.com bidr.trellian.com
bjanshee.ru bigcareer.info
blackhatworth.com bioca.org
blogporn.in biocn.dx.am
blogrankers.com blog.koreadaily.com
bmw.afora.ru bmw.afora.ru
bocoarchives.org boc.kz
bonzybuddy.com bonux.nextview.ru
bookmark4you.com.biz boom-celebs.com
brakehawk.com
brandedleadgeneration.com
brianhenry.co brianhenry.co
brothers-smaller.ru bryansk.zrus.org
bscodecs.com budpost.com.ua
btnativenav.com buttons-for-your-website.com
bumskontakte.org buy-meds24.com
bus-offer.com buypillsorderonline.com
businesxxl.com callejondelpozo.es
buypuppies.ca camsex.xxx-cam.webcam
buyscabiescream.com cartierlove2u.com
bvlgaribracelet.xyz cbox.ws
bvlgariwallet.xyz cenoval.ru
bycontext.com cfcl.co.uk
cablecar.us changde.58.com
calvet.altervista.org checkm8.com
candypeople.se checkpagerank.net
capacitacionyaprendizaje.com chinaelitecheapjerseys.com
carabela.com.do cialischmrx.com
carsdined.org
cartechnic.ru
cartierjusteunclou.xyz
cartiertrinity.xyz
cdn.walkme.com
celebsopics.com
cheap-trusted-backlinks.com
cheapbarbour.online
cheapestjerseysonwholesale.com
cheapmarmot.online
chee-by.biz
chocolateslim-u-srbiji.com
cialischsrx.com
cialisndbrx.com
cjmc.info cjmc.info
classicakuhni.ru click2pawn.com
cleanersoft.com
clickaider.com clickaider.com
cmd.kz coccoc.com
collegerentals.com compliance-jack.top
compliance-alex.top compliance-john.top
connectingsingles.com computernetworksonline.com
cookie-law-enforcement-hh.xyz creatives.adbetclickin.pink
cool-wedding.net culturevie.info
coolbar.pro cutt.us
cordstrap.cc damasarenai.info
cosmetic.donna7753191.ru data-ox.com
cosmeticswomens-womensports.rhcloud.com data.vtc.pw
cottageofgrace.com datadepths.com
cracksplanet.com dawlenie.com
cranly.net
credit-online.ws
creditnation.ru
customcollegeessays.net
cypernhuset.se
dailystrength.org
daptravel.com
datract.com
daydream-studio.ru daydream-studio.ru
decorazilla.com detmebel.su
dellalimov.com detsky-nabytek.info
dengi-pod-zalog-nedvizhimosti.ru digital-video-processing.com
detki-opt.ru dividendo.ru
detoxmed24.ru dneprsvet.com.ua
dev33.dioniqlabb.se dogsrun.net
dickssportinggoods.com
dinosaurus.site
diusyawiga.tk
div.as
divisioncore.com
dktr.ru
dollartree.info dollartree.info
domainroam.win domaineaneblanc.com
doxysexy.com dotmass.top
draniki.org download-of-the-warez.blogspot.com
drupa.com download-wallpaper.net
dumpsmania24.com downloads-whatsapp.com
drugstoreforyou.com
dvd-famille.com
e-c.al
e-collantes.com
e-poker-2005.com
earl-brown.info earl-brown.info
easytuningshop.ru earncash.com.ua
ebooknovel.club ekosmetyki.net.pl
ec-file.info elektrischezi.canalblog.com
ecookna.com.ua elektronischezi.livejournal.com
education-cz.ru elidelcream.weebly.com
egovaleo.it elkacentr.ru
eldiariodeguadalajara.com elstal.com.pl
elektrischezigarette2.devhub.com enthuse.computernetworksonline.com
elektronischezigarettekaufen1.beeplog.com erotikchat-24.com
elvenar.com erotiktreff24.info
enskedesquashclub.se etotupo.ru
eorogo.top etur.ru
euromasterclass.ru eu-cookie-law.info
extlinks.com europeanwatches.ru
extrabot.com euroskat.ru
ezigarettekaufen.myblog.de exdocsfiles.com
ezigarettenkaufen1.deviantart.com executehosting.com
ezrvrentals.com exoneration-project.us
favorcosmetics.com ezigarettenshop1.yolasite.com
faz99.com f00kclan.de
feorina.ru failingmarriege.blogspot.com
fetlifeblog.com faithe.top
fidelityfunding.com faracontrol.ir
filesclub.net fatmaelgarny.com
filesdatabase.net feel-planet.com
fillmewithhappiness.com fenoyl.batcave.net
filmetricsasia.com filmetricsasia.com
filmgo.ru fishtauto.ru
fireads.men flavors.me
fitfloponline.store flooringinstallation-edmonton.com
flash4fun.com
flex4launch.ru
foodgid.net
forex-indextop20.ru forex-indextop20.ru
formulaantiuban.com forexgb.ru
fortevidyoze.net forumprofi.de
foto-basa.com freewareseek.com
fototravel.eu freewebs.com
fotzen-ficken.com fungirlsgames.net
fr.netlog.com fx-brokers-review.com
franecki.net
free-laptop-reward.com
free-share-buttons.com
free411games.com
freelifetimefuckbook.com
front.to
fullgirl.ru
fxund.us
fyxabomiw.ru
gael-s.ru gael-s.ru
game300.ru
gay-file.com
gelezki.com gelezki.com
gemgrab-a.akamaihd.net
gentamicineyedrops.blogspot.com
gepezz.info gepezz.info
germetiki.com.ua
get-free-social-traffic.com
getdot.ru getdot.ru
gk-atlant.info getmyads24.com
glopages.ru ghernnqr.skyrock.com
go2album.com goldadpremium.com
golfresa.lucania.se gombita.info
gopixdatabase.com
gorodservis.ru
gox.com.ua gox.com.ua
greatgrace.ru graphid.com
greendream.com.ua greenzaim.ru
grtyi.com gribokstop.com
habermetre.com gsasearchengineranker.space
happy.new.yeartwit.com gsmlab.pl
hatdc.org gsmtlf.ru
haveinc.xyz gta-top.ru
hazardky.net hacktougroup.ru
hermesreplica.win hatedriveapart.com
histats.com havepussy.com
historichometeam.com hdseriale.pl
hoporno.com healgastro.com
hostsshop.ru hitsbox.info
hotblog.top hmywwogw.bloger.index.hr
hotcore.info homegardenlova.com
hotshoppymac.com host-protection.com
hotsocialz.com hostcritique.com
housediz.com housemilan.ru
howmuchdoestizanidinecost.blogspot.com hoverboard360.se
ilo134uloh.com hulfingtonpost.com
imediadesk.com hybrid.ru
imfamous.info hydropump.su
inbabes.sexushost.com ideawheel.com
inboxdollars.com igithab.com
inclk.com igrovyeavtomaty777.ru
intervsem.ru igtools.club
investyb.com ihtec2019.org
iskalko.ru ilovevitaly.ru
islamtoday.co.za ilte.info
itag.pw imguramx.pw
iyasimasennka.com impotentik.com
izoll.ru incest-ru.com
javstock.com incolors.club
jobgirl24.ru internetproviderstucson.com
iptool.xyz
irkutsk.online-podarki.com
je7.us
jetsli.de
jimmychoosale.online
jongose.ninja jongose.ninja
juliaworld.net joy-penguin.com
kakadu-interior.com.ua jpcycles.com
kamen-e.ru kazrent.com
kerei.ru keenoutlet.online
keywords-monitoring-success.com kicknights.gq
kino-ecran.ru kihi.gdn
kinohall.ru kiwi237au.tk
knigonosha.net klosetkitten.com
konturkrasoty.ru kopihijau.info
koopilka.com kraljeva-sutjeska.com
kosynka-games.ru krasnodar.xrus.org
lalalove.ru krasula.pp.ua
landscaping.center kwzf.net
lapitec.eu laptoper.net
lasvegaslockandsafe.com lasvegaslockandsafe.com
layola.biz.tc laxdrills.com
ldrtrack.com leadn.pl
lennatin.info lecbter-relationships.ga
lidoradio.com ledis.top
likesuccess.com lifehacĸer.com
linkbuddies.com likrot.com
linkrr.com lineavabit.it
lisque.batcave.net livetsomudvekslingstudent.bloggersdelight.dk
listiseltemournlan.gq livingcanarias.com
liveshoppersmac.com ljusihus.se
liveu.infoteka.hu lkbennettstore.online
lombia.co locustdesign.co
louisvuittonoutletstore.net louisvuittonoutletstore.net
m1media.net luxup.ru
m4ever.net macdamaged.tech
mafcards.ru madot.onlinewebshop.net
magento-crew.net magnetpress.sk
mainlinehobby.net mail.allnews24.in
makis.nu mailemedicinals.com
manualterap.roleforum.ru marcogrup.com
map028.com marcowebonyodziezowe.pl
mature.free-websites.com marktforschung-stuttgart.com
medanestesia.ru marwer.info
meddesk.ru matsdale.com
megaapteka.ru mcadamssupplyco.com
megakino.net medicine-4u.org
metalonly.info mejoresfotos.eu
metaxalonevstizanidine.blogspot.com members.ghanaweb.com
meteocast.net mesbuta.info
michaelkorsoutletstore.net mhi-systems.ru
mindeyegames.com minegam.com
minyetki.ru mixtapetorrent.com
misswell.net mobile-appster.ru
mobilierland.com moesen-ficken.com
modenamebel.ru mokrayakiska.com
moetomnenie.com monitorwebsitespeed.com
moneyteam24.com moviezbonkerssk.cf
moxo.com moyakuhnia.ru
mrbojikobi4.biz mturkcontent.com
mrinsidesales.com multgo.ru
musicas.baixar-musicas-gratis.com
musicpro.monster
mustwineblog.com mustwineblog.com
muz-shoes.ru muzaporn.com
my-floor.in.ua mycouponizemac.com
myfreemp3.eu mystats.xyz
myphotopipe.com nagdak.ru
myxdate.info nailsimg.com
narutonaruto.ru navalwiki.info
nbsproject.ru noclegonline.info
needtosellmyhousefast.com nordstar.pro
netvouz.com nordvpn.com
new-apps.ru obiavo.by
new7ob.com obiavo.uz
news-readers.ru oda.as
nextlnk12.com oecnhs.info
nicovideo.jp offergroup.info
nikitabuch.com onlinadverts.com
nofreezingmac.click onlinemegax.com
normalegal.ru onlywoman.org
notfastfood.ru ontargetseo.us
novgorod.xrus.org ooo-gotovie.ru
ntic.fr opinionreelle.com
nyfinance.ml otbelivanie-zubov.com
nzfilecloud.weebly.com ownshop.win
o-o-11-o-o.com painting-planet.com
obiavo.net palocco.it
omsk.xrus.org partner-cdn.men
onclickpredictiv.com partner-pop.men
oneclickfiles.com pastaleads.com
orgasmatrix.com pateaswing.com
outpersonals.com pay2me.pl
pandroid.co pc-virus-d0l92j2.pw
peekyou.com pdfprof.com
pdns.cz
pepperstyle.ru pepperstyle.ru
photorepair.ru perso.wanadoo.es
pic2fly.com pestomou.info
pixelrz.com photochki.com
play-mp3.com pictures-and-images.net
plaff-go.ru
playmsn.com playmsn.com
pochtovyi-index.ru pontiacsolstice.info
polytopesexempt.com popup-fdm.xyz
pomoc-drogowa.cba.pl popup-hgd.xyz
pornhub-ru.com porn555.com
pornoklad.ru porndroids.com
pornolook.net porno-play.net
pornotubs.com pornofeuer.com
pornpost.in pricheskaonline.ru
porto.abuilder.net produkto.net
potolokelekor.ru projefrio.com.br
pozdravleniya-c.ru prokotov.com
pozvonim.com proprostatit.com
predmety.in.ua
primedice.com
priora-2.com
prizeestates.cricket
prodess.ru
profitkode.com
promgirldresses.xyz
pronorm.fr
prostitutki-odessa.org prostitutki-odessa.org
prostitutki-rostova.org purchasepillsnorx.com
prostitutki-tyumeni.org purplesphere.in
pskcijdc.bloger.index.hr qld10000.net
quality-traffic.com qpypcx.com
quangcaons.com
queerspace.com
questionmarque.ch questionmarque.ch
rangoman.date quick-seeker.com
rankexperience.com rainbowice.ru
rapidsites.pro rapidokbrain.com
redirlock.com recipedays.com
referencemoi.com redbottomheels.xyz
registratciya-v-moskve.ru redirect.trafficreceiver.club
rennlist.com regdefense.com
remorcicomerciale.ro
remote-dba.de
rentaremotecomputer.com
resant.ru
responsinator.com responsinator.com
respublica-otel.ru resultshub-a.akamaihd.net
restaurantlescampi.com rewardpoll.com
ribieiendom.no reyel1985.webnode.fr
rique.host.sk rezeptiblud.ru
rosbalt.com.ua rfid-locker.co
russintv.fr riders.ro
s.lollypopgaming.com rockprogblog.com
saecsa.co roleforum.ru
saitevpatorii.com roofers.org.uk
salut-camp.ru ru-mediaget.ru
santechnik.jimdo.com running-line.ru
saveriopiazza.it safe-app.net
sanidumps.com
sarm.tk
sc-specialhost.com
scanner-alexa.top
scanner-jack.top
scanner-julianna.top
scanner-margo.top scanner-margo.top
scanner-mark.top scanner-nelson.top
schlampen-treffen.com scanner-walt.top
sdi-pme.com scanner-walter.top
search.alot.com school-diplomat.ru
securityallianceservices.com schoolfiles.net
see-your-website-here.com scrapy.org
seemoreresultshu-a.akamaihd.net seansonline24.pl
sendearnings.com search.1and1.com
service.adtech.us semp.net
sevendays.com.ua semprofile.com
seo-traffic-ranking.info
seokicks.de
sex-tracker.de sex-tracker.de
sharebutton.net sexobzor.info
shijian.ac.cn sexstream.pl
shillyourcoins.com sextracker.be
shop.xz618.com sexy-pings.com
shopwme.ru sexy-screen-savers.com
sharebutton.to
shareyards.com
shop.acim.org
shoppingmiracles.co.uk
shymkent.xkaz.org shymkent.xkaz.org
sideeffectsoftizanidine.blogspot.com silverage.ru
siteaero.com simul.co
skypasss.com sitebeam.net
skytraf.xyz sitevaluation.com
slowmacfaster.trade sitevalued.com
snowplanes.com sk.golden-praga.ru
soviet-portal.do.am smailik.org
space-worry.ml smart-scripts.com
space4updating.win snjack.info
spl63.fr snomer1.ru
staticfs.host soblaznu.net
statoutlook.info socialbookmarksubmission.org
stoki.ru socialmadesimple.com
stopnarco.ru sofit-dmd.ru
subj.ukr-lit.com softwaretrend.net
sugarkun.com solmarket.by
supermama.top spb.ru
svnuppsalaorebro.se spywarenuker.com
tdsing.ru spywarespy.com
techart24.com standardchartered-forex.com
telefonsex-ohne0900.net stroymonolit.su
terrafootwear.us strv.se
thedownloadfreeonlinegames.blogspot.com stuffpride.com
thegolfclub.info suchenindeutschland.com
themeforest.net sugarlyflex.pw
thin.me.pn superiends.org
ticketsys.inetwd.com surffoundation.nl
suture.co
swinger-mobil.net
tabletkinaodchudzanie.com.pl
tandvardshuset.net
tastyfoodideas.com
thedownloadfromwarez.blogspot.com
tiens2010.ru
tilido.com tilido.com
time-japan.ru timeallnews.ru
timetorelax.biz
timhost.ru timhost.ru
tizanidine4mgstreetvalue.blogspot.com tizanidineforopiatewithdrawal.blogspot.com
tizanidinecapsules.blogspot.com tizanidineorflexeril.blogspot.com
tizanidinehclsideeffects.blogspot.com tizanidinesideeffectsweightloss.blogspot.com
tizanidineoral.blogspot.com tooplay.com
tizanidinepain.blogspot.com topcar-krasnodar.ru
tootoo.to topdownloads.ru
topads.men
torrentdownloadhub.com
torrents.cd torrents.cd
traffic-club.info tour-line.net
trafficmania.com tourismvictoria.com
trafficreceiver.club trackmedia101.com
trainoffend.ml trafaret74.ru
trudogolik.net
trustl.life
tsan.net tsan.net
turbabitload.weebly.com tuckpointingmasonrysystems.com
typimga.pw tx41tclega.ru
uginekologa.com uggsale.online
uhod-za-sobakoj.ru ugguk.online
ultimateclassicrock.com umaseh.com
ultramart.biz umekana.ru
umityangin.net uogonline.com
universals.com.ua urll.eu
upproar.com
uptimechecker.com
url-extractor.xyz
url-img.link
urlopener.com urlopener.com
us-america.ru uroki.net
usbggettwku.ga usacasino.com
uzungil.com v24s.net
vancleefreplica.pw vacuumcleanerguru.com
vclicks.net vedomstvo.net
veselokloun.ru venta-prom.ru
videochat.tv.br via-energy-cumpara.com
videosbox.ru viandpet.com
videospornogratisx.net video-hollywood.ru
vip-dom.in video-woman.com
vip.51.la vielporno.net
vipromoffers.com vita.com.hr
virtuagirl.com viven.host.sk
voloomoney.com vkontaktemusic.ru
volume-pills.biz vladimir.zrus.org
vzlomtw.com voprosotvet24.ru
wallpapers-best.com vseigru.one
warningwar.ru w-journal.ru
watracker.net w3javascript.com
web.cvut.cz walkme.com
website-analyzer.info warningzscaler.heraeus.com
websites-reviews.com wdfdocando.com
weburok.com wdrake.com
westvilletowingservices.co.za weblibrary.win
webmonetizer.net
website-speed-checker.site
whos.amung.us
wikes.20fr.com
winwotgold.pl
wiosenny-bon-1500.pl wiosenny-bon-1500.pl
withstandingheartwarming.com wma-x.com
wnoz.de wnoz.de
wordkeyhelper.com woman-h.ru
works.if.ua wordpresscore.com
worst-sites.online wurr.voila.net
wovis.site ww2awards.info
wzgyyq.com www.888.com
x5market.ru xedserver.com
xboxster.ru xn-----6kcaacnblni5c5bicdpcmficy.xn--p1ai
xmnb.net xn-----7kceclhb4abre1b4a0ccl2fxch1a.xn--p1ai
xn----8sbarihbihxpxqgaf0g1e.xn--80adxhks xn----7sbifcamovvfggw9d.xn--p1ai
xn----8sbdbjgb1ap7a9c4czbh.xn--p1acf
xn----9sbebi2bvzr7h.xn--p1ai xn----9sbebi2bvzr7h.xn--p1ai
xn--e1afanlbnfckd7c3d.xn--p1ai xn----9sbubg3ambdfl1j.xn--p1ai
yginekologa.com xn--24-glceagatoq7c2a6ioc.xn--p1ai
youraticles.pl xn--80aeahghtf8ac5i.xn--p1ai
zaimite.ru xn--80aikhbrhr.net
zapatosenventa.info xn--80aodinpgi.xn--p1ai
zapiszto.pl xn--80atua3d.xn--p1ai
zarepta.com xtubeporno.net
zirondelli.it xxlargepop.com
znakom.sibtest.ru xxxtubesafari.com
znakomstvaonlain.ru yachts-cruise.info
znaniyapolza.ru yadro.ru
zona-aqua.ru yellowproxy.net
zscalerone.net youresponsive.com
zvooq.eu youtoner.it
ypmuseum.ru
yugk.net
zaloro.com
zed21.net
zeroredirect.com
zetmaster.ru
zionstar.net
zog.link
zrizvtrnpale.tk

482
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
108shot.com 00webcams.com
12bet.com 12masterov.com
1flag.co.za 1kdailyprofit.me
1millionusd.xyz
202ch.com 202ch.com
6128786.com 4kplayer.pl
7zap.com 4ur.click
8558l.jobs.net aa08daf7e13b6345e09e92f771507fa5f4.com
acheterviagrafr24.com aac52006ec82a24e08b665f4db2b5013f7.com
acmebtn.ml aad1f4acb0a373420d9b0c4202d38d94fa.com
admatic.com.tr admitad.com
adtiger.tk ads-seo.men
alarmobninsk.ru adtology.com
alf-img.com albuteroli.com
alive-ua.com
alltheviews.com alltheviews.com
alphaforum.ru alpinism.ru
am15.net angkortours.vn
analnoeporno.tv aosexkontakte.net
anapa-inns.ru apibrowsesmartne-a.akamaihd.net
anaseracresar.tk apifasterlightin-a.akamaihd.net
apartmentbay.ru apps-analytics.net
apibatbrowsecom-a.akamaihd.net arabseyes.com
apidiamondatanet-a.akamaihd.net arate.ru
apiluckyleapnet-a.akamaihd.net arcteryxstore.online
atmagroup.ru arewater.com
australia-opening-times.com artavenuegardenstudios.com
autoblogger24.info auspolice.com
autoua.top auto-zapchasti.org
ayodhya.co automatic-seo.com
balkanfarma.ru automobile-spec.com
bannertesting.com avtointeres.ru
bayareaaeroclub.org axbocz.net
beachdriveblog.com ayakino.net
beremenyashka.com bagcionderlab.com
besthomemadepornsites.com baixar-musicas-gratis.com
bfz.biz begalka.xyz
bidbuy.co.kr besthoro.ru
bio.trade-jp.net bestmarriages.com
bioinnovate.co bestssaker.com
bitcoins-live.ru betwinservice.com
bkgr.se bizlist.com.de
blog.axant.it bloggen.be
brewdom.ru blogos.kz
buyparajumpers.online bobba.dzaba.com
callawaygolfoutlet.online boom-celebs.com
candlehandmade.com brainxs.us
cars-modification.net buynorxx.com
cartierlove2u.xyz buzz-porno.info
cdnanalytics.xyz camdenmemorials.com
ceotrk.com candelluxsklep.pl
check-this-out-now.online cbox.ws
chidporn.com chinacheapelitejerseys.com
co.lumb.co chuckguilford.com
compliance-barak.top cienum.fr
classicakuhni.ru
cognitiveseo.com
compliance-irvin.xyz compliance-irvin.xyz
cookielawblog.wordpress.com compliance-mary.top
cornerstone-countertops.com compliance-nelson.top
country-chic.ru compliance-walter.top
cubook.supernew.org construmac.com.mx
dafatiri.com coolbar.pro
daydream-studio.ru customboxes4less.com
ddpills.com daptravel.com
demon-tweeks.com delitime.info
detalizaciya-tut.biz
detmebel.su
dfiles.me dfiles.me
digital-sale.su divisioncore.com
discovertreasure-a.akamaihd.net dnepr-avtospar.com.ua
dnsrsearch.com druzhininevgeniy63.blogspot.com
dotmass.top ed-shop01.ru
doxysexy.com eduserver.net
dynainbox.com eleimgo.pw
e-collantes.com elektrozigarettekaufen2.blogse.nl
edge.sharethis.com eloxal.ru
ege-russian.ru empirepoker.com
elektronischezi.livejournal.com englishgamer.com
elkacentr.ru essayassist.com
empathica.com eupornstar.info
englishdictionaryfree.com expdom.com
eropho.net exportshop.us
essaypro.com ez8motelseaworldsandiego.com
estelight.ru fba-mexico.com
falopicm.pw fifa-coins.online
feorina.ru film-one.ru
filmfanatic.com fireads.men
financeloan.us frbizlist.com
fiuxy.com frcls.fr
forex21.ru freejabs.com
freshdz.com freewhatsappload.com
fx-brokers-review.com fusoradio.info
g.starmoe.xyz
g7m.pl
galaxy-family.ru
gambarkataku.co gambarkataku.co
games.kolossale.ru gaytube.com
gdzkurokam.ru gdebestkupit.ru
ge0ip.net geckoandfly.com
gheus.altervista.org getresponse.com
goldenggames.com ghernnqr.skyrock.com
google-liar.ru girlporn.ru
googlsucks.com glopages.ru
gratuitxblcodes.com gonextmedia.com
gwagka.com goo.ne.jp
hamptonoaks.ca goodwriterssales.com
heartofbeijing.blogspot.com googlepositions.com
hermesbelts.xyz gopro-online.info
hosting-tracker.com hackers-crackers.tk
houseofgaga.ru hauleddes.com
hubbble.com heroz.fr
imagerydatabase.com hitcpm.com
import-sales.com homegardenlova.com
in-tandem.co housemilan.ru
iqupdatetmz.win hspline.com
iscblog.info ideashome.id
jasonpartington.com ideawheel.com
jetsli.de iflycapetown.co.za
job.icivil.ir ilovevitaly.com
jrpmakati.com imagui.eu
keywesthideaways.co imgarcade.com
khadastoafarde.tk interesnie-faktu.ru
kino-rf.ru irkutsk.zrus.org
koral.se isistaylorporn.info
kostenlos-sexvideos.com isitpaleo.info
krasnodar.ru j33x.com
jagg.info
jrcigars.com
justkillingti.me
kerei.ru
kinogolos.ru
konpax.com
krynica.info
lacasamorett.com
landreferat.ru
laxdrills.com laxdrills.com
lego4x4.ru leboard.ru
lerporn.info lexaprogeneric.link
lesbian.xyz linkbolic.com
linkwithin.com live-sexcam.tk
liveinternet.ru live-sexchat.ru
loadingpages.me locimge.pw
louboutinshoes.xyz lomb.co
lsp-awak-perikanan.com luchshie-topcasino.ru
m1media.net m-google.xyz
macfix.life mackeeper-land-672695126.us-east-1.elb.amazonaws.com
machicon-akihabara.info marcowebonyodziezowe.pl
macotool.com mcar.in.ua
mafcards.ru mearns-tractors.co.uk
manualterap.roleforum.ru mediaoffers.click
mararoom.ru meet-flirt-dating.com
marinetraffic.com member-quiz.com
marketingtechniques.info
masturbate.co.uk
matsdale.com
medicineseasybuy.com
meendo-free-traffic.ga
milblueprint.com milblueprint.com
minyetki.ru miniature.io
mirtorrent.net mnimmigrantrights.net
missis.top mobioffertrck.com
mmofreegames.online mobstarr.com
mobsfun.net moneymaster.ru
most.gov.iq mountainstream.ms
mostantikor.ru networkad.net
mp3ritm.top newhairstylesformen2014.com
my-bc.ru nikitsyringedrivelg.pen.io
myra.top noumeda.com
narkologiya-orel.ru novosibirsk.xrus.org
new7ob.com nzfilecloud.weebly.com
next-dentists.tk online-templatestore.com
nhl09.ru pammik.ru
nightvision746.weebly.com
northfacestore.online
obiavo.ru
obuv-kupit.ru
ochistka-stokov.ru
oecnhs.info
ok.ru
onetravelguides.com
online-sbank.ru
onlinefilmz.net
panamaforbeginners.com panamaforbeginners.com
paydayonlinecom.com pandarastore.top
phelissota.xyz papasdelivery.ru
pintattoos.com partner-high.men
pinup-casino1.ru pathwhelp.org
platinumdeals.gr peekyou.com
poiskzakona.ru petitions.whitehouse.gov
pons-presse.com picsfair.com
pontiacsolstice.info pinapchik.com
popup-fdm.xyz poem-paying.gq
pornodojd.ru porno-dojki.net
pornosexrolik.com pornogig.com
pr-ten.de pozdrawleniya.com
preg.marketingvici.com pravoholding.ru
profolan.pl prefersurvey.net
radiodigital.co prizestohandle.club
redhotfreebies.co.uk proekt-mos.ru
regdefense.com professionaldieselcare.com
remontvsamare.su prokotov.com
revistaindustria.com puzzleweb.ru
rockprogblog.com qitt.ru
roznica.com.ua ranksignals.com
saveriopiazza.it reelheroes.net
seeresultshub-a.akamaihd.net reklama1.ru
sexvideo-sex.com relayblog.com
sexy-pings.com remontgruzovik.ru
sfd-chess.ru rus-pornuha.com
sharebutton.to saneyes.com
shlyahten.ru sbornik-zakonov.ru
sindragosa.comxa.com scanmarine.info
sisi-go.ru scanner-nelson.top
site-speed-check.site search.1and1.com
social-search.me segol.tv
socialbuttons.xyz seocheckupx.com
spanking.to seozoom.it
spravka-medosmotr.ru shareyards.com
strigkaomsk.ru smsactivator.ru
supervesti.ru soc-econom-problems.ru
telefonsex-ohne0900.net softonicads.com
telemetryverification.net specialfinanceoffers.com
templates.franklinfire.co spin2016.cf
thecoral.com.br startwp.org
thejournal.ru staynplay.net
tizanidine6mg.blogspot.com steelmaster.lv
tizanidinerecreationaluse.blogspot.com store-rx.com
tizanidinevsvalium.blogspot.com strongholdsb.ru
tksn.ru swinon.site
topmira.com tagil.zrus.org
truebeauty.cc taihouse.ru
trustl.life tarad.com
try-rx.com tecnoteakviareggio.it
tsyndicate.com teenbbw.yopoint.in
tuberkuleznik.ru telsis.com
tversvet.ru thelottosecrets.com
twittrading.com theplacetoupdating.pw
ucoz.ru tizanidineandgabapentin.blogspot.com
udsgame.online tmtrck.com
ultimatesetnewfreeallsoftupgradesystems.pw topappspro.com
urlopener.blogspot.com.au um-razum.ru
uroffer.link usiad.net
vavilone.com verymes.xyz
videos-for-your-business.com vesnatehno.com
vut.com.ru villakohlanta.nu
watchmygf.net vipromoffers.com
waterpurifier.club vmnmvzsmn.over-blog.com
we-are-gamers.com vvpg.ru
weightatraining.com website-speed-up.site
whatistizanidinehclusedfor.blogspot.com westsextube.com
wjgony.com world-mmo.com
wnoz.de xev.ru
worldis.me xitjw.info
wosik-dach.service-for-web.de xn-----7kceclhb4abre1b4a0ccl2fxch1a.xn--p1ai
www.ehscloud.cn xn--b1addnj3cah.xn--p1ai
x-true.info xn--lifehacer-1rb.com
xblog.in xuki.us
xn-----6kcaacnblni5c5bicdpcmficy.xn--p1ai xvideospornoru.com
xxart.ru xxxtubesafari.com
xzlive.com yebocasino.co.za
yougotanewdomain.com zaloro.com
zacreditom.ru zarabotat-na-sajte.ru
zahvat.ru zarajbuilders.com
zoodrawings.com zoolubimets.ru
zryydi.com zryydi.com
zscaler.net

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.150 0; 10.1.0.86 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.10.3400 ### Version: V4.2022.10.3401
### Updated: Sun Oct 9 22:01:15 UTC 2022 ### Updated: Mon Oct 10 10:03:44 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.10.3400 ### Version: V4.2022.10.3401
### Updated: Sun Oct 9 22:01:15 UTC 2022 ### Updated: Mon Oct 10 10:03:44 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##