vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-10 06:15:06 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2022.10.3393 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2022-10-06 10:11:07 +00:00
parent b0f213d6c9
commit ae7543c4f8
46 changed files with 100097 additions and 100097 deletions
Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.10.3392 #### Version: V4.2022.10.3393
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.10.3392 #### Version: V4.2022.10.3393
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -14,7 +14,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2022.10.3392 #### Version: V4.2022.10.3393
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

12376
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2022.10.3392 #### Version: V4.2022.10.3393
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

12380
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

12380
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

12380
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

12380
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.44 1; 10.1.0.73 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.44 0; 10.1.0.73 0;
127.0.0.1 0; 127.0.0.1 0;

12380
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.44 1; 10.1.0.73 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.44 0; 10.1.0.73 0;
127.0.0.1 0; 127.0.0.1 0;

12380
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.44 1; 10.1.0.73 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.44 0; 10.1.0.73 0;
127.0.0.1 0; 127.0.0.1 0;

12380
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
3392 3393

12380
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

12380
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.232.30.45 0; 13.64.99.143 0;

12380
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.44 1; 10.1.0.73 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.44 0; 10.1.0.73 0;
127.0.0.1 0; 127.0.0.1 0;

12380
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.44 1; 10.1.0.73 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.44 0; 10.1.0.73 0;
127.0.0.1 0; 127.0.0.1 0;

12380
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.44 1; 10.1.0.73 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.44 0; 10.1.0.73 0;
127.0.0.1 0; 127.0.0.1 0;

12380
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.232.30.45 0; 13.64.99.143 0;

12380
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.232.30.45 0; 13.64.99.143 0;

12380
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.44 1; 10.1.0.73 1;
127.0.0.1 1; 127.0.0.1 1;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
Grabber BDFetch
NPbot BetaBot
Octopus Bitacle
OutfoxBot Id-search
Pimonster Joomla
SemrushBot JustView
URLy Warning LinkScan
Vacuum Mister PiX
Web Pix PeoplePal
scalaj-http VB Project

290
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
360Spider
404enemy
80legs
ADmantX ADmantX
AIBOT
ALittle Client ALittle Client
ASPSeek Aipbot
Aboundex
AfD-Verbotsverfahren
AhrefsBot
Alexibot Alexibot
AlphaBot AlphaBot
Anarchie Anarchie
Anthill Anthill
Aspiegel Atomseobot
AwarioRssBot
AwarioSmartBot
BBBike
BDCbot BDCbot
BackWeb BDFetch
BackDoorBot
BacklinkCrawler BacklinkCrawler
BatchFTP Barkrowler
Blow Battleztar Bazinga
BetaBot
Bigfoot
Blackboard
BlowFish BlowFish
Bolt
BotALot
Brandprotect
Brandwatch Brandwatch
BuiltWith BuzzSumo
Bullseye CATExplorador
BunnySlippers CCBot
CODE87 CODE87
Cegbfeieh Calculon
CheTeam CensysInspect
CheeseBot Claritybot
ChinaClaw Cloud mapping
Collector Cocolyzebot
Cogentbot
Copier Copier
CopyRightCheck CopyRightCheck
Copyscape Copyscape
Craftbot Cosmos
CrazyWebCrawler
Crescent Crescent
DIIbot
DSearch DSearch
Deusu DataCha0s
Devil
Digincore Digincore
DigitalPebble DigitalPebble
Dirbuster
Discobot Discobot
Dispatch Discoverybot
DnBCrawler-Analytics
DomainAppender DomainAppender
DomainSigmaCrawler
DomainStatsBot DomainStatsBot
Dotbot
Dragonfly
Drip Drip
EMail Siphon EMail Wolf
Ebingbong
EirGrabber
EroCrawler
Evil Evil
Express WebPictures Express WebPictures
ExtLinksBot ExtLinksBot
ExtractorPro Extreme Picture Finder
FHscan Ezooms
Firefox/7.0 FDM
FemtosearchBot
FlashGet FlashGet
Foobot Freeuploader
FrontPage
Fuzz Fuzz
GetRight GermCrawler
GetWeb
Getintent
Go!Zilla Go!Zilla
GrabNet Go-Ahead-Got-It
Grafula Grafula
GrapeshotCrawler GrapeshotCrawler
HTMLparser HEADMasterSEO
HTTP::Lite HTTP::Lite
HaosouSpider
Havij
HonoluluBot HonoluluBot
IDBTE4M Humanlinks
IDBot IRLbot
Iblog Iblog
IlseBot Image Fetch
Internet Ninja Image Sucker
IndeedBot
Indy Library
InfoNaviRobot
InternetSeer InternetSeer
Iria Iria
JamesBOT JOC Web Spider
JennyBot Jbrofuzz
JetCar Jetty
Jorgee JikeSpider
Joomla
Jyxobot Jyxobot
Keybot Translation-Search-Machine Kinza
Lanshanbot LNSpiderguy
Larbin
LeechFTP
Lftp Lftp
Libwhisker Linkbot
LieBaoFast LinkextractorPro
LinkWalker
LinkpadBot
LinksManager
LinqiaRSSBot LinqiaRSSBot
LinqiaScrapeBot Litemage_walker
Lmspider MQQBrowser
MFC_Tear_Sample
MIIxpc
MSIECrawler
MTRobot MTRobot
Mail.RU_Bot
Majestic SEO Majestic SEO
Majestic-SEO
MarkMonitor MarkMonitor
Mata Hari Mass Downloader
Masscan
MauiBot
MeanPath Bot
Metauri Metauri
MicroMessenger Microsoft Data Access
Microsoft URL Control MolokaiBot
Moblie Safari Morfeus Fucking Scanner
Mozlila
Mr.4x3 Mr.4x3
Musobot Musobot
NICErsPRO
NPbot NPbot
Name Intelligence
Nameprotect Nameprotect
NearSite
Nessus
NetAnts NetAnts
NetLyzer
NetMechanic NetMechanic
NetZIP NetZIP
Netcraft Netcraft
Netvibes Netvibes
Niki-bot
Nikto
NimbleCrawler NimbleCrawler
Nutch Nimbostratus
Ninja
Nmap
Offline Navigator Offline Navigator
OnCrawl
OpenLinkProfiler
OpenVAS OpenVAS
Openfind Openfind
Openvas
OrangeBot OrangeBot
OrangeSpider OutfoxBot
PageScorer PageScorer
Pandalytics PageThing.com
Panscient
Pavuk Pavuk
PictureFinder PeoplePal
Piepmatz Piepmatz
Probethenet Pixray
PleaseCrawl
Pockey
ProPowerBot
ProWebWalker
Psbot Psbot
Pu_iN
PyCurl PyCurl
QueryN Metasearch QueryN Metasearch
RSSingBot RankActive
RankFlex RankActiveLinkBot
RankingBot2
RankurBot
ReGet
RealDownload
Reaper Reaper
RebelMouse
Recorder
RepoMonkey RepoMonkey
Ripper Ripper
RocketCrawler
SBIder
SEOkicks SEOkicks
SEOkicks-Robot
SEOstats
SISTRIX
SMTBot SMTBot
ScanAlert
Scanbot
ScoutJet ScoutJet
Scrapy Scrapy
Screaming Screaming
ScreenerBot
ScrepyBot
SearchmetricsBot SearchmetricsBot
SemanticJuice
SeoSiteCheckup SeoSiteCheckup
SeobilityBot Site Sucker
SiteLockSpider SiteLockSpider
SiteSnagger
Sitevigil
SmartDownload SmartDownload
Snake Snoopy
Snapbot SocialRankIOBot
Sociscraper
Sosospider Sosospider
SpaceBison
Spammen
Spanner Spanner
Spinn3r Spinn3r
Sqlworm SputnikBot
Sucuri Sqlmap
SuperHTTP Stripper
T8Abot T8Abot
Telesoft Telesoft
Telesphoreo The Intraformant
TheNomad Thumbor
Titan TightTwatBot
Toweyabot Trendiction
True_Robot TurnitinBot
Typhoeus Twice
URLy Warning UnisterBot
Vacuum VB Project
VelenPublicWebCrawler Vagabondo
VidibleScraper VeriCiteCrawler
Virusdie Virusdie
VoidEYE WBSearchBot
Voil
WEBDAV
WISENutbot WISENutbot
WPScan WPScan
WWW-Collector-E WWW-Collector-E
WWW-Mechanize
Wallpapers Wallpapers
WallpapersHD
WeSEE WeSEE
Web Pix Web Auto
Web Enhancer
Web Fetch
Web Fuck
Web Sucker Web Sucker
WebCollage WebFetch
WebEnhancer
WebFuck
WebImageCollector WebImageCollector
WebLeacher WebLeacher
WebReaper WebReaper
WebSauger
WebStripper WebStripper
Webalta WebmasterWorldForumBot
Webshag
Website Quester Website Quester
WebsiteQuester Webster
Whack Whack
Whacker
Whatweb
Widow Widow
WiseGuys Robot WiseGuys Robot
Woobot Xaldon WebSpider
Zade Xaldon_WebSpider
Xenu
Zauba
Zitebot
ZmEu ZmEu
ZoomBot
ZoominfoBot ZoominfoBot
ZyBorg ZumBot
adscanner adscanner
autoemailspider arquivo-web-crawler
coccocbot arquivo.pt
cognitiveseo com.plumanalytics
crawler.feedback crawl.sogou.com
domainsproject.org dataforseo.com
eCatch heritrix
evc-batch internetVista monitor
gopher linkdexbot
instabid magpie-crawler
meanpathbot
mediawords
netEstate NE Crawler
oBot oBot
page scorer
pcBrowser
plumanalytics plumanalytics
s1z.ru ripz
scalaj-http scalaj-http
serpstatbot seocompany.store
sitechecker.pro seoscanners
sexsearcher
sogouspider sogouspider
ubermetrics-technologies.com webgains-bot
webmeup-crawler webmeup-crawler
webpros.com webpros.com
x09Mozilla x09Mozilla
xpymep1.exe x22Mozilla
zauba.io
zgrab zgrab

310
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
360Spider 01h4x.com
404enemy
ASPSeek ASPSeek
Aboundex Aboundexbot
AfD-Verbotsverfahren Acunetix
AiHitBot
Aipbot Aipbot
AllSubmitter Alexibot
Anarchie AlphaBot
Anarchy Anarchy99
Ankit
Anthill
Apexoo Apexoo
Aspiegel
Atomseobot
Attach
AwarioRssBot AwarioRssBot
BBBike
BDFetch BDFetch
BLEXBot
BackStreet BackStreet
BackWeb BackWeb
Backlink-Ceck
BacklinkCrawler BacklinkCrawler
BatchFTP Bandit
Blow Barkrowler
Blackboard
BlowFish BlowFish
Boardreader Brandprotect
Brandwatch
Buck Buck
Buddy
BuiltBotTough BuiltBotTough
BuzzSumo BuiltWith
CensysInspect CCBot
CheeseBot CODE87
Calculon
CazoodleBot
Cegbfeieh
CherryPicker CherryPicker
Claritybot ChinaClaw
Cloud mapping Citoid
Collector Collector
Copier
CopyRightCheck CopyRightCheck
Copyscape
Cosmos Cosmos
Crawling at Home Project
CrazyWebCrawler CrazyWebCrawler
CrunchBot Crescent
Curious Curious
DBLBot Custo
CyotekWebCopy
DataCha0s
Demon Demon
Deusu Deusu
Devil Devil
DigitalPebble DigitalPebble
Dirbuster Discobot
Disco DomCopBot
DittoSpyder
DnBCrawler-Analytics
DnyzBot
DomainCrawler DomainCrawler
DomainSigmaCrawler Dotbot
EMail Siphon Download Wonder
EroCrawler Drip
Express WebPictures ECCP/1.0
Ebingbong
Ecxi
Evil
Exabot
ExtLinksBot
Extractor Extractor
Extreme Picture Finder Fyrebot
FHscan G-i-g-a-b-o-t
FemtosearchBot
Foobot
FrontPage
Fuzz
FyberSpider
GT::WWW
GalaxyBot GalaxyBot
GermCrawler
GetRight GetRight
Getintent Go-Ahead-Got-It
Go!Zilla GridBot
Grabber
Grafula
GrapeshotCrawler
HEADMasterSEO
HTMLparser HTMLparser
HTTP::Lite HTTrack
Haansoft
HaosouSpider HaosouSpider
Harvest Havij
Heritrix
HonoluluBot
Humanlinks
HybridBot HybridBot
Iblog IDBTE4M
IlseBot IRLbot
IndeedBot IndeedBot
InfoTekies InterGET
Intelliseek
Internet Ninja
InternetSeer
Iskanie Iskanie
JOC Web Spider
JamesBOT
Jbrofuzz
JennyBot JennyBot
Jetty
Jorgee
JustView JustView
Kenjin Spider Keybot Translation-Search-Machine
Kinza
Kozmosbot
LNSpiderguy LNSpiderguy
LWP::Simple
Lanshanbot
Larbin Larbin
Lftp LeechFTP
Likse LeechGet
LexiBot
LibWeb
Libwhisker
Lightspeedsystems
LinkWalker LinkWalker
Linkbot Linkbot
LinkpadBot
LinqiaMetadataDownloaderBot LinqiaMetadataDownloaderBot
MSIECrawler LinqiaRSSBot
Lipperhey
Lipperhey Spider
MFC_Tear_Sample
MIDown tool
MJ12bot
MTRobot MTRobot
MarkWatch Mag-Net
Majestic SEO
Mass Downloader Mass Downloader
Masscan Mata Hari
MauiBot MauiBot
Mb2345Browser
MeanPath Bot MeanPath Bot
Meanpathbot
MegaIndex.ru MegaIndex.ru
MicroMessenger
Minefield Minefield
Mister PiX Mister PiX
Mojeek Moblie Safari
Mr.4x3 Morfeus Fucking Scanner
Mozlila
Musobot Musobot
NPbot Name Intelligence
Nameprotect
NearSite
NetAnts NetAnts
NetSpider
NetZIP
Netcraft
Netvibes
Nibbler
Niki-bot Niki-bot
Not Nimbostratus
Nutch Ninja
Nmap
Octopus Octopus
Offline Explorer
Offline Navigator
OnCrawl OnCrawl
OpenLinkProfiler
Openvas
OrangeSpider OrangeSpider
OutfoxBot OutfoxBot
Page Analyzer
PageAnalyzer PageAnalyzer
PageGrabber
PageThing.com
Panscient Panscient
Papa Foto Papa Foto
Petalbot Petalbot
Pi-Monster Picsearch
Picscout
Piepmatz
Pockey Pockey
ProWebWalker Pu_iN
Probethenet PxBroker
RankActiveLinkBot PyCurl
RankFlex QueryN Metasearch
RankingBot Quick-Crawler
Rankivabot RankActive
RankurBot RankurBot
RealDownload Re-re
ReGet
Reaper Reaper
RebelMouse SEOkicks
RepoMonkey
Ripper
RocketCrawler
Rogerbot
SBIder
SEOkicks-Robot SEOkicks-Robot
SEOlyticsCrawler SEOlyticsCrawler
SEOstats SEOstats
SalesIntelligent
Scanbot Scanbot
ScoutJet
Screaming Screaming
ScreenerBot
ScrepyBot
Seekport Seekport
SeobilityBot Semrush
Seomoz SeoSiteCheckup
Shodan Siphon
SiteCheckerBotCrawler Site Sucker
Sitebeam SiteExplorer
Siteimprove SiteSucker
Sitevigil
SlySearch SlySearch
SmartDownload
Snoopy
SocialRankIOBot
Sociscraper
Sogou web spider Sogou web spider
Sosospider SpankBot
Sottopop SputnikBot
Sqlmap Sqworm
Stripper Sucker
SuperHTTP Sucuri
Suzuran
Szukacz Szukacz
T8Abot T0PHackTeam
Teleport Teleport
TeleportPro
Telesphoreo Telesphoreo
Telesphorep
The Intraformant
TheNomad TheNomad
Thumbor
TightTwatBot
Toata
Toweyabot
TurnitinBot TurnitinBot
TwengaBot
Typhoeus Typhoeus
URLy Warning VB Project
URLy.Warning Vacuum
VelenPublicWebCrawler VeriCiteCrawler
VoidEYE WBSearchBot
Voil WEBDAV
WPScan WISENutbot
WWW-Mechanize WWW-Collector-E
WWW::Mechanize WWWOFFLE
Wallpapers Wallpapers
Wallpapers/3.0 Wallpapers/3.0
WallpapersHD WeSEE
Web Auto Web Auto
Web Collage
Web Enhancer
Web Pix Web Pix
Web Sucker Web Sucker
WebFetch WebFetch
WebFuck WebFuck
WebLeacher WebmasterWorldForumBot
WebWhacker
WebZIP
Webshag Webshag
Website Quester
WebsiteExtractor
WebsiteQuester WebsiteQuester
Webster
Whack
Whacker
Whatweb Whatweb
Who.is Bot
Widow
Wonderbot Wonderbot
Wotbox Xaldon_WebSpider
Zauba Xenu
Zermelo ZoomBot
ZumBot ZoominfoBot
ZyBorg ZyBorg
archive.org_bot arquivo-web-crawler
autoemailspider backlink-check
check1.exe check1.exe
cognitiveseo demandbase-bot
crawler4j eCatch
dataforseo.com instabid
domainsproject.org isitwp.com
evc-batch
facebookscraper
heritrix
internetVista monitor
iubenda-radar
linkdexbot
lwp-request
mediawords
muhstik-scan muhstik-scan
netEstate NE Crawler
oBot oBot
pcBrowser pcBrowser
plumanalytics plumanalytics
polaris version polaris version
satoristudio.net ripz
scalaj-http
seoscanners
seostar seostar
sitechecker.pro serpstatbot
sp_auditbot sysscan
tAkeOut tAkeOut
trendiction.com
ubermetrics-technologies.com ubermetrics-technologies.com
webgains-bot voyagerx.com
webmeup-crawler webmeup-crawler
x09Mozilla x09Mozilla
xpymep1.exe

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
actices.com bcmp.org
eloconcream.blogspot.com cakesplus.com.au
nalogovyykodeks.ru filkhbr.com
parlament.biz irunfar.com
ranking2017.ga mir-limuzinov.ru
rating-bestcasino.com ofanda.com
socialtrade.biz pixshark.com
trustedhealthtips.com pornowarp.info
unmaroll.ya.ru praisong.net
volgograd.xrus.org redirectingat.com

944
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
01apple.com 00webcams.com
1flag.co.za 0c47f8422d3f.com
24-ak.ru 1webmaster.ml
2728fb936f0.com 256bit.by
3dracergames.com 404.mn
45en.ru 55wmz.ru
7fon.ru 5tey7463.weebly.com
888.com 72-news.com
abtasty.com 8kisses.eu
acc.eu.org 91abcw.com
adloads.com 98oi.ru
adsloads.com a1security.com.ua
agreda.pluto.ro abctoppictures.net
akama.com academiacsmendoza.org
allwomen.info adcash.com
alt-servis.ru adultmeetonline.info
am15.net afslankpillen2017nl.eu
amazingninja.com airlandsea.info
an-donut.com alarmobninsk.ru
angry-fermi-7633.arukascloud.io algarveglobal.com
aosheng-tech.com alienwheels.de
apccargo.com alta-realestate.com
apiadanaknet-a.akamaihd.net alvtank.se
apimountainbikei-a.akamaihd.net amigobulls.com
anatomiy.com
android4fun.org
animebox.com.ua
anonymizeme.pro
apartmentbay.ru
apessay.com
appfixing.space
apple.com-cleaner.systems
apps-analytics.net
arcadeplayhouse.com
arclk.net
ardimobileinfo.ml
arkkivoltti.net
arraty.altervista.org
artdeko.info artdeko.info
asrv-a.akamoihd.net aruplighting.com
astana.xxxkaz.org asrvrep-a.akamaihd.net
audiofree.ru atleticpharm.org
autoloans.com atofilms.com
aversis.net aucoinhomes.com
aviav.eu aussie-prizes.com
avkzarabotok.info avramstroy.ru
azadnegar.com awaybird.ru
azbukafree.com azartmix.com
b2b-lounge.com balla-boo.se
baixar-musicas-gratis.com bambi.ck.ua
baltgem.com bankcrediti.ru
bashtime.ru battle.net
battleforupdating.site bayareaaeroclub.org
bensbargains.net beachdriveblog.com
best-businessman.ru becuo.com
best-way.men bedcapdealers.com
bestfortraders.com
besthoro.ru besthoro.ru
bestmarriages.com bestmarriages.com
bestofupload.info bidbuy.co.kr
bestserials.com bimmerpost.com
bibys.com biographiya.com
bidr.trellian.com bitnote.co
bimatoprost-careprost.com bkgr.se
binomo.com bkns.vn
blog-hits.com blogig.org
blog.koreadaily.com bluesman.nu
bonzibuddi.com bmw-ark.ru
boobsimge.com boazpower.com
bracketsmackdown.com bongacams.com
bronzeaid-a.akamaihd.net bosman.pluto.ro
bukleteg.xyz brandedleadgeneration.com
bum.com.ru bravegirlsclub.com
buyfriend.ru brothers-smaller.ru
c-gainsbourg.com businescoop.men
cakemediahq.com.au business-suggested.tk
callstevens.com bvlgariring.xyz
camdolls.com bwlx.prepedu.cn
candytiner.com bzero1jewelry.net
canoncdriverq3.pen.io call-of-duty.info
carloans.com callcafe.info
cartierreplica.xyz camsex.xxx-cam.webcam
celebsopics.com carapics.com
cgi2.nintendo.co.jp carina-sy.de
checktext.org castingbank.ru
celejihad.info
cellfun.mobi
cheapbelstaff.online
cheapmarmot.online
cheapmoncler.pw
cheapmoncler.win
cialgenisrx.com
ciceros.co ciceros.co
citysecurity.nu cleansearch.net
classiquebijoux.ru
clayvasedesigns.tk
cleanmypc.com
clevernt.com
clickcash.com
cmhomestayagency.com cmhomestayagency.com
coccoc.com coin-hive.com
collegerentals.com com-secure.download
compliance-don.xyz comissionka.net
compliance-elena.top compliance-andrew.top
compliance-fred.top compliance-checker-7.info
compliance-mary.top compliance-ivan.xyz
compliance-willy.top compliance-jane.top
contentsexpress.com compliance-john.top
continent-e.tv consorzioilmosaico.org
coolgamechannel.com constantaservice.net
coolwallpapers4k.info cookingmeat.ru
creams.makeforum.eu countercrazy.com
culmimg.pw covadhosting.biz
customboxes4less.com crackzplanet.com
customsua.com.ua cutalltheshit.com
dairyindia.in cv.wallhade.co
cymbaltaandtizanidine.blogspot.com
czat.wp.pl
czeshop.info
dandiyabeats.in dandiyabeats.in
daretodonate.co darmebel.com.ua
daydream-studio.ru date-withme.com
ddsoldes.fr delitime.info
detsky-nabytek.info delta-line.men
diarioaconcagua.com deniven.1bb.ru
diffbot.com detoxmed24.ru
dignitasdata.se digitalassetmanagement.site
dildofotzen.net dinkolove.ya.ru
dimaka.info dms-sw.ru
djihispano.com dominterior.org
domain2008.com dosugrostov.site
domaincrawler.com doublepimp.com
dood.live download-walpaperhd.blogspot.com
downloadmefiranaratb1972.xpg.com.br doxyporno.com
dpihatinh.gov.vn
draniki.org
drunkmoms.net drunkmoms.net
duawitchrarato.tk dverimegapolis.ru
dyt.net e90post.com
e-kwiaciarz.pl
eandsgallery.com
ecommerce-seo.com
edudocs.net
eduinfosite.com
efkt.jp
ege-essay.ru
eksprognoz.ru
ekto.ee ekto.ee
elmacho.xyz elektroniksigaraankara.info
enbersoft.com elektrozigarette2.wordpressy.pl
encodable.com elektrozigaretten1.postbit.com
enews.tech elidelcream.weebly.com
enhand.se elkacentr.ru
enpolis.ru emerson-rus.ru
enskedesquashclub.se eropho.com
erectile.bid erotische-geschichten-xxl.com
erot.co essay-edu.biz
erotag.com evehemming.blogspot.com.au
erotik0049.com extlabs.io
ertelecom.ru extstat.com
eshop4u.jp ezigarettenkaufen2.dreamwidth.org
executehosting.com ezigarettenshop2.postbit.com
exhibitionplus.eu farm26.ru
exportshop.us fast-wordpress-start.com
extlinks.com
ezigaretteshop2.mywapblog.com
facebook-mobile.xyz
fbdownloader.com
feel-planet.com
feeriaclub.ru
feorina.ru feorina.ru
fickenprivat.info fickblock18.com
fikasound.tk film-one.ru
filesdatabase.net filmci.pro
filmetricsasia.com filmgo.ru
firesub.pl finansov.info
fishingwholesale.us findanysex.com
fitfloponline.store firstsiteguide.com
flashbannernow.com flprog.com
focalink.com fordsonmajbor.cf
forex-indextop20.ru forum.doctissimo.fr
formseo.com foxweber.com
foto-sisek.porngalleries.top franecki.net
foxjuegos.com freecamdollars.com
fr-bearings.ru freejabs.com
free-stock-illustration.com freevpn.space
freemags.cc front.ru
fsakhalin.ru fxtips.ru
galaxy-family.ru gallery.rennlist.com
galeon.com game-mmorpg.net
gameonasia.com game300.ru
gaygalls.net geilehausfrauen.net
ge0ip.net geoads.com
getmyads24.com getprismatic.com
ghostvisitor.com ghostvisitor.com
girlspicsa.com go2jump.org
globalscam.ga gogps.me
gojiberriess.apishops.ru gojiberriess.apishops.ru
gox.com.ua goldadpremium.com
gq-catalog.gq golden-praga.ru
guod.me gombita.info
gwagka.com googleseo.com.tr
gymi.name googlsucks.com
hahashka.ru gratuitxblcodes.com
hamacapty.com greamimgo.pw
greatidea.marketing
green-tea.tv
growshop.es
guiadeserraazul.com
gwebtools.com
hamptonoaks.ca
hard-porn.mobi
hatedriveapart.com hatedriveapart.com
haveinc.xyz hdwallpapers-free.com
havepussy.com healing-dysplasia.ru
hdimagegallery.net hermesbracelets.xyz
healgastro.com hifidesign.ru
helicalpile.us highland-homes.com
helpmymacfaster.trade histock.info
hentai-manga.porn hoholikik.club
hidemyass.com hopeonthestreet.co.uk
hit-men.men horoshieokna.com
homeart.space hotsocialz.com
hoste.octopis.com housekuba.org
hotkeys.com hoverboard360.nl
hoverboardforsaledirect.com howlongdoestizanidinestayinyoursystem.blogspot.com
hubbble.com
huimin764128.com
hunterboots.online hunterboots.online
iccornacircri.cf hunthillfarmtrust.org
igru-xbox.net hyhj.info
iklysha.ml idc.com.ua
ilikevitaly.com igadgetsworld.com
images-free.net ihc2015.info
imfamous.info
immobiliaremassaro.com immobiliaremassaro.com
impotentik.com in-tandem.co
incomekey.net indetiske.ya.ru
infogame.name infowarcraft.ru
intim-uslugi.info investmac.com
investpamm.ru iopeninghours.co.uk
ipostroika.ru ipchicken.com
ispaniya-costa-blanca.ru iqoption.com
istizanidineanopiate.blogspot.com iqupdatetmz.win
itronics.ca itag.pw
jacago.com jackpotchances.com
janavibekken.no james13prix.info
jav-way.site jav-fetish.com
jerseysbizwholesalecheap.com jobgirl24.ru
jongose.ninja juliadiets.com
justdating.online kaidalibor.de
kadashihotel.com kam-dom.ru
kaz.kz keywordglobal.co.za
kerch.site keywords-monitoring-success.com
keywesthideaways.co kidd.reunionwatch.com
keyword-suggestions.com kinogolos.ru
keywordblocks.com kinopolet.net
kino2018.cc kmd-pto.ru
kinogonew.ru kmgamex.cf
kinotorka.ru kollekcioner.ru
klin3952.ru kolotiloff.ru
knogg.net
kol-energo.ru
konteiner24.com
kosmetyki.tm.pl kosmetyki.tm.pl
kosova.de kozhniebolezni.com
kovrenok.ru krasula.pp.ua
kredit-blog.ru kurbappeal.info
kvartiry-remont.ucoz.ru kw21.org
kwzf.net la-fa.ru
laserpen.club landmania.ru
law-check-nine.xyz landoftracking.com
leadwayau.com laulini.soclog.se
leboard.ru layola.biz.tc
letmacworkfaster.site lazymanyoga.com
letolove.ru ldrtrack.com
letslowbefast.today letslowbefast.today
lifebyleese.com life-instyle.com
lion.snapmap.us likrot.com
livesex-amateure.info linerdrilling.com
liveu.infoteka.hu linkbux.ru
loadingpages.me linkwithin.com
lombardfinder.ru littleberry.ru
lostfilm-online.ru lodki-pvh.dp.ua
louisvuittonoutletstore.net lunchrock.co
love-baby.cz malls.com
lumb.co manimpotence.com
m1media.net marcoislandvacations.net
macdamaged.space marmotstore.online
madot.onlinewebshop.net marsgatan.com
mall.uk
marwer.info marwer.info
mastershef.club massage-info.nl
matematikus.info matsdale.com
matrixalchemy.com mebeldekor.com.ua
maximpartnerspr.com med-zdorovie.com.ua
meble-bogart.info medi-fitt.hu
mediaoffers.click meet-flirt-dating.com
medicineseasybuy.com megaindex.ru
medizinreisen.de mensandals.xyz
medtherapy.ru mikozstop.com
megahdporno.net minharevisao.com
mesbuta.info mitrasound.ru
mindeyegames.com
miniads.ca
mixtapetorrent.com mixtapetorrent.com
mmog-play.ru moi-glazki.ru
mobot.site mole.pluto.ro
monarchfind-a.akamaihd.net moncleroutletonline.xyz
monarhs.info morefastermac.trade
moomi-daeri.com mosrif.ru
mostantikor.ru moz.com
movies-in-theaters.net mrbitsandbytes.com
mp3downloadhq.com mrlmedia.net
mundoaberrante.com msfsaar.de
musezone.su myra.top
muz-baza.net mywallpaper.top
myonlinepayday.co nailsimg.com
mypets.by naturtreenspicerx.pw
naphukete.ru net-radar.com
nastydollars.com nextconseil.com
nerudlogistik.ru nfljerseyscheapbiz.us
newfilmsonline.ru nhl17coins.exblog.jp
nfljerseyscheapchinabiz.com nibbler.silktide.com
nhl09.ru nikitabuch.com
nl.netlog.com nippon-bearings.ru
odoratus.net nonameread45.live
oivcvx.website nootrino.com
ontargetseo.us normalegal.ru
openlibrary.org o-o-11-o-o.com
ops.picscout.com oakridgemo.com
ororodnik.goodbb.ru office-windows.ru
orsonet.ru okel.co
online.ktc45.ru
onlinebay.ru
onlinemegax.com
onstrapon.purplesphere.in
opinionreelle.com
oranga.host.sk
ostroike.org
outclicks.net
oz-offers.com
p-business.ru p-business.ru
paceform.com pacificair.com
pammik.ru paleohub.info
panchro.xyz palvira.com.ua
patol01.pw pandarastore.top
pendelprognos.se pavlodar.xkaz.org
petsblogroll.com perfectplanned.com
piccdata.com phobia.us
piccshare.com photo.houseofgaga.ru
picturesmania.com photosaga.info
piter.xrus.org pihl.se
piulatte.cz pinwallpaper.top
pixell.club pivka.xyz
pizda.lol pizza-tycoon.com
pizdeishn.com pl.id-forex.com
pk-services.ru poem-paying.gq
plusnetwork.com poisk-zakona.ru
pojdelo.weebly.com pony-business.com
polytopesexempt.com portside.xyz
popugauka.ru
porn-w.org
porn555.com
pornobrazzers.biz
pornofeuer.com
pornogratisdiario.com
pornoinn.com
pozdrawleniya.ru
predmety.in.ua predmety.in.ua
priceg.com pricheskaonline.ru
prizefestival.mobi princeadvantagesales.com
pro-okis.ru printingpeach.com
progonrumarket.ru priora-2.com
projefrio.com.br prod2016.com
prostitutki-belgoroda.org proekt-mos.ru
pukaporn.com professionalwritingservices15.blogspot.ru
puteshestvennik.com promoheads.com
pwwysydh.com proposal-engine.com
rating-bestcasino.com prostitutki-tolyatti.org
pyrodesigns.com.au
quick-seeker.com
quickloanbank.com
qwarckoine.com
rabot.host.sk
ranksays.com
rebelmouse.com
redirectme.net redirectme.net
redirlock.com refererx.com
registratciya-v-moskve.ru reining.lovasszovetseg.hu
registrationdomainsite.com
relayblog.com relayblog.com
remont-comp-pomosh.ru remontbiz.ru
remontvsamare.su resant.ru
replicaclub.ru rewardpoll.com
replicalouboutin.xyz robertefuller.com
research.ifmo.ru rockprogblog.com
rixpix.ru roll123.com
robot-forex.biz
roma-kukareku.livejournal.com roma-kukareku.livejournal.com
rozalli.com rvzr-a.akamaihd.net
rumamba.com saneyes.com
runofilms.ru santechnik.jimdo.com
runstocks.com sbf441.com
russkoe-zdorovie.ru scanner-fred.top
s-iwantyou.com scanner-willy.top
s8-nowy-wygraj.comli.com scopich.com
sakhboard.ru screpy.com
sbprabooks.com sdi-pme.com
sc-specialhost.com search.1and1.com
screentoolkit.com searchinquire.com
sdsjweb.com semxiu.com
search-error.com seofied.com
searchtooknow-a.akamaihd.net seoheap.com
seemoreresultshu-a.akamaihd.net seorankinglinks.us
semaltmedia.com serialsway.ucoz.ru
seocheki.net serving.adbetclickin.pink
service.adtech.fr sex-watch.com
shoesonlinebuy.cn sex.hotblog.top
shoppytoolmac.com sexfreepornoxxx.com
shopsellcardsdumps.com sextracker.be
shopvilleroyboch.com.ua sextracker.de
shopwme.ru sexvporno.ru
silktide.com shakhtar-doneck.ru
simple-share-buttons.com sharebutton.org
site.ru shlyahten.ru
siteexpress.co.il shopfishing.com.ua
sixcooler.de sibecoprom.ru
skylta.com sim-service.net
skyway24.ru sitevalued.com
slkrm.ru smokewithrabbits.com
snjatie-geroinovoy-lomki.ru socialmadesimple.com
social-button.xyz solinf.co
social-search.me spb-plitka.ru
socialbuttons.xyz spidtest.space
sockshare.net stard.shop
soft1.ru stariy-baku.com
sohoindia.net statistici.ro
soietvousmaime.fr steebook.com
solnplast.ru stickers-market.ru
sonata-arctica.wz.cz streetfire.net
songoo.wz.cz stroiminsk.com
sonnikforme.ru success-seo.com
space2019.top sugvant.ru
splendorsearch-a.akamaihd.net sukirgenk.dvrlists.com
stairliftstrue.com supermama.top
stjamesschool.info superstats.com
sumo.com suralink.com
sunflowerdrawingpaintings.blogspot.com sweepstakes.rewardit.com
supers.com.ua swinger-mobil.net
supervesti.ru tacbelarus.ru
surgut.zrus.org tarad.com
svolze.com
tackletarts.co
tamada69.com
tds-advert005.info
teastory.co
teenbbw.yopoint.in teenbbw.yopoint.in
teenforporn.com teguh.info
teesdaleflyballclub.co.uk texbaza.by
tehngr.ru thedownloadfromwarez.blogspot.com
templates.franklinfire.co thefotosgratis.eu
teslathemes.com thenews-today.info
testingads.pro thepantonpractice.co.uk
tetracsaudi.com theprofitsmaker.net
textads.men thfox.com
thebluenoodle.com
titslove.yopoint.in titslove.yopoint.in
tizanidine6mg.blogspot.com tizanidineandgabapentin.blogspot.com
tizanidineformigraines.blogspot.com tizanidinefibromyalgia.blogspot.com
tizanidinehcl2mg.blogspot.com tizanidinehydrochloride2mg.blogspot.com
tizanidinehcl2mgsideeffects.blogspot.com tizanidinerecreationaluse.blogspot.com
tizanidinesleepaid.blogspot.com todohr.com
tizanidinevssoma.blogspot.com tootoo.to
topvidos.ru top10-way.com
torrentred.games topanasex.com
totu.us topkarkas.com
tpu.ru torrent-to-magnet.com
tracfone.com tracxn.com
track.deriv.com trafficmania.com
tracklead.net traffpartners.com
traffic100.com traxdom.ru
trafficjunky.com truck-rece.life
traffixer.com ttsq.fr
truebeauty.cc twittruth.com
tsyndicate.com tytoona.com
tula.howotorg.ru tyumen.xrus.org
turist-strani.ru u555u.info
twelvevisionspartyofcolorado.com uamtrk.com
twinderbella.com ukkelberg.no
uasb.ru ultimatesetnewfreeallsoftupgradesystems.pw
udsgame.online
ugogo.info
um-razum.ru
umekana.ru
unisexjewelry.org unisexjewelry.org
upupa.net unpredictable.ga
urlcut.ru unrealcommander.com
uroffer.link url-img.link
uroki.net urlopener.blogspot.com.au
v24s.net usadacha.net
vandrie-ict.nl valuado.com
vchulkax.com vasileostrovsky-rayon.ru
velpanex.ru venerologiya.com
via-gra.webstarts.com via-energy-order.com
viagroid.ru viagra-soft.ru
videospornogratisx.net videositename.com
vilingstore.net
villakohlanta.nu villakohlanta.nu
vipromoffers.com vintontech.info
virtuagirl.com vip2ch.com
visionwell.com.cn vksaver-all.ru
vizag.kharkov.ua vroze.com
voloomoney.com vsesubwaysurfers.com
vzglyadriv.kg vykup-avto-krasnodar.ru
vzube.com w-journal.ru
w3data.co wallpapers-best.com
web-analytics.date watchinf.com
web.cvut.cz waterefficiency.co
website-speed-checker.site waysbetter.cn
website-speed-up.top webadvance.club
websiteexplorer.info webcamdevochka.com
wesharepics.com webmasterhome.cn
website-audit.com.ua
wedding-salon.net
wedding0venues.tk
weightatraining.com
wheelchairliftsarea.com wheelchairliftsarea.com
wholinkstome.com wholesalenfljerseys.us.com
womama.ru wiosenny-bon-1500.pl
world-mmo.com word-vorlagen.net
wurr.voila.net worldis.me
www.souvenirua.com wosik-dach.service-for-web.de
xboxster.ru woweb.com.ua
xitjw.info x-rates.ru
xjrul.com xaylapdiendanang.com
xlovecam.com yginekologa.com
xn--80ak6aa92e.com yottos.com
xsfetish.org youbloodyripper.com
xtremeeagles.net youghbould.wordpress.com
xxart.ru zajm-pod-zalog-nedvizhimosti.ru
xxx-treker.ru zaloro.com
xxxtubesafari.com zebramart.ru
yaminecraft.ru zeroredirect12.com
yellowads.men zhorapankratov7.blogspot.com
yellowproxy.net zigarettenonlinekaufen1.blox.pl
youresponsive.com zvezdagedon.ru
yoursearch.me
yugo-star.ru
yunque.pluto.ro
zajm-zalog-krasnodar.ru
zambini.ru
zeroredirect10.com
znakomstva-piter78.ru
znakomstvaonlain.ru
zone-kev717.info

482
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
1kdailyprofit.me 0912701309f8ce.com
2728fb936f0.com 1314dh.com
51unlim.ru 28n2gl3wfyb0.ru
7minuteworkout.com 3-letter-domains.net
8gold.com 5i2.net
aa9bd78f328a6a41279d0fad0a88df1901.com 8xv8.com
aa9d046aab36af4ff182f097f840430d51.com a14download.com
ad-words.ru abiente.ru
addbin.men absolute-s.ru
adtiger.tk absugars.com
akama.com acheterviagrafr24.com
albamargroup.com adrunnr.com
algerianembassy.co.in adsloads.com
alkoravto.ru advokat-grodno.by
allmarketsnewdayli.gdn allforminecraft.ru
amateurmatch.com alphavisions.net
animebox.com.ua alpinism.ru
animenime.ru anniemation.com
apimegabrowsebiz-a.akamaihd.net arcteryxstore.online
apioutoboxnet-a.akamaihd.net arendakvartir.kz
appmsr.org artdeko.info
arewater.com artparquet.ru
azadnegar.com avon-severozapad.ru
azbukafree.com azartmsl.com
azinoofficial777.ru banksrf.ru
baixar-musicas-gratis.com bavsac.com
basedecor.ru bestfortraders.com
bear.gotcher.us bestmouthwash.club
best-mam.ru big-cash.net
betune.onlinewebshop.net binomo.com
bio-japan.net bkns.vn
bioscorp.ru blackbabesporn.com
bitcoins-live.ru blagovest-med.ru
blog.f00kclan.de briomotor.co
book-bets.com bristolhotel.com
braindaily.xyz buigas.00it.com
bristolhotel.com.ua burn-fat.ga
browsepulse-a.akamaihd.net bus-offer.com
callstevens.com business-suggested.tk
cardsharp1.ru buy-forum.ru
cartierreplica.top camdolls.com
casite-513049.cloudaccess.net canoncdriverq3.pen.io
cementaresearch.se canrioloadm.gq
centraletermice.us cardiosport.com.ua
chatroulette.life carstrends2015.com
christianlouboutinreplica.win cartiertrinity.xyz
cialischsrx.com cartierwatch.xyz
clicksor.com cctva.tv
compliance-jack.top cherrypointplace.ca
contentlook.co clayvasedesigns.tk
coolwallpapers4k.info clickintext.net
daydream-studio.ru clickprotects.com
derevesendeco.com com-onlinesupport.site
dfwu1013.info compliance-andrew.top
compliance-ivan.top
cosmetic.donna7753191.ru
crirussian.ru
cyclobenzaprinevstizanidine.blogspot.com
czeshop.info
dating-time-now.com
dfwu1019.info dfwu1019.info
divci-hry.info dikx.gdn
dmmspy.com djihispano.com
doeco.ru dktr.ru
dogsrun.net dokfilms.net
drev.biz domain-tracker.com
elmifarhangi.com domoysshop.ru
eralph.tk doreenblog.online
extremal-blog.com drpornogratisx.xxx
ezigarettekaufen2.mpbloggar.se drugspowerstore.com
fanpagerobot.com dstroy.su
fastfixing.tech duplicashapp.com
fikasound.tk e-poker-2005.com
filmidivx.com eduserver.net
firstsiteguide.com elmacho.xyz
empis.magix.net
enews.tech
facebook-mobile.xyz
favorcosmetics.com
feorina.ru
fitness-video.net
fitnesspiks.com
flauntyoursite.com
flavors.me
forum.doctissimo.fr
foto-basa.com
foxweber.com foxweber.com
free-fb-traffic.com frankofficial.ru
freelinkbuilding.website.tk frcls.fr
freeseedsonline.com free-traffic.xyz
front.ru freshsuperbloop.com
fxgallery.com frivgame250.com
gallery.rennlist.com fuckingawesome.com
gamblingnerd.com ge0ip.com
gamesprite.me gifspics.com
gearsadspromo.club gnuetella.com
gelezki.com gtopstats.com
getlamborghini.ga guarrasdelporno.xxx
goforexvps.com guidefs.ru
goo.ne.jp
gpirate.com
guruofcasino.com
h2monline.com h2monline.com
hamilton.ca hermesreplica.pw
heroz.fr hexpilot.com
hjaoopoa.top homik.pw
homegardenlova.com hotkeys.com
hoterika.com hoverboard360.at
hotxnights.info inboxdollars.com
housediz.com int.search.mywebsearch.com
ido3.com integritylandscapeservices.com
imgarcade.com ivanstroi.ru
imguramx.pw jerseyschinabizwholesale.us
impresagaia.it johnrobertsoninc.com
indiakino.net juliadiets.com
insurple.com kaac.ru
irkutsk.online-podarki.com kambasoft.com
janerikholst.se karaganda.xkaz.org
kam-dom.ru kazan.xrus.org
kemerovo.zrus.org keywesthideaways.co
kerch.site kinohall.ru
keywordbasket.com kinoplen.ru
komp-pomosch.ru kmgamex.cf
ks1234.com lancheck.net
kustanay.kz lasvegaslockandsafe.com
lalalove.ru lexixxx.com
leadwayau.com lineavabit.it
linerdrilling.com luckyshop.net.ua
m292.info makis.nu
mafa-free.com manifestation.betteroffers.review
maxthon.com manyresultshub-a.akamaihd.net
medkritika.ru maranbrinfo.com.br
medmajor.ru markjaybeefractal.com
mensandals.xyz matematikus.info
menstennisforums.com max-p.men
metafilter.com medicineseasybuy.com
mexicosleevegastrectomy.com mini-modus.ru
mlf.hordo.win mirzonru.net
mmoguider.ru
mmostrike.ru
monarchfind-a.akamaihd.net
monclercheap.xyz monclercheap.xyz
moncleroutletonline.win moneyviking-a.akamaihd.net
mossmesi.com mydownlodablefiles.com
muizre.ru mygameplus.ru
musicstock.me mymobilemoneypages.com
muznachas-service.ru narutonaruto.ru
mykings.pw national-today-winning-winner.club
nacap.ru neobux-bg.info
nastydollars.com nevansk.ru
newstraveller.ru nicefloor.co.uk
nordstar.pro
northfacestore.online northfacestore.online
oakridgemo.com oballergiya.ru
oktube.ru obiavo.by
online-templatestore.com obiavo.ru
onlyforemont.ru onclkads.com
openlibrary.org oneminutesite.it
ostroike.org origin-my.ru
ovirus.ru orsonet.ru
ozoz.it osb.se11.ru
partner-cdn.men paccohichetoti.ml
partner-print.men partner-print.men
partnerads.men partnersafe.men
pestomou.info patol01.pw
photosaga.info pay2me.pl
physfunc.ru pl-top.pl
pila.pl plaff-go.ru
pladform.ru pony-business.com
plusnetwork.com popander.mobi
pogosh.com popugauka.ru
poligon.com pornhubforum.tk
pons-presse.com pospr.waw.pl
porno-home365.com privhosting.com
pornoblood.com prosperent.com
pornotubexxx.name proxyelite.biz
pornstartits.xblog.in qwesa.ru
potolokelekor.ru r-control.ru
promoheads.com rapidokbrain.com
prostitutki-rostova.org remont-comp-pomosh.ru
ranksonic.org remontvsamare.su
realnye-otzyvy.info
registry-cleaner.net
reklama-i-rabota.ru
renewablewealth.com renewablewealth.com
rezeptiblud.ru rimedia.org
robot-forex.biz risparmiocasa.bz.it
rusenvironmental.net rock-cafe.info
rybalka-opt.ru rospromtest.ru
s.lollypopgaming.com s-forum.biz
saletool.ru sack.net
sampleletters.net savememoney.co.za
santasgift.ml scanner-irvin.top
sbetodiodnye-lampy.ru seadragonherbery.com
sbricur.com search.pch.com
sdelai-prosto.ru searchlock.com
seasonvar.ru
semalt.com semalt.com
seobility.net semxiu.com
service.adtech.fr seoanalyses.com
serw.clicksor.com seoprofiler.com
shakhtar-doneck.ru sex-foto.pw
shinikiev.com.ua sfj-ror.no
shoesonlinebuy.cn shijian.ac.cn
shopvilleroyboch.com.ua simply.net
shtaketniki.kz sims-sims.ru
sibvitr.ru sinel.info
sindragosa.comxa.com sitevaluation.org
sivs.ru sizeplus.work
slowmac.tech sluganarodu.ru
snjack.info smailik.org
snjatie-geroinovoy-lomki.ru solitaire-game.ru
snowplanes.com sophang8.com
sodexo.com spb-plitka.ru
soundfrost.org squidoo.com
strag-invest.ru srgwebmail.nl
strigkaomsk.ru staff.prairiesouth.ca
svensk-poesi.com steelmaster.lv
taqplayer.info stroicol.net
taqywu51.soup.io stroiminsk.org
taximytishi.ru stroyplus.ru
theendivechronicles.com stuff-about-money.com
thepokertimer.com sumo.com
tizanidineduringpregnancy.blogspot.com superoboi.com.ua
tizanidinenarcotic.blogspot.com talant-factory.ru
tizanidinewithdrawal.blogspot.com teenbbw.yopoint.in
tomck.com template-kid.com
top-deal.com.pl tetracsaudi.com
topmira.com themeforest.net
touchmods.fr tizanidinedosage.blogspot.com
tracfone.com toonfamilies.net
tracksurf.daooda.com torrents.cd
tracksz.co trackzapper.com
trafficfactory.biz traffic100.com
ttsq.fr traffic2money.com
tupper-posuda.ru trustaffs.com
turizm.bz tube8.com
turkeyreport.tk uchetunet.su
twittruth.com urzedowski.eu
tytoona.com vekzdorov.ru
ukkelberg.no velpanex.ru
upupa.net versaut.xxx-cam.webcam
vchulkah.net video-chat.cn
vroze.com voluumtrk.com
vuclip.com vykup-avto-krasnodar.ru
wapsite.me w-journal.ru
watchmygf.net w3javascript.com
web-analytics.date watchinf.com
while.cheapwebsitehoster.com waysbetter.cn
williamrobsonproperty.com welcomeauto.ru
wleuaprpxuvr.ga whatistizanidine2mg.blogspot.com
wnhjavlhezp.gq whatsupinfoley.com
womama.ru witclub.info
worldis.me wordpress-crew.net
xn-----6kcaabbafhu7cskl7akvongwpo7hvjj.xn--p1ai xn--80atua3d.xn--p1ai
xn--e1aggki3c.xn--80adxhks xnxx-n.com
xnxxandxvideos.com yeartwit.com
xrus.org
xsfetish.org
xxxsiterips.xyz
yatrk.xyz
youghbould.wordpress.com youghbould.wordpress.com
yourporn.com zaapplesales.blogspot.com
zapiszto.pl
zastenchivosti.net
zed21.net
zhacker.net
znaturaloriginal.com
zverokruh-shop.cz

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.44 0; 10.1.0.73 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.10.3392 ### Version: V4.2022.10.3393
### Updated: Wed Oct 5 22:01:24 UTC 2022 ### Updated: Thu Oct 6 10:05:17 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.10.3392 ### Version: V4.2022.10.3393
### Updated: Wed Oct 5 22:01:24 UTC 2022 ### Updated: Thu Oct 6 10:05:17 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##