vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-04 19:50:17 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2022.09.3372 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2022-09-25 22:07:30 +00:00
parent 92c43ce6e6
commit d85fbc19f2
46 changed files with 93940 additions and 93940 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.09.3371 #### Version: V4.2022.09.3372
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.09.3371 #### Version: V4.2022.09.3372
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -14,7 +14,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2022.09.3371 #### Version: V4.2022.09.3372
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

11606
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2022.09.3371 #### Version: V4.2022.09.3372
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

11610
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

11610
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

11610
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

11610
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.10 1; 10.1.0.63 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.10 0; 10.1.0.63 0;
127.0.0.1 0; 127.0.0.1 0;

11610
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.10 1; 10.1.0.63 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.10 0; 10.1.0.63 0;
127.0.0.1 0; 127.0.0.1 0;

11610
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.10 1; 10.1.0.63 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.10 0; 10.1.0.63 0;
127.0.0.1 0; 127.0.0.1 0;

11610
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
3371 3372

11610
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

11610
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.12.6.215 0; 20.236.138.157 0;

11610
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.10 1; 10.1.0.63 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.10 0; 10.1.0.63 0;
127.0.0.1 0; 127.0.0.1 0;

11610
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.10 1; 10.1.0.63 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.10 0; 10.1.0.63 0;
127.0.0.1 0; 127.0.0.1 0;

11610
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.10 1; 10.1.0.63 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.10 0; 10.1.0.63 0;
127.0.0.1 0; 127.0.0.1 0;

11610
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.12.6.215 0; 20.236.138.157 0;

11610
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.12.6.215 0; 20.236.138.157 0;

11610
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.10 1; 10.1.0.63 1;
127.0.0.1 1; 127.0.0.1 1;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
Boardreader Bandit
G-i-g-a-b-o-t DatabaseDriverMysqli
GrapeFX JikeSpider
HMView Lightspeedsystems
Keyword Density Microsoft Data Access
Libwhisker Ninja
Nuclei Toweyabot
OutclicksBot WebAuto
Spammen crawl.sogou.com
meanpathbot seoscanners

314
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
360Spider 360Spider
404checker 80legs
ADmantX
Aboundex Aboundex
Acunetix AfD-Verbotsverfahren
AiHitBot AhrefsBot
Aipbot AlphaBot
Alligator Anarchy99
Ankit Anthill
Apexoo Aspiegel
BDCbot Atomseobot
Attach
AwarioRssBot
AwarioSmartBot
BBBike
BDFetch
BLEXBot
BackStreet BackStreet
BackWeb Bandit
Badass Barkrowler
BatchFTP BatchFTP
BetaBot Battleztar Bazinga
Bigfoot Bigfoot
Bitacle
BlackWidow BlackWidow
Blackboard
Blow Blow
BlowFish BlowFish
Bolt Boardreader
BotALot Brandwatch
Buck BuiltBotTough
Buddy Bullseye
BunnySlippers BunnySlippers
CATExplorador CATExplorador
CCBot Cegbfeieh
CODE87 CheeseBot
Calculon
CheTeam
CherryPicker
Chlooe Chlooe
Claritybot Claritybot
Cliqzbot Cliqzbot
Copier Cloud mapping
CopyRightCheck Cocolyzebot
Cogentbot
Collector
Copyscape
Crawling at Home Project Crawling at Home Project
Crescent
Curious Curious
Custo
DSearch DSearch
DTS Agent Demon
DataCha0s Devil
Digincore
Disco
DittoSpyder DittoSpyder
DnyzBot DnyzBot
Domains Project DomCopBot
DomainCrawler
EasyDL EasyDL
Ebingbong
Ecxi
EroCrawler EroCrawler
Evil Evil
ExtractorPro Exabot
FDM
FemtosearchBot FemtosearchBot
Flunky Fimap
Fuzz Freeuploader
FrontPage
FyberSpider FyberSpider
Fyrebot Fyrebot
GalaxyBot GermCrawler
Genieo GetWeb
Gigabot Getintent
Go!Zilla
GoZilla
Gotit
GrabNet GrabNet
Grabber Grabber
Grafula
GrapeFX GrapeFX
GrapeshotCrawler GrapeshotCrawler
GridBot
HMView
HTMLparser
HTTP::Lite HTTP::Lite
Haansoft Haansoft
HaosouSpider
Heritrix
Hloader Hloader
HonoluluBot
HybridBot HybridBot
IlseBot IDBot
InfoNaviRobot IndeedBot
Internet Ninja Indy Library
IstellaBot InfoTekies
JOC Web Spider Iria
JennyBot JikeSpider
JetCar
Jetty
Joomla
Jorgee Jorgee
JustView
Jyxobot
Keybot Translation-Search-Machine
Keyword Density Keyword Density
Kinza
LNSpiderguy
Lanshanbot Lanshanbot
Larbin Larbin
LeechFTP LeechGet
LibWeb LexiBot
Libwhisker
Lightspeedsystems Lightspeedsystems
LinkScan
LinkWalker LinkWalker
Linkbot Linkbot
LinkextractorPro LinksManager
LinkpadBot LinqiaScrapeBot
LinqiaMetadataDownloaderBot
Lipperhey Lipperhey
Litemage_walker
Ltx71
MFC_Tear_Sample
MIIxpc
MJ12bot MJ12bot
MSFrontPage MSFrontPage
Mag-Net
Magnet
Majestic SEO
Majestic12 Majestic12
MarkWatch
Mass Downloader Mass Downloader
Masscan
Mata Hari Mata Hari
Meanpathbot MegaIndex.ru
Microsoft URL Control Metauri
Mister PiX Microsoft Data Access
Moblie Safari Moblie Safari
Mojeek
Mojolicious
MolokaiBot MolokaiBot
Mozlila Morfeus Fucking Scanner
Musobot Msrabot
NPbot NICErsPRO
Name Intelligence Navroad
Needle
Net Vampire Net Vampire
NetSpider NetMechanic
NetZIP
Netcraft Netcraft
NimbleCrawler Nettrack
Nuclei Netvibes
Nibbler
Niki-bot
Ninja
Nutch
Offline Navigator Offline Navigator
Openfind Openvas
OrangeBot OrangeBot
OrangeSpider
OutclicksBot OutclicksBot
POE-Component-Client-HTTP OutfoxBot
PageAnalyzer PageScorer
Pandalytics Papa Foto
Pavuk PeoplePal
Petalbot
Pi-Monster Pi-Monster
Picsearch PictureFinder
Piepmatz PleaseCrawl
Pimonster
ProPowerBot
ProWebWalker
Psbot Psbot
Pu_iN
PxBroker
PyCurl
QueryN Metasearch QueryN Metasearch
Quick-Crawler
RSSingBot RSSingBot
RankActive Re-re
RankActiveLinkBot Reaper
RankFlex
RankingBot2
RankurBot
ReGet
RebelMouse RebelMouse
Recorder Recorder
Ripper Ripper
RocketCrawler
Rogerbot Rogerbot
SBIder
SEOkicks SEOkicks
SEOkicks-Robot
SEOprofiler SEOprofiler
SEOstats
SISTRIX SISTRIX
Scrapy SalesIntelligent
Screaming ScrepyBot
Searchestate Searchestate
Semrush SearchmetricsBot
SeoSiteCheckup SemrushBot
SeobilityBot SeobilityBot
SiteCheckerBotCrawler Seomoz
Site Sucker
SiteExplorer
SiteSnagger SiteSnagger
SiteSucker Snapbot
Sitebeam Sociscraper
Sitevigil
Snake
Sogou web spider Sogou web spider
SpaceBison Spanner
Spinn3r SputnikBot
Sqlmap Sqlmap
Steeler Stripper
Suzuran SuperBot
SuperHTTP
Swiftbot Swiftbot
T0PHackTeam T0PHackTeam
Teleport T8Abot
TeleportPro
Telesoft Telesoft
Telesphoreo Thumbor
Telesphorep Titan
The Intraformant Trendictionbot
TheNomad Turingos
Toata
Tracemyfile
True_Robot
Turnitin Turnitin
TurnitinBot
TwengaBot
Twice Twice
VB Project Typhoeus
VCI UnisterBot
Vagabondo V-BOT
Vacuum
VelenPublicWebCrawler VelenPublicWebCrawler
Virusdie VidibleScraper
VoidEYE Voltron
WASALive-Bot WASALive-Bot
WPScan WBSearchBot
WWW-Mechanize
WWW::Mechanize
WWWOFFLE
Wallpapers
Wallpapers/3.0 Wallpapers/3.0
WallpapersHD
WeSEE WeSEE
Web Collage Web Pix
Web Enhancer Web Sauger
Web Fetch WebCollage
WebEnhancer WebCopier
WebFetch
WebGo IS WebGo IS
WebSauger WebReaper
WebStripper
WebSucker WebSucker
Whack WebZIP
Whacker Whacker
Whatweb Whatweb
Widow
WinHTTrack
WiseGuys Robot WiseGuys Robot
Wonderbot
Woobot
Wotbox Wotbox
Xaldon WebSpider Wprecon
YoudaoBot Xenu
Zade Zauba
ZoominfoBot Zeus
ZyBorg ZoomBot
adscanner arquivo-web-crawler
archive.org_bot autoemailspider
check1.exe check1.exe
coccocbot clark-crawler
com.plumanalytics com.plumanalytics
crawler.feedback crawler4j
demandbase-bot dataforseo.com
domainsproject.org
eCatch eCatch
isitwp.com evc-batch
facebookscraper
gopher
internetVista monitor
linkdexbot
lwp-request
magpie-crawler
mediawords mediawords
netEstate NE Crawler
oBot oBot
pcBrowser plumanalytics
ripz
s1z.ru s1z.ru
satoristudio.net
scan.lol
seobility
seoscanners seoscanners
seostar serpstatbot
sexsearcher sexsearcher
sitechecker.pro sitechecker.pro
sogouspider sp_auditbot
sysscan
voyagerx.com
x22Mozilla x22Mozilla

314
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
01h4x.com
404enemy
ASPSeek ASPSeek
Abonti Abonti
Aboundexbot Aboundex
AhrefsBot Aipbot
AllSubmitter Anarchy
Anarchie Asterias
Anthill Atomseobot
Apexoo Attach
Aspiegel BBBike
BDCbot Badass
BDFetch Battleztar Bazinga
BLEXBot BlackWidow
BackStreet Blackboard
Backlink-Ceck
Barkrowler
Bigfoot
Bitacle
Black Hole
Blow Blow
BlowFish
Boardreader Boardreader
Brandprotect Bolt
Brandwatch BotALot
BuiltBotTough Bullseye
BuiltWith
BunnySlippers
BuzzSumo
CATExplorador
CSHttp CSHttp
Calculon CazoodleBot
CheeseBot CheeseBot
ChinaClaw ChinaClaw
Chlooe Citoid
Cliqzbot Claritybot
CrazyWebCrawler Cloud mapping
Crescent Cogentbot
CrunchBot Copyscape
DBLBot Cosmos
DIIbot Crawling at Home Project
Curious
Custo
CyotekWebCopy
DSearch DSearch
DTS Agent Demon
DataCha0s Digincore
Devil
DigitalPebble DigitalPebble
Dirbuster
Disco Disco
DnBCrawler-Analytics DittoSpyder
DnyzBot DomainAppender
DomainSigmaCrawler
Domains Project Domains Project
Dotbot Dotbot
Drip Drip
ECCP/1.0 EroCrawler
EMail Wolf
EasyDL
EirGrabber
Evil
Exabot Exabot
Express WebPictures Express WebPictures
Extractor FDM
EyeNetIE Firefox/7.0
Foobot FlashGet
Fuzz Freeuploader
Fyrebot FrontPage
GT::WWW G-i-g-a-b-o-t
Genieo
GetRight GetRight
Getintent
Gigabot
Go!Zilla Go!Zilla
Go-Ahead-Got-It
Gotit
Grabber Grabber
GrapeFX GrapeFX
GridBot HTMLparser
HTTrack Harvest
Havij Havij
HybridBot Heritrix
Hloader
IDBTE4M IDBTE4M
IRLbot
Id-search
Image Fetch Image Fetch
Image Sucker InfoNaviRobot
Indy Library Intelliseek
InfoTekies InternetSeer
InterGET Iskanie
JamesBOT JOC Web Spider
Joomla Jbrofuzz
JustView JetCar
Kozmosbot Jetty
JikeSpider
Keybot Translation-Search-Machine
LNSpiderguy
Larbin Larbin
LeechGet LeechGet
LexiBot
Lftp Lftp
LieBaoFast Libwhisker
Likse Likse
LinkScan
Linkbot Linkbot
LinkextractorPro
LinqiaMetadataDownloaderBot
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey
Lmspider Lmspider
Ltx71
MFC_Tear_Sample MFC_Tear_Sample
MIDown tool MIDown tool
MIIxpc
MJ12bot
MSFrontPage MSFrontPage
Mag-Net MSIECrawler
Majestic SEO Magnet
Mail.RU_Bot
Mass Downloader Mass Downloader
MauiBot MauiBot
Metauri MegaIndex.ru
Microsoft URL Control Moblie Safari
Mojeek
Mojolicious
MolokaiBot MolokaiBot
NearSite Mr.4x3
Needle Msrabot
Nessus Musobot
NPbot
Nameprotect
Navroad
Net Vampire Net Vampire
NetAnts NetAnts
NetMechanic NetLyzer
NetSpider NetSpider
NetZIP Netcraft
Nettrack NextGenSearchBot
Netvibes
Niki-bot Niki-bot
Ninja NimbleCrawler
Nimbostratus
Not
Nuclei
Nutch Nutch
Octopus
OnCrawl
OpenLinkProfiler OpenLinkProfiler
Openvas
OrangeBot OrangeBot
OrangeSpider OrangeSpider
OutclicksBot OutfoxBot
Page Analyzer POE-Component-Client-HTTP
PageThing.com PageThing.com
Panscient Pavuk
Papa Foto
PeoplePal PeoplePal
Pi-Monster Petalbot
PictureFinder
Piepmatz Piepmatz
PleaseCrawl
Pockey Pockey
Pu_iN ProWebWalker
Quick-Crawler Psbot
RankActive PyCurl
RSSingBot
RankActiveLinkBot
RankFlex RankFlex
RankingBot2 RankingBot2
RealDownload Re-re
RedesScrapy ReGet
Ripper Reaper
RocketCrawler
Rogerbot Rogerbot
SEOkicks SEOkicks
SEOprofiler SEOprofiler
SISTRIX SMTBot
SalesIntelligent ScanAlert
Scanbot Screaming
ScreenerBot ScreenerBot
ScrepyBot
Searchestate
SearchmetricsBot SearchmetricsBot
Seekport
SemanticJuice
Semrush Semrush
SeoSiteCheckup SentiBot
SeobilityBot SeobilityBot
Shodan Seomoz
Site Sucker Siphon
Sitevigil SiteCheckerBotCrawler
Snake SiteSnagger
Sottopop SlySearch
SocialRankIOBot
Sogou web spider
Spammen Spammen
SpankBot SpankBot
Spanner
SputnikBot SputnikBot
Sqlmap
Sqlworm Sqlworm
Sqworm SuperBot
Stripper SurveyBot
Sucker
Sucuri
Surfbot
Suzuran Suzuran
Szukacz Swiftbot
T8Abot T0PHackTeam
Teleport
TeleportPro TeleportPro
Telesoft Telesoft
The Intraformant TightTwatBot
Titan Titan
Toata Toata
Toweyabot Tracemyfile
Trendictionbot Trendiction
Turingos True_Robot
Turnitin TwengaBot
TurnitinBot Typhoeus
URLy Warning
UnisterBot UnisterBot
VelenPublicWebCrawler V-BOT
Vacuum
VeriCiteCrawler VeriCiteCrawler
VidibleScraper
Virusdie Virusdie
VoidEYE
WASALive-Bot WASALive-Bot
WBSearchBot WEBDAV
WISENutbot WISENutbot
WWW-Collector-E WWW::Mechanize
Wallpapers
WallpapersHD WallpapersHD
Web Auto Web Auto
Web Collage Web Fetch
Web Enhancer
Web Fuck Web Fuck
Web Pix
Web Sucker Web Sucker
WebBandit
WebCollage WebCollage
WebCopier
WebFetch
WebGo IS WebGo IS
WebLeacher WebLeacher
WebPix WebReaper
WebSauger
WebStripper WebStripper
Webshag WebWhacker
Webster WebZIP
Whack Who.is Bot
Whacker Widow
WinHTTrack Wonderbot
WiseGuys Robot
Woobot
Wotbox Wotbox
Wprecon Wprecon
Xaldon_WebSpider Xaldon_WebSpider
YoudaoBot
Zauba Zauba
Zitebot
ZmEu ZmEu
ZoomBot ZoomBot
ZyBorg
adscanner adscanner
arquivo-web-crawler
backlink-check backlink-check
cah.io.community cah.io.community
coccocbot
cognitiveseo
com.plumanalytics com.plumanalytics
crawler4j crawl.sogou.com
demandbase-bot crawler.feedback
heritrix dataforseo.com
instabid domainsproject.org
internetVista monitor
ips-agent ips-agent
iubenda-radar isitwp.com
linkdexbot linkdexbot
lwp-request magpie-crawler
pcBrowser muhstik-scan
oBot
plumanalytics plumanalytics
ripz
s1z.ru s1z.ru
scalaj-http satoristudio.net
scan.lol sexsearcher
seocompany.store sogouspider
seostar
serpstatbot
sitechecker.pro
sp_auditbot sp_auditbot
ubermetrics-technologies.com sysscan
webmeup-crawler webmeup-crawler
webpros.com
x22Mozilla
zgrab

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
6hopping.com destinationrealestate.com
coolwallpapers4k.info figuringmoneyout.com
googlemare.com hermesbirkinhandbagoutlets.com
medosmotr-ufa.ru kaac.ru
offer.wpsecurity.website moscow.online-podarki.com
pic-re.blogspot.com pk-services.ru
pricheskaonline.ru play-mp3.com
r-control.ru userequip.com
ros-ctm.ru vielporno.net
tivolibasket.it wowcasinoonline.ooo

924
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
0lovespells0.blogspot.com 000free.us
1001watch.com.ua 00author.com
101flag.ru 0daymusic.org
13tabs.com 28n2gl3wfyb0.ru
24-ak.ru 3rbseyes.com
2nt.ru 4inn.ru
2rich4bitches.com 51unlim.ru
3-letter-domains.net 6128786.com
4rent.ru 7a2rnuey1tw9ar.ru
51.la 7fon.ru
72-news.com 7wind.ru
8lufu.com 8lufu.com
aa8780bb28a1de4eb5bff33c28a218a930.com aa14ab57a3339c4064bd9ae6fad7495b5f.com
aac500b7a15b2646968f6bd8c6305869d7.com activepr.ru
abiente.ru adamoads.com
academiacsmendoza.org adobereader-free.ru
acortarurl.es adprotect.net
acunetix-referrer.com adtech.de
adloads.com adtiger.tk
admatic.com.tr adult3dgames.com
adultgalls.com advokat-grodno.by
adultmeetonline.info agahinameh.com
advertex.info
adviceforum.info
ahhjf.com ahhjf.com
albamargroup.com ahmedabadwebs.com
allcredits.su alarmobninsk.ru
allwomen.info albumsuper.info
ameblo.top alfabot.xyz
amt-k.ru all4invest.ru
anabolics.shop all4wap.ru
andpolice.com allnews24.in
ananumous.ru
android-vsem.org
angigreene.com
anjalika.co.in anjalika.co.in
antons-transporte.de apimegabrowsebiz-a.akamaihd.net
apartamentwroclaw.eu apiwebwebgetcom-a.akamaihd.net
apibrowsesmartne-a.akamaihd.net app5.letmacworkfaster.world
apifasterlightin-a.akamaihd.net appsaurus.com
apptester.tk arclk.net
aquarium-pro.ru
artel116.ru artel116.ru
asseenontv.ru aruplighting.com
auto-moto-elektronika.cz atofilms.com
autovideobroadcast.com aucoinhomes.com
baixar-musicas-gratis.com autoloans.com
balkanfarma.ru autoseo-traffic.com
banksrf.ru azartmsl.com
bannerspace.com azazaporn.com
bannertesting.com azlex.uz
bard-real.com.ua badavit.com.ua
battleforupdating.site balkanfarma.org
bavsac.com bausparen.bz.it
bayareaaeroclub.org bazaronline24.ru
beatifullandscape.co best-seo-offer.com
beauty-things.com bestofferswalkmydogouteveryday.gq
bedcapdealers.com bestofpicture.com
begalka.xyz bestserials.com
bestcoin.cc
bestkfiledxd.cf
bet365.com bet365.com
betshuckclean.com betterhdporn.com
bibys.com bibys.com
bizzliving.com big-boards.info
bjorkbacken.nu biglistofwebsites.com
blackhatworth.com boazpower.com
blacktwhite.com boc.kz
bloggerads.net bombla.org
blogsfunky672.weebly.com bonzbuddy.com
bluerobot.info bookmaker-bet.com
bouda.kvalitne.cz braip.com.br
break-the-chains.com bristolhotel.com
bristolhotel.com.ua brothers-smaller.ru
brokergid.ru brus.city
bronzeaid-a.akamaihd.net buketeg.xyz
budpost.com.ua burn-fat.ga
bukleteg.xyz business-suggested.tk
buytizanidineonlinenoprescription.blogspot.com businesxxl.com
canacopegdl.com buy-loft.ru
candelluxsklep.pl buyessay3.blogspot.ru
candy-glam-hp.com buzzonclick.com
cartierlovestore.com c-english.ru
cartiertrinity.xyz c1.onedmp.com
casablancamanor.co.za californianews.cf
ccjp.eu callmd5map.com
centrumcoachingu.com camdenmemorials.com
ciceros.co cardiosport.com.ua
cleanmypc.com cartierbraceletsreplica.pw
clevernt.com cdncash.org
clickbank.net cejewelry.xyz
clicksotrk.com cfacarrosserie74.com
cocolyze.com cheapestjerseysonwholesale.com
cocyq.inwtrade.com cheapmarmot.online
compliance-andrew.xyz christianlouboutinsaleoutletonline.us
compliance-brian.top ci.ua
compliance-irvin.xyz cicaki.net
compliance-josh.top clickso.com
compliance-julianna.top coldfilm.ru
compliance-mary.top compliance-alex.top
conciergegroup.org compliance-alexa.top
contentsexpress.com compliance-andrew.top
converse.ddsoldes.fr compliance-checker-7.info
cool-wedding.net compliance-don.top
compliance-willy.top
concealthyself.com
contextualyield.com
cookie-law-enforcement-hh.xyz
coolgamechannel.com
cordstrap.cc cordstrap.cc
corta.co craftinsta.ru
countbertwistdisp26.soup.io custom-product-labels.com
csgo4.win
customboxes4less.com
customergrowthsystems.com
customerguru.in
cymbaltaandtizanidine.blogspot.com
cyse.tk cyse.tk
daisye.top damasarenai.info
dealighted.com date-withme.com
dealitright.click
dear-diary.ru
delfin-aqua.com.ua delfin-aqua.com.ua
dentalpearls.com.au deplim.com
deutschland123.de detmebel.su
dev78.dioniqlabb.se detsky-nabytek.info
devochki.top dev33.dioniqlabb.se
dieta-personalna.pl dikx.gdn
dinosaurus.site diminishedvalueoforegon.com
discovertreasure-a.akamaihd.net
disruptingdinnerparties.com disruptingdinnerparties.com
dojki365.online dms-sw.ru
dogbreedspicture.net
dogclothing.store
dokumentalkino.net dokumentalkino.net
dollartree.info domain2008.com
domainsphoto.com domoysshop.ru
donvito.unas.cz donvito.unas.cz
doska-vsem.ru dorratex.tn
downloaddy.net doublepimp.com
earn-from-articles.com dptaughtme.com
earthmagic.info driving.kiev.ua
educatemetv.com dverimegapolis.ru
dwomlink.info
dyt.net
e705.net
edwinkonijn.com.au
ege-essay.ru
ege-russian.ru ege-russian.ru
ekto.ee elektrischezi.canalblog.com
election.interferencer.ru elektrischezigarette2.onsugar.com
elektrischezigarette2.devhub.com elitepcgames.com
elektrozigarette1.dreamwidth.org emediate.eu
elektrozigarettekaufen2.blogse.nl eropho.net
encodable.com evening-dating-club.info
erotikchat-24.com excaliburfilms.com
errorfixing.space exhibitionplus.eu
eu-cookie-law.info expdom.com
excitacion.info extstat.com
expertnaya-ocenka.ru ezigarettekaufen2.yolasite.com
ezigaretteshop2.mywapblog.com f-online.de
f07.de facecup.top
faithe.top fanoboi.com
fandlr.com farmprofi.net
faracontrol.ir fastcrawl.com
fickenprivat.info fastfixing.tech
fickkontaktehobbyhuren.com fealq.com
filkhbr.com fermersovet.ru
filmbokep69.com fillmewithhappiness.com
financetip.eu film-one.ru
finejewelryshop.ru filmi-v.online
finuse.com financepoints.eu
fix-website-errors.com find1friend.com
flash4fun.com finstroy.net
flavors.me fishingwholesale.us
floridahuntingfishingadventures.com flagcounter.me
flowersbazar.com floating-share-buttons.com
flowwwers.com foxinsocks.ru
food.dtu.dk free411games.com
foodgid.net freelifetimefuckbook.com
forex.osobye.ru freeseedsonline.com
forexunion.net
formulaantiuban.com
franch.info
franklinfire.co
free-floating-buttons.com
freevpn.space freevpn.space
freewlan.info
freshwallpapers.info freshwallpapers.info
frivgame250.com funtoonez.com
front.to fym.com.ru
fuck-paid-share-buttons.xyz galeria-zdjec.com
fuckbuddybestgilf.info garciniaxt.us
fuel-gas.com generousdeal-a.akamaihd.net
gallerily.com germes-trans.com
game-top.su getaclueamerica.com
gaz-voshod.ru getmyads24.com
gazporno.com ggiaro.com
getlamborghini.ga golden-praga.ru
girls-ufa.ru goodwinmetals.co
glogow.pl googst2.ru
goforexvps.com goroda-vsego-mira.ru
golfresa.lucania.se grand-chlen.ru
goosefishpost.bid gratuitbaise.com
gq-catalog.gq greamimgo.pw
graphicwe.org gsasearchenginerankerhelp.com
greenidesign.co gsmtlf.ru
grtyi.com hamacapty.com
grupografico-pilar.com.ar hawaiisurf.com
gsbs.com.ua hd-film.pl
gunsvicceadadebt.tk hdapp1008-a.akamaihd.net
gz2.bbsoldes.fr hdseriale.pl
hannasolution.ru hdwalls.xyz
happy.new.yeartwit.com heroz.fr
health-medical-portal.info himazin.info
heartofbeijing.blogspot.com himgaws.pw
heliko.no hkladys.com
hem.passagen.se hoholikik.club
hexpilot.com horoshieokna.com
highspeed5.net hotcore.info
hitmuzik.ru hspline.com
hmmm.cz https-legalrc.biz
hopeonthestreet.co.uk humbmosquina.tk
host-protection.com hystersister.com
host-tracker.com ifirestarter.ru
hostnow.men ifmo.ru
hotblognetwork.com ilovevitaly.ru
hotelcrocenzi.sm images.gyffu.com
hully.altervista.org importchinacoach-teach.com
iamsport.org inboundlinks.win
iblogpress.xyz indiakino.net
ideawheel.com indo-export.ru
ie.57883.net infogame.name
imk.com.ua infokonkurs.ru
interesnie-faktu.ru innodgfdriverhm.aircus.com
intimshop-fantasy.ru insider.pro
invest-pamm.ru instasexyblog.com
investmac.com intermesh.net
irunfar.com investsuccess.org
islandminingsupply.wordpress.com inzn.ru
isotoner.com istizanidinelikexanax.blogspot.com
jamiembrown.com istock-mebel.ru
janavibekken.no itronics.ca
jackwolfskinoutlet.online
jagg.info
janerikholst.se
japfm.com japfm.com
jewelryandfiligree.com javspace.net
karting196.ru javxxx18.com
ketrzyn.pl jeremyeaton.co
jose.mulinohouse.co
jwss.cc
kaac.ru
kamen-e.ru
karadene.com
keywordglobal.co.za
keywords-monitoring-success.com keywords-monitoring-success.com
keywords-monitoring-your-success.com keywordsking.com
kichenaid.ru
kino-rf.ru
kinohall.ru
kinotorka.ru
kit-opt.ru
kladrus.ru
kndxbkdx.bloger.index.hr kndxbkdx.bloger.index.hr
kollesa.ru konkursov.net
kostenloser-sex.com konoplisemena.com
kupit-adenu.ru kovrenok.ru
kwzf.net krasivoe-hd.net
ladsup.com kredit-blog.ru
laexotic.com kriokomora.info
laxdrills.com kvartiry-remont.ucoz.ru
letmacwork.world landinez.co
lietaer.com landscaping.center
link.ac languagecode.com
liveinternet.ro laserpen.club
loadingpages.me lasvegaslockandsafe.com
lodki-pvh.dp.ua layola.biz.tc
loginduepunti.it lecbter-relationships.ga
lolnex.us lego4x4.ru
lookingglassemb.com lescinq.com
luxmagazine.cf lexiangwan.com
m-google.xyz libertybilisim.com
machicon-ueno.info lida-ru.com
mafcards.ru lionking-1994.blogspot.com
magicalfind-a.akamaihd.net livefixer.com
makenahartlin.com livingroomdecor.info
makis.nu localmatchbook.com
managerpak204.weebly.com lombardfinder.ru
mastershef.club losangeles-ads.com
maxxtor.eu lottospring.com
mebeldekor.com.ua lovasszovetseg.hu
mecash.ru m3gadownload.pl
medmajor.ru mamasuper.prom.ua
member-quiz.com megavolt.net.ua
metallosajding.ru mex-annushka.ru
microsearch.ru mhi-systems.ru
misandesign.se michellblog.online
mixed-wrestling.ru mikozstop.com
mobicover.com.ua mikrobiologies.ru
mil-stak.com
mindeyegames.com
mirzonru.net
mixx.com
mmog-play.ru
mobplayer.net
mobplayer.ru
mobstarr.com mobstarr.com
mokrayakiska.com modenamebel.ru
monarchfind-a.akamaihd.net moivestiy.biz
monclerboots.xyz more-letom.ru
moskva.nodup.ru moyaterapiya.ru
mosrif.ru
mrinsidesales.com mrinsidesales.com
mydearest.co mrvideospornogratis.xxx
myfreemp3.eu mrwhite.biz
myliveblog.ru musicas.baixar-musicas-gratis.com
na-telefon.biz musicstock.me
napalm51.nut.cc mydownlodablefiles.com
nardulan.com mywallpaper.top
natali-forex.com narkologiya-peterburg.ru
naval.jislaaik.com nastroyke.net
nibbler.silktide.com netanalytics.xyz
ningessaybe.me netvouz.com
novatech.vn nicefloor.co.uk
nudepatch.net nikhilbahl.com
nuker.com njpalletremoval.com
o-o-6-o-o.ru nofreezingmac.click
obiavo.ru notasprensa.info
odoratus.net notfastfood.ru
offer.camp november-lax.com
offside2.5v.pl novosti-hi-tech.ru
oil-td.ru ntic.fr
okeinfo.online obiavo.in
oklogistic.ru oda.as
oneshotdate.com omgtnc.com
online-zaymy.ru onetravelguides.com
onlinewritingjobs17.blogspot.ru online-hit.info
onload.pw oops-cinema.ru
onlyporno.ru ourtherapy.ru
ordernorxx.com
ostroike.org
outshop.ru outshop.ru
paintingplanet.ru ownshop.win
parajumpersjakkesalgnorge.info paperwritingservice17.blogspot.ru
partnerworkroom.men paradontozanet.ru
pavlodar.xkaz.org parlament.biz
perm-profnastil.ru partner-pop.men
picturesmania.com paydayloanslocal.com
pijoto.net pcgroup.com.uy
pinkduck.ga penisvergrotendepillennl.ovh
piratecams.com percin.biz.ly
pix24x7.com perfection-pleasure.ru
perso.wanadoo.es
piccshare.com
pillscheap24h.com
pixshark.com pixshark.com
pk-pomosch.ru pliks.pl
pl.aasoldes.fr poem-paying.gq
plugingeorgia.com
poiskzakona.ru poiskzakona.ru
polska-poezja.com polimga.pw
poptool.net popup-hgd.xyz
popunder.net pornosee.info
porndroids.com pornosemki.info
porno-video-chati.ru pornotubs.com
porodasobak.net potolokelekor.ru
pourvous.info pr-ten.de
preconnubial.usuby.site producm.ru
preventheadacheguide.info proekt-gaz.ru
privatbank46.ru qor360.com
pro-okis.ru questionmarque.ch
professionalwritingservices15.blogspot.ru rapidgator-porn.ga
profitwithalex.info redhotfreebies.co.uk
ptr.ruvds.com remont-fridge-tv.ru
purchasepillsnorx.com rentalcarnavi.info
push-ad.com royalcar-ufa.ru
qcstrtvt.bloger.index.hr rusenvironmental.net
ragecash.com rutor.vip
rankingchart.de sabaapress.com
reelheroes.net sadaholding.com
registrysweeper.com samara.rosfirm.ru
reimageplus.com samoiedo.it
relatodelpresente.com.ar samolet.fr
remontgruzovik.ru
rialp.getenjoyment.net
ringtonepartner.com
rique.host.sk
robot-forex.biz
rocis.site
rocketchange.ru
roll123.com
rossanasaavedra.net
royalads.net
rubanners.com
rucrypt.com
runstocks.com
russintv.fr
sady-urala.ru
sape.top
sarafangel.ru sarafangel.ru
sarahmilne.top saveriopiazza.it
sashagreyblog.ga scalerite.co.za
satellite.maps.ilovevitaly.com scanner-julia.top
sayyoethe.blogspot.co.za
scanner-andrew.top
scanner-julianna.top scanner-julianna.top
scanner-mark.top scanner-willy.top
scanner-walter.top scanspyware.net
securityallianceservices.com sdelai-prosto.ru
seocdvig.ru searchinterneat-a.akamaihd.net
sex-tracker.com seksotur.ru
sex-watch.com sell-fb-group-here.com
sexcamamateurchat.com semrush.com
sexkrasivo.net senger.atspace.co.uk
sexobzor.info seo-2-0.com
sexvideo-sex.com sexvideo-sex.com
sexytrend.ru
sharebutton.org
sharpchallenge.com sharpchallenge.com
shikiso.info shinikiev.com.ua
shop.acim.org shoesonlinebuy.cn
silktide.com sigmund-freud.co.uk
sim-service.net silverage.ru
simplesite.com silvermature.net
site-speed-checker.site simply.net
siteexpress.co.il site3.free-share-buttons.com
sizeplus.work sitevalued.com
skytraf.xyz skanninge.se
slayerlife.com skypasss.com
sladkoevideo.com
slavic-magic.ru
slkrm.ru slkrm.ru
slutloadlive.com sloopyjoes.com
sneakyboy.com slowmac.tech
snworks.com small-games.biz
soc-proof.su soc-proof.su
socialbookmarksubmission.org socialbookmarksubmission.org
soft1.ru socialseet.ru
sosdepotdebilan.com socialtrade.biz
spacash.com softxaker.ru
spamnuker.com spamnuker.com
stats-collector.org spanking.to
stillmiracle.com spidtest.space
strigkaomsk.ru stathat.com
strongholdsb.ru stauga.altervista.org
studiofaca.com stjamesschool.info
studworks.org strongsignal-a.akamaihd.net
summerlinhomes411.info stroy-portal22.ru
sumo.com strv.se
suture.co superiends.org
swinger-mobil.net supermama.top
supers.com.ua
sygraem.com sygraem.com
symbaloo.com talant-factory.ru
szamponrevita.pl teenporn18.net
tattoo33.ru telegramdownload10.com
testingads.pro thefarmergame.com
theendivechronicles.com thefotosgratis.eu
tizanidineinteractions.blogspot.com titslove.yopoint.in
tizanidinesleepaid.blogspot.com tizanidine6mg.blogspot.com
tizanidineusedfor.blogspot.com tizanidineandcipro.blogspot.com
tizanidinevssoma.blogspot.com tizanidinehcl2mgtablet.blogspot.com
tjkckpytpnje.com tizanidinehydrochloride2mg.blogspot.com
topclickguru.com tizanidinenarcotic.blogspot.com
tizanidinepills.blogspot.com
tobeyouday.win
tomatis.gospartner.com
topanasex.com
topflownews.com
torrentdownloadhub.com torrentdownloadhub.com
totu.us torrentred.games
toyota.7zap.com trafaret74.ru
traffic-club.info trafficfactory.biz
traffic2cash.org trafficmania.com
trafficmp.com trustl.life
tube8.com tubeline.biz
tubo360.com tuberkulezanet.ru
tuckpointingmasonrysystems.com tuberkuleznik.ru
tversvet.ru turvgori.ru
tvorozhnaja-zapekanka-recept.ru tvand.ru
twelvevisionspartyofcolorado.com unblocksit.es
twiclub.in unimodemhalfduplefw.pen.io
u-cheats.ru uptimechecker.com
uggbootsoutletsale.us urengoy.pro
uhdtv.website urlcut.ru
ukrtvir.com.ua urll.eu
undergroundcityphoto.com vasileostrovsky-rayon.ru
uptime-as.net vesnatehno.ru
uptime.com via-gra.webstarts.com
urccvfmc.bloger.index.hr viagroid.ru
us-america.ru videonsk.com
utrolive.ru vipsexfinders.com
uytmaster.ru vriel.batcave.net
vgoloveboli.net vseuznaem.com
video--production.com vsexkontakte.net
vksaver-all.ru vzube.com
volgograd.xrus.org wareseeker.com
vrotike.ru webalan.ru
vsdshnik.com webjam.com
vseigru.one webnode.me
w3data.co webradiology.ru
warningzscaler.heraeus.com
watchmygf.net
webs.com webs.com
websitevaluebot.com webscouter.net
wedding0venues.tk website-speed-up.site
wheelchairliftsarea.com wechatdownload10.com
whiteelephantwellington.com weightatraining.com
wholinkstome.com wfb.hatedriveapart.com
williamrobsonproperty.com whatsappdownload10.com
wingsofrefuge.net where-toget.com
witclub.info wholesalejerseys-cheapest.com
woman-h.ru wiosenny-bon-1500.pl
woman-orgasm.ru womama.ru
womensplay.net womens-journal.net
wonderfulflowers.biz
workle.website
worldis.me worldis.me
worldlovers.ru wrz0iuebwhp5fg.freeddns.com
www.jbetting.com www.arenda-yeisk.ru
www.event-tracking.com
x-lime.net
x-musics.com
x-true.info x-true.info
xedserver.com xblog.in
xerox-douglas.cf
xfluro.com
xitjw.info
xjlottery.com
xn-----7kceclhb4abre1b4a0ccl2fxch1a.xn--p1ai
xn----7sbaaabaei0cc8aj5bj0bncejx.xn--p1ai xn----7sbaaabaei0cc8aj5bj0bncejx.xn--p1ai
xn--80aaagvmjabrs1aoc9luc.xn--p1ai xn----8sbdbjgb1ap7a9c4czbh.xn--p1acf
xn--80ahvj9e.xn--p1ai xn--80aagddcgkbcqbad7amllnejg6dya.xn--p1ai
xn--80aanaardaperhcem4a6i.com
xn--c1acygb.xn--p1ai
xn--d1acah0c.xn--p1ai
xn--h1aakne2ba.xn--p1ai
xpresscare.ru xpresscare.ru
y8games-free.com xzlive.com
yadro.ru yeartwit.com
yaminecraft.ru yoshkarola.zrus.org
yebocasino.com your-bearings.com
yhit.press youresponsive.com
ynymnwbm.bloger.index.hr yurgorod.ru
yourads.website zaapplesales.blogspot.com
yourporngay.com zaimhelp.ru
yun56.co zerocash.msk.ru
zagadki.in.ua zeroredirect5.com
zeroredirect12.com zhongwenlink.com
zirondelli.it zmoda.hostreo.com
znakomstva-piter78.ru znakomstva-moskva77.ru
zolotoy-lis.ru zoolubimets.ru
zrelaya.pw

480
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
0lovespells0.blogspot.com 1-99seo.com
0n-line.tv 100searchengines.com
123any.com 101raccoon.ru
2ads.co.uk 1j7740kd.website
34.gs 6128786.com
4rent.ru
72-news.com
9med.net
aa9bd78f328a6a41279d0fad0a88df1901.com aa9bd78f328a6a41279d0fad0a88df1901.com
adbetclickin.pink abtasty.com
adclickservice.com ads.tremorhub.com
adobereader-free.ru adsloads.com
adsfresh.men ahhjf.com
adultfullhd.com akusherok.ru
adzerg.com alarmobninsk.ru
alessandraleone.com alert-fjg.xyz
all4invest.ru allcredits.su
allsilver925.co.il angigreene.com
angel1777.kz anlimebel.kiev.ua
arendakvartir.kz apartmentratings.com
artparquet.ru apibatbrowsecom-a.akamaihd.net
asmxsatadriverin.aircus.com autorn.ru
autobudpostach.club autoseo-traffic.com
babespcs.com azazaporn.com
backgroundpictures.net azbaseimages.net
bad-stars.net azlex.uz
balla-boo.se balans.shahterworld.org
bank.uz baltgem.com
bannerpower.com baoxaydung.com.vn
bayareaaeroclub.org bedcapdealers.com
berdasovivan.ru
beremenyashka.com
best-businessman.ru
bet365.com
bio.trade-jp.net
biznesrealnost.ru biznesrealnost.ru
bluejays-jerseys.us blackplanet.com
boazpower.com blog.axant.it
brimstonehillfortress.org bloggedporn.com
bristolhotel.com blogsfunky672.weebly.com
buchananshardware.com boobsimge.com
budilneg.xyz bristolhostel.com
bumble.cheapwebsitehoster.com buckspar.gq
buttons-for-website.com buehne-fuer-menschenrechte.de
c1.onedmp.com bvlgariring.xyz
cactussoft.biz bytimedance.ru
callcafe.info calc-for-credit.ru
candlewooddentalcentre.com.au californianews.cf
cartierreplica.xyz candiceloves.us
cdnanalytics.xyz carsdined.org
christianlouboutinreplica.win cejewelry.xyz
cinemaflix.website ceotrk.com
compliance-walter.top cfacarrosserie74.com
cookie-law-enforcement-ff.xyz changde.58.com
cosmetic.donna7753191.ru chatroulette.online
craftinsta.ru chatseo.com
dailyrank.net cheapjerseysfootballshop.com
dairyindia.in check-this-out-now.online
darodar.com choosecuisine.com
deadlinkchecker.com clickzzs.nl
dignitasdata.se clodo.ru
discovertreasurenow.com collegeessay19.blogspot.ru
dispo.de com-secure.download
dms-sw.ru compliance-mary.top
doeco.ru constantaservice.net
dollartree.info coolwallpapers-hd.com
downloader12.ru coop-gamers.ru
downloadkakaotalk.com custom-product-labels.com
drupa.com cyprusbuyproperties.com
electrik-avenue.com dataloading.net
elektrozigarettekaufen2.blogse.nl dellalimov.com
elkacentr.ru den-noch24.ru
erotag.com dev.citetick.com
erotik-kostenlos.net dinkolove.ya.ru
essayassist.com dipstar.org
extremepornos.net dirtpics.pw
facebook-mobile.xyz distver.ru
facecup.top domainsatcost.com
filmci.pro domination.ml
firstsiteguide.com downloads-whatsapp.com
flprog.com downtuptv.gq
folowsite.com doxyporno.com
forum.poker4life.ru dprtb.com
forumprofi.de dvd-famille.com
foto-basa.com eksprognoz.ru
free-social-buttons.xyz eldiariodeguadalajara.com
freelifetimefuckbook.com elektrischezi.canalblog.com
elvenmachine.com
enthuse.computernetworksonline.com
eorogo.top
eu-cookie-law.blogspot.com
ezigarettenshop1.yolasite.com
f5mtrack.com
fable.in.ua
fettefrauen.net
forpackningsutveckling.se
fr.netlog.com
free-traffic.xyz
free411games.com
freeuploader.com freeuploader.com
fugarif.ga fres-news.com
futbolkisales.ru froggytube.com
galleryawesome.com fx-brokers-review.com
genericviagrasildenafiled.net gelezki.com
gonextmedia.com given2.com
gotorussia.com globalsurfari.com
greenzaim.ru goldandcard.ru
guarrasdelporno.xxx goodly.pro
healthcarestore.info gpms.org.my
hebr.myddns-flir.com greatfind-a.akamaihd.net
hermesbracelets.xyz greenidesign.co
hosting-tracker.com groupmoney.ru
hotel-mkad.ru guardlink.com
house.sieraddns.com hd-film.pl
houston-vikings.com hermesbirkinhandbagoutlets.com
i-midias.net.br hit-men.men
hobild.net
hotdl.in
hunterboots.online
iamsport.org
iboss.com iboss.com
igrovyeavtomaty777.ru ilo134uloh.com
ihc2015.info iloveitaly.ru
ikritikimou.gr imabase.com
images-free.net indetiske.ya.ru
impisr.ru infowarcraft.ru
incanto.in.ua insider.pro
infostatsvc.com isitpaleo.info
irkutsk.online-podarki.com ispaniya-costa-blanca.ru
isoveti.ru izismile.com
joy-penguin.com izoll.ru
khafre.us jav-fetish.com
kino-rating.ru jav-way.site
kliksaya.com justbcause.com
kopihijau.info jwss.cc
kostenlos-sexvideos.com jyvopys.com
kupiproday.com.ua keywordsking.com
lasvegaslockandsafe.com kinobaks.com
leftofcentrist.com klikbonus.com
lennatin.info lawyers.cafe
liumimgx.pw lesbian.xyz
ljusihus.se lignofix.ua
machicon-akihabara.info lion.playtap.us
marmitaco.cat live-cam6.info
meet-flirt-dating.com louboutinreplica.pw
meetlocalchicks.com marcogrup.com
mesbuta.info marwer.info
michaelkorsoutlet.store medispainstitute.com.au
mikozstop.com medizinreisen.de
meds-online24.com
miniature.io
mobioffertrck.com mobioffertrck.com
mobplayer.ru most-kerch.org
monarhs.info mp3downloadhq.com
moomi-daeri.com mrsdalloways.com
moscow-clining.ru multgo.ru
mrinsidesales.com musflashtv.com
music.utrolive.ru narkologiya-penza.ru
mybackgroundlandscape.blogspot.com net-profits.xyz
mydearest.co newhairstylesformen2014.com
northfacestore.online nodding-passion.tk
ntic.fr nuit-artisanale.com
nuup.info oralsexfilme.net
offers.bycontext.com ostroike.org
office-windows.ru ozas.net
omgtnc.com ozoz.it
onlainbesplatno.ru pammik.ru
online-hit.info panicatack.com
online-sbank.ru pdns.cz
onlineporno.site pills24h.com
osb.se11.ru pinkduck.ga
outpersonals.com plastweb.ru
parvezmia.xyz play.leadzupc.com
pathwhelp.org poiskzakona.ru
pechikamini.ru popcash.net
pekori.to poquoson.org
pharmacyincity.com
piccshare.com
poisk-zakona.ru
pons-presse.com
popander.mobi
porn-w.org
porngalleries.top porngalleries.top
presleycollectibles.com pornoklad.ru
prizestohandle.club pornonik.com
pronorm.fr pornozhara.com
prostitutki-astana.org praisong.net
prostitutki-rostova.org privatefx-in.ru
realresultslist.com pro-tec.kz
redhotfreebies.co.uk producm.ru
remont-komputerov-notebook.ru professionaldieselcare.com
remorcicomerciale.ro proftests.net
prostitutki-yaroslavlya.org
pyrodesigns.com.au
r-e-f-e-r-e-r.com
rebrand.ly
renewablewealth.com renewablewealth.com
retreatia.com rentehno.ru
rimedia.org revistaindustria.com
robot-forex.biz rfserial.net
rockprogblog.com rique.host.sk
rucrypt.com rixpix.ru
rutor.vip royalvegascasino.com
sarf3omlat.com runofilms.ru
sarahmilne.top
scalerite.co.za scalerite.co.za
sdrescher.net scanner-walter.top
searchaddis.com scat.porn
searchmywindow-a.akamaihd.net semxiu.com
serdcenebolit.com seo-platform.com
servethis.com seo-smm.kz
sexsaoy.com seoprofiler.com
share-buttons-for-free.com sex.hotblog.top
shareyards.com sextracker.be
shoppingmiracles.co.uk sharebutton.net
siteexpress.co.il shijian.ac.cn
skylta.com shikiso.info
soc-proof.su shoppingjequiti.com.br
spidtest.org shtora66.ru
sport-video-obzor.ru sinestesia.host.sk
spy-sts.com skincrate.net
superlist.biz sledstvie-veli.net
superoboi.com.ua sockshare.net
svensk-poesi.com soheavyblog.com
swsociety.se soietvousmaime.fr
syndicate.fun starpages.net
tam-gde-more.ru stefanbakosab.se
tasteidea.com stop-gepatit.te.ua
taximytishi.ru svetlotorg.ru
teencastingporn.com t-bygg.com
the-trader.net tanieaukcje.com.pl
thebluffs.com texbaza.by
tizanidine4mg.blogspot.com tizanidinedosage.blogspot.com
top1-seo-service.com tizanidinedosageforsleep.blogspot.com
torontoplumbinggroup.com tizanidinedruginteractions.blogspot.com
toursmaps.com tizanidineduringpregnancy.blogspot.com
trackmedia101.com tizanidinefibromyalgia.blogspot.com
tracksz.co tizanidineorflexeril.blogspot.com
todohr.com
torrent-newgames.com
torrentgamer.net
tri-slona.org
triplepanda.xyz
trudogolik.net trudogolik.net
trustedmaccleaner.com tsan.net
u17795.netangels.ru unrealcommander.org
ugogo.info uptimebot.net
uk-zheu20.ru varikozdok.ru
ukrtextbook.com via-energy-acquistare.com
umaseh.com visionwell.com.cn
urll.eu
usbggettwku.ga
vandrie-ict.nl
varbergsvind.se
virtualbb.com
vksaver-all.ru
vladhistory.com
volgograd.xrus.org
voloslove.ru
volume-pills.biz volume-pills.biz
vvpg.ru waysbetter.cn
wedding0venues.tk web-betting.ru
where-toget.com wesharepics.info
whos.amung.us wesharepics.site
witherrom55.eklablog.fr wetgames.ru
ww1943.ru wikes.20fr.com
xaylapdiendanang.com woodyguthrie.se
xn----itbeirbjbi7bc6bh2d.xn--p1ai wpthemedetector.co.uk
xn--80aodinpgi.xn--p1ai xcc24.pl
xxx-treker.ru xn--80aikhbrhr.net
yoshkarola.zrus.org yougetsignal.com
you-shall-not-pass.is74.ru zigarettenonl.canalblog.com
youandcredit.ru zvezdagedon.ru
zeroredirect11.com
zixizop.net.ru
znakomstva-piter78.ru
zoogdinsney.com
zvetki.ru

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.10 0; 10.1.0.63 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.09.3371 ### Version: V4.2022.09.3372
### Updated: Sun Sep 25 10:03:18 UTC 2022 ### Updated: Sun Sep 25 22:01:30 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.09.3371 ### Version: V4.2022.09.3372
### Updated: Sun Sep 25 10:03:18 UTC 2022 ### Updated: Sun Sep 25 22:01:30 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##