vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-10 06:15:06 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2022.10.3428 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2022-10-23 22:07:07 +00:00
parent 73d220a73a
commit 02cd29d13e
46 changed files with 91273 additions and 91273 deletions
Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.10.3427 #### Version: V4.2022.10.3428
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.10.3427 #### Version: V4.2022.10.3428
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -14,7 +14,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2022.10.3427 #### Version: V4.2022.10.3428
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

11272
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2022.10.3427 #### Version: V4.2022.10.3428
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

11276
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

11276
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

11276
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

11276
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.87 1; 10.1.0.77 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.87 0; 10.1.0.77 0;
127.0.0.1 0; 127.0.0.1 0;

11276
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.87 1; 10.1.0.77 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.87 0; 10.1.0.77 0;
127.0.0.1 0; 127.0.0.1 0;

11276
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.87 1; 10.1.0.77 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.87 0; 10.1.0.77 0;
127.0.0.1 0; 127.0.0.1 0;

11276
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
3427 3428

11276
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

11276
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.232.46.134 0; 20.237.229.226 0;

11276
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.87 1; 10.1.0.77 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.87 0; 10.1.0.77 0;
127.0.0.1 0; 127.0.0.1 0;

11276
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.87 1; 10.1.0.77 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.87 0; 10.1.0.77 0;
127.0.0.1 0; 127.0.0.1 0;

11276
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.87 1; 10.1.0.77 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.87 0; 10.1.0.77 0;
127.0.0.1 0; 127.0.0.1 0;

11276
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.232.46.134 0; 20.237.229.226 0;

11276
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.232.46.134 0; 20.237.229.226 0;

11276
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.87 1; 10.1.0.77 1;
127.0.0.1 1; 127.0.0.1 1;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
Aspiegel CODE87
EasyDL FHscan
Ecxi HaosouSpider
ExtLinksBot JustView
Internet Ninja Mail.RU_Bot
Leap Sociscraper
LinqiaScrapeBot Virusdie
Mass Downloader coccocbot
Site Sucker scalaj-http
polaris version serpstatbot

316
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
360Spider 360Spider
ADmantX 80legs
AIBOT
ASPSeek ASPSeek
Abonti Abonti
AiHitBot AfD-Verbotsverfahren
Alligator AhrefsBot
Anarchy Aipbot
Alexibot
AllSubmitter
Ankit Ankit
Anthill
Apexoo Apexoo
Asterias Attach
AwarioSmartBot AwarioSmartBot
BBBike BBBike
BDFetch BDCbot
BLEXBot
BackStreet
BackWeb
Backlink-Ceck
Bandit Bandit
BatchFTP Barkrowler
Bigfoot BetaBot
Bitacle Bitacle
Black Hole BlackWidow
Buddy BotALot
BuiltWith Buck
Bullseye Bullseye
BunnySlippers
BuzzSumo
CATExplorador CATExplorador
CODE87 CCBot
CSHttp CazoodleBot
Calculon Cegbfeieh
CensysInspect CensysInspect
CheTeam
CherryPicker CherryPicker
Cliqzbot ChinaClaw
Cloud mapping Citoid
Collector Cocolyzebot
Craftbot Cosmos
CrazyWebCrawler CrazyWebCrawler
Crescent Custo
CrunchBot CyotekWebCopy
DBLBot
DIIbot DIIbot
DTS Agent DTS Agent
DatabaseDriverMysqli DataCha0s
Deusu Demon
DigitalPebble Discoverybot
Dirbuster Dispatch
Discobot DittoSpyder
DnBCrawler-Analytics
DnyzBot DnyzBot
DomCopBot DomCopBot
DomainAppender DomainCrawler
DomainSigmaCrawler DomainSigmaCrawler
EMail Siphon DomainStatsBot
EasyDL Download Wonder
Ebingbong ECCP/1.0
EirGrabber Ecxi
Evil ExtLinksBot
Extractor
Extreme Picture Finder Extreme Picture Finder
Ezooms EyeNetIE
Foobot FDM
GermCrawler Fimap
Firefox/7.0
Flunky
Freeuploader
FrontPage
FyberSpider
GT::WWW
GalaxyBot
Getintent Getintent
Grabber Gigabot
Go!Zilla
Gotit
GrabNet
Grafula Grafula
GrapeFX
GrapeshotCrawler
GridBot GridBot
HEADMasterSEO HaosouSpider
HMView Harvest
HTTrack Havij
IlseBot IRLbot
IndeedBot Iblog
Indy Library Id-search
InfoTekies Image Fetch
InternetSeer InfoNaviRobot
InterGET
IstellaBot IstellaBot
JamesBOT
Jbrofuzz Jbrofuzz
JennyBot JetCar
Jetty Joomla
Jorgee Jyxobot
Kozmosbot Keybot Translation-Search-Machine
LNSpiderguy Keyword Density
Kinza
Lanshanbot Lanshanbot
LexiBot LexiBot
Lftp Lftp
LibWeb
Libwhisker
Lightspeedsystems Lightspeedsystems
LinkScan
Linkbot Linkbot
LinksManager
Lipperhey Lipperhey
Lipperhey Spider
Litemage_walker
Lmspider Lmspider
MFC_Tear_Sample
MIDown tool MIDown tool
MJ12bot
MSFrontPage
Mag-Net Mag-Net
Majestic SEO Magnet
Mail.RU_Bot
MarkWatch MarkWatch
Mass Downloader Mass Downloader
Masscan Masscan
Mata Hari
Meanpathbot Meanpathbot
Metauri Mediatoolkitbot
MicroMessenger MicroMessenger
Minefield Mister PiX
Mojolicious Moblie Safari
MolokaiBot Mojeek
Morfeus Fucking Scanner
Mozlila Mozlila
Mr.4x3 Mr.4x3
Msrabot Musobot
Name Intelligence Navroad
Nameprotect
NearSite
Net Vampire Net Vampire
NetLyzer NetLyzer
NetMechanic NetMechanic
NetZIP
Netvibes Netvibes
NextGenSearchBot
Nibbler Nibbler
Niki-bot
Nimbostratus
Nuclei
Nutch Nutch
Octopus Offline Navigator
OnCrawl OnCrawl
OpenLinkProfiler OutclicksBot
OpenVAS PECL::HTTP
Openfind PHPCrawl
OutfoxBot
POE-Component-Client-HTTP POE-Component-Client-HTTP
PageAnalyzer PageAnalyzer
PageGrabber
PageScorer
PageThing.com PageThing.com
Panscient Pavuk
Picscout PeoplePal
Piepmatz Picsearch
Pixray PleaseCrawl
ProWebWalker ProWebWalker
Probethenet QueryN Metasearch
Pu_iN RankActive
PyCurl RankingBot
RSSingBot ReGet
RankFlex
RankingBot2
RealDownload RealDownload
RebelMouse RepoMonkey
RocketCrawler Rogerbot
SBIder
SEOkicks SEOkicks
SEOkicks-Robot SEOstats
SEOlyticsCrawler
SEOprofiler
SISTRIX SISTRIX
SMTBot Screaming
SalesIntelligent
ScanAlert
Scanbot
ScoutJet
Scrapy
ScrepyBot ScrepyBot
SearchmetricsBot Semrush
Seekport SentiBot
SemanticJuice
SemrushBot
SeobilityBot SeobilityBot
Seomoz Seomoz
Shodan Shodan
SiteCheckerBotCrawler Site Sucker
SiteSnagger Sitebeam
SiteSucker Siteimprove
Sitevigil Sitevigil
SlySearch Snake
Snapbot Snapbot
Sogou web spider SocialRankIOBot
Sociscraper
Sottopop Sottopop
SpaceBison
Spammen Spammen
Sqworm Spinn3r
Sucker Sqlworm
Sucuri Stripper
SuperBot Surfbot
SurveyBot
Szukacz Szukacz
T0PHackTeam
Teleport
Telesoft
Telesphoreo Telesphoreo
The Intraformant TheNomad
TightTwatBot Thumbor
Titan Titan
Toata
Toweyabot Toweyabot
Tracemyfile
Trendiction Trendiction
Turnitin TurnitinBot
Twice TwengaBot
URLy Warning Typhoeus
Upflow UnisterBot
VB Project
VCI VCI
Vacuum
Vagabondo Vagabondo
VelenPublicWebCrawler WASALive-Bot
VoidEYE WWW-Mechanize
Voil
Voltron
WBSearchBot
WISENutbot
WWW-Collector-E
WWW::Mechanize WWW::Mechanize
Wallpapers/3.0 Wallpapers/3.0
Web Auto
Web Enhancer Web Enhancer
Web Fuck Web Fuck
Web Pix
Web Sauger
Web Sucker Web Sucker
WebFuck WebBandit
WebEnhancer
WebImageCollector WebImageCollector
WebPix WebReaper
Webalta Webalta
WebsiteQuester WebmasterWorldForumBot
Webshag
Website Quester
Webster Webster
Whacker Who.is Bot
Whatweb WinHTTrack
Widow Wotbox
WiseGuys Robot
Wprecon Wprecon
Xaldon WebSpider
Xaldon_WebSpider
Xenu Xenu
ZmEu YoudaoBot
ZyBorg Zade
Zermelo
Zeus
ZoominfoBot
archive.org_bot archive.org_bot
arquivo-web-crawler arquivo-web-crawler
autoemailspider autoemailspider
check1.exe cah.io.community
coccocbot
com.plumanalytics
crawl.sogou.com crawl.sogou.com
crawler.feedback crawler.feedback
dataforseo.com dataforseo.com
demandbase-bot
eCatch eCatch
evc-batch gopher
isitwp.com instabid
iubenda-radar linkdexbot
lwp-request meanpathbot
lwp-trivial oBot
pcBrowser
scalaj-http scalaj-http
scan.lol
seocompany.store seocompany.store
serpstatbot seoscanners
sexsearcher sexsearcher
spyfu sitechecker.pro
sp_auditbot
sysscan sysscan
tAkeOut x09Mozilla
trendiction.com zauba.io
trendiction.de
webmeup-crawler
webpros.com
xpymep1.exe
zgrab zgrab

304
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
360Spider 360Spider
80legs ASPSeek
ADmantX
AIBOT
ALittle Client
Abonti Abonti
Aboundexbot
Acunetix
AfD-Verbotsverfahren AfD-Verbotsverfahren
AiHitBot Aipbot
Alligator Alligator
AlphaBot Anthill
Anarchy99 Aspiegel
Asterias AwarioSmartBot
BDCbot BDFetch
Battleztar Bazinga Badass
Bigfoot Bigfoot
Blackboard Black Hole
Blow BlowFish
Boardreader
Bolt Bolt
Brandprotect BotALot
BuiltBotTough Bullseye
BuiltWith BunnySlippers
Cegbfeieh Cegbfeieh
CensysInspect Cloud mapping
CherryPicker Copier
ChinaClaw Cosmos
Cocolyzebot Crawling at Home Project
Cogentbot
Collector
CopyRightCheck
CrazyWebCrawler CrazyWebCrawler
Crescent CrunchBot
Curious Curious
CyotekWebCopy Custo
DBLBot DBLBot
DSearch DataCha0s
DTS Agent
DatabaseDriverMysqli
Demon Demon
Devil DigitalPebble
Discoverybot Dispatch
DnyzBot DittoSpyder
DomCopBot DomCopBot
Domains Project DomainStatsBot
Dotbot
Download Wonder Download Wonder
ECCP/1.0
EMail Siphon EMail Siphon
EMail Wolf EMail Wolf
EasyDL
Ebingbong Ebingbong
Ecxi EirGrabber
EroCrawler
Exabot Exabot
Express WebPictures Extreme Picture Finder
FDM Ezooms
FHscan FemtosearchBot
Firefox/7.0
FlashGet FlashGet
Flunky Flunky
Foobot
Freeuploader Freeuploader
FrontPage FrontPage
Fuzz Fuzz
Fyrebot FyberSpider
GT::WWW GetWeb
Getintent Getintent
Gigabot Gigabot
Go!Zilla Go-Ahead-Got-It
GoZilla
Grafula Grafula
GrapeFX
GridBot GridBot
HEADMasterSEO
HMView
HTMLparser HTMLparser
HTTP::Lite HTTP::Lite
HaosouSpider HTTrack
Haansoft
Harvest
Havij
Heritrix Heritrix
HybridBot
IDBTE4M IDBTE4M
IlseBot Iblog
Indy Library Id-search
Image Fetch
InfoTekies
Internet Ninja Internet Ninja
Iskanie Iskanie
IstellaBot IstellaBot
JOC Web Spider JOC Web Spider
JamesBOT
JetCar
Joomla Joomla
Jorgee JustView
Kenjin Spider
Keyword Density Keyword Density
LNSpiderguy LWP::Simple
Lanshanbot Lanshanbot
Larbin
LeechFTP
LeechGet LeechGet
LieBaoFast Lftp
Lightspeedsystems LibWeb
Likse LinkScan
LinkWalker LinkextractorPro
Linkbot
LinqiaMetadataDownloaderBot
LinqiaRSSBot LinqiaRSSBot
Litemage_walker Litemage_walker
Lmspider
MIIxpc
MJ12bot MJ12bot
MSFrontPage MQQBrowser
MSIECrawler
MTRobot MTRobot
Majestic SEO Magnet
Majestic12 Majestic-SEO
MarkWatch Mass Downloader
MauiBot Masscan
Mb2345Browser Mb2345Browser
MeanPath Bot Mister PiX
Metauri Mr.4x3
Microsoft URL Control Name Intelligence
Moblie Safari
Mojeek
Mojolicious
MolokaiBot
Msrabot
Musobot
NICErsPRO
NPbot
Nameprotect
Navroad Navroad
Nessus NetLyzer
Net Vampire NetSpider
NetAnts
NetMechanic
NetZIP NetZIP
Netcraft Nettrack
Netvibes Netvibes
Nibbler
Nikto
Nimbostratus
Ninja Ninja
Nmap Offline Explorer
Nuclei
Offline Navigator Offline Navigator
OnCrawl OnCrawl
OpenLinkProfiler
Openfind Openfind
PHPCrawl OrangeBot
Page Analyzer OutfoxBot
POE-Component-Client-HTTP
PageAnalyzer PageAnalyzer
Pandalytics PageGrabber
Panscient PageScorer
Picscout PageThing.com
PeoplePal
Petalbot
Pi-Monster
PictureFinder PictureFinder
Piepmatz Piepmatz
PleaseCrawl Pimonster
Pixray
Pockey
ProPowerBot
ProWebWalker
Probethenet Probethenet
Psbot
Pump
QueryN Metasearch QueryN Metasearch
RSSingBot
RankingBot
RankingBot2 RankingBot2
RankurBot
Re-re Re-re
Reaper RealDownload
Recorder
RepoMonkey
Ripper
RocketCrawler RocketCrawler
SBIder SEOkicks
SMTBot SEOprofiler
ScanAlert
ScoutJet ScoutJet
Scrapy ScreenerBot
Searchestate Searchestate
SemanticJuice SemanticJuice
SentiBot SentiBot
SeoSiteCheckup
Shodan Shodan
Siphon
Site Sucker Site Sucker
SiteLockSpider SiteExplorer
SiteSucker SiteSnagger
Sitebeam
Siteimprove Siteimprove
Sitevigil SmartDownload
Snapbot Snapbot
Snoopy Snoopy
SocialRankIOBot
Sociscraper Sociscraper
Sottopop Sosospider
SpaceBison Spammen
SpankBot SpankBot
Spanner
Spbot
Sqlmap Sqlmap
Sqworm Stripper
Sucuri
SurveyBot SurveyBot
Suzuran Suzuran
Swiftbot Swiftbot
T8Abot Szukacz
Teleport Teleport
TeleportPro TeleportPro
Telesphoreo
The Intraformant The Intraformant
TheNomad TheNomad
Titan Thumbor
Toata
Tracemyfile Tracemyfile
Trendiction Trendiction
Turingos True_Robot
TurnitinBot Turnitin
Typhoeus Typhoeus
URLy Warning V-BOT
URLy.Warning VCI
UnisterBot Vagabondo
Upflow
VelenPublicWebCrawler VelenPublicWebCrawler
VidibleScraper
Virusdie Virusdie
VoidEYE
WASALive-Bot WASALive-Bot
WEBDAV WEBDAV
WISENutbot
WPScan WPScan
WWW-Collector-E WWW-Mechanize
Wallpapers
WeSEE WeSEE
Web Auto
Web Collage Web Collage
Web Enhancer Web Fetch
Web Pix Web Pix
Web Sucker
WebAuto
WebBandit
WebCollage
WebCopier
WebFuck WebFuck
WebImageCollector WebGo IS
WebPix WebLeacher
WebReaper
WebStripper
WebZIP
WebmasterWorldForumBot
Webshag Webshag
WebsiteQuester WebsiteQuester
Webster Whack
Whacker Whacker
Who.is Bot
WinHTTrack WinHTTrack
Wonderbot Wprecon
Xaldon_WebSpider
Xenu Xenu
YoudaoBot Zauba
ZmEu Zermelo
ZumBot ZyBorg
adscanner
arquivo-web-crawler
arquivo.pt arquivo.pt
autoemailspider backlink-check
check1.exe cah.io.community
cognitiveseo clark-crawler
crawler.feedback dataforseo.com
crawler4j
demandbase-bot demandbase-bot
eCatch domainsproject.org
ips-agent facebookscraper
isitwp.com internetVista monitor
linkdexbot meanpathbot
mediawords netEstate NE Crawler
muhstik-scan
oBot oBot
satoristudio.net page scorer
scalaj-http pcBrowser
seobility plumanalytics
webgains-bot probe-image-size
seocompany.store
seostar
serpstatbot
sexsearcher
sitechecker.pro
sp_auditbot
sysscan
trendiction.com
webpros.com
webprosbot webprosbot
x22Mozilla zgrab
zauba.io

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
cartierloveringreplica.xyz aac52006ec82a24e08b665f4db2b5013f7.com
funtoonez.com alphahoverboards.com
getaclueamerica.com carrauterie.be
hasfun.com eachdayisagift.review
hoverboard360.at gettpromos.com
longgreen.info pornoforadult.com
nash-krym.info siteimprove.com
prostitutki-belgoroda.org writersgroup580.web.fc2.com
seokicks.de yellowads.men
skladvaz.ru zaloro.com

948
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
08800.top 0c47f8422d3f.com
1-99seo.com 0n-line.tv
1001watch.com.ua 123locker.com
2000k.ru 1kdailyprofit.me
2728fb936f0.com 55wmz.ru
3-letter-domains.net 5forex.ru
4kpics.rocks 5kstore.com
5ws.dating-app.ru a96527gi.beget.tech
83net.jp aasoldes.fr
aaa38852e886ac4af1a3cff9b47cab6272.com abcdeg.xyz
abctoppictures.net abclauncher.com
absolute-s.ru abwa.tk
add-add.men acmebtn.ml
adhome.biz adbetclickin.pink
admitad.com adrunnr.com
ads-cool.pro adsref.men
advancedsoftwaresupport.com adtech.de
afslankpillen2017nl.eu aihelen.net
agahinameh.com air-edem.ru
ageofclones.com alienwheel.es
agroeconom.kz alif-ba-ta.com
ahrefs.com all-streaming-media.com
akuhni.by allcredits.su
alive-ua.com allesohnegirls.net
allpdfmags.net allproblog.com
amigobulls.com amoi.tn
android-vsem.org angkortours.vn
android4fun.org animal-drawings.com
angigreene.com apifasterlightin-a.akamaihd.net
ap.senai.br apimossnetinfo-a.akamaihd.net
apelsinnik.website apiwebwebgetcom-a.akamaihd.net
app5.letmacworkfaster.world
appleid-verification.com appleid-verification.com
arabgirls.adultgalls.com arcadeplayhouse.com
arkartex.ru ardimobileinfo.ml
artdestshop.eu artefakct.com
atmagroup.ru asscenihotosidea.blogspot.co.za
autotop.com.ua astana.xxxkaz.org
avkzarabotok.info atlant-auto.info
avtoarenda.by autonew.biz
azadnegar.com avtovolop.ru
azazu.ru b2b-lounge.com
azlex.uz bagsonsale.online
backlink4u.net banki76.ru
balla-boo.se bausparen.bz.it
balook.com best-deals-products.com
banksrf.ru best-mam.ru
bannerspace.com best-seo-solution.com
bard-real.com.ua bestcurs.org
bbtec.net bestmouthwash.club
beauty-b0x.pl bestwebsiteawards.com
benchmarkcommunications.co.uk bestwebsitesawards.com
best-way.men big-cash.net
besthoro.ru
bestofupload.info
bestpornuha.com
bet-prognoz.com
big-boards.info
biketank.ga biketank.ga
bimatoprost-careprost.com bizlist.com.de
bio-optomarket.ru bkns.vn
blackplanet.com bloggerads.net
blacktwhite.com brandedleadgeneration.com
blackwitchcraft.ru brandimensions.com
blobar.org breastaugmentation.co.za
bloggen.be breget74.ru
bloke.com brendbutik.ru
bmsco.co bristolhotel.com
bmw-ark.ru bryansk.zrus.org
board.f00d.de buketeg.xyz
boltalko.xyz buqyxa.rincian.info
bonvillan.com buy-loft.ru
boo-arts.com buyclomidonlaine.com
brakehawk.com bvlgariring.xyz
brandehk.dk calc-for-credit.ru
brianhenry.co cardul.ru
bugof.gq ccjp.eu
builtwith.com ceotrk.com
buyk.host.sk cezartabac.ro
buzzzg.men cheapbarbour.online
c-english.ru chinaelitecheapjerseys.com
callmd5map.com chorus.terakeet.com
capacitacionyaprendizaje.com
carstrends2015.com
cartierlove.xyz
cashkitten-a.akamaihd.net
cbox.ws
celejihad.info
censys.io
chelyabinsk.xrus.org
chiblackhawks-jerseys.com
christianlouboutinreplica.win christianlouboutinreplica.win
ciekawinki.pl christianlouboutinshoes.xyz
cleanallvirus.com cialiswithoutadoctor.net
clickprotects.com cibpenonptib.flu.cc
clicksor.com cl.s7.exct.net
cmhomestayagency.com clickaider.com
coaching-netz.info clickpapa.com
coin-hive.com clicksotrk.com
compliance-alex.xyz compliance-alex.xyz
compliance-don.xyz compliance-don.xyz
compliance-elena.xyz compliance-donald.xyz
compliance-ivan.top compliance-fred.xyz
compliance-jane.top compliance-walter.top
compliance-willy.top concealthyself.com
confib.ifmo.ru conciergegroup.org
conocer-sanabria.com contentlook.co
counter.yadro.ru cookie-law-enforcement-aa.xyz
covadhosting.biz copblock.org
craftburg.ru copypaste.traderzplanet.in
creditnation.ru cscwtalkto.site
crirussian.ru cutt.us
culturevie.info dafatiri.com
custom-electric-guitar.com dangphoto.trade
cv.wallhade.co datract.com
cxpromote.com dawlenie.com
d0t.ru dbmkfhqk.bloger.index.hr
daisye.top dealwifi.com
data-mining.tk decorationspcs.com
data-ox.com delfin-aqua.com.ua
detskie-konstruktory.ru depositfiles-porn.ga
dev78.dioniqlabb.se design-ideas.info
digital-sale.su deutschehobbyhuren.net
dividendo.ru diffbot.com
dnepropetrovsk.mistr-x.org dikqlyremy.info
dogoimage.com dimkino.ru
dolohen.com diy-handmade-ideas.com
domain-submit.info dms-sw.ru
domainsatcost.com dojki-hd.com
domini.cat doska-vsem.ru
dostavimvdom.ru doxysexy.com
driving.kiev.ua drivotracker.com
e-biznes.info drugspowerstore.com
e-commerce-seo1.com dscaas.website
easycommerce.cf duplicashapp.com
elektrozigaretten2.yn.lt dvervmoskvu.ru
elexies.info dwomlink.info
encodable.com eandsgallery.com
enews.tech ed-shop01.ru
erotiktreff24.info eduinfosite.com
eu-cookie-law.info ege-essay.ru
eupornstar.info electro-prom.com
extlinks.com elektrischezigarette2.onsugar.com
extremal-blog.com elektrozigarettekaufen2.blogse.nl
ez8motelseaworldsandiego.com emerson-rus.ru
ezigarettenkaufen2.dreamwidth.org eredijovon.com
f-online.de escortslet.net
fable.in.ua espaceinventoristes.com
fetlifeblog.com estelight.ru
fickluder69.com evehemming.blogspot.com.au
fil.ru ewebarticle.info
filmania-x.ru extads.net
finemanteam.com extractorandburner.com
flash4fun.com eyessurgery.ru
flipper.top ezigaretteshop.webs.com
flowwwers.com familyholiday.ml
forexunion.net fashion-mk.net
frbizlist.com fastcrawl.com
free-traffic.xyz filefilter.weebly.com
freejabs.com filerockstar298.weebly.com
freeuploader.com filesvine.com
freewhatsappload.com filmetricsasia.com
frustrated-favorable.gq filmfanatic.com
ftns.ru financeloan.us
funponsel.com firesub.pl
gamewrath.com fitfloponline.store
gaming-journal.com fiuxy.com
flirt4free.com
fodelsedagspresenter.nu
footballfarrago.com
fordsonmajbor.cf
forex21.ru
frameimage.org
free-video-tool.com
freelinkbuilding.website.tk
freshsuperbloop.com
freza-sverlo.ru
gallictures.com
gamezblox.com
gamingspark.com gamingspark.com
gay.adultgalls.com ge0ip.com
gemgrab-a.akamaihd.net generalporn.org
generic-pills-online.com genericviagrasildenafiled.net
ghazel.ru getresponse.com
glicol.kz gg.zzyjxs.com
globatur.ru
goatse.ru goatse.ru
googglet.com gogps.me
gopro-online.info golden-praga.ru
gpirate.com googlefeud.com
grand-chlen.ru goosefishpost.bid
greendream.com.ua gotwebsite1.com
gta-top.ru growmyfunds.ca
guidefs.ru gsasearchengineranker.site
gta-club.ru
guitar-master.org
gunsvicceadadebt.tk
handsandlegs.ru
hao123.com
hasfun.com hasfun.com
hentaiheroes.com hccoder.info
hermesreplica.pw heartofpayne.xyz
highstairs-a.akamaihd.net hermesbelts.xyz
hollywoodactress.info histats.com
homeandhealth.ru hobild.net
hostnow.men hoholikik.club
hotenergy.ru homeinns.com
houseofgaga.ru homelygarden.com
houtings.xyz hoporno.com
hoverboard360.de hotchatdate.com
huhn.altervista.org hotdl.in
hully.altervista.org hothot.ru
humanelydrew.com house.sieraddns.com
i4track.net housediz.com
iideaidekonkatu.info hoverboard360.at
imagecoolpub.com hoverboard360.nl
internet-apteka.ru hydropump.su
investpamm.ru iamsport.org
ip-guide.com ideawheel.com
iradiology.ru iloveitaly.ru
ispaniya-costa-blanca.ru ilovevitaly.com
itag.pw ilovevitaly.xyz
itbc.kiev.ua imgarit.pw
janavibekken.no impisr.ru
jav-idol.com importchinacoach-teach.com
javspace.net indianmedicaltourismshop.com
jumptap.com intervsem.ru
karadene.com istripper.com
kashubadesign.ru johnnyhaley.top
kchaxton.com jpcycles.com
kino-key.info juliaworld.net
kinogolos.ru kaidalibor.de
kinogonew.ru karachev-city.ru
kinopolet.net kazinogames.lv
kinotorka.ru ketrzyn.pl
kit-opt.ru keywords-monitoring-success.com
khadastoafarde.tk
kidd.reunionwatch.com
kiinomaniak.pl
kinky-fetishes.com
kinobest.pl
kinozapas.org
kiprinform.com
komputernaya-pomosh-moscow.ru komputernaya-pomosh-moscow.ru
kongruan.com konturkrasoty.ru
koral.se kountrylife.com
koversite.info ks1234.com
kredit-blog.ru kung-fu-ru.com
kretpicf.pw laapp.com
kustanay.kz labvis.host.sk
kw21.org landmania.ru
laptoper.net laptop-4-less.com
lazymanyoga.com lawyersinfo.org
letmacworkfaster.site leboard.ru
letmacworkfaster.world lecbter-relationships.ga
light.ifmo.ru legalrc.biz
liky.co.ua lennatin.info
linkbux.ru letmacwork.world
linksharingt.com letslowbefast.today
liver-chintai.org lexixxx.com
lonerangergames.com lightinghomes.net
lrac.info lignofix.ua
macdamaged.tech littlesexdolls.com
macrotek.ru livingcanarias.com
manifestyourmillion.com locimge.pw
manipulyator-peterburg.ru lomb.co
marcogrup.com lonfon.xyz
maridan.com.ua lookingglassemb.com
mastershef.club lost-alpha.ru
matb3aa.com magiadinamibia.blogspot.com
matpre.top makedo.ru
maximilitary.ru makenahartlin.com
mbiologi.ru markjaybeefractal.com
mearns-tractors.co.uk mebeldekor.com.ua
mebel-alait.ru medanestesia.ru
mediaoffers.click mediaoffers.click
mediawhirl.net mega-bony-2017.pl
medicine-4u.org megagrabber.ru
medicines-choice.com memberty.com
medicineseasybuy.com metaxalonevstizanidine.blogspot.com
medispainstitute.com.au mhtr.be
medkritika.ru microsoftportal.net
microstatic.pl microstatic.pl
minecraft-rus.org millionare.com
minegam.com mini-modus.ru
mini.7zap.com missis.top
mir-business-24.ru monclerjacketsoutlet.win
mirtorrent.net moncleroutletonline.win
mixx.com moncleroutletonline.xyz
mmgq.ru monsterdivx.com
mmostrike.ru monsterdivx.tv
monetizer.com-01.site most-kerch.org
money-every-day.com most.gov.iq
moneymaster.ru moviemail-online.co.uk
morlat.altervista.org muschisexbilder.com
mrbojikobi4.biz mydoctorok.ru
muz-tracker.net naj-filmy24.pl
mydeathspace.com najaden.no
myftpupload.com napalm51.nut.cc
myghillie.info negral.pluto.ro
myhitmp3.club nibbler.silktide.com
mylesosibirsk.ru
myprintscreen.com
nac-bearings.ru
narosty.com
nastydollars.com
nero-us.com
nerudlogistik.ru
netoil.no
nicefloor.co.uk
nightvision746.weebly.com nightvision746.weebly.com
nikhilbahl.com nlfjjunb5.ru
niki-mlt.ru
nikkiewart.ru
nordstar.pro nordstar.pro
norththeface.store notaria-desalas.com
notebook-pro.ru
novgorod.xrus.org
nuup.info
nvformula.ru nvformula.ru
o-o-6-o-o.com o-dachnik.ru
obnal.org o-o-8-o-o.ru
offer.wpsecurity.website oecnhs.info
office2web.com ohmyrings.com
oklogistic.ru omgtnc.com
oksrv.com oneshotdate.com
omsk.xrus.org online-templatestore.com
oneclickfiles.com onlythegames.com
openstat.com openfrost.com
oralsexfilme.net optikremont.ru
osb.se11.ru orenburg-gsm.ru
outrageousdeal-a.akamaihd.net outrageousdeal-a.akamaihd.net
panicatack.com pacificair.com
paperwritingservice17.blogspot.ru partybunny.ru
pavlodar.xkaz.org pechikamini.ru
pcimforum.com peekyou.com
pekori.to
photo.houseofgaga.ru
pictures-and-images.net
picturesboss.com picturesboss.com
pinsdaddy.com pirateday.ru
pinwallpaper.top piter.xrus.org
pinwallpaper.xyz playlott.com
pisanieprac.info plohaya-kreditnaya-istoriya.ru
pivka.xyz poem-paying.gq
pkr1hand.com pokemongooo.ml
plastgranar.nu popserve.adscpm.net
platesauto.com popugaychiki.com
playboyfiles.xblog.in porno-play.net
plugingeorgia.com pornowarp.info
pochtovyi-index.ru poshiv-chehol.ru
podshipniki-ntn.ru
pons-presse.com
popads.net
popcash.net
popunder.net
pornodojd.ru
pornogad.com
positive2b.ru positive2b.ru
potolokelekor.ru pospr.waw.pl
priora-2.com powenlite24.ru
prizeestates.cricket pp-budpostach.com.ua
proekt-gaz.ru predominant-invent.tk
professionaldieselcare.com privatefx-in.ru
promodj.com privetsochi.ru
pushdata.sendpulse.com qpypcx.com
quickcashlimited.com quickchange.cc
r-control.ru rangoman.date
rabotaetvse.ru rarbg.to
rada.ru rebrand.ly
randki-sex.com remont-comp-pomosh.ru
rangjued.com rentaremotecomputer.com
rankingchart.de replicalouboutin.xyz
ranksignals.com rewardit.com
recinziireale.com rockprogblog.com
redbottomheels.xyz rukino.org
redirect.trafficreceiver.club rusvideos.su
redirectme.net rvzr-a.akamaihd.net
remedyotc.com ryetaw.com
rennlist.com
rentalcarnavi.info
rff-cfal.info
ric.info
rimedia.org
rus-teh.narod.ru
sabaapress.com sabaapress.com
saltspray.ru saddiechoua.com
sankt-peterburg.nodup.ru sanidumps.com
sanyuprojects.com savingsslider-a.akamaihd.net
sarf3omlat.com sbdl.no
savefrom.com sbtdesign.co.uk
sbprabooks.com scanmarine.info
sbwealthsolutions.ca scanmyphones.com
scanner-alexa.top scanner-alexa.top
scanner-julianna.top scanner-brian.top
scrapinghub.com scanner-don.top
sei80.com scanner-donald.top
seksvideoonlain.com scanner-jess.top
selectads.men scanner-walt.top
semp.net searchimage.co
seo-prof1.xyz securityallianceservices.com
sergiorossistore.online semaltmedia.com
sexad.net sendearnings.com
sexgalleries.top seo-platform.com
sexspornotub.com seoheap.com
sextracker.com seokicks.de
sexy-pings.com seoprofiler.com
sexyebonyteen.com seorankinglinks.xyz
shell-pmr.ru service.adtech.fr
shinikiev.com.ua sex-watch.com
shopsellcardsdumps.com sex.hotblog.top
signoredom.com sexflirtbook.com
sildenafil-tadalafil.info sexpartygirls.net
siteaero.com sfj-ror.no
sitebeam.net sharebutton.net
skyway24.ru shop-electron.ru
slim.sellany.ru shtaketniki.kz
smailik.org sibecoprom.ru
sms2x2.ru sildenafilcitratemed.com
snip.tw sisi-go.ru
snjatie-geroinovoy-lomki.ru siteimprove.com
snyatie-lomki-v-stacionare.ru sladkoevideo.com
social-vestnik.ru slimcdn.com
socialmediasuggest.com smallseotools.com
spidtest.space socas.pluto.ro
spitfiremusic.com social-button.xyz
spravka-medosmotr.ru social-search.me
spywarebegone.com sockshare.net
sribno.net soft-program.com
softonicads.com
softtor.com
softwaretrend.net
soserfis.com
soundfrost.org
spasswelt.net
splendorsearch-a.akamaihd.net
stackthatbucks.com
star61.de
stard.shop
stardevine.com stardevine.com
statistici.ro sticken.co
staynplay.net stoki.ru
stockquotes.wooeb.com surfbuyermac.com
streamin.to
stroydetali.ru
suchenindeutschland.com
sucsesofinspiration.com
supernew.org
superstarfloraluk.com
svensk-poesi.com
swinon.site swinon.site
taboola.com tedy.su
tackletarts.co teenbbw.yopoint.in
takeprofitsystem.com telefonsexsofort.tk
taximytishi.ru templates.franklinfire.co
teastory.co thaismartloan.com
tecspb.ru thecounter.com
teencastingporn.com themeforest.net
telesvoboda.ru thepantonpractice.co.uk
tetracsaudi.com thexart.club
textads.men ticketsys.inetwd.com
theendivechronicles.com tivolibasket.it
thepokertimer.com tizanidineformigraines.blogspot.com
thin.me.pn tizanidinehcl2mgtablet.blogspot.com
tizanidineduringpregnancy.blogspot.com tizanidinehcl4mgtablet.blogspot.com
tizanidineshowupondrugtest.blogspot.com tizanidineinfo.blogspot.com
tizanidinesideeffectsweightloss.blogspot.com tjkckpytpnje.com
tizanidinevssoma.blogspot.com tnaionline.org
tizanidinevsvalium.blogspot.com top10-online-games.com
tmm-kurs.ru topshef.ru
tmtrck.com torrentgamer.net
tonivedu.it totu.us
toonfamilies.net touchmods.fr
torrentred.games track.deriv.com
torrents.cd
torrnada.ru
track-rankings.online
tradgardspartner.se tradgardspartner.se
trainoffend.ml trafaret74.ru
trion.od.ua tramadolandtizanidine.blogspot.com
trkdf.com tuberkuleznik.ru
trubywriting.com tvnewsclips.info
ttsq.fr tvorozhnaja-zapekanka-recept.ru
tupper-posuda.ru typimga.pw
turbo-suslik.org uginekologa.com
tvoystartup.ru ukr-lit.com
twittruth.com ukrtvory.in.ua
uamtrk.com umaseh.com
ultimateclassicrock.com unmaroll.ya.ru
unitygame3d.com upproar.com
univerfiles.com usiad.net
unpredictable.ga usswrite.com
uptime-alpha.net valmetrundan.se
uptime-delta.net vclicks.net
urzedowski.eu vedomstvo.net
v-doc.co venerologiya.com
vadimkravtcov.ru ventelnos.com
vduplo.ru vepad.com
verymes.xyz via-energy-order.com
vesnatehno.com viberdownload10.com
via-energy-acquistare.com videositename.com
video-woman.com vids18.site
vladimir.zrus.org vipsiterip.org
vremya.eu vizag.kharkov.ua
vvpg.ru vkgaleria.com
vzlomtw.com vtcdns.com
wanker.us warezaccess.com
waterpurifier.club waterpurifier.club
we-are-gamers.com webcamtalk.net
webshoppermac.com webix.me
website-speed-check.site website-analyzer.info
website-speed-up.top websiteaccountant.de
weddingdresses.xyz weddingdresses.xyz
wesharepics.info wfb.hatedriveapart.com
westen-v.life whereverdesperate.gq
whatsupinfoley.com wineration.com
whosonmyserver.com wiosenny-bon-1500.pl
winwotgold.pl withstandingheartwarming.com
woodyguthrie.se wpthemedetector.co.uk
worldinternetauthority.com www.888.com
worst-sites.online www.arenda-yeisk.ru
wowas31.ucoz.ru
www.timer4web.com www.timer4web.com
www.wohnkabinen-shop.de x-diesel.org
xchangetrak.com xaijo.com
xn----8sbhefaln6acifdaon5c6f4axh.xn--p1ai xblognetwork.com
xn--80aodinpgi.xn--p1ai xn----9sbebi2bvzr7h.xn--p1ai
xn--90acenikpebbdd4f6d.xn--p1ai xn--1-8sbcpb0bdm8k6a.xn--p1ai
xn--b1ag5cfn.xn--p1ai xn--b1ag5cfn.xn--p1ai
yaaknaa.info xn--b1agm2d.net
yebocasino.com xn--d1aifoe0a9a.top
yellowstonevisitortours.com xn--e1aggki3c.xn--80adxhks
ynymnwbm.bloger.index.hr xn--oogle-wmc.com
youbloodyripper.com xxlargepop.com
youjizz.com xxxguitars.com
za-music.mymobiplanet.com yatrk.xyz
zajm-pod-zalog-nedvizhimosti.ru youbrainboost.asia
zakonobosago.ru youghbould.wordpress.com
zarenica.net youraticles.pl
znaturaloriginal.com zacreditom.ru
zs2vm.top zaimhelp.ru
zarabotok--doma.ru
zastenchivosti.net
zeroredirect11.com
zirondelli.it
znakomstva-piter78.ru
zoogdinsney.com
zoomovies.org
zscaler.net
zvuker.net

474
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
1000n1.ru 1001desert.com
202ch.com 12masterov.com
214jaluwobapef.cf 3rbseyes.com
273-fz.ru 5elementov.ru
4pp13.com 5u.com
abiente.ru 6hopping.com
admanaerofoil.com 8xv8.com
adrenalin-stk.ru aaronabel.com
adventureparkcostarica.com aghanyna.com
advertex.info airlandsea.info
alarmobninsk.ru akita.kz
alekseevec.ru alienwheel.es
alessandraleone.com allpdfmags.net
alphaforum.ru anmysite.com
amt-k.ru anniemation.com
amung.us apishops.ru
android4fun.org apper.de
apiportalmorecom-a.akamaihd.net approvedlocal.co.za
arcadeplayhouse.com arcadeplayhouse.com
asdfg.pro arendatora.ru
atmagroup.ru arendovalka.xyz
auto-zapchasti.org avirasecureserver.com
autobrennero.it awency.com
avramstroy.ru back.dog
axbocz.net backlink4u.net
azartniy-bonus.com bannerconnect.net
balitouroffice.com bannertesting.com
balla-boo.se battleforupdating.site
banki76.ru
basisches-wasser.net
beachtoday.ru
beauty-clinic.ru
bedandbreakfast.com
belstaffstore.online
bestimagecoollibrary.com
bestofupload.info
betshuckclean.com betshuckclean.com
bg6s0.com beyan.host.sk
birzha-truda.eu big-cash.net
blobar.org biographiya.com
bongiornos.info bizcheapjerseyswholesalechina.com
boom-celebs.com blog.f00kclan.de
brokergid.ru bloke.com
buttons-for-website.com bodybuilding-shop.biz
cardsharp1.ru bongacams.com
cartierlovestore.com brainzpod.win
chatroulette.life bscodecs.com
chatroulette.video bupropion-sr-150-mg.us
chocolateslim-en-france.com buron.pw
buy-cheap-online.info
buy-meds24.com
buydissertation.net
buytizanidineonline.blogspot.com
canzoni.ru
check-host.net
cindymatches.com cindymatches.com
citizenclsdriveri7.pen.io clips.ua.ac.be
clicksor.net colehaanoutlet.store
com-supportcenter.website counterbot.com
connectingsingles.com culturevie.info
copro.pw customerguru.in
cowblog.fr dirtpics.pw
creativehutindia.com doska-vsem.ru
crynet.cc dostavimvdom.ru
cyprusbuyproperties.com dvrlists.com
dalavia.ru efnor-ac.com
damedingel.ya.ru election.interferencer.ru
daydream-studio.ru enbersoft.com
ddpills.com enthuse.computernetworksonline.com
dekorkeramik.ru erotik-kostenlos.net
depositfiles-porn.ga executehosting.com
destinationrealestate.com fakehandbags.xyz
dev-seo.blog feeriaclub.ru
directrev.com
djonwatch.ru
domain2008.com
downloaddy.net
dumpsmania24.com
ekspresihati.info
elektrischezigarette1.blog.pl
elektronischezigarettekaufen2.tumblr.com
enternet.ee
eralph.tk
etm-consult.de
evaashop.ru
exci.ru
ezaz.info
f0815.de
faracontrol.ir
fashion-mk.net
fellowshipoftheminds.com
ferretsoft.com ferretsoft.com
filesclub.net
fillmewithhappiness.com fillmewithhappiness.com
filmci.pro fitfloponline.store
finstroy.net flirt4free.com
forums.toucharcade.com fr-bearings.ru
foto-basa.com free-social-buttons.xyz
fr.netlog.com freetangodownload.com
ftns.ru froggytube.com
funponsel.com gamezblox.com
gambarkatabaru.com ge0ip.net
gamerextra.com
gemara.com
gigapeta.com
glass-msk.ru glass-msk.ru
go2mike.ru glcomputers.ru
googglet.com gnuetella.com
greatidea.marketing golden-praga.ru
gorabagrata.ru
gratuitxblcodes.com
gta-club.ru
gwebtools.com gwebtools.com
hchha.com hamilton.ca
hdapp1008-a.akamaihd.net hdpixent.com
heatpower.ru healbio.ru
holidaypics.org hidemyass.com
host-tracker.com homelygarden.com
hostsshop.ru homik.pw
howlongdoestizanidinestayinyoursystem.blogspot.com hornymatches.com
https-legalrc.biz hostcritique.com
hydropump.su hosting-tracker.com
ideoworld.org housediz.com
igithab.com impisr.edunsk.ru
iideaidekonkatu.info incanto.in.ua
imabase.com incest-ru.com
imagez.co infokonkurs.ru
imicrovision.com internetproviderstucson.com
infobanks.ru investpamm.ru
int.search.mywebsearch.com islamtoday.co.za
ipostroika.ru istmira.ru
istizanidineanarcoticdrug.blogspot.com iwanttodeliver.com
iusstf.org javrip.net
ivoiretechnocom.ci justdating.online
j-times.ru kazka.ru
jobmarket.com.ua kemerovo.zrus.org
juliaworld.net keywordblocks.com
kartiniresto.com keywordhouse.com
kevblog.top kidskunst.info
konpax.com kinofak.net
krasnodar-avtolombards.ru kirov.zrus.org
kriokomora.info kiskinhouse.com
kw21.org kiwe-analytics.com
labafydjxa.su ktotut.net
lietaer.com kunstaktien.info
likrot.com ladsup.com
laudit.ru
lego4x4.ru
liky.co.ua
linkpulse.com linkpulse.com
locatellicorretor.com.br live-sexcam.tk
luckyday.world longadventure.com
lunchrock.co mabdoola.blogspot.com
m4ever.net macrotek.ru
macdamaged.space maju.bluesalt.co
macotool.com masthopehomes.com
mailemedicinals.com mebel-ekb.com
marcoislandvacations.net mebel-vstroika.ru
medizinreisen.de meduza-consult.ru
mir-betting.ru menetie.ru
mjchamonix.org mesbuta.info
monclercheap.xyz mobplayer.net
monthlywinners.com
morlat.altervista.org
mrpornogratis.xxx
mundoaberrante.com mundoaberrante.com
networkad.net musflashtv.com
niroo.info myperiod.club
nudo.ca new7ob.com
odywpjtw.bloger.index.hr next-dentists.tk
one.net.in nextbackgroundcheck.gq
onemactrckr.com nicovideo.jp
openfrost.com njpalletremoval.com
opinionreelle.com notasprensa.info
palvira.com.ua novosibirsk.xrus.org
pcads.ru nrjmobile.fr
pcgroup.com.uy o00.in
picanalyzer.data-ox.com o333o.com
pijoto.net officedocuments.net
poligon.com oktube.ru
popads.net online-sbank.ru
pornoelita.info otbelivanie-zubov.com
pornogad.com ownshop.cf
portal-eu.ru parajumpersstore.online
potoideas.us peugeot-club.org
pflexads.com
pictures-and-images.net
pintattoos.com
pio.polytopesexempt.com
pix-hd.com
pixelrz.com
popunder.net
pornotubexxx.name
portnoff.od.ua
powc.r.ca.d.sendibm2.com
pr0fit-b0x.com pr0fit-b0x.com
pricheskaonline.ru privatamateure.com
proprostatit.com profitfx.online
qualitymarketzone.com progonrumarket.ru
quickcashlimited.com pyramidlitho.webs.com
realizmobi.com quickbuck.com
realmonte.net ragecash.com
recordpage-a.akamaihd.net randalljhoward.com
rennlist.com rating-casino2021.ru
retailwith.com razorweb-a.akamaihd.net
rocketchange.ru recipedays.ru
rogervivierforsale.com refads.pro
ryetaw.com rff-cfal.info
satellite.maps.ilovevitaly.com rossanasaavedra.net
scanmyphones.com s-forum.biz
scanner-john.top scanner-elena.top
scanner-mark.top scrapy.org
scottbywater.com sdi-pme.com
search.pch.com seinterface.com
seasonvar.ru selectads.men
securityallianceservices.com seolab.top
seobility.net sex-tracker.de
seoboxes.com sex-watch.com
seoheap.com sexy-pings.com
sexpornotales.net sexyteens.hol.es
sexxdate.net share-buttons-for-free.com
sexy.babes.frontend-stack.top shisha-swag.de
shopfishing.com.ua siteaero.com
shtaketniki.kz sk.golden-praga.ru
simply.net solnplast.ru
siteimprove.com sophang8.com
slayerlife.com souvenirua.com
smart-scripts.com space4updating.win
snyatie-lomki-v-stacionare.ru stroymonolit.su
socialbookmarksubmission.org styro.ru
socialsignals24.com symbaloo.com
spywarebegone.com tech4master.com
sugarkun.com
superstats.com
taximytishi.ru
technopellet.gr technopellet.gr
teletype.in testbotprocessor44.com
template-kid.com thecoral.com.br
terraclicks.com thefotosgratis.eu
thegamerznetwork.com tilido.com
theguardlan.com
tiandeural.ru
tizanidinecapsules.blogspot.com tizanidinecapsules.blogspot.com
tizanidinehclsideeffects.blogspot.com tizanidinedosage.blogspot.com
tizanidinezanaflex.blogspot.com tk-assortiment.ru
tmm-kurs.ru token-lab.org
topcasinoratings.ru tozup.com
toyota.7zap.com trafficshaper.com
trichizobswiv.agddns.net treasuretrack-a.akamaihd.net
twincitiescarservice.com trion.od.ua
um-razum.ru tsan.net
urldelivery.com tubeoffline.com
ustion.ru tuckpointingmasonrysystems.com
vclicks.net tyumen.xrus.org
viagraneggrx.com uginekologa.com
videokrik.net ultramart.biz
viktoria-center.ru unionmarkt.de
vipsiterip.org unmaroll.ya.ru
voditeltrezviy.ru unrealcommander.org
vote-up.ru uptimechecker.com
vremya.eu uytmaster.ru
vseigru.one v24s.net
wallpaperaccess.com varikoz24.com
webmasters.stackexchange.com venta-prom.ru
video--production.com
video-hollywood.ru
viel.su
virtuagirl.com
vita.com.hr
vodaodessa.com
vodkoved.ru
voltrknc1.com
vvon.co.uk
wahicbefa31.soup.io
webscouter.net webscouter.net
website-speed-checker.site wemedinc.com
welck.octopis.com whiteelephantwellington.com
witherrom55.eklablog.fr whosonmyserver.com
xportvusbdriver8i.snack.ws wingsofrefuge.net
yourmovies.pl winwotgold.pl
zmoda.hostreo.com winx-play.ru
zvetki.ru womensterritory.ru
x-diesel.com
xn--80adaggc5bdhlfamsfdij4p7b.xn--p1ai
xxx-cam.webcam
xxxtubesafari.com
zaapplesales.blogspot.com
znakomstvaonlain.ru

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.87 0; 10.1.0.77 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.10.3427 ### Version: V4.2022.10.3428
### Updated: Sun Oct 23 10:03:56 UTC 2022 ### Updated: Sun Oct 23 22:01:15 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.10.3427 ### Version: V4.2022.10.3428
### Updated: Sun Oct 23 10:03:56 UTC 2022 ### Updated: Sun Oct 23 22:01:15 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##