vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-05 12:09:57 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2022.05.3109 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2022-05-16 22:07:00 +00:00
parent 7a9e02355c
commit 4c80e6eadb
46 changed files with 100789 additions and 100789 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.05.3108 #### Version: V4.2022.05.3109
#### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.05.3108 #### Version: V4.2022.05.3109
#### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -14,7 +14,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2022.05.3108 #### Version: V4.2022.05.3109
#### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

12460
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2022.05.3108 #### Version: V4.2022.05.3109
#### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

12464
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

12464
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

12464
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

12464
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.65 1; 10.1.0.12 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.65 0; 10.1.0.12 0;
127.0.0.1 0; 127.0.0.1 0;

12464
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.65 1; 10.1.0.12 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.65 0; 10.1.0.12 0;
127.0.0.1 0; 127.0.0.1 0;

12464
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.65 1; 10.1.0.12 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.65 0; 10.1.0.12 0;
127.0.0.1 0; 127.0.0.1 0;

12464
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
3108 3109

12464
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

12464
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.245.113.138 0; 20.225.141.253 0;

12464
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.65 1; 10.1.0.12 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.65 0; 10.1.0.12 0;
127.0.0.1 0; 127.0.0.1 0;

12464
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.65 1; 10.1.0.12 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.65 0; 10.1.0.12 0;
127.0.0.1 0; 127.0.0.1 0;

12464
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.65 1; 10.1.0.12 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.65 0; 10.1.0.12 0;
127.0.0.1 0; 127.0.0.1 0;

12464
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.245.113.138 0; 20.225.141.253 0;

12464
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.245.113.138 0; 20.225.141.253 0;

12464
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.65 1; 10.1.0.12 1;
127.0.0.1 1; 127.0.0.1 1;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
BBBike Acunetix
CrunchBot Aipbot
G-i-g-a-b-o-t Collector
Jetty Grafula
Mojeek Jorgee
NetSpider Keyword Density
PHPCrawl Lmspider
Semrush PleaseCrawl
WebBandit Suzuran
lwp-trivial seocompany.store

322
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
AIBOT 01h4x.com
ALittle Client 404checker
80legs
ASPSeek ASPSeek
AfD-Verbotsverfahren Abonti
AhrefsBot AhrefsBot
AiHitBot
Aipbot Aipbot
AllSubmitter AllSubmitter
AlphaBot Alligator
Ankit Anarchy
Anarchy99
Anthill
Apexoo Apexoo
Aspiegel Aspiegel
Asterias Asterias
Atomseobot
AwarioSmartBot AwarioSmartBot
BBBike BDFetch
BackDoorBot BackDoorBot
BacklinkCrawler BackStreet
Badass Bandit
BetaBot Barkrowler
Bitacle BlackWidow
BotALot Blow
Brandprotect Bolt
Brandwatch Brandwatch
BuiltBotTough Buck
Bullseye BuiltWith
BunnySlippers
BuzzSumo BuzzSumo
CSHttp CCBot
Calculon CODE87
CazoodleBot
CensysInspect CensysInspect
CheTeam CheTeam
Cloud mapping CherryPicker
Chlooe
Claritybot
Cliqzbot
Cocolyzebot
Cogentbot Cogentbot
Collector Copyscape
Cosmos
Craftbot
Crawling at Home Project Crawling at Home Project
Crescent CrazyWebCrawler
CrunchBot CrunchBot
DBLBot Curious
DSearch Custo
Deusu CyotekWebCopy
Devil DIIbot
Demon
DigitalPebble DigitalPebble
Discoverybot Dirbuster
DittoSpyder Disco
Dispatch
DnBCrawler-Analytics
DnyzBot DnyzBot
DomCopBot
DomainAppender DomainAppender
DomainCrawler
Dotbot
Download Wonder
ECCP/1.0 ECCP/1.0
EMail Siphon EMail Siphon
EasyDL ExtractorPro
Ecxi FemtosearchBot
EroCrawler
Evil
Express WebPictures
ExtLinksBot
Extractor
FDM
Firefox/7.0 Firefox/7.0
Flunky
Foobot Foobot
FrontPage
Fuzz Fuzz
GT::WWW G-i-g-a-b-o-t
GalaxyBot GetRight
Genieo GetWeb
GermCrawler Getintent
Go!Zilla GoZilla
Go-Ahead-Got-It
Grabber Grabber
GrapeshotCrawler
GridBot
HMView
HTMLparser HTMLparser
Humanlinks HTTP::Lite
Haansoft
Harvest
Heritrix
HybridBot HybridBot
IRLbot IRLbot
Iblog
IlseBot IlseBot
Image Sucker IndeedBot
InfoNaviRobot InfoNaviRobot
InfoTekies Intelliseek
Internet Ninja InterGET
Iskanie Iskanie
IstellaBot IstellaBot
JOC Web Spider
JamesBOT
Jbrofuzz Jbrofuzz
JennyBot
JikeSpider JikeSpider
Kenjin Spider JustView
Keyword Density Keybot Translation-Search-Machine
LNSpiderguy Kinza
LWP::Simple LWP::Simple
Larbin Lanshanbot
Leap
LeechFTP LeechFTP
LeechGet LeechGet
LexiBot Lftp
LibWeb
Lightspeedsystems Lightspeedsystems
Lipperhey LinkScan
LinkWalker
Linkbot
LinksManager
Lipperhey Spider
Litemage_walker Litemage_walker
MIIxpc Lmspider
Ltx71
MIDown tool
MJ12bot MJ12bot
MQQBrowser Mag-Net
MTRobot
Magnet Magnet
Mata Hari Majestic-SEO
MarkMonitor
Mb2345Browser Mb2345Browser
MeanPath Bot
Meanpathbot Meanpathbot
Microsoft URL Control Mediatoolkitbot
Minefield MicroMessenger
Mister PiX Microsoft Data Access
Mojeek Mojeek
Msrabot Mojolicious
Mr.4x3
NICErsPRO NICErsPRO
NPbot
Name Intelligence
Navroad
NearSite NearSite
Needle Netcraft
Net Vampire
NetAnts
NetLyzer
NetMechanic
NetSpider
Netvibes Netvibes
NextGenSearchBot Niki-bot
Nmap NimbleCrawler
Not Ninja
Nutch
Octopus Octopus
OpenLinkProfiler Offline Explorer
OpenVAS Openfind
Openvas
OrangeBot OrangeBot
OutclicksBot OrangeSpider
OutfoxBot
PECL::HTTP PECL::HTTP
PHPCrawl
POE-Component-Client-HTTP POE-Component-Client-HTTP
Page Analyzer PageGrabber
Panscient PageScorer
Papa Foto Pandalytics
PeoplePal
Petalbot Petalbot
Picscout
Picsearch Picsearch
Piepmatz Piepmatz
Pimonster Pimonster
PleaseCrawl Pixray
Pockey ProPowerBot
Probethenet
Psbot
Pump
PyCurl
QueryN Metasearch QueryN Metasearch
RSSingBot RSSingBot
RankActive RankActiveLinkBot
RankFlex
RankingBot
Rankivabot
RankurBot RankurBot
ReGet RebelMouse
Reaper
Recorder Recorder
RedesScrapy
RepoMonkey RepoMonkey
Ripper
SBIder SBIder
SEOlyticsCrawler SEOkicks-Robot
ScanAlert
Scanbot Scanbot
ScoutJet Searchestate
ScrepyBot SemanticJuice
SentiBot Semrush
SeobilityBot SemrushBot
Shodan
Siphon
SiteCheckerBotCrawler SiteCheckerBotCrawler
SiteLockSpider
Sitebeam
Siteimprove Siteimprove
SlySearch Sitevigil
Snake Snake
Snoopy Snapbot
SocialRankIOBot Sociscraper
Sogou web spider Sogou web spider
Sottopop
SpaceBison
Spammen Spammen
Spinn3r SpankBot
Spanner
Spbot
Sqlmap Sqlmap
Sqworm Stripper
Steeler SuperHTTP
Sucuri TeleportPro
SuperBot The Intraformant
Surfbot TheNomad
SurveyBot True_Robot
Suzuran TwengaBot
Telesoft Twice
Turnitin VB Project
TurnitinBot VCI
Typhoeus
V-BOT
Vacuum Vacuum
VeriCiteCrawler
VidibleScraper
Virusdie Virusdie
Voltron VoidEYE
WISENutbot Voil
WPScan WASALive-Bot
Web Auto WBSearchBot
Web Enhancer WEBDAV
WWW-Collector-E
WWW::Mechanize
WWWOFFLE
Web Collage
Web Fetch Web Fetch
Web Fuck Web Fuck
Web Sauger Web Sauger
Web Sucker WebAuto
WebBandit WebLeacher
WebCopier
WebGo IS
WebPix WebPix
WebReaper WebReaper
WebSauger WebSauger
WebStripper Webalta
WebSucker Website Quester
WebWhacker Widow
WinHTTrack
WiseGuys Robot
Woobot Woobot
Wotbox Wprecon
Zade YoudaoBot
Zermelo Zauba
ZmEu ZoomBot
ZumBot archive.org_bot
adscanner autoemailspider
backlink-check check1.exe
clark-crawler
cognitiveseo cognitiveseo
crawler.feedback com.plumanalytics
crawl.sogou.com
demandbase-bot
domainsproject.org domainsproject.org
evc-batch
instabid instabid
internetVista monitor
isitwp.com isitwp.com
lwp-trivial iubenda-radar
magpie-crawler magpie-crawler
meanpathbot muhstik-scan
netEstate NE Crawler netEstate NE Crawler
oBot
page scorer
plumanalytics plumanalytics
polaris version
ripz ripz
s1z.ru
satoristudio.net
scalaj-http
scan.lol scan.lol
serpstatbot seocompany.store
sitechecker.pro
sp_auditbot
spyfu
sysscan sysscan
tAkeOut ubermetrics-technologies.com
trendiction.com
trendiction.de
webpros.com webpros.com
webprosbot webprosbot
x22Mozilla zauba.io

306
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
01h4x.com 360Spider
404checker ADmantX
80legs ALittle Client
AIBOT Abonti
Aboundex Aboundex
AiHitBot Aboundexbot
AllSubmitter AhrefsBot
AlphaBot Alexibot
Anarchy99 Alligator
Ankit Ankit
Anthill
Aspiegel Aspiegel
AwarioRssBot Attach
BDCbot BackStreet
BDFetch
BLEXBot
BackWeb BackWeb
Backlink-Ceck Bandit
BacklinkCrawler Barkrowler
Badass
BatchFTP
Battleztar Bazinga Battleztar Bazinga
Bigfoot BetaBot
BlackWidow Bitacle
Blow Blackboard
Brandprotect Bolt
Brandwatch Buck
BuiltWith BuiltWith
Bullseye
BuzzSumo
Calculon
CazoodleBot CazoodleBot
Cegbfeieh
CensysInspect
CheeseBot CheeseBot
CherryPicker CherryPicker
Cliqzbot ChinaClaw
Chlooe
Cloud mapping Cloud mapping
Cocolyzebot Cocolyzebot
Collector
Cosmos Cosmos
Craftbot
Crawling at Home Project Crawling at Home Project
Custo CrunchBot
CyotekWebCopy Curious
DBLBot
DIIbot DIIbot
DataCha0s
Demon Demon
Deusu
Devil Devil
Disco Digincore
Discoverybot DigitalPebble
Dispatch
DittoSpyder DittoSpyder
DnyzBot DnBCrawler-Analytics
DomainCrawler DomainStatsBot
ECCP/1.0 Domains Project
EMail Siphon Dotbot
Dragonfly
EMail Wolf EMail Wolf
EasyDL Ebingbong
Ecxi Evil
Express WebPictures
Extractor
ExtractorPro
Ezooms Ezooms
FDM
Flunky
Foobot Foobot
Freeuploader Freeuploader
FrontPage GT::WWW
FyberSpider GetRight
Fyrebot Gigabot
G-i-g-a-b-o-t Go!Zilla
GalaxyBot
Go-Ahead-Got-It Go-Ahead-Got-It
GoZilla
Grafula
GrapeshotCrawler GrapeshotCrawler
GridBot HEADMasterSEO
HTTrack HMView
Haansoft
HaosouSpider HaosouSpider
Harvest Harvest
Havij Havij
Heritrix HybridBot
Hloader IRLbot
HonoluluBot
Iblog
Id-search Id-search
IlseBot IlseBot
Image Fetch
IndeedBot IndeedBot
InterGET InfoNaviRobot
Internet Ninja InfoTekies
IstellaBot IstellaBot
Jbrofuzz Jbrofuzz
JennyBot JennyBot
Joomla JetCar
Jorgee JustView
Keyword Density Keybot Translation-Search-Machine
Kozmosbot Kinza
LNSpiderguy LNSpiderguy
LWP::Simple
Lanshanbot Lanshanbot
Larbin Larbin
Leap Leap
LeechFTP LeechFTP
LexiBot
LibWeb LibWeb
Libwhisker Libwhisker
Likse LieBaoFast
LinkWalker
Linkbot Linkbot
LinkpadBot
LinksManager
LinqiaRSSBot LinqiaRSSBot
LinqiaScrapeBot
Lipperhey Lipperhey
Lmspider Litemage_walker
Ltx71 Ltx71
MFC_Tear_Sample MFC_Tear_Sample
MSFrontPage MIDown tool
MJ12bot
MTRobot
Mail.RU_Bot Mail.RU_Bot
Majestic-SEO Majestic SEO
MarkMonitor MarkMonitor
MarkWatch
Mass Downloader Mass Downloader
Mb2345Browser Meanpathbot
MegaIndex.ru Metauri
MicroMessenger
Microsoft Data Access Microsoft Data Access
Microsoft URL Control Moblie Safari
Mister PiX
Mojolicious
MolokaiBot MolokaiBot
Morfeus Fucking Scanner Morfeus Fucking Scanner
Mr.4x3 Mozlila
NPbot
Name Intelligence Name Intelligence
Navroad
Needle Needle
NetZIP NetMechanic
NextGenSearchBot
Nibbler Nibbler
Niki-bot Niki-bot
NimbleCrawler
Nimbostratus Nimbostratus
Not OpenVAS
Octopus OrangeBot
Offline Explorer
Offline Navigator
OnCrawl
OpenLinkProfiler
Openfind
OutclicksBot OutclicksBot
POE-Component-Client-HTTP PECL::HTTP
Page Analyzer PageScorer
PageGrabber Papa Foto
Pandalytics PeoplePal
Pavuk
Petalbot Petalbot
Pi-Monster
Picscout
Picsearch
Piepmatz
Pimonster Pimonster
ProPowerBot
ProWebWalker
Probethenet Probethenet
PxBroker Psbot
QueryN Metasearch Pu_iN
Quick-Crawler
RankActive
RankingBot2 RankingBot2
RankurBot
Re-re Re-re
Reaper RealDownload
RebelMouse RebelMouse
RedesScrapy Recorder
RepoMonkey Ripper
RocketCrawler
Rogerbot
SBIder SBIder
SEOkicks-Robot
SEOlyticsCrawler
SEOprofiler
SISTRIX SISTRIX
SalesIntelligent
ScanAlert ScanAlert
Scanbot
ScoutJet
Screaming Screaming
ScreenerBot ScreenerBot
ScrepyBot Searchestate
SearchmetricsBot SearchmetricsBot
Seekport Seekport
SiteLockSpider SeobilityBot
Shodan
Site Sucker
SiteSucker SiteSucker
Siteimprove Sitevigil
Snapbot SmartDownload
SocialRankIOBot Snoopy
Sociscraper Sociscraper
Spammen SpankBot
Spanner Spinn3r
Stripper SputnikBot
Sucuri Sqlmap
Surfbot Sucker
Suzuran SuperBot
SurveyBot
Swiftbot Swiftbot
Szukacz T0PHackTeam
TeleportPro T8Abot
Teleport
Telesoft Telesoft
Telesphoreo Telesphoreo
Thumbor Telesphorep
Trendiction Toata
Twice Tracemyfile
URLy.Warning Trendictionbot
UnisterBot Turingos
TurnitinBot
TwengaBot
Typhoeus
URLy Warning
Upflow Upflow
VelenPublicWebCrawler
VeriCiteCrawler
VidibleScraper VidibleScraper
Virusdie
Voil Voil
Voltron
WASALive-Bot WASALive-Bot
WBSearchBot
WISENutbot WISENutbot
WPScan WPScan
WWW::Mechanize WWW-Collector-E
Wallpapers WWW-Mechanize
Wallpapers/3.0 WallpapersHD
WeSEE Web Collage
Web Fetch
Web Pix Web Pix
Web Sucker WebAuto
WebCollage WebEnhancer
WebFetch WebSauger
WebWhacker WebWhacker
WebZIP
WebmasterWorldForumBot WebmasterWorldForumBot
WebsiteQuester
Whack Whack
Whacker
Widow Widow
WinHTTrack
WiseGuys Robot
Wonderbot
Xaldon WebSpider Xaldon WebSpider
Xaldon_WebSpider
Xenu
Zade Zade
Zermelo
Zeus
Zitebot Zitebot
archive.org_bot ZyBorg
autoemailspider autoemailspider
backlink-check
cah.io.community cah.io.community
check1.exe check1.exe
clark-crawler clark-crawler
coccocbot coccocbot
cognitiveseo com.plumanalytics
crawl.sogou.com
crawler.feedback crawler.feedback
evc-batch demandbase-bot
eCatch
heritrix heritrix
instabid instabid
internetVista monitor meanpathbot
ips-agent oBot
lwp-request ripz
magpie-crawler seocompany.store
netEstate NE Crawler seostar
page scorer serpstatbot
pcBrowser sitechecker.pro
probe-image-size
satoristudio.net
scalaj-http
scan.lol
seoscanners
sp_auditbot
tAkeOut tAkeOut
trendiction.com x22Mozilla
trendiction.de zauba.io
ubermetrics-technologies.com zgrab
voyagerx.com
webgains-bot
webprosbot
x09Mozilla

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
108shot.com acgs.tk
acads.net ad-words.ru
albumsuper.info aviav.ru.com
anapa-inns.ru findsexguide.com
anaseracresar.tk gpms.org.my
atmovs.com pornotubs.com
compliance-checker-7.info vgoloveboli.net
placid-rounded-coast.glitch.me video-production.com
vepad.com visitcambridge.org
zone-kev717.info woweb.com.ua

950
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
00it.com
1001watch.com.ua
1008.su 1008.su
202ch.com 12bet.com
4kplayer.pl 12u.info
4replicawatch.net 1314dh.com
5i2.net 14b.info
5tey7463.weebly.com 1bet.com
8si.ru 2015god.org
9icmzvn6.website 214jaluwobapef.cf
2itech.ru
4inn.ru
6128786.com
7search.com
a.pr-cy.ru a.pr-cy.ru
aa8780bb28a1de4eb5bff33c28a218a930.com
aaa38852e886ac4af1a3cff9b47cab6272.com
aac52006ec82a24e08b665f4db2b5013f7.com aac52006ec82a24e08b665f4db2b5013f7.com
abtasty.com
ad-words.ru
adamoads.com
addblueoff.com.ua addblueoff.com.ua
adserver-e7.com aerogo.com
adultgalls.com afftrack001.com
adultwebhosting.info algarveglobal.com
affordablewebsitesandmobileapps.com amazingpic.net
airlandsea.info android-vsem.org
aktobe.xkaz.org apifasterlightin-a.akamaihd.net
alarmobninsk.ru apiwoodensealcom-a.akamaihd.net
albamargroup.com approved.su
ald2014.org arvut.org
allwomen.info atmagroup.ru
alphavisions.net atofilms.com
alpinism.ru audiofree.ru
analnoeporno.tv autoseo-traffic.com
analytics-ads.xyz avon-novosib.ru
animal36.com avon-ukraine.com
anti-virus-removal.info avtolombard-krasnodar.com
apartmentratings.com avtolombard-krasnodar.ru
apibatbrowsecom-a.akamaihd.net ayanaspa.com
apiitsthirteende-a.akamaihd.net bablonow.ru
appiq.mobi bad-stars.net
apps-analytics.net baoxaydung.com.vn
arcteryxsale.online bestkfiledxd.cf
arewater.com besttorrentknifta.weebly.com
asmxsatadriverin.aircus.com bigcareer.info
astrochicks.com bikini-image.com
autoloans.com bildsuche.ru
autoua.top billiard-classic.com.ua
aviapanda.ru bingo8888.com
avon-severozapad.ru bitcoins-live.ru
avtocredit-legko.ru bizzliving.com
axbocz.net blacktwhite.com
baersaratov.ru blogos.kz
bag77.ru bmw.afora.ru
bambi.ck.ua boeuklad.com
bard-real.com.ua book-bets.com
basisches-wasser.net bookmark4you.com
best-businessman.ru bracketsmackdown.com
bestchoice.cf braindaily.xyz
bestdraws.com brandedleadgeneration.com
bestmouthwash.club bronzeaid-a.akamaihd.net
bestofpicture.com brus-vsem.ru
blackbabesporn.com
blagovest-med.ru
blockworld.ru
bloglag.com
blogqpot.com
boanonihaca.tk
bombla.org
bonzybuddy.com
bouda.kvalitne.cz
brains2.biz
brainsandeggs.blogspot.com
braip.com.br
breget74.ru
brillianty.info
brimstonehillfortress.org
bristolhostel.com
buckspar.gq buckspar.gq
businescoop.men budilneg.xyz
buttons-for-your-website.com bugof.gq
buybest1.biz bus-offer.com
buypanicdisorderpill.com business-made-fun.com
calc-for-credit.ru buydissertation.net
carabela.com.do buypuppies.ca
carfax.com.ua buzzsumo.com
chatroulette.online buzzzg.men
cheapcigarettesc.info c-english.ru
checkhit.com c1.onedmp.com
chimiver.info cactussoft.biz
cigarpass.com camsex.xxx-cam.webcam
civilwartheater.com canacopegdl.com
candy-glam-hp.com
canvas.gloverid.site
capture-room.com
casinos4dummies.co.uk
cayado.snn.gr
ccbill.com
cdncash.com
cellfun.mobi
cherubinimobili.it
choosecuisine.com
cibpenonptib.flu.cc
cleanallspyware.com
clickpapa.com
clmforexeu.com
coaching-netz.info coaching-netz.info
cobaltpro.ru coindirect.io
compliance-alex.top com-cleaner.systems
compliance-irvin.xyz communisave.co.za
contextualyield.com compliance-brian.top
cookie-law-enforcement-ff.xyz compliance-ivan.xyz
coolbar.pro compliance-nelson.top
countercrazy.com connectingsingles.com
cpajunkies.com cookie-law-enforcement-aa.xyz
crest3d.ru cornomase.win
culad.com cougfan.info
custodieva.ru counterbot.com
d2jsp.org craftinsta.ru
danceuniverse.ru creativehutindia.com
dangphoto.trade credit.co.ua
danschawbel.com dating-time-now.com
decenttools.com dbmkfhqk.bloger.index.hr
dekorkeramik.ru ddospanel.com
dellalimov.com ddpills.com
deluxedumps.com deadlinkchecker.com
den-noch24.ru dealighted.com
dinkolove.ya.ru delta-line.men
dnepr-avtospar.com.ua demon-tweeks.com
dostavka-v-ukrainu.ru deniven.1bb.ru
downtuptv.gq deshevo-nedorogo.ru
dverimegapolis.ru devochki.top
eager-nash.188-93-233-196.plesk.page dickssportinggoods.com
easyshoppermac.com digitalfaq.com
ebooknovel.club djstools.com
ec-file.info domain.webkeyit.com
egvar.net domaineaneblanc.com
electricwheelchairsarea.com dominateforex.ml
elektrozigaretten1.webs.com dominterior.org
elmacho.xyz donvito.unas.cz
elvenar.com dostavimvdom.ru
emergencyneeds.org download-of-the-warez.blogspot.com
empathica.com drpornogratisx.xxx
en.altezza.travel dscaas.website
enhand.se dumuelave.xyz
epngo.bz dynainbox.com
eredijovon.com e-c.al
eu-cookie-law.blogspot.com eaplay.ru
exci.ru education-cz.ru
ezigarettenshop1.yolasite.com electro-prom.com
f07.de elektrischezigarette1.onsugar.com
fable.in.ua elmifarhangi.com
failingmarriege.blogspot.com enbersoft.com
falopicm.pw essayservicewriting.org
faracontrol.ir eyessurgery.ru
faz99.com ezrvrentals.com
feeriaclub.ru f5mtrack.com
fermersovet.ru family1st.ca
fickenbumsen.net familyphysician.ru
film-one.ru famix.xyz
filmbokep69.com fantasticpixcool.com
fitnesspiks.com fertilitetsradgivningen.se
fiverr.com filefilter.weebly.com
fix-website-errors.com filmania-x.ru
floating-share-buttons.com filmgo.ru
fodelsedagspresenter.nu filmi-onlain.info
foodcrafts.website fireads.men
foto-basa.com fitfloponline.store
foxydeal.com focalink.com
frankofficial.ru forsex.info
freakycheats.com foto-sisek.porngalleries.top
free-deals.faith free-stock-illustration.com
free-fb-traffic.com freeseedsonline.com
free-fbook-traffic.com freeuploader.com
free-share-buttons.com frequiry.com
free-social-buttons.xyz fuckbuddybestgilf.info
freelifetimefuckbook.com fuel-gas.com
freshwallpapers.info funtoonez.com
frivgame250.com g7m.pl
frustrated-favorable.gq galeria-zdjec.com
galaxys6manual.info gallerylisting.com
gateway.zscalerone.net gaypornmovie.net
gemara.com generousdeal-a.akamaihd.net
glasof.es getdot.ru
go2album.com getlamborghini.ga
go2mike.ru gg-arena.ru
gomusix.com girls-ufa.ru
goodly.pro glastecfilms.com.my
googlefeud.com go2jump.org
gorabagrata.ru graphics8.info
gotcher.us gratuitbaise.com
greenshop.su
gsasearchengineranker.pw
gsasearchengineranker.site
gsasearchengineranker.space gsasearchengineranker.space
gsmtlf.ru gsasearchenginerankerdiscount.com
gungamesz.com guarrasdelporno.xxx
hahashka.ru guitar-master.org
hanink.biz.ly guruofcasino.com
hannasolution.ru gwhwpxbw.bloger.index.hr
hatdc.org hasfun.com
hausfrauensex18.com havepussy.com
headpharmacy.com healmytrauma.info
headpress.ru hentai-manga.porn
healing-dysplasia.ru high-speed1.net
hkdiiohi.skyrock.com hmmm.cz
hledejvshopech.cz honyaku.yahoofs.jp
homeandhealth.ru hostcritique.com
hostsshop.ru housekuba.org
hothor.se hoverboard360.se
housediz.com howopen.ru
housemilan.ru hreade.com
howtowhitenteethfast.xyz hully.altervista.org
hulfingtonpost.com hyipmanager.in
hundejo.com ideibiznesa2015.ru
hunterboots.online ido3.com
id-forex.com ilmexico.com
idegenvezeto.eu ilovevitaly.ru
iideaidekonkatu.info images-graphics-pics.com
imagui.eu iminent.com
imediadesk.com imperiafilm.ru
imk.com.ua
imperia31.ru
import-sales.com import-sales.com
impresagaia.it impotentik.com
infodocsportal.com indiakino.net
informatiecentro.be infoupdate.org
instasexyblog.com innoslicon.com
insurple.com int.search.mywebsearch.com
intelhdgraphicsgtdrive6w.metroblog.com
internetartfair.com internetartfair.com
istmira.ru ip-guide.com
iweblist.info iqoption.pro
jagg.info islandminingsupply.wordpress.com
jamiembrown.com istripper.com
jewelryandfiligree.com jav-idol.com
jmat.cn javitas.info
job.icivil.ir jerseyswholesalechinalimited.com
jrcigars.com johnnyhaley.top
junglenet-a.akamaihd.net joingames.org
justdating.online journeydownthescale.info
justucalling32211123456789.tk karpun-iris.ru
kabbalah-red-bracelets.com kchaxton.com
kaliningrad.zrus.org keenoutlet.online
kanimage.com kerch.site
karadene.com kerwinandcariza.com
kasino-money.pw kfon.eu
keyhantercume.com
kichenaid.ru
kicknights.gq
kimcurlrvsms.com kimcurlrvsms.com
kinobest.pl kino-ecran.ru
knogg.net kino-filmi.com
kopihijau.info kino-rf.ru
koronirealestate.gr kino2018.club
krasivoe-hd.com kinofak.net
kursy-ege.ru kinogolos.ru
larutti.ru kinohit1.ru
laulini.soclog.se kletkimehan.ru
leadn.pl koleso24.com.ua
letmacworkfaster.site kollesa.ru
lignofix.ua lafourmiliaire.com
likesdesign.com lampokrat.ws
llastbuy.ru lashstudia.ru
locustdesign.co laxob.com
longgreen.info lechtaczka.net
luxup.ru lflash.ru
mafcards.ru lida-ru.com
maladot.com lion.misba.us
marmotstore.online lion.playtap.us
marwer.info locatellicorretor.com.br
mcnamaratech.com louboutinshoes.xyz
me-ke.com louisvuittonoutletstore.net
med-zdorovie.com.ua m-google.xyz
medanestesia.ru m0r0zk0-krava.ru
meddesk.ru m5home.ru
mediaoffers.click macdamaged.tech
meet-flirt-dating.com macnewtech.com
meget.co.za malls.com
metaxalonevstizanidine.blogspot.com malwareremovalcenter.com
methodsmarketing.com mararoom.ru
michaelkorsoutletstore.net martlinker.com
microsoftportal.net mecash.ru
milblueprint.com medicineseasybuy.com
minecraft-neo.ru megahdporno.net
mirobuvi.com.ua mere.host.sk
missclub.info mesto-x.com
meteostate.com
mirzonru.net
misterjtbarbers.com
mistr-x.org mistr-x.org
mobstarr.com mitrasound.ru
moesexy.com mnogabukaff.net
monarhs.info mobilemedia.md
moneyviking-a.akamaihd.net mobplayer.ru
moscow.online-podarki.com mobsfun.net
moscow.xrus.org moesonce.com
mozello.ru mole.pluto.ro
mtmtv.info moonci.ru
musflashtv.com morf.snn.gr
musicktab.com moxo.com
musicstock.me mrsdalloways.com
mustat.com myblogregistercm.tk
muz-baza.net myfreemp3.eu
muznachas-service.ru narco24.me
muztops.ru naturtreenspicerx.pw
myftpupload.com newyorkhotelsmotels.info
mypets.by nfljerseyscheapchinabiz.com
na-telefon.biz nikkiewart.ru
nakrutka.cc noclegonline.info
narkologiya-orel.ru novatech.vn
nelc.edu.eg nrjmobile.fr
niki-mlt.ru nufaq.com
nikitsyringedrivelg.pen.io oballergiya.ru
njkmznnb.ru obiavo.kz
njpalletremoval.com obiavo.uz
northfacestore.online okonich.com.ua
oconto.ru okout.ru
oda.as omoikiri-japan.ru
okuos.com onemantrip.com
one.net.in online-x.ru
onlinadverts.com ooo-gotovie.ru
openstat.com optitrade24.com
optibuymac.com osb.se11.ru
orel-reshka.net ourville.info
orsonet.ru pacificair.com
owathemes.com parajumpersjakkesalgnorge.info
oxotl.com parajumpersoutlet.online
paidonlinesites.com park.above.com
palvira.com.ua partner-trustworthy.men
pammik.ru partnerads.men
paparazzistudios.com.au partners-ship.pro
partnersafe.men partnersafe.men
pateaswing.com pawli.eu
pavlodar.xkaz.org pdn-4.com
perederni.net phormchina.com
phelissota.xyz physfunc.ru
picphotos.net pictures-and-images.com
pistonclasico.com plastgran.com
pixgood.com play.leadzupc.com
pizdeishn.com ploenjitmedia.azurewebsites.net
poligon.com poligon.com
popander.mobi polska-poezja.com
popserve.adscpm.net polytopesexempt.com
porndl.org popcash.net
pornogad.com poptool.net
pornoinn.com popup-hgd.xyz
portside.cc porn-w.org
preparevideosafesystem4unow.site porno-chaman.info
preparevideosafesystem4unow.space pornoblood.com
pornoelita.info
pornoklad.net
pornoreino.com
portadd.men
pp-budpostach.com.ua
primedice.com
printingpeach.com
privatefx-in.ru
privetsochi.ru privetsochi.ru
proftests.net prizefestival.mobi
progress-upakovka.ru pro-tec.kz
projefrio.com.br promodj.com
pron.pro pronekut.com
proprostatit.com proprostatit.com
prostitutki-rostova.org pssucai.info
pts163.ru pufip.com
pwwysydh.com purplesphere.in
qor360.com pyramidlitho.webs.com
quebec-bin.com quickloanbank.com
qwarckoine.com rabotaetvse.ru
rabot.host.sk rankia.com
radiodigital.co rankscanner.com
ranksonic.info
ranksonic.org ranksonic.org
rcb101.ru rebuildermedical.com
recinziireale.com redirlock.com
redirectingat.com rednise.com
registrationdomainsite.com relatodelpresente.com.ar
remont-komputerov-notebook.ru rent2spb.ru
restaurantlescampi.com rep-am.com
reward-survey.net replica-watch.ru
rfd-split.hr rethinkwasteni.info
ribieiendom.no reversing.cc
rimedia.org ritlweb.com
robertefuller.com rollercoin.com
rucrypt.com rutor.vip
ryetaw.com sanidumps.com
sa-live.com santechnik.jimdo.com
salutmontreal.com sashagreyblog.ga
sbprabooks.com savetubevideo.com
scanmyphones.com scanmyphones.com
schoolfiles.net scanner-walter.top
scoopquest.com scenicmissouri.us
search.pch.com school-diplomat.ru
searchinterneat-a.akamaihd.net score-ads.men
securityallianceservices.com scrapinghub.com
see-your-website-here.com search.1and1.com
seemoreresultshu-a.akamaihd.net searchencrypt.com
seocheki.net seasonvar.ru
seoholding.com secret.xn--oogle-wmc.com
seorank.info seorussian.ru
seozoom.it serving.adbetclickin.pink
serialsway.ucoz.ru sexcamamateurchat.com
service.adtech.us sexfreepornoxxx.com
serw.clicksor.com sexs-foto.com
sethrollins.net sexy-pings.com
sex-dating.co sheerseo.com
sex-sex-sex5.com silverage.ru
shakhtar-doneck.ru simplesite.com
shell-pmr.ru
shijian.ac.cn
sildenafilcitratemed.com
similardeals.net
sims-sims.ru sims-sims.ru
siteheart.net skylta.com
sitopreferito.it sledstvie-veli.net
skachat-besplatno-obrazcy.ru small-games.biz
slavia.info smart-scripts.com
slimcdn.com sms2x2.ru
slowmac.tech social-s-iii.xyz
sneakyboy.com socialmediasuggest.com
snworks.com sofit-dmd.ru
soheavyblog.com special-porn.com
solitaire-game.ru spravka-medosmotr.ru
sovinsteel.ru sprttrack.com
speedup-my.site spy-app.info
stardevine.com stairliftsarea.com
statoutlook.info statoutlook.info
stretchingabuckblog.com statustroll.com
stroicol.net streamin.to
strongholdsb.ru stromerrealty.com
svbur.ru suhanpacktech.com
svtrd.com surffoundation.nl
swinger-mobil.net swsociety.se
taraz.xkaz.org tacbibirfa.tk
tasteidea.com tagil.zrus.org
teenfuck.tv tedy.su
telefonsexkostenlos.tk terraclicks.com
telesvoboda.ru terrafootwear.us
tetracsaudi.com thetattoohut.com
the-usa-games.blogspot.com thfox.com
theallgirlarcade.com tiandeural.ru
thefds.net tilido.com
themeforest.net timetorelax.biz
thesmartsearch.net tizanidinehcl4mgisitanarcotic.blogspot.com
thin.me.pn tizanidineinfo.blogspot.com
ticketsys.inetwd.com tizanidineonline.blogspot.com
titan-ads.life tizanidinesideeffectsweightloss.blogspot.com
titelhelden.eu tizanidineusedfor.blogspot.com
tizanidine4mgprice.blogspot.com tmtrck.com
tizanidinedruginteractions.blogspot.com tootoo.to
tizanidineinteractions.blogspot.com topanasex.com
tizanidineoral.blogspot.com
tizanidineshowupondrugtest.blogspot.com
tnaionline.org
top-karkas.ru
topclickguru.com
torrentred.games torrentred.games
torrents.cd tpu.ru
tourcroatia.co.uk trafficcentr.xyz
track112.site trafficstars.com
tracksurf.daooda.com trailer.cinemaflix.website
tracxn.com triumf-realty.ru
truck-land.life truck-land.life
truebeauty.cc trucri.me
trumpetedextremes.com turbodsp.com
turkeyreport.tk twelvevisionspartyofcolorado.com
tv-spoty.info typer.one
twinderbella.com tyumen.xrus.org
u-cheats.ru ua.tc
uchil.net ukrtvory.in.ua
uggbootsoutletsale.us ultimateclassicrock.com
uhdtv.website unisexjewelry.org
uhod-za-sobakoj.ru upstore.me
unimodemhalfduplefw.pen.io uptimechecker.com
unitygame3d.com urccvfmc.bloger.index.hr
unlimitdocs.net url2image.com
unmaroll.ya.ru usacasino.com
uptime-delta.net
ural-buldozer.ru
urldelivery.com
urlopener.blogspot.com.au
ussearche.cf ussearche.cf
uytmaster.ru utrolive.ru
vapsy.com uvozdeckych.info
vedomstvo.net vabasa.inwtrade.com
veles.shop valueclick.com
vesnatehno.ru vbikse.com
viandpet.com vegan-foods.us
video-woman.com viagroid.ru
videochat.cafe
videochat.life
videochat.world videochat.world
videonsk.com videosbox.ru
vinylvault.co.uk viel.su
vip.51.la vipps.com.my
vksaver-all.ru visa-pasport.ru
vvpg.ru vkonche.com
vysigy.su vladimir.zrus.org
vzlomsn.org voloslove.ru
vzube.com vremya.eu
w3javascript.com vtcdns.com
wapsite.me wallpapersdesk.info
watchinf.com wallpapersist.com
we-are-gamers.com wardreapptokone.tk
webpromotion.ae watchmyfb.pl
webs.com waterefficiency.co
websiteaccountant.de waycash.net
weburok.com weclipart.com
wesharepics.info wedding0venues.tk
westvilletowingservices.co.za wesharepics.site
whatsappbot.flyland.ru whengirlsgowild.com
wholesalejerseychinashop.com wholesalejerseychinashop.com
wikes.20fr.com wingsoffury2.com
worldoffiles.ru wingsofrefuge.net
x-true.info woman-orgasm.ru
xn----7sbahjd3btneuw1joc.xn--p1ai wonderfulflowers.biz
xn----7sbaphztdjeboffeiof6c.xn--p1ai www.arenda-yeisk.ru
xn--d1acah0c.xn--p1ai www.event-tracking.com
xsion.net xbaboon.com
xtremeeagles.net xblognetwork.com
xtubeporno.net xn--80aikhbrhr.net
xxx-cam.webcam xn--90acenikpebbdd4f6d.xn--p1ai
xxxkaz.org xn--hxazdsfy.blogspot.com
yellowproxy.net xn--q1a.xn--b1aube0e.xn--c1acygb.xn--p1ai
yellowstonesafaritours.com xvideosbay.com
youjizz.com youdesigner.kz
youradexchange.com yougame.biz
yourserverisdown.com yourporn.com
yourtemplatefinder.com youtubologia.it
ypmuseum.ru
zaim-pod-zalog-krasnodar.ru
zapatosenventa.info
zero1.it zero1.it
zeroredirect12.com zionstar.net
zeroredirect7.com zixizop.net.ru
zeroredirect8.com zootravel.com
zrelaya.pw zrus.org
zs2vm.top zzlgxh.com

488
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
123cha.com 00it.com
1qingdao.com 101lesbian.xyz
28n2gl3wfyb0.ru 123kuma.com
4kepics.com 123movies.love
4pp13.com 7xc4n.com
a.pr-cy.ru abcdefh.xyz
aarbur.com add-add.men
aasoldes.fr addray.pro
abwa.tk adidas.frwebs.fr
advertisingtag.net adtech.de
alloysteel.ru adult3dgames.com
allpdfmags.net ahhjf.com
amateurlivechat.org allcredits.su
aproposde.com alldownload.pw
artefakct.com allornamenti.com
auto4style.ru alphaforum.ru
autodo.info alpinism.ru
avon-novosib.ru am-se.com
azinoofficial777.ru animebox.com.ua
balans.shahterworld.org aosheng-tech.com
bankofthewext.com astana.xxxkaz.org
bannertesting.com atley.eu.pn
bard-real.com.ua atmagroup.ru
bestbrainprod.win atofilms.com
bfz.biz avtocredit-legko.ru
azartmsl.com
babyfactory.fr
banan.tv
berdasovivan.ru
bestwebsiteawards.com
bibys.com bibys.com
bimatoprost-careprost.com.ua bio-optomarket.ru
blackcurranthumidifiers.site bioca.org
blockety.co bitporno.sx
blogrankers.com blackhatworth.com
bombla.org bmsco.co
bonzbuddy.com bongacams.com
boo-arts.com brandehk.dk
brillianty.info callmd5map.com
cah.io.community candlewooddentalcentre.com.au
calvet.altervista.org carsplate.com
carabela.com.do castingbank.ru
cartierlove2u.com cfsrating.sonicwall.com
cbozhe.com cheapsergiorossi.online
chatroulette.life clodo.ru
check-host.net community.allhiphop.com
chimiver.info courtshipgift.com
cinemaflix.website crackzplanet.com
cjmc.info crest3d.ru
codysbbq.com cs-passion.pl
compliance-alex.xyz customergrowthsystems.com
compliance-elena.top cyprusbuyproperties.com
compliance-josh.top d2jsp.org
compliance-viktor.top dailyfinancefix.com
cool-wedding.net darkages.info
counterbot.com decorationspcs.com
cowlmash.com design-lands.ru
creams.makeforum.eu detective01.ru
creatives.adbetclickin.pink dimaka.info
credit-online.ws diminishedvalueoforegon.com
dandiyabeats.in djihispano.com
designdevise.com dojki365.online
dkvorota.ru dostavimvdom.ru
druzhininevgeniy63.blogspot.com dtm-spain.com
elektrischezigarette1.blog.pl dustyorate.com
emediate.eu egovaleo.it
eupornstar.info elektroniksigaraankara.info
f5mtrack.com esnm.ru
fantasticpixcool.com extremez.net
fillmewithhappiness.com farmingworm.com
flex4launch.ru fast-wordpress-start.com
fm-upgrade.ru fastcrawl.com
forensicpsychiatry.ru filesmonster.porn
forpackningsutveckling.se freelifetimefuckbook.com
fototravel.eu freemags.cc
foxweber.com fuckbuddybestgilf.info
freetangodownload.com fuckingawesome.com
frivgame250.com fxtips.ru
front.to gateway.zscalertwo.net
fun2cell.net gcup.ru
gallerily.com geile-lelly.eu
gamewrath.com geilehausfrauen.net
gaytube.com gerhardhealer.com
gentamicineyedrops.blogspot.com get-free-social-traffic.com
glopages.ru getdot.ru
gotcher.us getridofstretchmarks.org
grand-chlen.ru gigixo.com
gribokstop.com goo.ne.jp
guildebzh.info gov.yanao.ru
gwebtools.com.br gsasearchengineranker.site
handicapvantoday.com hamilton.ca
handsandlegs.ru hayate.biz
healthcarestore.info hem.passagen.se
help.tpu.ru hermesreplica.pw
hitsbox.info hoverboard360.nl
home-task.com hoverboardforsaledirect.com
homemature.net hplaserjetpdriver8y.pen.io
hotgirlhdwallpaper.com hustoon.over-blog.com
hothot.ru icaseclub.ru
hotshoppymac.com iideaidekonkatu.info
hulfingtonpost.com ilmen.net
hunthillfarmtrust.org inboundlinks.win
images.gyffu.com infektsii.com
imitex-plus.ru insta-add.pro
izhevsk.xrus.org intellektmedia.at
jav-fetish.com invitefashion.com
jerseywholesalebizchina.com ipchicken.com
jurajskie.info iqoption.com
kinosed.net irunfar.com
kirov.zrus.org isitpaleo.info
kliksaya.com isoveti.ru
kndxbkdx.bloger.index.hr ix20.ru
knogg.net j-times.ru
komp-pomosch.ru je7.us
kretpicf.pw jennyfire.ru
kriokomora.info jeremyeaton.co
kutikomi.net jjbabskoe.ru
kwzf.net juliadiets.com
linkdebrideur.xyz justprofit.xyz
live-cam6.info karusel-market.ru
locksmith.jp keywordblocks.com
lodki-pvh.dp.ua kichenaid.ru
lol-smurfs.com kimcurlrvsms.com
lomza.info kino-rating.ru
louisvuittonoutletstore.net kinofak.net
lunchrock.co kinotorka.ru
mabdoola.blogspot.com konoplisemena.com
macfix.life konpax.com
medicineseasybuy.com kovrenok.ru
mesbuta.info labplus.ru
mil-stak.com lexiangwan.com
missvietnam.org link.ac
misswell.net liquimondo.com
mixx.com ljusihus.se
lordzfilmz.me
m-google.xyz
macnewtech.com
martlinker.com
mcadamssupplyco.com
medanestesia.ru
medicines-choice.com
medizinreisen.de
mir-business-24.ru
mlf.hordo.win
mokrayakiska.com
mole.pluto.ro mole.pluto.ro
monclerjacketsoutlet.win
mp3s.club
msk.afora.ru msk.afora.ru
musflashtv.com muztops.ru
mycaf.it
myhitmp3.club
myra.top
naturalshair.site naturalshair.site
naturtreenspicerx.pw negociosdasha.com
net-profits.xyz nevansk.ru
news-speaker.com notaria-desalas.com
nina.az nrjmobile.fr
noclegonline.info nzfilecloud.weebly.com
nordvpn.com o333o.com
nowtorrents.com obiavo.kz
o.light.d0t.ru okout.ru
okmusic.jp optibuymac.com
okroshki.ru orgasmus-virtual.com
olympescort.com outclicks.net
onblastblog.online pewit.pw
paintingplanet.ru pijoto.net
paleohub.info pixshark.com
palocco.it plaff-go.ru
parajumpersjakkesalgnorge.info play-movie.pl
pensplan.com podshipniki-nsk.ru
petedrummond.com polytopesexempt.com
petsblogroll.com popugauka.ru
pharmacyincity.com pornobrazzers.biz
piccdata.com pornoplen.com
pics-group.com pornzone.tv
play-mp3.com preconnubial.usuby.site
porndroids.com prefersurvey.net
pornhub-forum.ga prostitutki-kiev.org
prizefestival.mobi prostitutki-tyumeni.org
productarium.com r-e-f-e-r-e-r.com
produkto.net rabot.host.sk
promoforum.ru realresultslist.com
puserving.com realtytimes.com
qwertty.net rightenergysolutions.com.au
rank-checker.online rocis.site
razorweb-a.akamaihd.net rusprostitute.com
rczhan.com scanner-olga.top
remont-comp-pomosh.ru
remont-mobile-phones.ru
remontbiz.ru
reward-survey.net
sakhboard.ru
sanidumps.com
satoristudio.net
sayyoethe.blogspot.co.za
sbricur.com
scanner-ivan.top
scanner-jess.top
scanner-josh.top
scanner-mary.top
screpy.com screpy.com
seadragonherbery.com sdrescher.net
search.pch.com semp.net
service.adtech.fr semxiu.com
sexgalleries.top seo-traffic-ranking.info
sexiporno.net sexiporno.net
sim-service.net shitting.pro
simon3.ru signx.info
sinestesia.host.sk siha.de
site3.free-share-buttons.com simplesite.com
sitevaluation.com skypasss.com
slomm.ru skytraf.xyz
snegozaderzhatel.ru social-button.xyz
soaksoak.ru socialmonkee.com
sohoindia.net sockshares.tv
soserfis.com sortthemesitesby.com
sterva.cc sportbetfair.com
stpicks.com sptslmtrafms.com
streha-metalko.si spywarespy.com
strongholdsb.ru srdrvp.com
stuffpride.com stoki.ru
suchenindeutschland.com superlist.biz
sweepstakes.rewardit.com svetlotorg.ru
tako3.com tacbibirfa.tk
tampabaywatch.org taihouse.ru
tasteidea.com tattomedia.com
teenbbw.yopoint.in taximytishi.ru
telefonsexsofort.tk tecnoteakviareggio.it
templates.radiodigital.co thepantonpractice.co.uk
the-usa-games.blogspot.com tizanidinehcl4mgisitanarcotic.blogspot.com
tizanidinehcl2mgtablet.blogspot.com tizanidinestreetprice.blogspot.com
tizanidinerecreationaluse.blogspot.com tmm-kurs.ru
tmearegion26.com tongkatmadura.info
torture.ml tradgardspartner.se
tozup.com trafficreceiver.club
trkdf.com tsan.net
uptime-delta.net ugogo.info
viddyoze.com uprour.com
vkonche.com urengoy.pro
webcamdevochka.com uzporno.mobi
website-speed-check.site vesnatehno.com
websites-reviews.com videtubs.pl
webstatsdomain.org vipms.ru
westen-z.life virus-schutzmasken.de
whos.amung.us viven.host.sk
wttavern.com vk-mus.ru
www.arenda-yeisk.ru vladimir.xrus.org
www.pinnacle-bets.com walkme.com
wygraj-skiny.win webcamtalk.net
x-porno.video websiteexplorer.info
xedserver.com weburok.com
xfluro.com welck.octopis.com
xn--b1agm2d.net wesharepics.site
xn--e1afanlbnfckd7c3d.xn--p1ai whereiskentoday.com
yebocasino.co.za wingsoffury2.com
youbrainboost.asia wowas31.ucoz.ru
youghbould.wordpress.com xaylapdiendanang.com
yourmovies.pl xn--80aaaks3bbhabgbigamdr2h.xn--p1ai
youtubologia.it youbloodyripper.com
zhacker.net yoursearch.me
zixizop.net.ru yugk.net
zone-kev717.info yun56.co
zs2vm.top zastroyka.org
zskdla.site znaturaloriginal.com
zzlgxh.com zrelaya.pw
zygophyceous.womanstars.site
zynax.ua

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.65 0; 10.1.0.12 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.05.3108 ### Version: V4.2022.05.3109
### Updated: Mon May 16 10:03:42 UTC 2022 ### Updated: Mon May 16 22:01:11 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.05.3108 ### Version: V4.2022.05.3109
### Updated: Mon May 16 10:03:42 UTC 2022 ### Updated: Mon May 16 22:01:11 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##