vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-02 10:40:36 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2021.11.2746 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2021-11-29 22:07:21 +00:00
parent b8ea31d4ef
commit 7961130738
46 changed files with 72401 additions and 72401 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2021.11.2745 #### Version: V4.2021.11.2746
#### Bad Referrers Blocked: [7079](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7079](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [630](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [630](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2021.11.2745 #### Version: V4.2021.11.2746
#### Bad Referrers Blocked: [7079](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7079](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [630](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [630](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -11,7 +11,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2021.11.2745 #### Version: V4.2021.11.2746
#### Bad Referrers Blocked: [7079](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7079](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [630](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [630](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

8914
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2021.11.2745 #### Version: V4.2021.11.2746
#### Bad Referrers Blocked: [7079](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7079](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [630](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [630](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

8918
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

8918
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

8918
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

8918
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.144 1; 10.1.0.50 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.144 0; 10.1.0.50 0;
127.0.0.1 0; 127.0.0.1 0;

8918
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.144 1; 10.1.0.50 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.144 0; 10.1.0.50 0;
127.0.0.1 0; 127.0.0.1 0;

8918
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.144 1; 10.1.0.50 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.144 0; 10.1.0.50 0;
127.0.0.1 0; 127.0.0.1 0;

8918
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
2745 2746

8918
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

8918
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
51.143.91.199 0; 20.124.225.148 0;

8918
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.144 1; 10.1.0.50 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.144 0; 10.1.0.50 0;
127.0.0.1 0; 127.0.0.1 0;

8918
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.144 1; 10.1.0.50 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.144 0; 10.1.0.50 0;
127.0.0.1 0; 127.0.0.1 0;

8918
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.144 1; 10.1.0.50 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.144 0; 10.1.0.50 0;
127.0.0.1 0; 127.0.0.1 0;

8918
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
51.143.91.199 0; 20.124.225.148 0;

8918
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
51.143.91.199 0; 20.124.225.148 0;

8918
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.144 1; 10.1.0.50 1;
127.0.0.1 1; 127.0.0.1 1;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
BlackWidow MarkMonitor
BuzzSumo Msrabot
Cloud mapping Nutch
NextGenSearchBot Trendictionbot
Sogou web spider WWW-Collector-E
Sqlworm WiseGuys Robot
WWW::Mechanize Wprecon
eCatch Zauba
heritrix ZumBot
spyfu gopher

286
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
404checker 01h4x.com
80legs 360Spider
ALittle Client ALittle Client
ASPSeek
Abonti Abonti
Aboundexbot Aipbot
Acunetix AlphaBot
AiHitBot Anarchy
Alexibot
Anarchy99 Anarchy99
Anthill Ankit
Asterias Apexoo
AwarioRssBot Attach
BBBike BackWeb
BDCbot Badass
BacklinkCrawler
Bandit Bandit
Battleztar Bazinga Battleztar Bazinga
Bitacle Bigfoot
Black Hole Black Hole
BlackWidow
Blackboard Blackboard
Blow
BlowFish
Brandprotect
Brandwatch Brandwatch
Buck
Buddy
BuiltWith BuiltWith
Bullseye Bullseye
BunnySlippers BunnySlippers
BuzzSumo
CATExplorador CATExplorador
CCBot
CazoodleBot CazoodleBot
CheTeam Cegbfeieh
CheeseBot CensysInspect
CherryPicker Chlooe
ChinaClaw Cloud mapping
Cogentbot Cocolyzebot
Copyscape Copyscape
Cosmos
Crawling at Home Project Crawling at Home Project
CrazyWebCrawler Crescent
Curious
Custo
CyotekWebCopy
DBLBot
DTS Agent DTS Agent
DataCha0s Demon
DatabaseDriverMysqli Deusu
Devil Devil
Digincore Digincore
DigitalPebble Dirbuster
Discoverybot Discoverybot
Dispatch DnBCrawler-Analytics
DomainAppender
DomainStatsBot DomainStatsBot
Dotbot
Dragonfly Dragonfly
EMail Siphon EMail Wolf
EasyDL
Ebingbong Ebingbong
Ecxi Evil
Express WebPictures
ExtLinksBot ExtLinksBot
EyeNetIE Extractor
FHscan FDM
Firefox/7.0 Fimap
Flunky FrontPage
Foobot G-i-g-a-b-o-t
FyberSpider GermCrawler
GT::WWW
Genieo
GetWeb
Getintent Getintent
Go-Ahead-Got-It Gigabot
GrabNet Go!Zilla
GoZilla
Gotit
Grafula Grafula
HTMLparser GrapeFX
HTTrack HTTrack
HaosouSpider HaosouSpider
Havij Harvest
Heritrix Hloader
HybridBot IDBTE4M
Iblog IDBot
IlseBot IRLbot
IndeedBot Indy Library
InfoNaviRobot InfoNaviRobot
IstellaBot JOC Web Spider
JamesBOT
JennyBot JennyBot
JetCar JetCar
Jorgee
Jyxobot
Keyword Density Keyword Density
LWP::Simple
Lanshanbot Lanshanbot
Larbin Lftp
LeechGet LibWeb
LinkScan Libwhisker
LinkWalker Likse
Linkdexbot
LinkextractorPro LinkextractorPro
LinkpadBot
LinksManager LinksManager
Litemage_walker LinqiaScrapeBot
Lmspider Lipperhey Spider
MFC_Tear_Sample
MIIxpc MIIxpc
MQQBrowser
MTRobot
Mag-Net
Mail.RU_Bot
Majestic SEO Majestic SEO
Majestic-SEO
MarkMonitor MarkMonitor
Mass Downloader
MauiBot MauiBot
MeanPath Bot
Mediatoolkitbot
MegaIndex.ru MegaIndex.ru
Metauri Metauri
Moblie Safari MicroMessenger
Microsoft URL Control
Minefield
Mister PiX
Mojeek
Morfeus Fucking Scanner Morfeus Fucking Scanner
Mozlila Mozlila
Msrabot Mr.4x3
NPbot NearSite
Needle
Nessus Nessus
NetAnts Net Vampire
NetLyzer
NetSpider
NetZIP
Netcraft
Nettrack Nettrack
Nibbler Netvibes
Nikto
NimbleCrawler NimbleCrawler
Nimbostratus
Nuclei Nuclei
Nutch Nutch
Offline Navigator Offline Navigator
OpenLinkProfiler OpenLinkProfiler
OpenVAS OrangeBot
Openfind
OrangeSpider OrangeSpider
OutclicksBot OutclicksBot
OutfoxBot
PECL::HTTP
POE-Component-Client-HTTP POE-Component-Client-HTTP
PageAnalyzer PageAnalyzer
PageGrabber
PageThing.com
Panscient Panscient
PeoplePal PeoplePal
Petalbot Petalbot
Pi-Monster Pixray
Picscout
Probethenet Probethenet
Psbot Psbot
Pump Pump
PxBroker Quick-Crawler
RSSingBot RSSingBot
RankFlex Rankivabot
RankingBot
Re-re
ReGet ReGet
RealDownload RealDownload
RebelMouse RocketCrawler
RedesScrapy SBIder
Rogerbot SEOkicks-Robot
SEOlyticsCrawler
SEOprofiler SEOprofiler
SISTRIX
SMTBot SMTBot
SalesIntelligent
ScanAlert
Scanbot
Scrapy
Screaming
ScreenerBot ScreenerBot
ScrepyBot
SearchmetricsBot SearchmetricsBot
SemrushBot
Seomoz
Shodan Shodan
SiteLockSpider SiteExplorer
SiteSnagger Sitebeam
Siteimprove Snake
SocialRankIOBot
Sociscraper Sociscraper
Sogou web spider Sogou web spider
Sosospider Sosospider
SpaceBison Sottopop
Spanner Spinn3r
Spbot Sqlmap
Sqworm Sqworm
Steeler Stripper
Sucker
SuperBot
Surfbot Surfbot
Teleport SurveyBot
Szukacz
T0PHackTeam
TeleportPro TeleportPro
Telesphoreo Telesoft
TheNomad TheNomad
Thumbor Thumbor
TightTwatBot Titan
Tracemyfile Turingos
Trendiction
True_Robot
Turnitin Turnitin
TurnitinBot
Twice Twice
VB Project Typhoeus
URLy.Warning
V-BOT
VCI VCI
VeriCiteCrawler Voltron
VidibleScraper
VoidEYE
WBSearchBot WBSearchBot
WEBDAV
WISENutbot
WPScan WPScan
WWW-Collector-E WWW-Mechanize
WWWOFFLE WallpapersHD
Wallpapers
Web Auto Web Auto
Web Pix Web Fuck
Web Sucker
WebAuto WebAuto
WebBandit
WebCollage WebCollage
WebImageCollector WebCopier
WebEnhancer
WebFetch
WebGo IS
WebLeacher
WebPix WebPix
WebReaper WebReaper
WebStripper WebStripper
Webshag WebWhacker
WebsiteExtractor WebsiteQuester
Webster Webster
Whack Whack
Who.is Bot Whatweb
Widow
WinHTTrack WinHTTrack
Woobot Xaldon WebSpider
Wotbox
Xaldon_WebSpider Xaldon_WebSpider
YoudaoBot YoudaoBot
Zade Zade
Zauba Zauba
Zeus Zitebot
ZoomBot ZoomBot
ZoominfoBot ZoominfoBot
arquivo-web-crawler ZyBorg
check1.exe arquivo.pt
coccocbot-web
cognitiveseo cognitiveseo
com.plumanalytics
crawl.sogou.com crawl.sogou.com
dataforseo.com dataforseo.com
demandbase-bot gopher
eCatch
facebookscraper
internetVista monitor internetVista monitor
ips-agent
lwp-trivial
meanpathbot
mediawords
muhstik-scan muhstik-scan
oBot netEstate NE Crawler
pcBrowser pcBrowser
polaris version plumanalytics
ripz
s1z.ru
scalaj-http scalaj-http
scan.lol scan.lol
seocompany.store
serpstatbot
sexsearcher sexsearcher
sitechecker.pro
sogouspider sogouspider
sp_auditbot spyfu
sysscan
tAkeOut
trendiction.com
ubermetrics-technologies.com ubermetrics-technologies.com
voyagerx.com
webgains-bot webgains-bot
webmeup-crawler x22Mozilla
webprosbot xpymep1.exe
x09Mozilla zauba.io
zgrab

318
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
01h4x.com
360Spider 360Spider
80legs 80legs
AIBOT
ALittle Client
ASPSeek ASPSeek
Aboundex AiHitBot
Acunetix
AfD-Verbotsverfahren
Aipbot Aipbot
AllSubmitter
Alligator
AlphaBot AlphaBot
Anarchy Anarchie
Ankit Anthill
Apexoo Apexoo
Asterias AwarioSmartBot
Attach BLEXBot
BDCbot BackDoorBot
BDFetch Bandit
Backlink-Ceck
Badass
Battleztar Bazinga
BetaBot BetaBot
Bitacle Bigfoot
BlackWidow Black Hole
Blackboard
Blow Blow
Bolt Bolt
Buddy Brandprotect
Bullseye BuiltBotTough
BuzzSumo
CATExplorador CATExplorador
CCBot Calculon
CSHttp CazoodleBot
CheTeam Cegbfeieh
CheeseBot CensysInspect
CherryPicker CherryPicker
ChinaClaw ChinaClaw
Cloud mapping Chlooe
Claritybot
Cliqzbot
Cocolyzebot Cocolyzebot
Cosmos Copier
Craftbot CopyRightCheck
Crawling at Home Project
CrunchBot CrunchBot
CyotekWebCopy Custo
DBLBot DBLBot
DataCha0s
DatabaseDriverMysqli DatabaseDriverMysqli
Demon Digincore
Deusu DittoSpyder
Discobot DnBCrawler-Analytics
Dispatch DnyzBot
DomCopBot
DomainAppender DomainAppender
DomainSigmaCrawler
Domains Project Domains Project
Dotbot ECCP/1.0
Download Wonder
EMail Siphon
EMail Wolf EMail Wolf
EasyDL EasyDL
Ebingbong Ebingbong
Ecxi
EirGrabber
EroCrawler EroCrawler
FDM Evil
FHscan ExtractorPro
Extreme Picture Finder
EyeNetIE
Ezooms
FemtosearchBot FemtosearchBot
FlashGet
Flunky
Foobot Foobot
Freeuploader Freeuploader
FrontPage FrontPage
Fyrebot FyberSpider
GalaxyBot G-i-g-a-b-o-t
GetWeb GT::WWW
Go!Zilla GermCrawler
Gotit Gigabot
HEADMasterSEO GoZilla
GrabNet
Grafula
HTMLparser
HTTP::Lite HTTP::Lite
Haansoft HTTrack
HaosouSpider HaosouSpider
Hloader Harvest
HybridBot IDBot
IDBTE4M
Id-search Id-search
Image Fetch IndeedBot
Image Sucker
Indy Library
InfoTekies InfoTekies
InterGET Intelliseek
InternetSeer InternetSeer
IstellaBot Iskanie
JennyBot JamesBOT
JetCar JetCar
JikeSpider Jetty
Joomla Jorgee
JustView
Jyxobot Jyxobot
Kenjin Spider Kenjin Spider
Kozmosbot Kozmosbot
LWP::Simple LeechFTP
Libwhisker LeechGet
LieBaoFast Lftp
Lightspeedsystems Likse
LinkWalker Linkbot
LinkextractorPro
LinkpadBot LinkpadBot
LinksManager
LinqiaMetadataDownloaderBot LinqiaMetadataDownloaderBot
LinqiaRSSBot
Lipperhey
Litemage_walker
MIIxpc
MQQBrowser
MSFrontPage
MSIECrawler
MTRobot MTRobot
Mail.RU_Bot Magnet
Majestic SEO
Majestic12 Majestic12
MarkMonitor Mass Downloader
Masscan
Mata Hari Mata Hari
MauiBot
Mb2345Browser
MeanPath Bot
Mediatoolkitbot Mediatoolkitbot
MegaIndex.ru MegaIndex.ru
Metauri Mojolicious
MicroMessenger Msrabot
Microsoft Data Access Nameprotect
Moblie Safari Navroad
Morfeus Fucking Scanner Needle
NICErsPRO NetSpider
NPbot
Name Intelligence
NearSite
NetLyzer
NetZIP NetZIP
Nettrack NextGenSearchBot
Nibbler Niki-bot
Nimbostratus
Ninja Ninja
Nmap Nmap
Not Not
Nuclei Nutch
Octopus Offline Explorer
Offline Navigator Offline Navigator
OpenVAS OpenLinkProfiler
OrangeBot
OutfoxBot
PHPCrawl
Page Analyzer Page Analyzer
PageGrabber PageAnalyzer
Panscient PageThing.com
Picscout Pandalytics
Piepmatz Papa Foto
Pimonster PeoplePal
Pixray
PleaseCrawl
Pockey Pockey
ProWebWalker
Probethenet Probethenet
Psbot Pu_iN
PxBroker PxBroker
PyCurl
QueryN Metasearch
RSSingBot RSSingBot
RankingBot RankFlex
RankingBot2 Rankivabot
RankurBot
ReGet ReGet
Reaper RebelMouse
RedesScrapy RepoMonkey
Ripper Ripper
SBIder
SEOkicks-Robot SEOkicks-Robot
SEOprofiler
SEOstats SEOstats
SISTRIX
SMTBot
Scanbot Scanbot
Scrapy ScrepyBot
ScreenerBot SeobilityBot
SearchmetricsBot
SemanticJuice
SemrushBot
SeoSiteCheckup
Seomoz Seomoz
Shodan
Siphon Siphon
SiteExplorer
SiteSnagger SiteSnagger
SiteSucker Siteimprove
Snake SmartDownload
Snoopy Snoopy
Sogou web spider
Sosospider Sosospider
Sottopop Spammen
SpaceBison
Spanner
Spinn3r Spinn3r
Steeler Sqlworm
Sucuri Sqworm
SuperHTTP Stripper
Szukacz SurveyBot
T0PHackTeam T0PHackTeam
TeleportPro
Telesphoreo Telesphoreo
The Intraformant Telesphorep
TightTwatBot Thumbor
Titan Titan
Toweyabot
Tracemyfile Tracemyfile
Trendictionbot True_Robot
TwengaBot Turingos
Twice TurnitinBot
Typhoeus Typhoeus
URLy Warning
URLy.Warning
UnisterBot UnisterBot
V-BOT V-BOT
Vacuum VCI
VeriCiteCrawler Vagabondo
VidibleScraper
Virusdie Virusdie
WASALive-Bot Voil
WBSearchBot WEBDAV
WISENutbot WISENutbot
WPScan WPScan
WWW-Mechanize
WWW::Mechanize WWW::Mechanize
WWWOFFLE WWWOFFLE
Wallpapers
Wallpapers/3.0 Wallpapers/3.0
WebAuto WallpapersHD
WebEnhancer Web Auto
Web Fetch
Web Fuck
WebBandit
WebCopier
WebFetch
WebFuck WebFuck
WebSucker WebLeacher
WebSauger
WebWhacker WebWhacker
WebZIP Webalta
WebmasterWorldForumBot
Webshag
Website Quester Website Quester
Whack Webster
Whacker Who.is Bot
WiseGuys Robot WiseGuys Robot
Wonderbot Wprecon
Xenu Xenu
Zauba Zermelo
Zeus Zeus
ZmEu ZoominfoBot
ZoomBot
ZyBorg
adscanner adscanner
archive.org_bot cognitiveseo
arquivo-web-crawler crawler.feedback
arquivo.pt crawler4j
check1.exe
clark-crawler
coccocbot-web
com.plumanalytics
dataforseo.com
demandbase-bot demandbase-bot
domainsproject.org domainsproject.org
eCatch
evc-batch evc-batch
facebookscraper
gopher
instabid instabid
internetVista monitor
ips-agent ips-agent
lwp-request lwp-request
lwp-trivial
magpie-crawler
netEstate NE Crawler netEstate NE Crawler
oBot pcBrowser
probe-image-size satoristudio.net
ripz
scalaj-http
scan.lol scan.lol
sitechecker.pro seoscanners
siteripz sexsearcher
sysscan webgains-bot
voyagerx.com zgrab
webpros.com
webprosbot
zauba.io

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
76brighton.co.uk amazingninja.com
avtochehli.by fandlr.com
coolwallpapers-hd.com forum69.info
gallerily.com nationalbreakdown.com
jacago.com picurams.pw
kandidos.com prchecker.info
microsearch.ru sergiorossistore.online
videonsk.com sex-sex-sex5.com
youbrainboost.asia tomatis.gospartner.com
yunque.pluto.ro wormix-cheats.ru

938
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
00it.com 1-free-share-buttons.com
03p.info 1001desert.com
1-99seo.com 101lesbian.xyz
178evakuator178.ru 12u.info
1flag.co.za 2girls1cup-free.com
256bit.by 3w24.com
2pxg8bcf.top 51.la
3xforum.ro 7zap.com
66cpwgln.space
7a2rnuey1tw9ar.ru
7xc4n.com
888.com 888.com
8lufu.com 8lufu.com
9icmzvn6.website 91abcw.com
991mostfm.co.id
999webdesign.com
aa9bd78f328a6a41279d0fad0a88df1901.com aa9bd78f328a6a41279d0fad0a88df1901.com
abcguru.xyz aarbur.com
adminshop.com absugars.com
adsloads.com acheterviagrafr24.com
adtech.us adelly.bg
adexprts.com
adpremium.org
adultgalls.com adultgalls.com
adultnet.in
adventureparkcostarica.com
advocatemsk.ru
affiliate-fr.com affiliate-fr.com
aibolita.com agroeconom.kz
akvamaster.dp.ua alekseevec.ru
albamargroup.com alf-img.com
allcredits.su allmarketsnewdayli.gdn
allnews.md animal36.com
allnews24.in apelsinnik.website
alltheviews.com apiitsthirteende-a.akamaihd.net
alot.com apilinkswiftco-a.akamaihd.net
amateurmatch.com app5.letmacworkfaster.world
analnoeporno.tv arcteryxstore.online
ananumous.ru arkkivoltti.net
andpolice.com artdestshop.eu
anonymizeme.pro artel116.ru
apple.com-cleaner.systems asiavirtualsolutions.com
appmsr.org asociatia-tipografilor-transilvania.ro
appsaurus.com audiobangout.com
aquarium-pro.ru ausergrubhof.info
arabsexxxtube.com australia-opening-times.com
arate.ru auto-moto-elektronika.cz
arquivo.pt autobrennero.it
aruplighting.com autovideobroadcast.com
asrv-a.akamoihd.net avtointeres.ru
autobudpostach.club avtovolop.ru
autorn.ru ayakino.net
autowebmarket.com.ua azarttoto.com
aviav.ru azbukafree.com
azartmsl.com babespcs.com
azazu.ru baikaleminer.com
azte.ch banan.tv
backiee.com
bagsonsale.online
balans.shahterworld.org
balkanfarma.org
bangla-chat-uk-paralud.ga
bannerpower.com bannerpower.com
barbourjackets.online barbourjackets.online
battle.net batanga.net
bayareaaeroclub.org bcmp.org
belinvestdom.by bear.gotcher.us
best-deals-products.com beclean-nn.ru
bestofpicture.com
bestserials.com bestserials.com
bet365.com bitcoin-ua.top
betteroffers.review bizfly.info
bgviagrachrx.com bjorkbacken.nu
biglistofwebsites.com blogos.kz
bildsuche.ru boazpower.com
blackhatworth.com book-bets.com
blogs.rediff.com bookmark4you.com
boanonihaca.tk brains2.biz
bolegapakistan.com brakehawk.com
bongacams.com brandov.ru
bonzbuddy.com break-the-chains.com
boom-celebs.com
bosefux.esy.es
brainboostingsupplements.org
breget74.ru breget74.ru
brothers-smaller.ru brewdom.ru
browsepulse-a.akamaihd.net brimstonehillfortress.org
brus.city brus-vsem.ru
business-made-fun.com budilneg.xyz
buy-cheap-pills-order-online.com burkesales.com
buypanicdisorderpill.com bus-offer.com
bvlgariwallet.xyz butstrap.space
cam-kontakte.org buynorxx.com
buyscabiescream.com
buzzsumo.com
calstaterealty.us
camdolls.com
camel-beach.com
cand.jp cand.jp
candypeople.se canyougethighofftizanidine.blogspot.com
cartierjusteunclou.xyz carina-sy.de
cartierlove.xyz cartierring.xyz
ccjp.eu celejihad.info
centre-indigo.org.ua centre-indigo.org.ua
chatroulette.video changde.58.com
cheapmoncler.win checkhit.com
cheatcode-lita12.rhcloud.com checktext.org
chinese-amezon.com chlooe.com
chocolateslim-en-france.com cjs.com.ru
chocolateslim-original.com classicakuhni.ru
chuckguilford.com clickzzs.nl
cinemaflix.website clmforexeu.com
cityadspix.com collegerentals.com
cl.s7.exct.net compliance-barak.xyz
claytransformations.info compliance-brian.xyz
cleanallvirus.com compliance-ivan.top
clevernt.com compliance-jessica.top
com-onlinesupport.site converse.ddsoldes.fr
compliance-andrew.top copenergo.ru
compliance-brian.top crystalslot.com
compliance-elena.top customsua.com.ua
compliance-ivan.xyz cyse.tk
compliance-jane.top deluxedumps.com
construmac.com.mx demian.kz
cosmetic.donna7753191.ru dengi-pod-zalog-nedvizhimosti.ru
courtshipgift.com detmebel.su
crirussian.ru dispo.de
customcatchcan.com djekxa.ru
czat.wp.pl dkvorota.ru
d-black.bz docsportal.net
dafatiri.com dolohen.com
damedingel.ya.ru domain-tracker.com
danashop.ru domainroam.win
darkbooks.org dostavka-v-krym.com
decenttools.com dverimegapolis.ru
detective01.ru e-avon.ru
detki-opt.ru eachdayisagift.review
dfiles.me electricwheelchairsarea.com
dignitasdata.se electronicadirect.com
dodlive.mil elektrischezigarettekaufen2.cowblog.fr
dokfilms.net elektronischezigarette2.mex.tl
drunkenstepfather.com englishdictionaryfree.com
drupa.com esopini.com
dscaas.website essaypro.com
dyshagi.ru etm-consult.de
dyt.net etur.ru
e-kwiaciarz.pl evidencecleanergold.com
electro-prom.com excaliburfilms.com
eleimgo.pw excitacion.info
elektrischeziga.livejournal.com eyes-on-you.ga
elidelcream.weebly.com eyessurgery.ru
empathica.com ezigarettekaufen1.hpage.com
eshop4u.jp f0815.de
eupornstar.info fashion-stickers.ru
executehosting.com fast-torrent.ru
expertblog.info fast-wordpress-start.com
extlabs.io fatfasts-4tmz.com
ezaz.info fearcrow.com
ezb.elvenmachine.com filesmonster.porn
ezigarettenkaufen1.deviantart.com filmidivx.com
ezofest.sk foodcrafts.website
familyholiday.ml forex.osobye.ru
farmingworm.com forum.poker4life.ru
favornews.com fotosfotos.eu
ferieboligkbh.dk
fertilitetsradgivningen.se
filesdatabase.net
film-one.ru
filmania-x.ru
filmetricsasia.com
firma-legion.ru
fiuxy.com
floating-share-buttons.com
flooringinstallation-edmonton.com
formulaf1results.blogspot.com
forum-engineering.ru
forum.tvmir.org
forzeronly.com
foto-basa.com
fotoxxxru.com
frbizlist.com
free-deals.faith free-deals.faith
free-share-buttons.blogspot.com free-fb-traffic.com
free411games.com freecamdollars.com
freegamesplay.online freenode.info
freelinkbuilding.website.tk freenom.link
freeseedsonline.com fres-news.com
futbolkisales.ru froggytube.com
gallery.rennlist.com fuckingawesome.com
gallictures.com funnel.co.za
gcup.ru fym.com.ru
ge0ip.org fyxabomiw.ru
getmyads24.com g7m.pl
ghostvisitor.com galeon.com
glicol.kz gallerily.com
glogow.pl gallerylisting.com
gobongo.info gamerscorps.com
goodprotein.ru garciniaxt.us
goodwriterssales.com gardene.ru
googlsucks.com gearcraft.us
gorodservis.ru getprismatic.com
getridofstretchmarks.org
getyourimage.club
gilbertbanda.net
glasof.es
good-mummy.ru
googst2.ru
goosefishpost.bid
gopro-online.info
gourcy.altervista.org
greatdealshop.com greatdealshop.com
guildebzh.info greenzaim.ru
gwhwpxbw.bloger.index.hr growboxbl.ru
h2monline.com gsasearchengineranker.pw
hatdc.org guruofcasino.com
hd720kino.ru habermetre.com
hd-film.pl
hdhc.ru hdhc.ru
healthcarestore.info health-medical-portal.info
helvetia.com.ua heygidday.biz
hermesbelts.xyz hildinghr.se
hetmanship.xyz hitmuzik.ru
hjaoopoa.top hobbyhuren-datenbank.com
hkladys.com homeandhealth.ru
homeart.space homelygarden.com
homedo.fabpage.com hotenergy.ru
honyaku.yahoofs.jp hoverboard360.de
hotloans.ru hoverboard360.se
housekuba.org hptwaakw.blog.fc2.com
howmuchdoestizanidinecost.blogspot.com huimin764128.com
hybrid.ru hunterboots.online
idealtits.net hydropump.su
hyipmanager.in
ideibiznesa2015.ru
ido3.com ido3.com
ifirestarter.ru ilovevitaly.xyz
ilikevitaly.com impisr.ru
img.wallpaperstock.net import-sales.com
indiasourcemart.in
infobabki.ru
inspiring-desperate.tk inspiring-desperate.tk
intellekt21.ru intellego.info
internet-apteka.ru investingclub.ru
internetartfair.com iptool.xyz
invest-pamm.ru iqoption-bin.com
investsuccess.org istizanidineanarcoticdrug.blogspot.com
ip-guide.com istizanidinelikexanax.blogspot.com
itag.pw itronics.ca
itis4you.com itservicesthatworkforyou.com
j-times.ru javidol.site
jabimgo.pw jestr.org
jamiembrown.com jofucipiku.tk
jerseychinabizwholesale.us joyceblog.top
jolic2.com juliadiets.com
kakadu-interior.com.ua jus0wil.pp.ua
karachev-city.ru kazka.ru
karadene.com kerei.ru
kartiniresto.com keywordsuggest.org
kazinogames.lv khadastoafarde.tk
kevblog.top kihi.gdn
kino-rating.ru kinohall.ru
kinoduh.ru krasnodar-avtolombards.ru
knogg.net kw21.org
knowyournextmove.com lacapilla.info
koral.se lalalove.ru
kovesszucs.atw.hu lanadelreyfans.us
krafte.ru lanasshop.ru
kraljeva-sutjeska.com lapolis.it
kriokomora.info lawyersinfo.org
kumuk.info laxdrills.com
kupiproday.com.ua laxob.com
labelwater.se lexiangwan.com
lafriore.ru lifeinsurancekb.com
lampokrat.ws
languagecode.com
laparfumotec.com
laptoper.net
lasvegaslockandsafe.com
law-check-two.xyz
leboard.ru
ledpolice.ru
lflash.ru
lightinghomes.net lightinghomes.net
lignofix.ua linkdebrideur.xyz
likesdesign.com
linerdrilling.com
liquimondo.com
liran-locks.com liran-locks.com
ljusihus.se live-sexchat.ru
long-beach-air-conditioning.com livingcanarias.com
lostfilm-online.ru longlifelomilomi.info
lovasszovetseg.hu louboutinshoes.xyz
lyrster.com mabdoola.blogspot.com
magnetpress.sk macresource.co.uk
managerpak204.weebly.com madot.onlinewebshop.net
maxxtor.eu mafa-free.com
magazintiande.ru
maglid.ru
manve.info
manyresultshub-a.akamaihd.net
marcoislandvacations.net
marmitaco.cat
marmotstore.online
matematikus.info
mb140.ru
medi-fitt.hu medi-fitt.hu
medkritika.ru member-quiz.com
medmajor.ru
megaapteka.ru
memberty.com memberty.com
menetie.ru metabar.ru
message-warning.net metalonly.info
michaelkorsoutletstore.net microsearch.ru
microsoftportal.net middlerush-a.akamaihd.net
midst.eu mobile-appster.ru
mikozstop.com mobilierland.com
mirmedinfo.ru mobstarr.com
misandesign.se modnie-futbolki.net
missis.top monclervests.xyz
mjchamonix.org montazhnic.ru
mobicover.com.ua moonci.ru
modenamebel.ru mp3downloadhq.com
mojpreskumanie.com mp3ringtone.info
monclerboots.xyz musezone.su
moneytop.ru muznachas-service.ru
moomi-daeri.com mybackgroundlandscape.blogspot.com
moscow-region.ru mycouponizemac.com
mountainstream.ms mygameplus.com
moviemail-online.co.uk myhydros.org
myanyone.net nacap.ru
mydirtystuff.com
myonlinepayday.co
nalogovyy-kodeks.ru nalogovyy-kodeks.ru
natali-forex.com nardulan.com
nicefloor.co.uk naturalbreakthroughsresearch.com
naturalpharm.com.ua
naturalshair.site
nerudlogistik.ru
netcheckcdn.xyz
newtechspb.ru
newyorkhotelsmotels.info
next-dentists.tk
nikkiewart.ru
northfacestore.online
noscrapleftbehind.co noscrapleftbehind.co
obiavo.com ok-ua.info
obsessionphrases.com okmedia.sk
oda.as onlainbesplatno.ru
online-sbank.ru online-x.ru
online-templatestore.com onlinebay.ru
online-zaymy.ru
onlinefilmz.net onlinefilmz.net
onlinewritingjobs17.blogspot.ru ooo-gotovie.ru
onload.pw openlibrary.org
opinionreelle.com ops.picscout.com
orion-code-access.net ordernorxx.com
ostrovtaxi.ru orgasmatrix.com
panchro.xyz origin-my.ru
partner-high.men outrageousdeal-a.akamaihd.net
pavlodar.xkaz.org oxford-book.com.ua
pc-services.ru oxotl.com
pc-virus-d0l92j2.pw pacificair.com
pcads.ru paclitor.com
pcboa.se painting-planet.com
pelfind.me panouri-solare-acoperis.com
petsblogroll.com parlament.biz
peugeot-club.org partner-cdn.men
phormchina.com pc4download.co
pic-re.blogspot.com perfectpracticeweb.com
picscout.com pictures-and-images.com
picturesify.com piuminiita.com
piluli.info pixgood.com
pinup-casino1.ru pizdopletka.club
pk-services.ru pkr1hand.com
plastgran.com pl-vouchers.com
porndairy.in pladform.ru
porno-chaman.info plohaya-kreditnaya-istoriya.ru
pornoklad.net pogruztehnik.ru
pornoklad.ru popugaychiki.com
pornonik.com porndl.org
portadd.men powitania.pl
pp-budpostach.com.ua pozvonim.com
printie.com priora-2.com
printingpeach.com
privatefx.all4invest.info
prizesbook.online
prlog.ru
prodess.ru prodess.ru
proftests.net proekt-mos.ru
prostitutki-tyumeni.org professionaldieselcare.com
proxyradar.com progonrumarket.ru
psoriasis-file.trade prokotov.com
psa48.ru
pulse33.ru pulse33.ru
pussysaga.com purplesphere.in
qwertty.net putevka24.ru
ranksonic.com pwwysydh.com
rapidokbrain.com pyramidlitho.webs.com
rasteniya-vs-zombi.ru rainbowice.ru
rating-bestcasino.com randalljhoward.com
razvratnoe.org ranksonic.info
reeyanaturopathy.com razorweb-a.akamaihd.net
relax.ru rcb101.ru
relayblog.com realtytimes.com
remontgruzovik.ru rednise.com
renewablewealth.com rentalcarnavi.info
replica-watch.ru rfd-split.hr
riders.ro rff-cfal.info
ritlweb.com ricorsogiustizia.org
rocis.site rimedia.org
rockingclicks.com robotixix.com
ruclicks.com rockma.se
rusenvironmental.net rollercoin.com
sarafangel.ru roofers.org.uk
rospromtest.ru
royal-investments.net
ruscopybook.com
russian-postindex.ru
rvi.biz
samolet.fr
sandhillsonline.com
saneitconsulting.com
sarahmilne.top sarahmilne.top
sarf3omlat.com saveriopiazza.it
satoristudio.net savingsslider-a.akamaihd.net
sbwealthsolutions.ca scanner-jane.top
scanner-brian.top
scanner-walt.top
schlampen-treffen.com schlampen-treffen.com
scmor.ilxc.cc searchencrypt.com
scopich.com searchtooknow-a.akamaihd.net
screentoolkit.com searchwebknow-a.akamaihd.net
seminarykansas904.ml service.adtech.us
seo-prof1.xyz
seoboxes.com
sevenstars7.com sevenstars7.com
shitting.pro sextracker.com
shoesonlinebuy.cn sextracker.de
shop-electron.ru sherlock.se
shopvilleroyboch.com.ua shtaketniki.kz
shtora66.ru si-unique.com
simpoed.ufop.br sideeffectsoftizanidine.blogspot.com
sindragosa.comxa.com signoredom.com
sinestesia.host.sk silverage.ru
sitopreferito.it sinel.info
snegozaderzhatel.ru skachat-besplatno-obrazcy.ru
social-search.me skylta.com
soda.media slowmacfaster.trade
soheavyblog.com sms2x2.ru
sonata-arctica.wz.cz social-button.xyz
soviet-portal.do.am social-s-ggg.xyz
spabali.org social-s-iii.xyz
spy-sts.com softomix.net
srdrvp.com sortthemesitesby.com
staynplay.net soundfrost.org
steamoff.net spasswelt.xyz
sticken.co speechfoodie.com
stmassage.ru sptslmtrafms.com
strongsignal-a.akamaihd.net spylog.com
sudexpert66.ru sstroy44.ru
suhanpacktech.com standardchartered-forex.com
svnuppsalaorebro.se star61.de
tabletkinaodchudzanie.com.pl stariy-baku.com
taqplayer.info startwp.org
taxi-v-eisk.ru stefanbakosab.se
taximytishi.ru stockspmb.info
telegraf.by streamin.to
terrafootwear.us stroicol.net
testingads.pro studiofmp.com
tfxiq.com studiokamyk.com.pl
thebitcoincode.com superfish.com
thecoral.com.br supervesti.ru
theprofitsmaker.net svolze.com
thewomenlife.com swiped.su
thexart.club tabakur77.com
tizanidineforopiatewithdrawal.blogspot.com takethatad.com
tizanidinepills.blogspot.com tamada69.com
tomatis.gospartner.com taqywu51.soup.io
toolsky.com tattooha.com
tootoo.to tdsing.ru
top-study.work telegramdownload10.com
top10registrycleaners.com telemetryverification.net
topshef.ru thegioixekhach.com
torontoplumbinggroup.com thesmartsearch.net
trafficjunky.com thruport.com
traffpartners.com tiandeural.ru
trumpetedextremes.com ticketsys.inetwd.com
ttsq.fr timer4web.com
tuberkulezanet.ru titan-cloud.life
tuckermktg.com tizanidinehcl4mgtab.blogspot.com
turbabitload.weebly.com tizanidinehydrochloride2mg.blogspot.com
turizm.bz tizanidineinfo.blogspot.com
tvand.ru tizanidinerecreationaluse.blogspot.com
typer.one tizanidinewithdrawal.blogspot.com
uasb.ru tizanidinezanaflex.blogspot.com
ukrup.com tksn.ru
ultimatesetnewfreeallsoftupgradesystems.pw todohr.com
umaseh.com tomck.com
unisexjewelry.org topbestgames.com
unrealcommander.org torrentred.games
us-america.ru torture.ml
utrolive.ru toy-shop.top
vancleefreplica.pw tozup.com
video-production.com tracxn.com
videokrik.net tri-slona.org
vigrx-original.ru tripper.de
vip2ch.com tt-ipd.info
visionwell.com.cn tula.mdverey.ru
vladhistory.com unlimitdocs.net
vostoktrade.info urccvfmc.bloger.index.hr
vse-pesni.com vektorpress.ru
webextract.profound.net venerologiya.com
webmonetizer.net vepad.com
website-speed-checker.site versaut.xxx-cam.webcam
wedding0venues.tk vinsit.ru
weddingdresses.xyz vipms.ru
virus-respirators.com
web-analytics.date
webadvance.club
webmasters.stackexchange.com
webnode.me
website-audit.com.ua
website-speed-up.site
wellcome2slovenia.ru
wemarketing.se
wemedinc.com wemedinc.com
wesharepics.site westum.se
where-toget.com whatistizanidine2mg.blogspot.com
wholesalecheapjerseysfree.com whengirlsgowild.com
wildworld.site whipme.yopoint.in
williamrobsonproperty.com whiteproduct.com
wjgony.com windowssearch-exp.com
wnhjavlhezp.gq witclub.info
womama.ru word-vorlagen.net
wonderfulflowers.biz wowcasinoonline.ooo
wowas31.ucoz.ru xcombear.ru
wstroika.ru xfluro.com
wttavern.com xingzi-vision.com
www.labves.ru xn-----6kcaabbafhu7cskl7akvongwpo7hvjj.xn--p1ai
www.souvenirua.com
x-diesel.com
xaylapdiendanang.com
xblognetwork.com
xboxster.ru
xjrul.com
xn-----6kcaacnblni5c5bicdpcmficy.xn--p1ai
xn-----7kcabaipgeakzcss7bjdqdwpfnhv.xn--p1ai xn-----7kcabaipgeakzcss7bjdqdwpfnhv.xn--p1ai
xn----btbdvdh4aafrfciljm6k.xn--p1ai xn----itbeirbjbi7bc6bh2d.xn--p1ai
xn--80ahdheogk5l.xn--p1ai xn--80aaajbdbddwj2alwjieei2afr3v.xn--p1ai
xn--80ahvj9e.xn--p1ai xn--b1agm2d.net
xn--80aodinpgi.xn--p1ai xolodremont.ru
xtrafficplus.com xxxrus.org
y8games-free.com
yes-com.com
yginekologa.com yginekologa.com
zagadki.in.ua youporn-forum.ga
zazagames.org zaapplesales.blogspot.com
zeroredirect.com zajm-pod-zalog-nedvizhimosti.ru
zoodrawings.com zajm-zalog-krasnodar.ru
zophim.me zigarettenonlinekaufen1.blox.pl
zigarettenonlinekaufen2.bloog.pl
zocaparj.kz
zoogdinsney.com
zootoplist.com
zrizvtrnpale.tk

484
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
01apple.com 0912701309f8ce.com
adktrailmap.com 100searchengines.com
ads.tremorhub.com 1millionusd.xyz
alldownload.pw 23kw.ru
apccargo.com 3-letter-domains.net
apiallgeniusinfo-a.akamaihd.net 5000-cotydzien.com
applyneedy.xyz abcdeg.xyz
atmovs.com absolute-s.ru
auto-zapchasti.org abusora.com
autoloans.com abwa.tk
avon-severozapad.ru accessoires-mode.in
ayakino.net acgs.tk
bagcionderlab.com adclickservice.com
baoxaydung.com.vn adminshop.com
bestofupload.info ads-cool.pro
bezcmexa.ru adsfresh.men
adsloads.com
air-edem.ru
allmarketsnewdayli.gdn
alphaforum.ru
alyeskaresort.com
apelsinnik.website
apple.com-webbrowsing-security.review
aramaicmedia.org
arvut.org
asia-forum.ru
asiengirls.net
asrv-a.akamoihd.net
autoua.top
azartmix.com
bagsonsale.online
bannerads.de
bedandbreakfast.com
beetpics.pw
bidr.trellian.com
bigcities.org
bioca.org bioca.org
bjgugu.net.ua bird1.ru
blog.f00kclan.de bkns.vn
blogporn.in blobar.org
brakehawk.com bonvillan.com
bumble.cheapwebsitehoster.com bouda.kvalitne.cz
buzzsumo.com bradleylive.xyz
calc-for-credit.ru butstrap.space
callstevens.com buyfriend.ru
canoncdriverq3.pen.io bvlgaribracelet.xyz
cartierreplica.xyz capture-room.com
cb.iphantom.com cartierbraceletsreplica.pw
cezartabac.ro cementaresearch.se
cfjump.com check-this-out-now.online
cheapwebsitehoster.com classiquebijoux.ru
chelnytruck.ru clicksor.com
cherubinimobili.it com-supportcenter.website
christianlouboutinshoes.xyz connectionstrenth.com
clickintext.net cosmeticswomens-womensports.rhcloud.com
club-musics.ru cscwtalkto.site
cmd.kz culad.com
com-secure.download cvety24.by
compliance-ivan.xyz dafatiri.com
copblock.org danceuniverse.ru
custom-product-labels.com data.vtc.pw
customcollegeessays.net distver.ru
detsky-nabytek.info domaincheck.io
dichvuvesinhhanoi.com download-walpaperhd.blogspot.com
digest-project.ru dprtb.com
dktr.ru drhomes.biz
drunkenstepfather.com elektir.ru
elektronischezigarettekaufen1.beeplog.com emerson-rus.ru
elektronischezigarettekaufen1.myblog.de energy-ua.com
eropornosex.ru ezigarettekaufen2.blox.pl
erot.co favoritemoney.ru
erotikchat-24.com femmesdenudees.com
essay-edu.biz fetishinside.com
este-line.com.ua filesvine.com
executehosting.com
extremal-blog.com
ezaz.info
ezigarettenshop1.yolasite.com
family1st.ca
fandlr.com
fashion-mk.net
fdzone.org
filmbokep69.com filmbokep69.com
flowersbazar.com filmi-onlain.info
free-floating-buttons.com fitnesspiks.com
free411games.com fiverr.com
freegamesplay.online fortwosmartcar.pw
frustrated-favorable.gq foxjuegos.com
fuck-paid-share-buttons.xyz franecki.net
fym.com.ru frequiry.com
g33.org gambarkatabaru.com
gabeshop.ru
gameonasia.com
gardene.ru
genericviagrasildenafiled.net
getdot.ru
glicol.kz
global-ics.co.za
glogow.pl glogow.pl
go2jump.org goodwinmetals.co
goldenggames.com gosarhivrt.ru
gombita.info greenzaim.ru
goodwriterssales.com guiadeserraazul.com
googlemare.com hackers-crackers.tk
googlepositions.com hdxnxxtube.mobi
gratuitbaise.com herehloadibs.cf
guildebzh.info heygidday.biz
heliko.no high-speed1.net
hidefiles.org himazin.info
hkladys.com hit-kino.ru
houston-vikings.com hoste.octopis.com
hvd-store.com housediz.com
ifirestarter.ru houseofrose.com
inboundlinks.win humbmosquina.tk
int.search.tb.ask.com iqupdatetmz.win
j-times.ru islamtoday.co.za
janettabridal.com islandminingsupply.wordpress.com
javatex.co.id itag.pw
joy-penguin.com itrevolution.cf
jrcigars.com jabimgo.pw
katadhin.co jolic2.com
kazan.xrus.org journalhome.com
kino2018.club justkillingti.me
kinopolet.net kazrent.com
kiprinform.com keki.info
kit-opt.ru keywordbasket.com
knogg.net khafre.us
konkursov.net kicknights.gq
kovesszucs.atw.hu kino-ecran.ru
kreativperlen.ch kinozapas.com
kuzinsp.ru kozhniebolezni.com
kvartira-sutochno.com kung-fu-ru.com
lancheck.net lacloop.info
landmania.ru lanasshop.ru
laparfumotec.com larger.io
lapitec.eu letsrepair.in
law-check-two.xyz localmatchbook.com
laxob.com lovelycraftyhome.com
lider-zhaluzi.kiev.ua med-zdorovie.com.ua
lostfilm-online.ru mediafresh.online
lyrster.com microstatic.pl
madot.onlinewebshop.net mir-business-24.ru
mantramusic.ru mixx.com
master-muznachas.ru moesen-ficken.com
matrixalchemy.com moivestiy.biz
metalonly.info mosdverka.ru
metascephe.com mrlmedia.net
meteostate.com mttwtrack.com
missclub.info muizre.ru
mobot.site music7s.me
moetomnenie.com mybackgroundlandscape.blogspot.com
mojpreskumanie.com myblogregistercm.tk
mrsdalloways.com myphotopipe.com
multgo.ru national-today-winning-winner.club
mxgetcode.com needtosellmyhousefast.com
mydearest.co newstraveller.ru
mydownloadengine.com newstudio.tv
narkologiya-penza.ru nikitsyringedrivelg.pen.io
noscrapleftbehind.co notfastfood.ru
november-lax.com november-lax.com
nrv.co.za novosti-hi-tech.ru
oksrv.com onblastblog.online
online-zaymy.ru ooomeru.ru
onlinemegax.com panamaforbeginners.com
onlineserialy.ru paradontozanet.ru
ororodnik.goodbb.ru percin.biz.ly
pammik.ru pizda.lol
pensplan.com playtap.us
perm.xrus.org polytopesexempt.com
piuminiita.com popmarker.com
pizdopletka.club popup-jdh.xyz
playboyfiles.xblog.in porno-dojki.net
playlott.com pornobrazzers.biz
pod-muzyku.club pornodojd.ru
pornohd1080.online privatefx.all4invest.info
pornonik.com
pornophoto.xyz
pornotubs.com
prefersurvey.net
pretty-mart.com
printie.com
profitfx.online profitfx.online
promalp-universal.ru qualitymarketzone.com
promover.org quick-seeker.com
propranolol40mg.blogspot.com qwesa.ru
prostitutki-odessa.org recinziireale.com
pssucai.info rent2spb.ru
quickcashlimited.com ringtonepartner.com
rank-checker.online rvi.biz
rapidsites.pro saneitconsulting.com
redhotfreebies.co.uk sbwealthsolutions.ca
reelheroes.net scanner-andrew.top
reklama-i-rabota.ru scansafe.net
remontvsamare.su search.1and1.com
retailwith.com secret.xn--oogle-wmc.com
reward-survey.net seminarykansas904.ml
rewardpoll.com seokicks.de
ringporno.com seryeznie-znakomstva.ru
rootandroid.org sexfreepornoxxx.com
rvtv.ru sexy-screen-savers.com
saecsa.co shisha-swag.de
santechnik.jimdo.com skachat-besplatno-obrazcy.ru
sarafangel.ru sobecjvuwa.com.ru
scanner-nelson.top socas.pluto.ro
scat.porn social-fun.ru
schalke04fc.info social-s-iii.xyz
seasonvar.ru stickers-market.ru
seemoreresultshu-a.akamaihd.net sugvant.ru
segol.tv supermesta.ru
seo-platform.com
seo18.su
sherlock.se
shitmovs.com
shoppingmiracles.co.uk
siha.de
sims-sims.ru
simul.co
sledstvie-veli.net
snjack.info
social-buttons.xyz
softlinesolutions.me
spabali.org
space4update.pw
spywarebegone.com
spywareit.com
srecorder.com
students-cheapskate.ml
superoboi.com.ua
surfbuyermac.com surfbuyermac.com
thetattoohut.com surintech.ac.th
tizanidinehydrochloride2mg.blogspot.com taaaak.com
tizanidineingredients.blogspot.com timhost.ru
tmm-kurs.ru tizanidineandcipro.blogspot.com
tomck.com tizanidinehclsideeffects.blogspot.com
tizanidinewithdrawal.blogspot.com
tjkckpytpnje.com
tnctrx.com
tonerbox.kz
toolsky.com toolsky.com
topsy.com top1-seo-service.com
torrentred.games topanasex.com
traffmonster.info topclickguru.com
tri-slona.org torrents.life
tripper.de traderzplanet.in
try-rx.com turbo-suslik.org
tuckpointingmasonrysystems.com tvorozhnaja-zapekanka-recept.ru
twojebook.pl
twu.com.ua
umnovocaminho.com umnovocaminho.com
universals.com.ua upproar.com
vigrx-original.ru uytmaster.ru
visionwell.com.cn vbikse.com
voloo.ru viddyoze.com
wahicbefa31.soup.io videooko.weebly.com
webalan.ru vipromoffers.com
weightatraining.com vizitki.net
whatzmyip.net vkak.ru
wholesalejerseyscheapjerseys.us.com vladimir.zrus.org
whos.amung.us voloslove.ru
xbaboon.com voluumtracker1.com
xchat26.myfreecams.com vvpg.ru
xn--80aaafbn2bc2ahdfrfkln6l.xn--p1ai waterefficiency.co
xn--e1aggki3c.xn--80adxhks weblo.com
xtubeporno.net webmasterhome.cn
xzlive.com website-analyzer.info
yes-com.com wfb.hatedriveapart.com
yoopsie.com wnhjavlhezp.gq
yourserverisdown.com wrz0iuebwhp5fg.freeddns.com
yousense.info wsgames.ru
yugk.net wtsindia.in
yugo-star.ru wufak.com
yunque.pluto.ro xclicks.net
zarabotat-na-sajte.ru xn-----6kcaacnblni5c5bicdpcmficy.xn--p1ai
zocaparj.kz xn--h1aakne2ba.xn--p1ai
xrus.org
xxxguitars.com
yaaknaa.info
yellowads.men
ynymnwbm.bloger.index.hr
yougame.biz
zacreditom.ru
zahvat.ru
zakon-ob-obrazovanii.ru
zarajbuilders.com
zastroyka.org
zeroredirect5.com
zigarettenonlinekaufen.tumblr.com
zigarettenonlinekaufen1.bloog.pl
zoogdinsney.com
zootoplist.com
zrelaya.pw
zynax.ua

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.144 0; 10.1.0.50 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2021.11.2745 ### Version: V4.2021.11.2746
### Updated: Mon Nov 29 10:03:24 UTC 2021 ### Updated: Mon Nov 29 22:01:30 UTC 2021
### Bad Bot Count: 630 ### Bad Bot Count: 630
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2021.11.2745 ### Version: V4.2021.11.2746
### Updated: Mon Nov 29 10:03:24 UTC 2021 ### Updated: Mon Nov 29 22:01:30 UTC 2021
### Bad Bot Count: 630 ### Bad Bot Count: 630
################################################### ###################################################
### Version Information ## ### Version Information ##