vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-06 04:30:21 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2022.03.2963 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2022-03-06 22:07:11 +00:00
parent 97db5737a5
commit 48e87dc73e
46 changed files with 87027 additions and 87027 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.03.2962 #### Version: V4.2022.03.2963
#### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.03.2962 #### Version: V4.2022.03.2963
#### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -14,7 +14,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2022.03.2962 #### Version: V4.2022.03.2963
#### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

10744
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2022.03.2962 #### Version: V4.2022.03.2963
#### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

10748
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

10748
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

10748
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

10748
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.15 1; 10.1.0.20 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.15 0; 10.1.0.20 0;
127.0.0.1 0; 127.0.0.1 0;

10748
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.15 1; 10.1.0.20 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.15 0; 10.1.0.20 0;
127.0.0.1 0; 127.0.0.1 0;

10748
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.15 1; 10.1.0.20 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.15 0; 10.1.0.20 0;
127.0.0.1 0; 127.0.0.1 0;

10748
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
2962 2963

10748
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

10748
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
13.87.203.127 0; 104.42.51.129 0;

10748
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.15 1; 10.1.0.20 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.15 0; 10.1.0.20 0;
127.0.0.1 0; 127.0.0.1 0;

10748
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.15 1; 10.1.0.20 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.15 0; 10.1.0.20 0;
127.0.0.1 0; 127.0.0.1 0;

10748
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.15 1; 10.1.0.20 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.15 0; 10.1.0.20 0;
127.0.0.1 0; 127.0.0.1 0;

10748
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
13.87.203.127 0; 104.42.51.129 0;

10748
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
13.87.203.127 0; 104.42.51.129 0;

10748
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.15 1; 10.1.0.20 1;
127.0.0.1 1; 127.0.0.1 1;

16
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
ASPSeek
Anarchy99 Anarchy99
Chlooe Crawling at Home Project
Digincore Discobot
GoZilla Fyrebot
GrapeFX
HTMLparser HTMLparser
Ripper InfoNaviRobot
Toweyabot Keyword Density
TurnitinBot Not
Web Enhancer tAkeOut

318
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
01h4x.com
360Spider 360Spider
ADmantX 404checker
Aboundex AIBOT
Aboundexbot Aboundexbot
Acunetix AfD-Verbotsverfahren
AhrefsBot
AiHitBot
AllSubmitter
Alligator Alligator
AlphaBot
Anarchie
Anarchy
Apexoo Apexoo
Aspiegel
Asterias Asterias
Atomseobot BDCbot
AwarioSmartBot
BDFetch
BLEXBot
BackDoorBot
BackWeb BackWeb
Bitacle Backlink-Ceck
Black Hole Badass
BlowFish Bandit
Bolt Barkrowler
BotALot BatchFTP
CSHttp Blackboard
CazoodleBot Brandwatch
CheeseBot BuiltWith
CherryPicker CATExplorador
CCBot
CODE87
Cegbfeieh
Chlooe Chlooe
Claritybot
Cocolyzebot Cocolyzebot
Cogentbot Collector
CopyRightCheck Copier
Cosmos Copyscape
Curious Craftbot
CyotekWebCopy Crawling at Home Project
DBLBot Crescent
CrunchBot
DIIbot DIIbot
DataCha0s Deusu
Demon Dirbuster
Digincore Discobot
DigitalPebble
Disco
Discoverybot Discoverybot
Dispatch Dispatch
DnyzBot DittoSpyder
DomainCrawler DnBCrawler-Analytics
DomainAppender
DomainStatsBot DomainStatsBot
Domains Project Dotbot
Dragonfly Download Wonder
Drip
EMail Siphon EMail Siphon
EasyDL EirGrabber
EroCrawler
Evil
Exabot Exabot
Express WebPictures
Extractor Extractor
Ezooms FHscan
FemtosearchBot Flunky
FlashGet
Freeuploader Freeuploader
FyberSpider
Fyrebot Fyrebot
GT::WWW G-i-g-a-b-o-t
GalaxyBot GalaxyBot
GetRight GermCrawler
GetWeb
Getintent Getintent
Go!Zilla Go!Zilla
Gotit Go-Ahead-Got-It
Grafula Grabber
GrapeFX GrapeFX
GrapeshotCrawler HaosouSpider
Harvest
Havij Havij
Heritrix
Humanlinks
IDBot IDBot
IlseBot
Image Fetch Image Fetch
IndeedBot Image Sucker
Indy Library
InfoNaviRobot InfoNaviRobot
JOC Web Spider InfoTekies
JennyBot InterGET
Internet Ninja
InternetSeer
Iria
IstellaBot
Jetty
JikeSpider
Joomla Joomla
Jorgee Kenjin Spider
JustView Keybot Translation-Search-Machine
Keyword Density
Kinza Kinza
Kozmosbot Kozmosbot
Lanshanbot Leap
LeechGet
LexiBot LexiBot
LibWeb LibWeb
LieBaoFast Likse
Lightspeedsystems
Linkbot Linkbot
Linkdexbot LinkextractorPro
LinkpadBot LinkpadBot
LinqiaMetadataDownloaderBot LinksManager
MFC_Tear_Sample Lmspider
MIDown tool
MIIxpc MIIxpc
MQQBrowser MQQBrowser
MTRobot MSIECrawler
Majestic SEO Mail.RU_Bot
Majestic-SEO
Majestic12 Majestic12
Masscan MarkMonitor
MarkWatch
MauiBot
Mb2345Browser
MeanPath Bot MeanPath Bot
Meanpathbot Meanpathbot
Mediatoolkitbot
Metauri Metauri
Microsoft Data Access
Microsoft URL Control
Minefield Minefield
Mojeek
Mojolicious
MolokaiBot MolokaiBot
Mozlila Morfeus Fucking Scanner
Msrabot Msrabot
NPbot NPbot
Nameprotect Name Intelligence
NearSite Needle
Net Vampire Nessus
NetAnts NetAnts
NetLyzer NetMechanic
Netvibes NetZIP
Netcraft
Nibbler Nibbler
Octopus Nikto
NimbleCrawler
Not
Offline Explorer
Offline Navigator
OnCrawl
OpenVAS
Openfind
OutfoxBot
PECL::HTTP PECL::HTTP
PageThing.com PHPCrawl
Page Analyzer
PageScorer
Pandalytics Pandalytics
Pavuk Pavuk
Petalbot PeoplePal
Pi-Monster Picscout
Piepmatz PleaseCrawl
Pockey Pockey
ProPowerBot ProPowerBot
ProWebWalker Psbot
PxBroker Pu_iN
RankActive Pump
PyCurl
RankActiveLinkBot
RankingBot2
Rankivabot Rankivabot
RankurBot RankurBot
Re-re Re-re
RealDownload
RebelMouse
Recorder Recorder
RocketCrawler Ripper
Rogerbot SEOlyticsCrawler
SEOkicks SalesIntelligent
SEOkicks-Robot ScanAlert
SEOstats ScoutJet
SMTBot Scrapy
Scanbot
ScreenerBot ScreenerBot
SemanticJuice ScrepyBot
Searchestate
SearchmetricsBot
Seekport
Semrush Semrush
SemrushBot SeoSiteCheckup
Seomoz Seomoz
Shodan
Siphon
Site Sucker
SiteCheckerBotCrawler
SiteExplorer SiteExplorer
SiteSnagger SiteSnagger
SiteSucker
Sitevigil
SlySearch
Snapbot Snapbot
SocialRankIOBot Sociscraper
Sogou web spider
Sosospider Sosospider
SpankBot SpaceBison
Spbot
Spinn3r
SputnikBot SputnikBot
Sqworm Sqlworm
Steeler
Stripper Stripper
Sucuri
SuperHTTP
Surfbot
SurveyBot SurveyBot
Suzuran Suzuran
T8Abot
Teleport
TeleportPro TeleportPro
Telesoft
Telesphoreo
Toata Toata
Toweyabot Tracemyfile
Trendiction
Trendictionbot
True_Robot True_Robot
Turingos Turingos
TurnitinBot TwengaBot
Typhoeus
URLy Warning URLy Warning
V-BOT URLy.Warning
VeriCiteCrawler UnisterBot
Voil VCI
Voltron Vagabondo
WBSearchBot VelenPublicWebCrawler
WEBDAV Virusdie
WISENutbot WISENutbot
WWW-Mechanize WWW-Mechanize
WWWOFFLE
Wallpapers Wallpapers
Wallpapers/3.0
WeSEE WeSEE
Web Collage Web Collage
Web Enhancer
Web Fuck
Web Pix Web Pix
Web Sauger
Web Sucker
WebAuto
WebBandit WebBandit
WebCollage WebCopier
WebEnhancer WebFetch
WebFuck WebmasterWorldForumBot
WebGo IS
WebImageCollector
WebLeacher
WebPix
WebStripper
WebSucker
WebZIP
Webshag
Website Quester Website Quester
Whacker Whatweb
Who.is Bot Who.is Bot
WiseGuys Robot Widow
Wprecon WinHTTrack
Xenu Xaldon WebSpider
YoudaoBot
Zeus
ZmEu
ZoomBot ZoomBot
ZoominfoBot ZoominfoBot
ZumBot ZumBot
archive.org_bot ZyBorg
check1.exe arquivo-web-crawler
coccocbot arquivo.pt
com.plumanalytics
crawler.feedback crawler.feedback
crawler4j
demandbase-bot
domainsproject.org
evc-batch evc-batch
facebookscraper instabid
heritrix
ips-agent ips-agent
magpie-crawler isitwp.com
meanpathbot meanpathbot
muhstik-scan probe-image-size
netEstate NE Crawler
pcBrowser
plumanalytics
ripz
s1z.ru s1z.ru
satoristudio.net satoristudio.net
scalaj-http
scan.lol
seobility seobility
serpstatbot seostar
sexsearcher
siteripz siteripz
trendiction.com sp_auditbot
spyfu
sysscan
trendiction.de trendiction.de
ubermetrics-technologies.com
voyagerx.com voyagerx.com
webgains-bot
xpymep1.exe
zgrab

274
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,92 +1,99 @@
01h4x.com 01h4x.com
404checker 404enemy
80legs ASPSeek
ALittle Client
Aboundex Aboundex
AfD-Verbotsverfahren
AiHitBot AiHitBot
Alexibot Aipbot
AllSubmitter
Alligator Alligator
AlphaBot AlphaBot
Ankit
Apexoo
Aspiegel Aspiegel
Asterias BDCbot
Atomseobot
BBBike
BDFetch BDFetch
BackDoorBot
BackStreet BackStreet
BackWeb BackWeb
Backlink-Ceck
Badass
Barkrowler Barkrowler
BatchFTP
BetaBot BetaBot
Bigfoot Bitacle
Black Hole Black Hole
Boardreader
Bolt Bolt
Brandwatch Brandprotect
Buck Buck
BuiltBotTough
Bullseye
BunnySlippers
BuzzSumo
CATExplorador
CODE87 CODE87
CSHttp CSHttp
Calculon Calculon
CazoodleBot
CensysInspect CensysInspect
CheTeam CheeseBot
Chlooe Chlooe
Citoid Citoid
Claritybot
Cliqzbot Cliqzbot
Cocolyzebot Cocolyzebot
Copier Copier
CopyRightCheck
Craftbot
CrazyWebCrawler CrazyWebCrawler
DSearch Crescent
Custo
CyotekWebCopy
DBLBot
DIIbot
DTS Agent
DataCha0s
DatabaseDriverMysqli DatabaseDriverMysqli
Devil
Digincore Digincore
DigitalPebble DigitalPebble
Dirbuster Dirbuster
Disco Dispatch
Discobot
DnBCrawler-Analytics
DnyzBot
DomCopBot DomCopBot
DomainAppender DomainAppender
DomainSigmaCrawler
DomainStatsBot
Download Wonder Download Wonder
Drip Drip
ECCP/1.0
EasyDL EasyDL
EirGrabber EroCrawler
Evil
Exabot Exabot
Express WebPictures
ExtLinksBot
ExtractorPro ExtractorPro
Extreme Picture Finder
EyeNetIE
Ezooms Ezooms
FDM FHscan
FlashGet Foobot
Flunky FyberSpider
Genieo GalaxyBot
GermCrawler GetRight
GetWeb GetWeb
Getintent
Gotit
Grafula
GrapeFX GrapeFX
GrapeshotCrawler GrapeshotCrawler
HTMLparser GridBot
HTTP::Lite HMView
HaosouSpider
Harvest Harvest
HonoluluBot HybridBot
Humanlinks
IDBTE4M
IDBot
Iblog Iblog
Id-search
Image Fetch
Image Sucker Image Sucker
Indy Library Indy Library
InfoNaviRobot InfoNaviRobot
Internet Ninja InfoTekies
Intelliseek
Iria Iria
Iskanie IstellaBot
JamesBOT
Jbrofuzz Jbrofuzz
JetCar JennyBot
Jetty
JikeSpider JikeSpider
Joomla Joomla
Jorgee Jorgee
@ -95,156 +102,149 @@ Kinza
LNSpiderguy LNSpiderguy
LWP::Simple LWP::Simple
Larbin Larbin
LeechFTP
LeechGet
LexiBot LexiBot
Lftp Lftp
Likse LibWeb
LinkpadBot Libwhisker
LinksManager LieBaoFast
LinqiaRSSBot LinkScan
Linkbot
LinkextractorPro
Lmspider Lmspider
MFC_Tear_Sample
MIDown tool
MIIxpc MIIxpc
MQQBrowser
Mag-Net Mag-Net
Magnet
Mail.RU_Bot Mail.RU_Bot
Majestic-SEO MarkMonitor
MarkWatch
Mass Downloader
Mata Hari Mata Hari
MauiBot MauiBot
Mb2345Browser Mb2345Browser
Meanpathbot Meanpathbot
MegaIndex.ru Metauri
MicroMessenger
Microsoft URL Control Microsoft URL Control
Minefield Minefield
Mister PiX
Moblie Safari Moblie Safari
Mozlila Mojolicious
Morfeus Fucking Scanner
Mr.4x3
Msrabot Msrabot
Musobot Musobot
NPbot Name Intelligence
Net Vampire Nameprotect
Navroad
NetAnts
NetLyzer
NetMechanic NetMechanic
NetSpider Niki-bot
NetZIP
Netcraft
Nikto
NimbleCrawler
Ninja
Nmap Nmap
Nuclei Not
Offline Explorer Nutch
OnCrawl
OpenVAS OpenVAS
Openfind OrangeBot
OrangeSpider
OutclicksBot
PECL::HTTP PECL::HTTP
Page Analyzer PHPCrawl
PageAnalyzer POE-Component-Client-HTTP
PageThing.com Pandalytics
Papa Foto
Pavuk Pavuk
PeoplePal Picscout
Petalbot
Picsearch Picsearch
Piepmatz
Pixray Pixray
PleaseCrawl
Pockey Pockey
ProPowerBot Probethenet
Pu_iN Pu_iN
QueryN Metasearch PxBroker
Quick-Crawler PyCurl
RSSingBot
RankActive
RankActiveLinkBot RankActiveLinkBot
RankingBot
RankingBot2 RankingBot2
RankurBot
Re-re Re-re
ReGet RealDownload
Reaper
RebelMouse
RedesScrapy RedesScrapy
RepoMonkey RepoMonkey
Ripper Ripper
RocketCrawler
Rogerbot Rogerbot
SEOkicks SEOlyticsCrawler
SEOprofiler SMTBot
SISTRIX
ScanAlert
Scanbot Scanbot
Scrapy ScoutJet
SentiBot ScreenerBot
SeobilityBot SearchmetricsBot
Seomoz Semrush
SiteSnagger
Siteimprove Siteimprove
Sitevigil Sitevigil
Sogou web spider SlySearch
Sociscraper
Spammen
SpankBot SpankBot
Spbot Spanner
Spinn3r SputnikBot
Sqlmap Sqlmap
Sqworm
Stripper Stripper
Sucker
Sucuri Sucuri
SuperBot Swiftbot
Szukacz Szukacz
Teleport TeleportPro
Telesoft
Telesphoreo Telesphoreo
Toata TightTwatBot
Turingos Tracemyfile
Turnitin Trendictionbot
Twice Typhoeus
URLy Warning URLy Warning
Vacuum V-BOT
Vagabondo Vagabondo
VelenPublicWebCrawler Virusdie
Voltron Voil
WWW::Mechanize WEBDAV
WWWOFFLE WWW-Mechanize
Wallpapers
WeSEE WeSEE
Web Fetch
Web Pix Web Pix
Web Sucker Web Sucker
WebBandit WebAuto
WebFuck WebCopier
WebPix WebEnhancer
WebReaper WebImageCollector
WebSauger WebSucker
Webalta WebZIP
Whack Website Quester
Whatweb
Widow Widow
Wonderbot Wonderbot
Wotbox Woobot
Xaldon WebSpider
Xaldon_WebSpider
Xenu
YoudaoBot
Zade Zade
ZoomBot Zeus
ZumBot ZyBorg
adscanner autoemailspider
archive.org_bot
cah.io.community cah.io.community
check1.exe
coccocbot coccocbot
crawl.sogou.com cognitiveseo
eCatch crawler.feedback
evc-batch crawler4j
facebookscraper facebookscraper
heritrix lwp-request
isitwp.com meanpathbot
netEstate NE Crawler
oBot
pcBrowser pcBrowser
polaris version polaris version
ripz
s1z.ru s1z.ru
seostar seobility
seoscanners
serpstatbot serpstatbot
sitechecker.pro
spyfu spyfu
trendiction.com trendiction.com
trendiction.de trendiction.de
ubermetrics-technologies.com webgains-bot
webmeup-crawler
webpros.com
webprosbot webprosbot
xpymep1.exe zgrab
zauba.io

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
capsderfudd.tk avtovolop.ru
compliance-elena.xyz cayado.snn.gr
coolbar.pro dcj-nn.ru
coslab.club domznaniy.ru
documentsite.net estelight.ru
macdamaged.tech extractorandburner.com
romhacking.ru greatgrace.ru
seksotur.ru nfljerseysforsalewholesaler.com
skincrate.net ros-ctm.ru
tech4master.com school-diplomat.ru

940
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
1000n1.ru 00go.com
101flag.ru 00it.com
123any.com 1001desert.com
14b.info 100dollars-seo.com
1hwy.com
1stat.ru 1stat.ru
4istoshop.com 2000k.ru
4senses.co 24x7-server-support.site
57883.net 2daytrendingnews.com
5kstore.com 2nt.ru
777-club.ru 3w24.com
7search.com 40cg.com
a.frcls.fr 4webmasters.com
a.pr-cy.ru 883zy.com
aa8b68101d388c446389283820863176e7.com 8xv8.com
aaa38852e886ac4af1a3cff9b47cab6272.com a1security.com.ua
aac500b7a15b2646968f6bd8c6305869d7.com abcdeg.xyz
abbanreddy.com abctoppictures.net
abcdefh.xyz absugars.com
abwa.tk adnotbad.com
actices.com adzerg.com
admatic.com.tr airmaxshoes-2016.com
adrenalin-stk.ru alevinefesleri.com
ads.gold algarveglobal.com
adtech.de alibestsale.com
adultfullhd.com allkrim.com
advocatemsk.ru alloysteel.ru
akuhni.by amazingpic.net
akvamaster.dp.ua animali.deagostinipassion.it
albuteroli.com anticrawler.org
all-streaming-media.com aosheng-tech.com
allforminecraft.ru api.stathat.com
allwidewallpapers.com apiadanaknet-a.akamaihd.net
amt-k.ru apilinkswiftco-a.akamaihd.net
ananumous.ru arkkivoltti.net
anapa-inns.ru arquivo.pt
anniemation.com articlesdirectoryme.info
apiluckyleapnet-a.akamaihd.net asrvrep-a.akamaihd.net
arate.ru asscenihotosidea.blogspot.co.za
arewater.com autogrep.ru
artparquet.ru autorn.ru
asrv-a.akamaihd.net
atlasvkusov.ru
autolombard-krasnodar.ru
autonew.biz
autotop.com.ua
aviav.org aviav.org
avto-oligarh.ru avon-severozapad.ru
babespcs.com ayakino.net
babyguns.ru azazaporn.com
balois.worldbreak.com babs.com.ua
banki76.ru baditri.com
batanga.net bagcionderlab.com
beauty-b0x.pl bala.getenjoyment.net
bedandbreakfast.com balkanfarma.org
belinka.com.ua bannertesting.com
belstaffstore.online bard-real.com.ua
bestkfiledxd.cf bbsoldes.fr
bestwaystogetpaid.us bestsexyblog.com
betterhdporn.com bget.ru
beztuberkuleza.ru bigpictures.club
binomo.kz biketank.ga
bio-market.kz blockety.co
bitporno.sx bluejays-jerseys.us
blackbabesporn.com bobinoz.com
blogs.rediff.com bonzbuddy.com
bolitgorlo.net bonzibuddi.com
brandbucket.com bookmaker-bet.com
bracketsmackdown.com
brakehawk.com
brandedleadgeneration.com
brandov.ru
brateg.xyz brateg.xyz
brendbutik.ru brothers-smaller.ru
brianhenry.co browserprotecter.com
bristolhotel.com bscodecs.com
bristolhotel.com.ua buchananshardware.com
btnativenav.com buketeg.xyz
bumascloset.com businesxxl.com
buntube.net
buqyxa.rincian.info
business-suggested.tk
buydissertation.net buydissertation.net
buyessayonline19.blogspot.ru buzzonclick.com
buyhoverboard.com buzzzg.men
buyviagraa.blogspot.com bzero1jewelry.net
bycontext.com c1.onedmp.com
cartierring.xyz callstevens.com
carsplate.com
cartierlovebraceletreplica.xyz
cartierlovestore.com
cashkitten-a.akamaihd.net
cayado.snn.gr
cbozhe.com
cdn.walkme.com
celejihad.info celejihad.info
cfjump.com cheapestjerseys-wholesale.com
chatroulette.video cheapjerseysbizwholesale.us
cheap-trusted-backlinks.com cheapsergiorossi.online
cheapjerseysap.com chelyabinsk.xrus.org
check-this-out-now.online chiptuninger.com
checktext.org
chocolateslim-en-france.com chocolateslim-en-france.com
cialisovercounteratwalmartusa.com cialis-samples.com
cineacademy.ru cinemaflix.website
cjmc.info citetick.com
clickso.com clickhype.com
clips.ua.ac.be clickprotects.com
cocolyze.com clicksotrk.com
companies-catalog.com clubfashionista.com
compliance-alexa.top coinsspb.com
compliance-don.top com-onlinesupport.host
compliance-jack.top community.allhiphop.com
compliance-john.top compliance-don.xyz
compliance-nelson.top compliance-ivan.top
computernetworksonline.com compliance-ivan.xyz
concealthyself.com compliance-walter.top
contentlook.co comsysnet.com
cookingmeat.ru conciergegroup.org
cool-wedding.net converse.ddsoldes.fr
coolingoods.com cookie-law-enforcement-aa.xyz
country-chic.ru cosmetic.donna7753191.ru
crackzplanet.com cougfan.info
cs-passion.pl creativehutindia.com
cscwtalkto.site creatives.adbetclickin.pink
culmimg.pw cryptoswap.biz
customcatchcan.com dame-ns.kz
date-withme.com danceuniverse.ru
datract.com data-mining.tk
dawlenie.com davebestdeals.com
ddospanel.com de.zapmeta.com
dealitright.click delfin-aqua.com.ua
decenttools.com dgfitness.co
dev.citetick.com djihispano.com
diamond-necklace.info djstools.com
dipstar.org dnepropetrovsk.mistr-x.org
disruptingdinnerparties.com domainsphoto.com
dojki365.online dominateforex.ml
domaincdn.xyz domznaniy.ru
dstroy.su dotnetdotcom.org
dvd-famille.com e-avon.ru
dynainbox.com earl-brown.info
e-collantes.com easyukraine.com
eager-nash.188-93-233-196.plesk.page ekaterinburg.xrus.org
editmedios.com election.interferencer.ru
edwinkonijn.com.au elektrischezigarette1.blog.pl
ege-essay.ru elektronischezigarette2.mex.tl
elektir.ru eloxal.ru
elektrischezigaretten1.blogse.nl empathica.com
elektrozigarette2.webs.com erot.co
elidelcream.weebly.com ertelecom.ru
eloconcream.blogspot.com extremepornos.net
eluxer.net eywords-monitoring-your-success.com
eorogo.top ezigarettenshop2.postbit.com
eralph.tk f1nder.org
escortplius.com factorynightclub.com
etur.ru falopicm.pw
f-loaded.de family1st.ca
facecup.top fashionindeed.ml
fanrto.com fdzone.org
floating-share-buttons.com fefo.gdn
forpackningsutveckling.se fetlifeblog.com
forum.tvmir.org fickblock18.com
foxinsocks.ru fikasound.tk
franecki.net filerockstar298.weebly.com
frbizlist.com filesmonster.porn
free-fbook-traffic.com fillmewithhappiness.com
free-share-buttons.com findpik.com
free-traffic.xyz firstsiteguide.com
freemags.cc forodvd.com
freenode.info fortwosmartcar.pw
freewlan.info foxweber.com
frcls.fr
frequiry.com frequiry.com
fsalas.com
ftns.ru ftns.ru
fuckmill.com fungamelands.com
fyl.com.ru funnymama.com
gallictures.com g33.org
gardene.ru gallery.rennlist.com
gateway.zscalerone.net galleryawesome.com
gazoblok.net.ua gamebackyard.com
gdzkurokam.ru gaming-journal.com
gembird.com geile-lelly.eu
generousdeal-a.akamaihd.net gigixo.com
getmyads24.com gk-atlant.info
getresponse.com gktt.ru
getridofstretchmarks.org gogps.me
girlsfuckdick.com goodwriterssales.com
glcomputers.ru googleseo.com.tr
glopages.ru gopro-online.info
gotwebsite1.com greatfind-a.akamaihd.net
grand-chlen.ru green-tea.tv
gta-top.ru greenidesign.co
hamacapty.com greenshop.su
handicapvansarea.com grizzlysgrill.com
hdapp1008-a.akamaihd.net gungamesz.com
healing-dysplasia.ru guod.me
health-medical-portal.info hauleddes.com
hermesreplica.win hebr.myddns-flir.com
heroz.fr hentai-manga.porn
hetmanship.xyz hkladys.com
hitmuzik.ru hmmm.cz
hledejvshopech.cz hoholikik.club
hobbyhuren24.net homedecoguide.info
homedecorpicture.us homegardenlova.com
hotloans.ru horoshieokna.com
houdom.net house.sieraddns.com
howopen.ru howtoclean.club
hscsscotland.com htmlcorner.com
hubbble.com hvd-store.com
humanelydrew.com hydropump.su
hunterboots.online hyipmanager.in
igtools.club i-hobot.ru
imagecoolpub.com iblogpress.xyz
imfamous.info ideashome.id
in-tandem.co imagerydatabase.com
inboxdollars.com images.gyffu.com
imagui.eu
immigrational.info
impresagaia.it
incep.imagine-ex.co incep.imagine-ex.co
incest-ru.com
infostatsvc.com infostatsvc.com
intellekt21.ru internetartfair.com
intellektmedia.at inzn.ru
intermesh.net iopeninghours.co.uk
iqbazar.ru ipostroika.ru
javcoast.com iradiology.ru
javrip.net isistaylorporn.info
jerseywholesalechinabiz.com itch.io
junketjuice.blogspot.com itservicesthatworkforyou.com
jus0wil.pp.ua izhevsk.zrus.org
kaac.ru jabimgo.pw
karadene.com javitas.info
karting196.ru jerseychinabizwholesale.com
kasino-money.pw juliaworld.net
kiinomaniak.pl jurajskie.info
justbcause.com
justdating.online
kakadu-interior.com.ua
kamalsinha.com
kandidos.com
katadhin.co
kazan.zrus.org
ketrzyn.pl
kinoduh.ru
klumba55.ru klumba55.ru
kolotiloff.ru kosmetyki.tm.pl
konoplisemena.com
kosova.de kosova.de
kosynka-games.ru kostenloser-sex.com
kovrenok.ru krasnodar-avtolombards.ru
ladsblue.com krasnodar.ru
lampokrat.ws kredit-blog.ru
lanadelreyfans.us kurbappeal.info
landinez.co kvartira-sutochno.com
landscapebackgrounds.blogspot.com lakomka.com.ua
lapolis.it laparfumotec.com
laxdrills.com letmacwork.world
lazymanyoga.com
leboard.ru
lego4x4.ru
lesbian.xyz
letslowbefast.today letslowbefast.today
lflash.ru
liky.co.ua
live-cam6.info live-cam6.info
livefixer.com llastbuy.ru
lrac.info lombia.com
m5home.ru longlifelomilomi.info
machicon-akihabara.info lostfilm-online.ru
macotool.com lsp-awak-perikanan.com
magazin-pics.ru luchshie-topcasino.ru
lulea-auktionsverk.se
lyrster.com
mactechinfo.info
make-money-online.com make-money-online.com
manyresultshub-a.akamaihd.net marinetraffic.com
marketland.ml matb3aa.com
mediawhirl.net me-ke.com
mejoresfotos.eu mebelcomplekt.ru
mhi-systems.ru medizinreisen.de
mindeyegames.com meetingrainstorm.bid
mir-business-24.ru megaindex.ru
mistr-x.org member-quiz.com
mmgq.ru metascephe.com
mncrftpcs.com minyetki.ru
mobilierland.com
moesonce.com moesonce.com
mokrayakiska.com moinozhki.com
monitorwebsitespeed.com monthlywinners.com
moviemail-online.co.uk moskva.nodup.ru
moz.com most.gov.iq
mp3films.ru muz-shoes.ru
mustat.com mydirtystuff.com
myperiod.club mymobilemoneypages.com
myxdate.info nalogovyy-kodeks.ru
naturalbreakthroughsresearch.com neobux-bg.info
nelc.edu.eg netallergy.ru
nero-us.com netfacet.net
networkcheck.xyz new7ob.com
new-apps.ru nextrent-crimea.ru
newstaffadsshop.club nibbler.silktide.com
nightvision746.weebly.com noclegonline.info
no-fuel.org nonameread45.live
nottyu.xyz nordstar.pro
november-lax.com nw-servis.ru
nowtorrents.com nyfinance.ml
nsatc.net o-o-6-o-o.ru
o-o-6-o-o.com obiavo.net
okroshki.ru offtime.ru
old-rock.com omsk.xrus.org
online-x.ru onclkads.com
onlineku.com oneshotdate.com
ooo-gotovie.ru online-hd.pl
ooo-olni.ru openfrost.net
ops.picscout.com openlibrary.org
optitrade24.com orsonet.ru
orhonit.com osb.se11.ru
ororodnik.goodbb.ru outclicks.net
ozas.net paleohub.info
paidonlinesites.com panchro.co.uk
pandroid.co pandarastore.top
patol01.pw papasdelivery.ru
pawli.eu paramountmarble.co.uk
pdn-4.com partner-high.men
photosaga.info pc-virus-d0l92j2.pw
picsfair.com pc4download.co
picturesfrom.com pdns.cz
pierrehardysale.online perederni.net
pigrafix.at perfection-pleasure.ru
pillscheap24h.com perfectpracticeweb.com
pipki.r.acdnpro.com perm-profnastil.ru
piratecams.com pic2fly.com
picturesmania.com
pio.polytopesexempt.com
pix24x7.com pix24x7.com
placid-rounded-coast.glitch.me pizdopletka.club
pochemychka.net platinumdeals.gr
pogruztehnik.ru playboyfiles.xblog.in
pontiacsolstice.info polimga.pw
popugauka.ru pony-business.com
poquoson.org porndl.org
porno-transsexuals.ru porndroids.com
pornogratisdiario.com pornogad.com
pornohub.me pornonik.com
pornoreino.com pourvous.info
pornoted.com pp-budpostach.com.ua
pornoxxx.com.mx preg.marketingvici.com
pozdrawleniya.ru presleycollectibles.com
pricheskaonline.ru printie.com
priscilarodrigues.com.br privatov-zapisi.ru
productarium.com profitwithalex.info
profit-opportunity.com progress-upakovka.ru
pronekut.com puzzleweb.ru
qcstrtvt.bloger.index.hr r-e-f-e-r-e-r.com
quelle.ru rankexperience.com
raavidesigns.com rankscanner.com
rankingchart.de rapevideosmovies.com
realmonte.net rapidgator-porn.ga
realtytimes.com rating-casino2021.ru
redirectingat.com rednise.com
registratciya-v-moskve.ru refads.pro
remmling.de registrationdomainsite.com
remont-komputerov-notebook.ru remont-ustanovka-tehniki.ru
rep-am.com rennlist.com
repeatlogo.co.uk rentalcarnavi.info
ringporno.com responsinator.com
ros-ctm.ru retailwith.com
rossmark.ru rfid-locker.co
ru-mediaget.ru ric.info
runstocks.com rome2rio.com
ruspdd.com rostov.xrus.org
sanatorrii.ru royalcar-ufa.ru
ryetaw.com
sanjosestartups.com sanjosestartups.com
savememoney.co.za savingsslider-a.akamaihd.net
sawin.beth.webd.pl sawin.beth.webd.pl
scanner-jess.top sbetodiodnye-lampy.ru
scanspyware.net scanner-alexa.top
scenicmissouri.us scanner-george.top
scrnet.biz.ua scanner-jessica.top
search.pch.com scanner-john.top
scmor.ilxc.cc
scripted.com
searchengineranker.email
searchlock.com searchlock.com
searchwebknow-a.akamaihd.net searchmywindow-a.akamaihd.net
seemoreresultshu-a.akamaihd.net secretscook.ru
senger.atspace.co.uk seorussian.ru
seofirmreviewsus.info sex-pr.net
seomarketings.online sex-znakomstva.online
seoprofiler.com sexad.net
seorankinglinks.com sexsaoy.com
servethis.com sexxdate.net
sexkontakte-seite.com sharebutton.org
sexkontakteao.info sheerseo.com
sexspornotub.com shikiso.info
sexy-pings.com shopsellcardsdumps.com
shodanhq.com silverage.ru
shoesonlinebuy.xyz sinel.info
sientalyric.co
silktide.com
site-speed-check.site site-speed-check.site
siteaero.com skachat-besplatno-obrazcy.ru
sladkoevideo.com small-game.com
slavia.info smartshoppymac.com
snip.to smokewithrabbits.com
snsdeainavi.info snjack.info
social-s-ggg.xyz snjatie-geroinovoy-lomki.ru
social-vestnik.ru snowplanes.com
socialbookmarksubmission.org social-fun.ru
socialmadesimple.com social-s-hhh.xyz
solitaire-game.ru social-s-iii.xyz
soochi.co social-search.me
sortthemesitesby.com sogimlecal.tk
spb-plitka.ru solmarket.by
spin2016.cf souvenir.cc
spy-app.info spacash.com
stevemonsen.com spidtest.org
stillmiracle.com srecorder.com
strangeduckfilms.com stairliftstrue.com
stroiminsk.com stockspmb.info
sudexpert66.ru stop-gepatit.te.ua
sugarkun.com stuff-about-money.com
suggest-keywords.com sureone.pro
suralink.com
surgut.zrus.org
svarkagid.com svarkagid.com
swiped.su swinginwithme.ru
t3chtonic.com taaaak.com
tamada69.com taboola.com
taranerymagesswa.blogspot.com tasteidea.com
td-33.ru tecspb.ru
tedxrj.com terrafootwear.us
telesvoboda.ru the-trader.net
thaismartloan.com
the-torrent-tracker.blogspot.com
thegalerie.eu thegalerie.eu
thegamerznetwork.com thejournal.ru
thenetinfo.com themestotal.com
thetattoohut.com theplacetoupdating.pw
thewomenlife.com thin.me.pn
thruport.com titelhelden.eu
timer4web.com tizanidineoral.blogspot.com
tizanidinehcl4mgtablet.blogspot.com tizanidinevssoma.blogspot.com
tizanidineinfo.blogspot.com tizanidinewithdrawal.blogspot.com
tizanidinezanaflex.blogspot.com tomck.com
tjkckpytpnje.com top250movies.ru
tkanorganizma.ru toy-shop.top
tobeyouday.win toys.erolove.in
top10registrycleaners.com trafficmania.com
topappspro.com traffique.net
torrnada.ru traxdom.ru
totu.us trk-4.net
touchmods.fr trustaffs.com
tracfone.com
trahvid.com
trailer.cinemaflix.website
truck-addzilla.life
tt-ipd.info
turkeyreport.tk
tvand.ru tvand.ru
ugguk.online tversvet.ru
ukr-lit.com txxx.com
umekana.ru u-cheats.ru
uptimechecker.com ua-company.ru
ural-buldozer.ru uac.net.au
usiad.net udayavani.com
v24s.net ukrtvir.com.ua
validccseller.com umnovocaminho.com
vapeface.club underthesite.com
univerfiles.com
uptime.com
uzporno.mobi
vbabule.net
vclicks.net
velobikestock.com velobikestock.com
viandpet.com venta-prom.ru
videochat.tv.br video-camer.com
videosbox.ru vipromoffers.com
videtubs.pl
villacoloniale.com
vip.51.la
vipms.ru
visa-china.ru
visionwell.com.cn
vitoriacabos.com vitoriacabos.com
vsexkontakte.net vkak.ru
vtc.pw voluumtracker1.com
vuclip.com voluumtrk.com
wallpaperaccess.com warning.or.kr
wallpapers-best.com watracker.net
wallpaperstock.net we-are-gamers.com
warezkeeper.com webcamdevochka.com
warningwar.ru webnode.me
webix.me website-speed-checker.site
websiteaccountant.de weburlopener.com
weburok.com wechatdownload10.com
weightatraining.com wellcome2slovenia.ru
welck.octopis.com wfb.hatedriveapart.com
weprik.ru whengirlsgowild.com
westen-z.life wholinkstome.com
westvilletowingservices.co.za whosonmyserver.com
whatzmyip.net wildcattube.com
while.cheapwebsitehoster.com williamrobsonproperty.com
whiteelephantwellington.com woman-orgasm.ru
winwotgold.pl woodyguthrie.se
wladimirpayen.com wowcasinoonline.ooo
wonderfulflowers.biz xcombear.ru
ws.ampower.me xdoza.com
wttavern.com
www.pinnacle-bets.com
www.souvenirua.com
x-rates.ru
xmladserver.com xmladserver.com
xn----8sbarihbihxpxqgaf0g1e.xn--80adxhks xn----dtbndd4ae7eub.top
xn--80abgj3a5acid6ghs.top
xn--90acenikpebbdd4f6d.xn--p1ai xn--90acenikpebbdd4f6d.xn--p1ai
xn--b1addnj3cah.xn--p1ai xn--b1ag5cfn.xn--p1ai
xtubeporno.net xn--q1a.xn--b1aube0e.xn--c1acygb.xn--p1ai
xxlargepop.com
xxxdatinglocal.us xxxdatinglocal.us
xxxkaz.org xxxsiterips.xyz
yaoguangdj.com xxxtube69.com
youbloodyripper.com xzlive.com
youdao.com y8games-free.com
yougame.biz youandcredit.ru
yougotanewdomain.com youporn-forum.ga
youjizz.vc yourporngay.com
yourads.website youtubologia.it
zagadki.in.ua zeg-distribution.com
zaim-pod-zalog-krasnodar.ru zeroredirect1.com
zaobao.com.sg zeroredirect11.com
zarabiaj-dzis.pl zeroredirect5.com
zeroredirect12.com
zeroredirect7.com zeroredirect7.com
zigarettenonl.canalblog.com zhuravlev.info
zolotoy-lis.ru zigarettenonlinekaufen1.bloog.pl
znaniyapolza.ru
zophim.me
zytpirwai.net

470
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
11235813.webzdarma.cz 101billion.com
256bit.by 1kinobig.ru
6hopping.com 23kw.ru
7ooo.ru 4istoshop.com
7search.com 4webmasters.com
abtasty.com 98oi.ru
actices.com adinterax.com
adssafeprotected.com adloads.com
adultnet.in adservme.com
agahinameh.com advocatemsk.ru
all4invest.ru alessandraleone.com
alldownload.pw alphavisions.net
allornamenti.com ampower.me
amateurgalls.com anaksma.info
android4fun.org angkortours.vn
apccargo.com animali.deagostinipassion.it
apiholdingmypage-a.akamaihd.net aramaicmedia.org
appmsr.org arclk.net
auspolice.com as5000.com
awaybird.ru asrvrep-a.akamaihd.net
bagcionderlab.com asscenihotosidea.blogspot.co.za
balla-boo.se astrochicks.com
beachfix.co atlasvkusov.ru
begalka.xyz autorn.ru
best-seo-solution.com autotrends.today
azazaporn.com
azbukafree.com
back.dog
baksman.com
barnfurnituremart.com
bensbargains.net
bestserials.com bestserials.com
billiard-classic.com.ua bestsexyblog.com
bkns.vn biteg.xyz
bluejays-jerseys.us bjetjt.com
brainxs.us blue-square.biz
candy-glam-hp.com braindaily.xyz
candypeople.se braintobe.win
cartierlovestore.xyz brateg.xyz
cartujano-pre.de call-of-duty.info
changde.58.com chinaelitecheapjerseys.com
chocolateslim-en-espana.com christianlouboutinreplica.win
chocoslim.pro cialischmrx.com
cineacademy.ru cindymatches.com
clevernt.com classicakuhni.ru
click2pawn.com clipartnew.com
clickaider.com cmd.kz
clickcash.com coaching-netz.info
clickzzs.nl comeondog.info
compliance-barak.top compliance-mary.top
copyrightclaims.org copblock.org
counter.bloke.com counter.bloke.com
country-chic.ru
cryptoswap.biz cryptoswap.biz
damedingel.ya.ru datract.com
deluxedumps.com diamond-necklace.info
demenageur.com diesel-parts28.ru
design-ideas.info
diffbot.com diffbot.com
directivepub.com digitalfaq.com
distver.ru divku.ru
drugstoreforyou.com djihispano.com
dtnlyss.com dogoimage.com
easycommerce.cf donna7753191.ru
easyshoppermac.com dosugrostov.site
editmedios.com earn-from-articles.com
elektrozigarette1.dreamwidth.org elmifarhangi.com
emergencyneeds.org enthuse.computernetworksonline.com
energy-ua.com evaashop.ru
epicbrogaming.com everypony.ru
european-torches.ru ezigaretteshop2.vefblog.net
exlarseva.webblog.es f07.de
extrabot.com facecup.top
fakehandbags.xyz falopicm.pw
feargames.ru fashion-stickers.ru
fikasound.tk fetlifeblog.com
filunika.com.ru fickblock18.com
flashahead.info fickkontakte.org
flirt4free.com filmgo.ru
focalink.com footbalive.org
fortunejack.com forex21.ru
forum.tvmir.org forums.toucharcade.com
foto-basa.com
foxjuegos.com
fr.netlog.com
freewlan.info
fres-news.com
funcrushgames.com
fx-brokers-review.com
g.starmoe.xyz
g33.org g33.org
gamebackyard.com gameplexcity.com
gamerscorps.com gameprimary.com
gateway.zscalertwo.net gamevalue7.weebly.com
geileweiber.tk gotwebsite1.com
get-seo-domain.com graphicwe.org
ghazel.ru guge.io
glogow.pl gunsvicceadadebt.tk
goforexvps.com hao123.com
golmau.host.sk hostingclub.lk
gox.com.ua hostnow.men
greenshop.su hoverboard360.se
gsasearchengineranker.pw humanelydrew.com
handicapvantoday.com hvd-store.com
haveinc.xyz ikearugs.xyz
helicalpile.us
hobbyhuren-datenbank.com
homelygarden.com
houdom.net
hyipmanager.in
igadgetsworld.com
imfamous.info
inboxdollars.com inboxdollars.com
infobanks.ru inmate-locator.us
interesnie-faktu.ru instakink.com
investsuccess.org iplusbit.blogspot.co.za
isoveti.ru itis4you.com
istizanidinelikexanax.blogspot.com ivearchenceinflu.cf
itronics.ca jmat.cn
izhevsk.zrus.org jwss.cc
janerikholst.se
justucalling32211123456789.tk
karting196.ru karting196.ru
kichenaid.ru keki.info
kirov.zrus.org kerch.site
knowsitall.info kinobaks.com
lacave.ntic.fr konica.kz
ladsblue.com konoplisemena.com
ladsup.com krasivoe-hd.net
laserpen.club kupit-adenu.ru
laudit.ru labafydjxa.su
lincolntheatre.com law-check-two.xyz
linkdebrideur.xyz lidoradio.com
lion.bolegapakistan.com liffa.ru
lookingglassemb.com likrot.com
masterseek.com linksharingt.com
mcar.in.ua lion.snapmap.us
medi-fitt.hu liquimondo.com
megavolt.net.ua liveinternet.ro
minecraft-neo.ru lkbennettstore.online
mirtorrent.net lostaruban.com
mmgq.ru lulea-auktionsverk.se
mojpregled.com luxmagazine.cf
moneyviking-a.akamaihd.net mastershef.club
mrlmedia.net mebel-vstroika.ru
mere.host.sk
michellblog.online
mmoguider.ru
monarhs.info
moneyteam24.com
more-letom.ru
mrwhite.biz
mturkcontent.com
musflashtv.com musflashtv.com
music7s.me music7s.me
myanyone.net musirc.com
nikhilbahl.com muycerdas.xxx
nikitabuch.com naval.jislaaik.com
nullrefer.com neobux-bg.info
obiavo.com nextrent-crimea.ru
oda.as nhl09.ru
offer.camp nibbler.silktide.com
onescreen.cc niki-mlt.ru
osagonline.ru njkmznnb.ru
partner-host.men odesproperty.com
peekyou.com offer.wpsecurity.website
pekori.to okonich.com.ua
pinwallpaper.xyz oneclickfiles.com
pistonclasico.com onlinefilmz.net
pomoc-drogowa.cba.pl onlinetvseries.me
poppen-nw.net openmultipleurl.com
porno-chaman.info orgasmus-virtual.com
porno-raskazy.ru orhonit.com
pornoklad.ru pandarastore.top
pornotubexxx.name panicatack.com
pornotubs.com partners-ship.pro
potoideas.us pinsdaddy.com
pretty-mart.com pliks.pl
pod-muzyku.club
popup-fdm.xyz
porno-transsexuals.ru
porno-video-chati.ru
pornokorol.com
pornowarp.info
pornozhara.com
pospr.waw.pl
pricheski-video.com pricheski-video.com
prospekt-st.ru privetsochi.ru
ptr.ruvds.com professionalwritingservices15.blogspot.ru
putevka24.ru prostitutki-tolyatti.org
qcstrtvt.bloger.index.hr pushdata.sendpulse.com
quebec-bin.com qld10000.net
rabot.host.sk randalljhoward.com
rankings-analytics.com ranksays.com
ranksonic.info rapidsites.pro
ranksonic.org realizmobi.com
razleton.com realting-moscow.ru
razvratnoe.org resant.ru
recipedays.ru restaurantlescampi.com
registratciya-v-moskve.ru risparmiocasa.bz.it
relatodelpresente.com.ar rocis.site
renhacklids.tk ros-ctm.ru
sad-torg.com.ua russia-tao.ru
saneyes.com rustic-quiver.win
sarafangel.ru saddiechoua.com
scanner-walter.top sashagreyblog.ga
scanspyware.net sc-specialhost.com
schlampen-treffen.com searchinterneat-a.akamaihd.net
scripted.com
seokicks.de seokicks.de
serpstat.com sexxdate.net
sexspornotub.com sexyteens.hol.es
shama-rc.net shoesonlinebuy.cn
sharpchallenge.com simply.net
shodanhq.com
shop.acim.org
shopperifymac.com
si-unique.com
simpoed.ufop.br
site-analyzer.com
siteonomy.com siteonomy.com
sneakyboy.com slonechka.ru
social-s-hhh.xyz snjack.info
sonnikforme.ru sonata-arctica.wz.cz
sotkal.lark.ru sport7777.net
speedup-my.site sptslmtrafms.com
spitfiremusic.com
staff.prairiesouth.ca
stair.registrydomainservices.com
stairliftstrue.com stairliftstrue.com
stop-zavisimost.com startwp.org
stromerrealty.com supers.com.ua
stroyhelp-dv.ru supervesti.ru
supermodni.com.ua susanholtphotography.com
surfbuyermac.com swagbucks.com
svetodiodoff.ru symphonyintegratedhealthcare.com
tabletkinaodchudzanie.com.pl tako3.com
td-33.ru tamada69.com
tedy.su the-torrent-tracker.blogspot.com
thefotosgratis.eu thegioixekhach.com
toloka.hurtom.com tizanidinevscyclobenzaprine.blogspot.com
top250movies.ru toondinsey.com
totu.us topanasex.com
tuckermktg.com triumf-realty.ru
turbabitload.weebly.com uptime-gamma.net
twincitiescarservice.com uptime.com
ublaze.ru usiad.net
uk-zheu20.ru vashsvet.com
url-img.link videochat.tv.br
url2image.com villacoloniale.com
viagraneggrx.com vita.com.hr
video-hollywood.ru vkontaktemusic.ru
videonsk.com vladhistory.com
vigrx-original.ru weddingdresses.xyz
vkgaleria.com weightatraining.com
voronezh.xrus.org whengirlsgowild.com
vrnelectro.ru whiteproduct.com
vucms.com wrz0iuebwhp5fg.freeddns.com
web-analytics.date www.arenda-yeisk.ru
webkeyit.com xaijo.com
website-speed-up.site
wedding-salon.net
westen-v.life
westsextube.com
wholinkstome.com
wstroika.ru
www.888.com
www.event-tracking.com
xmladserver.com xmladserver.com
xtrafficplus.com xn--80adaggc5bdhlfamsfdij4p7b.xn--p1ai
xxlargepop.com xxlargepop.com
yougotanewdomain.com xxxhdvideo.site
yuweng.info xxxsiterips.xyz
zaim-pod-zalog-krasnodar.ru youandcredit.ru
zarabotat-na-sajte.ru yourdesires.ru
zebradudka.com zajm-pod-zalog-nedvizhimosti.ru
zetgie.com.pl zapatosenventa.info
zigarettenonlinekaufen2.bloog.pl zs2vm.top
zigarettenonlinekaufen2.drupalgardens.com
zona-aqua.ru
zygophyceous.womanstars.site

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.15 0; 10.1.0.20 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.03.2962 ### Version: V4.2022.03.2963
### Updated: Sun Mar 6 10:03:44 UTC 2022 ### Updated: Sun Mar 6 22:01:22 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.03.2962 ### Version: V4.2022.03.2963
### Updated: Sun Mar 6 10:03:44 UTC 2022 ### Updated: Sun Mar 6 22:01:22 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##