vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-04 03:29:57 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2022.11.3471 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2022-11-14 22:07:21 +00:00
parent 9952e46517
commit a283207857
46 changed files with 98290 additions and 98290 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.11.3470 #### Version: V4.2022.11.3471
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.11.3470 #### Version: V4.2022.11.3471
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -14,7 +14,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2022.11.3470 #### Version: V4.2022.11.3471
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

12150
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2022.11.3470 #### Version: V4.2022.11.3471
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

12154
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

12154
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

12154
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

12154
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.29 1; 10.1.1.63 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.29 0; 10.1.1.63 0;
127.0.0.1 0; 127.0.0.1 0;

12154
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.29 1; 10.1.1.63 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.29 0; 10.1.1.63 0;
127.0.0.1 0; 127.0.0.1 0;

12154
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.29 1; 10.1.1.63 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.29 0; 10.1.1.63 0;
127.0.0.1 0; 127.0.0.1 0;

12154
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
3470 3471

12154
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

12154
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
40.88.46.236 0; 4.246.145.152 0;

12154
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.29 1; 10.1.1.63 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.29 0; 10.1.1.63 0;
127.0.0.1 0; 127.0.0.1 0;

12154
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.29 1; 10.1.1.63 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.29 0; 10.1.1.63 0;
127.0.0.1 0; 127.0.0.1 0;

12154
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.29 1; 10.1.1.63 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.29 0; 10.1.1.63 0;
127.0.0.1 0; 127.0.0.1 0;

12154
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
40.88.46.236 0; 4.246.145.152 0;

12154
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
40.88.46.236 0; 4.246.145.152 0;

12154
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.29 1; 10.1.1.63 1;
127.0.0.1 1; 127.0.0.1 1;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
404enemy EyeNetIE
Copier FyberSpider
HaosouSpider Indy Library
Lightspeedsystems NetLyzer
MarkWatch POE-Component-Client-HTTP
Reaper RankActive
SiteSnagger Tracemyfile
Telesphorep WebFuck
Web Auto cah.io.community
satoristudio.net domainsproject.org

316
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
404checker 360Spider
404enemy 80legs
ALittle Client ADmantX
AIBOT
ASPSeek
Abonti
Aboundexbot Aboundexbot
Alexibot Alexibot
AllSubmitter Alligator
AlphaBot Anarchie
Anarchy99 Ankit
Asterias Anthill
Aspiegel
AwarioRssBot
AwarioSmartBot AwarioSmartBot
BLEXBot BLEXBot
BackStreet
BackWeb BackWeb
Backlink-Ceck Backlink-Ceck
Bandit Battleztar Bazinga
Barkrowler
BatchFTP
Bitacle
Black Hole
BlackWidow BlackWidow
Blackboard
BlowFish
Brandprotect
Brandwatch Brandwatch
BuiltWith BuiltBotTough
BunnySlippers
BuzzSumo BuzzSumo
CATExplorador
CCBot
CODE87 CODE87
Calculon Calculon
CherryPicker CensysInspect
CheeseBot
Claritybot Claritybot
Cloud mapping Cliqzbot
Cogentbot Cocolyzebot
Collector Copier
CopyRightCheck
Copyscape Copyscape
Crawling at Home Project Cosmos
CrazyWebCrawler Craftbot
Custo CrunchBot
CyotekWebCopy DBLBot
DIIbot DIIbot
DataCha0s
Demon Demon
Deusu Deusu
Devil
DigitalPebble
Dirbuster Dirbuster
Disco Disco
Discobot
Discoverybot Discoverybot
DomainCrawler DomCopBot
DomainSigmaCrawler
DomainStatsBot DomainStatsBot
Dotbot
Download Wonder Download Wonder
Drip Dragonfly
ECCP/1.0 EroCrawler
EMail Siphon Evil
Ecxi Express WebPictures
EirGrabber
Extractor Extractor
EyeNetIE ExtractorPro
Firefox/7.0 Extreme Picture Finder
FHscan
FlashGet
Foobot
Freeuploader Freeuploader
FyberSpider G-i-g-a-b-o-t
GalaxyBot GT::WWW
GermCrawler GetRight
GetWeb Getintent
Go!Zilla
GoZilla GoZilla
Gotit Gotit
GrabNet
Grafula
GrapeshotCrawler
GridBot GridBot
HEADMasterSEO HTMLparser
HTTP::Lite HTTP::Lite
HTTrack HTTrack
Haansoft
HaosouSpider
Harvest Harvest
Heritrix Heritrix
Hloader Image Sucker
HybridBot Intelliseek
Image Fetch InternetSeer
InfoNaviRobot Iskanie
Internet Ninja JOC Web Spider
IstellaBot JetCar
Jbrofuzz Jetty
JikeSpider Jorgee
Joomla JustView
Keybot Translation-Search-Machine Keyword Density
Kinza
LNSpiderguy
Lanshanbot
Larbin Larbin
Leap LeechFTP
LeechGet LeechGet
LexiBot
Lftp Lftp
Lightspeedsystems LibWeb
Likse Likse
LinkScan LinkextractorPro
LinkWalker
LinkpadBot LinkpadBot
LinqiaRSSBot Lipperhey
LinqiaScrapeBot
Lipperhey Spider Lipperhey Spider
MFC_Tear_Sample Litemage_walker
MJ12bot Lmspider
Ltx71
MIIxpc
MQQBrowser
MSFrontPage
MTRobot MTRobot
Majestic-SEO Magnet
Metauri Mail.RU_Bot
Mojeek MarkMonitor
Mozlila MarkWatch
Msrabot Mata Hari
Musobot MauiBot
MeanPath Bot
Meanpathbot
Mediatoolkitbot
MegaIndex.ru
Minefield
Mister PiX
MolokaiBot
NICErsPRO
NPbot
NearSite NearSite
Needle NetMechanic
Nessus
NetAnts
NetLyzer
NetSpider
NetZIP NetZIP
Netcraft
Nettrack
Netvibes Netvibes
Nibbler Nibbler
Nikto NimbleCrawler
Ninja Nmap
Not
Nutch
Offline Navigator Offline Navigator
OnCrawl
OpenVAS
Openfind
Openvas Openvas
OrangeBot OrangeBot
OutclicksBot OutclicksBot
OutfoxBot
PECL::HTTP PECL::HTTP
POE-Component-Client-HTTP
Page Analyzer Page Analyzer
PageThing.com PageThing.com
Panscient Panscient
Papa Foto
Picscout
PictureFinder
Piepmatz Piepmatz
Pimonster Pimonster
Pockey Pockey
Psbot ProPowerBot
QueryN Metasearch ProWebWalker
Pu_iN
PyCurl
Quick-Crawler Quick-Crawler
RSSingBot RSSingBot
RankActive
RankActiveLinkBot RankActiveLinkBot
RankFlex
RankingBot
Rankivabot Rankivabot
Re-re
RedesScrapy RedesScrapy
RepoMonkey RepoMonkey
Ripper ScanAlert
RocketCrawler Screaming
SBIder
SEOkicks
SEOlyticsCrawler
SMTBot
Scanbot
ScoutJet
ScreenerBot
ScrepyBot ScrepyBot
SearchmetricsBot Searchestate
SemanticJuice Seekport
SemrushBot SeoSiteCheckup
SentiBot SeobilityBot
SiteSnagger Siphon
Siteimprove SocialRankIOBot
SlySearch Sogou web spider
Snapbot
Sosospider
SpankBot
Spanner Spanner
SputnikBot
Sqlmap
Sqlworm
Sqworm Sqworm
Stripper
Sucuri Sucuri
Surfbot SuperBot
SurveyBot SurveyBot
Suzuran T0PHackTeam
Swiftbot Teleport
TeleportPro TeleportPro
Telesphoreo Telesoft
Toweyabot Thumbor
Trendictionbot TightTwatBot
TwengaBot Trendiction
Typhoeus True_Robot
Turnitin
URLy Warning URLy Warning
V-BOT
VB Project VB Project
Vagabondo VCI
Vacuum
VelenPublicWebCrawler
VeriCiteCrawler VeriCiteCrawler
VidibleScraper VidibleScraper
Virusdie VoidEYE
Voil WEBDAV
WASALive-Bot
WBSearchBot
WISENutbot WISENutbot
WPScan WPScan
WWW-Collector-E WWW-Collector-E
WWW-Mechanize WWW-Mechanize
WWW::Mechanize WWWOFFLE
Wallpapers/3.0
WeSEE WeSEE
Web Auto
Web Collage
Web Enhancer Web Enhancer
WebAuto Web Sauger
WebCopier WebBandit
WebCollage
WebEnhancer WebEnhancer
WebFetch
WebGo IS WebGo IS
WebReaper WebImageCollector
WebPix
WebSauger WebSauger
WebSucker WebStripper
WebWhacker WebZIP
Webalta WiseGuys Robot
WebmasterWorldForumBot Wonderbot
WebsiteExtractor
WebsiteQuester
Webster
Whack
Who.is Bot
Widow
WinHTTrack
Woobot Woobot
Wprecon
Xaldon WebSpider Xaldon WebSpider
Xenu YoudaoBot
Zade Zade
Zeus
Zitebot Zitebot
ZoomBot ZmEu
ZumBot adscanner
arquivo-web-crawler arquivo-web-crawler
cah.io.community autoemailspider
backlink-check
check1.exe check1.exe
coccocbot
cognitiveseo cognitiveseo
com.plumanalytics
crawler4j
demandbase-bot
domainsproject.org domainsproject.org
eCatch gopher
instabid heritrix
isitwp.com
iubenda-radar iubenda-radar
linkdexbot linkdexbot
lwp-request lwp-trivial
mediawords
muhstik-scan
netEstate NE Crawler netEstate NE Crawler
oBot oBot
page scorer page scorer
scan.lol plumanalytics
s1z.ru
scalaj-http
seobility
seoscanners seoscanners
sitechecker.pro serpstatbot
sogouspider tAkeOut
spyfu ubermetrics-technologies.com
webgains-bot voyagerx.com
webpros.com x09Mozilla
xpymep1.exe
zgrab zgrab

320
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
01h4x.com
360Spider
404checker
ADmantX ADmantX
ASPSeek
Abonti Abonti
Acunetix
AfD-Verbotsverfahren AfD-Verbotsverfahren
AiHitBot AhrefsBot
Alexibot
Anarchy Anarchy
Ankit Atomseobot
Apexoo
Aspiegel
AwarioRssBot AwarioRssBot
AwarioSmartBot BDCbot
BDFetch BackDoorBot
BatchFTP Backlink-Ceck
Battleztar Bazinga Bandit
BetaBot
Bigfoot Bigfoot
Bitacle Black Hole
BlowFish Blackboard
Boardreader
Bolt Bolt
Brandprotect
Brandwatch Brandwatch
Buddy
BuiltWith
Bullseye Bullseye
CATExplorador Calculon
CSHttp Cegbfeieh
CazoodleBot
CheTeam
CheeseBot CheeseBot
Cocolyzebot ChinaClaw
CopyRightCheck Cliqzbot
Craftbot Cloud mapping
Crawling at Home Project Collector
Copyscape
Cosmos
CrazyWebCrawler
Curious
Custo Custo
DBLBot DBLBot
DTS Agent DTS Agent
DataCha0s DataCha0s
Demon DatabaseDriverMysqli
Deusu Digincore
DigitalPebble Dirbuster
Disco Disco
DnyzBot Dispatch
DomCopBot
DomainAppender DomainAppender
DomainCrawler DomainCrawler
Dotbot DomainSigmaCrawler
Download Wonder Drip
ECCP/1.0 EMail Siphon
EMail Wolf EMail Wolf
Ebingbong EasyDL
Ecxi Ecxi
EroCrawler EroCrawler
ExtractorPro Exabot
FHscan Express WebPictures
Flunky ExtLinksBot
Freeuploader Extractor
Fuzz Extreme Picture Finder
Fyrebot EyeNetIE
GT::WWW Fimap
Go!Zilla FrontPage
Gotit G-i-g-a-b-o-t
Grafula GalaxyBot
GrapeshotCrawler GermCrawler
GridBot GetRight
HEADMasterSEO Go-Ahead-Got-It
GoZilla
GrapeFX
HTMLparser
HTTP::Lite HTTP::Lite
HTTrack
HaosouSpider HaosouSpider
Harvest Harvest
Heritrix HonoluluBot
Hloader
Humanlinks Humanlinks
IRLbot IDBot
Id-search Iblog
IlseBot
Image Sucker
IndeedBot IndeedBot
Indy Library Indy Library
InfoNaviRobot InfoNaviRobot
InternetSeer InfoTekies
Iskanie Internet Ninja
JamesBOT Iria
JetCar Joomla
Jetty
Jorgee
Jyxobot Jyxobot
Keyword Density Lftp
Kinza Libwhisker
LWP::Simple Lightspeedsystems
Lanshanbot Likse
Larbin LinkScan
Leap LinkpadBot
LexiBot LinqiaRSSBot
LinkextractorPro
LinqiaMetadataDownloaderBot
Lipperhey Lipperhey
Litemage_walker Litemage_walker
Lmspider Lmspider
Ltx71
MIDown tool
MIIxpc MIIxpc
MJ12bot MQQBrowser
MSFrontPage MSFrontPage
MTRobot
Mag-Net Mag-Net
Magnet
Mail.RU_Bot Mail.RU_Bot
MarkWatch Majestic-SEO
MauiBot Majestic12
Meanpathbot MarkMonitor
Mediatoolkitbot Masscan
MicroMessenger Mb2345Browser
Microsoft Data Access MegaIndex.ru
Microsoft URL Control Microsoft URL Control
Minefield
Moblie Safari Moblie Safari
Mojolicious Mr.4x3
Mozlila NICErsPRO
Musobot NPbot
Nessus Nameprotect
Net Vampire Navroad
NetAnts Needle
NetMechanic
NetSpider
NetZIP
Netcraft Netcraft
Netvibes NextGenSearchBot
Nimbostratus Nimbostratus
Nmap
Nutch
Octopus Octopus
Offline Explorer
OnCrawl OnCrawl
OpenLinkProfiler OpenLinkProfiler
Openfind OpenVAS
OrangeBot Openvas
OrangeSpider OrangeSpider
OutclicksBot POE-Component-Client-HTTP
OutfoxBot
PECL::HTTP
PageGrabber PageGrabber
PageScorer
Pandalytics Pandalytics
Panscient Papa Foto
Pavuk Pavuk
Petalbot Petalbot
Picscout
Picsearch
PictureFinder
Pimonster
Pixray
ProPowerBot ProPowerBot
Pump Probethenet
Pu_iN
PxBroker PxBroker
PyCurl PyCurl
QueryN Metasearch QueryN Metasearch
RSSingBot
RankActive RankActive
RankActiveLinkBot RankingBot
RankFlex RankingBot2
RankurBot RankurBot
Re-re
RedesScrapy RedesScrapy
RepoMonkey
Ripper Ripper
RocketCrawler RocketCrawler
Rogerbot
SBIder SBIder
SEOlyticsCrawler SEOkicks-Robot
SEOstats SEOprofiler
SISTRIX
SalesIntelligent
Scanbot
ScreenerBot ScreenerBot
ScrepyBot Searchestate
SearchmetricsBot Semrush
SemanticJuice SeoSiteCheckup
SeobilityBot Seomoz
Shodan
Siphon Siphon
Site Sucker Site Sucker
SiteCheckerBotCrawler
SiteSucker SiteSucker
Sitevigil SocialRankIOBot
SlySearch Sociscraper
Snake
Sosospider
Sottopop Sottopop
SpaceBison
Spammen
SpankBot
Spanner Spanner
SputnikBot Sqlmap
Sqlworm Sqlworm
Sqworm Sqworm
Surfbot Steeler
Sucuri
SuperBot
Suzuran
Swiftbot Swiftbot
T0PHackTeam T0PHackTeam
Teleport Telesphoreo
TeleportPro TheNomad
TightTwatBot
Toata Toata
Tracemyfile
Trendiction Trendiction
Turingos TurnitinBot
Twice Typhoeus
URLy Warning URLy Warning
URLy.Warning Upflow
V-BOT V-BOT
VB Project VCI
VelenPublicWebCrawler
VeriCiteCrawler VeriCiteCrawler
VoidEYE VoidEYE
WBSearchBot Voltron
WEBDAV WISENutbot
WWW-Mechanize WPScan
WWW::Mechanize WallpapersHD
WWWOFFLE WeSEE
Wallpapers Web Auto
Web Enhancer Web Fetch
Web Fuck
Web Sauger
Web Sucker Web Sucker
WebBandit WebFetch
WebCollage WebGo IS
WebEnhancer
WebImageCollector
WebLeacher
WebPix
WebReaper
WebSauger WebSauger
WebStripper
Webalta Webalta
WebsiteExtractor Whack
Webster Widow
Whatweb Wonderbot
WiseGuys Robot
Woobot Woobot
Wotbox Xaldon_WebSpider
Wprecon Xenu
Zauba Zauba
Zeus Zeus
Zitebot
ZoomBot ZoomBot
ZoominfoBot ZumBot
crawler4j adscanner
dataforseo.com archive.org_bot
arquivo-web-crawler
autoemailspider
cah.io.community
coccocbot
demandbase-bot
eCatch
evc-batch evc-batch
instabid heritrix
iubenda-radar internetVista monitor
ips-agent
linkdexbot linkdexbot
lwp-request lwp-request
meanpathbot lwp-trivial
mediawords mediawords
muhstik-scan
oBot oBot
page scorer page scorer
pcBrowser
probe-image-size probe-image-size
ripz
satoristudio.net
scalaj-http scalaj-http
seobility seobility
seoscanners seocompany.store
seostar
serpstatbot
sexsearcher
siteripz
spyfu spyfu
trendiction.de trendiction.com
voyagerx.com ubermetrics-technologies.com
webmeup-crawler webgains-bot
x09Mozilla webprosbot
zauba.io
zgrab

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
brillianty.info adzpower.com
clicksor.com amung.us
fearcrow.com dating-time-now.com
freecamdollars.com dstroy.su
goroda-vsego-mira.ru online-sbank.ru
imgarcade.com sady-urala.ru
m3gadownload.pl sel-hoz.com
nagdak.ru stariy-baku.com
savetubevideo.com vedomstvo.net
xcc24.pl westum.se

924
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
101raccoon.ru 10bet.com
1xbet4you.com 13tabs.com
273-fz.ru 1flag.co.za
7makemoneyonline.com 1kdailyprofit.me
888.com 214jaluwobapef.cf
8xv8.com 28n2gl3wfyb0.ru
91abcw.com 4k-player.pl
98oi.ru 4kepics.com
DomainStatsBot 55wmz.ru
a1security.com.ua 9icmzvn6.website
aanapa.ru abcdeg.xyz
acads.net abovetherivernc.com
acmebtn.ml acc.eu.org
adclickservice.com acgs.tk
adconscious.com actionnooz.com
add-add.men addblueoff.com.ua
advancedcleaner.com adloads.net
ahrefs.com adman.gr
akuhni.by akuhni.by
alibestsale.com alfabot.xyz
allfinweb.com alldownload.pw
allornamenti.com alloysteel.ru
alphaforum.ru amazon-adsystem.com
ample-awards-today.us ananumous.ru
ampower.me angry-fermi-7633.arukascloud.io
amyfoxfitness.com animenime.ru
analytics-ads.xyz anonymousfox.co
anmysite.com antons-transporte.de
anticrawler.org apelsinnik.website
apartmentbay.ru apiadanaknet-a.akamaihd.net
apibrowsesmartne-a.akamaihd.net apptester.tk
apimossnetinfo-a.akamaihd.net arabgirls.adultgalls.com
apper.de arcteryxstore.online
arcadepages.com ardimobileinfo.ml
arendakvartir.kz arkkivoltti.net
artavenuegardenstudios.com audiofree.ru
artel116.ru aviav.org
articlesdirectoryme.info aviav.ru
atmagroup.ru aviva-limoux.com
avon-novosib.ru ayeartoforget.com
awency.com azazu.ru
ayanaspa.com babieca.com
azartclub.org bablonow.ru
azartmix.com baersaratov.ru
azbukadiets.ru baksman.com
babespcs.com baladur.ru
babosas.com beatifullandscape.co
backiee.com best-seo-solution.com
backlinkwatch.com beyan.host.sk
bad-stars.net
bag77.ru
baixar-musicas-gratis.com
balitouroffice.com
baltgem.com
bard-real.com.ua
batanga.net
bestbrainprod.win
bestcurs.org
bestdraws.com
bestmouthwash.club
bestofferswalkmydogouteveryday.gq
bestwaystogetpaid.us
bezlimitko.xyz bezlimitko.xyz
bio.trade-jp.net bif-ru.info
bitcoinpile.com biographiya.com
bloggen.be biznesrealnost.ru
bmwhighperformers.com bizzliving.com
bochemit.com.ua blacktwhite.com
boeuklad.com blog.f00kclan.de
bolezniorganov.ru bmw-ark.ru
bonzbuddy.com bpro1.top
boom-celebs.com braintobe.win
bosefux.esy.es brk-rti.ru
bronzeaid-a.akamaihd.net budilneg.xyz
bupropion-sr-150-mg.us buntube.net
burkesales.com butstrap.space
businesxxl.com buy-meds24.com
buyk.host.sk buybest1.biz
callstevens.com buynorxx.com
camsex.xxx-cam.webcam buypuppies.ca
candelluxsklep.pl bvlgaribracelet.xyz
canyougethighofftizanidine.blogspot.com bzero1jewelry.net
canzoni.ru cacheimages.com
cardsdumps.com cactussoft.biz
carmuffler.net callejondelpozo.es
camdenmemorials.com
canacopegdl.com
candypeople.se
cannibalcheerleader.com
canrioloadm.gq
carsdined.org carsdined.org
cdn.walkme.com cartierloveringreplica.xyz
censys.io casinorewards.info
cfsrating.sonicwall.com casite-513049.cloudaccess.net
cheapmoncler.xyz cdncash.net
cdnnetwok.xyz
centre-indigo.org.ua
check-host.net check-host.net
choosecuisine.com chelnytruck.ru
cialgenisrx.com chelyabinsk.xrus.org
cialischsrx.com chocolateslim-en-espana.com
cialisndbrx.com chocolateslim-en-france.com
cl.s7.exct.net circlesl.com
cleanallspyware.com clicksor.net
clickintext.net clicksotrk.com
club-musics.ru
cognitiveseo.com
colehaanoutlet.store colehaanoutlet.store
communisave.co.za compliance-jack.top
compliance-walter.top compliance-jess.top
constantaservice.net concealthyself.com
construmac.com.mx concordexoticrentals.com
contentsexpress.com cookie-law-enforcement-aa.xyz
costablue.xyz coop-gamers.ru
crackzplanet.com coslab.club
crafthubs.com cpabegins.ru
craftinsta.ru
crd.clan.su crd.clan.su
crest-poloski.ru credit.co.ua
customcatchcan.com customergrowthsystems.com
cutalltheshit.com cvety24.by
dailystrength.org cyclobenzaprinevstizanidine.blogspot.com
damedingel.ya.ru darodar.com
daooda.com
data1.scopich.com data1.scopich.com
dataloading.net davebestdeals.com
dekoration.us daymusam.com
dev78.dioniqlabb.se deanmoore.ie
dieta-personalna.pl deniven.1bb.ru
dipstar.org diarioaconcagua.com
discovertreasurenow.com dickssportinggoods.com
doctormakarova.ru digital-video-processing.com
dojki365.online dinosaurus.site
domashneeruporno.com dirtpics.pw
discountliv.com
divatraffic.com
diy-handmade-ideas.com
documentbase.net
domaincrawler.com
domik-derevne.ru domik-derevne.ru
doreenblog.online donvito.unas.cz
druzhbany.ru downloadkakaotalk.com
e-c.al dprtb.com
e-commerce-seo.com drugspowerstore.com
earl-brown.info drunkmoms.net
ebooknovel.club duplicashapp.com
ec-file.info dverimegapolis.ru
el-nation.com dvrlists.com
electronicadirect.com eandsgallery.com
elektrischezigarette2.devhub.com econom.co
elektronischezi.livejournal.com edudocs.net
elmifarhangi.com eleimgo.pw
eropho.com elektronischezigarettekaufen2.tumblr.com
evrotekhservis.ru elektrozigarette2.webs.com
expertnaya-ocenka.ru elektrozigarettekaufen2.blogse.nl
extremepornos.net elvenar.com
ezigarettekaufen1.hpage.com elvenmachine.com
f-online.de englate.com
falopicm.pw eonpal.com
familyholiday.ml ero-advertising.com
fashion-stickers.ru escortslet.net
fdzone.org essayservicewriting.org
fefo.gdn estelight.ru
fickluder69.com europages.com.ru
everflora.ru
exoclick.com
extener.org
extlabs.io
ezigarettekaufen2.yolasite.com
face.hostingx.eu
fandlr.com
farmingworm.com
fealq.com
filmfanatic.com filmfanatic.com
financetip.eu filunika.com.ru
firstsiteguide.com fingerprintjs.com
fortevidyoze.net fitnesspiks.com
forum.poker4life.ru flashbannernow.com
free-laptop-reward.com flauntyoursite.com
free-traffic.xyz fordsonmajbor.cf
freemags.cc forex-indextop20.ru
frighteningremain.cf forzeronly.com
fx-brokers-review.com foto-sisek.porngalleries.top
fyl.com.ru foxweber.com
fz139.ttk.ru free-share-buttons.com
g7m.pl free411games.com
gambarxkata.co freelifetimefuckbook.com
freelotto.com
freenode.info
fres-news.com
freshwallpapers.info
freza-sverlo.ru
frivgame250.com
fsakhalin.ru
ftns.ru
fullgirl.ru
fym.com.ru
gamedayassist.com gamedayassist.com
getpopunder.com gay.adultgalls.com
getresponse.com gemgrab-a.akamaihd.net
gnuetella.com getlamborghini.ga
golaya.pw gifspics.com
goodly.pro girlgamerdaily.com
goodprotein.ru gkvector.ru
gopro-online.info glicol.kz
gosarhivrt.ru globalscam.ga
gratuitbaise.com gogalleryawesome.com
golden-catalog.pro
golfresa.lucania.se
gorodservis.ru
gowreckdiving.com
gratuitxblcodes.com gratuitxblcodes.com
greenidesign.co guitar-master.org
growmyfunds.ca gwebtools.com
guruofcasino.com gyffu.com
harmonyglen.us h2monline.com
headpharmacy.com hahashka.ru
health-medical-portal.info hamacapty.com
hermesbracelets.xyz hdpixion.com
highstairs-a.akamaihd.net hentai-manga.porn
himgaws.pw hitcpm.com
hotdl.in homeinns.com
hothot.ru host-tracker.com
hotkeys.com hotblognetwork.com
house.sieraddns.com housekuba.org
hubbble.com hoverboard360.de
huimin764128.com hoverboard360.se
ihc2015.info hptwaakw.blog.fc2.com
ilmexico.com hscsscotland.com
ilte.info huhn.altervista.org
imgarit.pw idealtits.net
impisr.edunsk.ru iframe-toloka.com
incest-ru.com igrovyeavtomaty777.ru
imguramx.pw
immobiliaremassaro.com
imperiafilm.ru
incomekey.net incomekey.net
infobanks.ru infogame.name
infokonkurs.ru infokonkurs.ru
intellekt21.ru intellekt21.ru
iptool.xyz interferencer.ru
isitwp.com intermesh.net
itis4you.com internet-apteka.ru
javxxx18.com iplogger.org
jaxcube.info ipostroika.ru
iradiology.ru
irunfar.com
ispac.org
istizanidinelikexanax.blogspot.com
istmira.ru
itrevolution.cf
janerikholst.se
jerseychinabizwholesale.com
jumptap.com
jwcialislrt.com jwcialislrt.com
kabbalah-red-bracelets.com jyvopys.com
kaidalibor.de karting196.ru
kartiniresto.com kevblog.top
katushka.net
ketrzyn.pl
keywesthideaways.co
keyword-suggestions.com keyword-suggestions.com
kino-key.info kimcurlrvsms.com
kinopolet.net kinogolos.ru
kmd-pto.ru komp-pomosch.ru
knowsitall.info
koral.se koral.se
la-fa.ru koversite.info
lacloop.info kovrenok.ru
ladov.ru kozhniebolezni.com
lalalove.ru kupiproday.com.ua
landreferat.ru landscaping.center
law-check-two.xyz larger.io
lazymanyoga.com lashstudia.ru
le-clos-des-alouettes.com leboard.ru
libertybilisim.com lerporn.info
lifehacĸer.com lineavabit.it
link.ac liupis.com
livesex-amateure.info liverpool.gsofootball.com
livingroomdecor.info lookingglassemb.com
lottospring.com lostfilm-online.ru
lovasszovetseg.hu louboutinreplica.xyz
ltvperf.com lutherstable.org
mantramusic.ru m3gadownload.pl
medtherapy.ru macnewtech.com
meduza-consult.ru magnetpress.sk
meetingrainstorm.bid mainhp.net
megaindex.ru mcnamaratech.com
merryhouse.co.uk mebelcomplekt.ru
mexicotravelnet.com meble-bogart.info
michaelkorssaleoutletonline.net med-zdorovie.com.ua
mindbox.co.za menhealed.net
minyetki.ru mesbuta.info
mlvc4zzw.space micasainvest.com
mmoguider.ru michaelkorsoutletstore.net
mompussy.net mil-stak.com
monetizationking.net mmostrike.ru
monthlywinners.com mockupui.com
mostantikor.ru moneytop.ru
moviezbonkerssk.cf more-letom.ru
mrsdalloways.com morocco-nomad-excursions.com
mug-na-chas-moscow.ru moskva.nodup.ru
mural.co msfsaar.de
musezone.su musezone.ru
musicktab.com my-floor.in.ua
myiptest.com myphotopipe.com
mylida.org myplaycity.com
myliveblog.ru nakozhe.com
myyour.eu narco24.me
na15.ru nardulan.com
nac-bearings.ru nerudlogistik.ru
naj-filmy24.pl newstraveller.ru
naturalbreakthroughsresearch.com nextbackgroundcheck.gq
needtosellmyhousefast.com nhl17coins.exblog.jp
neodownload.webcam nl.netlog.com
nero-us.com nordstar.pro
netvouz.com nottyu.xyz
newstaffadsshop.club
niroo.info
nofreezingmac.click
nordvpn.com
novatech.vn novatech.vn
november-lax.com novosibirsk.xrus.org
nw-servis.ru nucia.biz.ly
o-o-8-o-o.ru nudo.ca
oakridgemo.com nuker.com
obuv-kupit.ru nullrefer.com
ok-ua.info oda.as
okonich.com.ua online247.ml
olvanto.ru onlineku.com
omgtnc.com openmultipleurl.com
onlinadverts.com ourtherapy.ru
orel-reshka.net ownshop.cf
orgasmus-virtual.com panchro.xyz
orsonet.ru paradontozanet.ru
outclicks.net parajumpersoutlet.online
pacificair.com parvezmia.xyz
partnerline.men patterntrader-en.com
partnerworkroom.men pdn-4.com
pc-virus-d0l92j2.pw pdns.cz
perosan.com penisvergrotendepillennl.ovh
petsblogroll.com photo.houseofgaga.ru
photo-clip.ru pic2fly.com
photokitchendesign.com picmoonco.pw
pictures-and-images.net pierrehardysale.online
pinsdaddy.com pills24h.com
pinwallpaper.top pinstake.com
pinup-casino1.ru
pix-hd.com pix-hd.com
pixell.club pobeiranie.pl
pizza-imperia.com podshipniki-ntn.ru
plugingeorgia.com poem-paying.gq
popugaychiki.com pogosh.com
pornhubforum.tk pornosok.ru
pornobrazzers.biz poshiv-chehol.ru
pornotubexxx.name praisong.net
pozdrawleniya.com preg.marketingvici.com
presleycollectibles.com
pricheski-video.com pricheski-video.com
primedice.com
privatbank46.ru privatbank46.ru
pro-poly.ru
proekt-mos.ru proekt-mos.ru
profitfx.online progress-upakovka.ru
profitsport.club promoheads.com
prospekt-st.ru
prostitutki-almata.org prostitutki-almata.org
prostitutki-tyumeni.org pssucai.info
pshare.biz pufip.com
pulse33.ru pukaporn.com
quickbuck.com qor360.com
qpypcx.com
randalljhoward.com randalljhoward.com
raschtextil.com.ua rankingchart.de
rcb101.ru rapidokbrain.com
realting-moscow.ru rasteniya-vs-zombi.ru
realtytimes.com rating-casino2021.ru
reelheroes.net registratciya-v-moskve.ru
relayblog.com
remontvsamare.su
renecaovilla.online
replicaclub.ru
research.ifmo.ru
responsinator.com
restorator-msk.ru restorator-msk.ru
rewardit.com rewardpoll.com
rialp.getenjoyment.net ric.info
risparmiocasa.bz.it rockma.se
roznica.com.ua royalads.net
ru-dety.ru
rumamba.com rumamba.com
rus-pornuha.com
ruscopybook.com ruscopybook.com
rusprostitute.com russian-postindex.ru
rustic-quiver.win russintv.fr
rusvideos.su sabizonline.com
ryetaw.com saletool.ru
sack.net salut-camp.ru
sakhboard.ru
saneitconsulting.com
saneyes.com
sanyuprojects.com
sashagreyblog.ga
savememoney.co.za savememoney.co.za
scanner-fred.top savetubevideo.com
scanner-julianna.top scanner-andrew.top
scat.porn scanner-don.top
scenicmissouri.us scanner-donald.top
schlampen-treffen.com scansafe.net
scmor.ilxc.cc sdsjweb.com
score-ads.men se.bnt-team.com
scottbywater.com securityallianceservices.com
scripted.com seeresultshub-a.akamaihd.net
searchencrypt.com sei80.com
seccioncontrabajo.com seinterface.com
secret.xn--oogle-wmc.com
semaltmedia.com
semp.net semp.net
senger.atspace.co.uk seoanalyses.com
service-core.ru serdcenebolit.com
sexiporno.net serpstat.com
sexpartygirls.net sexphoto.site
sextracker.com sharebutton.org
sexyali.com shinikiev.com.ua
sexyebonyteen.com shop.acim.org
shakhtar-doneck.ru
shoesonlinebuy.xyz
sigmund-freud.co.uk sigmund-freud.co.uk
silverage.ru snowplanes.com
site-speed-check.site songoo.wz.cz
site.ru sotkal.lark.ru
sizeplus.work spabali.org
sklad-24.ru speedup-my.site
skladvaz.ru spl63.fr
skypasss.com spravka130.ru
slavkokacunko.de spy-app.info
slowmacfaster.trade ssconstruction.co
small-games.biz success-seo.com
smallseotools.com
smokewithrabbits.com
sobecjvuwa.com.ru
social-search.me
spin2016.cf
stair.registrydomainservices.com
stal-rulon.ru
stathat.com
steame.ru
stevemonsen.com
stroicol.net
studiokamyk.com.pl
stuffpride.com
sukarame.net sukarame.net
sunflowerdrawingpaintings.blogspot.com sukirgenk.dvrlists.com
supermama.top svolze.com
surfbuyermac.com swsociety.se
surflinksmedical.com tacbibirfa.tk
svarkagid.com takethatad.com
swingerseiten.com td-l-market.ru
szucs.ru teenporn18.net
tandvardshuset.net
teencastingporn.com
teenforporn.com
telefonsex-ohne0900.net
telefonsexi.com
templates.franklinfire.co templates.franklinfire.co
templates.radiodigital.co
terraclicks.com
texbaza.by texbaza.by
thaismartloan.com
thecoolimages.net
thecoral.com.br thecoral.com.br
thewebsitetemplate.info thecounter.com
thegioixekhach.com
titan-ads.life
titelhelden.eu
tivolibasket.it tivolibasket.it
tizanidinedosage.blogspot.com tizanidine4mgprice.blogspot.com
tizanidinewithdrawal.blogspot.com tizanidinedosageforsleep.blogspot.com
tk-assortiment.ru tizanidinehcl4mgisitanarcotic.blogspot.com
tootoo.to tizanidinehcl4mgtabinfo.blogspot.com
topbestgames.com tizanidinehydrochloride2mg.blogspot.com
topclickguru.com tongkatmadura.info
topkarkas.com topanasex.com
topshef.ru topappspro.com
topsy.com topcasinoratings.ru
torontoplumbinggroup.com topmira.com
torrents.life topvidos.ru
tourismvictoria.com torrent-to-magnet.com
toys.erolove.in torrnada.ru
traffique.net tracklead.net
trahvid.com traderzplanet.in
triplepanda.xyz trafficmonetize.org
u-cheats.ru trafficnetzwerk.de
trahic.ru
trkdf.com
trustaffs.com
turvgori.ru
tvorozhnaja-zapekanka-recept.ru
twiclub.in
txxx.com
ublaze.ru
udsgame.online
uhdtv.website
ukkala.xyz
ukrobstep.com ukrobstep.com
uni.me ultimatesetnewfreeallsoftupgradesystems.pw
unimodemhalfduplefw.pen.io ultramart.biz
urll.eu uroffer.link
uroki.net ussearche.cf
usdx.us v720hd.ru
usswrite.com vacances-voyages.info
utiblog.fr vertaform.com
utrolive.ru viandpet.com
v-doc.co video-chat.in
validccseller.com video-chat.love
vedomstvo.net videochat.cafe
vegascosmetics.ru videokrik.net
velobikestock.com vintontech.info
video--production.com virus-schutzmasken.de
videositename.com vsdshnik.com
vizitki.net w-journal.ru
vk-mus.ru wallpaperaccess.com
vmnmvzsmn.over-blog.com webix.me
vse-pesni.com webmonetizer.net
vseigry.fun websites-reviews.com
wallpapersdesk.info weburok.com
walpaperlist.com wejdz-tu.pl
warningzscaler.heraeus.com wemedinc.com
watchmygf.net wesharepics.site
we-are-gamers.com wingsoffury2.com
web.cvut.cz winterclassichockeyjerseys.com
webnode.me world-mmo.com
wellcome2slovenia.ru worst-sites.online
womensterritory.ru wsgames.ru
woodyguthrie.se wttavern.com
word-vorlagen.net ww1943.ru
wordpresscore.com
worldlovers.ru
wowas31.ucoz.ru
wrona.it
wrz0iuebwhp5fg.freeddns.com
www.arenda-yeisk.ru
www.ehscloud.cn
x-lime.net
x-stars.ru x-stars.ru
xn----7sbahjd3btneuw1joc.xn--p1ai xblognetwork.com
xn----9sbubg3ambdfl1j.xn--p1ai xingzi-vision.com
xn----dtbndd4ae7eub.top xitjw.info
xn--80adaggc5bdhlfamsfdij4p7b.xn--p1ai xjlottery.com
xn--80aeahghtf8ac5i.xn--p1ai xjrul.com
xn--90acenikpebbdd4f6d.xn--p1ai xn----7sbaphztdjeboffeiof6c.xn--p1ai
xn--oogle-wmc.com xn----8sbarihbihxpxqgaf0g1e.xn--80adxhks
xnxxandxvideos.com xn--b1addnj3cah.xn--p1ai
xxx-cam.webcam xn--b1agm2d.net
yellowstonesafaritours.com xxxguitars.com
y8games-free.com
yaderenergy.ru
yginekologa.com yginekologa.com
youjizz.com yoshkarola.zrus.org
yourporn.com youradulthosting.com
zaimhelp.ru youthreaders.com
zastroyka.org youtoner.it
zawyna.ua yun56.co
zebramart.ru zambini.ru
zetmaster.ru zarajbuilders.com
zhongwenlink.com zarepta.com
zigarettenonlinekaufen1.blox.pl zlatnajesen.com
zionstar.net zone-kev717.info
zoogdinsney.com zootravel.com
zophim.me zynax.ua
zs2vm.top

468
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
08800.top 1-free-share-buttons.com
1kinobig.ru 101lesbian.xyz
5elementov.ru 123kuma.com
adclickthru.net 34.gs
adexprts.com 7a2rnuey1tw9ar.ru
adimmix.com 8gold.com
advokateg.ru aa9d046aab36af4ff182f097f840430d51.com
agecheckadult.com absugars.com
allsilver925.co.il adminshop.com
anapa-inns.ru adrunnr.com
apessay.com adsloads.com
appartement-stumm.at adult-shop.com.ua
atmagroup.ru advancedmassagebysara.com
ausmepa.org.au agreda.pluto.ro
autochoixspinelli.com aimayangzhi.com
automatic-seo.com alienwheels.de
balkanfarma.org all-number.com
baoxaydung.com.vn allproblog.com
betterhdporn.com allstatesugarbowl.org
bpro1.top allwidewallpapers.com
budilneg.xyz apibrowsesmartne-a.akamaihd.net
buyessaynow.biz as5000.com
buyhoverboard.com ascat.porn
buzzsumo.com atovh.local-finders.com
cartechnic.ru babieca.com
cartierlove.xyz baditri.com
cartierring.xyz banki76.ru
casinos4dummies.co.uk beclean-nn.ru
cdncash.net beget.tech
chatroulette.si bin-brokers.com
cheapbarbour.online bluerobot.info
checkhit.com bolitgorlo.net
children-learningreading.info bonkers.name
cialisovercounteratwalmartusa.com break-the-chains.com
cityadspix.com bronzeaid-a.akamaihd.net
clayvasedesigns.tk buckspar.gq
clknsee.com calcularpagerank.com
clmforexeu.com cardul.ru
compliance-alex.top cartierwatch.xyz
compliance-donald.xyz chatseo.com
compliance-irvin.xyz checktext.org
compliance-willy.top cibpenonptib.flu.cc
confib.ifmo.ru citizenclsdriveri7.pen.io
connectionstrenth.com clicksor.net
contextualyield.com cntravelre.com
converse.ddsoldes.fr coindirect.io
costablue.xyz comissionka.net
countbertwistdisp26.soup.io compliance-don.xyz
cranly.net compliance-julianna.top
crest-poloski.ru comsysnet.com
customsua.com.ua cornerstone-countertops.com
demian.kz craftburg.ru
designdevise.com cubs-jerseys.us
digitalfaq.com descargar-musica-gratis.net
dinosaurus.site dgfitness.co
dispo.de djstools.com
djihispano.com dokfilms.net
dneprsvet.com.ua drupa.com
docstoc.com dustyorate.com
dstroy.su editors.choice6912650.hulfingtonpost.com
easync.io electronicadirect.com
ec-file.info englishdictionaryfree.com
ed-shop01.ru esnm.ru
ekaterinburg.xrus.org evening-dating-club.info
elektrozigaretten1.webs.com extremepornos.net
eng-lyrics.com ezigarettekaufen1.hpage.com
epicbrogaming.com fapgon.com
eshop.md fatfasts-4tmz.com
estelight.ru favornews.com
eugenevaultstorage.com felizporno.com
exct.net fingerprintjs.com
facialporntube.com
fandlr.com
femmesdenudees.com
flashbannernow.com flashbannernow.com
forums.d2jsp.org flooringinstallation-edmonton.com
frankofficial.ru frameimage.org
free-share-buttons.com freemags.cc
ftns.ru freeuploader.com
gamewrath.com frighteningremain.cf
front.ru
garciniaxt.us
gidonline.one gidonline.one
girlsfuckdick.com gogps.me
glall.ru gonextmedia.com
gnuetella.com helvetia.com.ua
goforexvps.com hledejvshopech.cz
golden-catalog.pro hobbyhuren24.net
gosarhivrt.ru hollywoodactress.info
gratuitxblcodes.com honyaku.yahoofs.jp
hasshe.com
highspeed5.net
hitsbox.info
homedo.fabpage.com
hotshoppymac.com hotshoppymac.com
houseofrose.com hspline.com
husky-shop.cz hubbble.com
ifirestarter.ru ibb.com.ua
iflycapetown.co.za
igithab.com igithab.com
imgata.com imagefinder.site
infektsii.com imguramx.pw
infogame.name interesnie-faktu.ru
informatiecentro.be investzalog.ru
insta-add.pro itch.io
internetartfair.com kadashihotel.com
investyb.com kakadu-interior.com.ua
ipchicken.com kamagragelusa.net
irkutsk.zrus.org karaganda.xkaz.org
itis4you.com keywords-monitoring-success.com
j33x.com
jobgirl24.ru
joyceblog.top
kamalsinha.com
kambasoft.com
kevblog.top
keywordbasket.com
kino-ecran.ru kino-ecran.ru
kinogolos.ru
kiprinform.com
klitimg.pw klitimg.pw
kollekcioner.ru kochanelli.com
konteiner24.com krasnodar.ru
lapolis.it kutikomi.net
lashstudia.ru landscapebackgrounds.blogspot.com
law-check-nine.xyz link.ac
law-check-two.xyz lisque.batcave.net
lazy-z.com listiseltemournlan.gq
letslowbefast.site littlesexdolls.com
livingroomdecor.info
loadopia.com
lolnex.us
longgreen.info
ltvperf.com
luckyday.world luckyday.world
macresource.co.uk
maladot.com
malls.com malls.com
marcowebonyodziezowe.pl malwareremovalcenter.com
marketland.ml martlinker.com
masthopehomes.com master-muznachas.ru
matematikus.info mecash.ru
medispainstitute.com.au medicinacom.ru
megavolt.net.ua meetlocalchicks.com
mensandals.xyz mikrobiologies.ru
micasainvest.com mindeyegames.com
mirobuvi.com.ua mini.7zap.com
mockupui.com mmoguider.ru
naturtreenspicerx.pw mobile-appster.ru
new-apps.ru moinozhki.com
nikitsyringedrivelg.pen.io monclerjacketsoutlet.pw
nodding-passion.tk moneymaster.ru
offers.bycontext.com mountainstream.ms
one-gear.com mp3films.ru
paleohub.info mulberryoutletonlineeu.com
pandroid.co narosty.com
pc-virus-d0l92j2.pw nero-us.com
pdfprof.com newfilmsonline.ru
perfectpracticeweb.com notasprensa.info
picsforkeywordsuggestion.com onclkads.com
pillscheap24h.com onetravelguides.com
onlythegames.com
openmultipleurl.com
optitrade24.com
outrageousdeal-a.akamaihd.net
owathemes.com
oyster-green.com
panchro.co.uk
pic-re.blogspot.com
picturesboss.com
pipki.r.acdnpro.com
pk-services.ru
pojdelo.weebly.com
polcin.de
poligon.com poligon.com
pons-presse.com pooleroadmedicalcentre.co.uk
pornotubs.com pornophoto.xyz
posible.net pornstartits.xblog.in
postclass.com postclass.com
pourvous.info pozvonim.com
pretty-mart.com predominant-invent.tk
pts163.ru producm.ru
pufip.com productarium.com
qitt.ru prokotov.com
questionmarque.ch promodj.com
rainbowice.ru psa48.ru
rankexperience.com
rankia.com rankia.com
razamicroelectronics.com ranksignals.com
razyboard.com respublica-otel.ru
rebrand.ly rff-cfal.info
revistaindustria.com richinvestmonitor.com
royal-betting.net rixpix.ru
rp9.ru robot-forex.biz
running-line.ru rozalli.com
saecsa.co ruclicks.com
samoiedo.it russintv.fr
rybalka-opt.ru
sammlungfotos.online
sankt-peterburg.nodup.ru sankt-peterburg.nodup.ru
sardinie.us scanner-mary.top
scanner-george.top sdrescher.net
scanner-john.top search.xtconnect.com
seasonvar.ru searchengineranker.email
senger.atspace.co.uk semaltmedia.com
seo-platform.com serpstat.com
seorankinglinks.xyz sex-sex-sex5.com
sheerseo.com sexkontakteao.info
similardeals.net sharebutton.org
siteripz.net shopvilleroyboch.com.ua
slomm.ru simul.co
sitebeam.net
skladvaz.ru
smichovbike.cz smichovbike.cz
socialseet.ru snts.shell-pmr.ru
spymac.net social-buttons.xyz
stats-public.grammarly.io social-fun.ru
stroilka.info sofit-dmd.ru
swinon.site softonicads.com
taraz.xkaz.org srgwebmail.nl
thaisamkok.com sstroy44.ru
theallgirlarcade.com summerlinhomes411.info
thiegs.reco.ws sundrugstore.com
threecolumnblogger.com tam-gde-more.ru
timhost.ru teencastingporn.com
titslove.yopoint.in thecounter.com
tizanidinehcl4mgtab.blogspot.com thepokertimer.com
tizanidineshowupondrugtest.blogspot.com tizanidine6mg.blogspot.com
tizanidinesleepaid.blogspot.com tizanidineinteractions.blogspot.com
tizanidineusedfor.blogspot.com tizanidinerestlesslegsyndrome.blogspot.com
toursmaps.com tizanidinevsvalium.blogspot.com
tracksurf.daooda.com top-karkas.ru
tuberkulezanet.ru tozup.com
tupper-shop.ru tracfone.com
umityangin.net tradgardspartner.se
upupa.net tuckpointingmasonrysystems.com
vegan-foods.us turist-strani.ru
verymes.xyz uac.net.au
viddyoze.com vabasa.inwtrade.com
videochat.cafe vacances-voyages.info
videochat.mx via-gra.webstarts.com
vmnmvzsmn.over-blog.com vinsit.ru
wareseeker.com vladimir.xrus.org
volume-pills.biz
vzlomtw.com
wallpapers-best.com
watchinf.com watchinf.com
webads.co.nz waterefficiency.co
wdfdocando.com
webenlace.com.ar webenlace.com.ar
webscouter.net webix.biz
williamrobsonproperty.com website-datenbank.de
withstandingheartwarming.com winwotgold.pl
word-vorlagen.net wyniki-lista.pl
xn--b1addnj3cah.xn--p1ai x-lime.com
xn--c1acygb.xn--p1ai x-porno.video
xsion.net xaijo.com
xtrafficplus.com xjlottery.com
xuki.us xn----ctbbcjd3dbsehgi.xn--p1ai
yaoguangdj.com xn--h1aakne2ba.xn--p1ai
yebocasino.com xtubeporno.net
yes-com.com xxxtubesafari.com
you-shall-not-pass.is74.ru yellowproxy.net
youdesigner.kz yun56.co
youtubologia.it zastroyka.org
zakazvzloma.com zdesoboi.com
zaloro.com
zed21.net zed21.net
zetgie.com.pl zixizop.net.ru
zetmaster.ru zojirushi-products.ru
zigarettenonl.canalblog.com zoogdiesney.com
znakomstva-piter78.ru zoominfo.com
zolotoy-lis.ru zvezdagedon.ru
zootoplist.com
zrelaya.pw
zrizvtrnpale.tk

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.29 0; 10.1.1.63 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.11.3470 ### Version: V4.2022.11.3471
### Updated: Mon Nov 14 10:03:52 UTC 2022 ### Updated: Mon Nov 14 22:01:26 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.11.3470 ### Version: V4.2022.11.3471
### Updated: Mon Nov 14 10:03:52 UTC 2022 ### Updated: Mon Nov 14 22:01:26 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##