vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-05 04:00:13 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2022.10.3398 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2022-10-08 22:07:13 +00:00
parent 8f1894474a
commit 57c4504567
46 changed files with 92238 additions and 92238 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.10.3397 #### Version: V4.2022.10.3398
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.10.3397 #### Version: V4.2022.10.3398
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -14,7 +14,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2022.10.3397 #### Version: V4.2022.10.3398
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

11396
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2022.10.3397 #### Version: V4.2022.10.3398
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

11400
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

11400
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

11400
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

11400
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.43 1; 10.1.0.56 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.43 0; 10.1.0.56 0;
127.0.0.1 0; 127.0.0.1 0;

11400
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.43 1; 10.1.0.56 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.43 0; 10.1.0.56 0;
127.0.0.1 0; 127.0.0.1 0;

11400
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.43 1; 10.1.0.56 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.43 0; 10.1.0.56 0;
127.0.0.1 0; 127.0.0.1 0;

11400
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
3397 3398

11400
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

11400
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
13.84.129.97 0; 40.86.6.64 0;

11400
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.43 1; 10.1.0.56 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.43 0; 10.1.0.56 0;
127.0.0.1 0; 127.0.0.1 0;

11400
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.43 1; 10.1.0.56 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.43 0; 10.1.0.56 0;
127.0.0.1 0; 127.0.0.1 0;

11400
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.43 1; 10.1.0.56 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.43 0; 10.1.0.56 0;
127.0.0.1 0; 127.0.0.1 0;

11400
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
13.84.129.97 0; 40.86.6.64 0;

11400
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
13.84.129.97 0; 40.86.6.64 0;

11400
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.43 1; 10.1.0.56 1;
127.0.0.1 1; 127.0.0.1 1;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
80legs Atomseobot
Aboundexbot BLEXBot
CensysInspect Keybot Translation-Search-Machine
EroCrawler NetZIP
LinqiaMetadataDownloaderBot PHPCrawl
Litemage_walker SEOstats
NimbleCrawler Sqlworm
OnCrawl Toweyabot
PictureFinder Typhoeus
Sqlmap Web Sucker

300
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
01h4x.com 404enemy
360Spider ADmantX
ALittle Client ALittle Client
ASPSeek ASPSeek
Abonti
Acunetix
AhrefsBot AhrefsBot
Aipbot
Alligator
AlphaBot
Anarchy Anarchy
Anarchy99
Ankit Ankit
Anthill
Apexoo
Aspiegel Aspiegel
Atomseobot Asterias
AwarioRssBot
BDCbot
BDFetch BDFetch
BLEXBot
Backlink-Ceck
BacklinkCrawler
Bandit
Barkrowler
BatchFTP BatchFTP
BetaBot
Bigfoot Bigfoot
Blackboard Black Hole
BlowFish BlackWidow
Boardreader Boardreader
Bolt Bolt
CODE87 BuiltBotTough
CazoodleBot Bullseye
CensysInspect BuzzSumo
CheeseBot CCBot
CherryPicker Calculon
Citoid ChinaClaw
Cogentbot Chlooe
Copier Claritybot
Cliqzbot
Collector
CopyRightCheck
Cosmos Cosmos
CrunchBot CrazyWebCrawler
DSearch CyotekWebCopy
DBLBot
DTS Agent
DatabaseDriverMysqli DatabaseDriverMysqli
Devil Devil
Dirbuster Dirbuster
Disco
Discobot
Discoverybot Discoverybot
Dispatch DnBCrawler-Analytics
DittoSpyder DomainStatsBot
DomCopBot Domains Project
DomainCrawler
DomainSigmaCrawler
Dotbot Dotbot
Download Wonder Dragonfly
Drip EasyDL
Ebingbong Ecxi
EirGrabber
EroCrawler EroCrawler
Exabot Evil
Express WebPictures
ExtLinksBot ExtLinksBot
FlashGet ExtractorPro
Foobot EyeNetIE
FrontPage Firefox/7.0
Fuzz Flunky
FyberSpider FyberSpider
GermCrawler G-i-g-a-b-o-t
GetRight GetRight
GetWeb
Getintent Getintent
Gigabot Gigabot
Go-Ahead-Got-It
GoZilla GoZilla
Gotit Gotit
GrabNet
Grabber Grabber
Grafula
GrapeFX
GridBot
HEADMasterSEO HEADMasterSEO
HMView HMView
HTTP::Lite HTTP::Lite
HTTrack HTTrack
HaosouSpider
Havij
Heritrix Heritrix
Humanlinks Hloader
HybridBot HonoluluBot
IDBot IDBot
IRLbot IRLbot
Image Fetch Image Fetch
Image Sucker Indy Library
Intelliseek
InterGET
Internet Ninja Internet Ninja
InternetSeer
Jbrofuzz Jbrofuzz
Jyxobot Kenjin Spider
LWP::Simple
Larbin
LeechFTP LeechFTP
LeechGet LibWeb
Lftp Lipperhey Spider
Libwhisker Lmspider
LieBaoFast
LinkScan
LinkpadBot
LinqiaScrapeBot
Lipperhey
Ltx71 Ltx71
MFC_Tear_Sample MIIxpc
MSIECrawler
Mag-Net
MarkWatch
Masscan Masscan
Mb2345Browser MauiBot
MeanPath Bot
Mediatoolkitbot
MegaIndex.ru
Metauri
MicroMessenger MicroMessenger
Microsoft URL Control Microsoft Data Access
Minefield Mister PiX
Morfeus Fucking Scanner Mojolicious
Mr.4x3 Mr.4x3
Musobot Name Intelligence
NICErsPRO Nameprotect
Navroad Navroad
Net Vampire NearSite
NetLyzer Needle
NetMechanic NetAnts
NetZIP NetZIP
Nettrack
Netvibes
NextGenSearchBot
Nikto Nikto
Nimbostratus NimbleCrawler
Not Ninja
Nuclei Nuclei
Octopus Nutch
Offline Navigator
OnCrawl
OpenLinkProfiler OpenLinkProfiler
OpenVAS
Openfind Openfind
POE-Component-Client-HTTP OutclicksBot
Page Analyzer
PageAnalyzer
PageGrabber PageGrabber
PageScorer
PageThing.com PageThing.com
Panscient
Papa Foto Papa Foto
Petalbot Pavuk
Picscout
Picsearch
PleaseCrawl
Pockey Pockey
ProPowerBot
Probethenet Probethenet
Psbot
Pu_iN Pu_iN
PxBroker Pump
PyCurl
RSSingBot RSSingBot
Rankivabot RankFlex
RankurBot RankingBot2
Re-re Re-re
RealDownload
Reaper Reaper
RebelMouse
Recorder Recorder
RedesScrapy RedesScrapy
RepoMonkey RepoMonkey
Ripper Ripper
RocketCrawler Rogerbot
SBIder SBIder
SEOkicks-Robot SEOkicks
SEOprofiler SEOlyticsCrawler
SEOstats SEOstats
SISTRIX SISTRIX
ScanAlert
Scanbot Scanbot
ScoutJet
Screaming Screaming
ScreenerBot SearchmetricsBot
Searchestate SemanticJuice
Seekport Site Sucker
Semrush SiteExplorer
SentiBot SiteSucker
SeoSiteCheckup Siteimprove
SeobilityBot Snake
Siphon Snapbot
SiteCheckerBotCrawler Snoopy
Sogou web spider Sociscraper
Sosospider Sottopop
Spammen SpankBot
Spanner Spanner
Spinn3r Spbot
Sucuri Steeler
SuperHTTP Stripper
Surfbot Sucker
SurveyBot
Suzuran Suzuran
T0PHackTeam T0PHackTeam
T8Abot T8Abot
TeleportPro
Telesphorep
The Intraformant The Intraformant
TheNomad TheNomad
TightTwatBot
Toata Toata
Toweyabot Toweyabot
Tracemyfile
Trendiction Trendiction
Trendictionbot True_Robot
Turnitin Turingos
Twice Twice
URLy.Warning URLy.Warning
VidibleScraper Upflow
Vacuum
Vagabondo
VelenPublicWebCrawler
VeriCiteCrawler
VoidEYE VoidEYE
WWW-Collector-E Voltron
WWWOFFLE WWW-Mechanize
WeSEE WallpapersHD
Web Enhancer
Web Fetch Web Fetch
Web Fuck WebBandit
Web Pix WebCollage
Web Sauger
Web Sucker
WebCopier WebCopier
WebFuck WebFuck
WebImageCollector WebImageCollector
WebLeacher WebLeacher
WebZIP WebReaper
WebSauger
WebStripper
WebSucker
WebWhacker
Webalta
Webshag Webshag
Website Quester Website Quester
WebsiteQuester WebsiteExtractor
Webster Webster
Widow Whack
WiseGuys Robot Whacker
Whatweb
WinHTTrack
Wonderbot Wonderbot
Wotbox Wotbox
Wprecon
Xaldon_WebSpider Xaldon_WebSpider
Xenu Xenu
Zermelo ZmEu
ZoominfoBot ZumBot
ZyBorg ZyBorg
arquivo-web-crawler archive.org_bot
arquivo.pt arquivo.pt
backlink-check autoemailspider
cah.io.community
check1.exe
coccocbot coccocbot
crawl.sogou.com
crawler4j crawler4j
dataforseo.com
demandbase-bot demandbase-bot
evc-batch domainsproject.org
instabid gopher
internetVista monitor heritrix
ips-agent magpie-crawler
iubenda-radar netEstate NE Crawler
linkdexbot plumanalytics
lwp-request
meanpathbot
polaris version
probe-image-size probe-image-size
ripz ripz
s1z.ru
scalaj-http
scan.lol
seobility seobility
seoscanners seoscanners
seostar
sexsearcher
sitechecker.pro
sp_auditbot
spyfu spyfu
tAkeOut sysscan
trendiction.de trendiction.de
voyagerx.com webgains-bot
webpros.com
webprosbot
zauba.io
zgrab

294
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
80legs 80legs
ADmantX ADmantX
AIBOT AIBOT
ASPSeek ALittle Client
Aboundex Abonti
Aboundexbot
Acunetix Acunetix
AfD-Verbotsverfahren
AhrefsBot
Aipbot
Alligator Alligator
Anarchy
Apexoo
Asterias Asterias
BackDoorBot Atomseobot
BackStreet Attach
AwarioSmartBot
BDFetch
BackWeb BackWeb
Backlink-Ceck Backlink-Ceck
BacklinkCrawler Badass
Barkrowler
Bigfoot Bigfoot
Bitacle
Black Hole Black Hole
BlackWidow
Boardreader Boardreader
BotALot
Brandprotect Brandprotect
Brandwatch
Buddy Buddy
BuiltBotTough BuiltBotTough
CATExplorador Bullseye
CCBot BunnySlippers
CODE87 CSHttp
Cegbfeieh Calculon
CensysInspect CazoodleBot
CheTeam Chlooe
CheeseBot
Citoid Citoid
Claritybot
Cliqzbot
Cocolyzebot
Cogentbot
CopyRightCheck
Cosmos Cosmos
CrazyWebCrawler CrazyWebCrawler
Curious CrunchBot
Custo Custo
CyotekWebCopy CyotekWebCopy
DBLBot
DTS Agent
DataCha0s DataCha0s
DatabaseDriverMysqli Demon
Deusu
Devil Devil
Disco
Discoverybot
DittoSpyder DittoSpyder
DnyzBot DnBCrawler-Analytics
DomainSigmaCrawler
DomainStatsBot DomainStatsBot
Dotbot Drip
Dragonfly
EMail Wolf EMail Wolf
Ebingbong
Ecxi Ecxi
Express WebPictures EirGrabber
ExtLinksBot
Extreme Picture Finder
EyeNetIE EyeNetIE
FDM
FemtosearchBot FemtosearchBot
Firefox/7.0 Fimap
Flunky Flunky
Fuzz Foobot
GT::WWW Freeuploader
GetWeb Fyrebot
GalaxyBot
Go!Zilla Go!Zilla
GoZilla Go-Ahead-Got-It
Gotit Gotit
GrabNet
Grabber Grabber
Grafula HTTrack
GrapeFX Harvest
HTTP::Lite Heritrix
Haansoft
Hloader
HonoluluBot
HybridBot HybridBot
IDBot Iblog
IlseBot
Image Fetch Image Fetch
IndeedBot
InfoNaviRobot
InfoTekies InfoTekies
InterGET InterGET
InternetSeer Internet Ninja
Iria
Iskanie
IstellaBot IstellaBot
Jbrofuzz JOC Web Spider
Jetty
Joomla Joomla
Jorgee
Keybot Translation-Search-Machine Keybot Translation-Search-Machine
Keyword Density Kozmosbot
Kinza LNSpiderguy
Lanshanbot Leap
LeechFTP LeechFTP
LinkWalker LexiBot
Libwhisker
LieBaoFast
Lightspeedsystems
LinkScan
LinkextractorPro
LinksManager
LinqiaRSSBot LinqiaRSSBot
Lipperhey Spider LinqiaScrapeBot
Lipperhey
Ltx71 Ltx71
MQQBrowser MFC_Tear_Sample
MSFrontPage MSIECrawler
MTRobot MTRobot
Magnet
Mail.RU_Bot
Majestic SEO
Majestic-SEO
Majestic12
MarkWatch
Masscan Masscan
Mata Hari
Mb2345Browser Mb2345Browser
MeanPath Bot Meanpathbot
MegaIndex.ru Metauri
Microsoft URL Control
Minefield
Moblie Safari Moblie Safari
MolokaiBot MolokaiBot
Morfeus Fucking Scanner
Mozlila Mozlila
Mr.4x3 Musobot
Msrabot
NPbot NPbot
Name Intelligence
Nameprotect
Navroad Navroad
Needle
NetAnts
NetLyzer NetLyzer
NetMechanic NetMechanic
NetZIP
Netvibes Netvibes
NextGenSearchBot
Nikto Nikto
Nutch Nimbostratus
Not
Offline Explorer Offline Explorer
OnCrawl
OpenLinkProfiler
OpenVAS
OrangeSpider
OutfoxBot
PECL::HTTP
PHPCrawl PHPCrawl
PageAnalyzer POE-Component-Client-HTTP
PageGrabber
PageScorer PageScorer
Pandalytics Pandalytics
Papa Foto Petalbot
PeoplePal Pi-Monster
Picsearch Picsearch
PleaseCrawl Piepmatz
Pimonster
Pixray
ProPowerBot ProPowerBot
ProWebWalker Psbot
Probethenet PyCurl
Pump QueryN Metasearch
Quick-Crawler
RSSingBot RSSingBot
RankActive RankFlex
RankingBot
RankingBot2 RankingBot2
Recorder Re-re
RedesScrapy RealDownload
RebelMouse
RepoMonkey RepoMonkey
Rogerbot Ripper
SBIder SEOkicks-Robot
Screaming SEOprofiler
ScreenerBot SMTBot
ScrepyBot ScrepyBot
SearchmetricsBot Semrush
SemanticJuice SentiBot
SemrushBot SeobilityBot
Seomoz Seomoz
Siphon
SiteExplorer SiteExplorer
SiteSucker SiteLockSpider
Sitevigil Sitebeam
Siteimprove
SlySearch SlySearch
Snake Snake
Snapbot Snoopy
SocialRankIOBot SocialRankIOBot
Sociscraper Sociscraper
Sogou web spider SpaceBison
Sottopop
SpankBot
Spanner
Spbot
Spinn3r
Sqlmap Sqlmap
Sqlworm
Steeler Steeler
Stripper Stripper
Sucker Sucker
Surfbot Surfbot
Suzuran
Swiftbot
TeleportPro TeleportPro
Telesoft Telesoft
Telesphoreo
Telesphorep Telesphorep
The Intraformant Thumbor
TightTwatBot
Titan Titan
Toata Toata
TurnitinBot Trendictionbot
Twice
Typhoeus Typhoeus
URLy.Warning
VCI
Vacuum Vacuum
VeriCiteCrawler VelenPublicWebCrawler
Voltron VidibleScraper
VoidEYE
WASALive-Bot
WBSearchBot
WEBDAV
WISENutbot
WPScan WPScan
WWW-Collector-E
WWW-Mechanize WWW-Mechanize
Wallpapers/3.0 WWW::Mechanize
Web Fetch Wallpapers
WallpapersHD
WeSEE
Web Auto
Web Enhancer
Web Pix
Web Sucker Web Sucker
WebAuto WebAuto
WebCollage WebCollage
WebEnhancer WebEnhancer
WebFetch WebFuck
WebLeacher WebPix
WebZIP WebSauger
Webalta Website Quester
WebsiteExtractor WebsiteExtractor
WebsiteQuester WebsiteQuester
Widow Webster
Wotbox Whacker
Whatweb
WiseGuys Robot
Wonderbot
Xaldon_WebSpider
Xenu
Zade Zade
Zauba
Zeus
ZmEu ZmEu
ZoomBot
ZoominfoBot
ZumBot
ZyBorg
archive.org_bot
arquivo.pt arquivo.pt
cah.io.community backlink-check
clark-crawler
coccocbot coccocbot
cognitiveseo com.plumanalytics
crawl.sogou.com crawler4j
crawler.feedback dataforseo.com
domainsproject.org
evc-batch
facebookscraper facebookscraper
heritrix
internetVista monitor internetVista monitor
ips-agent ips-agent
magpie-crawler isitwp.com
linkdexbot
lwp-trivial
meanpathbot meanpathbot
mediawords mediawords
muhstik-scan
netEstate NE Crawler netEstate NE Crawler
pcBrowser oBot
polaris version plumanalytics
scan.lol scan.lol
seobility seobility
seocompany.store sexsearcher
seoscanners
seostar
sitechecker.pro sitechecker.pro
sp_auditbot sp_auditbot
trendiction.com tAkeOut
ubermetrics-technologies.com trendiction.de
webpros.com webmeup-crawler
xpymep1.exe x09Mozilla
zauba.io
zgrab

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
bbsoldes.fr babyfactory.fr
cb.iphantom.com custom-electric-guitar.com
dostavimvdom.ru cwetochki.ru
elite-sex-finders.com goodhumor24.com
homik.pw high-speed1.net
jpcycles.com threecolumnblogger.com
lecbter-relationships.ga tsstcorpcddvdwshbbdriverfb.aircus.com
obiavo.com vellings.info
remont-mobile-phones.ru vip.51.la
zetgie.com.pl zscalertwo.net

922
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
1-99seo.com 1008.su
108shot.com
11235813.webzdarma.cz 11235813.webzdarma.cz
123movies.love 123any.com
12bet.com 123locker.com
1314dh.com 2000k.ru
178evakuator178.ru 214jaluwobapef.cf
1hwy.com 2itech.ru
1pamm.ru 4replicawatch.net
28n2gl3wfyb0.ru 4webmasters.org
2rich4bitches.com 5elementov.ru
5kstore.com
5ws.dating-app.ru
7makemoneyonline.com 7makemoneyonline.com
9icmzvn6.website 8558l.jobs.net
a.frcls.fr 991mostfm.co.id
aa9bd78f328a6a41279d0fad0a88df1901.com 9med.net
aab94f698f36684c5a852a2ef272e031bb.com aarbur.com
abovetherivernc.com aasoldes.fr
abwa.tk abcdeg.xyz
acortarurl.es abtasty.com
adclickservice.com acc.eu.org
adelly.bg adinterax.com
adexprts.com
adminshop.com
adobereader-free.ru adobereader-free.ru
adsland.men adpremium.org
adtech.us adventureparkcostarica.com
advertisingtag.net adverster.com
adviceforum.info affiliate-fr.com
affordablewebsitesandmobileapps.com ageofclones.com
agecheckadult.com aghanyna.com
alert.scansafe.net albamargroup.com
alevinefesleri.com albuteroli.com
alienwheel.es alert-fjg.xyz
all4wap.ru alive-ua.com
allbizne.co.ua allbizne.co.ua
allnews.md alot.com
amateurmatch.com ameblo.jp
amehdaily.com anabolics.shop
amigobulls.com animaltoplist.com
amospalla.es anime.dougasouko.com
anatomiy.com animenime.ru
angel1777.kz apifasterlightin-a.akamaihd.net
animebox.com.ua apiholdingmypage-a.akamaihd.net
ap.senai.br apple.com-cleaner.systems
apioutoboxnet-a.akamaihd.net aproposde.com
apiqualitinknet-a.akamaihd.net arabseyes.com
arabgirls.adultgalls.com
arenanews.com.ua arenanews.com.ua
aruplighting.com arenda-yeisk.ru
as5000.com arendatora.ru
asmxsatadriverin.aircus.com
asseenontv.ru asseenontv.ru
aviapanda.ru auto-zapchasti.org
avtolombard-krasnodar.com autobudpostach.club
awency.com autodo.info
bablonow.ru autoloans.com
bannerads.de autotop.com.ua
bavsac.com backlinkwatch.com
bbtec.net badavit.com.ua
beachdriveblog.com baksman.com
beachpics.com balkanfarma.org
berrymall.ru battle.net
best-games.today bcmp.org
bestkfiledxd.cf beauby.ru
besttorrentknifta.weebly.com bedcapdealers.com
bestwrinklecreamnow.com belsetirehafi.tk
betterscooter.com best-way.men
bezsporno.ru besthomemadepornsites.com
big-boards.info bestmarriages.com
big-cash.net bestwaystogetpaid.us
bigames.online betune.onlinewebshop.net
bigcities.org biketank.ga
bimmerpost.com bildsuche.ru
bimatoprost-careprost.com.ua
biographiya.com
bird1.ru bird1.ru
bitnote.co blockworld.ru
bitporno.sx bloggedporn.com
blog.yam.com bluesalt.co
bobinoz.com bmsco.co
boleznikogi.com bonzybuddy.com
bolezniorganov.ru
bolitgorlo.net
bookhome.info
boostmyppc.com boostmyppc.com
bracketsmackdown.com brewdom.ru
brainboosting.club brothers-smaller.ru
break-the-chains.com buehne-fuer-menschenrechte.de
brg8.com bumskontakte.org
bristolhostel.com buntube.net
btnativenav.com bvlgaribracelet.xyz
builtwith.com c-english.ru
buy-meds24.com carsdined.org
buytizanidineonline.blogspot.com casinopinup-wins.com
callawaygolfoutlet.online changde.58.com
camdolls.com chatroulette.online
canacopegdl.com cheapcigarettesc.info
carloans.com cheapjerseysa.com
carmuffler.net cheapmarmot.online
carrauterie.be cheapmoncler.xyz
cars-modification.net cheapsergiorossi.online
carstrends2015.com chinacheapelitejerseys.com
cartierring.xyz cienum.fr
certifywebsite.win clash-clans.ru
cgi2.nintendo.co.jp cleanallspyware.com
chatroulette.video clickbank.net
checkpagerank.net com-secure.download
chinajerseyswholesalecoupons.com compliance-nelson.top
chocolateslim-original.com coolyarddecorations.com
choosecuisine.com copro.pw
cl.s7.exct.net counciltally.com
clean-virus-mac.com countbertwistdisp26.soup.io
clicksor.com crackguru.tk
clmforexeu.com
coin-hive.com
comeondog.info
compliance-barak.xyz
compliance-jane.top
concealthyself.com
contentsexpress.com
cookie-law-enforcement-ff.xyz
cool-wedding.net
cordstrap.cc
covadhosting.biz
cranly.net cranly.net
cubs-jerseys.us crd.clan.su
culturevie.info creditmoney.com.ua
cutalltheshit.com cubook.supernew.org
cymbaltaandtizanidine.blogspot.com customcollegeessays.net
cypernhuset.se czeshop.info
dangphoto.trade dailyfinancefix.com
daooda.com damasarenai.info
dating-time-now.com data.vtc.pw
davebestdeals.com deadlinkchecker.com
defenderxtactical.com deluxedumps.com
dinkolove.ya.ru detmebel.su
dirtpics.pw deutschland123.de
dev-seo.blog
digitalfaq.com
divku.ru
dmmspy.com
dms-sw.ru
dneprsvet.com.ua
dnsrsearch.com
docstoc.com
dolohen.com
dominterior.org dominterior.org
domznaniy.ru driving.kiev.ua
dotnetdotcom.org drunkenstepfather.com
druzhbany.ru dtnlyss.com
eager-nash.188-93-233-196.plesk.page easytuningshop.ru
earncash.com.ua editors.choice6912650.hulfingtonpost.com
ebonyporn.site ee77ee.com
elektrischezigarette2.devhub.com ekobata.ru
elektrischezigarette2.onsugar.com elite-sex-finders.com
en.altezza.travel elkacentr.ru
engines-usa.com energydiet24.ru
englate.com englate.com
eorogo.top erotik-kostenlos.net
erotik0049.com escortplius.com
es5.com eu-cookie-law.blogspot.com
excitacao.com eurosamodelki.ru
f07.de exmasters.com
fandlr.com extrabot.com
fanrto.com ezigarettekaufen2.mpbloggar.se
faptitans.com ezigarettenkaufen1.deviantart.com
farm26.ru faithe.top
fakehandbags.xyz
falllow.gq
faracontrol.ir
fastcrawl.com
fatmaelgarny.com
faz99.com faz99.com
femmesdenudees.com fba-mexico.com
filmi-onlain.info fellowshipoftheminds.com
finteks.ru fifa-coins.online
fireads.men filmetricsasia.com
firma-legion.ru firstsiteguide.com
fivedwld.cf fitness-video.net
flashlarevista.com fix-website-errors.com
flooringinstallation-edmonton.com flagcounter.me
floridamhca.org flauntyoursite.com
focalink.com foto-basa.com
fortevidyoze.net foxinsocks.ru
foxjuegos.com fres-news.com
freenom.link fugarif.ga
freeseedsonline.com fxgallery.com
freewlan.info gagrasector.ru
fun2cell.net gallerylisting.com
gameprimary.com gambarkatabaru.com
gamevalue7.weebly.com gambarxkata.co
garciniaxt.us gamerscorps.com
gamesprite.me
gay-site.store gay-site.store
ge0ip.com gazporno.com
ge0ip.net
generic-pills-online.com
gepezz.info
get-seo-domain.com
getlaid-xxxhookupdirect.com
getmiro.com
given2.com given2.com
globatur.ru gojiberriess.apishops.ru
goblacked.com gok-kasten.net
goodprotein.ru googlemare.com
googleseo.com.tr gotwebsite1.com
googlsucks.com gratuitxblcodes.com
gopro-online.info greenzaim.ru
gratis-sexkontakte.com grupografico-pilar.com.ar
greatgrace.ru gsmtlf.ru
growboxbl.ru guitar-master.org
gsou.cf gyffu.com
guarrasdelporno.xxx hackers-crackers.tk
guge.io hayate.biz
guildebzh.info hdwalls.xyz
hahashka.ru heartofbeijing.blogspot.com
handicapvantoday.com hitcpm.com
hanwei.us homik.pw
havepussy.com hotblognetwork.com
hchha.com hotxnights.info
hdimagelib.com housekuba.org
hdseriale.pl houston-vikings.com
hdwallpapers-free.com hoverboard360.at
health-medical-portal.info howlongdoestizanidinestayinyoursystem.blogspot.com
heliko.no huhn.altervista.org
high-speed1.net hustoon.over-blog.com
histats.com igadgetsworld.com
homeandhealth.ru images.gyffu.com
homedecoguide.info imagine-ex.co
hostcritique.com imitex-plus.ru
htmlcorner.com inboundlinks.win
hully.altervista.org incomekey.net
hyhj.info indiasourcemart.in
idc.com.ua infazavr.ru
idegenvezeto.eu inmate-locator.us
igrovyeavtomaty777.ru intellego.info
imediadesk.com intim-uslugi.info
img.wallpaperstock.net irkutsk.online-podarki.com
imicrovision.com irkutsk.zrus.org
impisr.edunsk.ru iscblog.info
incep.imagine-ex.co isitwp.com
insurple.com iskalko.ru
interesnie-faktu.ru istanbulit.com
interfucks.net iweblist.info
investsuccess.org javspace.net
iphantom.com jewelryandfiligree.com
iplusbit.blogspot.co.za job.icivil.ir
iron-age.info joingames.org
isotoner.com jrpmakati.com
ispac.org justdating.online
iusstf.org kaac.ru
izoll.ru kalb.ru
javitas.info
jobgirl24.ru
joyceblog.top
junglenet-a.akamaihd.net
jurajskie.info
justkillingti.me
kanimage.com kanimage.com
kareliatobacco.ru kemerovo.zrus.org
kaz.kz ketoanhanoi.info
keyword-suggestions.com
keywordglobal.co.za keywordglobal.co.za
kihi.gdn
kimcurlrvsms.com kimcurlrvsms.com
kinohit1.ru kinomaniatv.pl
kinozapas.org kinostorm.net
kiprinform.com kiskinhouse.com
kladrus.ru kiwi237au.tk
klitimg.pw knigonosha.net
kredit-pod-zalog-krasnodar.ru kongruan.com
kurbappeal.info krasnodar-avtolombards.ru
kutikomi.net
kvartiry-remont.ucoz.ru
labelwater.se labelwater.se
laulini.soclog.se lacloop.info
law-check-eight.xyz landscaping.center
lankarns.com
lechenie-gemorroya.com lechenie-gemorroya.com
ledis.top lennatin.info
life.biz.ua letto.by
linkpulse.com liupis.com
live-sexcam.tk
livefixer.com
liverpool.gsofootball.com liverpool.gsofootball.com
lkbennettstore.online livesex-amateure.info
lmrauction.com louboutinreplica.pw
localflirtbuddies.com luckyday.world
locksmith.jp lyrster.com
lombardfinder.ru
lomza.info
louisvuittonoutletstore.net
lovi-moment.com.ua
lsp-awak-perikanan.com
lubetube.com
m292.info m292.info
macfix.life macdamaged.tech
make-money-online.com mackeeper-land-672695126.us-east-1.elb.amazonaws.com
mamasuper.prom.ua magazintiande.ru
magicalfind-a.akamaihd.net
maglid.ru
malwareremovalcenter.com
marblestyle.ru
marcowebonyodziezowe.pl marcowebonyodziezowe.pl
marktforschung-stuttgart.com maximpartnerspr.com
master-muznachas.ru medispainstitute.com.au
maximilitary.ru mensandals.xyz
mcar.in.ua mesbuta.info
me-ke.com mhtr.be
mecash.ru mini-modus.ru
mesto-x.com mirtorrent.net
meteostate.com mirzonru.net
midst.eu mister-shop.com
minet.club mnogabukaff.net
mobplayer.ru mockupui.com
money-for-placing-articles.com morepoweronmac.trade
moviemail-online.co.uk moscow-region.ru
mototsikl.org
mrmoneymustache.com mrmoneymustache.com
music7s.me mrwhite.biz
muz-tracker.net mundoaberrante.com
muztops.ru musicdaddy.net
mycouponizemac.com mwtpludn.review
mylesosibirsk.ru mydownloadengine.com
na-telefon.biz mydownlodablefiles.com
narkologiya-belgorod.ru myfreetutorials.com
narkologiya-peterburg.ru mygameplus.com
negral.pluto.ro myhealthcare.com
neobux-bg.info myindospace.com
netvouz.com mymobilemoneypages.com
nevansk.ru nacap.ru
nfljerseyscheapchinabiz.com netallergy.ru
nhl17coinsforps3.gratisblog.biz networkcheck.xyz
nightvision746.weebly.com newstudio.tv
nikitsyringedrivelg.pen.io nomuos.it
novosibirsk.xrus.org nyfinance.ml
o-dachnik.ru
o-o-6-o-o.com o-o-6-o-o.com
offtime.ru odywpjtw.bloger.index.hr
oklogistic.ru oklogistic.ru
okroshki.ru
onclickpredictiv.com onclickpredictiv.com
online-x.ru onlinadverts.com
online247.ml onlinemeetingnow.com
onlinefilmz.net onlythegames.com
ons-add.men orhonit.com
onstrapon.purplesphere.in ostroike.org
openfrost.com ozas.net
optitrade24.com paidonlinesites.com
oranga.host.sk pateaswing.com
park.above.com pc4download.co
partner-pop.men pcads.ru
partnerline.men pdamods.ru
pdn-4.com peekyou.com
pdns.cz photochki.com
perso.wanadoo.es photosaga.info
phelissota.xyz picturesify.com
piccshare.com pinkduck.ga
picsforkeywordsuggestion.com pio.polytopesexempt.com
pihl.se
pinapchik.com
piter.xrus.org piter.xrus.org
pizza-tycoon.com pix24x7.com
pl-vouchers.com pizda.lol
plastgran.com pizdeishn.com
polimga.pw platinumdeals.gr
popup-fdm.xyz playlott.com
porno-chaman.info poiskzakona.ru
porno.simple-image.com.ua popserve.adscpm.net
pornogig.com porno-home365.com
pornolook.net pornophoto.xyz
porto.abuilder.net pornotubs.com
poshiv-chehol.ru prefersurvey.net
potoideas.us pregnant.guru
powc.r.ca.d.sendibm2.com printingpeach.com
pozdravleniya-c.ru
preconnubial.usuby.site
preparevideosafesystem4unow.site
preparevideosafesystem4unow.space
printie.com
prizesbook.online
prizestohandle.club
professionalwritingservices15.blogspot.ru professionalwritingservices15.blogspot.ru
profitkode.com promodj.com
profitwithalex.info psa48.ru
promoforum.ru pushdata.sendpulse.com
queerspace.com pussyspace.net
quickbuck.com puteshestvennik.com
rada.ru putitin.me
rank-checker.online qcstrtvt.bloger.index.hr
quickcashlimited.com
rainbowice.ru
rankings-analytics.com rankings-analytics.com
recordpage-a.akamaihd.net recordpage-a.akamaihd.net
remont-comp-pomosh.ru redhotfreebies.co.uk
remontbiz.ru regionshop.biz
reversing.cc relatodelpresente.com.ar
rfd-split.hr rennlist.com
rialp.getenjoyment.net ribieiendom.no
rockma.se rixpix.ru
royalvegascasino.com rockprogblog.com
rvi.biz rp9.ru
saltspray.ru ruclicks.com
sarafangel.ru running-line.ru
saratov.xrus.org runstocks.com
sardinie.us rus-teh.narod.ru
sawin.beth.webd.pl sadaholding.com
sbricur.com saitevpatorii.com
sbwealthsolutions.ca sammlungfotos.online
schalke04fc.info sanidumps.com
score-ads.men scanner-donald.top
searchaddis.com scripted.com
searchencrypt.com sdi-pme.com
searchengineranker.email searchkut.com
seminarygeorgia59.ga seccioncontrabajo.com
seorankinglinks.com secretscook.ru
serdcenebolit.com securesmrt-dt.com
sex-tracker.com semxiu.com
sex-tracker.de seofied.com
sexfreepornoxxx.com seokicks.de
sextracker.be serptehnika.ru
sexxdate.net sex-watch.com
sexyali.com sexad.net
sharebutton.to shikiso.info
shemalegalls.blogporn.in shisha-swag.de
shiksabd.com shitting.pro
shivafurnishings.com
shtaketniki.kz
sildenafilcitratemed.com
simpoed.ufop.br simpoed.ufop.br
simul.co sisi-go.ru
site-analyzer.com sizeplus.work
skachat-besplatno-obrazcy.ru slavic-magic.ru
slimcdn.com snip.to
slomm.ru sobecjvuwa.com.ru
smallseotools.com social-s-ggg.xyz
smstraf.ru soft-program.com
soc-econom-problems.ru softlinesolutions.me
social-s-iii.xyz songplanet.ru
space4update.pw souvenir.cc
spl63.fr spacash.com
spywareit.com spammen.de
special-porn.com
spywarenuker.com
spywarespy.com spywarespy.com
staff.prairiesouth.ca stard.shop
stillmiracle.com streamin.to
stoki.ru stroilka.info
stopnarco.ru stroiminsk.com
stuff-about-money.com strongholdsb.ru
stuffpride.com
sucsesofinspiration.com
sugarlyflex.pw sugarlyflex.pw
supermodni.com.ua support.nopeas.sk
superoboi.com.ua surffoundation.nl
surfbuyermac.com svarbit.com
surflinksmedical.com svetlotorg.ru
susanholtphotography.com swsociety.se
sweepstakes.rewardit.com syvertsen-da.no
syndicate.fun tabletkinaodchudzanie.com.pl
tastyfoodideas.com telefonsex-ohne0900.net
taximytishi.ru testingads.pro
td-l-market.ru theallgirlarcade.com
tds-advert002.info thebestphotos.eu
tedxrj.com thepokertimer.com
teguh.info timer4web.com
telefonsexsofort.tk tizanidinehydrochloride2mg.blogspot.com
tizanidinedosageforsleep.blogspot.com tizanidinerestlesslegsyndrome.blogspot.com
tizanidinehcl4mgtablet.blogspot.com tizanidinevscyclobenzaprine.blogspot.com
tizanidinesideeffectsweightloss.blogspot.com tjkckpytpnje.com
tmearegion26.com tnaionline.org
toloka.hurtom.com toloka.hurtom.com
tomatis.gospartner.com tomatis.gospartner.com
tooplay.com topquality.cf
top1-seo-service.com track112.site
top10-online-games.com track2.shop
top10registrycleaners.com trafficreceiver.club
topappspro.com trafficstars.com
topkarkas.com trahic.ru
toproadrunner5.info truck-rece.life
trafficgenius.xyz tuberkulezanet.ru
trafficjunky.com tubo360.com
triumf-realty.ru twelvevisionspartyofcolorado.com
turist-strani.ru twiclub.in
twittruth.com tx41tclega.ru
uchetunet.su txxx.com
ukr-lit.com uchebavchehii.ru
ukrobstep.com udsgame.online
univerfiles.com uginekologa.com
url2image.com ukrtextbook.com
utrolive.ru uptime-gamma.net
valmetrundan.se uptimechecker.com
valueclick.com upupa.net
vegan-foods.us urengoy.pro
videochat.bz url-img.link
vigrx-original.ru urlopener.com
vikistars.com userequip.com
uvozdeckych.info
valsalud.com
vapeface.club
venerologiya.com
vesnatehno.com
vesnatehno.ru
video-production.com
videochat.cafe
videochat.mx
videochat.ph
vietimgy.pw
vipps.com.my
visa-china.ru visa-china.ru
visionwell.com.cn visa-pasport.ru
vkak.ru vita.com.hr
vkgaleria.com vkonche.com
vriel.batcave.net vksex.ru
vvon.co.uk volgograd.xrus.org
wallpapersist.com vse-pesni.com
waycash.net vysigy.su
watracker.net
webshoppermac.com
website-analyzer.info
website-speed-checker.site website-speed-checker.site
websiteaccountant.de wejdz-tu.pl
whatsappbot.flyland.ru wheelchairliftsarea.com
wholesalejerseys-cheapest.com wineration.com
wikes.20fr.com wjgony.com
witclub.info world-mmo.com
wordpresscore.com ww2awards.info
worldhistory.biz www.888.com
worldlovers.ru www.jbetting.com
ww1943.ru xmladserver.com
x-diesel.biz xmlinde.com
x5market.ru xn-----7kceclhb4abre1b4a0ccl2fxch1a.xn--p1ai
xjrul.com xn----8sblgmbj1a1bk8l.xn----161-4vemb6cjl7anbaea3afninj.xn--p1ai
xn------7cdbapdecfd4ak1bn0amjffj7afu3y.xn--p1ai xn----9sbubg3ambdfl1j.xn--p1ai
xn----8sbarihbihxpxqgaf0g1e.xn--80adxhks xn--1-8sbcpb0bdm8k6a.xn--p1ai
xn--24-glceagatoq7c2a6ioc.xn--p1ai xn--80aanaardaperhcem4a6i.com
xn--80ajbshivpvn2i.xn--p1ai
xn--e1afanlbnfckd7c3d.xn--p1ai xn--e1afanlbnfckd7c3d.xn--p1ai
xsion.net xsion.net
xtube.com yhit.press
xxxnatelefon.ru youtoner.it
youjizz.vc youtubedownload.org
yourserverisdown.com zaimhelp.ru
yuweng.info zakonobosago.ru
zaim-pod-zalog-krasnodar.ru zapiszto.pl
zakon-ob-obrazovanii.ru zetmaster.ru
zigarettenonlinekaufen2.drupalgardens.com zlatnajesen.com
zolotoy-lis.ru znaturaloriginal.com
zvuker.net zoomovies.org
zoosexart.com
zrelaya.pw

472
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
000free.us 1webmaster.ml
178evakuator178.ru adclickthru.net
3w24.com addblueoff.com.ua
4webmasters.com adf.ly
5tey7463.weebly.com adloads.net
7fon.ru agahinameh.com
absolute-s.ru ahrntal.verymes.xyz
adconscious.com amazingninja.com
addtoadd.men amung.us
adsref.men
advertex.info
akita.kz
alkoravto.ru
allesohnegirls.net
anabolics.shop
aosexkontakte.net aosexkontakte.net
appsecurityr.com approved.su
arabgirls.adultgalls.com arquivo.pt
arate.ru atlasvkusov.ru
arcteryxsale.online atout-energie-69.com
autoblogger24.info autoseo-traffic.com
avkzarabotok.info aversis.net
avtocredit-legko.ru aviav.co
avtointeres.ru azarttoto.com
battle.net balla-boo.se
beremenyashka.com beauty-b0x.pl
besthomemadepornsites.com bensbargains.net
betshuckclean.com best-businessman.ru
blackhatworth.com bio.trade-jp.net
breastaugmentation.co.za bitcoinremote.com
biteg.xyz
bloke.com
bongacams.com
braintobe.win
brateg.xyz
bristolhostel.com
bristolhotel.com.ua bristolhotel.com.ua
bugof.gq celebsopics.com
buy-forum.ru cfjump.com
cercacamion.it cfsrating.sonicwall.com
cfacarrosserie74.com chlooe.com
christianlouboutinshoes.xyz clean-start.net
cinemaenergy-hd.ru cobaltpro.ru
clayvasedesigns.tk compliance-george.top
clickcash.com compliance-jane.top
coindirect.io compliance-jessica.top
connectingsingles.com
costablue.xyz costablue.xyz
crest-poloski.ru countbertwistdisp26.soup.io
dawlenie.com cowblog.fr
decenttools.com creditnation.ru
djonwatch.ru crest3d.ru
docs4all.com cubook.supernew.org
download-wallpaper.net customcatchcan.com
downloader12.ru cvety24.by
drev.biz daretodonate.co
dvr.biz.ua dealighted.com
elektrischezigarettekaufen2.cowblog.fr defenderxtactical.com
elektronischezigarette2.mex.tl deluxedumps.com
englishgamer.com dfiles.me
eropornosex.ru disruptingdinnerparties.com
everflora.ru djihispano.com
extremal-blog.com domaineaneblanc.com
fast-wordpress-start.com drillsaw.ru
fba-mexico.com duawitchrarato.tk
fellowshipoftheminds.com elektrozigarette2.wordpressy.pl
ferieboligkbh.dk elektrozigarettekaufen1.devhub.com
filmidivx.com emergencyneeds.org
find1friend.com en.altezza.travel
finejewelryshop.ru escortplius.com
flowersbazar.com evaashop.ru
fok.nl fickkontaktehobbyhuren.com
firma-legion.ru
florida-tourism.net
forexunion.net
forpostlock.ru forpostlock.ru
gambarkatabaru.com freegamesplay.online
gameonasia.com freza-sverlo.ru
gamerscorps.com fuckmill.com
gateway.zscalerone.net fungirlsgames.net
g33.org
gambarkataku.co
gamingspark.com
gdcentre.ru gdcentre.ru
generalporn.org go2mike.ru
gidonline.one golden-catalog.pro
gilsonchiro.xyz goo.ne.jp
glicol.kz greatgrace.ru
goatse.ru greenshop.su
googglet.com growshop.es
guardlink.com hao123.com
hauleddes.com hauleddes.com
healgastro.com hdseriale.pl
herokuapp.com heartofbeijing.blogspot.com
heygidday.biz heygidday.biz
histock.info home.myplaycity.com
hitsbox.info hotel-mkad.ru
hostsshop.ru hotxnights.info
howopen.ru
husky-shop.cz
iblogpress.xyz
ifmo.ru ifmo.ru
immigrational.info ikritikimou.gr
inmate-locator.us iloveitaly.ru
iqbazar.ru infokonkurs.ru
istmira.ru istock-mebel.ru
iusstf.org itservicesthatworkforyou.com
japfm.com javcoast.com
jerseyssportsshop.com jerseyswholesalechinalimited.com
job.icivil.ir jetsli.de
katadhin.co jjbabskoe.ru
keywordsking.com jmat.cn
kino-ecran.ru joingames.org
kiprinform.com kadashihotel.com
konoplisemena.com kakadu-interior.com.ua
kopihijau.info kaliningrad.zrus.org
kursy-ege.ru kandidos.com
kvartir-remont.biz keywordsdoctor.com
ladsblue.com kinosed.net
lafriore.ru klejonka.info
lankarns.com kndxbkdx.bloger.index.hr
lazymanyoga.com konteiner24.com
letto.by krasnodar.xrus.org
liffa.ru landmania.ru
lionking-1994.blogspot.com landoftracking.com
liveinternet.ru legionalpha.com
liveshoppersmac.com lemon-ade.site
loadopia.com lernur.net
lollypopgaming.com liran-locks.com
louboutinreplica.xyz livetsomudvekslingstudent.bloggersdelight.dk
lunamedia.co loginduepunti.it
mac-shield.com longlifelomilomi.info
makis.nu lostaruban.com
marblestyle.ru lsp-awak-perikanan.com
marinetraffic.com luciddiagnostics.in
maximpartnerspr.com magento-crew.net
mediafresh.online maranbrinfo.com.br
mobot.site masthopehomes.com
mossmesi.com medicine-4u.org
moyakuhnia.ru medmajor.ru
music7s.me meduza-consult.ru
naperehresti.info mexicosleevegastrectomy.com
narkologiya-belgorod.ru mirmedinfo.ru
nastydollars.com morf.snn.gr
naughtyconnect.com moscow-region.ru
new-apps.ru moskva.nodup.ru
nottyu.xyz movies-in-theaters.net
obiavo.net mvpicton.co.uk
offer.camp mykings.pw
offtime.ru myliveblog.ru
okayimage.com mymobilemoneypages.com
okonich.com.ua mysex21.com
old-rock.com naval.jislaaik.com
onclkads.com netvouz.com
ooo-gotovie.ru npoet.ru
pathwhelp.org nufaq.com
pc-virus-d0l92j2.pw obiavo.com
pdns.cz oda.as
picturesboss.com onthemarch.co
picturesfrom.com oyster-green.com
pihl.se partner-trustworthy.men
piluli.info percin.biz.ly
polimga.pw picscout.com
poppen-nw.net plugingeorgia.com
popcash.net
poptool.net poptool.net
pornokajf.com porno-raskazy.ru
pornpost.in portside.xyz
priceg.com positive2b.ru
priora-2.com pregnant.guru
privacylocationforloc.com privatamateure.com
prostitutki-astana.org profitkode.com
prostitutki-kharkova.org proftests.net
qpypcx.com progress-upakovka.ru
questionmarque.ch pskcijdc.bloger.index.hr
rating-casino2021.ru puteshestvennik.com
recipedays.com puzo2arbuza.ru
reckonstat.info ranksonic.com
redbottomheels.xyz razleton.com
ritlweb.com refads.pro
rootandroid.org registrydomainservices.com
russia-tao.ru reining.lovasszovetseg.hu
rvtv.ru
sad-torg.com.ua sad-torg.com.ua
sandhillsonline.com sammyweaver.com
santechnik.jimdo.com saveriopiazza.it
saratov.xrus.org scanner-jessica.top
sbetodiodnye-lampy.ru scanner-julia.top
sc-specialhost.com schalke04fc.info
scanner-alexa.top segol.tv
scanner-jack.top seo-tools-optimizing.com
scanner-josh.top seo-traffic-ranking.info
seminarykansas904.ml seolab.top
sex-tracker.com sexkontakteao.info
sex-znakomstva.online
sexs-foto.top
sexyebonyteen.com
sharebutton.net sharebutton.net
sharebutton.to sharebutton.to
shinikiev.com.ua
shodanhq.com shodanhq.com
shohanb.com sitopreferito.it
shtaketniki.ru skachat-besplatno-obrazcy.ru
simplepooltips.com
skypasss.com
skytraf.xyz skytraf.xyz
smailik.org slavic-magic.ru
smokewithrabbits.com slayerlife.com
sneakyboy.com slim.sellany.ru
social-s-iii.xyz slowmac.tech
space2019.top smart-scripts.com
startufa.ru soft-terminal.ru
stauga.altervista.org softtor.com
strongsignal-a.akamaihd.net space4updating.win
stroyhelp-dv.ru spasswelt.net
studiofmp.com sr-rekneskap.no
sukarame.net stairliftsarea.com
swinon.site stroymonolit.su
telefonsexsofort.tk strv.se
thedownloadfromwarez.blogspot.com svarbit.com
thefds.net tarad.com
tizanidineandgabapentin.blogspot.com td-l-market.ru
tizanidinecost.blogspot.com thedownloadfreeonlinegames.blogspot.com
tizanidinedruginteractions.blogspot.com thejournal.ru
tizanidinehydrochloride2mg.blogspot.com thepornsex.org
tour-line.net tizanidine4mguses.blogspot.com
track2.shop tizanidinesideeffects.blogspot.com
traffic100.com tomatis.gospartner.com
trailer.cinemaflix.website topcasinoratings.ru
trkdf.com tri-slona.org
trustedmaccleaner.com trichizobswiv.agddns.net
turizmus.us trustaffs.com
udsgame.online uchetunet.su
uggbootsoutletsale.us uptime-alpha.net
ukkelberg.no urlopener.com
unacittaconte.org valkiria-tk.ru
universals.com.ua vapsy.com
validdomain.xyz vavilone.com
vashsvet.com viagra-soft.ru
viagroid.ru viagra.pp.ua
viddyoze.com videochat.bz
videochat.life videotuber.ru
videochat.tv.br villacoloniale.com
vitanail.ru vkak.ru
vkmusics.ru vod.com.ua
web.cvut.cz vostoktrade.info
website-stealer.nufaq.com vsexkontakte.net
whatistizanidine2mg.blogspot.com vzube.com
winterclassichockeyjerseys.com wallpapersdesk.info
withstandingheartwarming.com warningwar.ru
wsgames.ru waysbetter.cn
xbaboon.com webcamdevochka.com
xchangetrak.com webcamtalk.net
xfire.com webkeyit.com
xn----7sbaaabaei0cc8aj5bj0bncejx.xn--p1ai website-analytics.online
xtremeeagles.net whipme.yopoint.in
xzlive.com wygraj-teraz.com
yellowfootprints.com xmnb.net
yellowstonesafaritours.com yourtemplatefinder.com
yellowstonevisitortours.com yugk.net
youbloodyripper.com zigarettenonlinekaufen1.blox.pl
youdao.com zog.link
yuweng.info
zarabotat-na-sajte.ru
zeroredirect6.com
zigarettenonlinekaufen2.bloog.pl
zixizop.net.ru
zrelaya.pw

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.43 0; 10.1.0.56 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.10.3397 ### Version: V4.2022.10.3398
### Updated: Sat Oct 8 10:03:25 UTC 2022 ### Updated: Sat Oct 8 22:01:19 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.10.3397 ### Version: V4.2022.10.3398
### Updated: Sat Oct 8 10:03:25 UTC 2022 ### Updated: Sat Oct 8 22:01:19 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##