vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-04 19:50:17 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2021.10.2658 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2021-10-18 10:18:37 +00:00
parent 492e0b2273
commit 1b74c27192
46 changed files with 70563 additions and 70563 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2021.10.2657 #### Version: V4.2021.10.2658
#### Bad Referrers Blocked: [7078](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7078](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [623](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [623](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2021.10.2657 #### Version: V4.2021.10.2658
#### Bad Referrers Blocked: [7078](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7078](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [623](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [623](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -11,7 +11,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2021.10.2657 #### Version: V4.2021.10.2658
#### Bad Referrers Blocked: [7078](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7078](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [623](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [623](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

8686
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2021.10.2657 #### Version: V4.2021.10.2658
#### Bad Referrers Blocked: [7078](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7078](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [623](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [623](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

8690
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

8690
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

8690
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

8690
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.230 1; 10.1.1.85 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.230 0; 10.1.1.85 0;
127.0.0.1 0; 127.0.0.1 0;

8690
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.230 1; 10.1.1.85 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.230 0; 10.1.1.85 0;
127.0.0.1 0; 127.0.0.1 0;

8690
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.230 1; 10.1.1.85 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.230 0; 10.1.1.85 0;
127.0.0.1 0; 127.0.0.1 0;

8690
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
2657 2658

8690
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

8690
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.69.103.231 0; 52.186.140.21 0;

8690
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.230 1; 10.1.1.85 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.230 0; 10.1.1.85 0;
127.0.0.1 0; 127.0.0.1 0;

8690
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.230 1; 10.1.1.85 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.230 0; 10.1.1.85 0;
127.0.0.1 0; 127.0.0.1 0;

8690
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.230 1; 10.1.1.85 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.230 0; 10.1.1.85 0;
127.0.0.1 0; 127.0.0.1 0;

8690
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.69.103.231 0; 52.186.140.21 0;

8690
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.69.103.231 0; 52.186.140.21 0;

8690
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.230 1; 10.1.1.85 1;
127.0.0.1 1; 127.0.0.1 1;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
BuiltWith ADmantX
DSearch CensysInspect
Dragonfly Internet Ninja
Harvest Re-re
Heritrix TwengaBot
LNSpiderguy Vacuum
Lightspeedsystems WBSearchBot
OrangeSpider Wallpapers
V-BOT YoudaoBot
spyfu ZmEu

290
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
01h4x.com 01h4x.com
360Spider 360Spider
404checker 80legs
404enemy ADmantX
ASPSeek ALittle Client
Aboundex
Aboundexbot Aboundexbot
Acunetix
AhrefsBot AhrefsBot
AiHitBot
Aipbot
Alexibot Alexibot
AllSubmitter AllSubmitter
Alligator
AlphaBot
Anarchy Anarchy
Anarchy99 Anarchy99
Anthill Apexoo
Attach
AwarioSmartBot AwarioSmartBot
BDCbot BDCbot
BDFetch
BackStreet BackStreet
Backlink-Ceck Backlink-Ceck
Bandit BacklinkCrawler
BatchFTP Badass
BetaBot BetaBot
Bigfoot Bigfoot
Black Hole Bitacle
BlackWidow Blow
Boardreader
Brandprotect Brandprotect
Brandwatch
Buck Buck
BuiltWith Bullseye
CSHttp BunnySlippers
BuzzSumo
Calculon Calculon
Cegbfeieh CazoodleBot
ChinaClaw ChinaClaw
Chlooe Cliqzbot
Cogentbot Cloud mapping
Copyscape Cocolyzebot
Curious Collector
Custo CopyRightCheck
Crawling at Home Project
CyotekWebCopy CyotekWebCopy
DBLBot
DIIbot
DTS Agent
DataCha0s
DatabaseDriverMysqli DatabaseDriverMysqli
Devil
Discobot Discobot
DittoSpyder
DnyzBot DnyzBot
DomCopBot DomCopBot
DomainCrawler
DomainSigmaCrawler
DomainStatsBot
Domains Project Domains Project
EMail Wolf Dotbot
ECCP/1.0
Ecxi Ecxi
EirGrabber Evil
ExtLinksBot Extractor
Extreme Picture Finder Extreme Picture Finder
FemtosearchBot FemtosearchBot
FlashGet Fimap
Flunky Freeuploader
Foobot
Fuzz
FyberSpider FyberSpider
GalaxyBot G-i-g-a-b-o-t
Genieo GetWeb
Getintent
Gotit Gotit
GrabNet
Grabber Grabber
Grafula GridBot
HMView HEADMasterSEO
HTMLparser HTTrack
HTTP::Lite Haansoft
HaosouSpider
Havij
Heritrix Heritrix
Hloader
Humanlinks Humanlinks
HybridBot
IDBTE4M
IDBot
IRLbot IRLbot
Iblog
IlseBot
Image Fetch
Image Sucker Image Sucker
IndeedBot IndeedBot
InfoNaviRobot
InfoTekies InfoTekies
InterGET InternetSeer
Iskanie IstellaBot
JOC Web Spider JOC Web Spider
JamesBOT JamesBOT
Keyword Density Jyxobot
Kinza Kenjin Spider
LNSpiderguy LNSpiderguy
Larbin LexiBot
LeechGet
Lftp
Libwhisker Libwhisker
LieBaoFast LieBaoFast
LinkScan Lightspeedsystems
LinkextractorPro
LinkpadBot LinkpadBot
LinksManager LinksManager
LinqiaScrapeBot LinqiaRSSBot
Lipperhey
Lipperhey Spider Lipperhey Spider
Ltx71 MIDown tool
MFC_Tear_Sample MTRobot
MQQBrowser
MSFrontPage
Majestic12 Majestic12
Mass Downloader MarkWatch
Masscan
Mata Hari
MauiBot
Mb2345Browser
MeanPath Bot MeanPath Bot
Meanpathbot Meanpathbot
Mediatoolkitbot Mediatoolkitbot
MegaIndex.ru MegaIndex.ru
MicroMessenger MicroMessenger
Microsoft Data Access
Mister PiX
Moblie Safari Moblie Safari
Nameprotect Mojeek
NearSite Morfeus Fucking Scanner
Mozlila
Mr.4x3
Msrabot
Musobot
Name Intelligence
Navroad
Net Vampire
NetAnts
NetMechanic NetMechanic
NetSpider Nettrack
Netvibes Netvibes
NimbleCrawler NextGenSearchBot
Offline Navigator Nibbler
Openfind Ninja
OrangeSpider Nmap
OutclicksBot Nutch
OutfoxBot Octopus
PECL::HTTP
PageGrabber
PageScorer PageScorer
PageThing.com PageThing.com
Panscient Petalbot
Papa Foto Pi-Monster
PeoplePal
Picscout Picscout
Picsearch Pimonster
PictureFinder
Piepmatz
PleaseCrawl PleaseCrawl
ProPowerBot ProWebWalker
Probethenet Psbot
PyCurl PyCurl
QueryN Metasearch Quick-Crawler
RSSingBot
RankActive RankActive
ReGet RankActiveLinkBot
RankingBot
RankingBot2
RankurBot
RealDownload RealDownload
Reaper
RebelMouse
Recorder Recorder
RedesScrapy RepoMonkey
Ripper
RocketCrawler
Rogerbot Rogerbot
SBIder
SEOkicks
SEOlyticsCrawler
SEOstats
SISTRIX
SalesIntelligent SalesIntelligent
Scanbot ScanAlert
Screaming Scrapy
Searchestate ScreenerBot
Semrush Semrush
SemrushBot SemrushBot
SeoSiteCheckup SentiBot
SeobilityBot SeobilityBot
Seomoz Seomoz
Shodan
Site Sucker Site Sucker
SiteExplorer
SiteLockSpider SiteLockSpider
SiteSnagger
SiteSucker SiteSucker
Sitebeam
Siteimprove Siteimprove
Sitevigil SlySearch
SmartDownload
Snoopy
SocialRankIOBot
Sociscraper Sociscraper
Sosospider Sosospider
Sottopop Sottopop
Spammen
SpankBot
Spbot
Spinn3r Spinn3r
SputnikBot Sqlworm
Sqlmap
Steeler Steeler
Sucuri Sucker
SuperBot SuperBot
SuperHTTP SuperHTTP
Surfbot
SurveyBot
Suzuran Suzuran
Swiftbot Swiftbot
Szukacz Szukacz
T0PHackTeam T0PHackTeam
Teleport Teleport
TeleportPro TeleportPro
Telesoft Telesphorep
Thumbor TheNomad
TightTwatBot Titan
Tracemyfile
Trendiction Trendiction
True_Robot Turnitin
Turingos Typhoeus
VB Project V-BOT
VCI VCI
VelenPublicWebCrawler VelenPublicWebCrawler
VidibleScraper
Virusdie Virusdie
VoidEYE
Voltron
WASALive-Bot WASALive-Bot
WEBDAV WEBDAV
WPScan
WWW-Collector-E WWW-Collector-E
WWW-Mechanize WWW::Mechanize
Wallpapers Wallpapers/3.0
WeSEE Web Enhancer
Web Collage WebBandit
Web Pix WebCollage
Web Sauger
WebEnhancer
WebFetch
WebFuck WebFuck
WebGo IS WebGo IS
WebSauger WebImageCollector
WebStripper WebPix
WebWhacker WebSucker
WebZIP WebZIP
WebmasterWorldForumBot Webalta
Whack Webshag
Who.is Bot Webster
WiseGuys Robot Wotbox
Wprecon Wprecon
Xaldon_WebSpider Xaldon_WebSpider
Xenu Xenu
Zermelo Zade
Zeus Zitebot
ZumBot
ZyBorg ZyBorg
arquivo-web-crawler archive.org_bot
backlink-check arquivo.pt
clark-crawler autoemailspider
check1.exe
coccocbot-web
com.plumanalytics com.plumanalytics
crawler.feedback
crawler4j crawler4j
gopher dataforseo.com
instabid domainsproject.org
lwp-request evc-batch
isitwp.com
magpie-crawler magpie-crawler
oBot meanpathbot
muhstik-scan
netEstate NE Crawler
page scorer page scorer
s1z.ru plumanalytics
scan.lol polaris version
sexsearcher seoscanners
sogouspider sogouspider
sp_auditbot
spyfu spyfu
sysscan
ubermetrics-technologies.com
voyagerx.com voyagerx.com
webpros.com webprosbot
xpymep1.exe

300
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
360Spider
404enemy
80legs 80legs
ALittle Client ADmantX
Acunetix AIBOT
Aipbot ASPSeek
Alexibot
Alligator Alligator
Anarchy99 AlphaBot
Anthill Anarchy
Aspiegel Ankit
Asterias Apexoo
Attach AwarioSmartBot
BDCbot BBBike
Backlink-Ceck BLEXBot
BackStreet
Badass
Barkrowler Barkrowler
Battleztar Bazinga
BetaBot BetaBot
Bigfoot
Bitacle Bitacle
Black Hole
Blow
BlowFish
Bolt Bolt
Buck BotALot
Brandwatch
Buddy Buddy
BuiltBotTough BuiltBotTough
BunnySlippers
CATExplorador
CCBot CCBot
CODE87 CSHttp
CazoodleBot CazoodleBot
CheTeam CensysInspect
Chlooe CheeseBot
CherryPicker
Cliqzbot
Cloud mapping Cloud mapping
Cocolyzebot
Cogentbot
Copier Copier
CopyRightCheck
Cosmos
Craftbot
Crawling at Home Project Crawling at Home Project
CrazyWebCrawler CrazyWebCrawler
Crescent Crescent
CrunchBot
Custo Custo
CyotekWebCopy
DBLBot
DIIbot DIIbot
Deusu DataCha0s
DatabaseDriverMysqli
Devil Devil
DigitalPebble Dirbuster
Discobot
Discoverybot Discoverybot
DittoSpyder DnyzBot
DomainAppender DomCopBot
Drip DomainSigmaCrawler
DomainStatsBot
Domains Project
EMail Siphon
EMail Wolf
EasyDL EasyDL
EirGrabber Express WebPictures
Extractor
Extreme Picture Finder
EyeNetIE
Ezooms
FDM FDM
FHscan
FemtosearchBot FemtosearchBot
Fimap Flunky
Foobot
Freeuploader
FrontPage
Fuzz
FyberSpider FyberSpider
GT::WWW Fyrebot
GoZilla G-i-g-a-b-o-t
Gotit GalaxyBot
Grafula GermCrawler
GrapeshotCrawler GetRight
Haansoft GetWeb
Getintent
Go!Zilla
Grabber
HEADMasterSEO
HTMLparser
HaosouSpider HaosouSpider
Havij Havij
Hloader Hloader
Humanlinks Humanlinks
Iblog IDBTE4M
IlseBot Image Sucker
IndeedBot
InfoNaviRobot
InfoTekies
Intelliseek
InterGET InterGET
Internet Ninja InternetSeer
Iria
Iskanie Iskanie
JOC Web Spider JOC Web Spider
Jbrofuzz
Jetty Jetty
JikeSpider JikeSpider
Joomla
Jyxobot Jyxobot
Kenjin Spider
Kinza
Larbin Larbin
Leap Leap
LeechGet LeechGet
LieBaoFast
Lightspeedsystems
LinkScan
Linkdexbot
LinqiaMetadataDownloaderBot
LinqiaRSSBot
Lipperhey Lipperhey
Lipperhey Spider
Litemage_walker
Lmspider
Ltx71 Ltx71
MFC_Tear_Sample MIDown tool
MIIxpc Mag-Net
MQQBrowser Mail.RU_Bot
MSFrontPage Majestic SEO
MSIECrawler
Magnet
Majestic-SEO Majestic-SEO
Majestic12 Masscan
Meanpathbot Meanpathbot
Metauri Metauri
Mister PiX
Moblie Safari Moblie Safari
Mojeek
Mojolicious
Morfeus Fucking Scanner
Mozlila
Mr.4x3
Msrabot Msrabot
Musobot Name Intelligence
Needle NearSite
Nessus
Net Vampire
NetLyzer NetLyzer
NetSpider NetMechanic
NetZIP
Netvibes Netvibes
NextGenSearchBot
Nibbler Nibbler
Niki-bot Niki-bot
Nikto NimbleCrawler
Nimbostratus
Ninja Ninja
Nmap
Nuclei
Nutch
Offline Explorer Offline Explorer
Offline Navigator
OpenLinkProfiler OpenLinkProfiler
OpenVAS Openvas
Openfind
OrangeBot OrangeBot
OutfoxBot OrangeSpider
OutclicksBot
PECL::HTTP PECL::HTTP
PHPCrawl Page Analyzer
POE-Component-Client-HTTP
PageAnalyzer
PageGrabber
PageScorer PageScorer
PageThing.com PageThing.com
Papa Foto
Pavuk
Petalbot Petalbot
Pi-Monster
Picscout
Picsearch
PictureFinder
Piepmatz Piepmatz
Probethenet Psbot
Pu_iN
Pump Pump
PxBroker
Quick-Crawler Quick-Crawler
RankingBot RSSingBot
RankActiveLinkBot
RankFlex
Rankivabot Rankivabot
RankurBot Re-re
ReGet
RealDownload RealDownload
RebelMouse Reaper
Recorder
RedesScrapy RedesScrapy
RocketCrawler Ripper
SEOkicks SEOkicks-Robot
SEOlyticsCrawler SEOprofiler
SMTBot Scanbot
ScoutJet ScrepyBot
Scrapy
ScreenerBot
Semrush Semrush
SeoSiteCheckup
Seomoz Seomoz
Site Sucker Siteimprove
Sitebeam
SlySearch SlySearch
SmartDownload SmartDownload
Sociscraper Snake
Sogou web spider Snapbot
SpaceBison Snoopy
Spammen Sosospider
SpankBot Spbot
SputnikBot Spinn3r
Sqlmap Sqlmap
Sqlworm
Sqworm Sqworm
Steeler Steeler
Stripper Sucker
Sucuri
SuperBot SuperBot
Surfbot
Suzuran Suzuran
Swiftbot
Szukacz Szukacz
T0PHackTeam
T8Abot T8Abot
Teleport
TeleportPro TeleportPro
The Intraformant
Toata
Trendiction
Turingos
Turnitin Turnitin
TurnitinBot TurnitinBot
TwengaBot TwengaBot
Typhoeus
URLy Warning
URLy.Warning URLy.Warning
Upflow UnisterBot
V-BOT V-BOT
VB Project
Vacuum Vacuum
Virusdie Vagabondo
Voil VelenPublicWebCrawler
WISENutbot VidibleScraper
Wallpapers/3.0 VoidEYE
WallpapersHD Voltron
WeSEE WWWOFFLE
Web Auto Web Auto
Web Collage Web Collage
Web Fetch Web Enhancer
Web Fuck Web Fuck
Web Pix Web Pix
Web Sucker Web Sucker
WebAuto
WebCollage WebCollage
WebCopier
WebFetch
WebFuck WebFuck
WebGo IS WebGo IS
WebImageCollector WebImageCollector
WebLeacher WebZIP
WebPix
WebStripper
WebSucker
WebmasterWorldForumBot WebmasterWorldForumBot
Whack Website Quester
Whacker Webster
Whatweb Whatweb
Who.is Bot
WinHTTrack WinHTTrack
Xaldon_WebSpider Woobot
Wotbox
Xenu
YoudaoBot
Zade Zade
Zeus ZmEu
ZoomBot ZoominfoBot
ZumBot archive.org_bot
arquivo-web-crawler
arquivo.pt
backlink-check backlink-check
clark-crawler cah.io.community
coccocbot-web com.plumanalytics
cognitiveseo
crawler.feedback crawler.feedback
crawler4j
demandbase-bot demandbase-bot
evc-batch evc-batch
lwp-request instabid
lwp-trivial internetVista monitor
meanpathbot magpie-crawler
muhstik-scan mediawords
plumanalytics oBot
ripz
s1z.ru s1z.ru
satoristudio.net
seobility seobility
sitechecker.pro seoscanners
siteripz siteripz
sp_auditbot sogouspider
webmeup-crawler sysscan
webprosbot trendiction.com
voyagerx.com
x09Mozilla x09Mozilla
x22Mozilla

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
256bit.by divatraffic.com
classiquebijoux.ru hentaiheroes.com
en.altezza.travel kaz.kz
gov.yanao.ru parfusale.se
howmuchdoestizanidinecost.blogspot.com rvzr-a.akamaihd.net
jerseywholesalechinabiz.com searchimpression.com
ric.info statustroll.com
whiteelephantwellington.com upstore.me
womama.ru wowas31.ucoz.ru
zoompegs.com ynymnwbm.bloger.index.hr

926
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
01apple.com 123any.com
1-99seo.com 1qingdao.com
12masterov.com 2345.com
1xbet4you.com 24x7-server-support.site
2rich4bitches.com 4istoshop.com
300richmond.co.nz 4kpics.rocks
3rbseyes.com
3w24.com
4k-player.pl
4webmasters.org 4webmasters.org
5000-cotydzien.com 5tey7463.weebly.com
76brighton.co.uk 8gold.com
9med.net 999webdesign.com
a1security.com.ua acortarurl.es
adanih.com acunetix-referrer.com
adman.se adconscious.com
ads.gold adult3dgames.com
adtiger.tk aktivator-windows10.blogspot.com
adtology.com alfa-medosmotr.ru
aghanyna.com alkoravto.ru
agysya.ru all4wap.ru
ald2014.org allcredits.su
alfabot.xyz aloofly.com
all4invest.info ampower.me
alldubai.biz amt-k.ru
allmarketsnewdayli.gdn anabolics.shop
alphavisions.net
altamayoztourism.com
am15.net
amateurgalls.com
amung.us
anal-acrobats.hol.es anal-acrobats.hol.es
apibetweenlinesn-a.akamaihd.net animali.deagostinipassion.it
aproposde.com anonymous-redirect.com
arquivo.pt anti-virus-removal.info
artel116.ru apccargo.com
arvut.org apiholdingmypage-a.akamaihd.net
australia-opening-times.com arenda-avtoprokat-krasnodar.ru
auto-moto-elektronika.cz arkartex.ru
autoloans.com asacopaco.tk
automatic-seo.com asseenontv.ru
aviav.ru.com atovh.local-finders.com
avkzarabotok.com aussie-prizes.com
azbukafree.com auto-zapchasti.org
aviav.eu
avon-severozapad.ru
avtoarenda.by
avtovolop.ru
ayakino.net
azarttoto.com
b-styles.xyz
babespcs.com babespcs.com
baixar-musicas-gratis.com baikaleminer.com
bard-real.com.ua bala.getenjoyment.net
batanga.net balkanfarma.ru
beauty-bracelet.com bannertesting.com
bestdooz.com barnfurnituremart.com
bestwebsitesawards.com besthomemadepornsites.com
bestwrinklecreamnow.com betterscooter.com
betteroffers.review binomo.com
billiard-classic.com.ua bird1.ru
bizcheapjerseyswholesalechina.com bjetjt.com
biznesluxe.ru
blagovest-med.ru blagovest-med.ru
blog.f00kclan.de bonky.biz
blog.yam.com boostmyppc.com
blogporn.in bpro1.top
bmw-ark.ru brandbucket.com
boleznikogi.com buckspar.gq
bosefux.esy.es buron.pw
bouda.kvalitne.cz businescoop.men
braintobe.win buy-loft.ru
businesn.men buyantiviralwp.com
businesxxl.com buydissertation.net
butstrap.space bvlgariwallet.xyz
buynorxx.com callejondelpozo.es
buzzsumo.com cam-kontakte.org
bvlgariring.xyz candycrushshop.com
calcularpagerank.com
callcafe.info
candypeople.se candypeople.se
canrole.com carabela.com.do
carloans.com carapics.com
cbox.ws cartierlovestore.xyz
cdncash.com cartujano-pre.de
cbb1smartlist12.click
cdn.walkme.com
cdncash.net cdncash.net
centrumcoachingu.com cdnnetwok.xyz
cfjump.com cellfun.mobi
cheapestjerseysonwholesale.com cheapbarbour.online
checkm8.com chidporn.com
chiblackhawks-jerseys.com chocolateslim-en-france.com
chocolateslim-original.com cialgenisrx.com
ci.ua circlesl.com
cialischstgerts.com cleanallspyware.com
clevernt.com
clickbanksites.info
clickcash.com
clknsee.com clknsee.com
club-lukojl.ru coin-hive.com
coldfilm.ru construmac.com.mx
collegeessay19.blogspot.ru cookie-law-enforcement-aa.xyz
compliance-alex.top country-chic.ru
compliance-alex.xyz
compliance-barak.top
compliance-checker.info
compliance-fred.xyz
compliance-ivan.xyz
confib.ifmo.ru
connectionstrenth.com
consorzioilmosaico.org
contentlook.co
cool-wedding.net
cordstrap.cc
counterbot.com
crystalslot.com crystalslot.com
culmimg.pw custodieva.ru
custom-electric-guitar.com customerpromos-a.akamaihd.net
cutalltheshit.com dame-ns.kz
cv.wallhade.co datadepths.com
cypernhuset.se delayreferat.ru
dailyfinancefix.com deniven.1bb.ru
dailyrank.net deutschland123.de
damasarenai.info dieta-personalna.pl
datract.com dimkino.ru
davebestdeals.com dirtpics.pw
ddospanel.com dosug-lux.ru
decorationspcs.com downloadeer.net
delfin-aqua.com.ua downloadmefiranaratb1972.xpg.com.br
demon-tweeks.com dptaughtme.com
dentfidemountpreach.tk drivotracker.com
dimaka.info e-avon.ru
divatraffic.com e-poker-2005.com
dkvorota.ru
dneprsvet.com.ua
doctormakarova.ru
domaineaneblanc.com
dominateforex.ml
easyukraine.com easyukraine.com
ec-file.info
ecommerce-seo.org ecommerce-seo.org
eets.net edwinkonijn.com.au
ekaterinburg.xrus.org
ekobata.ru
ekspresihati.info
eldiariodeguadalajara.com
elektrischezigarette2.onsugar.com elektrischezigarette2.onsugar.com
elvel.com.ua elektrischezigarettekaufen2.cowblog.fr
enternet.ee elektronischezigarette2.mex.tl
erotik0049.com elektrozigaretten1.webs.com
esopini.com emailaccountlogin.co
essay-edu.biz energydiet24.ru
eu-cookie-law.blogspot.com englishgamer.com
euroskat.ru ero-advertising.com
exhibitionplus.eu essayservicewriting.org
expresstoplivo.ru evehemming.blogspot.com.au
ezaz.info everypony.ru
f012.de face.hostingx.eu
fakehandbags.xyz fanpagerobot.com
fashion-mk.net faptitans.com
fashion-stickers.ru
fast-wordpress-start.com fast-wordpress-start.com
fastcrawl.com fearcrow.com
ff30236ddef1465f88547e760973d70a.com feargames.ru
fickenbumsen.net filunika.com.ru
filesclub.net financeloan.us
firstsiteguide.com findpics.pw
fiverr.com flash4fun.com
flashlarevista.com flashahead.info
flirt4free.com forpackningsutveckling.se
fm-upgrade.ru fortunejack.com
food.dtu.dk forum.poker4life.ru
forexgb.ru forzeronly.com
fortwosmartcar.pw fotosfotos.eu
foto-telok.net freefoto.ca
frankofficial.ru galeon.com
free-share-buttons.com gallery.rennlist.com
freenode.info gambarkatabaru.com
frighteningremain.cf ge0ip.com
funponsel.com generic-pills-online.com
fx-brokers-review.com getoutofdebtfree.org
g.starmoe.xyz gilbertbanda.net
gambarxkata.co
game-mmorpg.net
gamesprite.me
gardene.ru
gaz-voshod.ru
ghostvisitor.com
glastecfilms.com.my glastecfilms.com.my
gnuetella.com gobongo.info
goldandcard.ru gogps.me
goo.ne.jp gombita.info
goodhumor24.com goodhousekeeping.com
goosefishpost.bid
gotcher.us gotcher.us
greenzaim.ru greatdealshop.com
gtopstats.com gsasearchengineranker.xyz
hannasolution.ru guidefs.ru
hao123.com habermetre.com
hasshe.com hamilton.ca
hatedriveapart.com hatedriveapart.com
headpharmacy.com hdimagegallery.net
highstairs-a.akamaihd.net healing-dysplasia.ru
hem.passagen.se
heroz.fr
hit-kino.ru
hmmm.cz
homedecorpicture.us
homemature.net
hopeonthestreet.co.uk
hornymatches.com
host-tracker.com host-tracker.com
hotblog.top hotel-mkad.ru
hotblognetwork.com hoterika.com
hotenergy.ru i4track.net
hptwaakw.blog.fc2.com iamsport.org
hyipmanager.in ibb.com.ua
ideibiznesa2015.ru ideawheel.com
ie.57883.net ihc2015.info
ilovevitaly.ru ilmen.net
imagerydatabase.com imagui.eu
increasewwwtraffic.info imgarit.pw
infazavr.ru imicrovision.com
inspiring-desperate.tk immobiliaremassaro.com
intimshop-fantasy.ru incep.imagine-ex.co
inzn.ru incest-ru.com
irkutsk.online-podarki.com inclk.com
infospot.pt
instabid.tech
insurple.com
int.search.mywebsearch.com
internet-apteka.ru
iqoption-bin.com
iqoption.pro
irunfar.com
istizanidineanopiate.blogspot.com istizanidineanopiate.blogspot.com
istripper.com istmira.ru
itch.io itch.io
izoll.ru jav-way.site
jackpotchances.com jaxcube.info
japfm.com je7.us
jolic2.com jerseychinabizwholesale.us
junglenet-a.akamaihd.net jetsli.de
kandidos.com jjbabskoe.ru
kartiniresto.com justdating.online
karusel-market.ru kasino-money.pw
kashubadesign.ru kfon.eu
kerei.ru kinky-fetishes.com
kerwinandcariza.com kino-rating.ru
keywordbasket.com kiwe-analytics.com
kino-key.info kiwi237au.tk
kol-energo.ru klejonka.info
kollekcioner.ru knogg.net
kostenloser-sex.com kongoultry.net
kredit-pod-zalog-krasnodar.ru kongruan.com
lacasamorett.com konkursov.net
lafourmiliaire.com konpax.com
kumuk.info
la-fa.ru
lalalove.ru
lanadelreyfans.us
languagecode.com
laserpen.club laserpen.club
layola.biz.tc laudit.ru
lenpipet.ru lerporn.info
lenvred.org lidoradio.com
levaquin750mg.blogspot.com lifehacĸer.com
likesdesign.com likesdesign.com
likesuccess.com likrot.com
lisque.batcave.net linkbolic.com
listiseltemournlan.gq linkwithin.com
liveinternet.ro liupis.com
loadopia.com liveu.infoteka.hu
locustdesign.co localflirtbuddies.com
lombardfinder.ru locimge.pw
lombia.com lolnex.us
lombia.co
long-beach-air-conditioning.com long-beach-air-conditioning.com
longadventure.com longgreen.info
lsp-awak-perikanan.com lotto6888.com
mailemedicinals.com lottospring.com
makedo.ru ltvperf.com
mebeldekor.com.ua mac-shield.com
mediawhirl.net magiadinamibia.blogspot.com
meet-flirt-dating.com manipulyator-peterburg.ru
meetlocalchicks.com massage-info.nl
megakino.net master-muznachas.ru
members.ghanaweb.com meddesk.ru
minet.club merryhouse.co.uk
metalonly.info
michaelkorsoutletstore.net
minyetki.ru
misandesign.se misandesign.se
misswell.net missis.top
mixed-wrestling.ru mmog-play.ru
mmgq.ru mmostrike.ru
monarhs.info mobplayer.ru
moneytop.ru mobstarr.com
morpicert.pw moesen-ficken.com
moscow-clining.ru moje-recenze.cz
most-kerch.org mojowhois.com
mrbitsandbytes.com moncleronline.xyz
mttwtrack.com more-letom.ru
mturkcontent.com morlat.altervista.org
mxgetcode.com mossmesi.com
mywallpaper.top mrmoneymustache.com
narkologiya-belgorod.ru mrsdalloways.com
natali-forex.com musicktab.com
nero-us.com my-aladin.com
net-radar.com mydeathspace.com
newtechspb.ru mymobilemoneypages.com
o.light.d0t.ru nacap.ru
obiavo.com narkologiya-orel.ru
onblastblog.online national-today-winning-winner.club
online-hd.pl negral.pluto.ro
onlineku.com netallergy.ru
onlinemegax.com next-dentists.tk
onlinetvseries.me nextconseil.com
onload.pw nextlnk12.com
nicefloor.co.uk
ningessaybe.me
no-fuel.org
npoet.ru
nrv.co.za
nzfilecloud.weebly.com
o333o.com
offf.info
oil-td.ru
oklogistic.ru
online-podarki.com
online-x.ru
onlineserialy.ru
onlywoman.org
onthemarch.co
ooomeru.ru ooomeru.ru
orion-v.com origin-my.ru
ossmalta.com
ostroike.org
ostrovtaxi.ru ostrovtaxi.ru
outclicks.net p-business.ru
oynat.info pagesense.com
pandroid.co painting-planet.com
partner-cdn.men panchro.co.uk
partner-stop.men perm-profnastil.ru
pastaleads.com picturesboss.com
patol01.pw pillscheap24h.com
pattersonsweb.com pintattoos.com
pc-services.ru piulatte.cz
perm.xrus.org play.leadzupc.com
photosaga.info pokemongooo.ml
pic-re.blogspot.com polcin.de
picmoonco.pw porn-w.org
picsfair.com pornogig.com
pihl.se porodasobak.net
pinup-casino1.ru postclass.com
pirateday.ru preconnubial.usuby.site
pix24x7.com predmety.in.ua
pixshark.com princevc.com
pl-top.pl printie.com
plaff-go.ru privat-girl.net
play-movie.pl
play-mp3.com
playtap.us
porno-chaman.info
porno-home365.com
porno-play.net
pornoelita.info
pornofiljmi.com
pornstartits.xblog.in
pornzone.tv
portnoff.od.ua
porto.abuilder.net
pozdrawleniya.com
prodess.ru prodess.ru
professionaldieselcare.com produkto.net
prointer.net.ua profolan.pl
projectforte.ru proftests.net
prom23.ru progonrumarket.ru
propranolol40mg.blogspot.com
prosmibank.ru
prospekt-st.ru prospekt-st.ru
prostitutki-almata.org proxyelite.biz
prostitutki-rostova.org pufip.com
prostitutki-tyumeni.org pussyfleet.com
pulseonclick.com putevka24.ru
pushdata.sendpulse.com qpypcx.com
qualitymarketzone.com quangcaons.com
r-control.ru quelle.ru
rarbg.to rada.ru
rating-casino2021.ru rank-checker.online
rapidokbrain.com
rating-bestcasino.com
rcb101.ru
realtytimes.com
rebelmouse.com
recipedays.ru
reelheroes.net
regionshop.biz regionshop.biz
registry-cleaner.net renecaovilla.online
registrydomainservices.com responsive-test.net
relatodelpresente.com.ar rock-cafe.info
remedyotc.com
remont-komputerov-notebook.ru
renecaovillasale.online
robot-forex.biz
robotixix.com
rockma.se rockma.se
roma-kukareku.livejournal.com roma-kukareku.livejournal.com
rus-teh.narod.ru rusvideos.su
russia-tao.ru sa-rewards.co.za
russia-today-video.ru sady-urala.ru
rvi.biz sampleletters.net
s1z.ru sandhillsonline.com
sammyweaver.com sankt-peterburg.nodup.ru
satellite.maps.ilovevitaly.com santechnik.jimdo.com
scat.porn sarafangel.ru
screpy.com savetubevideo.com
scanner-irvin.top
scanner-julianna.top
scoopquest.com
sdelai-prosto.ru
searchimpression.com
searchlock.com searchlock.com
seoanalyses.com seksotur.ru
seorankinglinks.com semaltmedia.com
seorankinglinks.xyz semp.net
sevenstars7.com seoboxes.com
sex-sex-sex5.com seofied.com
sex-znakomstva.online serptehnika.ru
sexs-foto.top servethis.com
sexspornotub.com service.adtech.us
sexstream.pl sethrollins.net
sextracker.de sexkontakte-seite.com
sexytrend.ru sexobzor.info
sharebutton.net sexreliz.com
shemale-sex.net sexyebonyteen.com
shijian.ac.cn shakhtar-doneck.ru
shodanhq.com sharpchallenge.com
shop.acim.org shop-electron.ru
shymkent.xkaz.org shopperifymac.com
sicfor.bcu.cc shopvilleroyboch.com.ua
sildenafil-tadalafil.info shopwme.ru
site-speed-check.site sientalyric.co
sitebeam.net siha.de
sitechecker.pro silverage.ru
sixcooler.de siteaero.com
skachat-besplatno-obrazcy.ru slomm.ru
skladvaz.ru smailik.org
sladkoevideo.com smartshoppymac.com
slimcdn.com snip.tw
smartbalanceworld.com snomer1.ru
snjatie-geroinovoy-lomki.ru soblaznu.net
snow.nvr163.com softomix.net
snyatie-lomki-v-stacionare.ru softonicads.com
soft1.ru sonnikforme.ru
sosdepotdebilan.com sosdepotdebilan.com
sport-video-obzor.ru spammen.de
statoutlook.info sportbetfair.com
stats-collector.org spywarebegone.com
stefanbakosab.se sstroy44.ru
sterva.cc stackthatbucks.com
stjamesschool.info staff.prairiesouth.ca
stoki.ru stairliftsarea.com
strana-krasoty.ru store-rx.com
streamin.to strag-invest.ru
superlist.biz stroimajor.ru
surcentro.com strongholdsb.ru
surflinksmedical.com subj.ukr-lit.com
swinon.site svarbit.com
szamponrevita.pl sweepstakes.rewardit.com
tampabaywatch.org tampabaywatch.org
td-l-market.ru td-33.ru
tdsing.ru telefonsex-ohne0900.net
tecnoteakviareggio.it terraclicks.com
tehngr.ru thaismartloan.com
template-kid.com thefarmergame.com
testbotprocessor44.com thefotosgratis.eu
themeforest.net thegamerznetwork.com
tizanidine4mgprice.blogspot.com theprofitsmaker.net
tizanidine4mgstreetvalue.blogspot.com thesmartsearch.net
tizanidinecost.blogspot.com thiegs.reco.ws
tizanidinedosageforsleep.blogspot.com titan-cloud.life
tizanidineinteractions.blogspot.com tizanidinehcl4mgtablet.blogspot.com
tizanidinemusclerelaxant.blogspot.com tizanidinemusclerelaxant.blogspot.com
tizanidinepain.blogspot.com
tizanidineshowupondrugtest.blogspot.com
tizanidinesleepaid.blogspot.com
tizanidinewithdrawal.blogspot.com
tizanidinezanaflex.blogspot.com tizanidinezanaflex.blogspot.com
tmtrck.com tk-assortiment.ru
tobeyouday.win top-deal.com.pl
tomatis.gospartner.com topanasex.com
top10-online-games.com torontoplumbinggroup.com
topappspro.com trafficjunky.net
topmira.com trainoffend.ml
topsy.com tramadolandtizanidine.blogspot.com
torrentred.games trion.od.ua
tour-line.net triumf-realty.ru
tracksz.co trubywriting.com
tracxn.com tuberkulezanet.ru
trafficmonetize.org turizm.bz
traffmonster.info
trahic.ru
truck-land.life
try-rx.com
tsan.net
tsstcorpcddvdwshbbdriverfb.aircus.com
tsyndicate.com
turkeyreport.tk turkeyreport.tk
twittrading.com twinderbella.com
twu.com.ua uac.net.au
tx41tclega.ru uamtrk.com
u555u.info uhod-za-sobakoj.ru
uchebavchehii.ru um-razum.ru
uk-zheu20.ru unlimitdocs.net
unmaroll.ya.ru upstore.me
unrealcommander.org us-america.ru
uogonline.com usbggettwku.ga
url-extractor.xyz
usacasino.com
uzungil.com uzungil.com
vadimkravtcov.ru vacuumcleanerguru.com
vashsvet.com valmetrundan.se
vavilone.com vbikse.com
veerotech.com veerotech.com
versaut.xxx-cam.webcam viagra.pp.ua
video--production.com video-camer.com
vipps.com.my videochat.mx
vipromoffers.com vids18.site
visa-pasport.ru villakohlanta.nu
vitoriacabos.com vip-parfumeria.ru
vodkoved.ru vkgaleria.com
voloo.ru vladhistory.com
vote-up.ru voluumtracker1.com
wdrake.com vonradio.com
website-datenbank.de vroze.com
websiteexplorer.info vsesubwaysurfers.com
wejdz-tu.pl vzlomfb.com
wetgames.ru vzube.com
wholesalejerseys-cheapest.com wallpapersdesk.info
winx-play.ru walpaperlist.com
worldoffiles.ru warningzscaler.heraeus.com
wttavern.com watsonrealtycorp.com
www.get-free-traffic-now.com webix.me
x-diesel.info websites-reviews.com
xblog.in webstatsdomain.org
xmladserver.com webtherapy.ru
xn--80aaajbdbddwj2alwjieei2afr3v.xn--p1ai wieseversa.no
xn--80ahvj9e.xn--p1ai wma-x.com
xn--c1acygb.xn--p1ai word-vorlagen.xyz
xsfetish.org wordpresscore.com
xvideosporn.biz www.jbetting.com
xxxguitars.com www.kabbalah-red-bracelets.com
xxxrus.org www.solartek.ru
xxxsiterips.xyz www.wohnkabinen-shop.de
yellowstonesafaritours.com xedserver.com
youradexchange.com xerox-douglas.cf
youtoner.it xn----7sbbahaq9bb5afgiqfliv4m.xn--p1ai
yurgorod.ru xn--80aafb2a.xn--p1ai
zaloadi.ru xn--80aebbcbcdemfkhba4byaehoejh8dza3v.xn--p1ai
zarabotok--doma.ru xn--d1acah0c.xn--p1ai
zastenchivosti.net xrus.org
zed21.net xsion.net
zeroredirect.com xxxdatinglocal.us
zetgie.com.pl xxxhdvideo.site
zixizop.net.ru za-fun-offer.com
znakomstva-moskva77.ru zajm-pod-zalog-nedvizhimosti.ru
zeroredirect10.com
zeroredirect11.com
zigarettenonlinekaufen.tumblr.com
zigarettenonlinekaufen2.drupalgardens.com

482
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
21h2o.com 000free.us
2pxg8bcf.top 11pikachu.ru
3w24.com 123cha.com
8jn.dating-app.ru 4k-player.pl
aad1f4acb0a373420d9b0c4202d38d94fa.com 6hopping.com
9med.net
actionnooz.com actionnooz.com
ads-seo.men addbin.men
adserver-e7.com adinterax.com
air-edem.ru admatic.com.tr
all4invest.info adsloads.com
alldubai.biz adtech.fr
allmarketsnewdayli.gdn allnews.md
alt-servis.ru alot.com
amazingninja.com amateurmatch.com
amazon-adsystem.com ap.senai.br
anatomiy.com appfastplay.com
androids-store.com bannerspace.com
animaltoplist.com beachfix.co
anmysite.com berrymall.ru
appiq.mobi best-games.today
architecturebest.com bestofpicture.com
arewater.com bfz.biz
asdfg.pro blagovest-med.ru
asrvvv-a.akamaihd.net blogig.org
astana.xxxkaz.org bmw-ark.ru
autowebmarket.com.ua bonux.nextview.ru
avtochehli.by brandimensions.com
azbaseimages.net bronzeaid-a.akamaihd.net
babyfactory.fr buckspar.gq
backiee.com bumble.cheapwebsitehoster.com
backlinkwatch.com buyhoverboard.com
bcmp.org buynorxx.com
bedandbreakfast.com buytizanidineonlinenoprescription.blogspot.com
bestplacetobuyeriacta.jw.lt byme.se
bimatoprost-careprost.com.ua cam-kontakte.org
blpmovies.com canacopegdl.com
blue-square.biz candy-glam-hp.com
bnt-team.com candytiner.com
board.f00d.de canzoni.ru
bongiornos.info carloans.com
bryansk.zrus.org cartechnic.ru
cartierloveringreplica.xyz cashonads.com
ccbill.com celejihad.info
cercacamion.it centre-indigo.org.ua
checkpagerank.net chatroulette.life
cheapbarbour.online
cjmc.info
clean-start.net clean-start.net
clean-virus-mac.com click2pawn.com
clickso.com clicksotrk.com
cocolyze.com com-supportcenter.website
comissionka.net
compliance-brian.top compliance-brian.top
conboy.us covid-schutzmasken.de
cookie-law-enforcement-aa.xyz
creatives.adbetclickin.pink
creditnation.ru creditnation.ru
customerguru.in customboxes4less.com
dailystrength.org cyse.tk
danashop.ru d-black.bz
decorationspcs.com darkbooks.org
diamond-necklace.info detsky-nabytek.info
dominateforex.ml dgfitness.co
donvito.unas.cz dogclothing.store
downloadeer.net domainsphoto.com
drupa.com doreenblog.online
dscaas.website download-walpaperhd.blogspot.com
dverimegapolis.ru drugspowerstore.com
dynainbox.com dvervmoskvu.ru
edudocs.net ekobata.ru
enews.tech electricwheelchairsarea.com
enskedesquashclub.se energydiet-info.ru
eonpal.com erotische-geschichten-xxl.com
eu-cookie-law.info exonline.info
ezigarettekaufen1.hpage.com eyemagination.com
fakehandbags.xyz fanrto.com
fighrofacciufreesig.ga fast-wordpress-start.com
firstdrugmall.ru fetlifeblog.com
fm-upgrade.ru filesvine.com
footbalive.org footballfarrago.com
forex-procto.ru foxydeal.com
freesitetest.com free-share-buttons.com
gabeshop.ru free-share-buttons.top
gazoblok.net.ua freenom.link
gelezki.com freewhatsappload.com
ggiaro.com getlamborghini.ga
globatur.ru globalsurfari.com
go2mike.ru gourcy.altervista.org
gwebtools.com graphics8.info
hamacapty.com gratis-sexkontakte.com
gz2.bbsoldes.fr
handicapbathtubarea.com
hasfun.com
hauleddes.com hauleddes.com
hd720kino.ru hawaiielectriclight.com
herehloadibs.cf hd-film.pl
headpharmacy.com
herokuapp.com herokuapp.com
hmywwogw.bloger.index.hr high-speed1.net
housediz.com highstairs-a.akamaihd.net
huimin764128.com hmmm.cz
husky-shop.cz hotloans.ru
hyhj.info hoverboard360.es
i4track.net hscsscotland.com
iccornacircri.cf ilo134uloh.com
idc.com.ua inclk.com
ideoworld.org investingclub.ru
imagez.co istizanidineacontrolledsubstance.blogspot.com
imgata.com itch.io
jagg.info iwantedmoney.com
kamorel.com izhevsk.zrus.org
koopilka.com japan-bearings.ru
krasnodar-avtolombards.ru jjbabskoe.ru
krasnodar.xrus.org jose.mulinohouse.co
kung-fu-ru.com journeydownthescale.info
kursy-ege.ru jurajskie.info
labelwater.se kadashihotel.com
lawyers.cafe kanimage.com
lawyersinfo.org kazka.ru
lazymanyoga.com keki.info
lernur.net kiskinhouse.com
levaquin750mg.blogspot.com kmd-pto.ru
listiseltemournlan.gq knigonosha.net
liver-chintai.org konkursov.net
locksmith.jp koral.se
lomb.co krasivoe-hd.net
machicon-ueno.info kretpicf.pw
mahnwachen-helfen.info ks1234.com
make-money-online.com kustanay.kz
makenahartlin.com lafourmiliaire.com
manipulyator-peterburg.ru landscaping.center
manualterap.roleforum.ru letmacworkfaster.site
marcoislandvacations.net lightinghomes.net
mature.free-websites.com lignofix.ua
meds-online24.com livetsomudvekslingstudent.bloggersdelight.dk
love-baby.cz
luxmagazine.cf
m292.info
marwer.info
masturbate.co.uk
mebel-ekb.com
mebel-vstroika.ru
medi-fitt.hu
meduza-consult.ru meduza-consult.ru
mega-bony2017.pl megakino.net
megahdporno.net metarip.ru
mirobuvi.com.ua middlerush-a.akamaihd.net
mlvc4zzw.space misandesign.se
moivestiy.biz mobsfun.net
mole.pluto.ro musirc.com
monclercheap.xyz muz-tracker.net
moncleroutletonline.win mygameplus.com
moscow-region.ru mywallpaper.top
musicstock.me naj-filmy24.pl
mybackgroundlandscape.blogspot.com national-today-winning-winner.club
mydearest.co news-readers.ru
mygameplus.ru newstraveller.ru
myonigroup.com nodding-passion.tk
northfacestore.online nottyu.xyz
novatech.vn novatech.vn
officedocuments.net nuup.info
onlinedomains.ru online-podarki.com
ororodnik.goodbb.ru onlinewritingjobs17.blogspot.ru
parajumpersjakkesalgnorge.info onlyporno.ru
parfusale.se optom-deshevo.ru
park.above.com papasdelivery.ru
perfectpracticeweb.com pcboa.se
perosan.com pertlocogasilk.tk
pestomou.info petedrummond.com
pijoto.net pinwallpaper.xyz
pixshark.com pirateday.ru
pkr1hand.com polcin.de
pokemon-go-play.online poptool.net
popup-jdh.xyz pornonik.com
porto.abuilder.net prefersurvey.net
princevc.com projectforte.ru
prospekt-st.ru puteshestvennik.com
pts163.ru putevka24.ru
radiodigital.co quickchange.cc
rainbowice.ru raisedseo.com
recinziireale.com razorweb-a.akamaihd.net
registrationdomainsite.com rebrand.ly
reining.lovasszovetseg.hu reklamuss.ru
rock-cafe.info responsinator.com
russia-tao.ru rewardpoll.com
s8-nowy-wygraj.comli.com riralmolamsaca.tk
saddiechoua.com ryetaw.com
scanner-viktor.top score-ads.men
screpy.com sdrescher.net
sdi-pme.com searchwebknow-a.akamaihd.net
sendearnings.com securityallianceservices.com
senger.atspace.co.uk seo-prof1.xyz
serpstat.com sexblog.pw
sexsearch.com shopcheermakeup.info
sexspornotub.com shopsellcardsdumps.com
sexvporno.ru sibtest.ru
sispe.com.br small-game.com
sitevaluation.org solnplast.ru
slkrm.ru spasswelt.net
sneakyboy.com studentguide.ru
soaksoak.ru svtrd.com
social-search.me syvertsen-da.no
socialmonkee.com tam-gde-more.ru
soda.media tamada69.com
softlinesolutions.me tanieaukcje.com.pl
softtor.com teesdaleflyballclub.co.uk
solitaire-game.ru thebluenoodle.com
space4updating.win thenews-today.info
spidtest.org todohr.com
spywarebegone.com torture.ml
spywarenuker.com trafficgenius.xyz
strongsignal-a.akamaihd.net tupper-shop.ru
sugarlyflex.pw tvoystartup.ru
sumo.com uk-zheu20.ru
survival.betteroffers.review ukrtvir.com.ua
svarbit.com url2image.com
sweepstakes.rewardit.com userequip.com
tengohydar.tk vbikse.com
thejournal.ru vchulkah.net
titan-cloud.life vedomstvo.net
tizanidine4mgstreetvalue.blogspot.com ventelnos.com
tizanidine4mgtablets.blogspot.com video-hollywood.ru
tizanidinedosage.blogspot.com video-woman.com
toonfamilies.net vietimgy.pw
tootoo.to voprosotvet24.ru
topads.men vroze.com
tracksurf.daooda.com vysigy.su
trailer.cinemaflix.website w7s.ru
ttsq.fr wallpaperstock.net
twitlinks.com watchdogs-2.ru
u555u.info waterpurifier.club
ufa.xrus.org watracker.net
underthesite.com webcamdevochka.com
vapomnoncri.tk whereverdesperate.gq
video-chat.cn wildworld.site
videojam.tv winner7777.net
vsesubwaysurfers.com xmlinde.com
vut.com.ru xn-----6kccaibs5cb8afhjrfmix2n.xn--p1ai
webcamtalk.net xn----7sbbagbq7bd5aheftfllo4m.xn--p1ai
webinstantservice.com xn----ctbigni3aj4h.xn--p1ai
webmasters.stackexchange.com xn--80aaaks3bbhabgbigamdr2h.xn--p1ai
websiteaccountant.de xn--80aagddcgkbcqbad7amllnejg6dya.xn--p1ai
wesharepics.com xn--80ahdheogk5l.xn--p1ai
whatistizanidinehclusedfor.blogspot.com xportvusbdriver8i.snack.ws
winwotgold.pl your-bearings.com
wma-x.com zakon-ob-obrazovanii.ru
woweb.com.ua zazagames.org
wpsecurity.website zeroredirect1.com
wygraj-teraz.com zeroredirect9.com
x-lime.com zhongwenlink.com
xblog.in
xn----7sbahjd3btneuw1joc.xn--p1ai
xn----9sbubg3ambdfl1j.xn--p1ai
xn--b1ag5cfn.xn--p1ai
xxlargepop.com
yginekologa.com
yoopsie.com
youdesigner.kz
yunque.pluto.ro
zeroredirect6.com
zetmaster.ru
zigarettenonlinekaufen2.bloog.pl
znakomstvaonlain.ru znakomstvaonlain.ru
zvezdagedon.ru zootoplist.com

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.230 0; 10.1.1.85 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2021.10.2657 ### Version: V4.2021.10.2658
### Updated: Sun Oct 17 22:02:59 UTC 2021 ### Updated: Mon Oct 18 10:12:48 UTC 2021
### Bad Bot Count: 623 ### Bad Bot Count: 623
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2021.10.2657 ### Version: V4.2021.10.2658
### Updated: Sun Oct 17 22:02:59 UTC 2021 ### Updated: Mon Oct 18 10:12:48 UTC 2021
### Bad Bot Count: 623 ### Bad Bot Count: 623
################################################### ###################################################
### Version Information ## ### Version Information ##