vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-05 04:00:13 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2021.08.2516 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2021-08-10 10:09:14 +00:00
parent 46b807a65d
commit 0ced5f15af
46 changed files with 63809 additions and 63809 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2021.08.2515 #### Version: V4.2021.08.2516
#### Bad Referrers Blocked: [7079](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7079](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [620](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [620](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2021.08.2515 #### Version: V4.2021.08.2516
#### Bad Referrers Blocked: [7079](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7079](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [620](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [620](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -11,7 +11,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2021.08.2515 #### Version: V4.2021.08.2516
#### Bad Referrers Blocked: [7079](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7079](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [620](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [620](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

7842
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2021.08.2515 #### Version: V4.2021.08.2516
#### Bad Referrers Blocked: [7079](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7079](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [620](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [620](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

7846
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

7846
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

7846
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

7846
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.207 1; 10.1.1.167 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.207 0; 10.1.1.167 0;
127.0.0.1 0; 127.0.0.1 0;

7846
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.207 1; 10.1.1.167 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.207 0; 10.1.1.167 0;
127.0.0.1 0; 127.0.0.1 0;

7846
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.207 1; 10.1.1.167 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.207 0; 10.1.1.167 0;
127.0.0.1 0; 127.0.0.1 0;

7846
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
2515 2516

7846
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

7846
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
52.168.107.197 0; 104.43.142.146 0;

7846
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.207 1; 10.1.1.167 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.207 0; 10.1.1.167 0;
127.0.0.1 0; 127.0.0.1 0;

7846
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.207 1; 10.1.1.167 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.207 0; 10.1.1.167 0;
127.0.0.1 0; 127.0.0.1 0;

7846
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.207 1; 10.1.1.167 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.207 0; 10.1.1.167 0;
127.0.0.1 0; 127.0.0.1 0;

7846
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
52.168.107.197 0; 104.43.142.146 0;

7846
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
52.168.107.197 0; 104.43.142.146 0;

7846
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.207 1; 10.1.1.167 1;
127.0.0.1 1; 127.0.0.1 1;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
Anarchy99 ADmantX
CyotekWebCopy Collector
Deusu Intelliseek
EasyDL Larbin
Go-Ahead-Got-It LeechGet
LinqiaScrapeBot Mojolicious
Netvibes True_Robot
The Intraformant Virusdie
Toweyabot Wallpapers
magpie-crawler WebZIP

298
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
404checker 01h4x.com
ADmantX 360Spider
ALittle Client ALittle Client
Abonti ASPSeek
Aboundexbot AllSubmitter
Acunetix AlphaBot
Anarchie
Anarchy Anarchy
Ankit
Anthill Anthill
Aspiegel Apexoo
BDCbot Attach
BDFetch AwarioSmartBot
BLEXBot
BackDoorBot BackDoorBot
BackStreet BackStreet
BackWeb BackWeb
Backlink-Ceck BacklinkCrawler
Barkrowler Bandit
BatchFTP
Battleztar Bazinga Battleztar Bazinga
BetaBot Bigfoot
Blow Black Hole
Bolt Blackboard
Boardreader
Brandprotect Brandprotect
Buck BuiltBotTough
BuiltWith BuiltWith
Bullseye
BunnySlippers
BuzzSumo BuzzSumo
CATExplorador
CODE87 CODE87
Calculon
CazoodleBot
Cegbfeieh Cegbfeieh
CherryPicker CheTeam
CheeseBot
ChinaClaw ChinaClaw
Cloud mapping Claritybot
Cocolyzebot Cocolyzebot
Cogentbot Cogentbot
Collector Copier
CopyRightCheck CopyRightCheck
Cosmos CrazyWebCrawler
Craftbot
Crescent Crescent
CrunchBot
Curious
Custo
CyotekWebCopy CyotekWebCopy
DBLBot
DIIbot DIIbot
DTS Agent DatabaseDriverMysqli
Deusu
Devil Devil
Dirbuster
Disco
Discoverybot Discoverybot
Dispatch DittoSpyder
DnyzBot
DomCopBot DomCopBot
DomainAppender
DomainSigmaCrawler
DomainStatsBot DomainStatsBot
Dotbot Domains Project
ECCP/1.0 Drip
EasyDL
Ebingbong Ebingbong
Ecxi Ecxi
EirGrabber
EroCrawler EroCrawler
Express WebPictures
ExtLinksBot ExtLinksBot
Extractor ExtractorPro
Extreme Picture Finder Extreme Picture Finder
Ezooms Ezooms
FHscan Fimap
Fuzz Firefox/7.0
Fyrebot Freeuploader
Genieo GalaxyBot
GetWeb GetRight
Getintent
Gigablast Gigablast
GrabNet GoZilla
Grabber Gotit
GridBot HTTP::Lite
HTMLparser Haansoft
HTTrack Heritrix
HaosouSpider
Hloader
Humanlinks Humanlinks
IDBot HybridBot
IRLbot IlseBot
Id-search Image Fetch
Image Sucker Image Sucker
IndeedBot
Indy Library
InfoNaviRobot
Intelliseek Intelliseek
InterGET
Internet Ninja Internet Ninja
InternetSeer Iskanie
JamesBOT IstellaBot
Jbrofuzz Jbrofuzz
JennyBot JennyBot
JetCar JetCar
Jetty Jorgee
JikeSpider
Joomla
JustView JustView
Keyword Density Keyword Density
LNSpiderguy
LWP::Simple LWP::Simple
Larbin Lanshanbot
Leap Leap
LibWeb LeechGet
Likse LexiBot
Linkbot Lftp
LinksManager Lightspeedsystems
LinkScan
Linkdexbot
LinkpadBot
LinqiaMetadataDownloaderBot LinqiaMetadataDownloaderBot
LinqiaScrapeBot Lipperhey Spider
Litemage_walker MIDown tool
Ltx71
MIIxpc MIIxpc
MSIECrawler Mag-Net
Mail.RU_Bot Majestic12
Majestic-SEO MarkMonitor
MarkWatch MarkWatch
Masscan
Mata Hari
MauiBot MauiBot
Mb2345Browser
MeanPath Bot
Mediatoolkitbot Mediatoolkitbot
Microsoft URL Control Microsoft URL Control
Mister PiX Moblie Safari
Mojeek Mojeek
Mojolicious Mojolicious
Msrabot Morfeus Fucking Scanner
NICErsPRO Musobot
NPbot NPbot
Nameprotect Name Intelligence
NearSite Nessus
Needle
Net Vampire Net Vampire
NetAnts NetLyzer
Netvibes NetMechanic
NetZIP
Nettrack
Nibbler Nibbler
Niki-bot
Nimbostratus
Nmap
Nuclei
Offline Navigator Offline Navigator
OpenVAS
Openfind Openfind
OrangeBot OrangeBot
OrangeSpider OrangeSpider
OutclicksBot OutfoxBot
PECL::HTTP PageGrabber
PageScorer PageScorer
PageThing.com Panscient
Papa Foto PeoplePal
PictureFinder Petalbot
Picscout
Picsearch
Pixray Pixray
PleaseCrawl
Pockey Pockey
ProPowerBot ProWebWalker
Probethenet
Psbot Psbot
Pu_iN Pump
PxBroker Quick-Crawler
PyCurl RankFlex
RankActive RankingBot2
RankingBot
Rankivabot Rankivabot
RankurBot
ReGet ReGet
Reaper Reaper
RebelMouse RebelMouse
Recorder
RedesScrapy
RepoMonkey RepoMonkey
SEOkicks
SEOprofiler SEOprofiler
SEOstats SEOstats
SISTRIX
SalesIntelligent SalesIntelligent
ScoutJet ScanAlert
Scrapy ScrepyBot
ScreenerBot SearchmetricsBot
Searchestate
SemrushBot
SeobilityBot SeobilityBot
Shodan
Siphon Siphon
Site Sucker
SiteCheckerBotCrawler SiteCheckerBotCrawler
Sitebeam
Siteimprove
Sitevigil
SmartDownload SmartDownload
Snoopy Snapbot
Spanner Sociscraper
Spinn3r SpaceBison
Sqlworm Spammen
Stripper SpankBot
Sucker Sqworm
Sucuri Steeler
T0PHackTeam Suzuran
T8Abot T8Abot
Telesphoreo The Intraformant
Telesphorep
TheNomad TheNomad
Thumbor Thumbor
Toata Titan
Toweyabot Trendiction
Trendictionbot Trendictionbot
True_Robot TurnitinBot
TwengaBot TwengaBot
URLy.Warning Twice
VCI URLy Warning
UnisterBot
V-BOT
VB Project
Vagabondo Vagabondo
VelenPublicWebCrawler VelenPublicWebCrawler
VidibleScraper
VoidEYE VoidEYE
Voil Voil
WASALive-Bot
WEBDAV WEBDAV
WeSEE WISENutbot
WPScan
WWW-Collector-E
WWWOFFLE
Wallpapers
WallpapersHD
WebAuto WebAuto
Web Fuck WebCollage
Web Sauger
WebCopier WebCopier
WebEnhancer
WebFuck WebFuck
WebImageCollector WebImageCollector
WebReaper
WebStripper
WebSucker WebSucker
WebZIP Webalta
WebmasterWorldForumBot
Website Quester
WebsiteExtractor WebsiteExtractor
WebsiteQuester Whacker
Whack WiseGuys Robot
Widow Wprecon
Xenu Xaldon WebSpider
Zade YoudaoBot
Zermelo Zermelo
ZumBot ZoominfoBot
archive.org_bot archive.org_bot
arquivo-web-crawler backlink-check
autoemailspider
cah.io.community cah.io.community
check1.exe check1.exe
cognitiveseo com.plumanalytics
crawl.sogou.com
crawler4j crawler4j
evc-batch evc-batch
facebookscraper facebookscraper
heritrix isitwp.com
internetVista monitor
lwp-request
netEstate NE Crawler
oBot oBot
plumanalytics page scorer
pcBrowser
polaris version
probe-image-size
ripz
satoristudio.net satoristudio.net
seobility scan.lol
sexsearcher seoscanners
serpstatbot
sitechecker.pro sitechecker.pro
sogouspider
sp_auditbot sp_auditbot
trendiction.com tAkeOut
trendiction.de trendiction.de
voyagerx.com
webmeup-crawler
x09Mozilla x09Mozilla
zauba.io
zgrab

274
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -2,249 +2,249 @@
404enemy 404enemy
ADmantX ADmantX
AIBOT AIBOT
ALittle Client
ASPSeek
Aboundexbot Aboundexbot
AhrefsBot Acunetix
Aipbot AfD-Verbotsverfahren
AllSubmitter
AlphaBot AlphaBot
Anarchie Anarchy99
Anthill Anthill
Aspiegel
Asterias
AwarioRssBot AwarioRssBot
AwarioSmartBot
BBBike BBBike
Bandit Backlink-Ceck
Barkrowler BacklinkCrawler
Battleztar Bazinga
BetaBot BetaBot
Bigfoot
Blackboard
Boardreader Boardreader
Bolt Bolt
Brandprotect Brandprotect
Buck Brandwatch
Buddy
BuiltBotTough
Bullseye
CCBot
CODE87 CODE87
CazoodleBot CazoodleBot
Cegbfeieh CheTeam
CensysInspect CheeseBot
CherryPicker CherryPicker
Chlooe
Claritybot Claritybot
Cloud mapping Copyscape
Cocolyzebot Cosmos
Cogentbot Crawling at Home Project
Copier CrazyWebCrawler
Custo Crescent
DIIbot
DSearch DSearch
DTS Agent DTS Agent
Demon DataCha0s
Deusu Devil
Digincore Digincore
DigitalPebble DigitalPebble
Dirbuster Dirbuster
Disco Disco
Discoverybot
Dispatch Dispatch
DittoSpyder DnyzBot
DomainCrawler DomainCrawler
DomainStatsBot DomainSigmaCrawler
Domains Project Download Wonder
Drip
EMail Wolf
Ebingbong
Ecxi Ecxi
Express WebPictures EirGrabber
Evil
ExtLinksBot ExtLinksBot
Ezooms FHscan
FDM
FemtosearchBot
Fimap Fimap
Firefox/7.0 Firefox/7.0
FlashGet Flunky
Foobot Fuzz
FrontPage Fyrebot
FyberSpider GT::WWW
GalaxyBot GetWeb
Getintent Gigabot
Gigablast Go!Zilla
Go-Ahead-Got-It GoZilla
Gotit Gotit
GrapeFX Grabber
GrapeshotCrawler GrapeshotCrawler
HTMLparser GridBot
Havij HTTrack
Harvest
Humanlinks Humanlinks
IDBot IRLbot
Iblog Iblog
Id-search
IlseBot IlseBot
Image Fetch IndeedBot
InterGET InterGET
Internet Ninja
Iria
Iskanie Iskanie
JOC Web Spider JOC Web Spider
JamesBOT JamesBOT
JennyBot JikeSpider
Joomla Jyxobot
Jorgee Kinza
Kenjin Spider Larbin
Keyword Density
Kozmosbot
Leap Leap
LeechFTP LeechFTP
LibWeb LexiBot
Lftp
Libwhisker
Lightspeedsystems Lightspeedsystems
Likse
LinkScan LinkScan
LinkextractorPro Linkdexbot
LinksManager LinqiaScrapeBot
LinqiaMetadataDownloaderBot
Lipperhey Lipperhey
Lipperhey Spider Litemage_walker
Lmspider Lmspider
Ltx71 Ltx71
MFC_Tear_Sample
MIDown tool MIDown tool
MSFrontPage MSFrontPage
MSIECrawler MSIECrawler
MTRobot MTRobot
Mag-Net Mag-Net
Mail.RU_Bot Majestic-SEO
Majestic SEO
Majestic12 Majestic12
MarkMonitor MarkMonitor
MarkWatch MarkWatch
Masscan Masscan
MicroMessenger MauiBot
Microsoft URL Control MeanPath Bot
Mojeek Meanpathbot
Mediatoolkitbot
Metauri
Microsoft Data Access
Mr.4x3 Mr.4x3
Musobot
NICErsPRO
Name Intelligence
Navroad
Needle Needle
Net Vampire
NetSpider
Netvibes Netvibes
Nibbler
Nikto Nikto
NimbleCrawler NimbleCrawler
Nimbostratus Nimbostratus
Nmap Ninja
Nuclei
Nutch Nutch
Octopus Octopus
OpenVAS Offline Navigator
Openfind Openfind
Openvas OrangeSpider
OutclicksBot OutclicksBot
OutfoxBot
PHPCrawl
POE-Component-Client-HTTP POE-Component-Client-HTTP
Pandalytics Page Analyzer
Panscient PageAnalyzer
Pavuk PageScorer
Pi-Monster PageThing.com
Papa Foto
Picsearch Picsearch
Pimonster Piepmatz
Pockey PleaseCrawl
ProPowerBot
Probethenet
PxBroker PxBroker
QueryN Metasearch QueryN Metasearch
RankingBot2 RankActive
ReGet
Recorder
RedesScrapy RedesScrapy
RepoMonkey
Ripper Ripper
Rogerbot SEOlyticsCrawler
SBIder
SEOkicks-Robot
SEOprofiler SEOprofiler
SISTRIX SalesIntelligent
ScreenerBot ScanAlert
Scanbot
Screaming
ScrepyBot ScrepyBot
Searchestate
SearchmetricsBot SearchmetricsBot
SeoSiteCheckup SentiBot
Seomoz Seomoz
SiteExplorer Site Sucker
SiteCheckerBotCrawler
SiteLockSpider
Sitebeam Sitebeam
Siteimprove SlySearch
Sociscraper Snapbot
Sosospider Snoopy
SocialRankIOBot
Sogou web spider
SpaceBison
Spammen Spammen
Spbot Spanner
Spinn3r Spinn3r
Sqlmap SputnikBot
Surfbot Sqlworm
SurveyBot Steeler
Sucker
SuperHTTP
Suzuran Suzuran
T8Abot T8Abot
Teleport
Telesphorep Telesphorep
Toata The Intraformant
Tracemyfile Thumbor
Trendiction TightTwatBot
True_Robot
Turingos Turingos
Turnitin TurnitinBot
TwengaBot Typhoeus
URLy Warning
URLy.Warning URLy.Warning
Upflow UnisterBot
V-BOT V-BOT
VB Project
Vacuum
Vagabondo Vagabondo
VelenPublicWebCrawler VelenPublicWebCrawler
VeriCiteCrawler VeriCiteCrawler
VidibleScraper
Virusdie Virusdie
VoidEYE VoidEYE
Voil WBSearchBot
WASALive-Bot WWW-Collector-E
WEBDAV
WWWOFFLE WWWOFFLE
WeSEE Wallpapers
Web Auto WallpapersHD
Web Collage Web Pix
WebAuto Web Sauger
WebBandit WebBandit
WebCollage WebCollage
WebCopier WebCopier
WebFuck
WebReaper WebReaper
WebSauger Webalta
WebSucker
WebZIP
WebmasterWorldForumBot WebmasterWorldForumBot
Webster
Whack Whack
Who.is Bot Who.is Bot
Widow
WinHTTrack WinHTTrack
Wonderbot Wonderbot
Woobot YoudaoBot
Wotbox
Xaldon WebSpider
Zade Zade
Zermelo
Zitebot Zitebot
ZoominfoBot
ZyBorg ZyBorg
archive.org_bot
arquivo.pt arquivo.pt
autoemailspider
backlink-check backlink-check
cah.io.community
check1.exe
coccocbot-web coccocbot-web
cognitiveseo
com.plumanalytics com.plumanalytics
crawler.feedback
crawler4j crawler4j
demandbase-bot facebookscraper
evc-batch gopher
internetVista monitor internetVista monitor
isitwp.com lwp-request
lwp-trivial lwp-trivial
netEstate NE Crawler magpie-crawler
mediawords
page scorer page scorer
pcBrowser pcBrowser
probe-image-size probe-image-size
s1z.ru satoristudio.net
scalaj-http serpstatbot
scan.lol sexsearcher
siteripz sitechecker.pro
spyfu tAkeOut
sysscan trendiction.de
trendiction.com
ubermetrics-technologies.com
voyagerx.com voyagerx.com
x09Mozilla x09Mozilla
x22Mozilla
zauba.io

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
28n2gl3wfyb0.ru 000free.us
computernetworksonline.com belstaffstore.online
crafthubs.com codysbbq.com
homedecoguide.info devochki.top
lacapilla.info domainroam.win
narkologiya-belgorod.ru domznaniy.ru
razvratnoe.org opinionreelle.com
simon3.ru privatefx-in.ru
williamrobsonproperty.com rent2spb.ru
xn--h1ahbi.com.ua surflinksmedical.com

952
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
0lovespells0.blogspot.com 1-99seo.com
1000n1.ru 11pikachu.ru
10bet.com 3-letter-domains.net
1314dh.com 404.mn
178evakuator178.ru 51.la
1flag.co.za 8gold.com
1hwy.com
1j7740kd.website
2rich4bitches.com
3xforum.ro
4webmasters.org
888.com
9med.net
aa8780bb28a1de4eb5bff33c28a218a930.com
aanapa.ru aanapa.ru
abbanreddy.com aarbur.com
ad-words.ru above.com
admitad.com absolute-s.ru
adprotect.net addray.pro
adman.gr
adultfriendfinder.com
adventureparkcostarica.com adventureparkcostarica.com
advokateg.xyz adviceforum.info
adzerg.com advokat-grodno.by
ahmedabadwebs.com aksonural.ru
ahrntal.verymes.xyz allbizne.co.ua
aktobe.xkaz.org am-se.com
alessandraleone.com amateurmatch.com
allesohnegirls.net anal-acrobats.hol.es
amateurgalls.com android-systems.ru
ameblo.top androids-store.com
amung.us angel1777.kz
anabolics.shop anime.dougasouko.com
analnoeporno.tv apccargo.com
andpolice.com apiallgeniusinfo-a.akamaihd.net
angigreene.com apishops.ru
anniemation.com applicationg29.com
api.stathat.com aquarium-pro.ru
apiwoodensealcom-a.akamaihd.net ardimobileinfo.ml
arenda-yeisk.ru
arendas.net arendas.net
artefakct.com ausergrubhof.info
ascat.porn auto-moto-elektronika.cz
autodo.info automatic-seo.com
avramstroy.ru autonew.biz
avtointeres.ru aviav.ru.com
ayakino.net avtoarenda.by
azadnegar.com avtovolop.ru
azartmsl.com azarttoto.com
azbaseimages.net baladur.ru
baditri.com balla-boo.se
bag77.ru best-deals-products.com
balitouroffice.com betterhdporn.com
banan.tv bgviagrachrx.com
bankcrediti.ru biteg.xyz
bankmib.ru bizcheapjerseyswholesalechina.com
basedecor.ru blackbabesporn.com
best-seo-software.xyz blavia.00author.com
bestbrainprod.win
bif-ru.info
biocn.dx.am
bitcoinremote.com
blacktwhite.com
blog-hits.com blog-hits.com
blog.remote-computer.de bloggen.be
bloggers.nl blogqpot.com
bluerobot.info bluesalt.co
bmwhighperformers.com bolitgorlo.net
board.f00d.de boobsimge.com
boom-celebs.com braindaily.xyz
boostmyppc.com brainsandeggs.blogspot.com
bpro1.top brateg.xyz
brandbucket.com breastaugmentation.co.za
browserprotecter.com brus.city
bryansk.zrus.org businesxxl.com
buchananshardware.com buttons-for-your-website.com
bukleteg.xyz buytizanidineonline.blogspot.com
buyhoverboard.com c-gainsbourg.com
buypanicdisorderpill.com callawaygolfoutlet.online
buyscabiescream.com carrauterie.be
carina-sy.de cartierlove2u.com
carsdined.org
cartierlove.xyz
cartierlovebracelet.xyz
cartierlovebraceletreplica.xyz
cartierreplica.win cartierreplica.win
cascadelink.org cenoval.ru
castingbank.ru cfcl.co.uk
cb.iphantom.com charmstroy.info
cbb1smartlist12.click checkm8.com
cenokos.ru chimiver.info
centraletermice.us chlooe.com
chiblackhawks-jerseys.com choosecuisine.com
chinaelitecheapjerseys.com cityadspix.com
cjs.com.ru classiquebijoux.ru
claytransformations.info clean-virus-mac.com
cleanallspyware.com clicksor.com
clicksor.net codysbbq.com
clodo.ru companies-catalog.com
cntravelre.com compliance-donald.xyz
collegeessay19.blogspot.ru confib.ifmo.ru
compliance-alex.top consorzioilmosaico.org
compliance-checker-7.info contextualyield.com
compliance-george.xyz coolingoods.com
compliance-nelson.top cougfan.info
comsysnet.com customcatchcan.com
continent-e.tv customsua.com.ua
coolgramgoods.com daneshetabiat.com
copenergo.ru db.speedup.gdn
cordstrap.cc ddpills.com
cosmetic.donna7753191.ru decenttools.com
crystalslot.com demenageur.com
culmimg.pw designdevise.com
customergrowthsystems.com discovertreasurenow.com
cv.wallhade.co dnepr-avtospar.com.ua
dailyfinancefix.com dojki365.online
day-news.info dosugrostov.site
dbmkfhqk.bloger.index.hr download-of-the-warez.blogspot.com
dealitright.click dpihatinh.gov.vn
decorationspcs.com drhomes.biz
dekoration.us droidlook.net
den-noch24.ru dverimegapolis.ru
devochki.top dvervmoskvu.ru
divku.ru earncash.com.ua
dkvorota.ru ebonyporn.site
doctormakarova.ru educontest.net
dokumentalkino.net elektrischezigarette1.onsugar.com
domain2008.com elektrozigaretten2.yn.lt
dominateforex.ml eorogo.top
domznaniy.ru es5.com
dosug-lux.ru
downloaddy.net
draniki.org
drugstoreforyou.com
dtnlyss.com
dvd-famille.com
ebooknovel.club
ec-file.info
ecookna.com.ua
ed-shop01.ru
ee77ee.com
efnor-ac.com
ege-essay.ru
elitesportsadvisor.com
envaseslotusama.com
erectile.bid
eropho.net
ertelecom.ru
eshop4u.jp
essay-edu.biz
eu-cookie-law.info
evaashop.ru
event-tracking.com event-tracking.com
everypony.ru ezigaretteshop2.vefblog.net
ewebarticle.info f0815.de
exchangeit.gq fanrto.com
extrabot.com fastcrawl.com
extremez.net favoritemoney.ru
falllow.gq fealq.com
fandlr.com feeriaclub.ru
faracontrol.ir fighrofacciufreesig.ga
fast-torrent.ru figuringmoneyout.com
filmci.pro filesvine.com
find1friend.com find1friend.com
finejewelryshop.ru findclan.org
fishingwholesale.us flirt4free.com
fitnesspiks.com forum.tvmir.org
floating-share-buttons.com free-share-buttons.blogspot.com
florida-tourism.net freefoto.ca
flytourisme.org galeria-zdjec.com
footbalive.org gameonasia.com
formulaantiuban.com gameplexcity.com
forum.doctissimo.fr gate5.co.za
frcls.fr gearsadspromo.club
freshmac.space gemgrab-a.akamaihd.net
freshsuperbloop.com germes-trans.com
fuckmill.com getprismatic.com
funponsel.com gotomontenegro.net
fz139.ttk.ru growboxbl.ru
galleryawesome.com guiadeserraazul.com
gallictures.com
gcup.ru
gemara.com
generalporn.org
ghernnqr.skyrock.com
gkvector.ru
globalsurfari.com
golmau.host.sk
goodnightjournal.com
gopixdatabase.com
gosmeb.ru
gratis-sexkontakte.com
green-tea.tv
gribkovye-zabolevaniya.com
grupografico-pilar.com.ar
gsasearchengineranker.top
gtopstats.com
gungamesz.com
habermetre.com
haikuware.com
hatedriveapart.com hatedriveapart.com
hccoder.info
hdwallpapers-free.com hdwallpapers-free.com
hdwalls.xyz hdxnxxtube.mobi
headpress.ru
heliko.no heliko.no
helpmymacfaster.trade herehloadibs.cf
highland-homes.com hermesbirkinhandbagoutlets.com
hit-men.men hermesreplica.win
hitcpm.com hitmuzik.ru
hmmm.cz hledejvshopech.cz
hotblog.top hoholikik.club
hotkeys.com homeart.space
hotsocialz.com horoshieokna.com
ideibiznesa2015.ru hotxnights.info
iflycapetown.co.za hoztorg-opt.ru
imagine-ex.co hully.altervista.org
import-sales.com hustoon.over-blog.com
incolors.club hvd-store.com
indo-export.ru hydropump.su
infodocsportal.com i-midias.net.br
interesnie-faktu.ru iklysha.ml
invivo.hu ilo134uloh.com
ipostroika.ru informatiecentro.be
irkutsk.online-podarki.com infoupdate.org
isitpaleo.info invitefashion.com
ispaniya-costa-blanca.ru iomoio.net
istizanidineanopiate.blogspot.com iqoption.com
itronics.ca irunfar.com
ivanovo.zrus.org iskalko.ru
janerikholst.se iwantedmoney.com
javatex.co.id izhevsk.zrus.org
javitas.info jeremyeaton.co
jmat.cn jerseyssportsshop.com
journeydownthescale.info jikoman.info
joy-penguin.com job.icivil.ir
justprofit.xyz johnnyhaley.top
kabbalah-red-bracelets.com jose.mulinohouse.co
kerch.site justkillingti.me
keywordglobal.co.za kerwinandcariza.com
kinoflux.net keywordhouse.com
kinozapas.com kidd.reunionwatch.com
kiskinhouse.com klin3952.ru
kladrus.ru knowsitall.info
koleso24.com.ua kochanelli.com
kollesa.ru kollekcioner.ru
kredit-blog.ru konkursowo-24.pl
laapp.com konturkrasoty.ru
labelwater.se kostenlos-sexvideos.com
lafriore.ru krassh.ru
lancheck.net kurbappeal.info
lawyersinfo.org landinez.co
laxob.com lapolis.it
lazy-z.com laulini.soclog.se
leftofcentrist.com law-check-eight.xyz
letmacworkfaster.site law-check-seven.xyz
linkredirect.biz lecbter-relationships.ga
linkwithin.com letslowbefast.today
lion.misba.us levaquin750mg.blogspot.com
liquimondo.com life-instyle.com
lirunet.ru lifeinsurancekb.com
loadingpages.me linkarena.com
locationdesaison.com lisque.batcave.net
lolnex.us livingroomdecor.info
lunchrock.co ljusihus.se
magda-gadalka.ru lmrauction.com
mall.uk louboutinreplica.pw
matsdale.com lsp-awak-perikanan.com
maxthon.com lunamedia.co
medispainstitute.com.au machicon-ueno.info
meduza-consult.ru macnewtech.com
megahdporno.net macresource.co.uk
metascephe.com mactechinfo.info
meteostate.com magicalfind-a.akamaihd.net
mexicosleevegastrectomy.com mansparskats.com
minegam.com maranbrinfo.com.br
mini.7zap.com mararoom.ru
misandesign.se marblestyle.ru
mobilemedia.md marcogrup.com
mobstarr.com marwer.info
moetomnenie.com master-muznachas.ru
monclerboots.xyz mastershef.club
mature.free-websites.com
medi-fitt.hu
mediawhirl.net
meetlocalchicks.com
mega-bony-2017.pl
megagrabber.ru
megakino.net
menhealed.net
metaxalonevstizanidine.blogspot.com
michaelkorsoutletstore.net
mobilierland.com
moinozhki.com
monclercoats.xyz monclercoats.xyz
monsterdivx.tv monclervests.xyz
moneyteam24.com
monthlywinners.com
moscow.online-podarki.com
moscow.xrus.org
moviemail-online.co.uk moviemail-online.co.uk
mtmtv.info mtmtv.info
mttwtrack.com muz-shoes.ru
muz-baza.net mybinaryoptionsrobot.com
myfreetutorials.com mydownloadengine.com
nalogovyykodeks.ru myfreecams.com
nastydollars.com myhitmp3.club
nerudlogistik.ru myhydros.org
nofreezingmac.work mysexpics.ru
nomuos.it nagdak.ru
nosecret.com.ua negociosdasha.com
nvformula.ru netoil.no
nw-servis.ru nfljerseyscheapbiz.us
o333o.com nfljerseysforsalewholesaler.com
obiavo.ru nhl09.ru
obsessionphrases.com nikhilbahl.com
oda.as novosibirsk.xrus.org
of-ireland.info npoet.ru
offer.camp nudepatch.net
okel.co o-o-8-o-o.com
onemactrckr.com offergroup.info
onlineporno.site ok.ru
onlyporno.ru olympescort.com
ooo-gotovie.ru omgtnc.com
ossmalta.com onclickpredictiv.com
ostroike.org openfrost.net
outrageousdeal-a.akamaihd.net ordernorxx.com
ozoz.it ownshop.win
parajumpersoutlet.online oxford-book.com.ua
painting-planet.com
parfusale.se
parvezmia.xyz parvezmia.xyz
pc-virus-d0l92j2.pw pastaleads.com
pestomou.info patol01.pw
petrovka-online.com pawli.eu
phuketscreen.com pc-test.net
piccshare.com pearlisland.ru
pintattoos.com peekyou.com
pistonclasico.com pensplan.com
pk-services.ru perfection-pleasure.ru
polcin.de perso.wanadoo.es
polska-poezja.com phormchina.com
popunder.net picswe.com
porn555.com pictures-and-images.com
pornodojd.ru picturesify.com
pornoelita.info piter.xrus.org
pornofeuer.com plaff-go.ru
pornpost.in playboyfiles.xblog.in
priceg.com pogodnyyeavarii.gq
pro-tec.kz poiskzakona.ru
prod2016.com poligon.com
progonrumarket.ru pons-presse.com
prokotov.com poppen-nw.net
pshare.biz popup.matchmaker.com
pts163.ru porndroids.com
pxhdwsm.com pornoforadult.com
q-moto.ru pornolook.net
qualitymarketzone.com pornosemki.info
quickbuck.com pornoslive.net
rebelmouse.com pornosok.ru
redhotfreebies.co.uk pornotubs.com
registrysweeper.com pornoxxx.com.mx
reimageplus.com pro-poly.ru
renecaovilla.online proftests.net
renecaovillasale.online prospekt-st.ru
rentalcarnavi.info prosperent.com
prostitutki-almata.org
quality-traffic.com
razamicroelectronics.com
recinziireale.com
redirectingat.com
redirectme.net
reelheroes.net
referencemoi.com
relax.ru
replica-watch.ru replica-watch.ru
rialp.getenjoyment.net resant.ru
ribieiendom.no resellerclub.com
ringporno.com retreatia.com
rubanners.com rff-cfal.info
ruf777.com rixpix.ru
rutor.vip rosbalt.com.ua
rybalka-opt.ru royalvegascasino.com
s-iwantyou.com rucrypt.com
sa-rewards.co.za saitevpatorii.com
salmonfishingsacramentoriver.com sanyuprojects.com
sbwealthsolutions.ca sarafangel.ru
scanner-barak.top satellite.maps.ilovevitaly.com
scanner-don.top sayyoethe.blogspot.co.za
scanner-fred.top scanmarine.info
schalke04fc.info scottbywater.com
sdelatmebel.ru searchencrypt.com
search.xtconnect.com searchinterneat-a.akamaihd.net
security60-e.com seminarykansas904.ml
securityallianceservices.com semxiu.com
semp.net seobility.net
seo18.su seoheap.com
seofirmreviewsus.info seorankinglinks.xyz
seorussian.ru seotoolsagency.com
service-core.ru seozoom.it
sex-tracker.com serviporno.com
sexkontakte-seite.com sex-dating.co
sexkvartal.com sex-watch.com
sexpornotales.net sfd-chess.ru
sexstream.pl shariki-zuma-lines.ru
shama-rc.net shemalegalls.blogporn.in
sharebutton.net shoesonlinebuy.cn
shoppingmiracles.co.uk shopsellcardsdumps.com
signal03.ru sideeffectsoftizanidine.blogspot.com
sispe.com.br signoredom.com
siteonomy.com simply.net
siteripz.net site-speed-check.site
skanninge.se skatestick.bid
skylta.com skutecznetabletkinaporostwlosow.pl
slayerlife.com slkrm.ru
slimcdn.com small-game.com
sluganarodu.ru smartadserver.com
smart-scripts.com sms2x2.ru
social-vestnik.ru smsactivator.ru
socialbutton.xyz snow.nvr163.com
soda.media snsdeainavi.info
soaksoak.ru
social-fun.ru
socialbookmarksubmission.org
socialtrade.biz
soft-program.com soft-program.com
songplanet.ru softonicads.com
sophang8.com softtor.com
sosdepotdebilan.com soundfrost.org
sotechco.co spamnuker.com
sport-video-obzor.ru spb.afora.ru
ssconstruction.co speedup-my.site
startwp.org splendorsearch-a.akamaihd.net
stillmiracle.com spravka-medosmotr.ru
stmassage.ru spywarenuker.com
stopnarco.ru stard.shop
streha-metalko.si statoutlook.info
stroilka.info stats-collector.org
summerlinhomes411.info stpolice.com
superstarfloraluk.com strana-krasoty.ru
swiped.su stretchingabuckblog.com
tacbibirfa.tk stroimajor.ru
suchenindeutschland.com
sukarame.net
sundrugstore.com
sunflowerdrawingpaintings.blogspot.com
supermama.top
surcentro.com
swimpool.ca
swinger-mobil.net
swinon.site
syndicate.fun
tam-gde-more.ru
tamada69.com tamada69.com
tasteidea.com tarad.com
telegramdownload10.com tattoo33.ru
thebestphotos.eu tech4master.com
thefarmergame.com teenbbw.yopoint.in
thexart.club telefonsexsofort.tk
tizanidine6mg.blogspot.com thecoolimages.net
tizanidinehcl2mg.blogspot.com thelottosecrets.com
tizanidinehcl2mgtablet.blogspot.com thenetinfo.com
thewomenlife.com
tiens2010.ru
tizanidine4mgstreetprice.blogspot.com
tizanidine4mguses.blogspot.com
tizanidinecost.blogspot.com
tizanidinehcl4mgtabinfo.blogspot.com tizanidinehcl4mgtabinfo.blogspot.com
tizanidinehcl4mgtablet.blogspot.com tizanidinehydrochloride4mgstreetvalue.blogspot.com
tizanidinesideeffects.blogspot.com tizanidineinteractions.blogspot.com
tizanidinevssoma.blogspot.com tizanidinerestlesslegsyndrome.blogspot.com
tobeyouday.win tizanidinesleepaid.blogspot.com
trafficshaper.com tizanidinevsvalium.blogspot.com
tri-slona.org tizanidinewithdrawal.blogspot.com
triplepanda.xyz tmearegion26.com
tsstcorpcddvdwshbbdriverfb.aircus.com todohr.com
tuckpointingmasonrysystems.com tomck.com
turbo-suslik.org torrent-to-magnet.com
tvorozhnaja-zapekanka-recept.ru toursmaps.com
ufa.xrus.org toyota.7zap.com
ukrtextbook.com track112.site
umityangin.net traffic-club.info
unisexjewelry.org traffic100.com
urccvfmc.bloger.index.hr ttsq.fr
url-extractor.xyz tuckermktg.com
urlopener.blogspot.com.au turbodsp.com
uroki.net turizm.bz
uzporno.mobi turizmus.us
vadimkravtcov.ru tvnewsclips.info
valmetrundan.se u-cheats.ru
vbabule.net uhodzalijami.ru
vekzdorov.ru umaseh.com
veopornogratis.xxx unrealcommander.com
viandpet.com uptimechecker.com
video-chat.in vasileostrovsky-rayon.ru
video-chat.love ventelnos.com
videochaty.ru via-energy-order.com
videositename.com viagraneggrx.com
villacoloniale.com viagroid.ru
vip-dom.in viddyoze.com
vodkoved.ru video-chat.cn
vtcdns.com videojam.tv
vut.com.ru vipsexfinders.com
vysigy.su virus-schutzmasken.de
wapsite.me vkonche.com
voltrknc1.com
vucms.com
vzlomsn.org
warezkeeper.com warezkeeper.com
wdrake.com waterefficiency.co
webads.co.nz webcamtalk.net
webinstantservice.com webnode.me
weboptimizes.com webpromotion.ae
website-datenbank.de webradiology.ru
whatsappbot.flyland.ru welck.octopis.com
wingsoffury2.com welcomeauto.ru
winterclassichockeyjerseys.com wellcome2slovenia.ru
wonderfulflowers.biz wemedinc.com
word-vorlagen.net wesharepics.com
wormix-cheats.ru wheelchairliftsarea.com
worst-sites.online whiteproduct.com
wsgames.ru withstandingheartwarming.com
wjgony.com
worldinternetauthority.com
worldlovers.ru
wrona.it
ws.ampower.me
wurr.voila.net
www.bookmaker-bets.com
www.event-tracking.com www.event-tracking.com
www.jbetting.com www.labves.ru
www.kabbalah-red-bracelets.com xcombear.ru
www.pinnacle-bets.com xerox-douglas.cf
www.souvenirua.com xingzi-vision.com
wzgyyq.com xn----7sbifcamovvfggw9d.xn--p1ai
x-diesel.com xn----9sbubg3ambdfl1j.xn--p1ai
x-lime.net xn----ctbigni3aj4h.xn--p1ai
xaylapdiendanang.com xn--1-8sbcpb0bdm8k6a.xn--p1ai
xjlottery.com xn--80aagddcgkbcqbad7amllnejg6dya.xn--p1ai
xn-----6kcaabbafhu7cskl7akvongwpo7hvjj.xn--p1ai xn--80aeahghtf8ac5i.xn--p1ai
xn----7sbaaabaei0cc8aj5bj0bncejx.xn--p1ai
xn--80ajbshivpvn2i.xn--p1ai xn--80ajbshivpvn2i.xn--p1ai
xolodremont.ru xn--oogle-wmc.com
xtubeporno.net xnxx-n.com
xxxguitars.com xtremeeagles.net
xwatt.ru
xxart.ru
xz618.com xz618.com
yatrk.xyz y8games-free.com
yebocasino.co.za yopoint.in
yougetsignal.com yourdesires.ru
youghbould.wordpress.com yourothersite.com
yoursearch.me yur-p.ru
zagadki.in.ua zarabotok--doma.ru
zapiszto.pl
zarabiaj-dzis.pl
zdesoboi.com zdesoboi.com
zed21.net
zeroredirect2.com zeroredirect2.com
zhorapankratov7.blogspot.com zeroredirect6.com
znakomstvaonlain.ru zojirushi-products.ru
zootoplist.com zone-kev717.info
zrelaya.pw zscalerone.net
zscalertwo.net

468
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
08800.top 5i2.net
0n-line.tv 7fon.ru
1flag.co.za a.pr-cy.ru
1qingdao.com acc.eu.org
3rbseyes.com adinterax.com
5u.com
acads.net
adcash.com
adclickservice.com
adsref.men adsref.men
adtech.de affiliate-fr.com
adtech.us airlandsea.info
advancedsoftwaresupport.com allnews24.in
ahmedabadwebs.com apelsinnik.website
albuteroli.com apibrowsesmartne-a.akamaihd.net
alert-jdh.xyz ardimobileinfo.ml
alfa9.com arquapetrarca.info
allkrim.com asrvrep-a.akamaihd.net
amateurmatch.com
ample-awards-today.us
androids-store.com
anniemation.com
aosheng-tech.com
apiallgeniusinfo-a.akamaihd.net
app5.letmacworkfaster.world
apper.de
appfastplay.com
apple.com-webbrowsing-security.science
applicationg29.com
arclk.net
astrochicks.com
autochoixspinelli.com autochoixspinelli.com
aversis.net aviapanda.ru
ayakino.net banki76.ru
baditri.com bdsmgalls.net
bala.getenjoyment.net belinvestdom.by
balook.com bestcurs.org
bangla-chat-uk-paralud.ga blackplanet.com
bank.uz blog.f00kclan.de
berlininsl.com bloggedporn.com
best-way.men bobba.dzaba.com
besthoro.ru boole.onlinewebshop.net
bigcities.org bosefux.esy.es
bjgugu.net.ua braip.com.br
blockworld.ru budpost.com.ua
bnt-team.com buigas.00it.com
bonux.nextview.ru calcularpagerank.com
bravegirlsclub.com candiceloves.us
businesn.men canvas.gloverid.site
buyfriend.ru celebsopics.com
cablecar.us cenoval.ru
callstevens.com ceotrk.com
cartierreplica.xyz chatroulette.si
cashkitten-a.akamaihd.net check-this-out-now.online
cfcl.co.uk checkpagerank.net
cheapestjerseysonwholesale.com chlooe.com
checkhit.com choosecuisine.com
clean-virus-mac.com clarithromycin500mg.com
clothesforcash.com cleansearch.net
cognitiveseo.com clickbank.net
compliance-brian.top clmforexeu.com
copro.pw co.lumb.co
creams.makeforum.eu coderstate.com
dairyindia.in compliance-andrew.xyz
daretodonate.co coolwallpapers4k.info
data.vtc.pw corta.co
deadlinkchecker.com data1.scopich.com
detective01.ru digest-project.ru
detki-opt.ru directivepub.com
digilander.libero.it discovertreasurenow.com
dividendo.ru dktr.ru
domain2008.com doctissimo.fr
domaincheck.io dogoimage.com
dumpsmania24.com dogsrun.net
easyukraine.com drunkmoms.net
ecxtracking.com duawitchrarato.tk
elektrischezigarette2.onsugar.com easycommerce.cf
escortplius.com edelstahlschornstein-123.de
europeanwatches.ru empirepoker.com
eropho.com
erotik-kostenlos.net
extads.net extads.net
farmprofi.net feel-planet.com
fatfasts-4tmz.com feeriaclub.ru
favoritemoney.ru findclan.org
femdom.twiclub.in formularz-konkurs.tk
ff30236ddef1465f88547e760973d70a.com forodvd.com
firma-legion.ru freeuploader.com
frameimage.org
free-gluten.ru
freshberry.com.ua
fuck-paid-share-buttons.xyz
fugarif.ga
fyl.com.ru fyl.com.ru
galeria-zdjec.com g.starmoe.xyz
gateway.zscalerone.net garciniaxt.us
gazporno.com
gfaq.ru
girlgamerdaily.com
globatur.ru
gloverid.site
gnuetella.com gnuetella.com
golmau.host.sk go2mike.ru
gomusix.com goldadpremium.com
gosmeb.ru goosefishpost.bid
gpms.org.my gosreg.amchs.ru
greatfind-a.akamaihd.net greatfind-a.akamaihd.net
guildebzh.info gta-club.ru
hamilton.ca hayate.biz
harmonyglen.us hd-filmy.net
hawaiielectriclight.com heliko.no
hd-film.pl hifidesign.ru
homemade.gq histats.com
hopeonthestreet.co.uk housemilan.ru
hoste.octopis.com hoverboard360.nl
howopen.ru i-midias.net.br
hydropump.su images-graphics-pics.com
igru-xbox.net internet-apteka.ru
ilovevitaly.com istock-mebel.ru
imadedinner.net iwantmyfreecash.com
images-free.net iweblist.info
imk.com.ua javidol.site
infoupdate.org javspace.net
iplogger.org kabbalah-red-bracelets.com
istizanidinelikexanax.blogspot.com karadene.com
ixora.pro karusel-market.ru
journalhome.com keywordsdoctor.com
journeydownthescale.info klejonka.info
justbcause.com klin3952.ru
kino2018.club kopihijau.info
klumba55.ru krafte.ru
knowyournextmove.com ks1234.com
kol-energo.ru laudit.ru
koral.se lawyersinfo.org
kreativperlen.ch lesbian.xyz
lampokrat.ws lescinq.com
landinez.co lida-ru.com
letsrepair.in life-instyle.com
livingcanarias.com life.biz.ua
ljusihus.se littleberry.ru
lockerz.com littlesunraiser.com
lookingglassemb.com lodki-pvh.dp.ua
lsex.xyz lsex.xyz
m292.info lsp-awak-perikanan.com
magazin-pics.ru mac-shield.com
magnetpress.sk
mainhp.net mainhp.net
malwareremovalcenter.com makenahartlin.com
managerpak204.weebly.com mebelcomplekt.ru
manve.info
mearns-tractors.co.uk
medi-fitt.hu
meetlocalchicks.com
megahdporno.net megahdporno.net
megaindex.ru
megakino.net
michaelkorsoutlet.store michaelkorsoutlet.store
monarchfind-a.akamaihd.net mir-business-24.ru
moskva.nodup.ru mmgq.ru
motherboard.vice.com mmofreegames.online
musicdaddy.net moneyzzz.ru
mycouponizemac.com muz-tracker.net
mymobilemoneypages.com myblogregistercm.tk
nacap.ru mylesosibirsk.ru
neks.info myperiod.club
new-apps.ru mysex21.com
next-dentists.tk namecrumilchlet.tk
nextlnk12.com naval.jislaaik.com
nibbler.silktide.com netfacet.net
nippon-bearings.ru netoil.no
newstraveller.ru
newyorkhotelsmotels.info
nikitabuch.com
nodding-passion.tk nodding-passion.tk
nofreezingmac.work nsatc.net
oakleyglassesonline.us o00.in
onclickpredictiv.com o333o.com
oneminutesite.it online-templatestore.com
online7777.com onlineku.com
osb.se11.ru onlinemegax.com
oz-offers.com onlinetvseries.me
page2rss.com outshop.ru
partner-trustworthy.men ownshop.cf
oyster-green.com
paccohichetoti.ml
panouri-solare-acoperis.com
pearlisland.ru
perl.dp.ua
pestomou.info pestomou.info
photosaga.info photosaga.info
physfunc.ru picphotos.net
pinapchik.com pillscheap24h.com
plastjulgranar.se pio.polytopesexempt.com
pobeiranie.pl piter.xrus.org
podshipniki-nsk.ru pladform.ru
pod-muzyku.club
polimga.pw polimga.pw
poquoson.org polytopesexempt.com
porno-transsexuals.ru popserve.adscpm.net
prombudpostach.com.ua profitsport.club
promover.org progonrumarket.ru
rightenergysolutions.com.au proprostatit.com
rimedia.org proxyelite.biz
rossmark.ru rating-bestcasino.com
redirect.trafficreceiver.club
regdefense.com
registry-clean-up.net
restorator-msk.ru
robotixix.com
rossanasaavedra.net
royal-betting.net
rus-teh.narod.ru rus-teh.narod.ru
ruscopybook.com saratov.xrus.org
ryetaw.com scalerite.co.za
s-forum.biz scat.porn
sadaholding.com searchengineranker.email
sakhboard.ru secretscook.ru
scanmyphones.com semalt.com
scanner-elena.top
sdrescher.net
sdsjweb.com
seo-2-0.com seo-2-0.com
serw.clicksor.com shell-pmr.ru
sexpornotales.com shop.acim.org
sextracker.be shoppytoolmac.com
sexyali.com sildenafilcitratemed.com
shopperifymac.com sitevalued.com
shtaketniki.ru skatestick.bid
shtora66.ru slutloadlive.com
skytraf.xyz smadihome.com
snip.tw social-fun.ru
sohoindia.net solinf.co
stats-public.grammarly.io stmassage.ru
steamoff.net strongholdsb.ru
stroicol.net sukarame.net
sunflowerdrawingpaintings.blogspot.com sumo.com
taboola.com suralink.com
taihouse.ru surflinksmedical.com
takeflyte.com svarbit.com
the-usa-games.blogspot.com swiped.su
thebluffs.com syvertsen-da.no
timer4web.com tamada69.com
top250movies.ru tech4master.com
torrent-newgames.com tfxiq.com
trackzapper.com thenetinfo.com
trubywriting.com thruport.com
tsan.net tizanidine4mgstreetvalue.blogspot.com
tvoystartup.ru tizanidinecost.blogspot.com
unimodemhalfduplefw.pen.io tracksz.co
upproar.com traderzplanet.in
url-img.link traffic100.com
ustion.ru twojebook.pl
vasileostrovsky-rayon.ru unitygame3d.com
vkontaktemusic.ru usswrite.com
vonradio.com vclicks.net
vozbujdenie.com videojam.tv
vvpg.ru videtubs.pl
wait3sec.org vk-mus.ru
web-betting.ru vmnmvzsmn.over-blog.com
westen-z.life vseigry.fun
wordkeyhelper.com vzlomfb.com
xblog.in watracker.net
xingzi-vision.com web-analytics.date
xmronta.com website-speed-up.top
xnxx-n.com wellcome2slovenia.ru
youtubedownload.org wemarketing.se
zigarettenonlinekaufen1.blox.pl worldhistory.biz
zlatnajesen.com xn-----6kccaibs5cb8afhjrfmix2n.xn--p1ai
xn----7sbaaabaei0cc8aj5bj0bncejx.xn--p1ai
xn----8sblgmbj1a1bk8l.xn----161-4vemb6cjl7anbaea3afninj.xn--p1ai
xn--80atua3d.xn--p1ai
xn--e1aggki3c.xn--80adxhks
xolodremont.ru
xvideosbay.com
xvideosporn.biz
yebocasino.com
yoshkarola.zrus.org
youjizz.com
yourads.website
yourmovies.pl
yourtemplatefinder.com
yur-p.ru
zacreditom.ru
zajm-zalog-krasnodar.ru
zeroredirect7.com
zrus.org
zs2vm.top

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.207 0; 10.1.1.167 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2021.08.2515 ### Version: V4.2021.08.2516
### Updated: Mon Aug 9 22:01:16 UTC 2021 ### Updated: Tue Aug 10 10:03:22 UTC 2021
### Bad Bot Count: 620 ### Bad Bot Count: 620
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2021.08.2515 ### Version: V4.2021.08.2516
### Updated: Mon Aug 9 22:01:16 UTC 2021 ### Updated: Tue Aug 10 10:03:22 UTC 2021
### Bad Bot Count: 620 ### Bad Bot Count: 620
################################################### ###################################################
### Version Information ## ### Version Information ##