vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-09 22:05:46 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2022.07.3238 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2022-07-20 10:09:28 +00:00
parent 00aeee7cc4
commit cf01aa5f39
46 changed files with 100287 additions and 100287 deletions
Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.07.3237 #### Version: V4.2022.07.3238
#### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.07.3237 #### Version: V4.2022.07.3238
#### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -14,7 +14,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2022.07.3237 #### Version: V4.2022.07.3238
#### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

12400
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2022.07.3237 #### Version: V4.2022.07.3238
#### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

12404
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

12404
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

12404
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

12404
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.244 1; 10.1.1.190 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.244 0; 10.1.1.190 0;
127.0.0.1 0; 127.0.0.1 0;

12404
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.244 1; 10.1.1.190 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.244 0; 10.1.1.190 0;
127.0.0.1 0; 127.0.0.1 0;

12404
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.244 1; 10.1.1.190 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.244 0; 10.1.1.190 0;
127.0.0.1 0; 127.0.0.1 0;

12404
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
3237 3238

12404
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

12404
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.25.188.221 0; 20.245.71.116 0;

12404
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.244 1; 10.1.1.190 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.244 0; 10.1.1.190 0;
127.0.0.1 0; 127.0.0.1 0;

12404
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.244 1; 10.1.1.190 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.244 0; 10.1.1.190 0;
127.0.0.1 0; 127.0.0.1 0;

12404
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.244 1; 10.1.1.190 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.244 0; 10.1.1.190 0;
127.0.0.1 0; 127.0.0.1 0;

12404
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.25.188.221 0; 20.245.71.116 0;

12404
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.25.188.221 0; 20.245.71.116 0;

12404
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.244 1; 10.1.1.190 1;
127.0.0.1 1; 127.0.0.1 1;

18
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
Buddy Discobot
HTTP::Lite GrapeFX
LeechGet MSIECrawler
Navroad RedesScrapy
Nuclei Sitebeam
SearchmetricsBot Sucker
SemanticJuice
Upflow Upflow
VCI WebmasterWorldForumBot
WWWOFFLE Widow
webprosbot

308
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
01h4x.com
360Spider 360Spider
404checker
404enemy
ADmantX ADmantX
AIBOT
ALittle Client ALittle Client
ASPSeek Aboundex
Abonti AhrefsBot
Acunetix AiHitBot
AfD-Verbotsverfahren Anthill
Aipbot Aspiegel
Alexibot
AllSubmitter
Alligator
Anarchie
Anarchy
Ankit
Asterias
Attach
AwarioSmartBot AwarioSmartBot
BBBike BackStreet
BackDoorBot Badass
BackWeb Bandit
Battleztar Bazinga
Bigfoot Bigfoot
Bitacle
BlackWidow BlackWidow
BlowFish
Boardreader Boardreader
Bolt Brandprotect
Buck
Buddy Buddy
BuiltWith BuiltWith
BunnySlippers CATExplorador
BuzzSumo ChinaClaw
CheTeam
Chlooe Chlooe
Cliqzbot
Cloud mapping
Cocolyzebot Cocolyzebot
Cogentbot Copier
Copyscape CopyRightCheck
Craftbot Cosmos
Crawling at Home Project Crawling at Home Project
CrazyWebCrawler
Crescent
CrunchBot CrunchBot
Custo Custo
CyotekWebCopy DBLBot
DataCha0s
DatabaseDriverMysqli DatabaseDriverMysqli
Deusu
Dirbuster Dirbuster
Discobot Discobot
Discoverybot Dispatch
DnBCrawler-Analytics DnyzBot
DomainCrawler DomainAppender
DomainSigmaCrawler DomainSigmaCrawler
EasyDL Domains Project
EroCrawler Dotbot
Evil Download Wonder
Drip
ECCP/1.0
EMail Siphon
Ecxi
Express WebPictures Express WebPictures
EyeNetIE ExtLinksBot
FDM ExtractorPro
Fimap FHscan
Flunky FemtosearchBot
FrontPage
Fuzz Fuzz
FyberSpider FyberSpider
Fyrebot
GT::WWW
GalaxyBot GalaxyBot
GermCrawler
GetRight GetRight
Gigabot
Go-Ahead-Got-It
GoZilla GoZilla
GrabNet
Grabber Grabber
GrapeshotCrawler GridBot
HEADMasterSEO HTMLparser
HTTrack Haansoft
Hloader Harvest
Havij
HonoluluBot HonoluluBot
IDBot IDBot
Iblog
Id-search
IlseBot IlseBot
Image Sucker Indy Library
Internet Ninja Intelliseek
Iria InterGET
IstellaBot JamesBOT
JennyBot Jetty
Jorgee
JustView JustView
Kenjin Spider Kinza
LeechFTP
LeechGet LeechGet
Lftp LexiBot
LibWeb LieBaoFast
Lightspeedsystems
Likse
LinkScan
LinkWalker LinkWalker
Linkbot Linkbot
LinkextractorPro
LinksManager
LinqiaRSSBot LinqiaRSSBot
LinqiaScrapeBot LinqiaScrapeBot
Lipperhey Lipperhey Spider
Litemage_walker Ltx71
MIDown tool
MIIxpc MIIxpc
MJ12bot
MSFrontPage
MTRobot MTRobot
Magnet
Mail.RU_Bot Mail.RU_Bot
Majestic SEO Majestic SEO
Majestic-SEO Majestic12
Mass Downloader Masscan
MauiBot Meanpathbot
Mediatoolkitbot
MegaIndex.ru MegaIndex.ru
Metauri
MicroMessenger MicroMessenger
Microsoft URL Control
Moblie Safari Moblie Safari
MolokaiBot MolokaiBot
Morfeus Fucking Scanner
Musobot Musobot
Navroad NICErsPRO
NetAnts Needle
Netcraft Nessus
Nettrack Net Vampire
Netvibes NetLyzer
NetMechanic
NextGenSearchBot NextGenSearchBot
Nibbler Nibbler
Niki-bot
Nikto Nikto
NimbleCrawler
Nuclei Nuclei
Nutch Offline Explorer
OnCrawl
Openfind Openfind
OrangeBot OrangeBot
OrangeSpider
OutfoxBot OutfoxBot
Pandalytics PECL::HTTP
Panscient PageGrabber
Picscout PageScorer
PageThing.com
Picsearch
PictureFinder
PleaseCrawl
ProWebWalker
Psbot Psbot
PxBroker
PyCurl
QueryN Metasearch QueryN Metasearch
Quick-Crawler RankActiveLinkBot
RSSingBot RankingBot
RankActive RankingBot2
RankFlex
Re-re Re-re
ReGet
RealDownload RealDownload
Reaper RebelMouse
RepoMonkey RedesScrapy
Ripper Ripper
SBIder Rogerbot
SEOlyticsCrawler SEOkicks-Robot
SEOprofiler SISTRIX
SEOstats ScanAlert
SMTBot
SalesIntelligent
ScrepyBot ScrepyBot
Searchestate Searchestate
Seekport Seekport
SemanticJuice SemanticJuice
Semrush SeoSiteCheckup
Shodan Seomoz
Siphon Siphon
SiteLockSpider Site Sucker
SiteSnagger Sitebeam
SiteSucker Siteimprove
SlySearch
SmartDownload
Snoopy
Sociscraper Sociscraper
Sosospider Sosospider
SpaceBison Spbot
Spammen
SpankBot
Spinn3r Spinn3r
SputnikBot Sucuri
Sqlmap
Sqworm
SuperBot SuperBot
Surfbot SuperHTTP
SurveyBot SurveyBot
Teleport Suzuran
Swiftbot
T0PHackTeam
TeleportPro TeleportPro
Telesoft
Telesphoreo Telesphoreo
Telesphorep TheNomad
Thumbor Toata
TightTwatBot Toweyabot
Titan
Tracemyfile
Trendictionbot Trendictionbot
True_Robot True_Robot
Turingos Turingos
URLy Warning Turnitin
TurnitinBot
Twice
Typhoeus
URLy.Warning URLy.Warning
Vacuum Vacuum
VelenPublicWebCrawler VeriCiteCrawler
VidibleScraper VoidEYE
Virusdie
Voil Voil
WBSearchBot Voltron
WISENutbot WISENutbot
WWW-Collector-E WPScan
WWW-Mechanize
WWWOFFLE
Wallpapers/3.0
WallpapersHD
WeSEE WeSEE
Web Auto Web Auto
Web Collage Web Enhancer
WebBandit Web Fetch
WebEnhancer Web Fuck
Web Pix
Web Sucker
WebFetch WebFetch
WebGo IS
WebPix WebPix
WebReaper WebReaper
WebSauger WebSucker
WebStripper WebZIP
WebWhacker WebmasterWorldForumBot
WebsiteExtractor WebsiteQuester
Webster Webster
Whack Whacker
Whatweb Whatweb
WiseGuys Robot
Woobot Woobot
Wotbox Xaldon WebSpider
Xenu Xaldon_WebSpider
YoudaoBot YoudaoBot
Zade
Zeus
ZmEu
ZoomBot ZoomBot
ZoominfoBot ZoominfoBot
ZumBot
adscanner adscanner
arquivo-web-crawler archive.org_bot
arquivo.pt arquivo.pt
cah.io.community backlink-check
coccocbot clark-crawler
cognitiveseo
crawl.sogou.com
crawler4j crawler4j
demandbase-bot demandbase-bot
domainsproject.org eCatch
evc-batch
facebookscraper
gopher gopher
iubenda-radar heritrix
linkdexbot ips-agent
isitwp.com
lwp-request lwp-request
magpie-crawler
mediawords
muhstik-scan
netEstate NE Crawler netEstate NE Crawler
oBot polaris version
page scorer probe-image-size
ripz
scan.lol scan.lol
seoscanners seobility
seostar seostar
sitechecker.pro sexsearcher
siteripz
sogouspider sogouspider
tAkeOut webgains-bot
trendiction.de x22Mozilla
ubermetrics-technologies.com
webpros.com
xpymep1.exe
zauba.io zauba.io
zgrab

294
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
01h4x.com 01h4x.com
360Spider
404checker 404checker
80legs
AIBOT
ALittle Client
ASPSeek ASPSeek
Abonti
Aboundex
Acunetix Acunetix
Aipbot Alexibot
Alligator AllSubmitter
AlphaBot AlphaBot
Anarchie Apexoo
Anarchy BBBike
Aspiegel BLEXBot
Asterias BackWeb
Atomseobot Badass
AwarioSmartBot Bandit
BackDoorBot
Backlink-Ceck
Barkrowler Barkrowler
Battleztar Bazinga Battleztar Bazinga
Blackboard BetaBot
Bigfoot
BlowFish BlowFish
BotALot Bolt
Buck Buck
CATExplorador CCBot
CSHttp CSHttp
CensysInspect
CheTeam CheTeam
Chlooe Chlooe
Citoid
Claritybot Claritybot
Collector Cliqzbot
Craftbot Cocolyzebot
Curious CopyRightCheck
DBLBot Copyscape
Cosmos
Crawling at Home Project
Custo
CyotekWebCopy
DIIbot DIIbot
DTS Agent DTS Agent
Digincore Deusu
DigitalPebble Dirbuster
Disco Disco
Discobot
Discoverybot Discoverybot
Dispatch DnyzBot
DomCopBot DomainCrawler
DomainSigmaCrawler DomainSigmaCrawler
Download Wonder Download Wonder
ECCP/1.0 ECCP/1.0
EMail Wolf EMail Siphon
EasyDL EasyDL
Ebingbong ExtractorPro
Evil Extreme Picture Finder
Ezooms EyeNetIE
FDM FHscan
FemtosearchBot FemtosearchBot
Fimap Fimap
Firefox/7.0
FlashGet FlashGet
FrontPage
G-i-g-a-b-o-t
GT::WWW GT::WWW
GetRight GetRight
Gigabot GetWeb
GoZilla Getintent
GrabNet Gotit
Grabber Grabber
GrapeFX Grafula
GrapeshotCrawler GrapeshotCrawler
HEADMasterSEO
HTMLparser HTMLparser
HTTP::Lite
Haansoft
Harvest Harvest
Heritrix
Hloader Hloader
HonoluluBot HonoluluBot
IDBot Humanlinks
IlseBot
Image Fetch
Image Sucker Image Sucker
Indy Library IndeedBot
InfoNaviRobot InfoTekies
Intelliseek InternetSeer
Iria
JOC Web Spider JOC Web Spider
JamesBOT
Jbrofuzz Jbrofuzz
Jetty
JikeSpider
Joomla Joomla
Jorgee
JustView JustView
Kenjin Spider
Kinza Kinza
LWP::Simple
Larbin Larbin
Leap LeechGet
LexiBot
Libwhisker Libwhisker
LieBaoFast Likse
Lightspeedsystems LinkWalker
Linkbot LinkextractorPro
LinkpadBot LinkpadBot
LinqiaMetadataDownloaderBot LinksManager
LinqiaScrapeBot Lipperhey
Lipperhey Spider
Litemage_walker
Ltx71 Ltx71
MFC_Tear_Sample
MJ12bot
MTRobot
Mag-Net Mag-Net
Mass Downloader Majestic-SEO
Mata Hari MarkMonitor
Masscan
Mb2345Browser Mb2345Browser
Meanpathbot
MegaIndex.ru MegaIndex.ru
Mojeek MicroMessenger
Microsoft Data Access
Microsoft URL Control
Minefield
Mister PiX
Moblie Safari
Mojolicious
Morfeus Fucking Scanner Morfeus Fucking Scanner
Musobot Msrabot
NICErsPRO
NPbot NPbot
Nameprotect Nameprotect
NetAnts NearSite
NetMechanic Needle
NetLyzer
NetSpider
NetZIP
Nettrack
Netvibes
NextGenSearchBot NextGenSearchBot
Nibbler
Niki-bot Niki-bot
NimbleCrawler
Nmap
Nutch
OpenLinkProfiler
OpenVAS OpenVAS
Openvas
OutclicksBot OutclicksBot
PECL::HTTP PageScorer
PHPCrawl PageThing.com
POE-Component-Client-HTTP Pandalytics
PageGrabber Papa Foto
Panscient
Pavuk Pavuk
PeoplePal PeoplePal
Pi-Monster Pi-Monster
PictureFinder
Pimonster Pimonster
Pixray Pixray
PleaseCrawl
Pockey Pockey
ProWebWalker ProWebWalker
Probethenet
Pu_iN
PxBroker PxBroker
Quick-Crawler PyCurl
RankActive QueryN Metasearch
Rankivabot RankActiveLinkBot
ReGet RankingBot
RealDownload Recorder
RedesScrapy RepoMonkey
Ripper RocketCrawler
Rogerbot
SBIder
SEOkicks SEOkicks
SEOkicks-Robot SEOkicks-Robot
SEOprofiler
SEOstats SEOstats
SISTRIX SISTRIX
SMTBot SalesIntelligent
Scanbot ScanAlert
ScoutJet ScoutJet
ScreenerBot
ScrepyBot
Searchestate Searchestate
Semrush SearchmetricsBot
SemanticJuice
SemrushBot SemrushBot
SentiBot SeoSiteCheckup
SeobilityBot Seomoz
Shodan SiteExplorer
Siphon SiteSucker
Site Sucker Sitebeam
SiteLockSpider
SiteSnagger
Siteimprove Siteimprove
Sitevigil Sitevigil
SlySearch SlySearch
Snake Snoopy
SocialRankIOBot SocialRankIOBot
Sociscraper
Sogou web spider Sogou web spider
Sottopop Sottopop
SpaceBison
Spammen Spammen
SpankBot
Spbot Spbot
Spinn3r
SputnikBot SputnikBot
SuperBot Stripper
Suzuran Suzuran
Swiftbot Swiftbot
Szukacz TeleportPro
T8Abot
Teleport
Telesphoreo
Telesphorep Telesphorep
The Intraformant
Thumbor Thumbor
Tracemyfile TightTwatBot
Toweyabot
Trendictionbot
True_Robot True_Robot
Turingos Turingos
Typhoeus Turnitin
URLy.Warning TurnitinBot
VB Project URLy Warning
VCI UnisterBot
Vacuum Upflow
Vagabondo
VelenPublicWebCrawler VelenPublicWebCrawler
VeriCiteCrawler VidibleScraper
VoidEYE WWW-Collector-E
Voil
Voltron
WWW-Mechanize
WWWOFFLE WWWOFFLE
WeSEE WallpapersHD
Web Auto
Web Collage Web Collage
Web Enhancer
Web Pix Web Pix
WebBandit Web Sucker
WebEnhancer WebFuck
WebGo IS WebGo IS
WebLeacher
WebPix WebPix
WebStripper
WebSucker WebSucker
WebZIP WebZIP
WebmasterWorldForumBot
Webshag Webshag
Website Quester
WebsiteExtractor
WebsiteQuester WebsiteQuester
Whack
Whacker
Whatweb Whatweb
Who.is Bot Wonderbot
WinHTTrack Xaldon_WebSpider
WiseGuys Robot YoudaoBot
Zauba
Zitebot Zitebot
ZoomBot ZmEu
ZoominfoBot ZoominfoBot
ZumBot autoemailspider
arquivo-web-crawler backlink-check
arquivo.pt check1.exe
cah.io.community coccocbot
cognitiveseo
com.plumanalytics com.plumanalytics
crawler.feedback
crawler4j
demandbase-bot
eCatch eCatch
evc-batch gopher
heritrix isitwp.com
internetVista monitor lwp-request
ips-agent magpie-crawler
lwp-trivial meanpathbot
mediawords
muhstik-scan muhstik-scan
netEstate NE Crawler netEstate NE Crawler
oBot oBot
page scorer
plumanalytics plumanalytics
polaris version
probe-image-size probe-image-size
satoristudio.net seoscanners
scalaj-http sp_auditbot
seobility sysscan
trendiction.de ubermetrics-technologies.com
webgains-bot webprosbot
x09Mozilla x09Mozilla
zgrab zauba.io

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
aviav.ru.com bezlimitko.xyz
indetiske.ya.ru blogporn.in
iron-age.info dengi-pod-zalog-nedvizhimosti.ru
kostenlos-sexvideos.com eropho.com
kriokomora.info exdocsfiles.com
mxgetcode.com historichometeam.com
rednise.com homeinns.com
sadaholding.com mebel-vstroika.ru
samo-soznanie.ru papasdelivery.ru
tvorozhnaja-zapekanka-recept.ru small-games.biz

938
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
20pascals.nl 1-99seo.com
24x7-server-support.site 1-free-share-buttons.com
2pxg8bcf.top 273-fz.ru
2rich4bitches.com
4kpics.rocks
4pp13.com
5-steps-to-start-business.com
55wmz.ru
57883.net
5i2.net 5i2.net
a.frcls.fr 66cpwgln.space
aad1f4acb0a373420d9b0c4202d38d94fa.com 70casino.online
abovetherivernc.com abovetherivernc.com
accessoires-mode.in acmebtn.ml
acgs.tk actices.com
adclickservice.com actulite.com
adclickthru.net adamoads.com
adpremium.org add-add.men
adtech.fr adloads.net
adult3dgames.com adman.se
agadelha.com.br adrunnr.com
aghanyna.com adtech.us
alert-jdh.xyz adzerg.com
all-streaming-media.com aerogo.com
alldubai.biz agapovdg.ru
allforminecraft.ru agroeconom.kz
alveris.ru aktivator-windows10.blogspot.com
alarmobninsk.ru
alekseevec.ru
alfa-img.com
all-number.com
all4invest.ru
alltheviews.com
allwidewallpapers.com
alvtank.se alvtank.se
anaseracresar.tk amigobulls.com
animali.deagostinipassion.it amospalla.es
animaltoplist.com animal36.com
apxeo.info apccargo.com
arendas.net apiqualitinknet-a.akamaihd.net
autotrends.today apparel-offer.com
avtocredit-legko.ru appfastplay.com
bank.uz arewater.com
bensbargains.net astana.xxxkaz.org
berrymall.ru auto-zapchasti.org
best-seo-offer.com autorn.ru
betonka.pro aviav.eu
betterscooter.com avtointeres.ru
beyan.host.sk bankcrediti.ru
bikini-image.com banksrf.ru
bird1.ru bannerconnect.net
bitcoinremote.com bazaronline24.ru
blackplanet.com begalka.xyz
bloggen.be beztuberkuleza.ru
bloglag.com bibys.com
blogos.kz big-cash.net
blogqpot.com biznesrealnost.ru
bjgugu.net.ua
blackwitchcraft.ru
blog.koreadaily.com
blog.yam.com
bluerobot.info bluerobot.info
boanonihaca.tk bpro1.top
bochemit.com.ua brakehawk.com
bonzbuddy.com brg8.com
boostmyppc.com briomotor.co
bosman.pluto.ro builtwith.com
brainsandeggs.blogspot.com buy-cheap-online.info
brianhenry.co buy-cheap-pills-order-online.com
btnativenav.com buyantiviralwp.com
btvn.ru buypuppies.ca
buckspar.gq buzzonclick.com
bum.com.ru bvlgariring.xyz
burger-imperia.com bvlgariwallet.xyz
buy-meds24.com bwlx.prepedu.cn
camdolls.com byme.se
camsex.xxx-cam.webcam bytimedance.ru
capsderfudd.tk c-gainsbourg.com
carmuffler.net c1.onedmp.com
cartierreplica.win cah.io.community
cakemediahq.com.au
calcularpagerank.com
camel-beach.com
cand.jp
candy-glam-hp.com
canyougethighofftizanidine.blogspot.com
capture-room.com
cartujano-pre.de cartujano-pre.de
censys.io cashkitten-a.akamaihd.net
cerev.info cdnanalytics.xyz
chatroulette.si cdncash.com
cherrypointplace.ca centre-indigo.org.ua
cherubinimobili.it checkpagerank.net
choice-credit.ru chidporn.com
chorus.terakeet.com christianlouboutinoutlet.win
christianlouboutinsaleoutletonline.us cityadspix.com
ciekawinki.pl claytransformations.info
citetick.com clean-virus-mac.com
civilwartheater.com com-onlinesupport.site
clickprotects.com
club-samodelkin.ru
cntravelre.com
coldfilm.ru
collegerentals.com
cometorussia.net cometorussia.net
compliance-jack.top compliance-ivan.xyz
compliance-josh.top connectionstrenth.com
cookie-law-enforcement-hh.xyz
copenergo.ru copenergo.ru
crd.clan.su corta.co
creatives.adbetclickin.pink crafthubs.com
creditnation.ru cwetochki.ru
crest3d.ru data.vtc.pw
csgo4.win dealitright.click
cypernhuset.se decoratinghomes.ga
dailyfinancefix.com design-lands.ru
daretodonate.co deutschland123.de
dataloading.net dev78.dioniqlabb.se
dekorkeramik.ru dgfitness.co
den-noch24.ru digitalfaq.com
detective01.ru dikqlyremy.info
deutschehobbyhuren.net dkvorota.ru
diesel-parts28.ru domaincdn.xyz
digitalassetmanagement.site donvito.unas.cz
directrev.com dotmass.top
discovertreasurenow.com download-walpaperhd.blogspot.com
dispo.de downloadeer.net
divci-hry.info downloadkakaotalk.com
dokumentalkino.net drillsaw.ru
domznaniy.ru drunkenstepfather.com
dosugrostov.site ege-essay.ru
dptaughtme.com
dyt.net
e-avon.ru
e-collantes.com
edge.sharethis.com
education-cz.ru
eduinfosite.com
ekn-art.se
ekosmetyki.net.pl ekosmetyki.net.pl
elektronischezigarettekaufen1.beeplog.com el-nation.com
elektrozigarette2.webs.com elektronischezigarette2.mex.tl
elite-sex-finders.com elitesportsadvisor.com
emailaccountlogin.co elstal.com.pl
englate.com envaseslotusama.com
enternet.ee eropho.com
escort-russian.com erotag.com
esnm.ru erotikstories.ru
essayservicewriting.org erotische-geschichten-xxl.com
european-torches.ru european-torches.ru
excaliburfilms.com event-tracking.com
exct.net evogarage.com
exonline.info exchanges-bet.com
expdom.com expertblog.info
extads.net eyessurgery.ru
ez8motelseaworldsandiego.com fapgon.com
ezigarettekaufen2.blox.pl
ezofest.sk
fashion-mk.net fashion-mk.net
fastfixing.tech fatfasts-4tmz.com
fickenprivat.info fdzone.org
fickkontakte.org fearcrow.com
fidelityfunding.com fil.ru
filefilter.weebly.com findacheaplawyers.com
filmania-x.ru findpik.com
filmidivx.com forum.doctissimo.fr
filunika.com.ru foto-sisek.porngalleries.top
floridamobilebillboards.com fotosfotos.eu
fok.nl free-stock-illustration.com
folowsite.com frequiry.com
forex21.ru freshwallpapers.info
forexgb.ru friendflnder.com
forminecrafters.ru frustrated-favorable.gq
foxtechfpv.com fsalas.com
franecki.net fullfileaccess.com
franklinfire.co game-top.su
free-deals.faith gemara.com
free-gluten.ru generalporn.org
freza-sverlo.ru gentamicineyedrops.blogspot.com
frivgame250.com
fuel-gas.com
fun2cell.net
gamedayhouse.com
gay-site.store
gaypornmovie.net
gayxperience.com
geilehausfrauen.net
genericlowlatencyasiodriverhq.aircus.com
genetworx.com
germetiki.com.ua
get-free-social-traffic.com
getmyads24.com
gg-arena.ru
ghernnqr.skyrock.com ghernnqr.skyrock.com
globalsurfari.com gk-atlant.info
goo.ne.jp global-ics.co.za
googleseo.com.tr golmau.host.sk
gopro-online.info googglet.com
gorodservis.ru gosreg.amchs.ru
gsasearchengineranker.top greenidesign.co
guge.io growshop.es
gunsvicceadadebt.tk haikuware.com
gyffu.com handsandlegs.ru
hacktougroup.ru headpress.ru
hchha.com heliko.no
hdfreeporno.net hit-men.men
healbio.ru hledejvshopech.cz
hitcpm.com hobild.net
hobbyhuren24.net home.myplaycity.com
homeandhealth.ru homeandhealth.ru
honyaku.yahoofs.jp homedecorpicture.us
hotblog.top hostcritique.com
hoste.octopis.com
hotcore.info
hoverboardforsaledirect.com hoverboardforsaledirect.com
htmlcorner.com huimin764128.com
ideibiznesa2015.ru husky-shop.cz
ifmo.ru ideashome.id
iideaidekonkatu.info imabase.com
ilmen.net
ilovevitaly.ru
imadedinner.net
imagefinder.site
images.gyffu.com
imagui.eu
impisr.edunsk.ru impisr.edunsk.ru
impisr.ru inboundlinks.win
inboxdollars.com incanto.in.ua
inet-traffic.com increasewwwtraffic.info
informatiecentro.be infektsii.com
instasexyblog.com infospot.pt
invest-pamm.ru int.search.mywebsearch.com
ispac.org iqoption.pro
istizanidineanopiate.blogspot.com istizanidineacontrolledsubstance.blogspot.com
itag.pw istizanidineanarcoticdrug.blogspot.com
ivearchenceinflu.cf itbc.kiev.ua
iwantedmoney.com ivanstroi.ru
japan-bearings.ru iyasimasennka.com
jennyfire.ru jabimgo.pw
jewelryandfiligree.com janerikholst.se
jobmarket.com.ua jav-fetish.site
jongose.ninja javatex.co.id
kaliningrad.zrus.org javspace.net
kambasoft.com jaxcube.info
kemerovo.zrus.org jbl-charge.info
ketoanhanoi.info jerseywholesalebizchina.com
keywordhut.com jillepille.com
keywordsdoctor.com jwss.cc
keywordteam.net kaidalibor.de
kicknights.gq kakablog.net
kinky-fetishes.com karpun-iris.ru
kino-rating.ru kasino-money.pw
kiprinform.com kazinogames.lv
kleine-titten.biz keyhantercume.com
kletkimehan.ru keywordsuggest.org
kometars.xyz kihi.gdn
kountrylife.com kopihijau.info
kovesszucs.atw.hu kovrenok.ru
krafte.ru krasnodar.zrus.org
krasivoe-hd.com labvis.host.sk
krasivye-devushki.net lakomka.com.ua
kursy-ege.ru laptoper.net
landmania.ru lashstudia.ru
lesbian.xyz laulini.soclog.se
lescinq.com law-check-eight.xyz
letslowbefast.today law-check-nine.xyz
lincolntheatre.com lawyers.cafe
linksharingt.com leadn.pl
lion.bolegapakistan.com letmacworkfaster.site
liupis.com lignofix.ua
live-sexchat.ru liky.co.ua
livefixer.com littleberry.ru
lob.com.ru littlesexdolls.com
locatellicorretor.com.br liumimgx.pw
lollypopgaming.com livingroomdecor.info
lovelycraftyhome.com lmrauction.com
mackeeper-center.club lost-alpha.ru
managerpak204.weebly.com luckyday.world
manyresultshub-a.akamaihd.net makenahartlin.com
mastershef.club mansiondelrio.co
mantramusic.ru
marinetraffic.com
max-eclat.men max-eclat.men
mebel-vstroika.ru maximpartnerspr.com
med-zdorovie.com.ua mcnamaratech.com
medicineseasybuy.com medicinacom.ru
meetingrainstorm.bid member-quiz.com
menhealed.net metabar.ru
metascephe.com mhtr.be
micasainvest.com midst.eu
mil-stak.com milblueprint.com
mindbox.co.za minneapoliscopiers.com
minecraft-neo.ru mitrasound.ru
minegam.com mixed-wrestling.ru
mini.7zap.com mixtapetorrent.com
miniature.io mlvc4zzw.space
missclub.info mnogolok.info
mister-shop.com mobioffertrck.com
mixx.com modabutik.ru
mobifunapp.weebly.com modnie-futbolki.net
moneytop.ru moje-recenze.cz
moonci.ru monclerjacketsoutlet.pw
moroccosurfadventures.com monclervests.xyz
most.gov.iq monsterdivx.tv
mwtpludn.review moomi-daeri.com
my-floor.in.ua morpicert.pw
myblogregistercm.tk moviemail-online.co.uk
mycaf.it mrpornogratis.xxx
myliveblog.ru mrvideospornogratis.xxx
myonlinepayday.co mundoaberrante.com
na-telefon.biz mural.co
nac-bearings.ru music.utrolive.ru
nacap.ru my-bc.ru
national-today-winning-winner.club mygameplus.com
nero-us.com myiptest.com
netfacet.net myxdate.info
newhairstylesformen2014.com nagdak.ru
nibbler.silktide.com naj-filmy24.pl
nisuturnetdgu.tk naperehresti.info
normalegal.ru narkologiya-belgorod.ru
norththeface.store natali-forex.com
noumeda.com net-profits.xyz
novosti-hi-tech.ru networkad.net
nw-servis.ru newstaffadsshop.club
o-o-8-o-o.ru nmrk.ru
obiavo.in nodding-passion.tk
office-windows.ru nucia.biz.ly
ok.ru o-o-11-o-o.com
onclkads.com obiavo.by
oneshotdate.com obiavo.kz
onlainbesplatno.ru odywpjtw.bloger.index.hr
ooo-olni.ru online-sbank.ru
orel-reshka.net osb.se11.ru
ostrovtaxi.ru osoznanie-narkotikam.net
ovirus.ru outclicks.net
oxotl.com parajumpersstore.online
pacificair.com pastaleads.com
palocco.it pateaswing.com
panchro.co.uk pawli.eu
paramountmarble.co.uk pb-dv.ru
pathwhelp.org
pdns.cz pdns.cz
pelfind.me
photorepair.ru photorepair.ru
pinwallpaper.top picscout.com
plaff-go.ru picsearch.com
play-movie.pl picturesboss.com
play.leadzupc.com pierrehardysale.online
playtap.us pillscheap24h.com
pochtovyi-index.ru pinapchik.com
pornhubforum.tk piuminiita.com
pornobrazzers.biz pogosh.com
pornodojd.ru pogruztehnik.ru
pornoforadult.com poisk-zakona.ru
pornoreino.com pokerniydom.ru
positive2b.ru polcin.de
pourvous.info polimga.pw
powenlite24.ru popugaychiki.com
princeadvantagesales.com porn555.com
priora-2.com porno-transsexuals.ru
privatov-zapisi.ru pornoblood.com
privetsochi.ru pornokorol.com
pornolook.net
portnoff.od.ua
portside.xyz
pozdravleniya-c.ru
pricheski-video.com
printdirectforless.com
profit-opportunity.com
prosmibank.ru
prostitutki-odessa.org
psvita.ru
ptr.ruvds.com ptr.ruvds.com
pufip.com pushdata.sendpulse.com
pussyspace.net ranksays.com
rabotaetvse.ru ratemodels.net
randki-sex.com realting-moscow.ru
rebuildermedical.com reckonstat.info
referencemoi.com redirlock.com
renecaovilla.online reimageplus.com
resant.ru reklama-i-rabota.ru
responsive-test.net remont-komputerov-notebook.ru
reversing.cc rennlist.com
rewardit.com responsinator.com
ribieiendom.no roofers.org.uk
robertefuller.com ru-dety.ru
robotixix.com
russintv.fr russintv.fr
russkoe-zdorovie.ru sa-rewards.co.za
rusvideos.su sady-urala.ru
rvtv.ru saecsa.co
saddiechoua.com saneitconsulting.com
sakhboard.ru sarahmilne.top
salutmontreal.com sbt-aqua.ru
sawin.beth.webd.pl scanner-josh.top
sax-sex.com scanner-walter.top
sbornik-zakonov.ru sell-fb-group-here.com
sc-specialhost.com seobility.net
scalerite.co.za seorussian.ru
sdelatmebel.ru sex-dating.co
seadragonherbery.com sex-pr.net
semprofile.com sex.hotblog.top
seofied.com
seojokes.net
seorank.info
sexfreepornoxxx.com
sexkvartal.com sexkvartal.com
sexobzor.info sexreliz.com
shopcheermakeup.info sexyteens.hol.es
shoppingmiracles.co.uk sibecoprom.ru
sibtest.ru sibtest.ru
signal03.ru siha.de
signoredom.com simply.net
sildenafilcitratemed.com sindragosa.comxa.com
sim-service.net sinel.info
simon3.ru site3.free-share-buttons.com
siteaero.com skachat-besplatno-obrazcy.ru
sitebeam.net
sitechecker.pro
skanninge.se skanninge.se
skytraf.xyz skutecznetabletkinaporostwlosow.pl
sloopyjoes.com slavic-magic.ru
snowplanes.com slim.sellany.ru
slowmac.tech
snjatie-geroinovoy-lomki.ru
snsdeainavi.info
social-search.me social-search.me
socialmonkee.com socialmadesimple.com
sofit-dmd.ru socialsignals24.com
soheavyblog.com sockshares.tv
spb.afora.ru softlinesolutions.me
spidtest.space sosdepotdebilan.com
spywarenuker.com spacash.com
sstroy44.ru sptslmtrafms.com
stal-rulon.ru spylog.com
starwars.wikia.com srdrvp.com
stauga.altervista.org stathat.com
stopnarco.ru stefanbakosab.se
survival.betteroffers.review stmassage.ru
svetlotorg.ru stockquotes.wooeb.com
swagbucks.com strangeduckfilms.com
swinginwithme.ru stroilka.info
swinon.site sugarkun.com
superlist.biz
suralink.com
suture.co
sygraem.com sygraem.com
tacbibirfa.tk tackletarts.co
taraz.xkaz.org takeflyte.com
tdsing.ru talant-factory.ru
tech4master.com tattooreligion.ru
tedy.su tedy.su
telegramdownload10.com teesdaleflyballclub.co.uk
teslathemes.com tengohydar.tk
thedownloadfreeonlinegames.blogspot.com the-trader.net
theporndude.com thebestweightlosspills.ovh
tizanidinehydrochloride2mg.blogspot.com thecounter.com
tizanidinevsvalium.blogspot.com tizanidine4mg.blogspot.com
toloka.hurtom.com tizanidinecost.blogspot.com
tootoo.to tizanidineduringpregnancy.blogspot.com
top-karkas.ru tizanidinefibromyalgia.blogspot.com
torrentgamer.net tmm-kurs.ru
tmtrck.com
toolsky.com
top-deal.com.pl
top-l2.com
topsy.com
torrent-newgames.com
torrnada.ru torrnada.ru
tracklead.net tracfone.com
treasuretrack-a.akamaihd.net tradgardspartner.se
trucri.me traffic2money.com
tsstcorpcddvdwshbbdriverfb.aircus.com trustl.life
tubeoffline.com tuberkulezanet.ru
turbodsp.com tuckermktg.com
turist-strani.ru turvgori.ru
twinderbella.com tv-spoty.info
twodollarshows.com tvorozhnaja-zapekanka-recept.ru
uamtrk.com tvory.predmety.in.ua
tx41tclega.ru
txxx.com
ublaze.ru ublaze.ru
uggsale.online um-razum.ru
ukr-lit.com unacittaconte.org
ukrobstep.com unpredictable.ga
unrealcommander.biz upstore.me
urdoot.win uptime-alpha.net
urccvfmc.bloger.index.hr
usacasino.com
ustion.ru
uzungil.com
vacances-voyages.info
vadimkravtcov.ru vadimkravtcov.ru
valsalud.com valoresito.com
vbikse.com vancleefreplica.pw
vekzdorov.ru vekzdorov.ru
via-energy-cumpara.com veles.shop
viagengrarx.com velobikestock.com
viandpet.com vesnatehno.ru
videochat.ph videojam.tv
vietimgy.pw
vilingstore.net vilingstore.net
virus-respirators.com vipps.com.my
vkgaleria.com vizag.kharkov.ua
vladimir.xrus.org vkak.ru
volume-pills.biz
vonradio.com vonradio.com
vrotike.ru vozbujdenie.com
vuclip.com vsdshnik.com
vzlom-na-zakaz.com vtc.pw
watchdogs-2.ru vvpg.ru
webmonetizer.net vzube.com
website-audit.com.ua warningzscaler.heraeus.com
website-speed-checker.site waysbetter.cn
websitevaluebot.com web-analytics.date
wemarketing.se webcamtalk.net
westum.se webmasterhome.cn
wholesalecheapjerseysfree.com website-analytics.online
whos.amung.us websiteexplorer.info
whosonmyserver.com websites-reviews.com
wildcattube.com westen-v.life
winner7777.net whatistizanidinehclusedfor.blogspot.com
winx-play.ru wheelchairliftsarea.com
wiosenny-bon-1500.pl wholesalenfljerseys.us.com
wnoz.de wieseversa.no
wpsecurity.website wineration.com
www.ehscloud.cn womens-journal.net
www.kabbalah-red-bracelets.com word-vorlagen.net
www.pinnacle-bets.com worldis.me
www.wohnkabinen-shop.de wrona.it
xmladserver.com xchangetrak.com
xn-----6kcaacnblni5c5bicdpcmficy.xn--p1ai xedserver.com
xn----7sbaaabaei0cc8aj5bj0bncejx.xn--p1ai xgftnlrt.bloger.index.hr
xn----7sbahjd3btneuw1joc.xn--p1ai xn--80ajjbdhgmudixfjc8c5a9df8b.xn--p1ai
xn----7sbbagbq7bd5aheftfllo4m.xn--p1ai xn--e1afanlbnfckd7c3d.xn--p1ai
xn----dtbndd4ae7eub.top xsfetish.org
xn--80atua3d.xn--p1ai xtube.com
xn--b1addnj3cah.xn--p1ai xxxnatelefon.ru
xn--b1ag5cfn.xn--p1ai xz618.com
xxxsiterips.xyz yoopsie.com
yaaknaa.info youandcredit.ru
yginekologa.com ytmnd.com
you-shall-not-pass.is74.ru yun56.co
yourads.website zagadki.in.ua
yourmovies.pl zakonobosago.ru
yuarra.pluto.ro zastroyka.org
zakazvzloma.com zeroredirect11.com
zapatosenventa.info znakomstva-moskva77.ru
zapiszto.pl zona-aqua.ru
zerocash.msk.ru zoogdisany.com
zvetki.ru zootravel.com
zvooq.eu zs2vm.top

484
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
2000k.ru 00author.com
202ch.com 00it.com
2pxg8bcf.top 2itech.ru
55wmz.ru abcdefh.xyz
acheterviagrafr24.com acortarurl.es
adtech.fr adultgalls.com
affiliate-fr.com adzerg.com
airmaxshoes-2016.com afftrack001.com
alevinefesleri.com aihelen.net
alienwheel.es alfa9.com
allmarketsnewdayli.gdn apilinkswiftco-a.akamaihd.net
alpinism.ru asiengirls.net
alveris.ru autotop.com.ua
animal-drawings.com avek.ru
arabsexxxtube.com avtoarenda.by
arcteryxstore.online batanga.net
atmovs.com bbtec.net
atout-energie-69.com beachpics.com
ausmepa.org.au bestbrainprod.win
auto4style.ru bestcoin.cc
autobudpostach.club bestempresas.es
autowebmarket.com.ua bestpornuha.com
baixar-musicas-gratis.com bidbuy.co.kr
bankmib.ru blogrankers.com
berrymall.ru blogsfunky672.weebly.com
best-coupon-offer.com bnt-team.com
best-seo-solution.com bonux.nextview.ru
beztuberkuleza.ru bumskontakte.org
bimatoprost-careprost.com.ua butstrap.space
bingoporno.com callmd5map.com
bloggedporn.com cartierlove.xyz
bloggerads.net cartierreplica.top
boanonihaca.tk cashkitten-a.akamaihd.net
bobinoz.com celejihad.info
boc.kz clarithromycin500mg.com
bookhome.info clickbank.net
brandehk.dk club-lukojl.ru
break-the-chains.com compliance-checker.info
btvn.ru compliance-donald.xyz
buigas.00it.com continent-e.tv
businesn.men crd.clan.su
buypanicdisorderpill.com customcollegeessays.net
buzzzg.men cutt.us
callejondelpozo.es dailyrank.net
canacopegdl.com data1.scopich.com
carstrends2015.com dating-time-now.com
catalogs-parts.com ddlmega.net
cbozhe.com demian.kz
ccbill.com
censys.io
cheapestjerseysonwholesale.com
check-host.net
checktext.org
chelyabinsk.xrus.org
cienum.fr
clickzzs.nl
colobit.biz
compliance-barak.top
compliance-elena.xyz
computernetworksonline.com
contentsexpress.com
coprofam.org
counterbot.com
cranly.net
dataloading.net
dbmkfhqk.bloger.index.hr
design-ideas.info design-ideas.info
digilander.libero.it diamond-necklace.info
dignitasdata.se documentbase.net
djihispano.com dogclothing.store
domini.cat domainroam.win
dtm-spain.com doxysexy.com
dvrlists.com drugspowerstore.com
ed-shop01.ru dyshagi.ru
ekosmetyki.net.pl ebooknovel.club
ekspresihati.info educatemetv.com
elektrozigarette1.dreamwidth.org eduserver.net
elektrozigarette2.webs.com elektrischezigarette1.blog.pl
enbersoft.com elektrischezigarette1.onsugar.com
extads.net elidelcream.weebly.com
fandlr.com en.home-task.com
faracontrol.ir erectile.bid
fighrofacciufreesig.ga eurosamodelki.ru
fikasound.tk evrotekhservis.ru
filmidivx.com extlabs.io
findanysex.com ezigarettekaufen2.blox.pl
findpics.pw f1nder.org
ferretsoft.com
fortwosmartcar.pw fortwosmartcar.pw
fr.netlog.com franecki.net
freshmac.space free-fb-traffic.com
fusoradio.info free411games.com
gearcraft.us freejabs.com
gelezki.com funponsel.com
gepezz.info fyxabomiw.ru
germes-trans.com gallery.rennlist.com
gfaq.ru gay-site.store
gilbertbanda.net gay.adultgalls.com
gk-atlant.info gaytube.com
goforexvps.com gazporno.com
gungamesz.com gdebestkupit.ru
gunsvicceadadebt.tk generousdeal-a.akamaihd.net
hikesearch.net gorodservis.ru
hit-men.men graphicwe.org
hoterika.com growboxbl.ru
hotshoppymac.com grtyi.com
houseofrose.com gsmlab.pl
iflycapetown.co.za gz2.bbsoldes.fr
igadgetsworld.com happy.new.yeartwit.com
ihtec2019.org hazardky.net
imgarcade.com helicalpile.us
infogame.name hifidesign.ru
interfucks.net homedecoguide.info
investingclub.ru host-protection.com
investyb.com imk.com.ua
iqbazar.ru incanto.in.ua
iqoption.com incest-ru.com
j-times.ru indianmedicaltourismshop.com
je7.us insurple.com
jerseychinabizwholesale.us intermesh.net
jerseywholesalechinabiz.com internetartfair.com
jobmarket.com.ua iron-age.info
kerei.ru isistaylorporn.info
keyhantercume.com jacago.com
kiprinform.com jus0wil.pp.ua
kovesszucs.atw.hu justucalling32211123456789.tk
lalalove.ru jyrxd.com
laulini.soclog.se kambasoft.com
ldrtrack.com keywordteam.net
liquimondo.com kfon.eu
lkbennettstore.online kidd.reunionwatch.com
long-beach-air-conditioning.com kmgamex.cf
kvartira-sutochno.com
lanasshop.ru
lapolis.it
lego4x4.ru
lidoradio.com
linerdrilling.com
livetsomudvekslingstudent.bloggersdelight.dk
lumb.co
m5home.ru
machicon-ueno.info
malls.com
master-muznachas.ru master-muznachas.ru
mastershef.club mbiologi.ru
mature.free-websites.com medizinreisen.de
max-eclat.men meteostate.com
mcadamssupplyco.com migente.com
metabar.ru milblueprint.com
mmog-play.ru moi-glazki.ru
monitorwebsitespeed.com monthlywinners.com
moyaterapiya.ru musicstock.me
musicpro.monster my-bc.ru
myfreetutorials.com myblogregistercm.tk
myliveblog.ru myftpupload.com
mylovelibrabry.com mykings.pw
myxdate.info mylida.org
naphukete.ru mypets.by
nalogovyy-kodeks.ru
nardulan.com
narkologiya-penza.ru
nastroyke.net
negral.pluto.ro negral.pluto.ro
ningessaybe.me noumeda.com
nottyu.xyz novgorod.xrus.org
o333o.com ntic.fr
obiavo.net obiavo.com
offer.wpsecurity.website oivcvx.website
olvanto.ru online-hit.info
one-gear.com
onlineporno.site
onlyporno.ru onlyporno.ru
opinionreelle.com ooomeru.ru
orgasmus-virtual.com openmediasoft.com
partner-pop.men optikremont.ru
pictures-and-images.net paceform.com
palvira.com.ua
panicatack.com
pavlodar.xkaz.org
pcboa.se
photostudiolightings.com
pic2fly.com
piluli.info
pinkduck.ga pinkduck.ga
pix24x7.com pixshark.com
pizdeishn.com placid-rounded-coast.glitch.me
pojdelo.weebly.com platesauto.com
polybuild.ru playlott.com
popads.net pogosh.com
pornoslive.net popugauka.ru
portadd.men pornogad.com
pp-budpostach.com.ua pornonik.com
preg.marketingvici.com presleycollectibles.com
priora-2.com promalp-universal.ru
privacylocationforloc.com promgirldresses.xyz
profitkode.com putitin.me
pufip.com razleton.com
randalljhoward.com rednise.com
real-time-analytics.com remontbiz.ru
realting-moscow.ru replicaclub.ru
remont-ustanovka-tehniki.ru rocis.site
reversing.cc rock-cafe.info
rome2rio.com rockingclicks.com
running-line.ru rubbed.us
russkie-gorki.ru ruscoininvest.company
samara.rosfirm.ru sandhillsonline.com
sanidumps.com sanjosestartups.com
santechnik.jimdo.com scanner-alex.top
savefrom.com scanner-alexa.top
scalerite.co.za scanner-fred.top
scanner-don.top sdi-pme.com
scanner-jane.top seemoreresultshu-a.akamaihd.net
secret.xn--oogle-wmc.com seorankinglinks.xyz
seojokes.net
sethrollins.net sethrollins.net
sex-sex-sex5.com shariki-zuma-lines.ru
sexphoto.site shitmovs.com
sextracker.be simply.net
shoppytoolmac.com site.ru
shtaketniki.ru sitevaluation.org
simplepooltips.com skachat-besplatno-obrazcy.ru
smartshoppymac.com sky-mine.ru
social-vestnik.ru smallseotools.com
sotkal.lark.ru solution4u.com
space4updating.win soochi.co
spywarebegone.com specialfinanceoffers.com
stillmiracle.com spl63.fr
streamin.to stanthonyscatholicchurch.org
streetfooduncovered.com statistici.ro
stroiminsk.org stmassage.ru
strv.se swinon.site
svbur.ru tacbelarus.ru
t-bygg.com tdsing.ru
tacbibirfa.tk telefonsex-ohne0900.net
takethatad.com time-japan.ru
talant-factory.ru timeallnews.ru
taqywu51.soup.io titslove.yopoint.in
texbaza.by tizanidine4mguses.blogspot.com
the-torrent-tracker.blogspot.com tn811.us
thedownloadfreeonlinegames.blogspot.com top10registrycleaners.com
thegioixekhach.com
tizanidinedosageforsleep.blogspot.com
tizanidineforopiatewithdrawal.blogspot.com
top10-way.com
topads.men
tourismvictoria.com tourismvictoria.com
tozup.com trainoffend.ml
truebeauty.cc typimga.pw
trustl.life ua.tc
turn-up-life.life ublaze.ru
uasb.ru udayavani.com
uptimechecker.com uogonline.com
usdx.us us-america.ru
vertaform.com videochat.cafe
vesnatehno.ru videospornogratisx.net
videojam.tv vikistars.com
volgograd.xrus.org vrnelectro.ru
vvon.co.uk w3javascript.com
warning.or.kr watracker.net
webinstantservice.com wordpress-crew.net
weboptimizes.com wosik-dach.service-for-web.de
website-stealer.nufaq.com www.wohnkabinen-shop.de
xgames-04.com xn----7sbahjd3btneuw1joc.xn--p1ai
xingzi-vision.com xn----itbkqkfiq.xn--p1ai
xmlinde.com xz618.com
xn-----6kcaabbafhu7cskl7akvongwpo7hvjj.xn--p1ai youjizz.vc
xn----dtbndd4ae7eub.top youthreaders.com
xn--80aikhbrhr.net zambini.ru
yoshkarola.zrus.org zarabotok--doma.ru
youtubedownload.org zarajbuilders.com
zagadki.in.ua zebramart.ru
zeroredirect7.com zed21.net
znaturaloriginal.com zeikopay.com
zmoda.hostreo.com
zojirushi-products.ru
zrizvtrnpale.tk

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.244 0; 10.1.1.190 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.07.3237 ### Version: V4.2022.07.3238
### Updated: Tue Jul 19 22:01:16 UTC 2022 ### Updated: Wed Jul 20 10:03:33 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.07.3237 ### Version: V4.2022.07.3238
### Updated: Tue Jul 19 22:01:16 UTC 2022 ### Updated: Wed Jul 20 10:03:33 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##