vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-03 11:10:47 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2021.08.2560 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2021-08-30 22:07:13 +00:00
parent 6a307f19bb
commit 231e6654c1
46 changed files with 59927 additions and 59927 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2021.08.2559 #### Version: V4.2021.08.2560
#### Bad Referrers Blocked: [7079](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7079](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [624](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [624](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2021.08.2559 #### Version: V4.2021.08.2560
#### Bad Referrers Blocked: [7079](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7079](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [624](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [624](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -11,7 +11,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2021.08.2559 #### Version: V4.2021.08.2560
#### Bad Referrers Blocked: [7079](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7079](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [624](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [624](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

7358
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2021.08.2559 #### Version: V4.2021.08.2560
#### Bad Referrers Blocked: [7079](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7079](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [624](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [624](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

7362
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

7362
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

7362
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

7362
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.16 1; 10.1.0.203 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.16 0; 10.1.0.203 0;
127.0.0.1 0; 127.0.0.1 0;

7362
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.16 1; 10.1.0.203 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.16 0; 10.1.0.203 0;
127.0.0.1 0; 127.0.0.1 0;

7362
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.16 1; 10.1.0.203 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.16 0; 10.1.0.203 0;
127.0.0.1 0; 127.0.0.1 0;

7362
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
2559 2560

7362
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

7362
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
52.170.93.99 0; 20.36.23.87 0;

7362
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.16 1; 10.1.0.203 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.16 0; 10.1.0.203 0;
127.0.0.1 0; 127.0.0.1 0;

7362
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.16 1; 10.1.0.203 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.16 0; 10.1.0.203 0;
127.0.0.1 0; 127.0.0.1 0;

7362
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.16 1; 10.1.0.203 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.16 0; 10.1.0.203 0;
127.0.0.1 0; 127.0.0.1 0;

7362
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
52.170.93.99 0; 20.36.23.87 0;

7362
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
52.170.93.99 0; 20.36.23.87 0;

7362
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.16 1; 10.1.0.203 1;
127.0.0.1 1; 127.0.0.1 1;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
Grafula DBLBot
Haansoft Discobot
Net Vampire GridBot
OutfoxBot IRLbot
RankFlex MegaIndex.ru
Wonderbot OrangeSpider
Zeus Semrush
ZumBot SeoSiteCheckup
domainsproject.org Telesoft
magpie-crawler crawl.sogou.com

268
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
01h4x.com 01h4x.com
80legs 80legs
AIBOT Aboundexbot
ASPSeek Acunetix
Aboundex AfD-Verbotsverfahren
AhrefsBot
AllSubmitter
Alligator Alligator
Ankit Anarchy99
Anthill Anthill
Apexoo AwarioRssBot
Asterias AwarioSmartBot
BBBike BDCbot
BDFetch BLEXBot
BackDoorBot BackDoorBot
BackStreet
BackWeb
Bandit
Barkrowler Barkrowler
BetaBot BetaBot
BlackWidow Blow
BlowFish BlowFish
Boardreader Bolt
BotALot
Brandwatch Brandwatch
Bullseye Buck
BuiltWith
BunnySlippers
BuzzSumo BuzzSumo
CATExplorador
CCBot
CODE87 CODE87
CensysInspect CSHttp
CheTeam Calculon
ChinaClaw ChinaClaw
Collector CopyRightCheck
CrunchBot Copyscape
DBLBot CyotekWebCopy
DIIbot
DataCha0s DataCha0s
Demon
Deusu
Devil Devil
Dirbuster Dirbuster
Disco Disco
Discobot
DomCopBot DomCopBot
DomainCrawler Download Wonder
DomainSigmaCrawler
Domains Project
Dotbot
Dragonfly Dragonfly
ECCP/1.0 ECCP/1.0
EMail Siphon EMail Siphon
EMail Wolf EMail Wolf
Ebingbong EirGrabber
Evil EroCrawler
Express WebPictures
ExtLinksBot
Extractor Extractor
ExtractorPro
Extreme Picture Finder Extreme Picture Finder
EyeNetIE
FDM FDM
FHscan
Firefox/7.0 Firefox/7.0
FrontPage
Fuzz Fuzz
FyberSpider FyberSpider
G-i-g-a-b-o-t
GT::WWW
GalaxyBot GalaxyBot
Genieo Genieo
Getintent GermCrawler
Gigablast GetWeb
Go-Ahead-Got-It Go!Zilla
GoZilla GoZilla
Gotit
Grabber Grabber
Grafula
GridBot GridBot
HEADMasterSEO
HMView
HTTrack HTTrack
HaosouSpider Harvest
Havij
Heritrix Heritrix
IDBTE4M Humanlinks
HybridBot
IRLbot IRLbot
Image Fetch Id-search
Indy Library IlseBot
InfoNaviRobot InfoNaviRobot
Internet Ninja Internet Ninja
InternetSeer IstellaBot
Iria
JOC Web Spider JOC Web Spider
JamesBOT
Jbrofuzz
JetCar JetCar
Jetty Jetty
Joomla JikeSpider
JustView
Keyword Density
Kinza Kinza
LNSpiderguy
LWP::Simple
Lanshanbot
LeechFTP
LexiBot
LibWeb LibWeb
Lightspeedsystems
Likse
LinkWalker
Linkbot
Linkdexbot
LinkextractorPro
LinksManager LinksManager
LinqiaRSSBot
Lipperhey Lipperhey
Lipperhey Spider
Litemage_walker Litemage_walker
Lmspider Lmspider
MIIxpc
MJ12bot MJ12bot
MQQBrowser
MSFrontPage
MTRobot
Mag-Net Mag-Net
Magnet
Mail.RU_Bot
MarkWatch MarkWatch
Masscan Masscan
Meanpathbot Mb2345Browser
MicroMessenger
Microsoft Data Access
Microsoft URL Control Microsoft URL Control
Mister PiX
Moblie Safari
Mojeek
Mr.4x3
Msrabot
Musobot Musobot
NICErsPRO
Name Intelligence Name Intelligence
Nameprotect
NearSite
Needle Needle
Nessus
Net Vampire Net Vampire
NetAnts NetLyzer
NetZIP NetSpider
Netcraft Nettrack
Niki-bot NextGenSearchBot
Nikto Nikto
Nimbostratus Nimbostratus
Offline Navigator Nmap
OnCrawl OnCrawl
OpenLinkProfiler
OpenVAS OpenVAS
Openvas Openvas
OrangeBot
OrangeSpider OrangeSpider
OutfoxBot OutclicksBot
PHPCrawl PageGrabber
Pandalytics PageScorer
Panscient PageThing.com
Papa Foto
Pavuk
PeoplePal PeoplePal
Petalbot
Picscout
Picsearch
PictureFinder PictureFinder
Pimonster
ProWebWalker
Probethenet Probethenet
Psbot
QueryN Metasearch QueryN Metasearch
RankActiveLinkBot RankActiveLinkBot
RankingBot RankingBot2
RankurBot
Re-re
ReGet
Reaper
RebelMouse
Recorder Recorder
RepoMonkey
Ripper Ripper
SEOkicks SEOkicks-Robot
SEOprofiler SEOprofiler
SEOstats SMTBot
ScoutJet SalesIntelligent
Screaming ScanAlert
ScreenerBot Scanbot
Searchestate
SearchmetricsBot
SemrushBot SemrushBot
SentiBot SeoSiteCheckup
SeobilityBot Seomoz
Site Sucker Shodan
SiteExplorer Siphon
SiteSnagger SiteCheckerBotCrawler
Siteimprove Siteimprove
SlySearch
SmartDownload SmartDownload
Snake Snake
Snapbot Snapbot
Sociscraper Sociscraper
Sosospider
SpaceBison SpaceBison
Spammen Spammen
Spanner SputnikBot
Sqlmap
Sqlworm
Sqworm Sqworm
Sucker Steeler
Sucuri Sucuri
SuperBot
SuperHTTP SuperHTTP
SurveyBot
Suzuran
Szukacz
T8Abot T8Abot
TeleportPro TeleportPro
Telesoft Telesoft
Telesphorep Telesphorep
The Intraformant Toata
TightTwatBot Tracemyfile
Titan True_Robot
Toweyabot
Trendiction
Trendictionbot
Turnitin Turnitin
Twice TwengaBot
URLy.Warning URLy.Warning
UnisterBot UnisterBot
VelenPublicWebCrawler Upflow
Virusdie Virusdie
Voil
Voltron Voltron
WEBDAV
WISENutbot WISENutbot
WPScan
WWW-Collector-E
WWW-Mechanize
Wallpapers/3.0 Wallpapers/3.0
WeSEE
Web Collage Web Collage
Web Enhancer Web Enhancer
Web Fuck Web Fuck
Web Sauger Web Pix
Web Sucker Web Sucker
WebBandit WebBandit
WebCollage
WebCopier WebCopier
WebFuck
WebGo IS
WebImageCollector
WebPix
WebReaper WebReaper
WebSauger WebStripper
WebSucker
WebWhacker
Webalta Webalta
WebmasterWorldForumBot WebmasterWorldForumBot
Webshag
Website Quester Website Quester
WebsiteExtractor
Webster Webster
Widow WinHTTrack
Woobot YoudaoBot
Wotbox Zade
Wprecon Zeus
Zauba
Zitebot
ZmEu ZmEu
ZoomBot
ZumBot
archive.org_bot
arquivo-web-crawler arquivo-web-crawler
arquivo.pt cognitiveseo
cah.io.community
clark-crawler
crawl.sogou.com crawl.sogou.com
crawler.feedback crawler4j
demandbase-bot
domainsproject.org
eCatch
facebookscraper
gopher gopher
heritrix heritrix
instabid instabid
ips-agent internetVista monitor
isitwp.com isitwp.com
lwp-request lwp-request
meanpathbot meanpathbot
mediawords
muhstik-scan muhstik-scan
netEstate NE Crawler
oBot oBot
page scorer
polaris version polaris version
ripz probe-image-size
s1z.ru sogouspider
scalaj-http
sexsearcher
sitechecker.pro
sp_auditbot sp_auditbot
tAkeOut
voyagerx.com voyagerx.com
webprosbot webpros.com
x22Mozilla x09Mozilla
zgrab xpymep1.exe

304
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
01h4x.com 01h4x.com
360Spider 404checker
404enemy
80legs 80legs
ADmantX AIBOT
Abonti Abonti
Aboundex AhrefsBot
Aboundexbot AiHitBot
Aipbot
Alexibot Alexibot
Alligator AllSubmitter
AlphaBot AlphaBot
Anthill Anarchy
Asterias Apexoo
Attach AwarioRssBot
BLEXBot BLEXBot
BacklinkCrawler BackStreet
Bandit Backlink-Ceck
Battleztar Bazinga Badass
Barkrowler
BatchFTP
Bigfoot Bigfoot
BlackWidow Blackboard
BlowFish BlowFish
Bolt Brandprotect
Buddy Bullseye
BuiltBotTough
BunnySlippers BunnySlippers
CATExplorador CODE87
ChinaClaw CSHttp
Claritybot Calculon
Cliqzbot Cegbfeieh
CensysInspect
CherryPicker
Chlooe
Cloud mapping
Cogentbot Cogentbot
Collector Copyscape
CopyRightCheck Craftbot
Crescent
CrunchBot CrunchBot
Curious DTS Agent
CyotekWebCopy
DBLBot
DIIbot
DSearch
DataCha0s DataCha0s
Demon Demon
Deusu Deusu
DigitalPebble Dirbuster
Discobot
Dispatch Dispatch
DnyzBot DittoSpyder
Dotbot DomainCrawler
Download Wonder DomainSigmaCrawler
DomainStatsBot
Drip Drip
ECCP/1.0 ECCP/1.0
EMail Siphon EMail Siphon
EMail Wolf
Ebingbong Ebingbong
Ecxi Ecxi
EirGrabber
EroCrawler EroCrawler
Evil ExtractorPro
Exabot EyeNetIE
Extractor Foobot
FemtosearchBot GT::WWW
Freeuploader
Fuzz
GalaxyBot
GetRight GetRight
GetWeb GetWeb
Gigabot Gigabot
Go!Zilla Go-Ahead-Got-It
GoZilla
Gotit Gotit
GrapeFX
HEADMasterSEO HEADMasterSEO
HMView HTMLparser
Haansoft HTTP::Lite
HTTrack
HaosouSpider HaosouSpider
Harvest Havij
Hloader
IDBTE4M IDBTE4M
IDBot Id-search
IlseBot Image Fetch
Indy Library
InfoNaviRobot InfoNaviRobot
InfoTekies Internet Ninja
InterGET Iria
Iskanie
IstellaBot
JOC Web Spider JOC Web Spider
JamesBOT JamesBOT
Jyxobot JennyBot
Jetty
Kenjin Spider Kenjin Spider
Keyword Density
Kinza Kinza
Larbin LNSpiderguy
Leap
LeechGet
LexiBot LexiBot
LibWeb LieBaoFast
Linkbot Lightspeedsystems
Linkdexbot Linkdexbot
LinksManager LinkextractorPro
LinqiaMetadataDownloaderBot LinqiaScrapeBot
LinqiaRSSBot Lipperhey
Mag-Net Litemage_walker
Mail.RU_Bot Ltx71
MFC_Tear_Sample
MJ12bot
MQQBrowser
MSFrontPage
MSIECrawler
MTRobot
Majestic-SEO Majestic-SEO
Majestic12
MarkMonitor MarkMonitor
MarkWatch Mass Downloader
Masscan
Mata Hari Mata Hari
Mb2345Browser MauiBot
MeanPath Bot Metauri
Mediatoolkitbot
MegaIndex.ru
MicroMessenger MicroMessenger
Mister PiX Mister PiX
Mojeek Moblie Safari
Mozlila Mozlila
Mr.4x3
Msrabot Msrabot
Musobot
NICErsPRO NICErsPRO
NPbot Name Intelligence
Nameprotect Needle
Navroad
NearSite
Nessus
Net Vampire
NetLyzer
NetSpider NetSpider
NetZIP NetZIP
NextGenSearchBot Netcraft
Netvibes
Nibbler Nibbler
NimbleCrawler
Nimbostratus
Ninja
Nmap Nmap
Nutch Nutch
Offline Explorer Offline Explorer
OnCrawl OnCrawl
OrangeBot OpenLinkProfiler
OpenVAS
Openfind
OrangeSpider OrangeSpider
OutclicksBot OutclicksBot
OutfoxBot PageThing.com
PECL::HTTP
POE-Component-Client-HTTP
Page Analyzer
Pandalytics
Panscient Panscient
Pavuk Papa Foto
PeoplePal
Petalbot Petalbot
Picscout
PictureFinder PictureFinder
Pixray Pixray
PleaseCrawl PleaseCrawl
ProWebWalker
Psbot
Pu_iN Pu_iN
Pump
PxBroker PxBroker
PyCurl PyCurl
Quick-Crawler QueryN Metasearch
RankActive RSSingBot
RankActiveLinkBot
RankingBot RankingBot
Rankivabot
RankurBot RankurBot
Re-re Re-re
ReGet
RealDownload RealDownload
Reaper Reaper
RebelMouse Ripper
RepoMonkey
Rogerbot
SEOkicks SEOkicks
SEOstats SEOkicks-Robot
SMTBot SEOprofiler
Scanbot
Screaming Screaming
ScreenerBot Searchestate
ScrepyBot SemrushBot
SearchmetricsBot
SentiBot
Shodan Shodan
SiteCheckerBotCrawler SiteCheckerBotCrawler
SiteExplorer SiteExplorer
SiteSucker SiteLockSpider
Sitevigil
SmartDownload SmartDownload
Snapbot Snapbot
Sogou web spider
Sosospider Sosospider
Sottopop
Spanner
Spbot Spbot
Spinn3r Spinn3r
Sqworm Sqlmap
Sucuri Sqlworm
SuperHTTP T0PHackTeam
Szukacz
Teleport Teleport
TeleportPro TeleportPro
Telesoft Telesphoreo
Telesphorep
The Intraformant The Intraformant
Thumbor TightTwatBot
Titan Toweyabot
TwengaBot Tracemyfile
Trendictionbot
Turingos
Turnitin
Twice
URLy Warning
Upflow Upflow
VB Project V-BOT
Vacuum VidibleScraper
Vagabondo Voil
VelenPublicWebCrawler WASALive-Bot
VeriCiteCrawler Wallpapers
VoidEYE Wallpapers/3.0
WBSearchBot WallpapersHD
WEBDAV Web Auto
WWW-Mechanize Web Enhancer
WWW::Mechanize Web Fuck
WeSEE Web Pix
Web Sauger Web Sauger
Web Sucker Web Sucker
WebAuto WebBandit
WebCollage WebFuck
WebGo IS WebImageCollector
WebLeacher
WebReaper
WebStripper
WebSucker WebSucker
WebZIP WebZIP
WebmasterWorldForumBot
Webshag
Website Quester
WebsiteQuester WebsiteQuester
Whack Webster
Whatweb
Who.is Bot Who.is Bot
WiseGuys Robot Wonderbot
Wotbox
Wprecon Wprecon
Zauba Xaldon_WebSpider
Zade
Zermelo Zermelo
Zeus Zeus
ZmEu archive.org_bot
ZoominfoBot arquivo.pt
clark-crawler clark-crawler
coccocbot-web cognitiveseo
com.plumanalytics
crawl.sogou.com crawl.sogou.com
crawler4j crawler.feedback
dataforseo.com
demandbase-bot demandbase-bot
gopher domainsproject.org
instabid heritrix
ips-agent internetVista monitor
isitwp.com isitwp.com
lwp-trivial
magpie-crawler magpie-crawler
meanpathbot mediawords
oBot page scorer
pcBrowser pcBrowser
polaris version
probe-image-size
ripz ripz
s1z.ru satoristudio.net
scalaj-http
seobility
serpstatbot
sexsearcher
sysscan sysscan
tAkeOut tAkeOut
trendiction.de trendiction.com
voyagerx.com webpros.com
webprosbot
x09Mozilla
x22Mozilla x22Mozilla
zauba.io

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
appearance-cool.com cartierlovestore.com
esopini.com clarithromycin500mg.com
forum69.info dentalpearls.com.au
fuckingawesome.com electricwheelchairsarea.com
funnel.co.za jjbabskoe.ru
girlgamerdaily.com krasnodar.zrus.org
healthcarestore.info mrsdalloways.com
igithab.com powenlite24.ru
quick-offer.com seolab.top
sabizonline.com svetlotorg.ru

914
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
000free.us 0n-line.tv
01apple.com 108shot.com
0daymusic.org 178evakuator178.ru
18ps.ru 1bet.com
20pascals.nl 3xforum.ro
24x7-server-support.site 4kpics.rocks
2itech.ru
2kata.ru
3-letter-domains.net
4webmasters.com
51.la 51.la
72-news.com 7yue.org
76brighton.co.uk 9med.net
98oi.ru a.pr-cy.ru
aa9bd78f328a6a41279d0fad0a88df1901.com abcdeg.xyz
abcguru.xyz abiente.ru
adanih.com absolutelyanalog.com
addtoadd.men academiacsmendoza.org
adidas.frwebs.fr acmebtn.ml
admanaerofoil.com admeasures.com
adminshop.com adrunnr.com
adnotbad.com adservme.com
ads-cool.pro adsland.men
adtology.com adultactioncam.com
advancedmassagebysara.com advancedmassagebysara.com
agadelha.com.br agadelha.com.br
agysya.ru agroeconom.kz
aibolita.com aihelen.net
alert-hgd.xyz alborzan.com
alfa9.com alienwheels.de
alif-ba-ta.com alt-servis.ru
alphavisions.net ample-awards-today.us
amazingninja.com angkortours.vn
amehdaily.com animaltoplist.com
animenime.ru aosexkontakte.net
anlimebel.kiev.ua api.stathat.com
apartment.ru apibrowsesmartne-a.akamaihd.net
appfixing.space arcteryxstore.online
appleid-verification.com
appmsr.org
approvedlocal.co.za
arpelsreplica.xyz
artpicso.com
as5000.com as5000.com
atmagroup.ru
aucoinhomes.com aucoinhomes.com
audiofree.ru audiofree.ru
automobile-spec.com aversis.net
autorn.ru avtolombard-krasnodar.ru
avirasecureserver.com azartmsl.com
aviva-limoux.com
azlex.uz
azte.ch azte.ch
baikaleminer.com babs.com.ua
balook.com bannerads.de
banki76.ru bbsoldes.fr
bankiem.pl beachdriveblog.com
bannerspace.com beauty-clinic.ru
battlecarnival.su belinka.com.ua
bazaronline24.ru bestcoin.cc
bestfortraders.com bestdraws.com
bigcities.org besthomemadepornsites.com
blogs.rediff.com betwinservice.com
bmsco.co bfz.biz
boanonihaca.tk bimatoprost-careprost.com
bonzbuddy.com bimatoprost-careprost.com.ua
brakehawk.com bin-brokers.com
brianhenry.co bingo8888.com
bronzeaid-a.akamaihd.net bio-japan.net
buntube.net bioca.org
buydissertation.net bizfly.info
cah.io.community blobar.org
callawaygolfstore.online blog.remote-computer.de
callstevens.com blog.yam.com
cand.jp blue-square.biz
candlewooddentalcentre.com.au bombla.org
canrole.com bonzybuddy.com
canyougethighofftizanidine.blogspot.com boole.onlinewebshop.net
cartierlovebracelet.xyz bosman.pluto.ro
cartierloveringreplica.xyz bouda.kvalitne.cz
cascadelink.org braindaily.xyz
caulderwoodkennels.com btvn.ru
cdn.walkme.com bugshoot.cn
celejihad.info bumskontakte.org
chatroulette.world burger-tycoon.com
cienum.fr burn-fat.ga
cleanmypc.com businescoop.men
coinsspb.com buyparajumpers.online
comeondog.info buytizanidineonline.blogspot.com
compliance-ivan.xyz bzero1jewelry.net
compliance-jess.top cactussoft.biz
compliance-josh.top callejondelpozo.es
compliance-julia.top canrioloadm.gq
compliance-olga.top capture-room.com
consorzioilmosaico.org cbox.ws
continent-e.tv check-host.net
cookie-law-enforcement-hh.xyz check-this-out-now.online
coolingoods.com chiblackhawks-jerseys.com
countercrazy.com chocolateslim-en-espana.com
craftburg.ru chocolateslim-en-france.com
cxpromote.com christianlouboutinsaleonline.us
daretodonate.co christianlouboutinsaleoutletonline.us
cibpenonptib.flu.cc
clickcash.com
clickso.com
clknsee.com
clodo.ru
cmhomestayagency.com
coaching-netz.info
colehaanoutlet.store
compliance-brian.top
compliance-ivan.top
compliance-jane.top
compliance-margo.top
compliance-willy.top
cookie-law-enforcement-aa.xyz
coolgamechannel.com
corta.co
culturevie.info
custom-product-labels.com
customerpromos-a.akamaihd.net
cutalltheshit.com
cvety24.by
d0t.ru
dafatiri.com
darodar.com
dawlenie.com dawlenie.com
degerlund.net day-news.info
dekoration.us delta-line.men
dekorkeramik.ru detskie-konstruktory.ru
detsky-nabytek.info detskie-zabavi.ru
dickssportinggoods.com dickssportinggoods.com
digest-project.ru dildofotzen.net
digilander.libero.it dimaka.info
discovertreasurenow.com dimkino.ru
dojki-hd.com directrev.com
domainroam.win distver.ru
domainsatcost.com div.as
diy-handmade-ideas.com
djekxa.ru
djihispano.com
docs4all.com
doctormakarova.ru
documentsite.net
doeco.ru
dollartree.info
doreenblog.online doreenblog.online
downtuptv.gq doublepimp.com
doyouknowtheword-flummox.ml drunkenstepfather.com
draniki.org ebooknovel.club
e705.net edelstahlschornstein-123.de
easyshoppermac.com edge.sharethis.com
egvar.net elektrozigaretten2.yn.lt
electricwheelchairsarea.com elitedollars.com
elektronischezi.livejournal.com enbersoft.com
elektronischezigarette2.mex.tl
elite-sex-finders.com
eloxal.ru
emediate.eu
emergencyneeds.org
empathica.com
englishdictionaryfree.com englishdictionaryfree.com
erectile.bid errorfixing.space
ero-advertising.com espaceinventoristes.com
escortplius.com
etenininrade.ga etenininrade.ga
exoneration-project.us exoclick.com
ezigarettenshop2.myblog.de eyemagination.com
ezigarettenshop2.postbit.com ezigaretteshop2.mywapblog.com
familyphysician.ru f0815.de
farmprofi.net familyholiday.ml
fashionindeed.ml fashion.stellaconstance.co
fastcrawl.com fast-wordpress-start.com
fatmaelgarny.com fdzone.org
fba-mexico.com
fearcrow.com
feel-planet.com
fellowshipoftheminds.com fellowshipoftheminds.com
filesmonster.porn femmesdenudees.com
filmbokep69.com fetroshok.ru
fishtauto.ru fettefrauen.net
flashahead.info filmetricsasia.com
flipper.top finemanteam.com
floridamhca.org fordsonmajbor.cf
formulaf1results.blogspot.com forex-indextop20.ru
formularz-konkurs.tk forexgb.ru
forsex.info freelifetimefuckbook.com
free411games.com
freelinkbuilding.website.tk freelinkbuilding.website.tk
fun2cell.net fuel-gas.com
funcrushgames.com
funnymama.com funnymama.com
gallery.rennlist.com galaxy-family.ru
gateway.zscalertwo.net gameprimary.com
gavuer.ru gazobeton-p.com.ua
gazoblok.net.ua gemgrab-a.akamaihd.net
gelezki.com gidonline.one
getaclueamerica.com girlgamerdaily.com
girls-ufa.ru girlporn.ru
glavprofit.ru girlsfuckdick.com
goldpanningtools.com golfresa.lucania.se
googglet.com goodnightjournal.com
goosefishpost.bid greenshop.su
gopro-online.info hanink.biz.ly
gox.com.ua hanwei.us
greenzaim.ru hatdc.org
gstatey.net
gta-top.ru
guardlink.com
hayate.biz
hccoder.info hccoder.info
hd-film.pl hdhc.ru
hdseriale.pl heartofpayne.xyz
hem.passagen.se herokuapp.com
hermesbelts.xyz himgaws.pw
hobbyhuren24.net hkladys.com
horoshieokna.com homemade.gq
hostcritique.com hostingclub.lk
howtoclean.club howlongdoestizanidinestayinyoursystem.blogspot.com
humbmosquina.tk hreade.com
i-hobot.ru https-legalrc.biz
i4track.net hut1.ru
ibb.com.ua hydropump.su
ideawheel.com hystersister.com
igithab.com ihtec2019.org
iklysha.ml ilo134uloh.com
incest-ru.com imabase.com
infobabki.ru imfamous.info
insider.pro imguramx.pw
instakink.com indiasourcemart.in
internetproviderstucson.com infogame.name
iplusbit.blogspot.co.za integritylandscapeservices.com
ispac.org intellekt21.ru
istock-mebel.ru intellektmedia.at
istripper.com interferencer.ru
j33x.com io9.com
janerikholst.se iqoption-bin.com
jav-fetish.com isotoner.com
jolic2.com isoveti.ru
jus0wil.pp.ua ispaniya-costa-blanca.ru
jwcialislrt.com itservicesthatworkforyou.com
kamen-e.ru jacago.com
karusel-market.ru japan-bearings.ru
katadhin.co jerseywholesalechinabiz.com
keywordspay.com jobmarket.com.ua
keywordteam.net jrcigars.com
kimcurlrvsms.com jumptap.com
kinomaniatv.pl jyvopys.com
kinosed.net karting196.ru
kiwe-analytics.com keyhantercume.com
konteiner24.com kletkimehan.ru
krasnodar-avtolombards.ru komp-pomosch.ru
krasnodar.ru konkursowo-24.pl
kung-fu-ru.com kovrenok.ru
kursy-ege.ru kurbappeal.info
kvartir-remont.biz kvartir-remont.biz
laptoper.net lanadelreyfans.us
leboard.ru ledis.top
legalrc.biz lflash.ru
lescinq.com link.ac
lexiangwan.com lion.playtap.us
linerdrilling.com littleberry.ru
linkbolic.com liumimgx.pw
linkwithin.com live-cam6.info
livetsomudvekslingstudent.bloggersdelight.dk livejasmin.com
llastbuy.ru liver-chintai.org
lrac.info loftdigital.eu
luckyday.world lollypopgaming.com
lutherstable.org lonfon.xyz
luxmagazine.cf lostaruban.com
m4ever.net lostfilm-online.ru
magiadinamibia.blogspot.com lyrster.com
managerpak204.weebly.com m.b00kmarks.com
mansiondelrio.co m1media.net
maridan.com.ua mabdoola.blogspot.com
marketingvici.com macdamaged.space
matrixalchemy.com macfix.life
mazda-roadsters.com marblestyle.ru
mebelcomplekt.ru markjaybeefractal.com
mcnamaratech.com
medosmotr-ufa.ru medosmotr-ufa.ru
meget.co.za megakino.net
mensandals.xyz menhealed.net
mesto-x.com meteostate.com
meteocast.net mil-stak.com
methodsmarketing.com minecraft-neo.ru
mindbox.co.za minegam.com
mixed-wrestling.ru mini.7zap.com
mmofreegames.online mirobuvi.com.ua
mmoguider.ru mmog-play.ru
mokrayakiska.com mobifunapp.weebly.com
mompussy.net moesexy.com
moneymaster.ru moncleroutletonline.xyz
montredemarque.nl morf.snn.gr
moroccosurfadventures.com
most-kerch.org most-kerch.org
mp3downloadhq.com mp3downloadhq.com
mrbitsandbytes.com mp3films.ru
mrpornogratis.xxx mrmoneymustache.com
mulberryoutletonlineeu.com music.utrolive.ru
mustat.com
mxgetcode.com mxgetcode.com
mydearest.co myblogregistercm.tk
myhealthcare.com mydownloadengine.com
mykings.pw myghillie.info
mysex21.com nalogovyykodeks.ru
nakrutka.cc narkologiya-peterburg.ru
newstaffadsshop.club nash-krym.info
neobux-bg.info
nero-us.com
netpics.org
newhairstylesformen2014.com
nextbackgroundcheck.gq
nextrent-crimea.ru nextrent-crimea.ru
nfvsz.com nfljerseys.online
nhl17coinsforps3.gratisblog.biz noclegonline.info
nicefloor.co.uk ntic.fr
nikhilbahl.com oddamzadarmo.eu
northfacestore.online ofanda.com
nuup.info offtime.ru
o-o-8-o-o.com onefilms.net
obiavo.in onlineserialy.ru
oil-td.ru onlywoman.org
onthemarch.co openmediasoft.com
osoznanie-narkotikam.net oren-cats.ru
oynat.info ourville.info
pandarastore.top p-business.ru
panicatack.com palvira.com.ua
paramountmarble.co.uk panouri-solare-acoperis.com
partner-pop.men partner-stop.men
patterntrader-en.com pathwhelp.org
pcboa.se pb-dv.ru
perso.wanadoo.es pinsdaddy.com
pflexads.com pl-top.pl
photorepair.ru play.leadzupc.com
picurams.pw pod-muzyku.club
pinstake.com poffet.net
piulatte.cz polytopesexempt.com
pizza-imperia.com pornoinn.com
pokemon-go-play.online pornolook.net
pokemongooo.ml pornosok.ru
polcin.de pornozhara.com
pooleroadmedicalcentre.co.uk poshiv-chehol.ru
popads.net privatefx-in.ru
pornogig.com prizefestival.mobi
pornogratisdiario.com prlog.ru
pornokajf.com pro-tec.kz
preconnubial.usuby.site prodess.ru
pregnant.guru productarium.com
pricheskaonline.ru
primedice.com
princevc.com
privat-girl.net
privatamateure.com
prizesbook.online
projectforte.ru
pronorm.fr pronorm.fr
prostitutki-astana.org propranolol40mg.blogspot.com
prostitutki-yaroslavlya.org prosmibank.ru
pshare.biz prpops.com
push-ad.com purplestats.com
qualitymarketzone.com qexyfu.bugs3.com
quick-seeker.com quit-smoking.ga
quickloanbank.com rapidsites.pro
r-e-f-e-r-e-r.com rating-casino2021.ru
rada.ru referencemoi.com
randki-sex.com remont-ustanovka-tehniki.ru
rarbg.to rep-am.com
razorweb-a.akamaihd.net rewardpoll.com
realtytimes.com rialp.getenjoyment.net
recordpage-a.akamaihd.net robertefuller.com
refudiatethissarah.info rock-cafe.info
relayblog.com
remont-comp-pomosh.ru
renecaovilla.online
rentehno.ru
rethinkwasteni.info
revistaindustria.com
riders.ro
rockma.se
rogervivierforsale.com
rollercoin.com
rossmark.ru rossmark.ru
running-line.ru royal-betting.net
sa-live.com royalvegascasino.com
sa-rewards.co.za rubanners.com
sammyweaver.com saddiechoua.com
sanidumps.com sankt-peterburg.nodup.ru
sardinie.us santasgift.ml
satoristudio.net satoristudio.net
savefrom.com sbdl.no
scanner-irvin.top scanner-george.top
scanner-jack.top scanner-jess.top
scanner-jane.top scanner-josh.top
schlampen-treffen.com schlampen-treffen.com
scmor.ilxc.cc sdrescher.net
searchimpression.com search.pch.com
seasaltwithfood.com searchinquire.com
secret.xn--oogle-wmc.com secret.xn--oogle-wmc.com
security60-e.com seo-2-0.com
sei80.com seocheckupx.com
seocdvig.ru seomarketings.online
servingnotice.com seorankinglinks.us
servethis.com
servicecenter.co.ua
sex-tracker.de
sex-znakomstva.online
sexfreepornoxxx.com
sexkontakte-seite.com
sextracker.de
sexytrend.ru
sfd-chess.ru sfd-chess.ru
sfj-ror.no shinikiev.com.ua
shopvilleroyboch.com.ua shoesonlinebuy.cn
shtaketniki.ru shop-electron.ru
siha.de simon3.ru
sildenafil-tadalafil.info simple-image.com.ua
sim-service.net simplepooltips.com
simple-share-buttons.com
site3.free-share-buttons.com site3.free-share-buttons.com
sitevaluation.com
sitopreferito.it sitopreferito.it
skachat-besplatno-obrazcy.ru sixcooler.de
skutecznetabletkinaporostwlosow.pl skutecznetabletkinaporostwlosow.pl
smailik.org skypasss.com
smallseotools.com sloopyjoes.com
smart-scripts.com smartadserver.com
snip.to soietvousmaime.fr
soaksoak.ru sonata-arctica.wz.cz
socialbutton.xyz soundfrost.org
soft-program.com soviet-portal.do.am
spb.afora.ru space4updating.win
spidtest.space speechfoodie.com
spin2016.cf speedup-my.site
spinnerco.ca squidoo.com
spl63.fr srgwebmail.nl
splendorsearch-a.akamaihd.net sstroy44.ru
spywarebegone.com start.myplaycity.com
stanthonyscatholicchurch.org stockspmb.info
steelmaster.lv strana-krasoty.ru
stretchingabuckblog.com stroicol.net
stroydetali.ru stromerrealty.com
sundrugstore.com strongsignal-a.akamaihd.net
survival.betteroffers.review students-cheapskate.ml
suture.co supervesti.ru
svetlotorg.ru swinger-mobil.net
svetodiodoff.ru
symbaloo.com symbaloo.com
tanieaukcje.com.pl tam-gde-more.ru
tandvardshuset.net
taximytishi.ru
telsis.com telsis.com
textads.men tetracsaudi.com
the-trader.net thefarmergame.com
thebestweightlosspills.ovh theheroes.ru
thecounter.com thepantonpractice.co.uk
theguardlan.com theporndude.com
thetoiletpaper.com thesmartsearch.net
thewebsitetemplate.info
thexart.club thexart.club
thfox.com tizanidine4mguses.blogspot.com
tiandeural.ru tizanidinecapsules.blogspot.com
time-japan.ru tizanidineformigraines.blogspot.com
tizanidineforopiatewithdrawal.blogspot.com
tizanidinehcl4mgtablet.blogspot.com
tizanidineinfo.blogspot.com
tizanidinepain.blogspot.com
tizanidinestreetvalue.blogspot.com tizanidinestreetvalue.blogspot.com
tizanidinewithdrawal.blogspot.com toolsky.com
tonivedu.it top250movies.ru
top-deal.com.pl torrnada.ru
topbestgames.com track-rankings.online
torrent-newgames.com trackzapper.com
torrentdownloadhub.com trafaret74.ru
totu.us trahvid.com
toyota.7zap.com trainoffend.ml
traffixer.com trion.od.ua
trustl.life tubeline.biz
tubo360.com turvgori.ru
turizm.bz tvnewsclips.info
tvteleport.ru tvorozhnaja-zapekanka-recept.ru
uasb.ru tvory.predmety.in.ua
ukrobstep.com typer.one
ukrtextbook.com udsgame.online
um-razum.ru unisexjewelry.org
umekana.ru unlimitdocs.net
unacittaconte.org urll.eu
undergroundcityphoto.com veles.shop
unimodemhalfduplefw.pen.io venta-prom.ru
usdx.us via-gra.webstarts.com
usswrite.com video-chat.cn
uvozdeckych.info vip-parfumeria.ru
uytmaster.ru visa-china.ru
vacuumscleaner.com visionwell.com.cn
vclicks.net vitanail.ru
viagra-soft.ru
vip-dom.in
vip2ch.com
vitalads.net
vkontarkte.com vkontarkte.com
vksaver-all.ru vltai.com
vsdshnik.com voluumtrk.com
vucms.com
vzglyadriv.kg
vzubah.com vzubah.com
walkme.com vzube.com
wallpaperstock.net wareseeker.com
walpaperlist.com warezkeeper.com
warning.or.kr waysbetter.cn
webix.me webadvance.club
webalan.ru
webcamdevochka.com
webjam.com
webs.com
website-speed-check.site website-speed-check.site
websiteexplorer.info
websites-reviews.com
wedding-salon.net wedding-salon.net
wetgames.ru wieseversa.no
whatistizanidinehclusedfor.blogspot.com wikes.20fr.com
whatsupinfoley.com winwotgold.pl
whereiskentoday.com wpsecurity.website
white-truck.life
whiteelephantwellington.com
witclub.info
woman-tampon.ru
works.if.ua
worldinternetauthority.com
wstroika.ru
www.ehscloud.cn
wygraj-skiny.win
xaylapdiendanang.com xaylapdiendanang.com
xev.ru xclicks.net
xgftnlrt.bloger.index.hr xn-----6kcaacnblni5c5bicdpcmficy.xn--p1ai
xjlottery.com xn----7sbbagbq7bd5aheftfllo4m.xn--p1ai
xmronta.com
xn--1-8sbcpb0bdm8k6a.xn--p1ai xn--1-8sbcpb0bdm8k6a.xn--p1ai
xn--80aaagvmjabrs1aoc9luc.xn--p1ai xn--80aaagvmjabrs1aoc9luc.xn--p1ai
xn--80ahvj9e.xn--p1ai xn--80aaajbdbddwj2alwjieei2afr3v.xn--p1ai
xn--h1ahbi.com.ua xn--80ahdheogk5l.xn--p1ai
xpresscare.ru xn--c1acygb.xn--p1ai
xwatt.ru xxxhdvideo.site
xxxtube69.com xzlive.com
yadro.ru
yaminecraft.ru yaminecraft.ru
yes-com.com yebocasino.co.za
youjizz.com yoopsie.com
youthreaders.com you-shall-not-pass.is74.ru
yunque.pluto.ro youbloodyripper.com
yur-p.ru yougetsignal.com
zaidia.xhost.ro yougotanewdomain.com
zastenchivosti.net yourads.website
zastroyka.org youtube-downloader.savetubevideo.com
zawyna.ua zajm-zalog-krasnodar.ru
zebradudka.com zambini.ru
zeroredirect9.com zerocash.msk.ru
zolotoy-lis.ru zeroredirect10.com
zone-kev717.info zhacker.net
zoomovies.org zhuravlev.info
zigarettenonlinekaufen.tumblr.com
zigzog.ru
znakomstva-piter78.ru
znakomstvaonlain.ru
zojirushi-products.ru
zona-aqua.ru
zoogdisany.com
zx6.ru

488
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
10bet.com 00webcams.com
123locker.com 0daymusic.org
1kinobig.ru 11235813.webzdarma.cz
2020iscoming.info 24videos.tv
404.mn 34.gs
aa9d046aab36af4ff182f097f840430d51.com 4pp13.com
aac52006ec82a24e08b665f4db2b5013f7.com 4webmasters.org
accessoires-mode.in 51.la
ahhjf.com 9med.net
albumsuper.info adanih.com
ameblo.jp adultwebhosting.info
ameblo.top affrh2015.com
amyfoxfitness.com alienwheel.es
animal-drawings.com alienwheels.de
apartmentbay.ru alt-servis.ru
autoblogger24.info anti-virus-removal.info
aversis.net apiappenableinfo-a.akamaihd.net
azartniy-bonus.com apilinkswiftco-a.akamaihd.net
azazu.ru arenda-avtoprokat-krasnodar.ru
babosas.com artparquet.ru
baikaleminer.com auto-moto-elektronika.cz
balkanfarma.ru auto.rusvile.lt
beclean-nn.ru automobile-spec.com
belinka.com.ua autotop.com.ua
bidbuy.co.kr ayakino.net
bigpictures.club balook.com
bimatoprost-careprost.com.ua bankcrediti.ru
bingo8888.com beachfix.co
bio.trade-jp.net beauty-clinic.ru
biocn.dx.am bestwaystogetpaid.us
bizzliving.com betune.onlinewebshop.net
blagovest-med.ru bimatoprost-careprost.com
bloggen.be blackbabesporn.com
bonzibuddi.com blogrankers.com
brainboostingsupplements.org bonkers.name
break-the-chains.com bosefux.esy.es
breget74.ru brus.city
canoncdriverq3.pen.io budilneg.xyz
canvas.gloverid.site buqayy0.livejournal.com
cheapmoncler.pw cakesplus.com.au
coaching-netz.info camdenmemorials.com
collegeessay19.blogspot.ru camel-beach.com
compiko.info cartierjusteunclou.xyz
coolgamechannel.com cartierreplica.win
cougfan.info charmstroy.info
customchocolate.business-for-home.com clknsee.com
dev78.dioniqlabb.se codq.info
dfwu1019.info compliance-alexa.top
dimaka.info compliance-jess.top
dividendo.ru compliance-nelson.top
divku.ru cookie-law-enforcement-ee.xyz
documentbase.net copyrightclaims.org
domini.cat cowblog.fr
education-cz.ru creativehutindia.com
dandiyabeats.in
darkages.info
demenageur.com
dev33.dioniqlabb.se
dlya-android.org
downloadeer.net
downloadme.life
downtuptv.gq
dustyorate.com
e-avon.ru
eduserver.net eduserver.net
ekosmetyki.net.pl elektir.ru
eleimgo.pw elektrischeziga.livejournal.com
elektrischezigarette1.onsugar.com elektrischezigaretten2.beeplog.com
elektrozigarette2.webs.com elektroniksigaraankara.info
elitedollars.com elektrozigaretten1.postbit.com
elmifarhangi.com en.altezza.travel
event-tracking.com englishgamer.com
exoclick.com erotikchat-24.com
ezigaretteshop2.mywapblog.com este-line.com.ua
feargames.ru etm-consult.de
flauntyoursite.com everypony.ru
flipper.top excitacion.info
foodgid.net executehosting.com
free-floating-buttons.com f1nder.org
freshberry.com.ua family1st.ca
fsalas.com fantasticpixcool.com
fungamelands.com fishingwholesale.us
gambarkataku.co fivedwld.cf
gearcraft.us forum20.smailik.org
forumprofi.de
fotopop.club
freemags.cc
fusoradio.info
gamezblox.com
gdzkurokam.ru
geilehausfrauen.net geilehausfrauen.net
gne8.com gembird.com
go2album.com genetworx.com
goblacked.com germetiki.com.ua
gribokstop.com get-seo-domain.com
gsasearchengineranker.site ghazel.ru
guardlink.com ghostvisitor.com
handsandlegs.ru glicol.kz
highspeed5.net goforexvps.com
historichometeam.com golaya.pw
hosting-tracker.com googst2.ru
hotel-mkad.ru graphid.com
hotelcrocenzi.sm gsasearchengineranker.top
hspline.com h2monline.com
humanorightswatch.org handicapbathtubarea.com
ico.re hasfun.com
images-graphics-pics.com hauleddes.com
inboxdollars.com howopen.ru
interior-stickers.ru iinstalll-fii1leis.jus0wil.pp.ua
investsuccess.org incest-ru.com
iphantom.com indiakino.net
ipornox.xxx internet-apteka.ru
isotoner.com invitefashion.com
iwantedmoney.com jackpotchances.com
ixora.pro jennyfire.ru
jamiembrown.com kaidalibor.de
janerikholst.se kasino-money.pw
javcoast.com kellyonline.xyz
joingames.org kemerovo.zrus.org
joyceblog.top keywordglobal.co.za
jurajskie.info kino-ecran.ru
kino-filmi.com kiwi237au.tk
kmgamex.cf kostenlos-sexvideos.com
komputernaya-pomosh-moscow.ru kredit-blog.ru
krasnodar.ru kung-fu-ru.com
kriokomora.info lanadelreyfans.us
lafriore.ru layola.biz.tc
lechtaczka.net leadn.pl
lexaprogeneric.link linkredirect.biz
life-instyle.com lion.playtap.us
limads.men liquimondo.com
linksharingt.com lirunet.ru
ljusihus.se livefixer.com
loadingpages.me lombardfinder.ru
longlifelomilomi.info m292.info
lostfilm-online.ru macresource.co.uk
marktforschung-stuttgart.com mafa-free.com
magda-gadalka.ru
mainlinehobby.net
marcogrup.com
masturbate.co.uk
mebel-ekb.com mebel-ekb.com
mebeldekor.com.ua mesto-x.com
mex-annushka.ru mexicotravelnet.com
michaelkorsoutlet.store missclub.info
militarysale.pro misterjtbarbers.com
minecraft-rus.org mistr-x.org
mini.7zap.com moneyviking-a.akamaihd.net
mirobuvi.com.ua moviezbonkerssk.cf
mixtapetorrent.com mttwtrack.com
mobile-appster.ru muztops.ru
moinozhki.com na15.ru
moroccosurfadventures.com naperehresti.info
moscow.online-podarki.com narkologiya-peterburg.ru
muz-shoes.ru nastroyke.net
muz-tracker.net neodownload.webcam
myseoconsultant.com no-fuel.org
northfacestore.online nw-servis.ru
nyfinance.ml oballergiya.ru
offside2.5v.pl onefilms.net
oralsexfilme.net onlythegames.com
ownshop.cf openfrost.com
paleohub.info openlibrary.org
partner-stop.men optitrade24.com
partner-trustworthy.men ororodnik.goodbb.ru
petitions.whitehouse.gov ostroike.org
phormchina.com ownshop.win
picquery.com page2rss.com
pizda.lol panamaforbeginners.com
porno-chaman.info parlament.biz
porno-play.net perso.wanadoo.es
porno-video-chati.ru phrcialiled.com
pornosee.info picturesmania.com
pr-ten.de pk-services.ru
prodess.ru popup-jdh.xyz
projectforte.ru priceg.com
prokotov.com privatamateure.com
pussysaga.com prod2016.com
qexyfu.bugs3.com profitfx.online
quickloanbank.com ptr.ruvds.com
raschtextil.com.ua pulseonclick.com
recipedays.com quangcaons.com
remont-komputerov-notebook.ru rangjued.com
remorcicomerciale.ro rebelmouse.com
remybutler.fr remote-dba.de
responsinator.com ribieiendom.no
rialp.getenjoyment.net roznica.com.ua
rozalli.com saltspray.ru
ruf777.com
sanatorrii.ru
saneitconsulting.com saneitconsulting.com
sankt-peterburg.nodup.ru sarf3omlat.com
sanyuprojects.com searchkut.com
savingsslider-a.akamaihd.net seminarykansas904.ml
score-ads.men seofirmreviewsus.info
secret.xn--oogle-wmc.com seorankinglinks.us
sell-fb-group-here.com sex-dating.co
seobility.net sex-znakomstva.online
seonetwizard.com sexfreepornoxxx.com
service-core.ru sexkontakteao.info
sex-sex-sex5.com
sexpornotales.com
sexuria.net sexuria.net
sharebutton.net sexvideo-sex.com
silverage.ru shakhtar-doneck.ru
sinel.info shopfishing.com.ua
sitechecker.pro siteaero.com
siteexpress.co.il snip.tw
sobecjvuwa.com.ru solicita.info
solitaire-game.ru songoo.wz.cz
spinnerco.ca souvenir.cc
spywarespy.com sr-rekneskap.no
staticfs.host start.myplaycity.com
steame.ru supernew.org
stroicol.net svolze.com
strongholdsb.ru symbaloo.com
suhanpacktech.com themeforest.net
superstarfloraluk.com tizanidine4mg.blogspot.com
surcentro.com tizanidinehcl4mgtab.blogspot.com
surgut.zrus.org tizanidineonline.blogspot.com
surintech.ac.th topsy.com
svarbit.com toy-shop.top
thaismartloan.com tpu.ru
thebluenoodle.com trafficfactory.biz
titelhelden.eu trahic.ru
topappspro.com tramadolandtizanidine.blogspot.com
topshef.ru tsstcorpcddvdwshbbdriverfb.aircus.com
tracxn.com uhodzalijami.ru
tripper.de ukr-lit.com
tsan.net umg-stroy.ru
tvnewsclips.info usadacha.net
tytoona.com valkiria-tk.ru
uchetunet.su varbergsvind.se
ugogo.info via-gra.webstarts.com
usswrite.com viagraneggrx.com
valuado.com viberdownload10.com
vandrie-ict.nl vuclip.com
vapeface.club watchmygf.net
vapsy.com wcb.su
vedomstvo.net webextract.profound.net
viandpet.com
videochat.life
videochat.tv.br
videooko.weebly.com
vksaver-all.ru
vonradio.com
vsesubwaysurfers.com
wallpaperstock.net
wapsite.me
webmasters.stackexchange.com webmasters.stackexchange.com
webnode.me webmonetizer.net
weightatraining.com website-speed-up.site
wholesalecheapjerseysfree.com websiteexplorer.info
wjgony.com wedding0venues.tk
worldlovers.ru wesharepics.site
worldoffiles.ru woweb.com.ua
wormix-cheats.ru xmladserver.com
xclicks.net xn-----8kcatubaocd1bneepefojs1h2e.xn--p1ai
xn----9sbubg3ambdfl1j.xn--p1ai yellowstonesafaritours.com
xn--hxazdsfy.blogspot.com za-fun-offer.com
xuki.us zaobao.com.sg
xvideosbay.com zeg-distribution.com
xxxasianporn.net zocaparj.kz
yebocasino.com
yougame.biz
zaloro.com
zeroredirect10.com
zeroredirect6.com
zigarettenonlinekaufen1.bloog.pl
zoolubimets.ru

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.16 0; 10.1.0.203 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2021.08.2559 ### Version: V4.2021.08.2560
### Updated: Mon Aug 30 10:03:22 UTC 2021 ### Updated: Mon Aug 30 22:01:22 UTC 2021
### Bad Bot Count: 624 ### Bad Bot Count: 624
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2021.08.2559 ### Version: V4.2021.08.2560
### Updated: Mon Aug 30 10:03:22 UTC 2021 ### Updated: Mon Aug 30 22:01:22 UTC 2021
### Bad Bot Count: 624 ### Bad Bot Count: 624
################################################### ###################################################
### Version Information ## ### Version Information ##