vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-01 18:19:55 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2022.03.2953 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2022-03-02 10:09:23 +00:00
parent 5c0011615d
commit 25a59bfc54
47 changed files with 89544 additions and 89554 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.03.2952 #### Version: V4.2022.03.2953
#### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [636](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [636](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.03.2952 #### Version: V4.2022.03.2953
#### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [636](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [636](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -13,7 +13,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2022.03.2952 #### Version: V4.2022.03.2953
#### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [636](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [636](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

11056
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2022.03.2952 #### Version: V4.2022.03.2953
#### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [636](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [636](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

11060
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

11060
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

11060
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

11060
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.219 1; 10.1.1.135 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.219 0; 10.1.1.135 0;
127.0.0.1 0; 127.0.0.1 0;

11060
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.219 1; 10.1.1.135 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.219 0; 10.1.1.135 0;
127.0.0.1 0; 127.0.0.1 0;

11060
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.219 1; 10.1.1.135 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.219 0; 10.1.1.135 0;
127.0.0.1 0; 127.0.0.1 0;

11060
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
2952 2953

11060
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

11060
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
52.158.234.151 0; 40.91.97.83 0;

11060
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.219 1; 10.1.1.135 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.219 0; 10.1.1.135 0;
127.0.0.1 0; 127.0.0.1 0;

11060
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.219 1; 10.1.1.135 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.219 0; 10.1.1.135 0;
127.0.0.1 0; 127.0.0.1 0;

11060
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.219 1; 10.1.1.135 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.219 0; 10.1.1.135 0;
127.0.0.1 0; 127.0.0.1 0;

11060
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
52.158.234.151 0; 40.91.97.83 0;

11060
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
52.158.234.151 0; 40.91.97.83 0;

11060
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.219 1; 10.1.1.135 1;
127.0.0.1 1; 127.0.0.1 1;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
404enemy BetaBot
Pu_iN Blackboard
Trendiction CODE87
Twice Digincore
V-BOT Express WebPictures
Web Auto ExtractorPro
cah.io.community Not
crawler.feedback Pimonster
lwp-trivial Sitevigil
zauba.io Web Enhancer

296
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
404enemy 01h4x.com
360Spider
80legs
ADmantX
ALittle Client ALittle Client
Abonti
Acunetix
AfD-Verbotsverfahren AfD-Verbotsverfahren
AhrefsBot AhrefsBot
AiHitBot
AllSubmitter
AlphaBot AlphaBot
Anarchie
Anarchy99
Ankit
Anthill
Aspiegel Aspiegel
Atomseobot Asterias
Attach BLEXBot
AwarioRssBot BackWeb
BBBike Bandit
BDCbot
BDFetch
BackStreet
Barkrowler
BetaBot
Bigfoot
Black Hole Black Hole
BlowFish BlackWidow
Boardreader
BotALot BotALot
Brandprotect
Brandwatch
Buck Buck
Buddy
BuiltWith BuiltWith
BuzzSumo CCBot
CODE87 CODE87
CSHttp
CazoodleBot CazoodleBot
Cegbfeieh Cegbfeieh
CheTeam CheTeam
CherryPicker CherryPicker
ChinaClaw ChinaClaw
Chlooe
Citoid
Cliqzbot
Cloud mapping Cloud mapping
Cocolyzebot
Copier Copier
CopyRightCheck CopyRightCheck
Cosmos Copyscape
Crawling at Home Project
CrazyWebCrawler CrazyWebCrawler
CrunchBot CrunchBot
Curious DIIbot
DataCha0s
Demon Demon
Deusu
Devil Devil
Digincore
DigitalPebble DigitalPebble
Dispatch Discobot
DnyzBot DomainSigmaCrawler
DomCopBot
DomainCrawler
DomainStatsBot
Domains Project Domains Project
Dotbot
Download Wonder
Dragonfly Dragonfly
Drip EMail Siphon
EMail Wolf EMail Wolf
Evil Ebingbong
Ecxi
EirGrabber
Express WebPictures Express WebPictures
ExtLinksBot Ezooms
Extractor Fimap
Extreme Picture Finder Firefox/7.0
FemtosearchBot FlashGet
Fuzz Freeuploader
G-i-g-a-b-o-t FyberSpider
GT::WWW Fyrebot
Genieo GalaxyBot
GetRight GetRight
GetWeb
Getintent
GrapeFX GrapeFX
GrapeshotCrawler GrapeshotCrawler
GridBot
HEADMasterSEO
HMView HMView
HTMLparser HTMLparser
HTTP::Lite HTTP::Lite
HTTrack
HaosouSpider
Harvest Harvest
Havij Havij
Hloader
HonoluluBot HonoluluBot
Humanlinks HybridBot
IDBot
IRLbot
IlseBot
Image Fetch
IndeedBot IndeedBot
Indy Library
InfoTekies InfoTekies
InterGET InterGET
JamesBOT Internet Ninja
Jbrofuzz InternetSeer
JetCar Iskanie
Jetty Jetty
Joomla Kenjin Spider
Jyxobot
Keyword Density
Kinza Kinza
Kozmosbot
LNSpiderguy LNSpiderguy
LWP::Simple LWP::Simple
Lanshanbot
Larbin
LeechFTP
LexiBot LexiBot
Lftp
LibWeb LibWeb
Libwhisker Likse
LinkScan LinkWalker
Linkdexbot LinkextractorPro
LinkpadBot
LinksManager
LinqiaMetadataDownloaderBot
LinqiaRSSBot LinqiaRSSBot
Lmspider LinqiaScrapeBot
Ltx71 Litemage_walker
MSFrontPage MFC_Tear_Sample
MSIECrawler MSIECrawler
Magnet Mag-Net
Mail.RU_Bot Mail.RU_Bot
Majestic-SEO MarkMonitor
MarkWatch MarkWatch
Mass Downloader
MauiBot MauiBot
MeanPath Bot
Microsoft URL Control Microsoft URL Control
Mojolicious Mister PiX
Mojeek
MolokaiBot MolokaiBot
Mozlila Mozlila
Mr.4x3
NICErsPRO
NPbot NPbot
Name Intelligence Nameprotect
NearSite Navroad
Needle
NetZIP NetZIP
Netcraft Nettrack
Netvibes
NextGenSearchBot
Niki-bot
Nikto
Nimbostratus Nimbostratus
Nmap Ninja
Not Nutch
Octopus OpenVAS
Offline Navigator Openvas
OutfoxBot OrangeSpider
PECL::HTTP PageAnalyzer
Page Analyzer Picscout
PageGrabber
PageScorer
Panscient
Papa Foto
Petalbot
Pi-Monster
Picsearch Picsearch
PictureFinder
Piepmatz Piepmatz
PleaseCrawl Pixray
ProPowerBot ProWebWalker
Psbot
Pu_iN
QueryN Metasearch QueryN Metasearch
Quick-Crawler RankingBot
RSSingBot
RankurBot RankurBot
Re-re ReGet
RealDownload Reaper
RebelMouse RedesScrapy
RepoMonkey
Ripper
Rogerbot
SBIder SBIder
SEOprofiler
SEOstats SEOstats
SalesIntelligent SMTBot
ScanAlert ScanAlert
Scrapy
Screaming Screaming
SearchmetricsBot Searchestate
Seekport Semrush
SeoSiteCheckup
SeobilityBot SeobilityBot
SiteExplorer Site Sucker
SiteSucker
Sitebeam Sitebeam
Siteimprove
Sitevigil Sitevigil
Snake
Snapbot Snapbot
Snoopy Snoopy
SocialRankIOBot Sogou web spider
Sociscraper
Sosospider
Sottopop Sottopop
SpaceBison
Spbot Spbot
Sqworm Sqlworm
Stripper Stripper
Surfbot Sucuri
SurveyBot Suzuran
Szukacz Szukacz
T0PHackTeam Teleport
T8Abot
TeleportPro TeleportPro
Telesoft Telesphoreo
Tracemyfile Telesphorep
True_Robot Thumbor
Turingos TightTwatBot
Titan
TwengaBot TwengaBot
Twice
Typhoeus Typhoeus
URLy Warning VB Project
UnisterBot
VCI
VelenPublicWebCrawler VelenPublicWebCrawler
Virusdie VidibleScraper
VoidEYE VoidEYE
Voltron Voil
WASALive-Bot WASALive-Bot
WEBDAV
WISENutbot
WPScan WPScan
WallpapersHD WWW::Mechanize
Web Fetch Wallpapers
Web Sucker Web Enhancer
WebCollage Web Fuck
WebCopier WebAuto
WebFetch WebFuck
WebLeacher WebPix
WebReaper WebReaper
WebSauger
WebZIP WebZIP
Webshag Webshag
WebsiteExtractor WebsiteExtractor
Whatweb Webster
Who.is Bot Whack
Widow WinHTTrack
WiseGuys Robot WiseGuys Robot
Xaldon_WebSpider Wonderbot
Xenu Wprecon
Xaldon WebSpider
YoudaoBot YoudaoBot
Zitebot Zauba
Zeus
ZoomBot ZoomBot
ZumBot
ZyBorg
adscanner adscanner
arquivo-web-crawler
autoemailspider autoemailspider
backlink-check backlink-check
check1.exe cah.io.community
coccocbot
cognitiveseo
crawl.sogou.com
crawler.feedback crawler.feedback
dataforseo.com dataforseo.com
demandbase-bot
domainsproject.org
evc-batch evc-batch
facebookscraper facebookscraper
gopher gopher
heritrix
instabid
ips-agent ips-agent
lwp-request isitwp.com
netEstate NE Crawler lwp-trivial
mediawords
plumanalytics
probe-image-size
ripz ripz
satoristudio.net scan.lol
seobility
seocompany.store seocompany.store
seoscanners
sexsearcher sexsearcher
sitechecker.pro sitechecker.pro
spyfu sogouspider
trendiction.com sp_auditbot
trendiction.de sysscan
webmeup-crawler ubermetrics-technologies.com
webgains-bot
webpros.com webpros.com
webprosbot webprosbot
xpymep1.exe x22Mozilla
zgrab

308
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
404enemy
80legs 80legs
Aboundexbot ADmantX
ASPSeek
Aboundex
Acunetix
AhrefsBot
Aipbot Aipbot
AllSubmitter AlphaBot
Anarchy
Anthill Anthill
Atomseobot Attach
AwarioRssBot BDFetch
AwarioSmartBot BLEXBot
BBBike BackStreet
Backlink-Ceck Backlink-Ceck
BacklinkCrawler BacklinkCrawler
Barkrowler Bandit
BetaBot BatchFTP
Bigfoot
Bitacle
Blackboard Blackboard
Blow BlowFish
Bolt BotALot
Brandprotect Brandprotect
Brandwatch
Buck Buck
Buddy BuiltBotTough
BuiltWith BuiltWith
BuzzSumo Bullseye
CATExplorador BunnySlippers
CCBot CSHttp
CODE87 Calculon
CheTeam Cegbfeieh
CherryPicker Chlooe
ChinaClaw Cloud mapping
Cliqzbot Cogentbot
Collector Collector
Copier Craftbot
Cosmos Crawling at Home Project
Crescent CrunchBot
CyotekWebCopy Curious
DataCha0s DSearch
Deusu DTS Agent
Dirbuster DatabaseDriverMysqli
Dispatch Demon
DittoSpyder Discoverybot
DnBCrawler-Analytics
DomCopBot DomCopBot
DomainStatsBot DomainAppender
Download Wonder DomainCrawler
DomainSigmaCrawler
Domains Project
Drip
ECCP/1.0 ECCP/1.0
EMail Siphon
EMail Wolf EMail Wolf
EasyDL EroCrawler
Express WebPictures Evil
ExtLinksBot ExtLinksBot
Ezooms Extractor
FemtosearchBot ExtractorPro
FlashGet EyeNetIE
Freeuploader FHscan
GT::WWW Fimap
Genieo Firefox/7.0
GetRight FrontPage
GetWeb Fuzz
Gigabot
Go-Ahead-Got-It Go-Ahead-Got-It
Grafula Grafula
GrapeFX GrapeFX
GridBot
HEADMasterSEO
HMView HMView
HTMLparser HTMLparser
HaosouSpider HTTP::Lite
HTTrack
Harvest
Havij Havij
Heritrix Heritrix
HonoluluBot Humanlinks
HybridBot HybridBot
IRLbot
Iblog Iblog
IlseBot
Image Fetch Image Fetch
Image Sucker Indy Library
IndeedBot Intelliseek
Internet Ninja Internet Ninja
JetCar InternetSeer
IstellaBot
JamesBOT
JennyBot
JikeSpider
Jorgee Jorgee
Jyxobot Kenjin Spider
Keyword Density Kinza
Lanshanbot
Larbin Larbin
Likse Leap
LinkWalker LibWeb
Linkbot Libwhisker
LieBaoFast
Lightspeedsystems
LinkScan
Linkdexbot
LinkextractorPro LinkextractorPro
LinksManager LinkpadBot
LinqiaScrapeBot LinqiaMetadataDownloaderBot
Litemage_walker Lmspider
Ltx71
MFC_Tear_Sample MFC_Tear_Sample
MSIECrawler MQQBrowser
MSFrontPage
MTRobot MTRobot
Mag-Net Majestic SEO
Magnet
Majestic12
MarkMonitor
Mass Downloader
Masscan Masscan
Mata Hari MauiBot
Mb2345Browser
MeanPath Bot
Meanpathbot
Mediatoolkitbot Mediatoolkitbot
Mister PiX MegaIndex.ru
Metauri
MicroMessenger
Moblie Safari Moblie Safari
Mojeek MolokaiBot
Mr.4x3 Mozlila
NICErsPRO NICErsPRO
Name Intelligence Name Intelligence
Navroad
Needle Needle
Net Vampire Nessus
NetAnts NetAnts
NetLyzer NetLyzer
NetMechanic
NetSpider NetSpider
NextGenSearchBot NetZIP
Nikto Nikto
NimbleCrawler
Nimbostratus Nimbostratus
Not Nuclei
Nutch
Octopus
Offline Explorer
Offline Navigator
OnCrawl
OpenLinkProfiler
OpenVAS
Openfind Openfind
OrangeBot OutfoxBot
PECL::HTTP PECL::HTTP
POE-Component-Client-HTTP PHPCrawl
Page Analyzer Page Analyzer
PageGrabber PageAnalyzer
PageScorer PageScorer
PageThing.com
Pandalytics Pandalytics
Pavuk Pavuk
Pi-Monster
Picscout Picscout
PictureFinder Piepmatz
PleaseCrawl Pimonster
ProPowerBot Pixray
ProWebWalker Psbot
Probethenet Pu_iN
Pump Pump
QueryN Metasearch
Quick-Crawler
RSSingBot RSSingBot
RankActiveLinkBot RankActive
RankingBot RankingBot
RankurBot
Re-re
RealDownload
Reaper
RedesScrapy RedesScrapy
Ripper Ripper
RocketCrawler RocketCrawler
SBIder
SEOkicks
SEOkicks-Robot SEOkicks-Robot
SEOlyticsCrawler
SEOstats
SISTRIX SISTRIX
SMTBot
ScanAlert ScanAlert
Scanbot Searchestate
ScoutJet
Scrapy
Screaming
ScreenerBot
SearchmetricsBot
Semrush Semrush
SeoSiteCheckup
SeobilityBot SeobilityBot
Shodan
Siphon
Site Sucker Site Sucker
SiteCheckerBotCrawler
SiteExplorer SiteExplorer
SiteSucker SiteSucker
Sitebeam Siteimprove
Sitevigil Sitevigil
SmartDownload Snoopy
SocialRankIOBot SocialRankIOBot
SpankBot Sociscraper
Sosospider
SpaceBison
Spammen
Spinn3r
SputnikBot SputnikBot
Sqlworm Sqlmap
Stripper
Sucuri
T0PHackTeam T0PHackTeam
Teleport T8Abot
TeleportPro Telesoft
Telesphoreo Telesphoreo
The Intraformant
TheNomad
Thumbor
TightTwatBot
Toweyabot
Trendiction Trendiction
Turingos Turnitin
TurnitinBot TurnitinBot
TwengaBot
Twice
Typhoeus
URLy Warning URLy Warning
V-BOT
VB Project VB Project
VCI Vacuum
VeriCiteCrawler Vagabondo
VidibleScraper
Virusdie
Voil Voil
WASALive-Bot
WISENutbot
WPScan WPScan
Wallpapers WWW-Mechanize
Web Collage WWWOFFLE
WallpapersHD
WeSEE
Web Enhancer
Web Fetch Web Fetch
Web Sauger WebAuto
Web Sucker
WebCollage WebCollage
WebCopier
WebFetch
WebFuck WebFuck
WebGo IS
WebLeacher WebLeacher
WebStripper
WebZIP
Webalta Webalta
WebmasterWorldForumBot Whack
Website Quester
Whatweb
Who.is Bot
Wonderbot Wonderbot
Woobot Woobot
Wotbox Wotbox
Wprecon Wprecon
Xaldon WebSpider
Xaldon_WebSpider
Xenu Xenu
Zauba Zauba
Zeus Zeus
Zitebot
ZoomBot
ZyBorg
arquivo-web-crawler arquivo-web-crawler
arquivo.pt
autoemailspider autoemailspider
check1.exe
coccocbot coccocbot
crawl.sogou.com cognitiveseo
crawler4j crawler.feedback
dataforseo.com eCatch
evc-batch evc-batch
gopher
heritrix
instabid instabid
internetVista monitor internetVista monitor
ips-agent ips-agent
meanpathbot lwp-request
muhstik-scan magpie-crawler
oBot
pcBrowser pcBrowser
polaris version plumanalytics
probe-image-size probe-image-size
ripz ripz
seocompany.store seostar
seoscanners serpstatbot
sp_auditbot trendiction.com
sysscan
tAkeOut
webmeup-crawler
webprosbot webprosbot
x09Mozilla xpymep1.exe
zauba.io

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
aloofly.com dividendo.ru
briomotor.co elektronischezigarettekaufen1.myblog.de
bytimedance.ru geile-lelly.eu
candypeople.se husky-shop.cz
exportshop.us jerseywholesalechinabiz.com
girlporn.ru kakablog.net
mobile-appster.ru koral.se
nsatc.net scanner-alexa.top
track-rankings.online sureone.pro
unionmarkt.de wanker.us

960
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
1-free-share-buttons.com 08800.top
10bet.com 1008.su
123cha.com 108shot.com
12masterov.com 1xbet4you.com
1kinobig.ru 214jaluwobapef.cf
1pamm.ru 2728fb936f0.com
20pascals.nl 3xforum.ro
24-ak.ru 5000-cotydzien.com
24videos.tv 5kstore.com
2girls1cup-free.com 7a2rnuey1tw9ar.ru
2itech.ru 8kisses.eu
7wind.ru DomainStatsBot
7zap.com aa625d84f1587749c1ab011d6f269f7d64.com
991mostfm.co.id abovetherivernc.com
aac500b7a15b2646968f6bd8c6305869d7.com academia-nsk.org
actices.com acmebtn.ml
adhome.biz adman.gr
ads-cool.pro admeasures.com
adsland.men adminshop.com
adssafeprotected.com adprotect.net
adultactioncam.com adsloads.com
adultfriendfinder.com agecheckadult.com
adultmeetonline.info air-edem.ru
ageofclones.com ald2014.org
ahrntal.verymes.xyz alldezservice.kz
aktivator-windows10.blogspot.com allnews.md
albamargroup.com alphaforum.ru
alldownload.pw ameblo.top
allstatesugarbowl.org amoi.tn
alpinism.ru andpolice.com
aludecor.info apiadanaknet-a.akamaihd.net
ampower.me apiappenableinfo-a.akamaihd.net
android-systems.ru apiholdingmypage-a.akamaihd.net
animalrank.com apiwebwebgetcom-a.akamaihd.net
apartamentwroclaw.eu apiwoodensealcom-a.akamaihd.net
apccargo.com apparel-offer.com
apidigidocketnet-a.akamaihd.net appartement-stumm.at
apifasterlightin-a.akamaihd.net appearance-cool.com
apimegabrowsebiz-a.akamaihd.net apper.de
apiportalmorecom-a.akamaihd.net arenda-avtoprokat-krasnodar.ru
appfixing.space arendakvartir.kz
apple.com-webbrowsing-security.science as5000.com
apxeo.info auto-zapchasti.org
artpicso.com auto.rusvile.lt
atlasvkusov.ru autobrennero.it
atmagroup.ru automatic-seo.com
atovh.local-finders.com aviav.ru
ayodhya.co avon-severozapad.ru
azbaseimages.net avto-oligarh.ru
b2b-lounge.com avtoarenda.by
bablonow.ru axbocz.net
babyguns.ru babespcs.com
bard-real.com.ua badavit.com.ua
bear.gotcher.us bankofthewext.com
beremenyashka.com bannerconnect.net
bestadbid.com bausparen.bz.it
bestfortraders.com bayareaaeroclub.org
besthoro.ru bbtec.net
bestmobilityscooterstoday.com beachfix.co
bestssaker.com berlininsl.com
bestwebsitesawards.com best-seo-solution.com
bestwrinklecreamnow.com bestcoin.cc
bfz.biz bestcurs.org
bigames.online bestimagecoollibrary.com
bigpictures.club betteroffers.review
bimatoprost-careprost.com big-boards.info
bio-optomarket.ru bigcities.org
blackcurranthumidifiers.site binomo.com
bmw-ark.ru bitcoins-live.ru
board.f00d.de bjorkbacken.nu
boobsimge.com blobar.org
boostmyppc.com blog-hits.com
bpro1.top blue-square.biz
brainzpod.win bobba.dzaba.com
brokergid.ru brainxs.us
buqayy0.livejournal.com brandedleadgeneration.com
buttons-for-your-website.com brillianty.info
buy-meds24.com bristolhostel.com
buyk.host.sk business-suggested.tk
buyviagraa.blogspot.com buy-cheap-online.info
bvlgariring.xyz bvlgaribracelet.xyz
calcularpagerank.com candcstuccoandstone.com
callawaygolfoutlet.online capsderfudd.tk
cardsharp1.ru carmuffler.net
cartechnic.ru carsdined.org
cbcseward.com cartierloveringreplica.xyz
cbox.ws caulderwoodkennels.com
cementaresearch.se cb.iphantom.com
censys.io cbozhe.com
check-this-out-now.online cctva.tv
chinacheapelitejerseys.com cdnanalytics.xyz
ciceros.co cellfun.mobi
ciekawinki.pl ceotrk.com
citysecurity.nu cfcl.co.uk
cl.s7.exct.net changde.58.com
charmstroy.info
chelnytruck.ru
cindymatches.com
claytransformations.info claytransformations.info
clippingphotoindia.com clicksor.net
coaching-netz.info collegeessay19.blogspot.ru
coccoc.com contentlook.co
comeondog.info cookingmeat.ru
cometorussia.net coolgamechannel.com
compliance-irvin.xyz cougfan.info
compliance-margo.top cowlmash.com
coolgramgoods.com craftinsta.ru
copro.pw cscwtalkto.site
coprofam.org culad.com
cranly.net cymbaltaandtizanidine.blogspot.com
cryptoswap.biz cypernhuset.se
d2jsp.org dairyindia.in
daptravel.com daisye.top
ddlmega.net dangphoto.trade
ddospanel.com darkbooks.org
ddpills.com data.vtc.pw
delitime.info davebestdeals.com
daydream-studio.ru
deluxedumps.com deluxedumps.com
derevesendeco.com demon-tweeks.com
detki-opt.ru deniven.1bb.ru
dev-seo.blog detmebel.su
discovertreasure-a.akamaihd.net diarioaconcagua.com
dmmspy.com dieswaene.com
dildofotzen.net
div.as
dnepropetrovsk.mistr-x.org
docsportal.net
dogbreedspicture.net
dokfilms.net
domik-derevne.ru domik-derevne.ru
domznaniy.ru dominterior.org
downloaddy.net downloader12.ru
downvids.net dvr.biz.ua
dvrlists.com e-c.al
dyt.net elektronischezi.livejournal.com
e-avon.ru elektronischezigarette2.mex.tl
easyukraine.com elektronischezigarettekaufen1.beeplog.com
efkt.jp elektronischezigarettekaufen2.tumblr.com
egovaleo.it elektrozigarettekaufen1.devhub.com
elektroniksigaraankara.info elektrozigaretten1.tumblr.com
elitesportsadvisor.com enbersoft.com
energydiet24.ru encodable.com
enge-fotzen.info englishdictionaryfree.com
enhand.se eropho.net
eonpal.com eshop.md
erectile.bid eupornstar.info
eropho.com euroskat.ru
erotikstories.ru evidencecleanergold.com
etur.ru exct.net
extlinks.com executehosting.com
f012.de exoneration-project.us
faithe.top expresstoplivo.ru
falopicm.pw ezaz.info
famix.xyz facialporntube.com
fatfasts-4tmz.com fatfasts-4tmz.com
ferrotodo.com fba-mexico.com
fettefrauen.net fertilitetsradgivningen.se
figuringmoneyout.com fifa-coins.online
finansov.info filefilter.weebly.com
findacheaplawyers.com filmgo.ru
findpics.pw filmi-onlain.info
financetip.eu
findpik.com findpik.com
fishtauto.ru floridamhca.org
fitnesspiks.com
flash4fun.com
flowersbazar.com flowersbazar.com
fm-upgrade.ru flprog.com
fodelsedagspresenter.nu food.dtu.dk
formulaantiuban.com
fortevidyoze.net fortevidyoze.net
fotoxxxru.com forum-engineering.ru
foxweber.com forum69.info
free-share-buttons.blogspot.com foto-basa.com
free-traffic.xyz frameimage.org
freenom.link free-today.com
freewlan.info
friendflnder.com friendflnder.com
fungirlsgames.net front.ru
fxtips.ru funnel.co.za
fyxabomiw.ru funnymama.com
gambarxkata.co gamebackyard.com
gamerscorps.com gay-site.store
gateway.zscalertwo.net gazporno.com
gazobeton-p.com.ua genericlowlatencyasiodriverhq.aircus.com
gearsadspromo.club girls-ufa.ru
geckoandfly.com glall.ru
geileweiber.tk glass-msk.ru
get-your-social-buttons.info glicol.kz
gifspics.com globalscam.ga
gigixo.com gogps.me
gilsonchiro.xyz goldadpremium.com
girlspicsa.com good-mummy.ru
goodhumor24.com goodwriterssales.com
gribkovye-zabolevaniya.com googlsucks.com
gsasearchengineranker.site gopro-online.info
gsasearchengineranker.xyz gotorussia.com
gsasearchenginerankerdiscount.com gsasearchengineranker.top
gta-top.ru gsmtlf.ru
hasfun.com gwebtools.com.br
hatdc.org hamilton.ca
hchha.com handicapbathtubarea.com
hdseriale.pl handicapvansarea.com
hermesbracelets.xyz hao123.com
hornymatches.com havepussy.com
hotenergy.ru hdhc.ru
hotxnights.info hentaiheroes.com
howopen.ru hotchatdate.com
howtowhitenteethfast.xyz howtoclean.club
imabase.com humanorightswatch.org
imediadesk.com igithab.com
imitex-plus.ru ilmexico.com
inclk.com imagecoolpub.com
increasewwwtraffic.info img.wallpaperstock.net
infazavr.ru immigrational.info
infoupdate.org impotentik.com
instasexyblog.com inboundlinks.win
int.search.mywebsearch.com indianmedicaltourismshop.com
investmac.com infogame.name
irunfar.com interior-stickers.ru
istizanidineacontrolledsubstance.blogspot.com internetartfair.com
iwantedmoney.com itis4you.com
jacago.com janavibekken.no
janerikholst.se jaxcube.info
jeremyeaton.co journalhome.com
jerseyschinabizwholesale.us justucalling32211123456789.tk
job.icivil.ir kambasoft.com
jrcigars.com kareliatobacco.ru
justprofit.xyz kaz.kz
keywords-monitoring-success.com keki.info
kino-ecran.ru kemerovo.zrus.org
kinoflux.net keywordsking.com
klikbonus.com keywordteam.net
kollekcioner.ru kinobaks.com
koversite.info kinomaniatv.pl
kustanay.kz kiwi237au.tk
lampokrat.ws koptims.tiu.ru
landinez.co kredit-pod-zalog-krasnodar.ru
landscaping.center kskjco.club
laserpen.club ktotut.net
le-clos-des-alouettes.com kupiproday.com.ua
lechtaczka.net kw21.org
legalrc.biz lacloop.info
lankarns.com
larger.io
laudit.ru
law-check-nine.xyz
legionalpha.com
lego4x4.ru lego4x4.ru
letmacworkfaster.world likesuccess.com
letsrepair.in lionking-1994.blogspot.com
likesdesign.com localmatchbook.com
linkarena.com lollypopgaming.com
liquimondo.com longgreen.info
lirunet.ru lookingglassemb.com
littlecity.ch lostaruban.com
liumimgx.pw louboutinreplica.xyz
live-sexcam.tk lovelycraftyhome.com
live-sexchat.ru m5home.ru
liveinternet.ru mac-shield.com
loginduepunti.it magicalfind-a.akamaihd.net
lol-smurfs.com makis.nu
lombia.com manyresultshub-a.akamaihd.net
m292.info markjaybeefractal.com
mactechinfo.info maslenka.kz
magento-crew.net mebeldekor.com.ua
mailemedicinals.com medispainstitute.com.au
mararoom.ru meds-online24.com
marmotstore.online meteocast.net
masturbate.co.uk minegam.com
matsdale.com
mecash.ru
medi-fitt.hu
meduza-consult.ru
message-warning.net
metafilter.com
microstatic.pl
minharevisao.com
mini-modus.ru
minyetki.ru
mir-betting.ru
mir-business-24.ru
misandesign.se misandesign.se
mistr-x.org mixed-wrestling.ru
mobicover.com.ua mjchamonix.org
mobot.site mobsfun.net
moi-glazki.ru modenamebel.ru
moinozhki.com moncleroutletonline.xyz
moroccosurfadventures.com monsterdivx.tv
moscow.xrus.org moonci.ru
musezone.su muycerdas.xxx
mustwineblog.com my-aladin.com
muz-shoes.ru my-bc.ru
mvpicton.co.uk mydirtystuff.com
mwtpludn.review mydownloadengine.com
my-cash-bot.co
mydeathspace.com
myghillie.info myghillie.info
myprintscreen.com nardulan.com
mysex21.com narkologiya-voronezh.ru
nakrutka.cc nationalbreakdown.com
naughtyconnect.com naturalbreakthroughsresearch.com
negociosdasha.com netallergy.ru
netoil.no new-apps.ru
nextlnk12.com newsperuse.com
nfljerseys.online nhl17coinsforps3.gratisblog.biz
ngps1.ru novgorod.xrus.org
nhl09.ru nrjmobile.fr
nicovideo.jp nudejapan.net
nmrk.ru nuup.info
nsatc.net oconto.ru
nuit-artisanale.com odesproperty.com
nzfilecloud.weebly.com odoratus.net
o-o-11-o-o.com oecnhs.info
oballergiya.ru onlywoman.org
oda.as orenburg-gsm.ru
okonich.com.ua
omoikiri-japan.ru
onclickpredictiv.com
onko-24.com
onlinefilmz.net
onlineporno.site
onlineslotmaschine.com
ooo-olni.ru
oops-cinema.ru
osagonline.ru osagonline.ru
outpersonals.com ozoz.it
outshop.ru panouri-solare-acoperis.com
ownshop.cf partner-cdn.men
oz-offers.com parvezmia.xyz
paighambot.com pavlodar.xkaz.org
panchro.co.uk pawli.eu
panchro.xyz pc-test.net
paperwritingservice17.blogspot.ru pc-virus-d0l92j2.pw
partner-host.men
partnerworkroom.men
pateaswing.com
paydayonlinecom.com
perfectplanned.com
perfectpracticeweb.com perfectpracticeweb.com
picturesboss.com perosan.com
pigrafix.at pestomou.info
pinwallpaper.top phuketscreen.com
pizza-tycoon.com physfunc.ru
pl-top.pl picture-group.com
pladform.ru pictures-and-images.net
pliks.pl picurams.pw
ploenjitmedia.azurewebsites.net pixgood.com
plohaya-kreditnaya-istoriya.ru play.leadzupc.com
pogodnyyeavarii.gq playlott.com
pojdelo.weebly.com polcin.de
polska-poezja.com popunder.ru
popander.mobi pornoelita.info
popup-hgd.xyz pornosok.ru
popup.matchmaker.com pornowarp.info
pornogratisdiario.com porodasobak.net
pornokorol.com pricheskaonline.ru
pornosemki.info privacylocationforloc.com
pornoted.com privatbank46.ru
praisong.net
preparevideosafesystem4unow.site
priscilarodrigues.com.br
privatamateure.com
privatefx-in.ru privatefx-in.ru
prostitutki-belgoroda.org privatov-zapisi.ru
prostitutki-kiev.org prombudpostach.com.ua
putevka24.ru pron.pro
qor360.com prostitutki-yaroslavlya.org
quick-offer.com pulseonclick.com
qwertty.net puteshestvennik.com
rada.ru qpypcx.com
raisedseo.com quality-traffic.com
ranksonic.info raavidesigns.com
rcpmda.ikan1080.xyz randki-sex.com
realmonte.net recipedays.com
recordpage-a.akamaihd.net recordpage-a.akamaihd.net
redirect.trafficreceiver.club referencemoi.com
redirectingat.com refererx.com
reining.lovasszovetseg.hu reimageplus.com
remont-ustanovka-tehniki.ru remmling.de
renecaovilla.online remont-komputerov-notebook.ru
ric.info remontgruzovik.ru
rocis.site remybutler.fr
running-line.ru research.ifmo.ru
runofilms.ru revistaindustria.com
russian-postindex.ru rixpix.ru
sanyuprojects.com robotixix.com
sarahmilne.top rus-pornuha.com
saugatuck.com ruspdd.com
scanner-don.top rustic-quiver.win
scanner-john.top rutor.vip
scanner-josh.top s-iwantyou.com
scanner-julianna.top s1z.ru
scanner-willy.top sady-urala.ru
searchengineranker.email sakhboard.ru
seasaltwithfood.com saneitconsulting.com
see-your-website-here.com santechnik.jimdo.com
seeingmeerkat.com saratov.xrus.org
seoanalyses.com satellite.maps.ilovevitaly.com
service-core.ru satoristudio.net
sethrollins.net sax-sex.com
sibvitr.ru sbwealthsolutions.ca
sildenafil-tadalafil.info scanner-nelson.top
sildenafilcitratemed.com scanner-olga.top
simplesite.com scmor.ilxc.cc
site5.com scrnet.biz.ua
sitebeam.net sdsjweb.com
siteripz.net seccioncontrabajo.com
sitevaluation.com semalt.com
sivs.ru sendearnings.com
slim.sellany.ru seoprofiler.com
smartbalanceworld.com seorankinglinks.xyz
solution4u.com serptehnika.ru
spasswelt.net sevendays.com.ua
spl63.fr sex-sex-sex5.com
spravka-medosmotr.ru sexad.net
squidoo.com sexkontakte-seite.com
stanthonyscatholicchurch.org sexsaoy.com
stoki.ru sexstream.pl
stopnarco.ru sherlock.se
stpicks.com shohanb.com
strana-solnca.ru sideeffectsoftizanidine.blogspot.com
studiofmp.com sinestesia.host.sk
studworks.org site-speed-checker.site
suchenindeutschland.com sitevaluation.org
superlist.biz skincrate.net
svtrd.com skytraf.xyz
swinginwithme.ru slkrm.ru
symbaloo.com smartadserver.com
symphonyintegratedhealthcare.com smichovbike.cz
tarad.com social-vestnik.ru
telefonsexsofort.tk soft1.ru
teletype.in softonicads.com
terrafootwear.us soheavyblog.com
textads.men soviet-portal.do.am
thebluffs.com special-porn.com
spymac.net
steelmaster.lv
sticken.co
stillmiracle.com
success-seo.com
sugarlyflex.pw
superinterstitial.com
supers.com.ua
survival.betteroffers.review
talant-factory.ru
taximytishi.ru
tds-advert005.info
telemetryverification.net
templates.franklinfire.co
testingads.pro
thecoolimages.net thecoolimages.net
thedownloadfromwarez.blogspot.com thegolfclub.info
theheroes.ru thenews-today.info
thetattoohut.com thepokertimer.com
tizanidinehydrochloride4mgstreetvalue.blogspot.com titelhelden.eu
tizanidinewithdrawal.blogspot.com tizanidine4mgstreetprice.blogspot.com
tizanidineforopiatewithdrawal.blogspot.com
tizanidineshowupondrugtest.blogspot.com
tk-assortiment.ru tk-assortiment.ru
tksn.ru token-lab.org
tonerbox.kz top-karkas.ru
top-l2.com top-study.work
topkarkas.com toproadrunner5.info
totu.info toyota.7zap.com
tt-ipd.info trafficcentr.xyz
tuckpointingmasonrysystems.com traffique.net
turizmus.us tramadolandtizanidine.blogspot.com
tvand.ru tsstcorpcddvdwshbbdriverfb.aircus.com
twittruth.com tsyndicate.com
ua.tc u17795.netangels.ru
ukkala.xyz ucsol.ru
ultramart.biz uggsale.online
unisexjewelry.org ukkelberg.no
unpredictable.ga uprour.com
urlcut.ru urldelivery.com
urlopener.com usiad.net
usadacha.net ussearche.cf
uzungil.com valoresito.com
vadimkravtcov.ru vancleefreplica.pw
vapomnoncri.tk vashsvet.com
vertaform.com viagra-soft.ru
veselokloun.ru video-chat.cn
videokrik.net video-chat.in
vigrx-original.ru videochat.tv.br
vip.51.la videochat.world
vipromoffers.com vip-file.com
vitoriacabos.com vipsexfinders.com
vltai.com voluumtracker1.com
vremya.eu voronezh.xrus.org
vrnelectro.ru vrnelectro.ru
vykup-avto-krasnodar.ru w3javascript.com
vysigy.su wallpapers-best.com
vzlomsn.org wapsite.me
walkme.com webix.me
wallpapersist.com webjam.com
webmasters.stackexchange.com website-stealer.nufaq.com
weclipart.com
wedding-salon.net
welck.octopis.com welck.octopis.com
whengirlsgowild.com westsextube.com
whereiskentoday.com westvilletowingservices.co.za
whosonmyserver.com wiosenny-bon-1500.pl
winx-play.ru withstandingheartwarming.com
wma-x.com wleuaprpxuvr.ga
writingservices17.blogspot.ru womama.ru
wufak.com wormix-cheats.ru
wyniki-lista.pl wrz0iuebwhp5fg.freeddns.com
xdoza.com wttavern.com
xitjw.info www.arenda-yeisk.ru
xn-----8kcatubaocd1bneepefojs1h2e.xn--p1ai www.bookmaker-bets.com
xn----itbkqkfiq.xn--p1ai wwwadultcheck.com
xn--80ahdheogk5l.xn--p1ai xaylapdiendanang.com
xn--80aodinpgi.xn--p1ai xcc24.pl
xn--b1agm2d.net xjrul.com
xn----7sbahjd3btneuw1joc.xn--p1ai
xn----7sbifcamovvfggw9d.xn--p1ai
xn--24-glceagatoq7c2a6ioc.xn--p1ai
xn--80aaagvmjabrs1aoc9luc.xn--p1ai
xn--80aaaks3bbhabgbigamdr2h.xn--p1ai
xn--80adaggc5bdhlfamsfdij4p7b.xn--p1ai
xn--h1aakne2ba.xn--p1ai xn--h1aakne2ba.xn--p1ai
xtraffic.plus xn--l1aengat.xn--p1ai
youradulthosting.com xn--oogle-wmc.com
yourothersite.com xxxasianporn.net
yourtemplatefinder.com yougetsignal.com
yousense.info yugk.net
youthreaders.com yun56.co
yunque.pluto.ro zatjmuzu.info
zagadki.in.ua zawyna.ua
zaim-pod-zalog-krasnodar.ru zeroredirect11.com
zapiszto.pl zeroredirect8.com
zeroredirect9.com zixizop.net.ru
zhorapankratov7.blogspot.com zoodrawings.com
zhuravlev.info zreloeporno.tv
zigarettenonl.canalblog.com zrus.org
zskdla.site zx6.ru
zvooq.eu

476
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
00go.com 4ureyesonly.com
1kinobig.ru 777-club.ru
3weekdiet.com 8558l.jobs.net
45en.ru 999webdesign.com
a.frcls.fr academiacsmendoza.org
acortarurl.es adhome.biz
adloads.net adrunnr.com
adsref.men advertex.info
alekseevec.ru aktobe.xkaz.org
alert-fjg.xyz alif-ba-ta.com
all-number.com allproblog.com
alyeskaresort.com amateurgalls.com
apifasterlightin-a.akamaihd.net animal-drawings.com
apiholdingmypage-a.akamaihd.net apibrowsesmartne-a.akamaihd.net
appiq.mobi aproposde.com
approved.su arenanews.com.ua
atelielembrancaqueencanta.com.br asiavirtualsolutions.com
backgroundpictures.net autodo.info
bala.getenjoyment.net autogrep.ru
beauty-clinic.ru autotop.com.ua
becuo.com autowebmarket.com.ua
begalka.xyz aviav.co
berdasovivan.ru beget.tech
bestmarriages.com belinvestdom.by
bestplacetobuyeriacta.jw.lt belsetirehafi.tk
bharatdefencekavach.com bizzliving.com
bizfly.info bloggen.be
boltalko.xyz bonzbuddy.com
bonzibuddi.com brillianty.info
bouda.kvalitne.cz businesxxl.com
buntube.net candy-glam-hp.com
buscarfoto.com casinos4dummies.co.uk
buypuppies.ca centrumcoachingu.com
bvlgariring.xyz cfjump.com
callejondelpozo.es cfsrating.sonicwall.com
camdenmemorials.com cheap-trusted-backlinks.com
candelluxsklep.pl cheapjerseysap.com
canzoni.ru cialgenisrx.com
cardiosport.com.ua cinemaenergy-hd.ru
cartierlovebraceletreplica.xyz cl.s7.exct.net
checkpagerank.net
christianlouboutinreplica.win
christianlouboutinsaleoutletonline.us
cialischmrx.com
claytransformations.info claytransformations.info
clicksor.com
clicksor.net clicksor.net
compliance-alexa.xyz compliance-jane.top
compliance-josh.top compliance-john.top
compliance-nelson.top computernetworksonline.com
consorzioilmosaico.org cool-wedding.net
cookie-law-enforcement-hh.xyz copyrightclaims.org
copenergo.ru cordstrap.cc
corta.co craftinsta.ru
counter.yadro.ru d0t.ru
crd.clan.su dailyfinancefix.com
creativehutindia.com dbmkfhqk.bloger.index.hr
cs-passion.pl dfwu1019.info
cubook.supernew.org digital-video-processing.com
darmebel.com.ua dirtpics.pw
de.zapmeta.com discountbarbour.online
deda-moroza-zakaz.ru domainsatcost.com
delayreferat.ru dostavka-v-krym.com
delitime.info download-wallpaper.net
dignitasdata.se e705.net
dnepropetrovsk.mistr-x.org e90post.com
download-of-the-warez.blogspot.com easycommerce.cf
duawitchrarato.tk easytuningshop.ru
eldiariodeguadalajara.com ec-file.info
erotikstories.ru ekto.ee
eyessurgery.ru eloconcream.blogspot.com
familienzahnaerzte.com evehemming.blogspot.com.au
farmprofi.net fealq.com
feeriaclub.ru filmfanatic.com
fickenbumsen.net fishingwholesale.us
filmi-onlain.info flashlarevista.com
findsexguide.com footbalive.org
findthe.pet forum.tvmir.org
fishtauto.ru freemaintenancesysforpcandmac.top
foodcrafts.website frighteningremain.cf
forex21.ru fullfileaccess.com
foto-sisek.porngalleries.top funnymama.com
fres-news.com galaxys6manual.info
freshsuperbloop.com gallerylisting.com
game300.ru gamedayhouse.com
gamingspark.com
gaygalls.net gaygalls.net
get-your-social-buttons.info germetiki.com.ua
getresponse.com gk170.ru
gheus.altervista.org
girls-ufa.ru
girlspicsa.com
go2jump.org
gomusix.com
gopro-online.info gopro-online.info
gpms.org.my greamimgo.pw
gsou.cf greenshop.su
hamilton.ca guildebzh.info
hanink.biz.ly hauleddes.com
hannasolution.ru hawaiielectriclight.com
hasshe.com heroz.fr
hdseriale.pl highspeed5.net
helvetia.com.ua host-tracker.com
herokuapp.com hotenergy.ru
hotblog.top humanorightswatch.org
hotblognetwork.com icaseclub.ru
humbmosquina.tk ido3.com
ibmdatamanagement.co iinstalll-fii1leis.jus0wil.pp.ua
incolors.club ikearugs.xyz
indiakino.net ilikevitaly.com
internet-apteka.ru invivo.hu
jerseychinabizwholesale.com ipornox.xxx
johannesburgsingles.co.za ipostroika.ru
keywordspay.com iptool.xyz
kladrus.ru irkutsk.online-podarki.com
klejonka.info ivoiretechnocom.ci
klumba55.ru jerseywholesalechinabiz.com
kostenlos-sexvideos.com jofucipiku.tk
journalhome.com
kanimage.com
kazan.zrus.org
kidskunst.info
kino-key.info
konpax.com
kostenloser-sex.com kostenloser-sex.com
kreativperlen.ch kovrenok.ru
kw21.org kunstaktien.info
lafriore.ru la-fa.ru
law-check-seven.xyz labplus.ru
lechenie-gemorroya.com lexixxx.com
lion.playtap.us
liran-locks.com liran-locks.com
lonerangergames.com localflirtbuddies.com
m-google.xyz lostfilm-online.ru
m5home.ru mackeeper-land-672695126.us-east-1.elb.amazonaws.com
manuscript.su maglid.ru
mega-bony2017.pl malwareremovalcenter.com
meget.co.za mararoom.ru
mikozstop.com marmotstore.online
mobilemedia.md mediafresh.online
moesen-ficken.com metaxalonevstizanidine.blogspot.com
moncleronline.xyz michaelkorsoutlet.store
mp3s.club misslike.ru
musezone.ru mmoguider.ru
myhydros.org mojowhois.com
myliveblog.ru morefastermac.trade
mywallpaper.top msk.afora.ru
nero-us.com music.utrolive.ru
mydoctorok.ru
narkologiya-orel.ru
networkad.net
newstudio.tv
nfljerseys.online
nhl09.ru nhl09.ru
nippon-bearings.ru nodding-passion.tk
novatech.vn nyfinance.ml
npoet.ru o-o-11-o-o.com
obiavo.net okuos.com
obiavo.ru onclickpredictiv.com
ok.ru onlinefilmz.net
online7777.com optom-deshevo.ru
oxford-book.com.ua origin-my.ru
oynat.info park.above.com
percin.biz.ly partnerline.men
picquery.com pensplan4u.com
polska-poezja.com phelissota.xyz
presleycollectibles.com picswe.com
pihl.se
poisk-zakona.ru
pooleroadmedicalcentre.co.uk
poshiv-chehol.ru
privatefx-in.ru
pronekut.com
psa48.ru psa48.ru
razvratnoe.org pulse33.ru
real-time-analytics.com purchasepillsnorx.com
remorcicomerciale.ro qld10000.net
rangoman.date
ranksignals.com
ranksonic.org
rapidgator-porn.ga
rating-bestcasino.com
razamicroelectronics.com
rebelmouse.com
respublica-otel.ru
riders.ro
ringtonepartner.com
ritlweb.com
rockingclicks.com
rockma.se rockma.se
roofers.org.uk ruspdd.com
sa-rewards.co.za rusvideos.su
sabizonline.com sammyweaver.com
sardinie.us sanidumps.com
sbricur.com scrapinghub.com
scanner-barak.top se-welding.ru
scopich.com search.pch.com
sdsjweb.com seasaltwithfood.com
seemoreresultshu-a.akamaihd.net seminarygeorgia59.ga
segol.tv seorank.info
semp.net
seorankinglinks.com seorankinglinks.com
sevendays.com.ua serpstat.com
sexyebonyteen.com sex-tracker.de
sexystrippe.info sex-znakomstva.online
sildenafil-tadalafil.info sexs-foto.top
similardeals.net sexstream.pl
skachat-besplatno-obrazcy.ru sharebutton.net
slim.sellany.ru shillyourcoins.com
snjack.info shoppytoolmac.com
snworks.com sibdevice.ru
soaksoak.ru softxaker.ru
social-s-ggg.xyz souvenirua.com
soheavyblog.com sportbetfair.com
soietvousmaime.fr srgwebmail.nl
spylog.com
spywarenuker.com
start.myplaycity.com
statustroll.com statustroll.com
stjamesschool.info strag-invest.ru
studiofaca.com success-seo.com
swagbucks.com svolze.com
szamponrevita.pl swsociety.se
t-bygg.com t3chtonic.com
tattoo33.ru takeflyte.com
tds-advert005.info tanieaukcje.com.pl
tehngr.ru thefds.net
telesvoboda.ru thegioixekhach.com
thecoral.com.br thexart.club
thedownloadfreeonlinegames.blogspot.com tizanidinehcl2mgsideeffects.blogspot.com
thegameriders.com trafficstars.com
thfox.com trahic.ru
ticketsys.inetwd.com trubywriting.com
tizanidine4mgstreetvalue.blogspot.com trucri.me
tizanidineshowupondrugtest.blogspot.com turizmus.us
tizanidinestreetvalue.blogspot.com ukkelberg.no
top-karkas.ru urlopener.com
torontoplumbinggroup.com
torrent-to-magnet.com
track112.site
trafficmania.com
trafficmp.com
truck-addzilla.life
try-rx.com
turkeyreport.tk
tversvet.ru
twincitiescarservice.com
ua-company.ru
ublaze.ru
ucsol.ru
ufa.xrus.org
uni.me
unisexjewelry.org
varikozdok.ru
vegan-foods.us vegan-foods.us
viel.su vereo.eu
vielporno.net via-energy-cumpara.com
villacoloniale.com videtubs.pl
vintontech.info vietimgy.pw
webcamdevochka.com voditeltrezviy.ru
webpromotion.ae w3javascript.com
wildnatureimages.com wapsite.me
wovis.site wareseeker.com
wufak.com watsonrealtycorp.com
xjrul.com weblibrary.win
xn----7sbaaabaei0cc8aj5bj0bncejx.xn--p1ai webmasterhome.cn
xn--h1ahbi.com.ua websitevaluebot.com
xn--hxazdsfy.blogspot.com wemarketing.se
yellowproxy.net wrz0iuebwhp5fg.freeddns.com
youandcredit.ru www.wohnkabinen-shop.de
yousense.info xmronta.com
yur-p.ru xn--e1afanlbnfckd7c3d.xn--p1ai
zajm-zalog-krasnodar.ru xuki.us
zazagames.org xz618.com
zeg-distribution.com xzlive.com
zeroredirect1.com yoshkarola.zrus.org
zetmaster.ru youjizz.vc
zigarettenonlinekaufen1.blox.pl youtuhe.com
zkjovpdgxivg.ga yuarra.pluto.ro
zoolubimets.ru zeroredirect.com
zeroredirect9.com
znakomstvaonlain.ru

10
dev-tools/test_units/ratelimittest-master.txt
View file

@ -581,14 +581,4 @@
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html> </html>

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.219 0; 10.1.1.135 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.03.2952 ### Version: V4.2022.03.2953
### Updated: Tue Mar 1 22:01:34 UTC 2022 ### Updated: Wed Mar 2 10:03:35 UTC 2022
### Bad Bot Count: 636 ### Bad Bot Count: 636
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.03.2952 ### Version: V4.2022.03.2953
### Updated: Tue Mar 1 22:01:34 UTC 2022 ### Updated: Wed Mar 2 10:03:35 UTC 2022
### Bad Bot Count: 636 ### Bad Bot Count: 636
################################################### ###################################################
### Version Information ## ### Version Information ##