vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-10 06:15:06 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2022.08.3305 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2022-08-22 10:09:29 +00:00
parent b5a117f25f
commit f3ced875ac
47 changed files with 81444 additions and 81454 deletions
Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.08.3304 #### Version: V4.2022.08.3305
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.08.3304 #### Version: V4.2022.08.3305
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -14,7 +14,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2022.08.3304 #### Version: V4.2022.08.3305
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

10046
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2022.08.3304 #### Version: V4.2022.08.3305
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

10050
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

10050
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

10050
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

10050
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.116 1; 10.1.1.130 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.116 0; 10.1.1.130 0;
127.0.0.1 0; 127.0.0.1 0;

10050
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.116 1; 10.1.1.130 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.116 0; 10.1.1.130 0;
127.0.0.1 0; 127.0.0.1 0;

10050
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.116 1; 10.1.1.130 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.116 0; 10.1.1.130 0;
127.0.0.1 0; 127.0.0.1 0;

10050
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
3304 3305

10050
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

10050
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.12.208.233 0; 20.7.207.161 0;

10050
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.116 1; 10.1.1.130 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.116 0; 10.1.1.130 0;
127.0.0.1 0; 127.0.0.1 0;

10050
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.116 1; 10.1.1.130 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.116 0; 10.1.1.130 0;
127.0.0.1 0; 127.0.0.1 0;

10050
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.116 1; 10.1.1.130 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.116 0; 10.1.1.130 0;
127.0.0.1 0; 127.0.0.1 0;

10050
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.12.208.233 0; 20.7.207.161 0;

10050
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.12.208.233 0; 20.7.207.161 0;

10050
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.116 1; 10.1.1.130 1;
127.0.0.1 1; 127.0.0.1 1;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
Bitacle 01h4x.com
BuiltBotTough Aipbot
Curious BunnySlippers
MarkMonitor MarkWatch
Netcraft Meanpathbot
Nibbler OutclicksBot
Offline Explorer WASALive-Bot
QueryN Metasearch WallpapersHD
SiteExplorer coccocbot
WebCopier sp_auditbot

286
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
01h4x.com
404enemy 404enemy
80legs
ADmantX ADmantX
AIBOT AIBOT
ALittle Client ALittle Client
ASPSeek ASPSeek
Aboundex Aboundexbot
Anarchie AhrefsBot
AiHitBot
Alexibot
Anarchy
Ankit Ankit
Atomseobot Anthill
Attach Apexoo
AwarioRssBot AwarioRssBot
AwarioSmartBot AwarioSmartBot
BBBike
BDCbot BDCbot
BDFetch BLEXBot
Backlink-Ceck
BacklinkCrawler BacklinkCrawler
Barkrowler
BatchFTP
BetaBot
Bitacle
BlackWidow
Blackboard
Blow Blow
Bolt Bolt
BotALot
Brandprotect
Brandwatch Brandwatch
Buddy
BuiltBotTough
BunnySlippers
CATExplorador CATExplorador
CCBot
CODE87
CSHttp CSHttp
CazoodleBot
Cegbfeieh Cegbfeieh
CheTeam
CherryPicker
Chlooe Chlooe
Citoid
Cliqzbot Cliqzbot
Cogentbot Cloud mapping
Collector
Cosmos Cosmos
CrazyWebCrawler Craftbot
DBLBot DBLBot
DIIbot DataCha0s
DTS Agent DatabaseDriverMysqli
Demon Digincore
Devil Dirbuster
DigitalPebble DomCopBot
Disco
Discobot
DittoSpyder
DnBCrawler-Analytics
DomainAppender DomainAppender
DomainSigmaCrawler DomainSigmaCrawler
DomainStatsBot Domains Project
Dotbot Download Wonder
Dragonfly Dragonfly
ECCP/1.0 ECCP/1.0
EMail Siphon EasyDL
Ecxi Ecxi
Express WebPictures EirGrabber
Extractor EroCrawler
ExtractorPro
Extreme Picture Finder Extreme Picture Finder
Ezooms Ezooms
FHscan
FemtosearchBot FemtosearchBot
Freeuploader Freeuploader
Fuzz
FyberSpider FyberSpider
Fyrebot
GT::WWW GT::WWW
Genieo GalaxyBot
GermCrawler GetWeb
Gigabot GoZilla
Go!Zilla GrapeshotCrawler
Gotit HEADMasterSEO
Grabber HTTrack
Grafula Hloader
Haansoft
Havij
Heritrix
HonoluluBot
Humanlinks Humanlinks
Iblog
Id-search Id-search
Image Sucker Image Fetch
IndeedBot
InfoTekies
Internet Ninja
Iria Iria
JennyBot JamesBOT
JetCar Jbrofuzz
Jetty
Joomla Joomla
Jorgee JustView
Kenjin Spider Kinza
Keybot Translation-Search-Machine Kozmosbot
Keyword Density LWP::Simple
Lanshanbot
LeechFTP LeechFTP
Libwhisker Lftp
Likse Lightspeedsystems
Linkbot LinkScan
LinkextractorPro LinqiaMetadataDownloaderBot
LinqiaRSSBot
LinqiaScrapeBot LinqiaScrapeBot
Lipperhey Spider Lipperhey
Litemage_walker
MFC_Tear_Sample MFC_Tear_Sample
MIDown tool MIDown tool
MIIxpc MIIxpc
MQQBrowser MJ12bot
MTRobot
Mag-Net Mag-Net
Mail.RU_Bot Magnet
MarkWatch
Mass Downloader Mass Downloader
MauiBot Masscan
Mediatoolkitbot Mb2345Browser
Metauri Meanpathbot
MicroMessenger
Microsoft URL Control
Minefield
Mister PiX
Mojeek Mojeek
Mojolicious MolokaiBot
Morfeus Fucking Scanner Morfeus Fucking Scanner
Mozlila Musobot
Mr.4x3
NPbot
Name Intelligence Name Intelligence
Nameprotect Nameprotect
Navroad NearSite
NetMechanic Net Vampire
NetSpider Nettrack
Netcraft
Netvibes Netvibes
Nikto Niki-bot
Nimbostratus
Ninja Ninja
Nmap Offline Navigator
Not
Nuclei
OnCrawl
OpenLinkProfiler OpenLinkProfiler
OpenVAS OpenVAS
Openfind Openvas
OrangeSpider OrangeBot
OutfoxBot OutfoxBot
PHPCrawl
POE-Component-Client-HTTP
Page Analyzer Page Analyzer
Pandalytics PageAnalyzer
Papa Foto Panscient
Pavuk Petalbot
PeoplePal
Picscout Picscout
Picsearch PictureFinder
Piepmatz
Pimonster Pimonster
Pixray Pixray
Pockey Pockey
Probethenet Psbot
Pu_iN
PxBroker PxBroker
RankActiveLinkBot RankActive
RankFlex
RankingBot
Re-re Re-re
ReGet
RealDownload
RebelMouse
RepoMonkey RepoMonkey
RocketCrawler RocketCrawler
SBIder
SEOkicks-Robot
SEOlyticsCrawler SEOlyticsCrawler
SISTRIX
ScoutJet ScoutJet
Scrapy Scrapy
ScreenerBot Screaming
SearchmetricsBot
Seekport Seekport
SemrushBot
SentiBot SentiBot
SeoSiteCheckup SeoSiteCheckup
SiteExplorer Siphon
SiteLockSpider
Site Sucker Site Sucker
Siteimprove SiteCheckerBotCrawler
Sitevigil SiteLockSpider
SiteSnagger
SlySearch
SmartDownload
Snake
Snoopy Snoopy
SocialRankIOBot
Sogou web spider
Sosospider Sosospider
Sottopop Sottopop
SpaceBison SpaceBison
Spammen Spammen
SpankBot
Spanner Spanner
Sqlworm SputnikBot
Sqworm Sqworm
Stripper
SurveyBot
Suzuran
Szukacz
T8Abot
TeleportPro
Telesphoreo Telesphoreo
Trendictionbot Trendiction
True_Robot True_Robot
Turingos
Turnitin Turnitin
TurnitinBot
TwengaBot
Twice Twice
Typhoeus Typhoeus
VB Project VB Project
Vacuum
VidibleScraper VidibleScraper
VoidEYE VoidEYE
Voil Voil
Voltron Voltron
WEBDAV WBSearchBot
WallpapersHD WISENutbot
WeSEE WPScan
Web Auto Wallpapers/3.0
Web Collage
Web Enhancer
Web Sauger
WebBandit
WebCollage
WebCopier
WebReaper
WebSauger
WebStripper
Web Sucker Web Sucker
WebBandit
WebFetch
WebFuck
WebLeacher
WebSauger
WebZIP WebZIP
Webalta
WebmasterWorldForumBot
Webshag
WebsiteExtractor
WebsiteQuester WebsiteQuester
Webster Whack
WinHTTrack Whacker
Who.is Bot
WiseGuys Robot WiseGuys Robot
Wonderbot
Woobot
Wotbox Wotbox
Zade Xaldon WebSpider
Zauba Xaldon_WebSpider
Xenu
Zermelo Zermelo
Zeus
Zitebot Zitebot
ZyBorg ZyBorg
adscanner
archive.org_bot
autoemailspider autoemailspider
backlink-check backlink-check
clark-crawler check1.exe
com.plumanalytics crawler.feedback
crawler4j demandbase-bot
eCatch
gopher gopher
ips-agent heritrix
iubenda-radar
linkdexbot
lwp-trivial
magpie-crawler magpie-crawler
mediawords
muhstik-scan muhstik-scan
netEstate NE Crawler netEstate NE Crawler
pcBrowser plumanalytics
ripz probe-image-size
satoristudio.net s1z.ru
scalaj-http scalaj-http
seobility seobility
seocompany.store
seoscanners seoscanners
seostar
serpstatbot serpstatbot
sexsearcher sexsearcher
spyfu sitechecker.pro
trendiction.com sp_auditbot
ubermetrics-technologies.com
voyagerx.com voyagerx.com
webgains-bot
webmeup-crawler webmeup-crawler
webpros.com
webprosbot webprosbot
x09Mozilla x09Mozilla
zgrab zauba.io

314
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
80legs ADmantX
AIBOT AhrefsBot
Abonti
Acunetix
Aipbot
Alexibot
AllSubmitter AllSubmitter
AlphaBot
Anarchy99 Anarchy99
Ankit
Aspiegel Aspiegel
Asterias Asterias
BBBike Atomseobot
BackDoorBot AwarioRssBot
Badass BDCbot
Battleztar Bazinga BDFetch
BetaBot BLEXBot
BackStreet
BackWeb
Barkrowler
Bigfoot
Black Hole Black Hole
Buddy Blow
BlowFish
Boardreader
Brandprotect
BuiltWith BuiltWith
BunnySlippers
BuzzSumo BuzzSumo
CATExplorador
CSHttp CSHttp
CazoodleBot CensysInspect
CheeseBot CheTeam
CherryPicker Cloud mapping
Claritybot
Collector
Cosmos Cosmos
Craftbot
Crescent Crescent
CrunchBot
Curious
Custo Custo
DBLBot
DIIbot
DSearch DSearch
DTS Agent Demon
Deusu
Devil Devil
Discobot
Discoverybot Discoverybot
Dispatch
DnBCrawler-Analytics DnBCrawler-Analytics
DomCopBot DnyzBot
DomainAppender DomainStatsBot
Domains Project Dotbot
Drip Drip
ECCP/1.0 EMail Siphon
EMail Wolf Ecxi
EasyDL
EroCrawler
Evil Evil
Exabot Exabot
Express WebPictures Express WebPictures
Extractor
ExtractorPro ExtractorPro
Ezooms FDM
FemtosearchBot FHscan
Fimap
Firefox/7.0
FlashGet
Flunky Flunky
Foobot Foobot
Freeuploader Freeuploader
G-i-g-a-b-o-t Fuzz
FyberSpider
Fyrebot
GalaxyBot
GermCrawler GermCrawler
Getintent
Gigabot Gigabot
GrabNet GoZilla
Grafula Grabber
GrapeFX GrapeshotCrawler
HTTrack GridBot
HMView
HTMLparser
HaosouSpider
Harvest Harvest
Havij Hloader
HonoluluBot IDBot
Humanlinks IRLbot
IDBTE4M Id-search
IlseBot Indy Library
Image Fetch InfoNaviRobot
Intelliseek InfoTekies
InterGET InterGET
InternetSeer Internet Ninja
Iskanie Iria
JOC Web Spider Joomla
Jorgee Jorgee
Jyxobot Kinza
Keybot Translation-Search-Machine
Kozmosbot
Lanshanbot
Larbin Larbin
Leap LeechFTP
LeechGet Libwhisker
LinkWalker Lightspeedsystems
LinkpadBot LinkextractorPro
LinksManager LinksManager
LinqiaRSSBot LinqiaMetadataDownloaderBot
Lipperhey LinqiaScrapeBot
Ltx71 Lipperhey Spider
MJ12bot MFC_Tear_Sample
MQQBrowser MSFrontPage
MSIECrawler
MTRobot MTRobot
Mag-Net Mag-Net
Magnet Mail.RU_Bot
Majestic SEO Majestic SEO
Majestic-SEO Majestic12
MarkMonitor
Masscan Masscan
Mata Hari Mata Hari
Meanpathbot
MegaIndex.ru MegaIndex.ru
Metauri
Microsoft Data Access Microsoft Data Access
Minefield
Mister PiX Mister PiX
Mojolicious
MolokaiBot MolokaiBot
Morfeus Fucking Scanner
Mr.4x3
Msrabot Msrabot
Musobot Musobot
NPbot
Name Intelligence Name Intelligence
Navroad Navroad
NearSite NearSite
Needle
Nessus Nessus
NetAnts
NetSpider NetSpider
NetZIP Nettrack
NextGenSearchBot NextGenSearchBot
Nibbler Ninja
Nikto Not
Nmap Nutch
Octopus
OnCrawl OnCrawl
OpenVAS OpenLinkProfiler
PHPCrawl OrangeBot
OutclicksBot
POE-Component-Client-HTTP
Page Analyzer Page Analyzer
PageAnalyzer PageThing.com
PageScorer
Panscient Panscient
Papa Foto
PictureFinder PictureFinder
Piepmatz Piepmatz
Pixray
PleaseCrawl PleaseCrawl
Probethenet Pockey
Psbot PyCurl
PxBroker RankActiveLinkBot
RankActive RankFlex
RankingBot RealDownload
RankurBot Recorder
Re-re Ripper
ReGet Rogerbot
RebelMouse
RedesScrapy
RocketCrawler
SEOkicks SEOkicks
SEOkicks-Robot SEOstats
SEOlyticsCrawler
SEOprofiler
SISTRIX
SMTBot SMTBot
SalesIntelligent SalesIntelligent
ScanAlert ScanAlert
Scanbot
ScoutJet
Scrapy Scrapy
Screaming
ScreenerBot ScreenerBot
ScrepyBot
Searchestate
SearchmetricsBot
SemanticJuice SemanticJuice
SemrushBot SemrushBot
SeoSiteCheckup
SeobilityBot SeobilityBot
Seomoz Seomoz
Site Sucker
SiteCheckerBotCrawler SiteCheckerBotCrawler
SiteLockSpider SiteSnagger
Sitebeam SiteSucker
Sitevigil Sitevigil
Snapbot SmartDownload
SocialRankIOBot SocialRankIOBot
Sogou web spider Sottopop
Sosospider Spammen
Spanner Spanner
Spinn3r Sqlworm
Sqworm Sqworm
Steeler
Stripper
Sucker
Sucuri Sucuri
SurveyBot SuperBot
Swiftbot Suzuran
Szukacz Szukacz
Teleport Telesoft
TeleportPro Telesphoreo
The Intraformant Telesphorep
TheNomad TheNomad
Thumbor
TightTwatBot TightTwatBot
Toata
Tracemyfile Tracemyfile
True_Robot Turnitin
Twice TwengaBot
Typhoeus Typhoeus
UnisterBot URLy Warning
VB Project V-BOT
VCI Vacuum
Vagabondo VidibleScraper
VelenPublicWebCrawler VoidEYE
Voil
Voltron
WASALive-Bot WASALive-Bot
WISENutbot WISENutbot
WPScan WWW-Collector-E
WWW-Mechanize
WWW::Mechanize WWW::Mechanize
WWWOFFLE
Wallpapers Wallpapers
Wallpapers/3.0
WallpapersHD WallpapersHD
WeSEE
Web Fetch
Web Pix
Web Sauger
Web Auto Web Auto
WebCollage Web Enhancer
WebCopier Web Pix
WebFuck
WebGo IS
WebLeacher
WebSauger
WebStripper
Web Sucker Web Sucker
WebBandit
WebCopier
WebEnhancer
WebReaper
WebSauger
WebWhacker WebWhacker
WebmasterWorldForumBot Webalta
Webshag Website Quester
Webster
Whack Whack
Whatweb
Who.is Bot Who.is Bot
Woobot WinHTTrack
Zermelo Wprecon
Xaldon WebSpider
Xaldon_WebSpider
Xenu
YoudaoBot
Zauba
Zeus
Zitebot
ZmEu
ZumBot ZumBot
adscanner ZyBorg
coccocbot cah.io.community
cognitiveseo check1.exe
crawl.sogou.com
crawler.feedback crawler.feedback
crawler4j domainsproject.org
evc-batch
heritrix heritrix
internetVista monitor isitwp.com
lwp-trivial linkdexbot
lwp-request
magpie-crawler
mediawords mediawords
muhstik-scan seocompany.store
netEstate NE Crawler
page scorer
pcBrowser
polaris version
probe-image-size
ripz
s1z.ru
seoscanners
seostar
sexsearcher sexsearcher
siteripz
sp_auditbot
spyfu
sysscan sysscan
trendiction.com
trendiction.de
ubermetrics-technologies.com ubermetrics-technologies.com
webmeup-crawler
x09Mozilla x09Mozilla
xpymep1.exe xpymep1.exe
zauba.io

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
admatic.com.tr anabolics.shop
alert.scansafe.net bloggers.nl
autovideobroadcast.com chastnoeporno.com
earncash.com.ua credit-online.ws
easytuningshop.ru filmbokep69.com
negociosdasha.com geilehausfrauen.net
oballergiya.ru glogow.pl
prostitutki-rostova.org nevansk.ru
s-iwantyou.com pics-group.com
udsgame.online ruscoininvest.company

922
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
01apple.com 00go.com
08800.top
0912701309f8ce.com 0912701309f8ce.com
0c47f8422d3f.com 0c47f8422d3f.com
1-free-share-buttons.com 0n-line.tv
3weekdiet.com 1flag.co.za
4kplayer.pl 2girls1cup-free.com
4senses.co 3-letter-domains.net
777-club.ru 4k-player.pl
a.pr-cy.ru 5ws.dating-app.ru
7ooo.ru
7xc4n.com
999webdesign.com
aa08daf7e13b6345e09e92f771507fa5f4.com
aa81bf391151884adfa3dd677e41f94be1.com
aa8780bb28a1de4eb5bff33c28a218a930.com
aa9bd78f328a6a41279d0fad0a88df1901.com aa9bd78f328a6a41279d0fad0a88df1901.com
abcdefh.xyz absolutelyanalog.com
abcguru.xyz adamoads.com
abclauncher.com adanih.com
adclickthru.net
addbin.men addbin.men
adinterax.com ads.gold
adtech.de adtech.us
advancedmassagebysara.com adultgalls.com
advertex.info advokateg.ru
agadelha.com.br agroeconom.kz
agecheckadult.com ahrefs.com
akusherok.ru ahrntal.verymes.xyz
albamargroup.com albamargroup.com
albuteroli.com alibestsale.com
alienwheel.es alienwheels.de
alkoravto.ru allforminecraft.ru
altamayoztourism.com allkrim.com
amateurmatch.com allornamenti.com
amazingninja.com allpdfmags.net
angry-fermi-7633.arukascloud.io allwidewallpapers.com
anmysite.com alphaforum.ru
aosexkontakte.net ameblo.top
apibatbrowsecom-a.akamaihd.net anaseracresar.tk
appartement-stumm.at android-systems.ru
appfixing.space animenime.ru
appleid-verification.com apifasterlightin-a.akamaihd.net
approvedlocal.co.za apiitsthirteende-a.akamaihd.net
appsecurityr.com arcadeplayhouse.com
asseenontvonline.ru ardimobileinfo.ml
atleticpharm.org arius.tech
aussie-prizes.com asrv-a.akamoihd.net
australia-opening-times.com atofilms.com
autotrends.today aucoinhomes.com
avtovolop.ru autochoixspinelli.com
axbocz.net autonew.biz
ayanaspa.com avek.ru
azlex.uz aversis.net
aviapanda.ru
avramstroy.ru
avtointeres.ru
b-styles.xyz
backgroundpictures.net backgroundpictures.net
baixar-musicas-gratis.com baikaleminer.com
bambi.ck.ua banan.tv
bamo.xsl.pt bankiem.pl
basisches-wasser.net bankofthewext.com
bavsac.com baoxaydung.com.vn
beachfix.co bestcalovebracelet.cn
bear.gotcher.us betwinservice.com
beauby.ru big-boards.info
benchmarkcommunications.co.uk bildsuche.ru
betshuckclean.com bimatoprost-careprost.com
betteroffers.review binaryoptionscops.info
bibys.com bio.trade-jp.net
biographiya.com biographiya.com
blpmovies.com bird1.ru
bmwhighperformers.com bitnote.co
boole.onlinewebshop.net biznesschat.net
bosefux.esy.es blog.koreadaily.com
braindaily.xyz bobinoz.com
brg8.com bolezniorganov.ru
buigas.00it.com bombla.org
buketeg.xyz bookhome.info
buntube.net bookmark4you.com
bvlgariwallet.xyz bpro1.top
c1.onedmp.com bradleylive.xyz
candlewooddentalcentre.com.au brains2.biz
carmuffler.net brk-rti.ru
cartierjusteunclou.xyz browsepulse-a.akamaihd.net
cartierlovebracelet.xyz buehne-fuer-menschenrechte.de
cartierlovestore.com bum.com.ru
cartierreplica.pw bumascloset.com
casinos4dummies.co.uk buscarfoto.com
caulderwoodkennels.com business-suggested.tk
cheap-trusted-backlinks.com buytizanidineonlinenoprescription.blogspot.com
cheapmoncler.pw buzzurl.jp
checkhit.com cablecar.us
chorus.terakeet.com cacheimages.com
christianlouboutinsaleonline.us candypeople.se
ciekawinki.pl candytiner.com
clickaider.com canrole.com
clipartnew.com capture-room.com
coindirect.io cars-modification.net
compliance-alex.xyz cartierreplica.win
compliance-jess.top caveavins.fr
compliance-julianna.top cdnnetwok.xyz
contentsexpress.com cellfun.mobi
coolbar.pro cerev.info
copro.pw chatroulette.si
corta.co cheapjerseysfootballshop.com
cosmeticswomens-womensports.rhcloud.com chocolateslim-u-srbiji.com
ciceros.co
cindymatches.com
clicksor.net
compliance-irvin.top
compliance-jack.top
compliance-willy.top
confib.ifmo.ru
contentlook.co
cracksplanet.com cracksplanet.com
crest3d.ru creditnation.ru
crystalslot.com crirussian.ru
cscwtalkto.site culmimg.pw
culad.com customcollegeessays.net
customboxes4less.com cv.wallhade.co
customergrowthsystems.com
cvety24.by
danashop.ru danashop.ru
dandiyabeats.in daooda.com
data.vtc.pw darkbooks.org
dellalimov.com data-ox.com
designdevise.com date-withme.com
detki-opt.ru davidovic.info
day-news.info
deda-moroza-zakaz.ru
delitime.info
dengi-pod-zalog-nedvizhimosti.ru
dentfidemountpreach.tk
detskie-konstruktory.ru
deutschehobbyhuren.net deutschehobbyhuren.net
dfwu1013.info digilander.libero.it
diffbot.com digital-video-processing.com
dimaka.info djihispano.com
distver.ru djonwatch.ru
dollartree.info doeco.ru
domain-tracker.com doublepimp.com
domaineaneblanc.com download-walpaperhd.blogspot.com
downtuptv.gq
doyouknowtheword-flummox.ml doyouknowtheword-flummox.ml
druzhininevgeniy63.blogspot.com e-c.al
dvervmoskvu.ru e-commerce-seo.com
e-avon.ru eandsgallery.com
editors.choice6912650.hulfingtonpost.com education-cz.ru
eets.net
egovaleo.it egovaleo.it
elektrischezigarette1.blog.pl ekn-art.se
elektrischezigarette1.onsugar.com eldiariodeguadalajara.com
elektrischezigarette2.devhub.com elektrischezigaretten1.blogse.nl
elektrozigaretten2.yn.lt elektronischezi.livejournal.com
erotik0049.com elvenar.com
escortslet.net enews.tech
essay-edu.biz enskedesquashclub.se
etotupo.ru esfchat.tk
europages.com.ru essayservicewriting.org
eyemagination.com etenininrade.ga
f-loaded.de euronis-free.com
falllow.gq european-torches.ru
familienzahnaerzte.com evrotekhservis.ru
familyphysician.ru exci.ru
fealq.com exoneration-project.us
ferretsoft.com expertblog.info
fighrofacciufreesig.ga expresstoplivo.ru
figuringmoneyout.com extads.net
filkhbr.com extlabs.io
film-one.ru ezofest.sk
finstroy.net fanoboi.com
flash4fun.com fast-wordpress-start.com
fortunejack.com fetlifeblog.com
forum.doctissimo.fr filesdatabase.net
forumprofi.de filmetricsasia.com
forums.d2jsp.org filmi-v.online
fotosfotos.eu findpik.com
frameimage.org finemanteam.com
freelotto.com finteks.ru
fuel-gas.com firesub.pl
fun2cell.net fitness-video.net
funnel.co.za forum.poker4life.ru
g33.org free-social-buttons.com
gay-site.store freejabs.com
gelezki.com freshberry.com.ua
getresponse.com fugarif.ga
ghazel.ru funnypica.com
glall.ru gael-s.ru
globatur.ru galaxys6manual.info
gobongo.info gamerextra.com
gaypornmovie.net
gdcentre.ru
ge0ip.net
gearsadspromo.club
glavtral.ru
goforexvps.com
golden-praga.ru golden-praga.ru
greamimgo.pw googlemare.com
gtopstats.com gosarhivrt.ru
gourcy.altervista.org
gq-catalog.gq
graphid.com
greenzaim.ru
gwhwpxbw.bloger.index.hr gwhwpxbw.bloger.index.hr
haikuware.com hamptonoaks.ca
handicapbathtubarea.com handicapvansarea.com
hawaiielectriclight.com healing-dysplasia.ru
hdwallpapers-free.com heartofbeijing.blogspot.com
healbio.ru herokuapp.com
hentaiheroes.com hildinghr.se
hermesbracelets.xyz hit-kino.ru
hermesreplica.pw hoporno.com
hifidesign.ru houseofrose.com
hikesearch.net howmuchdoestizanidinecost.blogspot.com
histock.info husky-shop.cz
hkdiiohi.skyrock.com hut1.ru
holidaypics.org
hostsshop.ru
hotchatdate.com
hothor.se
hothot.ru
houtings.xyz
hoverboard360.nl
howopen.ru
humanorightswatch.org
hundejo.com
iccornacircri.cf
ictizanidinehcl4mg.blogspot.com
idc.com.ua
idealtits.net
ideoworld.org ideoworld.org
imagecoolpub.com igtools.club
imgarit.pw iklysha.ml
imperiafilm.ru ilovevitaly.ru
incep.imagine-ex.co imagez.co
infoupdate.org imfamous.info
io9.com intim-uslugi.info
ipornox.xxx investzalog.ru
islamtoday.co.za iqoption.com
iqupdatetmz.win
istanbulit.com
istizanidineanopiate.blogspot.com istizanidineanopiate.blogspot.com
iusstf.org izhevsk.zrus.org
ivoiretechnocom.ci jabimgo.pw
iwanttodeliver.com je7.us
izoll.ru jennyfire.ru
jerseysbizwholesalecheap.com jerseyssportsshop.com
jerseyswholesalechinalimited.com jrcigars.com
job.icivil.ir kareliatobacco.ru
jwcialislrt.com kazinogames.lv
keyhantercume.com kchaxton.com
keyword-suggestions.com
keywordglobal.co.za
keywords-monitoring-your-success.com keywords-monitoring-your-success.com
kinky-fetishes.com kicknights.gq
kino-ecran.ru kinoduh.ru
kinohall.ru kleine-titten.biz
koptims.tiu.ru kochanelli.com
kountrylife.com konica.kz
krasnodar.ru krasivye-devushki.net
krasula.pp.ua krynica.info
lacasamorett.com laapp.com
landreferat.ru labplus.ru
law-check-two.xyz lafriore.ru
lernur.net lakomka.com.ua
levaquin750mg.blogspot.com laptop-4-less.com
lexaprogeneric.link laxob.com
light.ifmo.ru lecbter-relationships.ga
lignofix.ua leftofcentrist.com
liquimondo.com letto.by
littlesunraiser.com lexiangwan.com
liumimgx.pw lifeinsurancekb.com
live-sexcam.tk limtu.ifmo.ru
livesex-amateure.info lincolntheatre.com
livingcanarias.com linkarena.com
lollypopgaming.com locimge.pw
lovasszovetseg.hu lookingglassemb.com
luciddiagnostics.in lordzfilmz.me
lyrics.home-task.com lovelycraftyhome.com
m4ever.net luckyday.world
lunamedia.co
macnewtech.com
manimpotence.com manimpotence.com
mansiondelrio.co manualterap.roleforum.ru
maranbrinfo.com.br maximpartnerspr.com
martlinker.com med-zdorovie.com.ua
masserect.com mediawhirl.net
max-p.men
mebelcomplekt.ru
mecash.ru
medanestesia.ru
medicinacom.ru
medosmotr-ufa.ru
megagrabber.ru
menhealed.net
mex-annushka.ru mex-annushka.ru
mielec.pl micasainvest.com
minecraft-neo.ru microstatic.pl
mirzonru.net militarysale.pro
missis.top mixed-wrestling.ru
mlvc4zzw.space mnogabukaff.net
moesen-ficken.com moivestiy.biz
moetomnenie.com mojpregled.com
moneyteam24.com monclerjacketsoutlet.pw
morefastermac.trade moneytop.ru
mosrif.ru mosrif.ru
motherboard.vice.com
moviemail-online.co.uk moviemail-online.co.uk
movpod.in moxo.com
mriyadh.com mp3ritm.top
musezone.ru mrmoneymustache.com
musicvidz.ru mrwhite.biz
muz-shoes.ru muabancantho.info
mywallpaper.top musicktab.com
naturtreenspicerx.pw my-aladin.com
myanyone.net
myfreecams.com
myiptest.com
mykings.pw
myliveblog.ru
myonlinepayday.co
na-telefon.biz
nacap.ru
nailsimg.com
najaden.no
nalogovyy-kodeks.ru
napalm51.nut.cc
nastroyke.net
needtosellmyhousefast.com needtosellmyhousefast.com
netcheckcdn.xyz netanalytics.xyz
newyorkhotelsmotels.info newstudio.tv
nextbackgroundcheck.gq nhl17coinsforps3.gratisblog.biz
nfljerseysforsalewholesaler.com nodup.ru
nikitsyringedrivelg.pen.io nootrino.com
nisuturnetdgu.tk obiavo.kz
no-fuel.org obiavo.net
nowtorrents.com obiavo.uz
o333o.com
obiavo.su
obuv-kupit.ru
offers.bycontext.com
oivcvx.website
old-rock.com
olvanto.ru
one.net.in one.net.in
onetravelguides.com ororodnik.goodbb.ru
online-x.ru ossmalta.com
oren-cats.ru ostroike.org
orhonit.com owathemes.com
osb.se11.ru paidonlinesites.com
ostrovtaxi.ru pammik.ru
outshop.ru panouri-solare-acoperis.com
oxford-book.com.ua partnerworkroom.men
papasdelivery.ru pc-services.ru
parajumpersstore.online perl.dp.ua
pc-test.net pharmacyincity.com
pc4download.co picsearch.com
pepperstyle.ru picturesfrom.com
petrovka-online.com
physfunc.ru
piccshare.com
picsfair.com
pinapchik.com
pinkduck.ga pinkduck.ga
pisanieprac.info
pixshark.com pixshark.com
pizda.lol pizdeishn.com
pk-services.ru pladform.ru
pogosh.com polytopesexempt.com
poisk-zakona.ru porno-dojki.net
poiskzakona.ru porno-video-chati.ru
polcin.de portnoff.od.ua
popunder.ru portside.cc
porndroids.com postclass.com
pornmania.pl pozdrawleniya.ru
porno-play.net prchecker.info
pornoinn.com princevc.com
pornotubexxx.name priscilarodrigues.com.br
pornoxxx.com.mx prostitutki-almata.org
portal-eu.ru pufip.com
powenlite24.ru purchasepillsnorx.com
presleycollectibles.com puzo2arbuza.ru
prizeestates.cricket
produkto.net
professionalwritingservices15.blogspot.ru
prosmibank.ru
pssucai.info
pulse33.ru
pxhdwsm.com
pyramidlitho.webs.com pyramidlitho.webs.com
questionmarque.ch quebec-bin.com
quick-offer.com randki-sex.com
r-control.ru ranksonic.com
rapidsites.pro realitykings.com
rednise.com realnye-otzyvy.info
relayblog.com recordpage-a.akamaihd.net
rep-am.com reimageplus.com
resant.ru remont-ustanovka-tehniki.ru
responsinator.com remontvsamare.su
responsive-test.net repeatlogo.co.uk
revistaindustria.com replicalouboutin.xyz
richinvestmonitor.com reversing.cc
riralmolamsaca.tk rightenergysolutions.com.au
rogervivierforsale.com roll123.com
runtnc.net rome2rio.com
ruscoininvest.company roznica.com.ua
ruclicks.com
ruspdd.com ruspdd.com
russian-postindex.ru russkie-gorki.ru
rvzr-a.akamaihd.net saratov.xrus.org
sabaapress.com savetubevideo.com
saletool.ru sawin.beth.webd.pl
sbtdesign.co.uk sbt-aqua.ru
scalerite.co.za scalerite.co.za
scanhub.ru scenicmissouri.us
scanner-fred.top score-ads.men
scanner-josh.top scrapy.org
scanner-olga.top
schlampen-treffen.com
scopich.com
searchlock.com
searchwebknow-a.akamaihd.net
seasaltwithfood.com seasaltwithfood.com
segol.tv secretscook.ru
sei80.com
seksvideoonlain.com seksvideoonlain.com
semxiu.com sendearnings.com
servethis.com seobility.net
sethrollins.net seogadget.ru
sex-tracker.com seolab.top
sexpornotales.com sex-tracker.de
shakhtar-doneck.ru sex-znakomstva.online
share-buttons-for-free.com sexad.net
shikiso.info sexfreepornoxxx.com
ship-marvel.co.ua sexobzor.info
sibvitr.ru sextracker.com
sexyteens.hol.es
shemale-sex.net
shitting.pro
sigmund-freud.co.uk sigmund-freud.co.uk
silvercash.com sim-service.net
simpoed.ufop.br simon3.ru
sisi-go.ru siteexpress.co.il
sitevaluation.org
sivs.ru
skanninge.se skanninge.se
smallseotools.com skincrate.net
smstraf.ru skyway24.ru
soaksoak.ru slavic-magic.ru
social-s-ggg.xyz smadihome.com
social-s-iii.xyz snowplanes.com
soda.media socialtrade.biz
souvenirua.com
sovinsteel.ru sovinsteel.ru
space-worry.ml
space4updating.win space4updating.win
spinazdrav.ru sport-video-obzor.ru
sprttrack.com sportbetfair.com
spy-app.info sptslmtrafms.com
start.myplaycity.com stjamesschool.info
stillmiracle.com stockspmb.info
stroicol.net stroymonolit.su
strv.se suchenindeutschland.com
sugarkun.com sukirgenk.dvrlists.com
supermama.top sureone.pro
superstats.com szamponrevita.pl
svnuppsalaorebro.se tanieaukcje.com.pl
sweepstakes.rewardit.com tastyfoodideas.com
szucs.ru tattooreligion.ru
tako3.com teesdaleflyballclub.co.uk
talant-factory.ru tengohydar.tk
tam-gde-more.ru thaismartloan.com
tandvardshuset.net thepokertimer.com
taqywu51.soup.io thetoiletpaper.com
tedy.su timeallnews.ru
teguh.info timhost.ru
telemetryverification.net titan-ads.life
thenews-today.info tizanidine4mgstreetvalue.blogspot.com
tilido.com tizanidineformigraines.blogspot.com
tizanidineandgabapentin.blogspot.com tizanidinehclsideeffects.blogspot.com
tizanidineandhydrocodone.blogspot.com tizanidinerecreationaluse.blogspot.com
tizanidinemusclerelaxant.blogspot.com tizanidinevsvalium.blogspot.com
tizanidineusedfor.blogspot.com tizanidinewithdrawal.blogspot.com
tizanidinezanaflex.blogspot.com tmm-kurs.ru
tonivedu.it tootoo.to
topquality.cf topcasinoratings.ru
torrent-newgames.com topmira.com
torrent-to-magnet.com topshef.ru
torrentred.games toys.erolove.in
tovaroboom.vast.ru trackmedia101.com
toxicwap.com trafficjunky.com
tpu.ru trafficreceiver.club
traxdom.ru tuberkulezanet.ru
truck-addzilla.life tuckpointingmasonrysystems.com
truemfilelj.gq tula.mdverey.ru
trustedmaccleaner.com turizmus.us
typimga.pw uac.net.au
tytoona.com uhdtv.website
uasb.ru uhod-za-sobakoj.ru
udsgame.online umityangin.net
ultimateclassicrock.com uogonline.com
unionmarkt.de uptime.com
unitexindia.com urlopener.com
unrealcommander.org uroki.net
utiblog.fr vedomstvo.net
v-doc.co veopornogratis.xxx
vadimkravtcov.ru
velpanex.ru
verymes.xyz verymes.xyz
via-gra.webstarts.com video--production.com
viddyoze.com video-chat.cn
videos-for-your-business.com videochat.life
villacoloniale.com vipms.ru
vinsit.ru vkontarkte.com
vip-dom.in vladimir.zrus.org
vip-file.com vmnmvzsmn.over-blog.com
vip-parfumeria.ru voronezh.xrus.org
vipsexfinders.com vrotike.ru
vizag.kharkov.ua vseuznaem.com
vk-mus.ru vvon.co.uk
volume-pills.biz wapsite.me
vostoktrade.info waterpurifier.club
vseigru.one watsonrealtycorp.com
vtc.pw website-analyzer.info
vucms.com wejdz-tu.pl
vvpg.ru wesharepics.com
w3javascript.com wetgames.ru
w7s.ru whereiskentoday.com
walkme.com wingsoffury2.com
waterefficiency.co
webextract.profound.net
weblibrary.win
weburlopener.com
white-truck.life
wiosenny-bon-1500.pl wiosenny-bon-1500.pl
word-vorlagen.net wjgony.com
word-vorlagen.xyz woweb.com.ua
wovis.site ws.ampower.me
wurr.voila.net wurr.voila.net
www.get-free-traffic-now.com www.arenda-yeisk.ru
x-diesel.biz www.kabbalah-red-bracelets.com
x-lime.com
x-true.info
xcc24.pl xcc24.pl
xitjw.info xcombear.ru
xmlinde.com xkaz.org
xn----dtbndd4ae7eub.top xn--80aaagvmjabrs1aoc9luc.xn--p1ai
xn--80ahdheogk5l.xn--p1ai xn--e1afanlbnfckd7c3d.xn--p1ai
xn--b1ag5cfn.xn--p1ai xn--e1aggki3c.xn--80adxhks
xrus.org xrus.org
xsion.net xxxguitars.com
xvideosbay.com yachts-cruise.info
xxx-treker.ru youporn-ru.com
yourporn.com youtubedownload.org
yoursite.com yunque.pluto.ro
yun56.co zazagames.org
zacreditom.ru zebradudka.com
zeroredirect8.com zeroredirect.com
znaniyapolza.ru zetmaster.ru
zrus.org zigarettenonlinekaufen2.drupalgardens.com
zooggames.com

482
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
1flag.co.za 007angels.com
273-fz.ru 7ooo.ru
2x2fan.ru abiente.ru
abtasty.com academiacsmendoza.org
adrunnr.com acgs.tk
advancedcleaner.com admitad.com
agadelha.com.br adviceforum.info
allblogroll.com aksonural.ru
alvtank.se alfa-img.com
anabolics.shop alibestsale.com
animenime.ru alltheviews.com
apidigidocketnet-a.akamaihd.net altamayoztourism.com
apimountainbikei-a.akamaihd.net android-systems.ru
arvut.org apilinkswiftco-a.akamaihd.net
asacopaco.tk arabgirls.adultgalls.com
atlasvkusov.ru astana.xxxkaz.org
autowebmarket.com.ua aviav.eu
availit.weebly.com avitocars.ru
avtoarenda.by azbaseimages.net
azte.ch b2b-lounge.com
babyfactory.fr basisches-wasser.net
baladur.ru bavsac.com
belstaffstore.online beetpics.pw
bestcurs.org bestwebsiteawards.com
betteroffers.review bitnote.co
bget.ru bizcheapjerseyswholesalechina.com
bharatdefencekavach.com blpmovies.com
bimatoprost-careprost.com
bio-market.kz
birzha-truda.eu
biznesschat.net
bizzliving.com
bocoarchives.org
bonkers.name
brainsandeggs.blogspot.com brainsandeggs.blogspot.com
bristolhotel.com bravegirlsclub.com
buigas.00it.com bristolhotel.com.ua
buron.pw bumascloset.com
buyscabiescream.com bvlgariring.xyz
bycontext.com callejondelpozo.es
calstaterealty.us candy-glam-hp.com
candlehandmade.com carabela.com.do
cascadelink.org catalogs-parts.com
chatseo.com cdnanalytics.xyz
christianlouboutinsaleonline.us censys.io
christianlouboutinsaleoutletonline.us centrumcoachingu.com
classiquebijoux.ru cheapjerseysbizwholesale.us
clickintext.net checktext.org
clicksor.com chlooe.com
codq.info clash-clans.ru
com-onlinesupport.host cntravelre.com
compliance-alexa.xyz cobaltpro.ru
connectingsingles.com cocyq.inwtrade.com
continent-e.tv compliance-julianna.top
coolgramgoods.com compliance-willy.top
copblock.org constantaservice.net
crazyboost.pro corta.co
custodieva.ru cs-passion.pl
customergrowthsystems.com customboxes4less.com
data-ox.com cwetochki.ru
dayibiao.com deadlinkchecker.com
dieta-personalna.pl detki-opt.ru
directivepub.com dgfitness.co
dood.live doeco.ru
download-wallpaper.net domainroam.win
education-cz.ru download-of-the-warez.blogspot.com
egvar.net earl-brown.info
ekspertmed.com ed-shop01.ru
elvenar.com elektronischezigarette2.mex.tl
empis.magix.net empathica.com
energydiet-info.ru essayassist.com
evidencecleanergold.com etotupo.ru
expresstoplivo.ru euronis-free.com
extremez.net evrotekhservis.ru
feargames.ru exoneration-project.us
feeriaclub.ru extlabs.io
fickkontaktehobbyhuren.com ezigarettekaufen1.hpage.com
findpik.com ezigarettenshop2.postbit.com
footbalive.org f0815.de
gallerily.com faithe.top
game-mmorpg.net farmprofi.net
gamerscorps.com fast-torrent.ru
generic-pills-online.com filerockstar298.weebly.com
gheus.altervista.org filesmonster.porn
global-ics.co.za flashbannernow.com
gosmeb.ru franklinfire.co
green-tea.tv free-traffic.xyz
gsou.cf g7m.pl
hahashka.ru gamevalue7.weebly.com
hayate.biz gayxperience.com
himazin.info gembird.com
homeandhealth.ru getlamborghini.ga
hostingclub.lk glall.ru
hotgirlhdwallpaper.com googglet.com
house.sieraddns.com googlepositions.com
ihc2015.info gratis-sexkontakte.com
ikritikimou.gr hacktougroup.ru
inspiring-desperate.tk handicapvansarea.com
itrevolution.cf handsandlegs.ru
haveinc.xyz
heatpower.ru
hem.passagen.se
historichometeam.com
hmmm.cz
hmywwogw.bloger.index.hr
horoshieokna.com
humanorightswatch.org
hunterboots.online
iblogpress.xyz
ifirestarter.ru
igru-xbox.net
indiakino.net
inome.com.ua
interferencer.ru
iqoption.com
iron-age.info
japfm.com japfm.com
javspace.net junglenet-a.akamaihd.net
jbl-charge.info keyhantercume.com
jerseywholesaleelitestore.com komputernaya-pomosh-moscow.ru
jewelryandfiligree.com koopilka.com
jofucipiku.tk krassh.ru
keywordteam.net kumuk.info
kinopolet.net laapp.com
kmgamex.cf ladov.ru
knowyournextmove.com lalalove.ru
koronirealestate.gr lazy-z.com
kountrylife.com lazymanyoga.com
ladsup.com liky.co.ua
law-check-eight.xyz linkbuddies.com
letslowbefast.today lion.bolegapakistan.com
lombia.co locustdesign.co
losangeles-ads.com lordzfilmz.me
lowephotos.info lumb.co
m292.info lyrics.home-task.com
manifestation.betteroffers.review malls.com
manifestyourmillion.com medicinacom.ru
markjaybeefractal.com menstennisforums.com
marsgatan.com mir-betting.ru
matrixalchemy.com missvietnam.org
medosmotr-ufa.ru monarchfind-a.akamaihd.net
megavolt.net.ua monitorwebsitespeed.com
mere.host.sk mrwhite.biz
mindbox.co.za my-bc.ru
minet.club myplaycity.com
missis.top namecrumilchlet.tk
misswell.net narkologiya-orel.ru
mlvc4zzw.space
muztops.ru
mvpicton.co.uk
mydoctorok.ru
myhitmp3.club
mymobilemoneypages.com
mysex21.com
narkologiya-peterburg.ru
natali-forex.com natali-forex.com
nelc.edu.eg
netpics.org netpics.org
nevansk.ru nippon-bearings.ru
newstudio.tv offside2.5v.pl
nhl17coins.exblog.jp oivcvx.website
nmrk.ru onlywoman.org
nodding-passion.tk osagonline.ru
noumeda.com ostroike.org
nyfinance.ml ourville.info
obiavo.uz owathemes.com
obuv-kupit.ru oxford-book.com.ua
oddamzadarmo.eu partner-print.men
odywpjtw.bloger.index.hr pepperstyle.ru
oil-td.ru picturesboss.com
online-templatestore.com pixelrz.com
onlyporno.ru popup-hgd.xyz
onlythegames.com pornhive.org
outrageousdeal-a.akamaihd.net pornohub.me
panamaforbeginners.com powitania.pl
partner-pop.men privatbank46.ru
pathwhelp.org proekt-mos.ru
polcin.de projefrio.com.br
poptool.net promover.org
pornodojd.ru pufip.com
pornoslive.net pussysaga.com
pornosmola.info py100.ru
portside.cc
privatov-zapisi.ru
promgirldresses.xyz
prostitutki-odessa.org
qcstrtvt.bloger.index.hr
ranksays.com ranksays.com
recipedays.com recipedays.ru
refererx.com referencemoi.com
respublica-otel.ru reversing.cc
rutor.group ringporno.com
ryetaw.com s-forum.biz
sadaholding.com s1z.ru
sarafangel.ru sabaapress.com
saveriopiazza.it saratov.xrus.org
scanner-alex.top sbetodiodnye-lampy.ru
scanner-andrew.top semaltmedia.com
scanner-viktor.top sexreliz.com
scanner-walter.top sexyali.com
search.alot.com sibdevice.ru
searchlock.com sideeffectsoftizanidine.blogspot.com
senger.atspace.co.uk siteonomy.com
seoboxes.com sitevalued.com
seofied.com skutecznetabletkinaporostwlosow.pl
sexblog.pw smailik.org
sierraapps.com sneakyboy.com
sildenafilcitratemed.com snts.shell-pmr.ru
simply.net social-s-iii.xyz
siteheart.net
sledstvie-veli.net
smallseotools.com
snomer1.ru
social-button.xyz
sockshares.tv sockshares.tv
sportbetfair.com solicita.info
spywarespy.com sonnikforme.ru
sribno.net spamnuker.com
stpolice.com specialfinanceoffers.com
supernew.org spywareit.com
svarbit.com stickers-market.ru
symbaloo.com stretchingabuckblog.com
szamponrevita.pl summerlinhomes411.info
tabletkinaodchudzanie.com.pl sunflowerdrawingpaintings.blogspot.com
tanieaukcje.com.pl superoboi.com.ua
tizanidinecost.blogspot.com suture.co
topsiteminecraft.com svnuppsalaorebro.se
trafficnetzwerk.de taboola.com
trafficstars.com taihouse.ru
triplepanda.xyz template-kid.com
tuckermktg.com templates.radiodigital.co
turbodsp.com tengohydar.tk
tvnewsclips.info thetardistimes.ovh
uamtrk.com thin.me.pn
unacittaconte.org tnctrx.com
urlopener.com tongkatmadura.info
uroffer.link top1-seo-service.com
vapomnoncri.tk topcar-krasnodar.ru
varbergsvind.se topquality.cf
velen.io trailer.cinemaflix.website
via-gra.webstarts.com tripper.de
video-production.com truck-land.life
video-woman.com twodollarshows.com
videosbox.ru ucsol.ru
vkontaktemusic.ru valoresito.com
vvpg.ru vegascosmetics.ru
wdrake.com video-chat.in
webalan.ru viktoria-center.ru
webmasterhome.cn vip2ch.com
winwotgold.pl vkak.ru
wurr.voila.net vksaver-all.ru
vrnelectro.ru
walpaperlist.com
wesharepics.com
wholesalecheapjerseysfree.com
wholesalejerseys-cheapest.com
williamrobsonproperty.com
winx-play.ru
wma-x.com
wowas31.ucoz.ru
www.get-free-traffic-now.com
www.kabbalah-red-bracelets.com www.kabbalah-red-bracelets.com
wyniki-lista.pl xmladserver.com
xn----9sbubg3ambdfl1j.xn--p1ai xn----8sbhefaln6acifdaon5c6f4axh.xn--p1ai
xn--80aaajbdbddwj2alwjieei2afr3v.xn--p1ai xn--c1acygb.xn--p1ai
xn--80ahvj9e.xn--p1ai
xn--b1agm2d.net
xn--d1acah0c.xn--p1ai
xtube.com xtube.com
xxxasianporn.net
yoluxuryevents.com
youraticles.pl youraticles.pl
youtube-downloader.savetubevideo.com yugk.net
zakonobosago.ru zakazvzloma.com
zaloadi.ru zarabotat-na-sajte.ru
zdesformula.ru zastenchivosti.net
zeg-distribution.com zirondelli.it
zigarettenonlinekaufen1.bloog.pl zrelaya.pw
zoogdinsney.com zzbroya.com.ua

10
dev-tools/test_units/ratelimittest-beta.txt
View file

@ -581,14 +581,4 @@
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html> </html>

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.116 0; 10.1.1.130 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.08.3304 ### Version: V4.2022.08.3305
### Updated: Sun Aug 21 22:01:21 UTC 2022 ### Updated: Mon Aug 22 10:03:44 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.08.3304 ### Version: V4.2022.08.3305
### Updated: Sun Aug 21 22:01:21 UTC 2022 ### Updated: Mon Aug 22 10:03:44 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##