vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-02 18:50:13 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2022.09.3333 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2022-09-05 10:09:17 +00:00
parent b4e60504e9
commit 929d4b1c13
47 changed files with 92742 additions and 92752 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.09.3332 #### Version: V4.2022.09.3333
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.09.3332 #### Version: V4.2022.09.3333
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -14,7 +14,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2022.09.3332 #### Version: V4.2022.09.3333
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

11456
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2022.09.3332 #### Version: V4.2022.09.3333
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

11460
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

11460
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

11460
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

11460
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.49 1; 10.1.0.124 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.49 0; 10.1.0.124 0;
127.0.0.1 0; 127.0.0.1 0;

11460
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.49 1; 10.1.0.124 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.49 0; 10.1.0.124 0;
127.0.0.1 0; 127.0.0.1 0;

11460
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.49 1; 10.1.0.124 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.49 0; 10.1.0.124 0;
127.0.0.1 0; 127.0.0.1 0;

11460
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
3332 3333

11460
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

11460
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.225.224.207 0; 104.41.132.231 0;

11460
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.49 1; 10.1.0.124 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.49 0; 10.1.0.124 0;
127.0.0.1 0; 127.0.0.1 0;

11460
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.49 1; 10.1.0.124 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.49 0; 10.1.0.124 0;
127.0.0.1 0; 127.0.0.1 0;

11460
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.49 1; 10.1.0.124 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.49 0; 10.1.0.124 0;
127.0.0.1 0; 127.0.0.1 0;

11460
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.225.224.207 0; 104.41.132.231 0;

11460
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.225.224.207 0; 104.41.132.231 0;

11460
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.49 1; 10.1.0.124 1;
127.0.0.1 1; 127.0.0.1 1;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
BlackWidow CrazyWebCrawler
Ebingbong Drip
Needle Mojeek
PECL::HTTP NPbot
Shodan NetMechanic
Spinn3r NimbleCrawler
Sucuri Telesphorep
Virusdie Whatweb
crawler4j pcBrowser
polaris version x22Mozilla

294
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
360Spider 360Spider
404checker 404enemy
80legs
ADmantX
AIBOT AIBOT
ASPSeek ASPSeek
Aboundexbot AhrefsBot
AiHitBot
Alexibot
AllSubmitter AllSubmitter
Alligator
Anarchie
Ankit Ankit
Anthill Asterias
AwarioRssBot Atomseobot
Attach
AwarioSmartBot AwarioSmartBot
BDCbot BBBike
BDFetch BDFetch
BackStreet Badass
BackWeb BatchFTP
BetaBot
Bigfoot Bigfoot
Bitacle Bitacle
Boardreader Blackboard
BotALot
Brandprotect
Buck
BuiltBotTough BuiltBotTough
BunnySlippers Bullseye
CODE87 CATExplorador
CSHttp
Cegbfeieh
CheTeam CheTeam
CherryPicker CheeseBot
ChinaClaw ChinaClaw
Chlooe Chlooe
Citoid Citoid
Cliqzbot Cliqzbot
Cloud mapping Cloud mapping
Cocolyzebot Copier
Copyscape CopyRightCheck
Cosmos
Crawling at Home Project Crawling at Home Project
Crescent CrazyWebCrawler
CrunchBot DSearch
DBLBot
DIIbot
DTS Agent DTS Agent
Demon
Digincore Digincore
Disco Disco
DittoSpyder Discoverybot
DnBCrawler-Analytics DnBCrawler-Analytics
DnyzBot
DomCopBot
DomainStatsBot DomainStatsBot
Download Wonder Domains Project
Drip Dotbot
ECCP/1.0 EMail Wolf
EasyDL EasyDL
Ebingbong
Ecxi
Exabot
Express WebPictures
ExtLinksBot ExtLinksBot
Extractor Extractor
ExtractorPro ExtractorPro
EyeNetIE
Ezooms Ezooms
FDM
FHscan FHscan
Firefox/7.0 FemtosearchBot
Flunky FlashGet
Freeuploader G-i-g-a-b-o-t
FrontPage GermCrawler
Fuzz GetRight
GetWeb GetWeb
GrabNet Gigabot
GrapeFX Grabber
GrapeshotCrawler
GridBot GridBot
HMView HMView
Heritrix HTTP::Lite
HTTrack
Haansoft
HaosouSpider
Havij
HonoluluBot HonoluluBot
Humanlinks Humanlinks
HybridBot Id-search
IDBot
IRLbot
Image Fetch
IndeedBot IndeedBot
InfoTekies Indy Library
InterGET InfoNaviRobot
Jbrofuzz Iria
JennyBot Iskanie
Jetty JamesBOT
JetCar
JikeSpider JikeSpider
Joomla Jorgee
Jyxobot Jyxobot
Keyword Density
Kinza
Kozmosbot Kozmosbot
LWP::Simple LNSpiderguy
Libwhisker Lanshanbot
LieBaoFast Larbin
Likse Leap
LeechFTP
LeechGet
LexiBot
LinkScan
Linkbot Linkbot
LinkextractorPro LinkextractorPro
LinkpadBot LinkpadBot
MSFrontPage LinksManager
MSIECrawler LinqiaMetadataDownloaderBot
Mail.RU_Bot LinqiaRSSBot
Majestic-SEO Lipperhey Spider
MarkMonitor MIDown tool
Majestic12
MarkWatch MarkWatch
Mass Downloader Masscan
Mata Hari
MeanPath Bot MeanPath Bot
Meanpathbot
Mediatoolkitbot
MicroMessenger
Microsoft Data Access Microsoft Data Access
Minefield
Moblie Safari
Mojolicious
MolokaiBot MolokaiBot
Morfeus Fucking Scanner
Mozlila
Mr.4x3 Mr.4x3
Name Intelligence Musobot
Nameprotect
Navroad Navroad
NetAnts NetAnts
NetLyzer NetZIP
NetSpider Nettrack
Netcraft Netvibes
NextGenSearchBot
Niki-bot
Nikto Nikto
Not Ninja
Nuclei Nmap
Nutch
Octopus Octopus
OnCrawl Offline Explorer
OpenVAS OpenVAS
Openfind Openfind
OrangeBot Openvas
OrangeSpider
PECL::HTTP PECL::HTTP
PHPCrawl POE-Component-Client-HTTP
PageAnalyzer
PageGrabber
PageThing.com PageThing.com
Pandalytics
Panscient Panscient
Piepmatz PictureFinder
Pixray PleaseCrawl
ProPowerBot
Pu_iN Pu_iN
Pump Pump
PyCurl
QueryN Metasearch QueryN Metasearch
RSSingBot RSSingBot
RankActiveLinkBot RankActiveLinkBot
RankingBot2 RankingBot2
Rankivabot
Re-re Re-re
ReGet
RealDownload
Rogerbot
SEOkicks-Robot SEOkicks-Robot
SEOlyticsCrawler SEOlyticsCrawler
SEOstats SEOprofiler
Screaming SMTBot
ScreenerBot Scrapy
Searchestate ScrepyBot
SearchmetricsBot
Seekport Seekport
SemanticJuice SemrushBot
SentiBot
SeoSiteCheckup
SeobilityBot SeobilityBot
Seomoz
Shodan
Siphon Siphon
SiteCheckerBotCrawler
SiteExplorer SiteExplorer
SiteSucker SiteSucker
SmartDownload Sitebeam
Snapbot Siteimprove
Sitevigil
SocialRankIOBot SocialRankIOBot
Sogou web spider SpaceBison
Spammen
SpankBot
Spinn3r Spinn3r
SputnikBot Steeler
Sqlmap
Sqworm
Stripper
Sucuri Sucuri
SuperBot
Surfbot Surfbot
SurveyBot SurveyBot
Swiftbot
Szukacz Szukacz
T0PHackTeam T8Abot
Teleport Teleport
Telesphoreo Telesphoreo
The Intraformant Telesphorep
TheNomad Tracemyfile
Toweyabot
Trendictionbot Trendictionbot
True_Robot Turingos
Turnitin
Twice
Typhoeus Typhoeus
URLy Warning URLy Warning
URLy.Warning
V-BOT V-BOT
VB Project VeriCiteCrawler
Vagabondo
VelenPublicWebCrawler
VidibleScraper VidibleScraper
Voltron Virusdie
WASALive-Bot VoidEYE
Voil
WBSearchBot WBSearchBot
WPScan WISENutbot
WWW-Collector-E WWW-Collector-E
WWW-Mechanize WWWOFFLE
Web Fetch WallpapersHD
Web Fuck Web Auto
Web Collage
Web Enhancer
Web Pix
WebAuto WebAuto
WebBandit WebBandit
WebCopier WebCopier
WebEnhancer
WebFetch
WebFuck WebFuck
WebGo IS WebGo IS
WebLeacher
WebPix WebPix
WebReaper
WebSauger
WebStripper WebStripper
WebZIP Webalta
WebsiteQuester Website Quester
Webster Webster
Whack
Whacker
Whatweb
Widow Widow
WinHTTrack Wonderbot
Woobot
Wotbox Wotbox
Wprecon Xenu
Xaldon WebSpider Zitebot
YoudaoBot ZoomBot
ZyBorg
adscanner
arquivo-web-crawler
backlink-check
check1.exe check1.exe
clark-crawler coccocbot
dataforseo.com com.plumanalytics
evc-batch crawl.sogou.com
facebookscraper crawler4j
demandbase-bot
domainsproject.org
heritrix heritrix
isitwp.com isitwp.com
lwp-request linkdexbot
lwp-trivial
mediawords
netEstate NE Crawler
oBot
polaris version polaris version
ripz
s1z.ru s1z.ru
satoristudio.net satoristudio.net
scan.lol scalaj-http
seobility
seocompany.store seocompany.store
seostar
sexsearcher sexsearcher
sitechecker.pro siteripz
sysscan sogouspider
tAkeOut tAkeOut
ubermetrics-technologies.com
voyagerx.com voyagerx.com
webmeup-crawler xpymep1.exe
webpros.com zgrab
webprosbot

332
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
01h4x.com
360Spider
80legs 80legs
ASPSeek ASPSeek
Aboundexbot
Acunetix Acunetix
AiHitBot
Alexibot Alexibot
AllSubmitter Anarchy99
Alligator
AlphaBot
Anarchie
Apexoo Apexoo
AwarioRssBot Aspiegel
Asterias
Atomseobot
Attach
AwarioSmartBot AwarioSmartBot
BBBike BBBike
BLEXBot BDCbot
BackDoorBot
BackStreet
BackWeb
Backlink-Ceck
BacklinkCrawler
Bandit
Barkrowler
Battleztar Bazinga
Black Hole
BlackWidow BlackWidow
Blackboard BlowFish
Blow Bolt
Buddy Brandprotect
BunnySlippers Brandwatch
BuzzSumo Bullseye
CCBot
CODE87
Calculon Calculon
Cegbfeieh CazoodleBot
Citoid CheTeam
CheeseBot
CherryPicker
ChinaClaw
Claritybot
Cliqzbot Cliqzbot
Collector Cloud mapping
Cocolyzebot
Copier Copier
CopyRightCheck
Copyscape Copyscape
Curious Craftbot
DIIbot DTS Agent
DatabaseDriverMysqli DataCha0s
Deusu Devil
Digincore Digincore
Disco
Discobot
Discoverybot Discoverybot
DnyzBot Dispatch
DomCopBot DomCopBot
DomainAppender
DomainSigmaCrawler DomainSigmaCrawler
Domains Project Domains Project
ECCP/1.0 Dotbot
Dragonfly
EMail Siphon EMail Siphon
EMail Wolf Ebingbong
Ecxi
Exabot
Express WebPictures Express WebPictures
Ezooms ExtLinksBot
FHscan EyeNetIE
Fimap Fimap
Firefox/7.0 Foobot
FlashGet
Flunky
FrontPage FrontPage
FyberSpider Fuzz
Fyrebot Go!Zilla
Genieo
GetRight
GetWeb
Getintent
Gigabot
GoZilla
Gotit
Grabber
Grafula
GrapeFX GrapeFX
HMView GrapeshotCrawler
HTMLparser
Haansoft Haansoft
Havij Harvest
HonoluluBot Iblog
Humanlinks Image Fetch
IRLbot Indy Library
Image Sucker
Intelliseek Intelliseek
InterGET InternetSeer
Internet Ninja
Iskanie Iskanie
JetCar IstellaBot
Jetty JOC Web Spider
Joomla Jbrofuzz
JennyBot
JikeSpider
Jorgee Jorgee
Kenjin Spider
Keybot Translation-Search-Machine Keybot Translation-Search-Machine
Kinza LNSpiderguy
LWP::Simple LWP::Simple
Lanshanbot
Larbin Larbin
Leap
LeechFTP
Lftp Lftp
LibWeb LibWeb
Libwhisker LieBaoFast
Lightspeedsystems Likse
LinkWalker Linkbot
LinksManager
LinqiaMetadataDownloaderBot LinqiaMetadataDownloaderBot
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey Spider Lipperhey Spider
Litemage_walker
Lmspider Lmspider
Ltx71 Ltx71
MIDown tool
MIIxpc
MSFrontPage
MTRobot
Magnet
Mail.RU_Bot Mail.RU_Bot
Majestic-SEO MarkMonitor
Majestic12
MarkWatch MarkWatch
Mata Hari Mass Downloader
MegaIndex.ru Masscan
Metauri
MicroMessenger MicroMessenger
Microsoft Data Access Microsoft Data Access
Microsoft URL Control Minefield
Moblie Safari Mister PiX
Mojeek
Mojolicious
MolokaiBot MolokaiBot
Msrabot Morfeus Fucking Scanner
Musobot Mozlila
Mr.4x3
Needle Needle
Nessus Nessus
NetMechanic Net Vampire
Netvibes NetLyzer
Nmap NetSpider
Netcraft
Nettrack
NextGenSearchBot
Nibbler
Niki-bot
Ninja
Nuclei
Nutch Nutch
Octopus
Offline Explorer
OnCrawl OnCrawl
OpenVAS OpenLinkProfiler
Openfind OutclicksBot
Openvas
OutfoxBot OutfoxBot
POE-Component-Client-HTTP PECL::HTTP
Page Analyzer
PageScorer PageScorer
Petalbot PageThing.com
Pimonster Papa Foto
Pavuk
Picscout
PictureFinder
Piepmatz
Pixray Pixray
Pockey PleaseCrawl
ProPowerBot
ProWebWalker ProWebWalker
Probethenet
Psbot Psbot
Pu_iN PxBroker
PyCurl Quick-Crawler
QueryN Metasearch RankActiveLinkBot
RankFlex
Rankivabot Rankivabot
ReGet ReGet
RebelMouse
Recorder
RedesScrapy
RepoMonkey RepoMonkey
Ripper
RocketCrawler
Rogerbot Rogerbot
SISTRIX SBIder
SEOkicks
SEOkicks-Robot
SEOprofiler
SalesIntelligent SalesIntelligent
ScanAlert Scanbot
ScoutJet ScoutJet
ScreenerBot Seekport
ScrepyBot SiteSnagger
SearchmetricsBot
SemrushBot
SeoSiteCheckup
Seomoz
Shodan
Siphon
Site Sucker
SiteExplorer
SiteSucker SiteSucker
Sitebeam Snake
Sitevigil SocialRankIOBot
Snoopy
Sociscraper Sociscraper
Sogou web spider SpankBot
Sosospider
Spammen
Spanner Spanner
Spbot Spinn3r
SputnikBot Szukacz
Sqlmap
Sqworm
Sucuri
SuperBot
Surfbot
Suzuran
Swiftbot
T0PHackTeam T0PHackTeam
T8Abot TeleportPro
Telesoft Telesoft
TheNomad Telesphorep
Thumbor The Intraformant
Toweyabot Titan
Trendiction Trendiction
True_Robot
Turingos Turingos
TurnitinBot TurnitinBot
Twice Twice
URLy Warning Typhoeus
UnisterBot
V-BOT V-BOT
VoidEYE VCI
Vagabondo
VidibleScraper
WASALive-Bot
WISENutbot WISENutbot
WPScan WWWOFFLE
WWW::Mechanize Wallpapers
Web Fetch Wallpapers/3.0
Web Pix Web Collage
Web Sucker Web Enhancer
WebAuto Web Sauger
WebCollage
WebCopier
WebEnhancer
WebFetch WebFetch
WebLeacher WebFuck
WebGo IS
WebPix WebPix
WebZIP WebSucker
Webalta
WebmasterWorldForumBot
WebsiteExtractor WebsiteExtractor
Webster WebsiteQuester
Whack Widow
Whatweb
WinHTTrack WinHTTrack
Woobot Wotbox
Xenu
Zauba
Zermelo
Zeus Zeus
ZoomBot adscanner
ZoominfoBot archive.org_bot
ZumBot arquivo-web-crawler
ZyBorg
arquivo.pt
autoemailspider autoemailspider
cah.io.community
check1.exe check1.exe
cognitiveseo clark-crawler
com.plumanalytics
crawl.sogou.com
crawler.feedback crawler.feedback
crawler4j
dataforseo.com dataforseo.com
domainsproject.org domainsproject.org
eCatch
facebookscraper facebookscraper
gopher gopher
instabid
internetVista monitor internetVista monitor
ips-agent magpie-crawler
iubenda-radar meanpathbot
lwp-trivial
mediawords
muhstik-scan muhstik-scan
plumanalytics netEstate NE Crawler
polaris version oBot
ripz pcBrowser
s1z.ru
scalaj-http
seobility seobility
seostar
serpstatbot serpstatbot
sexsearcher sysscan
siteripz tAkeOut
sogouspider trendiction.de
sp_auditbot
spyfu
voyagerx.com voyagerx.com
webpros.com webmeup-crawler
webprosbot x22Mozilla
x09Mozilla
xpymep1.exe xpymep1.exe

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
aaa38852e886ac4af1a3cff9b47cab6272.com 5kstore.com
anlimebel.kiev.ua magazin-pics.ru
daptravel.com noscrapleftbehind.co
eyessurgery.ru ostroike.org
foxinsocks.ru plastweb.ru
glavprofit.ru preconnubial.usuby.site
phpdevops.com signoredom.com
seo-traffic-ranking.info socialbookmarksubmission.org
sexkvartal.com thebitcoincode.com
xxxnatelefon.ru xn--80aaafbn2bc2ahdfrfkln6l.xn--p1ai

938
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
000free.us 0n-line.tv
1001desert.com 12masterov.com
101raccoon.ru 14b.info
1bet.com 18ps.ru
2345.com 1kinobig.ru
24-ak.ru 2000k.ru
2daytrendingnews.com 2728fb936f0.com
2kata.ru 2girls1cup-free.com
2rich4bitches.com 3dracergames.com
5ws.dating-app.ru 3rbseyes.com
883zy.com aarbur.com
aa625d84f1587749c1ab011d6f269f7d64.com abbanreddy.com
adinterax.com abctoppictures.net
adman.se absugars.com
admatic.com.tr acmebtn.ml
adtech.us adbetclickin.pink
adzerg.com addtoadd.men
agreda.pluto.ro adprotect.net
airmaxshoes-2016.com ads-seo.men
ads.gold
adtiger.tk
advancedcleaner.com
affiliate-fr.com
agysya.ru
aimayangzhi.com
akama.com
albamargroup.com albamargroup.com
alekseevec.ru albumsuper.info
alert-jdh.xyz albuteroli.com
all4invest.info alienwheels.de
allesohnegirls.net aliexpresscashback.club
amateurgalls.com
amateurlivechat.org
amateurmatch.com amateurmatch.com
ample-awards-today.us anniemation.com
amyfoxfitness.com anonymousfox.co
anal-acrobats.com apibatbrowsecom-a.akamaihd.net
andpolice.com apioutoboxnet-a.akamaihd.net
apelsinnik.website arcadeplayhouse.com
applyneedy.xyz ardimobileinfo.ml
approvedlocal.co.za arewater.com
asiengirls.net arquivo.pt
aussie-prizes.com arraty.altervista.org
autobrennero.it artdeko.info
autorn.ru artel116.ru
asseenontvonline.ru
autodo.info
autoloans.com
autolombard-krasnodar.ru
avkzarabotok.info
avon-severozapad.ru
awency.com
ayakino.net ayakino.net
azte.ch backuperwebcam.weebly.com
babespcs.com badavit.com.ua
bank.uz baditri.com
beachpics.com bagsonsale.online
belstaffstore.online balans.shahterworld.org
best-games.today bambi.ck.ua
best-seo-offer.com bannertesting.com
besthomemadepornsites.com baoxaydung.com.vn
bestserials.com battleforupdating.site
bestwaystogetpaid.us beremenyashka.com
biketank.ga best-seo-software.xyz
bluesalt.co best-way.men
bmsco.co bestbrainprod.win
bodybuilding-shop.biz bestsexyblog.com
bonvillan.com bestssaker.com
brains2.biz bigpictures.club
brg8.com bikini-image.com
bscodecs.com billiard-classic.com.ua
burkesales.com bio-market.kz
buyclomidonlaine.com bjetjt.com
buyfriend.ru bloggen.be
buynorxx.com buehne-fuer-menschenrechte.de
buypillsorderonline.com bum.com.ru
buypuppies.ca burger-imperia.com
buzzsumo.com buyantiviralwp.com
callejondelpozo.es buzzurl.jp
calstaterealty.us bycontext.com
canacopegdl.com bzero1jewelry.net
candelluxsklep.pl cah.io.community
candypeople.se calvet.altervista.org
canyougethighofftizanidine.blogspot.com candiceloves.us
cardiosport.com.ua capacitacionyaprendizaje.com
cartiertrinity.xyz carfax.com.ua
cellfun.mobi cartierreplica.top
cercacamion.it cdncash.org
cheapmoncler.pw celebsopics.com
checkhit.com cfacarrosserie74.com
checktext.org chatroulette.online
christianlouboutinreplica.win cheapjerseysbizwholesale.us
ciceros.co cheapsergiorossi.online
cindymatches.com cialiswithoutadoctor.net
clickaider.com civilwartheater.com
clickbank.net clash-clans.ru
cobaltpro.ru classicakuhni.ru
clickhype.com
clickintext.net
club-lukojl.ru
colehaanoutlet.store colehaanoutlet.store
comissionka.net community.allhiphop.com
compliance-alex.xyz companies-catalog.com
compliance-brian.top compliance-andrew.top
compliance-jane.top compliance-checker-7.info
compliance-olga.top compliance-ivan.xyz
concealthyself.com compliance-jack.top
confib.ifmo.ru conboy.us
constantaservice.net cookingmeat.ru
cornomase.win cosmeticswomens-womensports.rhcloud.com
craftinsta.ru counter.bloke.com
crazyboost.pro covadhosting.biz
crd.clan.su covetnica.com
crynet.cc credit-online.ws
d-black.bz creditwell.ru
daneshetabiat.com cryptoswap.biz
data-ox.com cscwtalkto.site
ddospanel.com cutt.us
dekoration.us cvety24.by
delitime.info cymbaltaandtizanidine.blogspot.com
deshevo-nedorogo.ru dafatiri.com
deutschland123.de dailyrank.net
directrev.com daisye.top
dirtpics.pw data1.scopich.com
discountbarbour.online dealighted.com
discountliv.com destinationrealestate.com
dmmspy.com detmebel.su
dnepropetrovsk.mistr-x.org dfwu1013.info
docstoc.com digilander.libero.it
doctissimo.fr digital-sale.su
dojki365.online dimaka.info
domination.ml dnsrsearch.com
doublepimp.com doctormakarova.ru
download-of-the-warez.blogspot.com dokfilms.net
dptaughtme.com dpihatinh.gov.vn
drev.biz drev.biz
drugs-no-rx.info drhomes.biz
dscaas.website
dverimegapolis.ru
dynainbox.com dynainbox.com
e-collantes.com e-commerce-seo.com
e-poker-2005.com eandsgallery.com
ebonyporn.site ebonyporn.site
el-nation.com education-cz.ru
elexies.info ege-russian.ru
enpolis.ru ekspertmed.com
elektrischezigaretten1.blogse.nl
elitepcgames.com
elmacho.xyz
emailaccountlogin.co
embedle.com
enthuse.computernetworksonline.com enthuse.computernetworksonline.com
este-line.com.ua esfchat.tk
eupornstar.info eshop4u.jp
evehemming.blogspot.com.au etenininrade.ga
everflora.ru etm-consult.de
exoneration-project.us european-torches.ru
factorynightclub.com everypony.ru
feeriaclub.ru exhibitionplus.eu
femmesdenudees.com expdom.com
fickkontakte.org faithe.top
fidelityfunding.com farmingworm.com
fillmewithhappiness.com fastcrawl.com
filmidivx.com fenoyl.batcave.net
findsexguide.com film-one.ru
fitnesspiks.com fitnesspiks.com
flowwwers.com flashbannernow.com
flprog.com flirt4free.com
flytourisme.org forsex.info
focalink.com fortunejack.com
forum.doctissimo.fr forums.d2jsp.org
forzeronly.com
fotoxxxru.com
franklinfire.co franklinfire.co
free-today.com free-share-buttons.com
freshwallpapers.info freegamesplay.online
friendflnder.com freelifetimefuckbook.com
froggytube.com freelotto.com
ftns.ru freshsuperbloop.com
funnel.co.za front.to
funnymama.com fullgirl.ru
gallery.rennlist.com funcrushgames.com
gate5.co.za fxund.us
gavuer.ru fyl.com.ru
gay-file.com gabeshop.ru
gay.adultgalls.com ge0ip.org
gayxperience.com genericlowlatencyasiodriverhq.aircus.com
gdzkurokam.ru getlamborghini.ga
gg.zzyjxs.com
gigixo.com gigixo.com
gilsonchiro.xyz gk-atlant.info
globatur.ru gkvector.ru
gsasearchengineranker.pw globalscam.ga
guildebzh.info goatse.ru
guitar-master.org golden-praga.ru
gwebtools.com.br greamimgo.pw
hatedriveapart.com guod.me
health-medical-portal.info hamilton.ca
hermesbracelets.xyz hard-porn.mobi
hop.clickbank.net hdimagegallery.net
hotloans.ru heygidday.biz
houston-vikings.com hjaoopoa.top
houtings.xyz hotcore.info
husky-shop.cz hoverboardforsaledirect.com
hybrid.ru huhn.altervista.org
i-service.kz iccornacircri.cf
iamsport.org ico.re
iframe-toloka.com iframe-toloka.com
imabase.com igru-xbox.net
ikearugs.xyz
ilmen.net
imagefinder.site imagefinder.site
internetproviderstucson.com indetiske.ya.ru
intim-uslugi.info intelhdgraphicsgtdrive6w.metroblog.com
ivanovo.zrus.org ipornox.xxx
j33x.com iwantmyfreecash.com
jagg.info izhevsk.zrus.org
jerseychinabizwholesale.us jamiembrown.com
jillepille.com javatex.co.id
jmat.cn javrip.net
johnrobertsoninc.com jennyfire.ru
journeydownthescale.info jerseychinabizwholesale.com
jrcigars.com jerseywholesalechinabiz.com
junketjuice.blogspot.com jestr.org
kaidalibor.de justprofit.xyz
kaliningrad.zrus.org kaac.ru
kartiniresto.com kadashihotel.com
keki.info kambasoft.com
kiwi237au.tk kandidos.com
klitimg.pw karadene.com
kazinogames.lv
kenaba.su
ketrzyn.pl
keywordsuggests.com
kichenaid.ru
kinopolet.net
kiwe-analytics.com
klejonka.info
kongruan.com kongruan.com
kosynka-games.ru konkursowo-24.pl
kotaku.com koopilka.com
koptims.tiu.ru
kreativperlen.ch kreativperlen.ch
kvartiry-remont.ucoz.ru ktotut.net
lacave.ntic.fr kursy-ege.ru
laexotic.com ladov.ru
lancheck.net larchik.net
legionalpha.com laudit.ru
letslowbefast.site law-check-nine.xyz
libertybilisim.com lawyers.cafe
lidoradio.com le-clos-des-alouettes.com
likesuccess.com lescinq.com
lineshops.biz lifebyleese.com
linkrr.com lion.snapmap.us
liupis.com livesex-amateure.info
liveinternet.ro loadingpages.me
liveinternet.ru localflirtbuddies.com
liverpool.gsofootball.com lolnex.us
llastbuy.ru lostaruban.com
loadopia.com low-format.ru
lob.com.ru lsex.xyz
lol-smurfs.com luckyshop.net.ua
lombia.co m292.info
lotto6888.com mac-shield.com
louboutinshoes.xyz magnetpress.sk
m-google.xyz manifestation.betteroffers.review
m1media.net manimpotence.com
m4ever.net masthopehomes.com
macfix.life matrixalchemy.com
maladot.com maxxtor.eu
marketland.ml mcnamaratech.com
marsgatan.com mearns-tractors.co.uk
maslenka.kz mebel-ekb.com
masterseek.com metalonly.info
max-eclat.men miniature.io
mediaoffers.click misandesign.se
medicineseasybuy.com mmoguider.ru
mega-bony2017.pl mojowhois.com
megakino.net moyakuhnia.ru
mejoresfotos.eu mp3films.ru
menhealed.net mrbojikobi4.biz
menstennisforums.com msk-diplomat.com
metaxalonevstizanidine.blogspot.com mtmtv.info
methodsmarketing.com mttwtrack.com
mhtr.be mulberryoutletonlineeu.com
michaelkorssaleoutletonline.net musicdaddy.net
mikrobiologies.ru musicstock.me
mini.7zap.com musicvidz.ru
mjchamonix.org muz-shoes.ru
mobilemedia.md mymercy.info
moje-recenze.cz myperiod.club
monclerjacketsoutlet.win mypornfree.ru
moncleroutletonline.win myxdate.info
monitorwebsitespeed.com nac-bearings.ru
morpicert.pw naj-filmy24.pl
moscow.online-podarki.com naperehresti.info
mosrif.ru needtosellmyhousefast.com
moyaterapiya.ru net-profits.xyz
mrwhite.biz netallergy.ru
mturkcontent.com
musezone.ru
musicpro.monster
na15.ru
nagdak.ru
naphukete.ru
net-radar.com
netoil.no
newfilmsonline.ru
newstraveller.ru
nextlnk12.com
nfvsz.com
niroo.info
nlfjjunb5.ru
nodding-passion.tk
noscrapleftbehind.co noscrapleftbehind.co
obiavo.ru nosecret.com.ua
oddamzadarmo.eu nottyu.xyz
oecnhs.info nullrefer.com
offergroup.info nw-servis.ru
offtopic.biz nyfinance.ml
ohmyrings.com ochistka-stokov.ru
okmedia.sk oda.as
okuos.com offer.wpsecurity.website
offside2.5v.pl
old-rock.com
oneminutesite.it
online-templatestore.com
online-x.ru online-x.ru
online.ktc45.ru onlyporno.ru
openfrost.net openstat.com
openlibrary.org osb.se11.ru
otbelivanie-zubov.com p-business.ru
ovirus.ru panchro.co.uk
panicatack.com
papasdelivery.ru papasdelivery.ru
parajumpersoutlet.online pastaleads.com
partner-high.men pc-virus-d0l92j2.pw
partner-pop.men perm-profnastil.ru
partnerworkroom.men peugeot-club.org
pay2me.pl photosaga.info
pekori.to
perosan.com
pestomou.info
php-market.ru
pictures-and-images.net pictures-and-images.net
pijoto.net pizza-tycoon.com
play.leadzupc.com plugingeorgia.com
playfortuna-play.ru poem-paying.gq
pobeiranie.pl pontiacsolstice.info
polimga.pw pony-business.com
pons-presse.com popads.net
popcash.net popserve.adscpm.net
popugauka.ru
popunder.ru popunder.ru
popup-fdm.xyz porno-transsexuals.ru
popup-jdh.xyz porno-video-chati.ru
pornogratisdiario.com pornofeuer.com
pornoreino.com pornogad.com
pornoted.com pornoplen.com
pornotubexxx.name pornosexrolik.com
portside.xyz pornosok.ru
pospr.waw.pl pornowarp.info
postclass.com porodasobak.net
potolokelekor.ru potolokelekor.ru
pozvonim.com pretty-mart.com
presleycollectibles.com priceg.com
pricheskaonline.ru primedice.com
printie.com privatamateure.com
privacylocationforloc.com privatov-zapisi.ru
privatefx.all4invest.info prodvigator.ua
prodess.ru projefrio.com.br
profitsport.club promalp-universal.ru
profitwithalex.info promoheads.com
promodj.com pulse33.ru
promoforum.ru pxhdwsm.com
proxyradar.com qwertty.net
pts163.ru rabot.host.sk
putitin.me
quick-seeker.com
raisedseo.com raisedseo.com
rankia.com
ratemodels.net ratemodels.net
razyboard.com razvratnoe.org
rcb101.ru redirect.trafficreceiver.club
realitykings.com rednise.com
redbottomheels.xyz
regionshop.biz regionshop.biz
reining.lovasszovetseg.hu renecaovillasale.online
resant.ru ring4rhino.com
rfserial.net risparmiocasa.bz.it
rialp.getenjoyment.net running-line.ru
rique.host.sk sa-live.com
rome2rio.com santechnik.jimdo.com
rubanners.com scanner-alexa.top
ruclicks.com schlampen-treffen.com
ruspdd.com sdelatmebel.ru
russia-tao.ru seadragonherbery.com
rvzr-a.akamaihd.net seeresultshub-a.akamaihd.net
sabizonline.com sex-sex-sex5.com
sale-japan.com
samoiedo.it
saneitconsulting.com
sbetodiodnye-lampy.ru
scanner-josh.top
scanner-walt.top
scenicmissouri.us
searchaddis.com
searchkut.com
seemoreresultshu-a.akamaihd.net
segol.tv
semalt.com
sex-znakomstva.online
sex.hotblog.top sex.hotblog.top
sexblog.pw sexblog.pw
sexkrasivo.net sexsearch.com
sexytrend.ru sexyali.com
shikiso.info shoppingjequiti.com.br
shop.xz618.com shtaketniki.kz
shopsellcardsdumps.com sibvitr.ru
sibecoprom.ru signx.info
sibtest.ru sitopreferito.it
sivs.ru skachat-besplatno-obrazcy.ru
slutloadlive.com skincrate.net
smartadserver.com skyway24.ru
snworks.com slim.sellany.ru
sockshare.net sluganarodu.ru
soda.media slujbauborki.ru
softomix.com smichovbike.cz
softxaker.ru social-button.xyz
soochi.co social-s-hhh.xyz
sovetogorod.ru solution4u.com
spabali.org sotechco.co
spin2016.cf spin2016.cf
sports-supplements.us spinnerco.ca
spravka130.ru sps-shop.com
startufa.ru spy-app.info
staynplay.net squidoo.com
stpolice.com starwars.wikia.com
streha-metalko.si stathat.com
success-seo.com statistici.ro
suchenindeutschland.com statustroll.com
sucsesofinspiration.com stop-gepatit.te.ua
sugarlyflex.pw stopnarco.ru
supermesta.ru storehouse.ua
surgut.zrus.org supernew.org
survival.betteroffers.review sureone.pro
svetodiodoff.ru surflinksmedical.com
swinger-mobil.net swagbucks.com
syvertsen-da.no tastyfoodideas.com
taaaak.com tattomedia.com
tacbelarus.ru technopellet.gr
tattooha.com tecspb.ru
technika-remont.ru thecoral.com.br
theendivechronicles.com thegalerie.eu
thenews-today.info themestotal.com
ticketsys.inetwd.com threecolumnblogger.com
time-japan.ru tizanidinedosageforsleep.blogspot.com
tizanidineandgabapentin.blogspot.com tizanidinehcl4mgisitanarcotic.blogspot.com
tizanidinecapsules.blogspot.com tizanidinehclsideeffects.blogspot.com
torture.ml tizanidineorflexeril.blogspot.com
tourismvictoria.com tjkckpytpnje.com
toursmaps.com toon-families.com
toys.erolove.in top1-seo-service.com
trafaret74.ru topads.men
trailer.cinemaflix.website topcar-krasnodar.ru
ttsq.fr topflownews.com
turbodsp.com torrentgamer.net
twelvevisionspartyofcolorado.com torrents-tracker.com
u555u.info touchmods.fr
unimodemhalfduplefw.pen.io traffic100.com
upproar.com tripper.de
upupa.net truemfilelj.gq
uroki.net tula.mdverey.ru
usadacha.net twincitiescarservice.com
usdx.us uchil.net
utrolive.ru ukr-lit.com
v720hd.ru ukrobstep.com
vabasa.inwtrade.com umnovocaminho.com
varikoz24.com ural-buldozer.ru
url-img.link
urll.eu
uvozdeckych.info
uzungil.com
vacances-voyages.info
vavilone.com vavilone.com
vchulkah.net vedomstvo.net
vegan-foods.us vegan-foods.us
videojam.tv vezuviy.su
vids18.site viagra-soft.ru
villacoloniale.com viagra.pp.ua
vinylvault.co.uk viandpet.com
vip-dom.in video-production.com
virus-respirators.com video-woman.com
virus-schutzmasken.de videochat.ph
visa-china.ru videochat.tv.br
visitcambridge.org videochaty.ru
vostoktrade.info vip-parfumeria.ru
vroze.com vipms.ru
vseigru.one visa-pasport.ru
vsexkontakte.net vizitki.net
wallpapers-best.com voltrknc1.com
wardreapptokone.tk vzlom-na-zakaz.com
wdfdocando.com wahicbefa31.soup.io
webix.biz warningwar.ru
webmasters.stackexchange.com waterefficiency.co
webs.com webenlace.com.ar
website-analytics.online weddingdresses.xyz
weightatraining.com westermarkanjou.se
wesharepics.info whatistizanidine2mg.blogspot.com
westum.se wildcattube.com
whereiskentoday.com witclub.info
whereverdesperate.gq womensterritory.ru
whiteelephantwellington.com wonderfulflowers.biz
wikes.20fr.com word-vorlagen.xyz
wnhjavlhezp.gq worldhistory.biz
wovis.site ww2awards.info
wpsecurity.website www.arenda-yeisk.ru
wttavern.com
www.jbetting.com
www.labves.ru www.labves.ru
www.wohnkabinen-shop.de xbaboon.com
wyniki-lista.pl xblognetwork.com
xjlottery.com xdoza.com
xlovecam.com xingzi-vision.com
xmlinde.com xn----7sbaaabaei0cc8aj5bj0bncejx.xn--p1ai
xn-----7kcabaipgeakzcss7bjdqdwpfnhv.xn--p1ai xn--80aeahghtf8ac5i.xn--p1ai
xn-----7kceclhb4abre1b4a0ccl2fxch1a.xn--p1ai xn--d1aifoe0a9a.top
xn--80aaajbdbddwj2alwjieei2afr3v.xn--p1ai xsion.net
xnxx699.com yes-com.com
xportvusbdriver8i.snack.ws
xuki.us
yogamatsexpert.com yogamatsexpert.com
yourads.website yougame.biz
youtoner.it yoursearch.me
yun56.co youthreaders.com
yurgorod.ru zacreditom.ru
zagadki.in.ua zaimite.ru
zajm-pod-zalog-nedvizhimosti.ru zakon-ob-obrazovanii.ru
zawyna.ua zakonobosago.ru
zeroredirect12.com zaobao.com.sg
zirondelli.it zastenchivosti.net
zlatnajesen.com zoogdinsney.com
znakomstva-moskva77.ru zrus.org
zona-aqua.ru zscaler.net
zoodrawings.com
zooggames.com
zvuker.net

472
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
11235813.webzdarma.cz 1001desert.com
123any.com 1314dh.com
1qingdao.com abcdeg.xyz
51.la acgs.tk
5elementov.ru adloads.net
6128786.com adobereader-free.ru
aadroid.net adviceforum.info
aasoldes.fr affordablewebsitesandmobileapps.com
absolutelyanalog.com agecheckadult.com
abtasty.com akuhni.by
academia-nsk.org all-streaming-media.com
adconscious.com animal36.com
adktrailmap.com anniemation.com
admatic.com.tr apibetweenlinesn-a.akamaihd.net
advancedcleaner.com apioutoboxnet-a.akamaihd.net
affrh2015.com applyneedy.xyz
agardomains.com arendatora.ru
aghanyna.com aviav.eu
agroeconom.kz avtovolop.ru
aksonural.ru baksman.com
akusherok.ru baladur.ru
allcredits.su balois.worldbreak.com
alphavisions.net bambi.ck.ua
alpinism.ru battlecarnival.su
anonymizeme.pro best-mam.ru
appfixing.space bestkfiledxd.cf
arabsexxxtube.com bestofupload.info
avramstroy.ru besttorrentknifta.weebly.com
ayakino.net bestwebsitesawards.com
azlex.uz bin-brokers.com
bamo.xsl.pt binaryoptionscops.info
bankiem.pl bio-optomarket.ru
bestcalovebracelet.cn bmw.afora.ru
bestcurs.org board.f00d.de
bestpornuha.com bochemit.com.ua
big-cash.net brateg.xyz
biglistofwebsites.com brg8.com
bimatoprost-careprost.com buntube.net
bingoporno.com burger-tycoon.com
bio.trade-jp.net bzero1jewelry.net
blackhatworth.com calvet.altervista.org
bodybuilding-shop.biz canyougethighofftizanidine.blogspot.com
book-bets.com cartierwatch.xyz
burkesales.com chatroulette.life
buytizanidineonline.blogspot.com cindymatches.com
camel-beach.com cjmc.info
castingbank.ru clickso.com
cdncash.net clothesforcash.com
cheapmoncler.xyz cobaltpro.ru
cialischsrx.com cocyq.inwtrade.com
civilwartheater.com
classiquebijoux.ru
clean-virus-mac.com
click2pawn.com
clubfashionista.com
cocolyze.com
compliance-alex.xyz compliance-alex.xyz
compliance-irvin.xyz compliance-olga.top
conciergegroup.org constantaservice.net
cookie-law-enforcement-ff.xyz coolgramgoods.com
cracksplanet.com copyrightclaims.org
cubook.supernew.org counter.bloke.com
customerguru.in counter.yadro.ru
dailyfinancefix.com courtshipgift.com
datadepths.com cowlmash.com
digitalassetmanagement.site cranly.net
cscwtalkto.site
d-black.bz
dame-ns.kz
daneshetabiat.com
dealighted.com
deluxedumps.com
design-lands.ru
dneprsvet.com.ua dneprsvet.com.ua
domcran.net domainsphoto.com
downvids.net doreenblog.online
drhomes.biz downloaddy.net
drugspowerstore.com ebonyporn.site
drunkenstepfather.com efnor-ac.com
dtnlyss.com elektrozigarette1.dreamwidth.org
ecommerce-seo.org elektrozigaretten1.webs.com
education-cz.ru elvenmachine.com
eloxal.ru emailaccountlogin.co
elvel.com.ua energy-ua.com
erectile.bid envaseslotusama.com
escortslet.net eugenevaultstorage.com
extlabs.io evogarage.com
falcon-images.blogspot.com exonline.info
famix.xyz fashion-stickers.ru
fanoboi.com fashionavenuegame.com
fast-torrent.ru fertilitetsradgivningen.se
ferretsoft.com flashbannernow.com
fivedwld.cf frequiry.com
free-today.com
free411games.com
freshmac.space freshmac.space
gateway.zscalertwo.net fullfileaccess.com
gidonline.one fungirlsgames.net
gigapeta.com gaming-journal.com
gkvector.ru ge0ip.net
goldadpremium.com gearcraft.us
generalporn.org
girlsatgames.ru
gombita.info
googlepositions.com
goosefishpost.bid
gribokstop.com
grizzlysgrill.com grizzlysgrill.com
gta-club.ru gsmtlf.ru
guitar-master.org gsou.cf
heartofpayne.xyz gunsvicceadadebt.tk
high-speed1.net hannasolution.ru
hikesearch.net hd720kino.ru
hitcpm.com healing-dysplasia.ru
hoverboard360.at heartofbeijing.blogspot.com
hoverboard360.se hebr.myddns-flir.com
ilmen.net helvetia.com.ua
insomniagamingfestival.com highstairs-a.akamaihd.net
iplogger.org honyaku.yahoofs.jp
j-times.ru hotblognetwork.com
hotshoppymac.com
hoverboard360.nl
hvd-store.com
images-graphics-pics.com
incest-ru.com
int.search.tb.ask.com
investmac.com
iopeninghours.co.uk
iplusbit.blogspot.co.za
itbc.kiev.ua
japan-bearings.ru
javidol.site javidol.site
journeydownthescale.info kakablog.net
kinosed.net kalandranis.gr
kollekcioner.ru kam-dom.ru
komputernaya-pomosh-moscow.ru keywordsking.com
konica.kz kfon.eu
kinofak.net
kit-opt.ru
kmgamex.cf
konkursowo-24.pl
kraljeva-sutjeska.com
krynica.info
kumuk.info
lankarns.com lankarns.com
leadwayau.com
ledis.top ledis.top
ledpolice.ru letslowbefast.site
lennatin.info littleberry.ru
letmacworkfaster.world lolnex.us
lifeinsurancekb.com louboutinshoes.xyz
liupis.com make-money-online.com
llastbuy.ru mindbox.co.za
longadventure.com mir-betting.ru
lookingglassemb.com mmstat.com
lsp-awak-perikanan.com mobstarr.com
luckyshop.net.ua moncleroutletonline.win
m-google.xyz na15.ru
machicon-akihabara.info
medtherapy.ru
memberty.com
mhtr.be
microstatic.pl
mini-modus.ru
missclub.info
monetizer.com-01.site
moneyviking-a.akamaihd.net
morepoweronmac.trade
mossmesi.com
moxo.com
msk.afora.ru
namenectar.com namenectar.com
newsperuse.com nastydollars.com
ningessaybe.me new7ob.com
nonews.co news-readers.ru
northfacestore.online nudejapan.net
nudepatch.net
nvssf.com
oakleyglassesonline.us oakleyglassesonline.us
oakridgemo.com obnal.org
oconto.ru oda.as
okout.ru oil-td.ru
okuos.com oneminutesite.it
onefilms.net onthemarch.co
ostrovtaxi.ru oops-cinema.ru
ozas.net openfrost.net
pammik.ru ordernorxx.com
panchro.co.uk osnova3.ru
pandarastore.top parajumpersstore.online
partner-cdn.men partybunny.ru
partnerworkroom.men pattersonsweb.com
paydayloanslocal.com perm-profnastil.ru
percin.biz.ly picmoonco.pw
petrovka-online.com pisanieprac.info
photosaga.info pizdeishn.com
porn-w.org pizza-tycoon.com
porno-chaman.info playmsn.com
pornohub.me playtap.us
pornonik.com pliks.pl
pornpost.in poiskzakona.ru
potoideas.us pokemongooo.ml
preventheadacheguide.info popup-hgd.xyz
profolan.pl pornstartits.xblog.in
prostitutki-kiev.org portal-eu.ru
prostitutki-tolyatti.org pregnant.guru
pukaporn.com projectforte.ru
pushdata.sendpulse.com pron.pro
pyramidlitho.webs.com pussyspace.net
pyrodesigns.com.au rankexperience.com
ranking2017.ga
ranksonic.org
rcb101.ru rcb101.ru
remorcicomerciale.ro rentehno.ru
rep-am.com
restaurantlescampi.com restaurantlescampi.com
ringtonepartner.com ritlweb.com
ros-ctm.ru robotixix.com
rusexy.xyz ruclicks.com
sbricur.com ruspdd.com
scanner-andrew.top rvi.biz
servethis.com scanner-josh.top
servicecenter.co.ua scanner-viktor.top
si-unique.com schoolfiles.net
sibecoprom.ru sdi-pme.com
sinestesia.host.sk seeingmeerkat.com
skylta.com seo-smm.kz
seobility.net
seoprofiler.com
seozoom.it
sexystrippe.info
shopwme.ru
sluganarodu.ru sluganarodu.ru
sobecjvuwa.com.ru snomer1.ru
socialbuttons.xyz snowplanes.com
songplanet.ru soietvousmaime.fr
space-worry.ml steelmaster.lv
stjamesschool.info stjamesschool.info
stpolice.com stoki.ru
supermesta.ru stretchingabuckblog.com
supermodni.com.ua stroicol.net
svarbit.com supers.com.ua
svetodiodoff.ru taximytishi.ru
tagil.zrus.org tizanidinestreetvalue.blogspot.com
tds-advert005.info
techart24.com
tehngr.ru
telesvoboda.ru
template-kid.com
theguardlan.com
thetoiletpaper.com
tizanidine6mg.blogspot.com
tizanidinehcl2mg.blogspot.com
tizanidinehcl2mgsideeffects.blogspot.com
tizanidinezanaflex.blogspot.com
tn811.us
tomck.com
topcar-krasnodar.ru
track.deriv.com
trk-4.net
truemfilelj.gq truemfilelj.gq
uhod-za-sobakoj.ru ukkelberg.no
ultimatesetnewfreeallsoftupgradesystems.pw unionmarkt.de
um-razum.ru unpredictable.ga
unlimitdocs.net urengoy.pro
upproar.com usacasino.com
uprour.com validccseller.com
uptimebot.net vbtracker.net
vabasa.inwtrade.com versaut.xxx-cam.webcam
vancleefreplica.pw viberdownload10.com
vedomstvo.net villakohlanta.nu
vereo.eu vitalads.net
videos-for-your-business.com vladhistory.com
vinylvault.co.uk we-are-gamers.com
voloomoney.com webjam.com
vvon.co.uk websites-reviews.com
w3javascript.com wfb.hatedriveapart.com
wallpapersdesk.info wingsoffury2.com
waterpurifier.club wjgony.com
waycash.net wpsecurity.website
webinstantservice.com www.solartek.ru
welcomeauto.ru xn----7sbbahaq9bb5afgiqfliv4m.xn--p1ai
winx-play.ru xn--oogle-wmc.com
womens-journal.net ytmnd.com
xev.ru zaapplesales.blogspot.com
xn--80aebbcbcdemfkhba4byaehoejh8dza3v.xn--p1ai zakon-ob-obrazovanii.ru
youandcredit.ru zigarettenonl.canalblog.com
yougame.biz znaniyapolza.ru
yourporngay.com znaturaloriginal.com
zed21.net
zone-kev717.info
zrelaya.pw

10
dev-tools/test_units/ratelimittest-beta.txt
View file

@ -581,14 +581,4 @@
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html> </html>

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.49 0; 10.1.0.124 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.09.3332 ### Version: V4.2022.09.3333
### Updated: Sun Sep 4 22:01:32 UTC 2022 ### Updated: Mon Sep 5 10:03:23 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.09.3332 ### Version: V4.2022.09.3333
### Updated: Sun Sep 4 22:01:32 UTC 2022 ### Updated: Mon Sep 5 10:03:23 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##