vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-02 18:50:13 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2022.08.3307 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2022-08-23 10:09:14 +00:00
parent 07944a0bbf
commit 60d9040358
47 changed files with 86403 additions and 86393 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.08.3306 #### Version: V4.2022.08.3307
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.08.3306 #### Version: V4.2022.08.3307
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -14,7 +14,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2022.08.3306 #### Version: V4.2022.08.3307
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

10664
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2022.08.3306 #### Version: V4.2022.08.3307
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

10668
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

10668
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

10668
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

10668
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.67 1; 10.1.0.130 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.67 0; 10.1.0.130 0;
127.0.0.1 0; 127.0.0.1 0;

10668
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.67 1; 10.1.0.130 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.67 0; 10.1.0.130 0;
127.0.0.1 0; 127.0.0.1 0;

10668
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.67 1; 10.1.0.130 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.67 0; 10.1.0.130 0;
127.0.0.1 0; 127.0.0.1 0;

10668
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
3306 3307

10668
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

10668
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.29.88.157 0; 20.230.35.69 0;

10668
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.67 1; 10.1.0.130 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.67 0; 10.1.0.130 0;
127.0.0.1 0; 127.0.0.1 0;

10668
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.67 1; 10.1.0.130 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.67 0; 10.1.0.130 0;
127.0.0.1 0; 127.0.0.1 0;

10668
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.67 1; 10.1.0.130 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.67 0; 10.1.0.130 0;
127.0.0.1 0; 127.0.0.1 0;

10668
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.29.88.157 0; 20.230.35.69 0;

10668
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.29.88.157 0; 20.230.35.69 0;

10668
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.67 1; 10.1.0.130 1;
127.0.0.1 1; 127.0.0.1 1;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
Crescent Majestic-SEO
Dotbot Octopus
GalaxyBot Openfind
Leap QueryN Metasearch
Libwhisker Whacker
Magnet Zermelo
RankActiveLinkBot ZumBot
VelenPublicWebCrawler arquivo.pt
Web Sauger cognitiveseo
WebSauger seobility

294
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
ALittle Client 01h4x.com
Abonti 360Spider
Aboundex 404enemy
Aboundexbot ADmantX
AfD-Verbotsverfahren
AhrefsBot
AiHitBot AiHitBot
Aipbot
Alexibot Alexibot
AllSubmitter
Alligator Alligator
AlphaBot
Anarchy Anarchy
Anarchy99 Anarchy99
Anthill
Aspiegel
Atomseobot Atomseobot
AwarioSmartBot Attach
BBBike BDCbot
BackStreet BDFetch
Backlink-Ceck BackDoorBot
Bandit
Barkrowler Barkrowler
BatchFTP
Bitacle Bitacle
Black Hole Blackboard
BlackWidow
BlowFish BlowFish
Boardreader Brandprotect
Bolt
Buck
Buddy Buddy
BunnySlippers BuiltBotTough
BuzzSumo BuzzSumo
CATExplorador CCBot
CODE87 CazoodleBot
CSHttp Cegbfeieh
Calculon
CheTeam CheTeam
CheeseBot
CherryPicker CherryPicker
Chlooe Chlooe
Claritybot Claritybot
Cogentbot Collector
Cosmos Copier
CyotekWebCopy Copyscape
DBLBot
DIIbot DIIbot
DSearch
DTS Agent DTS Agent
DataCha0s
Demon Demon
DigitalPebble
Dirbuster Dirbuster
Discoverybot Discoverybot
Dispatch
DittoSpyder DittoSpyder
DnBCrawler-Analytics
DomainCrawler
Domains Project
Dotbot
Drip Drip
ECCP/1.0 ECCP/1.0
EMail Siphon Ecxi
EasyDL EroCrawler
Ebingbong ExtractorPro
Evil Ezooms
Exabot FemtosearchBot
ExtLinksBot
FHscan
Fimap Fimap
Firefox/7.0 FlashGet
FrontPage
Fuzz
Fyrebot Fyrebot
GalaxyBot GalaxyBot
GermCrawler GermCrawler
GetRight
Getintent Getintent
Gotit Gigabot
GrapeshotCrawler Go!Zilla
GoZilla
Grabber
GridBot GridBot
HMView HTMLparser
HTTrack
Haansoft
HaosouSpider HaosouSpider
Harvest
Havij
Heritrix
HonoluluBot
HybridBot
IDBTE4M IDBTE4M
IDBot
IRLbot
Iblog Iblog
Id-search Id-search
IlseBot IndeedBot
Image Sucker
Indy Library
InfoNaviRobot InfoNaviRobot
InfoTekies InfoTekies
Intelliseek InternetSeer
Iria
IstellaBot IstellaBot
JOC Web Spider
JamesBOT
JennyBot
Jetty
Joomla Joomla
Keybot Translation-Search-Machine Jorgee
Jyxobot
Keyword Density
Kozmosbot
Lanshanbot Lanshanbot
Larbin LeechFTP
Leap
LeechGet LeechGet
Lftp LieBaoFast
Libwhisker Lightspeedsystems
Likse Likse
LinksManager LinkScan
LinkWalker
Linkbot
LinkextractorPro
LinqiaMetadataDownloaderBot LinqiaMetadataDownloaderBot
Lmspider Lmspider
Ltx71
MIDown tool MIDown tool
MIIxpc MJ12bot
MQQBrowser MQQBrowser
MSFrontPage
MTRobot MTRobot
Mag-Net Magnet
Majestic-SEO Majestic SEO
Majestic12
Masscan Masscan
Mata Hari Mb2345Browser
MauiBot Meanpathbot
MeanPath Bot MicroMessenger
MegaIndex.ru Minefield
Microsoft URL Control Msrabot
Mister PiX Musobot
Mr.4x3 NICErsPRO
Name Intelligence Name Intelligence
Nameprotect
Needle
Net Vampire
NetLyzer
NetSpider
Nettrack Nettrack
NextGenSearchBot NextGenSearchBot
Nibbler Nibbler
Nikto Nikto
NimbleCrawler
Ninja Ninja
Nmap Nmap
Not Not
Nuclei
Nutch Nutch
Octopus OnCrawl
OrangeSpider Openfind
Page Analyzer OutclicksBot
OutfoxBot
PHPCrawl
PageAnalyzer PageAnalyzer
Papa Foto
Pi-Monster Pi-Monster
Picsearch Picscout
PictureFinder
Piepmatz Piepmatz
Pimonster Pimonster
Pockey Pixray
ProPowerBot PyCurl
ProWebWalker
Psbot
Pump
Quick-Crawler Quick-Crawler
RankActive Re-re
RankFlex
ReGet
RealDownload
RebelMouse
Recorder
RedesScrapy
Ripper Ripper
SBIder SEOlyticsCrawler
SEOkicks SMTBot
SEOprofiler SalesIntelligent
SEOstats
SISTRIX
Scanbot Scanbot
ScoutJet ScoutJet
Scrapy
Screaming
ScrepyBot ScrepyBot
Searchestate Searchestate
Seekport Seekport
Semrush SemanticJuice
SeobilityBot SemrushBot
SiteCheckerBotCrawler SentiBot
Shodan
Siphon
SiteExplorer SiteExplorer
SiteLockSpider
SiteSnagger SiteSnagger
Sitebeam
Siteimprove Siteimprove
Sitevigil Sitevigil
SmartDownload
Snapbot Snapbot
SocialRankIOBot Snoopy
Sociscraper Sociscraper
Sogou web spider SpaceBison
Spammen Spammen
SpankBot SpankBot
Spinn3r
SputnikBot
Sqlmap Sqlmap
Stripper Sqlworm
T0PHackTeam Sqworm
Telesphorep Steeler
TheNomad SuperHTTP
Thumbor Surfbot
Tracemyfile Suzuran
Swiftbot
T8Abot
Teleport
Titan
Toata
Trendiction Trendiction
Trendictionbot
True_Robot
Turingos Turingos
TurnitinBot
UnisterBot UnisterBot
V-BOT V-BOT
Virusdie VCI
Vacuum
Vagabondo
VoidEYE VoidEYE
Voil
Voltron
WBSearchBot
WISENutbot
WWW-Collector-E
WWW-Mechanize WWW-Mechanize
WWW::Mechanize
WWWOFFLE
Wallpapers Wallpapers
WeSEE Wallpapers/3.0
Web Fuck Web Fetch
Web Pix
Web Sauger Web Sauger
Web Sucker Web Sucker
WebAuto WebAuto
WebCollage WebBandit
WebCopier
WebEnhancer WebEnhancer
WebFetch
WebFuck WebFuck
WebLeacher WebImageCollector
WebReaper
WebSauger WebSauger
WebStripper WebStripper
WebWhacker
Webalta Webalta
WebmasterWorldForumBot WebmasterWorldForumBot
Website Quester Website Quester
Whack Webster
Whacker Whacker
Who.is Bot Wotbox
Widow Xenu
WinHTTrack YoudaoBot
WiseGuys Robot Zade
Woobot
Wprecon
Zauba
Zitebot
ZoominfoBot
ZyBorg ZyBorg
arquivo-web-crawler adscanner
backlink-check cah.io.community
coccocbot
cognitiveseo cognitiveseo
demandbase-bot crawler4j
domainsproject.org
heritrix
internetVista monitor internetVista monitor
ips-agent
isitwp.com isitwp.com
lwp-trivial iubenda-radar
linkdexbot
meanpathbot meanpathbot
mediawords mediawords
pcBrowser s1z.ru
plumanalytics satoristudio.net
probe-image-size seocompany.store
ripz
scalaj-http
seoscanners seoscanners
siteripz serpstatbot
sogouspider sogouspider
sp_auditbot sysscan
trendiction.com trendiction.com
trendiction.de webmeup-crawler
voyagerx.com webpros.com
webprosbot
x22Mozilla
xpymep1.exe xpymep1.exe
zauba.io

300
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
01h4x.com
404enemy 404enemy
80legs 80legs
AIBOT AIBOT
Acunetix ALittle Client
AhrefsBot ASPSeek
Anarchie Anarchy99
Ankit Ankit
Apexoo
Aspiegel Aspiegel
Asterias
Atomseobot
Attach Attach
BackDoorBot AwarioRssBot
Barkrowler AwarioSmartBot
BatchFTP BLEXBot
BlackWidow Backlink-Ceck
BlowFish BacklinkCrawler
Badass
Bandit
Battleztar Bazinga
BetaBot
Black Hole
Blackboard
Boardreader Boardreader
BotALot BotALot
Brandprotect
Buck
Buddy Buddy
BuiltBotTough
BunnySlippers
BuzzSumo BuzzSumo
CCBot
CSHttp CSHttp
Claritybot ChinaClaw
Citoid
Cogentbot
Copier Copier
CopyRightCheck CopyRightCheck
Crawling at Home Project Copyscape
CyotekWebCopy Cosmos
DBLBot Craftbot
DIIbot CrazyWebCrawler
DTS Agent
DataCha0s DataCha0s
DatabaseDriverMysqli DatabaseDriverMysqli
Deusu
Digincore Digincore
DigitalPebble DigitalPebble
Dirbuster
Disco Disco
Discobot
Discoverybot
Dispatch Dispatch
DnyzBot DnyzBot
DomainCrawler DomainAppender
DomainSigmaCrawler
Domains Project
Dotbot Dotbot
Download Wonder Drip
Dragonfly
ECCP/1.0 ECCP/1.0
EMail Wolf EMail Siphon
EasyDL Ebingbong
Ecxi
Evil
Exabot Exabot
ExtractorPro Express WebPictures
Ezooms Extractor
Firefox/7.0 FDM
Fimap
FlashGet FlashGet
Fuzz Foobot
FyberSpider GalaxyBot
Genieo Genieo
GermCrawler GermCrawler
GetWeb GetRight
Getintent
Gigabot Gigabot
Go-Ahead-Got-It Go!Zilla
GoZilla Gotit
GrabNet GrabNet
GridBot GrapeshotCrawler
HEADMasterSEO
HTMLparser HTMLparser
HTTrack Haansoft
HaosouSpider HaosouSpider
Heritrix
Hloader Hloader
Humanlinks HonoluluBot
HybridBot IDBTE4M
IDBot
IRLbot
Id-search Id-search
IlseBot Image Fetch
Image Sucker
IndeedBot
Indy Library Indy Library
InfoNaviRobot InfoTekies
InterGET InternetSeer
Iria Iria
Joomla Iskanie
Jorgee JOC Web Spider
JamesBOT
Jbrofuzz
JetCar
JikeSpider
JustView JustView
Keybot Translation-Search-Machine
Keyword Density Keyword Density
Kozmosbot Kozmosbot
LWP::Simple
Lanshanbot Lanshanbot
Larbin
Leap Leap
LeechGet LeechGet
Lftp Lftp
LibWeb LibWeb
LinkScan LinkWalker
LinkextractorPro LinqiaRSSBot
LinkpadBot LinqiaScrapeBot
LinqiaMetadataDownloaderBot
Litemage_walker Litemage_walker
Lmspider Lmspider
MIDown tool MIDown tool
MJ12bot Mag-Net
Magnet
Mail.RU_Bot Mail.RU_Bot
Majestic12 Majestic SEO
MarkWatch MarkWatch
Mata Hari Masscan
MauiBot MauiBot
Mb2345Browser Mb2345Browser
MegaIndex.ru Microsoft Data Access
Metauri
MicroMessenger
Mister PiX
Moblie Safari
Mojeek
Mojolicious
Morfeus Fucking Scanner Morfeus Fucking Scanner
Mozlila Msrabot
Mr.4x3 NPbot
NetAnts Nameprotect
Net Vampire
NetMechanic NetMechanic
Netcraft Netvibes
Niki-bot
Nikto Nikto
Nimbostratus NimbleCrawler
Not Ninja
Nuclei
Nutch Nutch
OnCrawl OnCrawl
Openvas Openvas
OrangeBot
OutfoxBot
PECL::HTTP PECL::HTTP
POE-Component-Client-HTTP POE-Component-Client-HTTP
PageAnalyzer PageAnalyzer
PageThing.com PageThing.com
Pandalytics Pandalytics
Papa Foto
Pavuk Pavuk
Pi-Monster Pi-Monster
Picsearch
Piepmatz Piepmatz
Pimonster Pimonster
Pixray
Pu_iN
Pump
QueryN Metasearch
Quick-Crawler Quick-Crawler
RankActive RSSingBot
RankActiveLinkBot RankFlex
RankingBot Rankivabot
RankingBot2 Re-re
RankurBot Reaper
RebelMouse RebelMouse
Recorder RedesScrapy
Ripper
RocketCrawler RocketCrawler
SBIder SBIder
SEOlyticsCrawler
SEOstats SEOstats
ScanAlert
ScoutJet ScoutJet
Scrapy ScreenerBot
Screaming SearchmetricsBot
Searchestate
Seekport Seekport
SemanticJuice SemanticJuice
Semrush
SeoSiteCheckup SeoSiteCheckup
SeobilityBot
Shodan
Siphon
SiteCheckerBotCrawler
SiteLockSpider
Site Sucker Site Sucker
Sitebeam SiteCheckerBotCrawler
SiteSnagger
Siteimprove Siteimprove
Sitevigil Sitevigil
Sociscraper SmartDownload
Snapbot
SocialRankIOBot
Sogou web spider Sogou web spider
Sosospider Sosospider
Sottopop SpaceBison
Spammen
Spanner Spanner
Spinn3r Spbot
Sqlmap SputnikBot
Sqlworm Steeler
Sqworm
Stripper
Sucuri
SuperHTTP
Surfbot Surfbot
SurveyBot Swiftbot
T0PHackTeam
T8Abot T8Abot
Teleport Telesphorep
Telesoft The Intraformant
TheNomad
Thumbor Thumbor
Titan Trendiction
Tracemyfile
Turnitin
TurnitinBot
TwengaBot TwengaBot
Twice
UnisterBot UnisterBot
VB Project Upflow
VCI VCI
Vacuum Vagabondo
VeriCiteCrawler VoidEYE
VidibleScraper Voil
Voltron
WISENutbot WISENutbot
WPScan
WWW-Mechanize WWW-Mechanize
WWW::Mechanize WWW::Mechanize
WWWOFFLE Wallpapers
Wallpapers/3.0 Wallpapers/3.0
Web Collage
Web Enhancer Web Enhancer
Web Pix Web Fuck
WebAuto Web Sucker
WebCopier WebEnhancer
WebFuck
WebGo IS
WebImageCollector WebImageCollector
WebPix
WebSauger WebSauger
WebStripper
WebWhacker WebWhacker
WebZIP WebsiteExtractor
Webalta
WebmasterWorldForumBot
Webshag
Website Quester
WebsiteQuester
Webster Webster
Whack Whacker
Widow Whatweb
Who.is Bot
WinHTTrack
Wprecon Wprecon
Zade Zade
Zitebot Zermelo
ZoominfoBot Zeus
archive.org_bot ZyBorg
arquivo-web-crawler
autoemailspider autoemailspider
check1.exe cah.io.community
cognitiveseo coccocbot
com.plumanalytics crawler4j
crawl.sogou.com eCatch
crawler.feedback instabid
dataforseo.com ips-agent
heritrix isitwp.com
lwp-request iubenda-radar
lwp-trivial magpie-crawler
muhstik-scan meanpathbot
page scorer netEstate NE Crawler
plumanalytics polaris version
probe-image-size ripz
serpstatbot satoristudio.net
seobility
seostar
sitechecker.pro sitechecker.pro
siteripz sogouspider
sp_auditbot spyfu
trendiction.com tAkeOut
trendiction.de
ubermetrics-technologies.com ubermetrics-technologies.com
webpros.com
webprosbot
x09Mozilla x09Mozilla
x22Mozilla xpymep1.exe
zauba.io

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
abctoppictures.net cartierbraceletsreplica.pw
cialischstgerts.com e2click.com
mrsdalloways.com eachdayisagift.review
posible.net gamevalue7.weebly.com
prizesbook.online hoztorg-opt.ru
saneyes.com internet-apteka.ru
tizanidinehcl4mgtabinfo.blogspot.com ix20.ru
validccseller.com more-letom.ru
xdoza.com moviezbonkerssk.cf
yellowfootprints.com studiofmp.com

926
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
1000n1.ru 00author.com
12masterov.com 101billion.com
1adult.com 1millionusd.xyz
2itech.ru 2020iscoming.info
2nt.ru 214jaluwobapef.cf
3-letter-domains.net 2rich4bitches.com
3weekdiet.com 2x2fan.ru
57883.net 4rent.ru
888.com 7minuteworkout.com
aac500b7a15b2646968f6bd8c6305869d7.com 999webdesign.com
aac52006ec82a24e08b665f4db2b5013f7.com 9med.net
adamoads.com abcdeg.xyz
ads.tremorhub.com actulite.com
advancedmassagebysara.com ad-words.ru
advokat-grodno.by addbin.men
adzerg.com adktrailmap.com
affiliate-fr.com adminshop.com
agardomains.com adobereader-free.ru
aksonural.ru adultfullhd.com
allblogroll.com afmuseum.com
alt-servis.ru afora.ru
alta-realestate.com afslankpillen2017nl.eu
alvtank.se agahinameh.com
ahrntal.verymes.xyz
akvamaster.dp.ua
alkoravto.ru
all-number.com
all-streaming-media.com
alldownload.pw
allpdfmags.net
aloofly.com
amateurlivechat.org
amazingninja.com
ameblo.top ameblo.top
ample-awards-today.us amehdaily.com
an-donut.com amospalla.es
analnoeporno.tv android-systems.ru
ananumous.ru apelsinnik.website
apccargo.com apple.com-webbrowsing-security.review
apessay.com apxeo.info
arabsexxxtube.com arabsexxxtube.com
atleticpharm.org arate.ru
audiobangout.com arenda-yeisk.ru
autorn.ru arendakvartir.kz
autoseo-traffic.com artparquet.ru
aviapanda.ru ascat.porn
avtocredit-legko.ru asdfz.pro
asia-forum.ru
asscenihotosidea.blogspot.co.za
asseenontv.ru
automobile-spec.com
avek.ru
aviav.org
aviav.ru.com
avramstroy.ru
azinoofficial777.ru
babosas.com
bagcionderlab.com bagcionderlab.com
bbtec.net baixar-musicas-gratis.com
bedandbreakfast.com beauby.ru
bestcalovebracelet.cn bestcalovebracelet.cn
besthomemadepornsites.com bestfortraders.com
bestpornuha.com bestmarriages.com
bget.ru beyan.host.sk
birzha-truda.eu bif-ru.info
bjgugu.net.ua bigcareer.info
bimatoprost-careprost.com
bird1.ru
biznesrealnost.ru
bjorkbacken.nu
blackhatworth.com
blackle.com blackle.com
blog.remote-computer.de blog.axant.it
blog.yam.com blogrankers.com
blpmovies.com blue-square.biz
board.f00d.de bongiornos.info
boobsimge.com bookhome.info
boole.onlinewebshop.net
bouda.kvalitne.cz
breastaugmentation.co.za breastaugmentation.co.za
brus-vsem.ru briomotor.co
buchananshardware.com brokergid.ru
budilneg.xyz buehne-fuer-menschenrechte.de
bukleteg.xyz burkesales.com
burger-tycoon.com buron.pw
businesn.men
business-made-fun.com business-made-fun.com
butstrap.space c-gainsbourg.com
buyantiviralwp.com cactussoft.biz
buyfriend.ru cakesplus.com.au
byme.se callstevens.com
cartierlove2u.com candycrushshop.com
cartiertrinity.xyz canzoni.ru
cashkitten-a.akamaihd.net capture-room.com
cashonads.com cardul.ru
cete.ru cartierlovestore.xyz
cartujano-pre.de
catalogs-parts.com
cdncash.com
celebsopics.com
centre-indigo.org.ua
chatroulette.life
cheap-trusted-backlinks.com cheap-trusted-backlinks.com
chidporn.com cheapjerseysa.com
cialgenisrx.com chinajerseyswholesalecoupons.com
citetick.com chorus.terakeet.com
clicksotrk.com cigarpass.com
club-samodelkin.ru cineacademy.ru
cntravelre.com clayvasedesigns.tk
coaching-netz.info clean-start.net
cocolyze.com clickpapa.com
coin-hive.com clipartnew.com
compliance-checker-7.info cobaltpro.ru
compliance-don.xyz compiko.info
compliance-irvin.xyz compliance-jane.top
compliance-walter.top conboy.us
confib.ifmo.ru cookingmeat.ru
coolwallpapers-hd.com coolbar.pro
coop-gamers.ru coop-gamers.ru
cosmetic.donna7753191.ru copyrightclaims.org
counter.bloke.com covid-schutzmasken.de
crackzplanet.com crystalslot.com
creditmoney.com.ua cs-passion.pl
culad.com
d-black.bz
dalavia.ru dalavia.ru
dandiyabeats.in damedingel.ya.ru
danschawbel.com daretodonate.co
daymusam.com deanmoore.ie
detki-opt.ru demenageur.com
dimfour.com detmebel.su
dktr.ru dignitasdata.se
dolohen.com dirtpics.pw
domaincdn.xyz dneprsvet.com.ua
dominterior.org domaincrawler.com
downloadmefiranaratb1972.xpg.com.br dostavka-v-krym.com
downtuptv.gq
draniki.org draniki.org
dscaas.website drunkenstepfather.com
dumpsmania24.com duawitchrarato.tk
e-avon.ru e90post.com
easytuningshop.ru eets.net
ecommerce-seo.com elektrozigarette1.dreamwidth.org
educatemetv.com embedle.com
ege-essay.ru enews.tech
eksprognoz.ru enhand.se
elektrischeziga.livejournal.com esnm.ru
elitepcgames.com essay-writing.work
emailaccountlogin.co eu-cookie-law.blogspot.com
enthuse.computernetworksonline.com eurosamodelki.ru
ereko.ru evening-dating-club.info
esfchat.tk evidencecleanergold.com
esopini.com ezigarettekaufen1.hpage.com
estelight.ru ezigarettenshop2.postbit.com
evehemming.blogspot.com.au ezigaretteshop.webs.com
expdom.com f1nder.org
eyes-on-you.ga factorynightclub.com
ezigaretteshop2.vefblog.net fashion.stellaconstance.co
ezofest.sk fastcrawl.com
fanrto.com faz99.com
fantasticpixcool.com fbdownloader.com
farm26.ru ferretsoft.com
fastfixing.tech fetishinside.com
fatmaelgarny.com fickkontaktehobbyhuren.com
favornews.com filesclub.net
fearcrow.com fillmewithhappiness.com
ferieboligkbh.dk
firstdrugmall.ru
flagcounter.me flagcounter.me
flprog.com forums.d2jsp.org
fok.nl fotosfotos.eu
foodgid.net frcls.fr
fordsonmajbor.cf free-fb-traffic.com
forex-indextop20.ru freemags.cc
forpackningsutveckling.se freesitetest.com
frankofficial.ru fres-news.com
freelifetimefuckbook.com frighteningremain.cf
frvo.alptandem.ru frivgame250.com
fuckbuddybestgilf.info fuckmill.com
funtoonez.com fusoradio.info
fx-brokers-review.com gdebestkupit.ru
gamerscorps.com ge0ip.com
gaz-voshod.ru gilsonchiro.xyz
gdzkurokam.ru
genericviagrasildenafiled.net
get-your-social-buttons.info
gigapeta.com
girlsatgames.ru
given2.com
gktt.ru gktt.ru
glasof.es globatur.ru
glogow.pl golden-catalog.pro
gobongo.info gonextmedia.com
grand-chlen.ru googglet.com
greatidea.marketing googlemare.com
guardlink.org googlepositions.com
guge.io googleseo.com.tr
gymi.name gribokstop.com
hasfun.com gsasearchengineranker.space
hasshe.com gsasearchenginerankerdiscount.com
hatedriveapart.com gtopstats.com
hdapp1008-a.akamaihd.net guidefs.ru
heliko.no haikuware.com
herokuapp.com hamacapty.com
hesteel.pl handsandlegs.ru
himazin.info hanwei.us
himgaws.pw hd720kino.ru
hjaoopoa.top hdpixent.com
hkladys.com hdwalls.xyz
homeinns.com hentaiheroes.com
hotxnights.info herehloadibs.cf
howlongdoestizanidinestayinyoursystem.blogspot.com hermesbracelets.xyz
hspline.com hledejvshopech.cz
ilmexico.com home.myplaycity.com
images.gyffu.com homik.pw
imagez.co host-protection.com
iminent.com hotblognetwork.com
immobiliaremassaro.com incolors.club
impisr.edunsk.ru indianmedicaltourismshop.com
infobabki.ru infostatsvc.com
infoupdate.org inspiring-desperate.tk
interfucks.net internetproviderstucson.com
invivo.hu irkutsk.zrus.org
iqbazar.ru isoveti.ru
isistaylorporn.info itservicesthatworkforyou.com
itch.io ixora.pro
japan-bearings.ru james13prix.info
jav-fetish.com janerikholst.se
jav-way.site jav-fetish.site
javrip.net javatex.co.id
kalb.ru javspace.net
jjbabskoe.ru
jo24news.com
kalandranis.gr
kamalsinha.com
karachev-city.ru karachev-city.ru
kinky-fetishes.com keyhantercume.com
kino-filmi.com
kinocccp.net
kinoduh.ru
kinogolos.ru kinogolos.ru
kinoplen.ru
kinopolet.net
kinozapas.com
kiskinhouse.com kiskinhouse.com
kit-opt.ru kndxbkdx.bloger.index.hr
klikbonus.com kol-energo.ru
kongruan.com kongoultry.net
konica.kz kosynka-games.ru
krafte.ru krasivye-devushki.net
krasnodar.ru kvartira-sutochno.com
ku6.com larose.jb2c.me
kung-fu-ru.com larutti.ru
lanadelreyfans.us leboard.ru
larchik.net ledpolice.ru
lawyers.cafe letmacworkfaster.site
letsart.ru liffa.ru
letslowbefast.site likesuccess.com
letsrepair.in likrot.com
lflash.ru lineshops.biz
li-er.ru liver-chintai.org
lida-ru.com localflirtbuddies.com
lidoradio.com localmatchbook.com
lietaer.com lockerz.com
lion.bolegapakistan.com loftdigital.eu
livingroomdecor.info loginduepunti.it
locatellicorretor.com.br louboutinshoes.xyz
lollypopgaming.com lovasszovetseg.hu
louisvuittonoutletstore.net lubetube.com
luxmagazine.cf m.b00kmarks.com
macotool.com m3gadownload.pl
macresource.co.uk mahnwachen-helfen.info
magnetic-bracelets.ru makis.nu
mail.allnews24.in malls.com
mainlinehobby.net managerpak204.weebly.com
maju.bluesalt.co maranbrinfo.com.br
makedo.ru marmotstore.online
masturbate.co.uk masserect.com
mathgym.com.au
matpre.top
max-eclat.men max-eclat.men
max-p.men maxxtor.eu
medanestesia.ru mcnamaratech.com
medicine-4u.org metafilter.com
medtherapy.ru metaxalonevstizanidine.blogspot.com
meget.co.za meteocast.net
meltwater.com michaelkorsoutlet.store
michaelkorsoutletstore.net mikrobiologies.ru
militarysale.pro millionare.com
mini-modus.ru mitrasound.ru
mistr-x.org moesonce.com
mmofreegames.online
mockupui.com
monclerboots.xyz
monclercoats.xyz monclercoats.xyz
monetizer.com-01.site moncleroutletonline.xyz
monsterdivx.tv moonci.ru
montazhnic.ru motherboard.vice.com
moscow.online-podarki.com muizre.ru
moviemail-online.co.uk mulberryoutletonlineeu.com
mowser.com music.utrolive.ru
mrbojikobi4.biz musicspire.online
mrsdalloways.com my-bc.ru
mtmtv.info
musirc.com
mvpicton.co.uk
my-cash-bot.co my-cash-bot.co
myhealthcare.com mydirtyhobby.com
mypornfree.ru mypets.by
naturalpharm.com.ua napalm51.nut.cc
negral.pluto.ro netallergy.ru
net-radar.com news-speaker.com
nfljerseyscheapbiz.us newstraveller.ru
nibbler.silktide.com niki-mlt.ru
nikkiewart.ru
nina.az nina.az
nofreezingmac.work notaria-desalas.com
novodigs.com nullrefer.com
nrv.co.za o-o-6-o-o.com
oakridgemo.com obnal.org
obiavo.uz obsessionphrases.com
oconto.ru of-ireland.info
office2web.com ofanda.com
oil-td.ru okayimage.com
ok.ru okroshki.ru
onclickpredictiv.com
onefilms.net onefilms.net
online-sbank.ru onlineku.com
onlinefilmz.net openmediasoft.com
onlinemegax.com openstat.com
ordernorxx.com orhonit.com
orenburg-gsm.ru ozoz.it
orion-code-access.net paighambot.com
ourville.info panchro.xyz
owohho.com paradontozanet.ru
oxford-book.com.ua pattersonsweb.com
oynat.info pechikamini.ru
pacificair.com perfectplanned.com
painting-planet.com perfectpracticeweb.com
paramountmarble.co.uk perso.wanadoo.es
partnerads.men pics-group.com
pawli.eu picswe.com
pdns.cz pigrafix.at
percin.biz.ly pizda.lol
perosan.com pkr1hand.com
pestomou.info play.leadzupc.com
photo-clip.ru playboyfiles.xblog.in
photosaga.info
picquery.com
pinwallpaper.top
pirateday.ru
pixelrz.com
pizza-imperia.com
playlott.com
pliks.pl pliks.pl
pogruztehnik.ru polytopesexempt.com
pons-presse.com pornogratisdiario.com
popunder.net pornoklad.net
popunder.ru pr0fit-b0x.com
popup-fdm.xyz prchecker.info
popup-hgd.xyz pricheskaonline.ru
porn-w.org
pornobrazzers.biz
pornogig.com
pornotubs.com
pourvous.info
pretty-mart.com
priceg.com
printdirectforless.com
privatefx.all4invest.info
privetsochi.ru
pro-tec.kz
prodess.ru
proekt-gaz.ru proekt-gaz.ru
professionaldieselcare.com profitfx.online
profitkode.com profolan.pl
proftests.net pussyfleet.com
promodj.com puteshestvennik.com
pron.pro qor360.com
qpypcx.com
questionmarque.ch
quick-offer.com quick-offer.com
rainbowice.ru quizzitch.net
rankia.com ragecash.com
razorweb-a.akamaihd.net rangjued.com
rcpmda.ikan1080.xyz rank-checker.online
relayblog.com ranksonic.info
remont-fridge-tv.ru rarbg.to
remote-dba.de rating-casino2021.ru
rfserial.net rebrand.ly
riralmolamsaca.tk recipedays.ru
risparmiocasa.bz.it redirectingat.com
rollercoin.com reimageplus.com
relatodelpresente.com.ar
remont-komputerov-notebook.ru
remont-ustanovka-tehniki.ru
rep-am.com
replicaclub.ru
research.ifmo.ru
reward-survey.net
ribieiendom.no
ringtonepartner.com
rique.host.sk
robot-forex.biz
roma-kukareku.livejournal.com roma-kukareku.livejournal.com
rubanners.com romhacking.ru
rusprostitute.com rossmark.ru
russia-today-video.ru rvi.biz
rvzr-a.akamaihd.net rvtv.ru
s1z.ru saveindex.xyz
sack.net scanner-donald.top
sammyweaver.com scanner-jane.top
sankt-peterburg.nodup.ru search-error.com
sape.top searchlock.com
scalerite.co.za semalt.com
scanner-andrew.top semxiu.com
scanner-fred.top seocdvig.ru
scmor.ilxc.cc seoexperimenty.ru
searchtooknow-a.akamaihd.net serpstat.com
secret.xn--oogle-wmc.com sex-dating.co
servethis.com sex-pr.net
servisural.ru
sexad.net sexad.net
sexflirtbook.com
sexsaoy.com
sextracker.de
sexvporno.ru sexvporno.ru
sexyali.com ship-marvel.co.ua
shakhtar-doneck.ru shmetall.com.ua
sharpchallenge.com shoesonlinebuy.cn
shillyourcoins.com shohanb.com
shopperifymac.com shopfishing.com.ua
sigmund-freud.co.uk
signal03.ru signal03.ru
sisi-go.ru siteimprove.com
sisiynas.ru
site5.com
skypasss.com skypasss.com
slkrm.ru sladkoevideo.com
snegozaderzhatel.ru slimcdn.com
soc-proof.su small-game.com
social-buttons.com sobecjvuwa.com.ru
social-s-hhh.xyz socas.pluto.ro
socialbookmarksubmission.org socialbuttons.xyz
socialmonkee.com socialmadesimple.com
sockshare.net socialseet.ru
sodexo.com softtor.com
songplanet.ru solicita.info
soserfis.com souvenirua.com
sotechco.co specialfinanceoffers.com
spanking.to spyfu.com
spidtest.space spymac.net
sport7777.net spywarenuker.com
sps-shop.com standardchartered-forex.com
spy-sts.com starpages.net
starwars.wikia.com statustroll.com
stats-public.grammarly.io sterva.cc
steelmaster.lv stjamesschool.info
stop-zavisimost.com stroyplus.ru
strv.se suhanpacktech.com
styro.ru superkanpo.com
sumo.com svbur.ru
sundrugstore.com swinger-mobil.net
supermama.top swinon.site
supernew.org tarad.com
superoboi.com.ua tattooha.com
sureone.pro
svarbit.com
svensk-poesi.com
symbaloo.com
syvertsen-da.no
szamponrevita.pl
tabakur77.com
takeprofitsystem.com
tako3.com
tastyfoodideas.com
tds-advert002.info tds-advert002.info
teenporn18.net tech4master.com
telefonsex-ohne0900.net tedxrj.com
terrafootwear.us the-torrent-tracker.blogspot.com
testbotprocessor44.com thedownloadfreeonlinegames.blogspot.com
thefds.net thefds.net
theplacetoupdating.pw thegolfclub.info
themestotal.com
thewebsitetemplate.info
tivolibasket.it tivolibasket.it
tizanidineandcipro.blogspot.com tizanidine4mguses.blogspot.com
tizanidineinteractions.blogspot.com tizanidineduringpregnancy.blogspot.com
tizanidinevssoma.blogspot.com tizanidineforopiatewithdrawal.blogspot.com
tizanidinewithdrawal.blogspot.com tizanidinehcl2mg.blogspot.com
tizanidinezanaflex.blogspot.com tizanidinepain.blogspot.com
top-deal.com.pl tomatis.gospartner.com
torrentdownloadhub.com tonivedu.it
track-rankings.online toon-families.com
track2.shop toondinsey.com
trkdf.com top10registrycleaners.com
tubeline.biz topcar-krasnodar.ru
uginekologa.com tracklead.net
traffic2cash.org
trafficmonetize.org
trafficnetzwerk.de
trahic.ru
trailer.cinemaflix.website
ttrraacckkrr.com
ttsq.fr
tula.mdverey.ru
turkeyreport.tk
tvorozhnaja-zapekanka-recept.ru
twinderbella.com
ukkala.xyz
ukkelberg.no ukkelberg.no
ukr-lit.com undergroundcityphoto.com
ukrobstep.com univerfiles.com
ukrup.com unrealcommander.com
umekana.ru uprour.com
unmaroll.ya.ru uptime-gamma.net
uptime-alpha.net
urlcut.ru
v-doc.co v-doc.co
vacuumcleanerguru.com
validccseller.com
valmetrundan.se
valuado.com
varbergsvind.se varbergsvind.se
vbabule.net
verymes.xyz
viberdownload10.com
video-chat.love video-chat.love
video-woman.com videochat.bz
videochat.mx virus-schutzmasken.de
vids18.site vladimir.zrus.org
vkak.ru vmnmvzsmn.over-blog.com
vkmusics.ru volume-pills.biz
voloslove.ru voronezh.xrus.org
vote-up.ru wait3sec.org
vozbujdenie.com
wallpaperaccess.com wallpaperaccess.com
walpaperlist.com wanker.us
watchinf.com wapsite.me
watchmygf.net wardreapptokone.tk
weblo.com we-are-gamers.com
wemedinc.com webextract.profound.net
westvilletowingservices.co.za weprik.ru
wetgames.ru whatistizanidine2mg.blogspot.com
whatsappbot.flyland.ru whengirlsgowild.com
wholesalejerseychinashop.com whiteelephantwellington.com
win-spy.com wholinkstome.com
wordkeyhelper.com wineration.com
wpsecurity.website wingsoffury2.com
xep.info winner7777.net
xgames-04.com womama.ru
xn-----6kccaibs5cb8afhjrfmix2n.xn--p1ai wosik-dach.service-for-web.de
xn--80aanaardaperhcem4a6i.com writersgroup580.web.fc2.com
xn--80ajjbdhgmudixfjc8c5a9df8b.xn--p1ai xbaboon.com
xn--b1adccaf1bzj.xn--p1ai xblognetwork.com
xn--h1aakne2ba.xn--p1ai xgftnlrt.bloger.index.hr
xxx-cam.webcam xn--80ak6aa92e.com
xxx-treker.ru xvideospornoru.com
xxxmania.top yoshkarola.zrus.org
xxxrus.org youdesigner.kz
yogamatsexpert.com yourmovies.pl
youbloodyripper.com youtuhe.com
yourdesires.ru zakazvzloma.com
zajm-pod-zalog-nedvizhimosti.ru zaloadi.ru
zdesformula.ru zarajbuilders.com
zeroredirect2.com zeroredirect.com
zhorapankratov7.blogspot.com zigarettenonlinekaufen1.bloog.pl
znakomstva-moskva77.ru zoogdisany.com
zscalerone.net zreloeporno.tv

486
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
00go.com 08800.top
03e.info 0n-line.tv
0c47f8422d3f.com 1008.su
101billion.com
123any.com 123any.com
123kuma.com 214jaluwobapef.cf
178evakuator178.ru 2itech.ru
3th.co.in 2pxg8bcf.top
57883.net 4k-player.pl
adhome.biz aa9d046aab36af4ff182f097f840430d51.com
adman.gr aaronabel.com
adsloads.com academiacsmendoza.org
adtiger.tk adimmix.com
affiliate-fr.com admanaerofoil.com
animali.deagostinipassion.it adpremium.org
arkkivoltti.net ads-seo.men
autobudpostach.club advokat-grodno.by
backgroundpictures.net aero2.ru
beauty-clinic.ru agapovdg.ru
beget.tech ahmedabadwebs.com
beta.hotkeys.com air-edem.ru
bio.trade-jp.net albamargroup.com
blogqpot.com algerianembassy.co.in
bouda.kvalitne.cz alive-ua.com
allforminecraft.ru
alphavisions.net
ameblo.top
amigobulls.com
animal36.com
anmysite.com
arclk.net
aviav.org
bankofthewext.com
bestplacetobuyeriacta.jw.lt
bitcoinremote.com
bizru.info
blackcurranthumidifiers.site
blockworld.ru
bmw-ark.ru
bnt-team.com
bobba.dzaba.com
bosefux.esy.es
brains2.biz brains2.biz
brakehawk.com brewdom.ru
brateg.xyz buigas.00it.com
buchananshardware.com celejihad.info
buqyxa.rincian.info chcu.net
buscarfoto.com cheap-trusted-backlinks.com
buypillsorderonline.com cheapsergiorossi.online
cablecar.us chocolateslim-u-srbiji.com
camdenmemorials.com com-secure.download
cardiosport.com.ua compliance-brian.top
carsdined.org cpajunkies.com
cfcl.co.uk cypernhuset.se
chinaelitecheapjerseys.com dailystrength.org
chocoslim.pro dame-ns.kz
cinemaflix.website detective01.ru
citetick.com detsky-nabytek.info
cjs.com.ru digital-video-processing.com
clodo.ru dolohen.com
collegeessay19.blogspot.ru dvd-famille.com
comsysnet.com easyukraine.com
constantaservice.net educatemetv.com
cosmetic.donna7753191.ru
cowblog.fr
cracksplanet.com
crystalslot.com
cupday.com
customcatchcan.com
cyclobenzaprinevstizanidine.blogspot.com
darkages.info
data.vtc.pw
davebestdeals.com
dekorkeramik.ru
delfin-aqua.com.ua
deutschland123.de
dimaka.info
divatraffic.com
doeco.ru
domaineaneblanc.com
drugs-no-rx.info
dumpsmania24.com
dumuelave.xyz
ekobata.ru
errorfixing.space errorfixing.space
etotupo.ru eshop4u.jp
ewebarticle.info everypony.ru
ezaz.info exonline.info
ezigaretteshop.webs.com facialporntube.com
f07.de fanpagerobot.com
femmesdenudees.com filmfanatic.com
findthe.pet
finstroy.net
fm-upgrade.ru
foodcrafts.website
fordsonmajbor.cf
forex-indextop20.ru forex-indextop20.ru
forum20.smailik.org funcrushgames.com
freakycheats.com g33.org
freeuploader.com gallerily.com
freshmac.space gambarkataku.co
freshwallpapers.info gamewrath.com
fxgallery.com gcup.ru
gavuer.ru gettpromos.com
getlaid-xxxhookupdirect.com getyourimage.club
ggiaro.com gidonline.one
ghernnqr.skyrock.com glall.ru
gifspics.com glicol.kz
growshop.es gogalleryawesome.com
guiadeserraazul.com google-liar.ru
hahashka.ru gotcher.us
help.tpu.ru gq-catalog.gq
hotchatdate.com greenzaim.ru
iblogpress.xyz growboxbl.ru
ibmdatamanagement.co guge.io
guigyverpo.cf
gz2.bbsoldes.fr
handsandlegs.ru
hasfun.com
hdwalls.xyz
hidefiles.org
hidemyass.com
histats.com
hostnow.men
hulfingtonpost.com
humanelydrew.com
ido3.com ido3.com
ihc2015.info infazavr.ru
ikritikimou.gr itsdp3.com
incolors.club ivearchenceinflu.cf
indetiske.ya.ru japfm.com
internet-apteka.ru javrip.net
iradiology.ru javspace.net
istizanidineanopiate.blogspot.com jeremyeaton.co
javidol.site jetsli.de
javstock.com junketjuice.blogspot.com
johnnyhaley.top jurajskie.info
jwss.cc justucalling32211123456789.tk
kaz.kz kakablog.net
ketrzyn.pl keywesthideaways.co
kinozapas.com keywordglobal.co.za
klejonka.info keywords-monitoring-your-success.com
knigonosha.net kmgamex.cf
kreativperlen.ch kosova.de
kupiproday.com.ua krasnodar-avtolombards.ru
leadwayau.com likesdesign.com
lescinq.com linkpulse.com
letmacwork.world lion.misba.us
lexaprogeneric.link lion.playtap.us
lexixxx.com littlesexdolls.com
lezbiyanki.net littlesunraiser.com
limtu.ifmo.ru locimge.pw
liupis.com lolnex.us
liveinternet.ru lombardfinder.ru
loginduepunti.it louboutinbooties.xyz
lollypopgaming.com lowephotos.info
lonfon.xyz lsex.xyz
lottospring.com magazintiande.ru
louboutinshoes.xyz manualterap.roleforum.ru
louisvuittonoutletstore.net mebelcomplekt.ru
ltvperf.com missis.top
lunchrock.co moivestiy.biz
machicon-akihabara.info monsterdivx.com
marketland.ml morefastermac.trade
med-zdorovie.com.ua morocco-nomad-excursions.com
methodsmarketing.com most-kerch.org
microsoftportal.net musezone.su
mil-stak.com my-bc.ru
mindbox.co.za mysex21.com
monetizer.com-01.site netoil.no
musicspire.online next-dentists.tk
muycerdas.xxx obnal.org
muzaporn.com of-ireland.info
myftpupload.com online.ktc45.ru
myplaycity.com onlinebay.ru
myshopmatemac.com openfrost.com
nastydollars.com orsonet.ru
neodownload.webcam ostroike.org
new7ob.com paradontozanet.ru
northfacestore.online
o-o-6-o-o.com
offer.camp
offside2.5v.pl
oneclickfiles.com
onlinemegax.com
openstat.com
optikremont.ru
parajumpersjakkesalgnorge.info parajumpersjakkesalgnorge.info
parfusale.se park.above.com
pendelprognos.se parlament.biz
pliks.pl paydayloanslocal.com
poptool.net pcboa.se
porn555.com petitions.whitehouse.gov
pornhive.org phrcialiled.com
pornonik.com picanalyzer.data-ox.com
pr-ten.de picmoonco.pw
pravoholding.ru pivka.xyz
priora-2.com pizza-tycoon.com
pro-poly.ru popup-hgd.xyz
profitsport.club porngalleries.top
pronorm.fr pornoted.com
prpops.com portal-eu.ru
quebec-bin.com portnoff.od.ua
raisedseo.com privatefx-in.ru
rankscanner.com prize44.com
rating-casino2021.ru profitwithalex.info
remontgruzovik.ru promover.org
ribieiendom.no pulseonclick.com
royal-betting.net q-moto.ru
rukino.org redirectme.net
rusprostitute.com rimedia.org
ryetaw.com ros-ctm.ru
sajatvelemeny.com saltspray.ru
saugatuck.com salut-camp.ru
schalke04fc.info sc-specialhost.com
sdelai-prosto.ru scanner-irvin.top
semp.net scanner-willy.top
service-core.ru scoopquest.com
sevenstars7.com searchimpression.com
sextracker.be securesmrt-dt.com
shop.xz618.com seo18.su
sildenafilcitratemed.com seoexperimenty.ru
slayerlife.com serialsway.ucoz.ru
sms2x2.ru sextracker.de
soc-econom-problems.ru sexy-screen-savers.com
softxaker.ru shoesonlinebuy.cn
solution4u.com sim-service.net
space4update.pw sirpornogratis.xxx
spywareit.com site-auditor.online
starwars.wikia.com slavkokacunko.de
sureone.pro sluganarodu.ru
susanholtphotography.com solinf.co
tasteidea.com songplanet.ru
tfxiq.com spinnerco.ca
timeallnews.ru studiofmp.com
tizanidine4mgstreetprice.blogspot.com suture.co
tizanidinecost.blogspot.com tampabaywatch.org
tizanidinedosage.blogspot.com taraz.xkaz.org
tizanidineingredients.blogspot.com tattomedia.com
tk-assortiment.ru texbaza.by
token-lab.org thebestphotos.eu
topanasex.com threecolumnblogger.com
topcasinoratings.ru tizanidine4mgtablets.blogspot.com
traffpartners.com tizanidinemusclerelaxant.blogspot.com
trainoffend.ml tizanidinepills.blogspot.com
trichizobswiv.agddns.net tmtrck.com
twu.com.ua toon-families.com
uchil.net top10-online-games.com
uhodzalijami.ru topappspro.com
urll.eu tour-line.net
uvozdeckych.info traffixer.com
vacances-voyages.info turbodsp.com
video-chat.cn twodollarshows.com
videogamesecrets.com u555u.info
videos-for-your-business.com unrealcommander.org
uptimebot.net
vbabule.net
vbtracker.net
vchulkah.net
viberdownload10.com
video-woman.com
videosbox.ru videosbox.ru
virus-respirators.com vodaodessa.com
voloslove.ru w-journal.ru
vote-up.ru warezkeeper.com
vtcdns.com whatsupinfoley.com
wahicbefa31.soup.io whiteproduct.com
watchmyfb.pl winwotgold.pl
webadvance.club wygraj-skiny.win
webix.me xblog.in
wingsofrefuge.net xn--1-8sbcpb0bdm8k6a.xn--p1ai
wleuaprpxuvr.ga xn--lifehacer-1rb.com
works.if.ua ynymnwbm.bloger.index.hr
wosik-dach.service-for-web.de yoshkarola.zrus.org
wowas31.ucoz.ru yottos.com
wzgyyq.com ypmuseum.ru
xev.ru zapatosenventa.info
xn------7cdbapdecfd4ak1bn0amjffj7afu3y.xn--p1ai zigarettenonlinekaufen2.drupalgardens.com
xn----7sbaaabaei0cc8aj5bj0bncejx.xn--p1ai zkjovpdgxivg.ga
xn--80aaagvmjabrs1aoc9luc.xn--p1ai zlatnajesen.com
xn--80ahvj9e.xn--p1ai
xtraffic.plus
xuki.us
yginekologa.com
youghbould.wordpress.com
youjizz.vc
yoursearch.me
zaobao.com.sg
zastenchivosti.net
zone-kev717.info

10
dev-tools/test_units/ratelimittest-beta.txt
View file

@ -581,4 +581,14 @@
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html> </html>

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.67 0; 10.1.0.130 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.08.3306 ### Version: V4.2022.08.3307
### Updated: Mon Aug 22 22:01:19 UTC 2022 ### Updated: Tue Aug 23 10:03:26 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.08.3306 ### Version: V4.2022.08.3307
### Updated: Mon Aug 22 22:01:19 UTC 2022 ### Updated: Tue Aug 23 10:03:26 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##