vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-10 06:15:06 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2022.08.3277 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2022-08-08 10:09:18 +00:00
parent 470515a01f
commit 8c77b15c85
47 changed files with 84436 additions and 84426 deletions
Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.08.3276 #### Version: V4.2022.08.3277
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.08.3276 #### Version: V4.2022.08.3277
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -14,7 +14,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2022.08.3276 #### Version: V4.2022.08.3277
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

10418
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2022.08.3276 #### Version: V4.2022.08.3277
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

10422
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

10422
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

10422
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

10422
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.27 1; 10.1.1.69 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.27 0; 10.1.1.69 0;
127.0.0.1 0; 127.0.0.1 0;

10422
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.27 1; 10.1.1.69 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.27 0; 10.1.1.69 0;
127.0.0.1 0; 127.0.0.1 0;

10422
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.27 1; 10.1.1.69 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.27 0; 10.1.1.69 0;
127.0.0.1 0; 127.0.0.1 0;

10422
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
3276 3277

10422
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

10422
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.110.96.135 0; 52.170.90.19 0;

10422
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.27 1; 10.1.1.69 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.27 0; 10.1.1.69 0;
127.0.0.1 0; 127.0.0.1 0;

10422
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.27 1; 10.1.1.69 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.27 0; 10.1.1.69 0;
127.0.0.1 0; 127.0.0.1 0;

10422
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.27 1; 10.1.1.69 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.27 0; 10.1.1.69 0;
127.0.0.1 0; 127.0.0.1 0;

10422
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.110.96.135 0; 52.170.90.19 0;

10422
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.110.96.135 0; 52.170.90.19 0;

10422
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.27 1; 10.1.1.69 1;
127.0.0.1 1; 127.0.0.1 1;

18
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
Extractor Domains Project
Go!Zilla Larbin
Libwhisker Metauri
Majestic-SEO Microsoft Data Access
ScreenerBot Niki-bot
WISENutbot Recorder
WebPix Site Sucker
Sitebeam
Vagabondo
crawler4j crawler4j
gopher
tAkeOut

288
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
01h4x.com
360Spider
404checker 404checker
80legs
ADmantX ADmantX
ASPSeek
Aboundex Aboundex
Acunetix AfD-Verbotsverfahren
AiHitBot
AllSubmitter AllSubmitter
Alligator Alligator
AlphaBot AlphaBot
Anarchie
Anarchy Anarchy
Anarchy99
Ankit
Anthill Anthill
Apexoo Apexoo
Asterias Attach
AwarioRssBot
BBBike
BDFetch BDFetch
BLEXBot Backlink-Ceck
BacklinkCrawler
Badass
BatchFTP
BetaBot BetaBot
BlackWidow
Blackboard Blackboard
Blow Blow
BlowFish
Bolt
BotALot BotALot
Brandprotect Brandprotect
Brandwatch
Buck Buck
BuiltBotTough BunnySlippers
Bullseye BuzzSumo
CCBot
Calculon Calculon
CherryPicker CherryPicker
Chlooe Citoid
Cliqzbot Cliqzbot
Cocolyzebot Cocolyzebot
Cogentbot Cogentbot
CopyRightCheck Copier
Craftbot
CrunchBot
Curious Curious
Custo
CyotekWebCopy CyotekWebCopy
DBLBot
DIIbot
DSearch
DataCha0s DataCha0s
Demon DatabaseDriverMysqli
Devil Dirbuster
Disco Disco
Discobot
Dispatch Dispatch
DittoSpyder DittoSpyder
DnBCrawler-Analytics DnBCrawler-Analytics
DomainAppender DomainSigmaCrawler
DomainCrawler DomainStatsBot
Dotbot
ECCP/1.0 ECCP/1.0
EMail Siphon EMail Siphon
EMail Wolf EMail Wolf
ExtLinksBot Ecxi
ExtractorPro EroCrawler
Exabot
Extreme Picture Finder
Ezooms Ezooms
FHscan
FemtosearchBot
Fimap Fimap
FlashGet Fuzz
FyberSpider GT::WWW
GermCrawler Genieo
GetWeb GetRight
Go!Zilla Getintent
Grabber Grabber
Grafula
GrapeFX GrapeFX
GridBot
HEADMasterSEO
HTMLparser
HTTP::Lite HTTP::Lite
Haansoft HTTrack
HaosouSpider
Harvest
Havij Havij
Hloader
HonoluluBot
HybridBot
IDBTE4M
IDBot IDBot
Iblog Id-search
InfoNaviRobot Image Fetch
Image Sucker
Intelliseek Intelliseek
InternetSeer Iskanie
Iria
IstellaBot
JOC Web Spider
JamesBOT JamesBOT
JennyBot Jbrofuzz
JetCar JikeSpider
Jetty Joomla
Jorgee Jyxobot
JustView
Keybot Translation-Search-Machine Keybot Translation-Search-Machine
Kozmosbot Keyword Density
LNSpiderguy LNSpiderguy
LWP::Simple LWP::Simple
Lanshanbot Lanshanbot
Larbin
Leap Leap
LeechGet LeechGet
LexiBot LibWeb
Likse Likse
LinkWalker LinkWalker
Linkbot LinkextractorPro
LinksManager LinqiaScrapeBot
LinqiaMetadataDownloaderBot Lmspider
LinqiaRSSBot MIIxpc
MFC_Tear_Sample MJ12bot
MIDown tool MQQBrowser
MSIECrawler MSIECrawler
MTRobot
Mag-Net
Magnet
Mail.RU_Bot Mail.RU_Bot
Majestic SEO Majestic SEO
Majestic-SEO
Majestic12 Majestic12
MarkMonitor MarkMonitor
Masscan Mata Hari
MeanPath Bot MeanPath Bot
Metauri Mediatoolkitbot
Microsoft Data Access MegaIndex.ru
Minefield Microsoft URL Control
Mister PiX
Moblie Safari
Mojeek Mojeek
Mojolicious Mojolicious
MolokaiBot
Mozlila Mozlila
Mr.4x3 Msrabot
NPbot NPbot
Navroad Navroad
Needle
NetAnts NetAnts
NetLyzer NetSpider
NetMechanic
Netcraft Netcraft
Netvibes Nettrack
Nibbler Nikto
Not Nimbostratus
Nuclei Octopus
Offline Explorer
OnCrawl OnCrawl
Openfind OpenVAS
OrangeSpider OrangeSpider
OutfoxBot PECL::HTTP
POE-Component-Client-HTTP POE-Component-Client-HTTP
PageGrabber PageAnalyzer
PageScorer PageThing.com
Pandalytics
Panscient Panscient
Papa Foto
Pavuk Pavuk
Petalbot PeoplePal
Picsearch Picscout
Pimonster Pimonster
Pixray
Pockey Pockey
Probethenet ProPowerBot
Psbot Psbot
Pu_iN
QueryN Metasearch
RankFlex RankFlex
RankurBot RankingBot
ReGet RankingBot2
Reaper Reaper
Recorder Recorder
RepoMonkey SEOkicks
RocketCrawler
SEOkicks-Robot SEOkicks-Robot
SEOlyticsCrawler
SEOstats SEOstats
ScanAlert SMTBot
Scanbot SalesIntelligent
Screaming Seekport
ScreenerBot
ScrepyBot
SemanticJuice
Semrush Semrush
SentiBot
SeobilityBot
Seomoz Seomoz
Shodan Shodan
SiteCheckerBotCrawler SiteCheckerBotCrawler
SiteLockSpider
SiteSucker
Sitevigil Sitevigil
SmartDownload SmartDownload
Snake
Sociscraper Sociscraper
Sogou web spider Sogou web spider
SpaceBison Spammen
SpankBot SpankBot
Sqlmap SputnikBot
Sqlworm
Sucker Sucker
Sucuri Sucuri
SuperBot
SurveyBot SurveyBot
Swiftbot T0PHackTeam
T8Abot
Teleport Teleport
The Intraformant TeleportPro
TheNomad TheNomad
Thumbor TightTwatBot
Titan
Toweyabot
Trendictionbot Trendictionbot
TurnitinBot True_Robot
Typhoeus
URLy.Warning URLy.Warning
UnisterBot
Upflow Upflow
Vacuum V-BOT
VidibleScraper VB Project
Voil VeriCiteCrawler
WBSearchBot VoidEYE
WEBDAV WASALive-Bot
WWW-Mechanize WWW::Mechanize
WWWOFFLE WallpapersHD
Wallpapers Web Auto
WeSEE Web Fetch
Web Enhancer Web Fuck
Web Sauger Web Pix
WebBandit
WebCollage
WebEnhancer WebEnhancer
WebSauger WebLeacher
WebPix
WebStripper WebStripper
Website Quester Webalta
WebmasterWorldForumBot
Webshag
WebsiteExtractor
WebsiteQuester
Webster
Whack
Whacker Whacker
WiseGuys Robot
Wonderbot Wonderbot
Wotbox Woobot
Xaldon WebSpider Wprecon
Xaldon_WebSpider
YoudaoBot
Zauba Zauba
Zeus
ZmEu
ZoominfoBot
adscanner
archive.org_bot
arquivo.pt arquivo.pt
backlink-check autoemailspider
cah.io.community cah.io.community
clark-crawler cognitiveseo
dataforseo.com crawler4j
domainsproject.org
eCatch eCatch
evc-batch
facebookscraper facebookscraper
gopher
heritrix
instabid instabid
internetVista monitor
ips-agent ips-agent
linkdexbot iubenda-radar
magpie-crawler lwp-request
mediawords
muhstik-scan muhstik-scan
oBot oBot
probe-image-size page scorer
pcBrowser
satoristudio.net satoristudio.net
seobility seoscanners
seostar sogouspider
serpstatbot spyfu
siteripz
sp_auditbot
sysscan sysscan
trendiction.com tAkeOut
webmeup-crawler trendiction.de
webprosbot voyagerx.com
x09Mozilla webpros.com
x22Mozilla xpymep1.exe

312
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
01h4x.com 360Spider
404checker Abonti
404enemy Acunetix
ALittle Client AhrefsBot
AfD-Verbotsverfahren AiHitBot
Aipbot Aipbot
Anarchie
Anarchy Anarchy
Ankit Ankit
Atomseobot Anthill
Aspiegel
Asterias
Attach Attach
BBBike BBBike
BackDoorBot BDCbot
BackStreet BLEXBot
Backlink-Ceck BackWeb
Badass Badass
Bandit
BatchFTP
Battleztar Bazinga Battleztar Bazinga
BetaBot Black Hole
BlackWidow BlackWidow
Blackboard Bolt
BlowFish Brandprotect
Boardreader Buddy
BuiltWith BuiltBotTough
Bullseye Bullseye
BunnySlippers CATExplorador
Cegbfeieh CODE87
CensysInspect
ChinaClaw
Chlooe Chlooe
Citoid Citoid
Cliqzbot Cliqzbot
Cloud mapping Cloud mapping
Cocolyzebot Collector
Copier Copier
CopyRightCheck
Copyscape
Cosmos
Crawling at Home Project
CrazyWebCrawler CrazyWebCrawler
Curious Crescent
DBLBot DBLBot
DIIbot DSearch
Demon DTS Agent
DataCha0s
Devil Devil
Disco Disco
Discobot
Discoverybot Discoverybot
Dispatch DittoSpyder
DnyzBot DnyzBot
DomainAppender DomainAppender
DomainStatsBot Dotbot
Domains Project Dragonfly
ExtLinksBot ECCP/1.0
EMail Siphon
EMail Wolf
Ecxi
EroCrawler
Extractor Extractor
EyeNetIE
Ezooms Ezooms
FDM
FHscan
FemtosearchBot FemtosearchBot
Firefox/7.0 Fimap
FlashGet Foobot
Flunky Fuzz
G-i-g-a-b-o-t
GT::WWW GT::WWW
GalaxyBot
Genieo Genieo
GrabNet GermCrawler
GrapeshotCrawler GetWeb
Go!Zilla
Grafula
GridBot GridBot
HMView
Haansoft
Harvest Harvest
Havij
Hloader
HonoluluBot HonoluluBot
HybridBot HybridBot
IDBot Image Sucker
Iblog InternetSeer
Internet Ninja Iskanie
IstellaBot
JOC Web Spider JOC Web Spider
Jbrofuzz
Jetty
JikeSpider JikeSpider
Joomla
Jorgee Jorgee
JustView
Kenjin Spider
Keyword Density Keyword Density
Kinza LWP::Simple
Kozmosbot Leap
Lanshanbot LieBaoFast
LexiBot Lightspeedsystems
Lftp
Likse Likse
LinkScan LinkScan
LinkWalker LinkWalker
LinkextractorPro LinkextractorPro
LinksManager
LinqiaRSSBot LinqiaRSSBot
Lipperhey LinqiaScrapeBot
Lipperhey Spider
Litemage_walker
Lmspider Lmspider
MFC_Tear_Sample
MIIxpc MIIxpc
MJ12bot
MSIECrawler
Magnet Magnet
Mass Downloader Mail.RU_Bot
Majestic-SEO
MarkMonitor
Mata Hari Mata Hari
MauiBot
Mb2345Browser Mb2345Browser
Meanpathbot Meanpathbot
Mediatoolkitbot
Metauri
MicroMessenger
Microsoft Data Access Microsoft Data Access
Microsoft URL Control Mister PiX
Minefield MolokaiBot
NearSite Mr.4x3
Msrabot
NPbot
Nameprotect
Needle
Net Vampire Net Vampire
NetAnts NetAnts
NetLyzer
NetSpider
NetZIP NetZIP
Nettrack
Netvibes Netvibes
Niki-bot
NimbleCrawler
Not
Nutch
Offline Explorer Offline Explorer
Offline Navigator Offline Navigator
OnCrawl
OpenLinkProfiler OpenLinkProfiler
OpenVAS PECL::HTTP
Openfind PHPCrawl
OrangeBot
OutfoxBot
POE-Component-Client-HTTP
PageGrabber
PageScorer PageScorer
PageThing.com PictureFinder
Panscient
Papa Foto
PeoplePal
Picsearch
Pimonster
Pixray
PleaseCrawl PleaseCrawl
ProWebWalker
Probethenet
Pump
PyCurl
QueryN Metasearch
RankActive RankActive
RankingBot
RankingBot2 RankingBot2
Rankivabot Rankivabot
RankurBot RankurBot
RebelMouse Re-re
Ripper ReGet
RealDownload
RedesScrapy
RepoMonkey
SBIder
SEOlyticsCrawler
SEOprofiler SEOprofiler
SEOstats
SISTRIX SISTRIX
SMTBot ScanAlert
SalesIntelligent
Scanbot Scanbot
ScoutJet
Screaming Screaming
ScreenerBot Seekport
SeobilityBot Semrush
Siphon Shodan
Site Sucker
SiteCheckerBotCrawler
SiteExplorer
SiteLockSpider SiteLockSpider
SiteSnagger Sitebeam
SiteSucker Siteimprove
SmartDownload
Snake Snake
Snapbot
Snoopy Snoopy
Sosospider Sosospider
SpaceBison Sottopop
Spammen SpankBot
Spanner Sqlworm
Sqlmap Sqworm
Steeler
Stripper Stripper
Sucker Sucuri
SuperBot
SuperHTTP
Surfbot
SurveyBot
Suzuran Suzuran
Swiftbot Szukacz
T0PHackTeam Telesphorep
T8Abot TheNomad
TeleportPro Toweyabot
Telesphoreo
The Intraformant
Thumbor
Tracemyfile
Trendiction
True_Robot True_Robot
Turingos Turnitin
TwengaBot TurnitinBot
Twice
Typhoeus Typhoeus
UnisterBot URLy.Warning
VB Project Upflow
VCI
Vacuum Vacuum
Vagabondo VoidEYE
VelenPublicWebCrawler Voil
VeriCiteCrawler
Voltron Voltron
WISENutbot WEBDAV
WPScan WWW-Collector-E
WWW-Mechanize WWW-Mechanize
WWWOFFLE
Wallpapers/3.0 Wallpapers/3.0
WallpapersHD
Web Auto Web Auto
Web Collage WebEnhancer
Web Enhancer WebFetch
Web Fuck
Web Sucker
WebCollage
WebFuck
WebGo IS
WebImageCollector WebImageCollector
WebPix WebLeacher
WebStripper WebWhacker
WebZIP
Webshag Webshag
WebsiteQuester
Webster Webster
Whacker Woobot
Who.is Bot Wprecon
WinHTTrack Xenu
Xaldon WebSpider
Xaldon_WebSpider
Zade Zade
Zauba Zeus
ZmEu Zitebot
ZoominfoBot
ZyBorg ZyBorg
archive.org_bot adscanner
arquivo.pt backlink-check
autoemailspider
cah.io.community cah.io.community
com.plumanalytics check1.exe
crawl.sogou.com domainsproject.org
demandbase-bot facebookscraper
eCatch heritrix
evc-batch instabid
gopher
internetVista monitor
isitwp.com
iubenda-radar iubenda-radar
linkdexbot linkdexbot
lwp-request
magpie-crawler magpie-crawler
meanpathbot
mediawords
muhstik-scan muhstik-scan
oBot
page scorer
pcBrowser pcBrowser
polaris version
ripz ripz
s1z.ru
satoristudio.net
scalaj-http scalaj-http
scan.lol seobility
seostar seocompany.store
serpstatbot seoscanners
siteripz sexsearcher
sogouspider
sysscan sysscan
tAkeOut tAkeOut
trendiction.com
trendiction.de trendiction.de
webgains-bot ubermetrics-technologies.com
voyagerx.com
webmeup-crawler
webpros.com webpros.com
x09Mozilla x09Mozilla
x22Mozilla zauba.io
zgrab

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
alert-hgd.xyz adobereader-free.ru
amateurgalls.com bongiornos.info
betune.onlinewebshop.net coop-gamers.ru
dealitright.click get-free-social-traffic.com
diminishedvalueoforegon.com kadashihotel.com
freesitetest.com m3gadownload.pl
pearlisland.ru relax.ru
rockingclicks.com rvzr-a.akamaihd.net
rome2rio.com torrentred.games
tonivedu.it vzlom-na-zakaz.com

934
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
007angels.com 03p.info
01apple.com 0c47f8422d3f.com
1000n1.ru 1webmaster.ml
11235813.webzdarma.cz 202ch.com
12u.info 214jaluwobapef.cf
1pamm.ru 23kw.ru
1xbet4you.com 28n2gl3wfyb0.ru
2015god.org 2x2fan.ru
21h2o.com 5ws.dating-app.ru
4senses.co 8gold.com
5forex.ru 8jn.dating-app.ru
70casino.online 999webdesign.com
7zap.com
9icmzvn6.website 9icmzvn6.website
DomainStatsBot aa625d84f1587749c1ab011d6f269f7d64.com
a96527gi.beget.tech abwa.tk
aa08daf7e13b6345e09e92f771507fa5f4.com
abclauncher.com
acads.net acads.net
activecampaign.dreamhosters.com addblueoff.com.ua
acunetix-referrer.com adf.ly
addbin.men adhome.biz
adktrailmap.com adult3dgames.com
adserver-e7.com adultfullhd.com
adsfresh.men advancedmassagebysara.com
adsloads.com adverster.com
adultfriendfinder.com advokat-grodno.by
advokateg.ru
advokateg.xyz
afslankpillen2017nl.eu afslankpillen2017nl.eu
ahmedabadwebs.com agadelha.com.br
airlandsea.info agecheckadult.com
aktobe.xkaz.org agysya.ru
akuhni.by ahrefs.com
alborzan.com akusherok.ru
alert-fdm.xyz albamargroup.com
allknow.info alfa-medosmotr.ru
allpdfmags.net alibestsale.com
alta-realestate.com alienwheel.es
anaksma.info aliexpresscashback.club
anaseracresar.tk alif-ba-ta.com
anatomiy.com allbizne.co.ua
angel1777.kz alldubai.biz
allstatesugarbowl.org
aloofly.com
alphavisions.net
alt-servis.ru
anime.dougasouko.com anime.dougasouko.com
anjalika.co.in anticrawler.org
aosheng-tech.com apartmentbay.ru
apilinkswiftco-a.akamaihd.net apiportalmorecom-a.akamaihd.net
apimossnetinfo-a.akamaihd.net aquarium-pro.ru
appartement-stumm.at arate.ru
applicationg29.com
architecturebest.com
arendatora.ru arendatora.ru
asseenontvonline.ru arkartex.ru
aussie-prizes.com arquapetrarca.info
auto.rusvile.lt arraty.altervista.org
autonew.biz aruplighting.com
avirasecureserver.com asseenontv.ru
avto-oligarh.ru atelielembrancaqueencanta.com.br
avtocredit-legko.ru atout-energie-69.com
azazaporn.com ausergrubhof.info
azlex.uz autovideobroadcast.com
bad-stars.net avek.ru
baditri.com aviav.eu
baixar-musicas-gratis.com avkzarabotok.info
balla-boo.se azartmix.com
banan.tv babespcs.com
bannerspace.com babs.com.ua
beachdriveblog.com babyfactory.fr
beetpics.pw badavit.com.ua
best-deals-products.com bag77.ru
bestadbid.com barbourjackets.online
besthomemadepornsites.com barnfurnituremart.com
bestmarriages.com beachtoday.ru
bestmobilityscooterstoday.com bestchoice.cf
bestofferswalkmydogouteveryday.gq bestofpicture.com
beta.hotkeys.com bestofupload.info
betune.onlinewebshop.net bestsexyblog.com
betwinservice.com betonka.pro
beyan.host.sk bezsporno.ru
bigcities.org bingoporno.com
bio-market.kz bizzliving.com
bitporno.sx
bjanshee.ru
bjgugu.net.ua
blacktwhite.com
blobar.org blobar.org
blog-hits.com blog.yam.com
blogs.rediff.com blogporn.in
bobba.dzaba.com bobba.dzaba.com
boeuklad.com bobinoz.com
bongacams.com bocoarchives.org
bonvillan.com book-bets.com
boostmyppc.com bravegirlsclub.com
bosefux.esy.es brokergid.ru
brainsandeggs.blogspot.com btvn.ru
bristolhostel.com bvlgariring.xyz
brus.city byme.se
butstrap.space c1.onedmp.com
buydissertation.net cakemediahq.com.au
buzzurl.jp calstaterealty.us
call-of-duty.info camel-beach.com
callawaygolfstore.online cand.jp
candlehandmade.com cartierreplica.xyz
carina-sy.de cdn.walkme.com
cars-modification.net cdncash.net
cartierbraceletsreplica.pw chatroulette.world
cayado.snn.gr
ccjp.eu
cheapcigarettesc.info
chee-by.biz
cialischmrx.com cialischmrx.com
cialisndbrx.com cialischstgerts.com
clipartnew.com cindymatches.com
clippingphotoindia.com ciproandtizanidine.blogspot.com
compliance-george.top citizenclsdriveri7.pen.io
compliance-jessica.top click2pawn.com
cosmetic.donna7753191.ru comeondog.info
counter.yadro.ru computernetworksonline.com
covid-schutzmasken.de contentsexpress.com
coolbar.pro
coprofam.org
courtshipgift.com
cpabegins.ru
craftinsta.ru craftinsta.ru
customboxes4less.com credit.co.ua
date-withme.com creditmoney.com.ua
dating-app.ru creditnation.ru
db.speedup.gdn customchocolate.business-for-home.com
ddlmega.net customsua.com.ua
deniven.1bb.ru cypernhuset.se
czeshop.info
danschawbel.com
defenderxtactical.com
dekorkeramik.ru
design-ideas.info design-ideas.info
dfwu1013.info detsky-nabytek.info
digital-video-processing.com dev.citetick.com
devochki.top
dikx.gdn dikx.gdn
directivepub.com diminishedvalueoforegon.com
dirtpics.pw discovertreasurenow.com
djihispano.com dmmspy.com
dktr.ru dodlive.mil
domoysshop.ru domain-submit.info
dood.live dorratex.tn
doyouknowtheword-flummox.ml doska-vsem.ru
drillsaw.ru dostavimvdom.ru
droidlook.net dostavka-v-krym.com
dvervmoskvu.ru dostavka-v-ukrainu.ru
e2click.com drugspowerstore.com
duplicashapp.com
dwomlink.info
e-kwiaciarz.pl
earl-brown.info earl-brown.info
earn-from-articles.com editmedios.com
education-cz.ru
ekaterinburg.xrus.org
ekosmetyki.net.pl ekosmetyki.net.pl
ekspertmed.com ekto.ee
elektrischezigarette1.blog.pl energy-ua.com
elektrischezigarette2.devhub.com eng-lyrics.com
elektronischezigarette2.mex.tl enge-fotzen.info
elidelcream.weebly.com erotiktreff24.info
enginebay.ru
enthuse.computernetworksonline.com
erotag.com
eshop.md eshop.md
essay-writing.work evogarage.com
evaashop.ru exchangeit.gq
expdom.com excitacao.com
eywords-monitoring-your-success.com exoneration-project.us
f00kclan.de extractorandburner.com
feorina.ru extremal-blog.com
eyessurgery.ru
farmprofi.net
fenoyl.batcave.net
ff30236ddef1465f88547e760973d70a.com ff30236ddef1465f88547e760973d70a.com
figuringmoneyout.com financetip.eu
filesdatabase.net findpics.pw
find1friend.com fingerprintjs.com
finteks.ru floating-share-buttons.com
fireads.men
firstdrugmall.ru
fiuxy.com
flirt4free.com
floridahuntingfishingadventures.com
floridamobilebillboards.com floridamobilebillboards.com
flprog.com fotoxxxru.com
forpostlock.ru freakycheats.com
forum.doctissimo.fr free-share-buttons.top
forum.poker4life.ru fuckmill.com
frameimage.org gagrasector.ru
frankofficial.ru gambarxkata.co
freshsuperbloop.com gamezblox.com
fxtips.ru gaming-journal.com
fxund.us gamingspark.com
fyl.com.ru gazoblok.net.ua
gamerscorps.com geileweiber.tk
gay-site.store get-your-social-buttons.info
gayxperience.com getlamborghini.ga
gazobeton-p.com.ua
get-free-social-traffic.com
getpopunder.com getpopunder.com
gettpromos.com getresponse.com
gg.zzyjxs.com girlsatgames.ru
gheus.altervista.org glass-msk.ru
ghostvisitor.com
girlspicsa.com
glall.ru
glasof.es
golden-praga.ru golden-praga.ru
googlemare.com google-liar.ru
gopixdatabase.com googlepositions.com
graphicwe.org graphicwe.org
handicapvansarea.com graphid.com
hausfrauensex18.com greatidea.marketing
headpress.ru gsasearchenginerankerdiscount.com
healbio.ru guiadeserraazul.com
guigyverpo.cf
hahashka.ru
hanink.biz.ly
happy.new.yeartwit.com
hdapp1008-a.akamaihd.net
hdfreeporno.net
hdimagegallery.net
hdimagelib.com
healmytrauma.info
health-medical-portal.info health-medical-portal.info
hermesbirkinhandbagoutlets.com hidemyass.com
holidaypics.org homeart.space
homemature.net hotgirlhdwallpaper.com
hotblog.top hotloans.ru
hotelcrocenzi.sm housediz.com
hothot.ru howtoclean.club
hotkeys.com i-service.kz
hotsocialz.com idc.com.ua
hoverboard360.nl igithab.com
howlongdoestizanidinestayinyoursystem.blogspot.com imk.com.ua
hyiphunter.org infobanks.ru
hystersister.com infostatsvc.com
iccornacircri.cf iomoio.net
idealtits.net iqoption.com
igru-xbox.net irkutsk.online-podarki.com
images-graphics-pics.com isotoner.com
inclk.com istanbulit.com
infowarcraft.ru istizanidineacontrolledsubstance.blogspot.com
investyb.com ixora.pro
jacago.com janerikholst.se
javrip.net jav-fetish.site
jus0wil.pp.ua jestr.org
jwcialislrt.com jimmychoosale.online
karpun-iris.ru jmat.cn
kaz.kz jrcigars.com
kazan.zrus.org kaac.ru
kambasoft.com
keyhantercume.com
keywordsdoctor.com keywordsdoctor.com
keywordsking.com keywordspay.com
kimcurlrvsms.com khadastoafarde.tk
kinostorm.net kichenaid.ru
knowsitall.info kino-key.info
kolotiloff.ru kinocccp.net
koral.se kinofak.net
koronirealestate.gr kinozapas.org
kosova.de kleine-titten.biz
krynica.info konteiner24.com
ktotut.net koopilka.com
kursy-ege.ru kotaku.com
kvartiry-remont.ucoz.ru krafte.ru
ladsup.com krassh.ru
languagecode.com kreativperlen.ch
lankarns.com labelwater.se
laptop-4-less.com lacapilla.info
larutti.ru lanadelreyfans.us
lapitec.eu
laulini.soclog.se laulini.soclog.se
lawyers.cafe le-clos-des-alouettes.com
light.ifmo.ru lechenie-gemorroya.com
lidoradio.com
likrot.com likrot.com
lineavabit.it lineshops.biz
lirunet.ru lion.misba.us
livefixer.com liran-locks.com
liverpool.gsofootball.com livingroomdecor.info
lmrauction.com locatellicorretor.com.br
ltvperf.com loftdigital.eu
luciddiagnostics.in lol-smurfs.com
m1media.net longadventure.com
madot.onlinewebshop.net louboutinreplica.pw
malwareremovalcenter.com lovasszovetseg.hu
manifestation.betteroffers.review luxup.ru
mansparskats.com machicon-akihabara.info
marcogrup.com macotool.com
mb140.ru magicdiet.gq
mcar.in.ua makis.nu
mebelcomplekt.ru mantramusic.ru
mebeldekor.com.ua maximpartnerspr.com
meetlocalchicks.com mbiologi.ru
mega-polis.biz.ua meccadumps.net
mejoresfotos.eu meet-flirt-dating.com
meteocast.net mielec.pl
meteostate.com milblueprint.com
mexicotravelnet.com mir-betting.ru
misterjtbarbers.com mmoguider.ru
mnimmigrantrights.net mnogabukaff.net
mole.pluto.ro mojpregled.com
monarhs.info monclercoats.xyz
monsterdivx.tv monetizationking.net
moscow.xrus.org moneymaster.ru
motherboard.vice.com mrbitsandbytes.com
moviezbonkerssk.cf mrbojikobi4.biz
mowser.com musicpro.monster
mp3films.ru muztops.ru
multgo.ru my-floor.in.ua
musicdaddy.net mybackgroundlandscape.blogspot.com
muycerdas.xxx mydownlodablefiles.com
myfreemp3.eu mygameplus.com
myhitmp3.club myyour.eu
nagdak.ru mzdish.site
nash-krym.info namecrumilchlet.tk
newhairstylesformen2014.com netpics.org
nfljerseysforsalewholesaler.com newyorkhotelsmotels.info
nibbler.silktide.com nfljerseyscheapbiz.us
nlfjjunb5.ru nfvsz.com
nordstar.pro ngps1.ru
normalegal.ru notasprensa.info
nudejapan.net
nzfilecloud.weebly.com
o.light.d0t.ru o.light.d0t.ru
oakleyglassesonline.us oakleyglassesonline.us
online-zaymy.ru obuv-kupit.ru
online247.ml office-windows.ru
onlinewritingjobs17.blogspot.ru okayimage.com
paceform.com okout.ru
paperwritingservice17.blogspot.ru oneminutesite.it
park.above.com onlinedomains.ru
patol01.pw onlythegames.com
pay2me.pl otbelivanie-zubov.com
pc-virus-d0l92j2.pw pagesense.com
pcimforum.com paleohub.info
pearlisland.ru parajumpersjakkesalgnorge.info
partner-cdn.men
partner-high.men
partner-print.men
pendelprognos.se
percin.biz.ly percin.biz.ly
photo.houseofgaga.ru petedrummond.com
phuketscreen.com picscout.com
pictures-and-images.net picture-group.com
pierrehardysale.online picturesboss.com
pillscheap24h.com picturesmania.com
pixell.club pizdeishn.com
playmsn.com pk-pomosch.ru
pliks.pl plastjulgranar.se
pogruztehnik.ru plastweb.ru
pooleroadmedicalcentre.co.uk
poppen-nw.net
popugaychiki.com popugaychiki.com
popup.matchmaker.com porn-w.org
porndroids.com pornodojd.ru
pornogig.com pornoforadult.com
pornoreino.com pornonik.com
pornosemki.info pornosok.ru
pornosexrolik.com porodasobak.net
pornoted.com portal-eu.ru
pornotubexxx.name pourvous.info
pornoxxx.com.mx
porto.abuilder.net
presleycollectibles.com presleycollectibles.com
privacylocationforloc.com pricheskaonline.ru
privatefx-in.ru ranksonic.com
privhosting.com realmonte.net
prize44.com rebelmouse.com
produkto.net rebrand.ly
professionalwritingservices15.blogspot.ru reelheroes.net
profitsport.club remedyotc.com
prohoster.info resant.ru
prointer.net.ua research.ifmo.ru
projefrio.com.br restorator-msk.ru
prostitutki-novgoroda.org reversing.cc
psoriasis-file.trade rfserial.net
pssucai.info romhacking.ru
pufip.com royal-betting.net
queerspace.com royalads.net
ragecash.com sack.net
randki-sex.com saddiechoua.com
rank-checker.online salut-camp.ru
ranksonic.org sanyuprojects.com
realresultslist.com sbdl.no
rebuildermedical.com scanhub.ru
recipedays.com scanner-alexa.top
registry-clean-up.net scanner-mary.top
remontbiz.ru scanspyware.net
replica-watch.ru se-welding.ru
replicalouboutin.xyz search.xtconnect.com
ricorsogiustizia.org securesmrt-dt.com
ringtonepartner.com sell-fb-group-here.com
russia-today-video.ru seo-tools-optimizing.com
rutor.group seo18.su
rvi.biz sevendays.com.ua
salutmontreal.com sex-dating.co
sayyoethe.blogspot.co.za sex-tracker.de
sbwealthsolutions.ca sexfreepornoxxx.com
scanner-don.top sexvideo-sex.com
scanner-josh.top sexyteens.hol.es
scanner-walt.top shama-rc.net
scanner-willy.top shariki-zuma-lines.ru
scmor.ilxc.cc shlyahten.ru
searchimpression.com shodanhq.com
searchlock.com shopfishing.com.ua
searchtooknow-a.akamaihd.net
secret.xn--oogle-wmc.com
seo-smm.kz
seobility.net
seoholding.com
seorankinglinks.us
serptehnika.ru
shikiso.info
shop.acim.org
shopcheermakeup.info
si-unique.com si-unique.com
sigmund-freud.co.uk site-auditor.online
site5.com site-speed-check.site
sitevalued.com site-speed-checker.site
slayerlife.com sitevaluation.com
skutecznetabletkinaporostwlosow.pl
slimcdn.com slimcdn.com
slomm.ru soda.media
smadihome.com solicita.info
smartadserver.com soserfis.com
snip.tw sovinsteel.ru
social-buttons.xyz space-worry.ml
sotechco.co spidtest.org
souvenirua.com spinnerco.ca
sps-shop.com steame.ru
spyfu.com stpicks.com
spywarenuker.com strana-krasoty.ru
sr-rekneskap.no streetfooduncovered.com
sribno.net strigkaomsk.ru
ssconstruction.co stroicol.net
stair.registrydomainservices.com suggest-keywords.com
stariy-baku.com superfish.com
statoutlook.info swinger-mobil.net
stockspmb.info
strana-solnca.ru
strfls.com
superiends.org
svarkagid.com
svensk-poesi.com
swsociety.se
sygraem.com sygraem.com
tds-advert005.info taboola.com
tedxrj.com tarad.com
teenfuck.tv taxi-v-eisk.ru
teslathemes.com tds-advert002.info
tech4master.com
technika-remont.ru
tecnoteakviareggio.it
teesdaleflyballclub.co.uk
theallgirlarcade.com
themestotal.com themestotal.com
thruport.com tizanidine4mg.blogspot.com
tizanidinehcl2mg.blogspot.com tizanidineandhydrocodone.blogspot.com
tizanidinehydrochloride2mg.blogspot.com tizanidineformigraines.blogspot.com
tizanidinepills.blogspot.com tizanidinewithdrawal.blogspot.com
tn811.us tomck.com
toonfamilies.net tooplay.com
torture.ml top10registrycleaners.com
tourcroatia.co.uk topdownloads.ru
toxicwap.com torrents.life
track2.shop toys.erolove.in
trafficjunky.net tracksurf.daooda.com
traffictrade.life tracksz.co
triumf-realty.ru traffic100.com
trustaffs.com trafficstars.com
tsan.net ttrraacckkrr.com
turizmus.us tupper-shop.ru
txxx.com turbabitload.weebly.com
ua-company.ru twelvevisionspartyofcolorado.com
uchil.net tzritel.tk
ugogo.info uchebavchehii.ru
uhodzalijami.ru uhdtv.website
ukrobstep.com uhod-za-sobakoj.ru
undergroundcityphoto.com unitexindia.com
univerfiles.com uptime-gamma.net
uprour.com uroki.net
uptimechecker.com usswrite.com
v720hd.ru v-doc.co
vapomnoncri.tk vancleefreplica.pw
vapsy.com vandrie-ict.nl
vbabule.net veselokloun.ru
vekzdorov.ru via-energy-acquistare.com
veopornogratis.xxx viddyoze.com
vezuviy.su videochat.life
via-energy-order.com videokrik.net
viagra-soft.ru videooko.weebly.com
video-chat.love vielporno.net
virtualbb.com vip-parfumeria.ru
viteonlusarezzo.it vip2ch.com
vkontaktemusic.ru vipromoffers.com
vksex.ru vpnhowto.info
vladimir.zrus.org vpnmouse.com
voloslove.ru
vonradio.com
vseigru.one vseigru.one
vykup-avto-krasnodar.ru wcb.su
vzlomfb.com weblibrary.win
wallpapersist.com weburok.com
warezaccess.com wejdz-tu.pl
watchdogs-2.ru wfb.hatedriveapart.com
waterpurifier.club wholesalejerseysgaa.com
watracker.net wildcattube.com
website-analytics.online worldhistory.biz
website-speed-check.site wttavern.com
weddingdresses.xyz xfire.com
whatistizanidine2mg.blogspot.com xjlottery.com
wildworld.site xn-----7kcabaipgeakzcss7bjdqdwpfnhv.xn--p1ai
winterclassichockeyjerseys.com xn----7sbbagbq7bd5aheftfllo4m.xn--p1ai
wladimirpayen.com xn--80abgj3a5acid6ghs.top
wordkeyhelper.com xn--b1agm2d.net
worldis.me xn--e1aggki3c.xn--80adxhks
writersgroup580.web.fc2.com xn--hxazdsfy.blogspot.com
wrz0iuebwhp5fg.freeddns.com xn--l1aengat.xn--p1ai
wsgames.ru xnxx699.com
xchangetrak.com xuki.us
xedserver.com xxxtube69.com
xerox-douglas.cf y8games-free.com
xn----7sbahjd3btneuw1joc.xn--p1ai yatrk.xyz
xn--80aafb2a.xn--p1ai yellowads.men
xn--80aanaardaperhcem4a6i.com yopoint.in
xvideosporn.biz youraticles.pl
yes-com.com yourserverisdown.com
youbloodyripper.com za-music.mymobiplanet.com
yuarra.pluto.ro zagadki.in.ua
yun56.co zakon-ob-obrazovanii.ru
z-master.ru zarabotat-na-sajte.ru
zakazvzloma.com zarepta.com
zaobao.com.sg zdesformula.ru
zarabotok--doma.ru zeg-distribution.com
zawyna.ua zerocash.msk.ru
zlatnajesen.com zeroredirect7.com
zolotoy-lis.ru zeroredirect8.com
zootravel.com zigarettenonlinekaufen2.drupalgardens.com
zynax.ua zirondelli.it
znakom.sibtest.ru
zocaparj.kz

480
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
0c47f8422d3f.com 000free.us
1-99seo.com 0lovespells0.blogspot.com
1xbet4you.com 100searchengines.com
101raccoon.ru
1kdailyprofit.me
2020iscoming.info
23kw.ru
2x2fan.ru
3-letter-domains.net 3-letter-domains.net
3w24.com 45en.ru
55wmz.ru advokat-grodno.by
8558l.jobs.net agysya.ru
a14download.com allblogroll.com
abclauncher.com alldubai.biz
addbin.men ananumous.ru
advokateg.ru apibrowsesmartne-a.akamaihd.net
aihelen.net apiwoodensealcom-a.akamaihd.net
air-edem.ru apple.com-webbrowsing-security.science
akusherok.ru azinoofficial777.ru
alert-hgd.xyz bedcapdealers.com
allforminecraft.ru bestofpicture.com
animalrank.com betterhdporn.com
animebox.com.ua bharatdefencekavach.com
apimossnetinfo-a.akamaihd.net blackplanet.com
apispringsmartne-a.akamaihd.net blavia.00author.com
apxeo.info bluesalt.co
arcadeplayhouse.com brateg.xyz
arendas.net brillianty.info
atleticpharm.org btvn.ru
autodo.info bumble.cheapwebsitehoster.com
automobile-spec.com businescoop.men
baditri.com buy-cheap-pills-order-online.com
battle.net buy-meds24.com
battleforupdating.site buytizanidineonlinenoprescription.blogspot.com
begalka.xyz bvlgariwallet.xyz
bestadbid.com callcafe.info
blogs.rediff.com canzoni.ru
brainboosting.club cartierring.xyz
brandov.ru casite-513049.cloudaccess.net
builtwith.com ccbill.com
buqayy0.livejournal.com cementaresearch.se
buypillsorderonline.com cenoval.ru
buypuppies.ca chatseo.com
calc-for-credit.ru cheapmoncler.pw
callstevens.com chinaelitecheapjerseys.com
candytiner.com
cartierreplica.win
chelnytruck.ru
chinese-amezon.com chinese-amezon.com
clipartnew.com citysecurity.nu
compliance-andrew.xyz clicksotrk.com
compliance-checker.info clknsee.com
converse.ddsoldes.fr coin-hive.com
credit.co.ua com-onlinesupport.host
customboxes4less.com compliance-george.xyz
cwetochki.ru compliance-ivan.xyz
csgo4.win
darmebel.com.ua
dating-time-now.com dating-time-now.com
deda-moroza-zakaz.ru demian.kz
dentalpearls.com.au dolohen.com
detoxmed24.ru dominateforex.ml
diarioaconcagua.com donna7753191.ru
digital-sale.su dorratex.tn
dildofotzen.net doxysexy.com
div.as easytuningshop.ru
domoysshop.ru ebonyporn.site
downloader12.ru ebooknovel.club
dumuelave.xyz electronicadirect.com
eaplay.ru elektroniksigaraankara.info
ecommerce-seo.org elektronischezigarettekaufen1.myblog.de
elvel.com.ua enpolis.ru
elvenar.com erotik-kostenlos.net
ertelecom.ru erotik0049.com
extlinks.com eshop4u.jp
filmetricsasia.com extener.org
find1friend.com ezofest.sk
fodelsedagspresenter.nu fapgon.com
fordsonmajbor.cf fast-wordpress-start.com
forsex.info filesdatabase.net
forum.doctissimo.fr filkhbr.com
freewebs.com finejewelryshop.ru
fuckbuddybestgilf.info flooringinstallation-edmonton.com
fungirlsgames.net fok.nl
freefoto.ca
freegamesplay.online
freemaintenancesysforpcandmac.top
fuck-paid-share-buttons.xyz
fungamelands.com
funtoonez.com funtoonez.com
fusoradio.info gdzkurokam.ru
games.kolossale.ru getlaid-xxxhookupdirect.com
ge0ip.org gilbertbanda.net
gettpromos.com guigyverpo.cf
glavtral.ru hamilton.ca
gloverid.site hatedriveapart.com
golaya.pw hesteel.pl
goodnightjournal.com hit-kino.ru
grand-chlen.ru hmmm.cz
greatdealshop.com hopeonthestreet.co.uk
greatidea.marketing hoste.octopis.com
gymi.name houseofgaga.ru
hawaiielectriclight.com hulfingtonpost.com
healthcarestore.info hyhj.info
heartofpayne.xyz ibb.com.ua
heatpower.ru ico.re
hoterika.com ilte.info
hothor.se imadedinner.net
hplaserjetpdriver8y.pen.io images-free.net
htmlcorner.com incomekey.net
https-legalrc.biz istizanidinelikexanax.blogspot.com
iamsport.org istock-mebel.ru
ideoworld.org javidol.site
imagerydatabase.com javlibrary.cc
interfucks.net jimmychoosale.online
iomoio.net justucalling32211123456789.tk
it-max.com.ua kandidos.com
itch.io kinoduh.ru
izhevsk.xrus.org kinostorm.net
izismile.com konkursov.net
jaxcube.info krafte.ru
jo24news.com ktotut.net
johnrobertsoninc.com kutikomi.net
jrpmakati.com kuzinsp.ru
keywordblocks.com kvartira-sutochno.com
klumba55.ru landreferat.ru
koleso24.com.ua leboard.ru
kostenlos-sexvideos.com lego4x4.ru
kovrenok.ru liquimondo.com
kredit-pod-zalog-krasnodar.ru lisque.batcave.net
kurwa.win lob.com.ru
laapp.com lombia.com
law-check-two.xyz long-beach-air-conditioning.com
letmacworkfaster.world lovi-moment.com.ua
lifebyleese.com mackeeper-center.club
lightinghomes.net makis.nu
lineavabit.it matchpal-a.akamaihd.net
liupis.com mcnamaratech.com
lovasszovetseg.hu mediaoffers.click
lowephotos.info meet-flirt-dating.com
luxup.ru mirtorrent.net
m3gadownload.pl montazhnic.ru
maglid.ru mybackgroundlandscape.blogspot.com
maladot.com nalogovyykodeks.ru
manipulyator-peterburg.ru narco24.me
meddesk.ru nhl09.ru
medicinacom.ru nudepatch.net
meetingrainstorm.bid
menstennisforums.com
michaelkorsoutlet.store
minharevisao.com
mmostrike.ru
mobilierland.com
modabutik.ru
moje-recenze.cz
monclerboots.xyz
morefastermac.trade
musicdaddy.net
mykings.pw
nbsproject.ru
nerudlogistik.ru
nomuos.it
novatech.vn
nullrefer.com
o-o-8-o-o.com o-o-8-o-o.com
offtime.ru omoikiri-japan.ru
online-sbank.ru onemantrip.com
onlinebay.ru onlyforemont.ru
onlywoman.org ordernorxx.com
onstrapon.purplesphere.in orion-v.com
orgasmus-virtual.com osoznanie-narkotikam.net
ownshop.win ourtherapy.ru
piccdata.com pekori.to
playtap.us perm-profnastil.ru
plugingeorgia.com pio.polytopesexempt.com
potolokelekor.ru pkr1hand.com
prizestohandle.club ploenjitmedia.azurewebsites.net
pukaporn.com poisk-zakona.ru
pussysaga.com polska-poezja.com
putitin.me polytopesexempt.com
qitt.ru popander.mobi
rapidsites.pro porno-play.net
razleton.com pornogad.com
research.ifmo.ru pornoslive.net
retreatia.com pricheskaonline.ru
ruscopybook.com primedice.com
russintv.fr produkto.net
prohoster.info
prombudpostach.com.ua
prosmibank.ru
qexyfu.bugs3.com
rabotaetvse.ru
randalljhoward.com
rczhan.com
reimageplus.com
rialp.getenjoyment.net
ric.info
riders.ro
rique.host.sk
rome2rio.com
rossmark.ru
ruex.org.ua
russkie-gorki.ru
sa-rewards.co.za sa-rewards.co.za
sale-japan.com samolet.fr
sanyuprojects.com scanner-julia.top
satellite.maps.ilovevitaly.com scanspyware.net
savememoney.co.za seo18.su
savetubevideo.com seotoolsagency.com
sbdl.no seozoom.it
sbornik-zakonov.ru sex-tracker.com
sbricur.com sexad.net
scrnet.biz.ua sexystrippe.info
sdelai-prosto.ru sexytrend.ru
search-goo.com shmetall.com.ua
searchaddis.com shop-electron.ru
searchimpression.com
securesmrt-dt.com
semaltmedia.com
seojokes.net
seomarketings.online
shopperifymac.com
shopvilleroyboch.com.ua
shopwme.ru
shymkent.xkaz.org
sibtest.ru
sicfor.bcu.cc
sildenafilcitratemed.com
simpoed.ufop.br simpoed.ufop.br
skytraf.xyz slonechka.ru
solnplast.ru smichovbike.cz
sms2x2.ru
social-button.xyz
socialbuttons.xyz
solution4u.com solution4u.com
spabali.org spy-sts.com
spb.ru srecorder.com
stanthonyscatholicchurch.org stal-rulon.ru
starpages.net staticfs.host
stefanbakosab.se sugvant.ru
svetlotorg.ru superkanpo.com
svolze.com svbur.ru
tamada69.com tampabaywatch.org
tfxiq.com taxi-v-eisk.ru
thetoiletpaper.com tedxrj.com
timeallnews.ru templates.franklinfire.co
tizanidine4mgstreetvalue.blogspot.com thexart.club
tizanidinehcl2mgsideeffects.blogspot.com timetorelax.biz
tobeyouday.win titangel-vietnam.com
toondinsey.com tnaionline.org
torrent-newgames.com topvidos.ru
torrentdownloadhub.com trustl.life
torrents-tracker.com tx41tclega.ru
tour-line.net udsgame.online
tri-slona.org unacittaconte.org
tsyndicate.com unitexindia.com
turvgori.ru userequip.com
tzritel.tk v-doc.co
uchebavchehii.ru vadimkravtcov.ru
urengoy.pro vesnatehno.ru
vedomstvo.net viteonlusarezzo.it
video-production.com vuclip.com
videonsk.com vysigy.su
vielporno.net w3javascript.com
vrotike.ru warningzscaler.heraeus.com
webjam.com watchmyfb.pl
website-speed-up.site wcb.su
wholinkstome.com webs.com
website-analytics.online
website-speed-checker.site
windowssearch-exp.com windowssearch-exp.com
woman-orgasm.ru
wormix-cheats.ru
writingservices17.blogspot.ru
www.ehscloud.cn www.ehscloud.cn
x-mix.info x-true.info
xn--24-glceagatoq7c2a6ioc.xn--p1ai xerox-douglas.cf
xn--80aagddcgkbcqbad7amllnejg6dya.xn--p1ai xn----8sbhefaln6acifdaon5c6f4axh.xn--p1ai
xn--b1addnj3cah.xn--p1ai xn--b1ag5cfn.xn--p1ai
xxxsiterips.xyz xxxdatinglocal.us
you-shall-not-pass.is74.ru xxxtube69.com
yoursite.com zdesoboi.com
zebramart.ru zmoda.hostreo.com
znaturaloriginal.com
zreloeporno.tv

10
dev-tools/test_units/ratelimittest-beta.txt
View file

@ -581,4 +581,14 @@
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html> </html>

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.27 0; 10.1.1.69 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.08.3276 ### Version: V4.2022.08.3277
### Updated: Sun Aug 7 22:01:26 UTC 2022 ### Updated: Mon Aug 8 10:03:29 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.08.3276 ### Version: V4.2022.08.3277
### Updated: Sun Aug 7 22:01:26 UTC 2022 ### Updated: Mon Aug 8 10:03:29 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##