vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-03 19:20:16 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2022.07.3245 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2022-07-23 10:09:27 +00:00
parent 9d2bc08e9f
commit 46b8d5f364
48 changed files with 98225 additions and 98242 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.07.3244 #### Version: V4.2022.07.3245
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.07.3244 #### Version: V4.2022.07.3245
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -14,7 +14,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2022.07.3244 #### Version: V4.2022.07.3245
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

12140
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2022.07.3244 #### Version: V4.2022.07.3245
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

12144
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

12144
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

12144
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

12144
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.117 1; 10.1.0.52 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.117 0; 10.1.0.52 0;
127.0.0.1 0; 127.0.0.1 0;

12144
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.117 1; 10.1.0.52 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.117 0; 10.1.0.52 0;
127.0.0.1 0; 127.0.0.1 0;

12144
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.117 1; 10.1.0.52 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.117 0; 10.1.0.52 0;
127.0.0.1 0; 127.0.0.1 0;

12144
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
3244 3245

12144
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

12144
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.59.113.88 0; 40.121.36.133 0;

12144
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.117 1; 10.1.0.52 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.117 0; 10.1.0.52 0;
127.0.0.1 0; 127.0.0.1 0;

12144
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.117 1; 10.1.0.52 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.117 0; 10.1.0.52 0;
127.0.0.1 0; 127.0.0.1 0;

12144
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.117 1; 10.1.0.52 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.117 0; 10.1.0.52 0;
127.0.0.1 0; 127.0.0.1 0;

12144
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.59.113.88 0; 40.121.36.133 0;

12144
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.59.113.88 0; 40.121.36.133 0;

12144
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.117 1; 10.1.0.52 1;
127.0.0.1 1; 127.0.0.1 1;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
BackDoorBot Aboundexbot
BackWeb BackStreet
MQQBrowser DnyzBot
Pu_iN EMail Wolf
PxBroker Flunky
Ripper MIDown tool
Swiftbot Web Auto
TheNomad YoudaoBot
cah.io.community heritrix
sp_auditbot webmeup-crawler

304
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
360Spider ADmantX
404checker
AIBOT AIBOT
ASPSeek
Aboundex Aboundex
AhrefsBot AfD-Verbotsverfahren
AiHitBot
Aipbot Aipbot
Alligator Alexibot
Anarchie AllSubmitter
Anarchy
Anarchy99 Anarchy99
Asterias
Atomseobot Atomseobot
Attach AwarioSmartBot
AwarioRssBot BDFetch
BackDoorBot BackDoorBot
BackWeb BackStreet
Barkrowler BacklinkCrawler
BetaBot Badass
Black Hole BatchFTP
Battleztar Bazinga
Bigfoot
BlackWidow
Blackboard
BlowFish BlowFish
Bolt Bolt
Brandprotect BotALot
Brandwatch
Buddy Buddy
BuiltBotTough
BuiltWith BuiltWith
CATExplorador CSHttp
CCBot Cegbfeieh
CazoodleBot CensysInspect
ChinaClaw ChinaClaw
Chlooe
Citoid Citoid
Claritybot
Cloud mapping Cloud mapping
Cocolyzebot Copier
Cogentbot
Collector
Craftbot Craftbot
Curious Crawling at Home Project
CyotekWebCopy CrunchBot
DatabaseDriverMysqli Custo
Demon DIIbot
Devil Deusu
DigitalPebble DigitalPebble
Dirbuster
Disco Disco
Discobot Discobot
DittoSpyder DittoSpyder
DnBCrawler-Analytics DomainAppender
DnyzBot DomainSigmaCrawler
DomainStatsBot DomainStatsBot
Domains Project
Dotbot
Drip Drip
EMail Siphon ECCP/1.0
EMail Wolf Ebingbong
EroCrawler
Express WebPictures Express WebPictures
Extreme Picture Finder ExtLinksBot
Ezooms Extractor
FemtosearchBot ExtractorPro
Firefox/7.0 EyeNetIE
FHscan
FlashGet
Flunky
Foobot
Freeuploader Freeuploader
FrontPage Fuzz
G-i-g-a-b-o-t FyberSpider
GT::WWW Fyrebot
Getintent GetRight
GetWeb
Gigabot Gigabot
Go-Ahead-Got-It Go-Ahead-Got-It
GoZilla
GrabNet GrabNet
HTMLparser Grabber
HMView
HTTP::Lite HTTP::Lite
Haansoft Hloader
Havij
Heritrix
HonoluluBot
Humanlinks Humanlinks
Intelliseek HybridBot
InternetSeer IDBTE4M
Iria Id-search
Iskanie IndeedBot
JOC Web Spider InfoTekies
Jbrofuzz Internet Ninja
JennyBot JennyBot
JetCar Kenjin Spider
Joomla LexiBot
Jyxobot
Keyword Density
Kinza
LNSpiderguy
Leap
LeechFTP
Lftp
LibWeb
LieBaoFast
Lightspeedsystems Lightspeedsystems
LinkScan
Linkbot Linkbot
LinkextractorPro LinkpadBot
LinksManager
LinqiaMetadataDownloaderBot LinqiaMetadataDownloaderBot
LinqiaScrapeBot LinqiaRSSBot
Lmspider Lipperhey Spider
Ltx71 Ltx71
MFC_Tear_Sample MFC_Tear_Sample
MJ12bot MIIxpc
MQQBrowser MQQBrowser
MSFrontPage MSFrontPage
Majestic SEO MSIECrawler
Masscan Mag-Net
Majestic-SEO
Majestic12
MarkMonitor
Mass Downloader
Mata Hari Mata Hari
Mb2345Browser Mb2345Browser
Metauri Mediatoolkitbot
MicroMessenger Microsoft URL Control
Minefield
Mister PiX Mister PiX
Moblie Safari
Mojolicious Mojolicious
Mozlila MolokaiBot
Msrabot Mr.4x3
Musobot Navroad
NICErsPRO
NearSite
Needle Needle
NetAnts NetAnts
NetLyzer NetLyzer
NetSpider NetMechanic
NetZIP
Nettrack Nettrack
Netvibes Netvibes
Niki-bot Nibbler
NimbleCrawler
Ninja Ninja
Not
Nuclei Nuclei
Nutch Nutch
Offline Navigator
OnCrawl OnCrawl
OpenVAS OpenLinkProfiler
Openfind Openfind
OrangeBot
OutclicksBot OutclicksBot
OutfoxBot
PHPCrawl PHPCrawl
POE-Component-Client-HTTP
PageAnalyzer
PageGrabber
PageScorer PageScorer
Petalbot Pandalytics
Panscient
Papa Foto
PeoplePal
Pi-Monster Pi-Monster
Picscout
Picsearch
Piepmatz Piepmatz
Pimonster
Pixray Pixray
PleaseCrawl
ProWebWalker ProWebWalker
Probethenet Probethenet
PyCurl Pump
RankActive
RankingBot RankingBot
Rankivabot
RankurBot RankurBot
Re-re
ReGet
RealDownload RealDownload
Reaper Reaper
RepoMonkey Ripper
SEOkicks RocketCrawler
SEOkicks-Robot
SEOprofiler SEOprofiler
SISTRIX
SMTBot
ScanAlert ScanAlert
Scrapy ScreenerBot
Screaming SemanticJuice
ScrepyBot
Searchestate
SentiBot SentiBot
SeoSiteCheckup SeobilityBot
Siteimprove Seomoz
SlySearch Site Sucker
SiteLockSpider
SiteSnagger
SiteSucker
Snake Snake
Snapbot
Sociscraper Sociscraper
Spammen Sogou web spider
Sqworm SpankBot
Steeler SputnikBot
Sqlmap
Sucuri
SuperBot SuperBot
SuperHTTP
Surfbot Surfbot
SurveyBot Suzuran
Szukacz T0PHackTeam
T8Abot
Teleport Teleport
Telesphoreo Telesoft
Telesphorep
The Intraformant The Intraformant
Thumbor TheNomad
Titan TightTwatBot
Toweyabot Toweyabot
Tracemyfile Tracemyfile
Trendictionbot Trendiction
Twice Turingos
Typhoeus TurnitinBot
URLy Warning URLy Warning
Upflow V-BOT
Vacuum Vacuum
Vagabondo Vagabondo
VelenPublicWebCrawler
VidibleScraper
Virusdie Virusdie
VoidEYE VoidEYE
Voil Voil
WISENutbot Voltron
WWW-Collector-E WEBDAV
WWW-Mechanize
WWW::Mechanize WWW::Mechanize
Wallpapers
WallpapersHD
Web Auto
Web Enhancer
Web Fetch Web Fetch
Web Fuck Web Sucker
Web Sauger WebBandit
WebFetch WebFuck
WebImageCollector
WebLeacher WebLeacher
WebPix WebSauger
WebReaper
WebStripper WebStripper
WebZIP Webshag
WebsiteExtractor
Webster Webster
Whack WinHTTrack
Whacker
Wonderbot Wonderbot
Woobot Xaldon WebSpider
Wotbox Xaldon_WebSpider
Zauba YoudaoBot
Zeus Zeus
ZmEu
ZoomBot
ZoominfoBot ZoominfoBot
ZumBot archive.org_bot
arquivo-web-crawler check1.exe
arquivo.pt
coccocbot coccocbot
cognitiveseo
crawl.sogou.com
crawler4j
dataforseo.com dataforseo.com
demandbase-bot domainsproject.org
facebookscraper eCatch
gopher instabid
heritrix internetVista monitor
ips-agent
isitwp.com isitwp.com
linkdexbot iubenda-radar
lwp-request
lwp-trivial lwp-trivial
magpie-crawler page scorer
muhstik-scan
probe-image-size probe-image-size
ripz satoristudio.net
scalaj-http scalaj-http
scan.lol scan.lol
seobility seobility
seocompany.store seocompany.store
siteripz seoscanners
tAkeOut
trendiction.de trendiction.de
ubermetrics-technologies.com
webmeup-crawler webmeup-crawler
webpros.com
x22Mozilla
xpymep1.exe
zauba.io
zgrab zgrab

330
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
01h4x.com AIBOT
404checker
404enemy
ADmantX
ALittle Client ALittle Client
ASPSeek
Abonti Abonti
AfD-Verbotsverfahren Aboundexbot
AhrefsBot
AiHitBot
Aipbot Aipbot
AlphaBot AllSubmitter
Anarchie
Anarchy
Anarchy99 Anarchy99
Asterias Anthill
Atomseobot Aspiegel
AwarioRssBot BDCbot
AwarioSmartBot BDFetch
BBBike
BLEXBot BLEXBot
BackDoorBot
BackStreet BackStreet
BackWeb
Backlink-Ceck Backlink-Ceck
Barkrowler Bandit
Boardreader BatchFTP
BotALot Battleztar Bazinga
Brandwatch BetaBot
Buddy BlackWidow
Bullseye Blackboard
BuzzSumo Blow
CSHttp Buck
Calculon CATExplorador
CCBot
Cegbfeieh Cegbfeieh
CensysInspect
CheeseBot
CherryPicker CherryPicker
ChinaClaw ChinaClaw
Cocolyzebot Chlooe
Cogentbot Citoid
Collector Claritybot
Cosmos
Craftbot Craftbot
Curious Crescent
DTS Agent Custo
DataCha0s DataCha0s
DatabaseDriverMysqli
Demon Demon
Digincore
Dirbuster
Disco
Discobot Discobot
DittoSpyder DomainCrawler
DnyzBot DomainStatsBot
DomainSigmaCrawler
Dotbot
Download Wonder Download Wonder
Dragonfly Dragonfly
EMail Wolf EMail Wolf
EroCrawler
Evil Evil
Express WebPictures Extractor
ExtLinksBot
Extreme Picture Finder
FHscan
Fimap
Firefox/7.0 Firefox/7.0
FlashGet Flunky
Foobot
Freeuploader Freeuploader
FyberSpider
Fyrebot
G-i-g-a-b-o-t G-i-g-a-b-o-t
GT::WWW GT::WWW
Genieo Genieo
GermCrawler GermCrawler
GetWeb Getintent
Go-Ahead-Got-It GoZilla
Gotit GridBot
Grafula
HEADMasterSEO HEADMasterSEO
HMView HTMLparser
HTTP::Lite HTTP::Lite
HTTrack
HaosouSpider HaosouSpider
Harvest
Havij
Hloader
Humanlinks Humanlinks
IDBTE4M HybridBot
IDBot IDBot
IlseBot IRLbot
Id-search
Image Sucker Image Sucker
IndeedBot
Indy Library Indy Library
InfoNaviRobot
InterGET InterGET
Iskanie Internet Ninja
IstellaBot InternetSeer
Iria
JOC Web Spider
JamesBOT JamesBOT
JetCar JennyBot
JikeSpider Jetty
Jorgee Joomla
Keybot Translation-Search-Machine Kenjin Spider
LWP::Simple Keyword Density
Lanshanbot Kinza
Lftp LNSpiderguy
LieBaoFast LeechFTP
Likse LexiBot
LinkWalker Libwhisker
LinkextractorPro
LinkpadBot LinkpadBot
LinksManager LinqiaMetadataDownloaderBot
LinqiaRSSBot LinqiaScrapeBot
Lipperhey Lipperhey
Lipperhey Spider Lmspider
MFC_Tear_Sample
MIIxpc MIIxpc
MJ12bot MSFrontPage
MSIECrawler MSIECrawler
Magnet MTRobot
MarkWatch Majestic SEO
Mass Downloader
Mata Hari Mata Hari
MegaIndex.ru MauiBot
Metauri Mb2345Browser
Minefield Meanpathbot
Mediatoolkitbot
Mister PiX Mister PiX
Mojeek Mojeek
Morfeus Fucking Scanner Mr.4x3
Mozlila Msrabot
NICErsPRO Musobot
Navroad Name Intelligence
Needle
Net Vampire Net Vampire
NetMechanic NetAnts
NetSpider NetZIP
Nettrack Nettrack
NextGenSearchBot
NimbleCrawler NimbleCrawler
Nimbostratus
Not Not
Nuclei Nuclei
Nutch Octopus
Offline Explorer Offline Navigator
OrangeSpider Openfind
OutfoxBot
PHPCrawl
POE-Component-Client-HTTP
Page Analyzer Page Analyzer
PageAnalyzer
PageGrabber PageGrabber
PageScorer PageThing.com
Pandalytics Pandalytics
Panscient
Papa Foto Papa Foto
PeoplePal
Petalbot Petalbot
Pi-Monster Pi-Monster
Picscout Piepmatz
PictureFinder Pockey
Pimonster ProWebWalker
ProPowerBot
Probethenet Probethenet
Psbot Pump
PxBroker
RankActive RankActive
RankActiveLinkBot RankurBot
RankFlex RealDownload
RankingBot RebelMouse
RankingBot2 RocketCrawler
Rankivabot Rogerbot
Reaper
RedesScrapy
Ripper
SEOkicks SEOkicks
SEOkicks-Robot
SEOlyticsCrawler SEOlyticsCrawler
SEOstats SEOstats
SISTRIX
SalesIntelligent SalesIntelligent
Searchestate ScanAlert
SemanticJuice ScrepyBot
Semrush SearchmetricsBot
SemrushBot Seekport
SeoSiteCheckup SentiBot
Shodan Siphon
Site Sucker
SiteExplorer
SiteLockSpider SiteLockSpider
SiteSnagger SiteSnagger
SiteSucker
Sitebeam Sitebeam
Snake Siteimprove
SlySearch
SmartDownload
Snoopy
SocialRankIOBot
Sogou web spider Sogou web spider
Spammen Sottopop
SpankBot Spbot
SputnikBot
Sqlworm
Sqworm Sqworm
SuperBot Sucker
SurveyBot Szukacz
Suzuran Telesoft
T0PHackTeam TightTwatBot
Teleport
Telesphoreo
Telesphorep
The Intraformant
Thumbor
Toata Toata
Toweyabot Toweyabot
Tracemyfile
Trendiction Trendiction
Turingos Trendictionbot
Turnitin
TurnitinBot TurnitinBot
URLy.Warning Twice
V-BOT Typhoeus
VB Project Vagabondo
VeriCiteCrawler VeriCiteCrawler
VidibleScraper Virusdie
VoidEYE
Voil Voil
WASALive-Bot WEBDAV
WBSearchBot
WPScan
WWW-Collector-E WWW-Collector-E
WWW::Mechanize Wallpapers
WWWOFFLE Wallpapers/3.0
Web Auto Web Auto
Web Sauger Web Fuck
WebCopier Web Pix
WebEnhancer Web Sucker
WebFuck
WebImageCollector
WebLeacher WebLeacher
WebStripper WebPix
WebWhacker WebReaper
Webalta WebSucker
WebZIP
WebmasterWorldForumBot WebmasterWorldForumBot
Website Quester Whack
WebsiteExtractor Whacker
Webster Widow
Whatweb WinHTTrack
WiseGuys Robot Wonderbot
Woobot
Wotbox
Wprecon Wprecon
Zade YoudaoBot
Zauba Zeus
ZmEu ZoominfoBot
ZumBot
ZyBorg ZyBorg
clark-crawler adscanner
coccocbot archive.org_bot
arquivo-web-crawler
autoemailspider
backlink-check
cah.io.community
check1.exe
cognitiveseo cognitiveseo
crawler4j
demandbase-bot
eCatch eCatch
evc-batch facebookscraper
heritrix
internetVista monitor internetVista monitor
ips-agent iubenda-radar
isitwp.com lwp-trivial
linkdexbot meanpathbot
magpie-crawler page scorer
mediawords seobility
muhstik-scan
plumanalytics
polaris version
seoscanners
seostar seostar
sexsearcher sexsearcher
sp_auditbot
spyfu spyfu
sysscan sysscan
trendiction.de trendiction.de
webgains-bot ubermetrics-technologies.com
webmeup-crawler
webpros.com
x09Mozilla x09Mozilla
x22Mozilla x22Mozilla
xpymep1.exe xpymep1.exe
zgrab

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
adimmix.com fugarif.ga
checkpagerank.net mall.uk
dbmkfhqk.bloger.index.hr moneyviking-a.akamaihd.net
doreenblog.online mustwineblog.com
fsalas.com mydirtystuff.com
maladot.com scanner-george.top
map028.com sispe.com.br
oranga.host.sk sugvant.ru
yourserverisdown.com teastory.co
yun56.co teenfuck.tv

936
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
0lovespells0.blogspot.com 000free.us
1-free-share-buttons.com 03e.info
1kinobig.ru 101raccoon.ru
3-letter-domains.net 1kdailyprofit.me
3weekdiet.com 2015god.org
3xforum.ro 2020iscoming.info
7ooo.ru 24-ak.ru
7search.com 2kata.ru
8lufu.com 3th.co.in
aa8b68101d388c446389283820863176e7.com 51unlim.ru
academiacsmendoza.org 5elementov.ru
actulite.com 5i2.net
adman.gr 9icmzvn6.website
admanaerofoil.com aaa38852e886ac4af1a3cff9b47cab6272.com
adult3dgames.com aasoldes.fr
acortarurl.es
actices.com
adloads.com
admatic.com.tr
adultactioncam.com adultactioncam.com
adultfullhd.com advertex.info
adultnet.in aibolita.com
aihelen.net airlandsea.info
allforminecraft.ru alert-fjg.xyz
allnews.md aliexpresscashback.club
allornamenti.com all-streaming-media.com
alphaforum.ru all4wap.ru
alta-realestate.com allblogroll.com
amt-k.ru allknow.info
appartement-stumm.at allsilver925.co.il
apper.de amateurmatch.com
arabsexxxtube.com angkortours.vn
arabseyes.com anniemation.com
arclk.net apartmentbay.ru
autotrends.today apelsinnik.website
avtointeres.ru apibatbrowsecom-a.akamaihd.net
ayodhya.co apibetweenlinesn-a.akamaihd.net
azlex.uz apibrowsesmartne-a.akamaihd.net
azte.ch appearance-cool.com
backuperwebcam.weebly.com apps-analytics.net
balook.com apptester.tk
baltgem.com arabgirls.adultgalls.com
bambi.ck.ua arendovalka.xyz
bamo.xsl.pt arraty.altervista.org
bannerads.de artdeko.info
aruplighting.com
asacopaco.tk
asociatia-tipografilor-transilvania.ro
asrvrep-a.akamaihd.net
atofilms.com
audiobangout.com
australia-opening-times.com
autobudpostach.club
autoloans.com
ayakino.net
azbukadiets.ru
back.dog
baladur.ru
bannerswap.com bannerswap.com
barbourjackets.online
bashtime.ru bashtime.ru
battle.net beauty-clinic.ru
bavsac.com bedandbreakfast.com
beauty-bracelet.com bedcapdealers.com
begalka.xyz berrymall.ru
besthoro.ru best-games.today
bestplacetobuyeriacta.jw.lt bestofupload.info
bestwebsiteawards.com betterhdporn.com
bezsporno.ru bgviagrachrx.com
bibys.com
big-cash.net
bimatoprost-careprost.com bimatoprost-careprost.com
bio-optomarket.ru bio-japan.net
blog.koreadaily.com birzha-truda.eu
blog.remote-computer.de bitcoinpile.com
blogqpot.com biteg.xyz
blue-square.biz bjetjt.com
bnt-team.com blacktwhite.com
bobba.dzaba.com blockety.co
bongacams.com blog.axant.it
bloke.com
boanonihaca.tk
boc.kz
bonzbuddy.com bonzbuddy.com
bookmark4you.com.biz bracketsmackdown.com
braintobe.win bradleylive.xyz
brainzpod.win brandedleadgeneration.com
buigas.00it.com brandehk.dk
bumskontakte.org breget74.ru
bytimedance.ru brendbutik.ru
cactussoft.biz burn-fat.ga
cam-kontakte.org buy-cheap-pills-order-online.com
camel-beach.com c-english.ru
candycrushshop.com c1.onedmp.com
canrole.com callstevens.com
cartierlove2u.xyz canzoni.ru
caulderwoodkennels.com carstrends2015.com
chastnoeporno.com cartierlovestore.com
cheapjerseysbizwholesale.us cartierring.xyz
chee-by.biz casablancamanor.co.za
christianlouboutinsaleonline.us cenoval.ru
cienum.fr centrdebut.ru
click2pawn.com cfcl.co.uk
clickcash.com chatroulette.world
clickprotects.com children-learningreading.info
clippingphotoindia.com ciceros.co
coldfilm.ru circlesl.com
collegerentals.com cjmc.info
cleanmypc.com
clickbanksites.info
clips.ua.ac.be
cocyq.inwtrade.com
com-supportcenter.website
comissionka.net
compliance-brian.top
compliance-elena.top compliance-elena.top
compliance-julianna.top compliance-fred.xyz
conboy.us constantaservice.net
contentsexpress.com cookie-law-enforcement-aa.xyz
cookielawblog.wordpress.com counciltally.com
cookingmeat.ru cranly.net
coolingoods.com
coslab.club
cpabegins.ru
creams.makeforum.eu
crynet.cc
cubook.supernew.org cubook.supernew.org
culturevie.info customerpromos-a.akamaihd.net
cymbaltaandtizanidine.blogspot.com cxpromote.com
cyse.tk davidovic.info
dailystrength.org
data.vtc.pw
dating-app.ru
delfin-aqua.com.ua
delitime.info
deniven.1bb.ru deniven.1bb.ru
dev33.dioniqlabb.se descargar-musica-gratis.net
dichvuvesinhhanoi.com designdevise.com
digest-project.ru detective01.ru
digital-sale.su detoxmed24.ru
dkvorota.ru diamond-necklace.info
dnepropetrovsk.mistr-x.org diarioaconcagua.com
dneprsvet.com.ua dikqlyremy.info
dojki365.online documentsite.net
domination.ml dogclothing.store
dosugrostov.site dollartree.info
dotnetdotcom.org domainsatcost.com
doublepimp.com donvito.unas.cz
drupa.com doreenblog.online
dscaas.website dostavimvdom.ru
dtm-spain.com eandsgallery.com
e705.net earn-from-articles.com
earncash.com.ua edwinkonijn.com.au
ee77ee.com ege-essay.ru
ekn-art.se elektronischezigarette2.mex.tl
elektroniksigaraankara.info elektrozigaretten1.tumblr.com
elitesportsadvisor.com erotik0049.com
elmacho.xyz etm-consult.de
eloxal.ru eu-cookie-law.blogspot.com
englishdictionaryfree.com eu-cookie-law.info
erotikstories.ru euronis-free.com
essayassist.com excitacao.com
everytalk.tv extlabs.io
excitacion.info eyemagination.com
exhibitionplus.eu ezb.elvenmachine.com
ezaz.info ezigarettekaufen2.blox.pl
ezigaretteshop2.mywapblog.com ezigaretteshop2.vefblog.net
face.hostingx.eu f-loaded.de
facecup.top f5mtrack.com
falcon-images.blogspot.com familyholiday.ml
farm26.ru favoritemoney.ru
farmprofi.net favornews.com
fbdownloader.com filmidivx.com
feorina.ru finuse.com
fetishinside.com flex4launch.ru
filkhbr.com foodgid.net
filmi-onlain.info forodvd.com
financetip.eu forzeronly.com
floating-share-buttons.com free-deals.faith
florida-tourism.net free-gluten.ru
focalink.com freesitetest.com
forex-procto.ru freewhatsappload.com
freenom.link friendflnder.com
front.to frighteningremain.cf
fun-mobi.pl fuckbuddybestgilf.info
fun2cell.net funnypica.com
funnymama.com
futbolkisales.ru futbolkisales.ru
fx-brokers-review.com gabeshop.ru
g33.org gardene.ru
galeon.com gelezki.com
gamedayassist.com getridofstretchmarks.org
gamerextra.com gg.zzyjxs.com
gamingspark.com gigapeta.com
ge0ip.org gilsonchiro.xyz
geilehausfrauen.net girlsfuckdick.com
gerhardhealer.com gk170.ru
get-free-social-traffic.com goodprotein.ru
getaclueamerica.com gratuitbaise.com
gfaq.ru greatfind-a.akamaihd.net
gifspics.com gsasearchengineranker.space
glall.ru gstatey.net
goblacked.com hamptonoaks.ca
golmau.host.sk handsandlegs.ru
goodly.pro hdfreeporno.net
goosefishpost.bid hdpixent.com
grupografico-pilar.com.ar heartofpayne.xyz
gsasearchenginerankerhelp.com hoholikik.club
guardlink.com hothor.se
guardlink.org housemilan.ru
hatedriveapart.com houtings.xyz
hchha.com howopen.ru
helpmymacfaster.trade
helvetia.com.ua
hem.passagen.se
heygidday.biz
highspeed5.net
homelygarden.com
hotdl.in
hoverboard360.es
hspline.com hspline.com
hully.altervista.org hustoon.over-blog.com
humbmosquina.tk hut1.ru
hunthillfarmtrust.org igadgetsworld.com
hybrid.ru igrovyeavtomaty777.ru
ihtec2019.org
iideaidekonkatu.info iideaidekonkatu.info
ilmexico.com imgarit.pw
impisr.ru imguramx.pw
inclk.com importchinacoach-teach.com
infektsii.com increasewwwtraffic.info
iplogger.org interesnie-faktu.ru
ipostroika.ru intermesh.net
isitpaleo.info iopeninghours.co.uk
isitwp.com iron-age.info
jackpotchances.com ivoiretechnocom.ci
janettabridal.com jamiembrown.com
japfm.com jav-idol.com
javstock.com job.icivil.ir
kaac.ru jrcigars.com
ketoanhanoi.info jrpmakati.com
keywordglobal.co.za karachev-city.ru
keywordsuggest.org kinofak.net
kladrus.ru kiwi237au.tk
konica.kz klumba55.ru
krasnodar.xrus.org kndxbkdx.bloger.index.hr
kredit-pod-zalog-krasnodar.ru kollekcioner.ru
kretpicf.pw komputers-best.ru
kursy-ege.ru kurwa.win
landmania.ru kwzf.net
landscaping.center ladsup.com
larchik.net laexotic.com
laserpen.club law-check-two.xyz
law-check-eight.xyz laxdrills.com
le-clos-des-alouettes.com le-clos-des-alouettes.com
listiseltemournlan.gq lego4x4.ru
liupis.com letto.by
livingcanarias.com lflash.ru
lonfon.xyz lion.misba.us
liquimondo.com
littlecity.ch
lordzfilmz.me
lostfilm-online.ru lostfilm-online.ru
low-format.ru lottospring.com
lrac.info louboutinreplica.pw
lsp-awak-perikanan.com
luciddiagnostics.in luciddiagnostics.in
m0r0zk0-krava.ru macresource.co.uk
macdamaged.tech mafa-free.com
mackeeper-center.club malls.com
maglid.ru manipulyator-peterburg.ru
manyresultshub-a.akamaihd.net marcoislandvacations.net
marketingtechniques.info marinetraffic.com
markjaybeefractal.com marketland.ml
massage-info.nl masturbate.co.uk
mastershef.club matb3aa.com
mature.free-websites.com mb140.ru
mearns-tractors.co.uk meet-flirt-dating.com
medicinacom.ru meetingrainstorm.bid
medictube.ru members.ghanaweb.com
meendo-free-traffic.ga
memberty.com memberty.com
microsearch.ru merryhouse.co.uk
mielec.pl methodsmarketing.com
minegam.com mex-annushka.ru
mirobuvi.com.ua michaelkorssaleoutletonline.net
mirzonru.net michellblog.online
mobstarr.com mikozstop.com
mockupui.com minet.club
moesen-ficken.com misandesign.se
mojowhois.com missclub.info
morefastermac.trade mlvc4zzw.space
mouselink.co mobilemedia.md
mp3films.ru mobioffertrck.com
mtmtv.info mobplayer.ru
music.utrolive.ru moivestiy.biz
myblogregistercm.tk mojaocena.com
myfreemp3.eu moje-recenze.cz
myindospace.com monitorwebsitespeed.com
mysex21.com mowser.com
networkad.net mp3downloadhq.com
networkcheck.xyz mrmoneymustache.com
nfljerseysforsalewholesaler.com muabancantho.info
nofreezingmac.click mug-na-chas-moscow.ru
nosecret.com.ua music7s.me
notaria-desalas.com musicstock.me
notfastfood.ru mydownloadengine.com
novgorod.xrus.org mydownlodablefiles.com
ntic.fr myfreecams.com
nudepatch.net myghillie.info
o-o-6-o-o.com myliveblog.ru
oballergiya.ru mymobilemoneypages.com
nagdak.ru
nailsimg.com
nakrutka.cc
namecrumilchlet.tk
nash-krym.info
nelc.edu.eg
nicefloor.co.uk
nisuturnetdgu.tk
npoet.ru
nucia.biz.ly
nw-servis.ru
o-dachnik.ru
obesidadealgarve.com
okmusic.jp
olympescort.com
one-gear.com one-gear.com
ooo-olni.ru online247.ml
oops-cinema.ru ons-add.men
openfrost.com openmediasoft.com
orgasmus-virtual.com optikremont.ru
osagonline.ru oralsexfilme.net
otbelivanie-zubov.com orion-code-access.net
ororodnik.goodbb.ru
ostroike.org
outpersonals.com
outshop.ru outshop.ru
owohho.com owathemes.com
paintingplanet.ru parfusale.se
park.above.com partner-high.men
pastaleads.com partnersafe.men
pb-dv.ru pcads.ru
pdamods.ru pcboa.se
pechikamini.ru picmoonco.pw
pensplan4u.com picquery.com
pepperstyle.ru
pertlocogasilk.tk
pestomou.info
petsblogroll.com
photochki.com
picscout.com
picturesfrom.com picturesfrom.com
pierrehardysale.online pinapchik.com
pinwallpaper.xyz pinwallpaper.top
pixgood.com pk-services.ru
pizda.lol
platezhka.net
play-movie.pl
pochemychka.net
polytopesexempt.com polytopesexempt.com
pony-business.com pomoc-drogowa.cba.pl
popugauka.ru poptool.net
porndroids.com pornhub-forum.ga
porno-dojki.net pornosee.info
pornogad.com pornotubexxx.name
pornogratisdiario.com pornstartits.xblog.in
pornoklad.net portadd.men
pornolook.net positive2b.ru
pornosmola.info potoideas.us
pornozhara.com presleycollectibles.com
pr0fit-b0x.com pricheskaonline.ru
prchecker.info printingpeach.com
preparevideosafesystem4unow.space privetsochi.ru
prizestohandle.club prizefestival.mobi
prodess.ru proekt-mos.ru
prokotov.com pronekut.com
promover.org ptr.ruvds.com
prostitutki-rostova.org puserving.com
psvita.ru putevka24.ru
qld10000.net qualitymarketzone.com
quick-offer.com raavidesigns.com
ranksays.com registry-cleaner.net
rapidgator-porn.ga registrydomainservices.com
regionshop.biz reklama-i-rabota.ru
remont-komputerov-notebook.ru reklamuss.ru
remontvsamare.su remont-fridge-tv.ru
rennlist.com
restaurantlescampi.com restaurantlescampi.com
ric.info rezeptiblud.ru
richinvestmonitor.com rozalli.com
rrutw.com rrutw.com
ru-dety.ru rucrypt.com
rus-pornuha.com s8-nowy-wygraj.comli.com
rutor.vip sady-urala.ru
rybalka-opt.ru safe-app.net
s-iwantyou.com sajatvelemeny.com
saitevpatorii.com sammlungfotos.online
sanjosestartups.com santechnik.jimdo.com
satellite.maps.ilovevitaly.com sarahmilne.top
satoristudio.net saugatuck.com
saveriopiazza.it
sayyoethe.blogspot.co.za
sbprabooks.com sbprabooks.com
sbtdesign.co.uk scanner-don.top
scanhub.ru scanner-donald.top
scanner-george.top scanner-jane.top
scanner-josh.top
scanner-mark.top
scanner-walt.top scanner-walt.top
scenarii-1-sentyabrya.uroki.org.ua scenarii-1-sentyabrya.uroki.org.ua
screpy.com searchengineranker.email
searchimpression.com seo18.su
searchwebknow-a.akamaihd.net
seasaltwithfood.com
seccioncontrabajo.com
segol.tv
sell-fb-group-here.com
seo-smm.kz
seoanalyses.com
seoholding.com seoholding.com
seorankinglinks.us sevendays.com.ua
seorankinglinks.xyz sex-znakomstva.online
sergiorossistore.online sex.hotblog.top
serving.adbetclickin.pink sexkontakteao.info
sexkvartal.com sexsearch.com
sexpornotales.com sexy.babes.frontend-stack.top
shariki-zuma-lines.ru sexyali.com
shiksabd.com sibtest.ru
shlyahten.ru silverage.ru
shopsellcardsdumps.com simple-share-buttons.com
shtaketniki.kz
sildenafil-tadalafil.info
simpoed.ufop.br
sisi-go.ru
site.ru site.ru
siteheart.net site5.com
sitevaluation.org smichovbike.cz
slowmac.tech sms2x2.ru
smailik.org sneakyboy.com
snjatie-geroinovoy-lomki.ru social-button.xyz
soc-proof.su socialtrade.biz
sohoindia.net sofit-dmd.ru
solicita.info softtor.com
sonnikforme.ru softwaretrend.net
soochi.co soviet-portal.do.am
sportbetfair.com spasswelt.xyz
srgwebmail.nl spin2016.cf
stroilka.info sports-supplements.us
strongsignal-a.akamaihd.net spravka130.ru
suchenindeutschland.com spylog.com
sucsesofinspiration.com spymac.net
suhanpacktech.com sribno.net
supernew.org steamoff.net
superstarfloraluk.com sudexpert66.ru
sumo.com
supermodni.com.ua
superstats.com superstats.com
svensk-poesi.com tacbelarus.ru
swiped.su tako3.com
tanieaukcje.com.pl tamada69.com
taraz.xkaz.org
tecnoteakviareggio.it tecnoteakviareggio.it
telefonsexsofort.tk teencastingporn.com
telemetryverification.net telefonsex-ohne0900.net
telesvoboda.ru telefonsexkostenlos.tk
thaismartloan.com the-trader.net
thecoolimages.net thepokertimer.com
thecoral.com.br thetattoohut.com
theendivechronicles.com thin.me.pn
tiens2010.ru tilido.com
tizanidinestreetprice.blogspot.com timer4web.com
tizanidinewithdrawalsymptoms.blogspot.com tizanidineandcipro.blogspot.com
todohr.com tizanidineforopiatewithdrawal.blogspot.com
tomatis.gospartner.com tizanidinepain.blogspot.com
topclickguru.com toon-families.com
topshef.ru tootoo.to
torrentred.games torrentdownloadhub.com
torrents-tracker.com torrentgamer.net
totu.us trafficgenius.xyz
toys.erolove.in trafficjunky.com
tracxn.com trafficreceiver.club
traderzplanet.in tupper-posuda.ru
traffixer.com turbabitload.weebly.com
tuckpointingmasonrysystems.com turbodsp.com
tv-spoty.info tyumen.xrus.org
twu.com.ua uamtrk.com
ukrtextbook.com uchil.net
ultramart.biz ukkelberg.no
underthesite.com ukrtvory.in.ua
uptime-gamma.net unitygame3d.com
urldelivery.com uptimebot.net
uroffer.link
usswrite.com usswrite.com
v-doc.co vadimkravtcov.ru
varikozdok.ru vapeface.club
vbikse.com varbergsvind.se
vegascosmetics.ru vbtracker.net
ventelnos.com vclicks.net
veselokloun.ru vduplo.ru
videochat.world vegan-foods.us
vip-dom.in via-energy-acquistare.com
visa-china.ru viagra-soft.ru
vkak.ru videogamesecrets.com
videospornogratisx.net
vk-mus.ru
vkonche.com vkonche.com
vladhistory.com vkontaktemusic.ru
vltai.com vkontarkte.com
voditeltrezviy.ru voloslove.ru
voluumtracker1.com wallpaperaccess.com
voluumtrk.com
vtc.pw
vtcdns.com
w-journal.ru
walkme.com
watchmyfb.pl
we-are-gamers.com
webix.me webix.me
webmasters.stackexchange.com weblibrary.win
weboptimizes.com weblo.com
webstatsdomain.org website-speed-checker.site
wedding0venues.tk website-speed-up.top
weekes.biz.tc wechatdownload10.com
wejdz-tu.pl weclipart.com
wesharepics.com whatistizanidine2mg.blogspot.com
westum.se whatzmyip.net
westvilletowingservices.co.za wholesalejerseysgaa.com
whatsappbot.flyland.ru womensplay.net
witherrom55.eklablog.fr wpsecurity.website
worldoffiles.ru www.timer4web.com
wovis.site wygraj-teraz.com
www.888.com x-diesel.info
www.bookmaker-bets.com xclicks.net
www.get-free-traffic-now.com xcombear.ru
x-diesel.biz xn----7sbaaabaei0cc8aj5bj0bncejx.xn--p1ai
xev.ru xn----7sbbahaq9bb5afgiqfliv4m.xn--p1ai
xn-----8kcatubaocd1bneepefojs1h2e.xn--p1ai
xn----8sbhefaln6acifdaon5c6f4axh.xn--p1ai
xn----8sblgmbj1a1bk8l.xn----161-4vemb6cjl7anbaea3afninj.xn--p1ai
xn--1-8sbcpb0bdm8k6a.xn--p1ai
xn--80aaagvmjabrs1aoc9luc.xn--p1ai
xn--80aaajbdbddwj2alwjieei2afr3v.xn--p1ai xn--80aaajbdbddwj2alwjieei2afr3v.xn--p1ai
xn--d1acah0c.xn--p1ai xn--80ajjbdhgmudixfjc8c5a9df8b.xn--p1ai
xn--l1aengat.xn--p1ai xpresscare.ru
xwatt.ru yaminecraft.ru
xxxnatelefon.ru ynymnwbm.bloger.index.hr
yaderenergy.ru yoshkarola.zrus.org
yatrk.xyz yun56.co
yellowstonesafaritours.com za-music.mymobiplanet.com
youbrainboost.asia zarenica.net
yur-p.ru zdesformula.ru
zajm-pod-zalog-nedvizhimosti.ru znakom.sibtest.ru
zeikopay.com zona-aqua.ru
zeroredirect2.com zskdla.site
zigarettenonlinekaufen2.bloog.pl zvuker.net
zmoda.hostreo.com zytpirwai.net
zojirushi-products.ru
zophim.me
zzlgxh.com

482
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
08800.top 1adult.com
0c47f8422d3f.com 2345.com
101raccoon.ru 4rent.ru
10bet.com 5forex.ru
256bit.by aac52006ec82a24e08b665f4db2b5013f7.com
3weekdiet.com adobereader-free.ru
aaronabel.com adventureparkcostarica.com
aktobe.xkaz.org adzerg.com
alert-hgd.xyz
algerianembassy.co.in
allknow.info allknow.info
alpharma.net allmarketsnewdayli.gdn
amehdaily.com allnews.md
apidiamondatanet-a.akamaihd.net alta-realestate.com
apimountainbikei-a.akamaihd.net amateurmatch.com
ample-awards-today.us
animenime.ru
apiluckyleapnet-a.akamaihd.net
apioasisspacenet-a.akamaihd.net apioasisspacenet-a.akamaihd.net
apparel-offer.com apiwoodensealcom-a.akamaihd.net
appfixing.space arenanews.com.ua
astrochicks.com asrv-a.akamaihd.net
autorn.ru auto4style.ru
avtolombard-krasnodar.ru aviapanda.ru
azartmix.com balkanfarma.ru
azbukafree.com battle.net
balitouroffice.com bausparen.bz.it
bankofthewext.com bestpriceninja.com
bannertesting.com biglistofwebsites.com
bayareaaeroclub.org bio-japan.net
belsetirehafi.tk
belstaffstore.online
best-businessman.ru
bestbrainprod.win
bestfortraders.com
besttorrentknifta.weebly.com
bif-ru.info
bimatoprost-careprost.com
bizzliving.com bizzliving.com
bonanza-fortune.men bjetjt.com
brainboostingsupplements.org bloggers.nl
brakehawk.com blogporn.in
brateg.xyz bluerobot.info
breget74.ru boc.kz
bugshoot.cn budilneg.xyz
buqayy0.livejournal.com carabela.com.do
carrauterie.be carmuffler.net
carson.getenjoyment.net centraletermice.us
cdn.walkme.com certifywebsite.win
cete.ru
chiptuninger.com chiptuninger.com
cigarpass.com cialisovercounteratwalmartusa.com
co.lumb.co cobaltpro.ru
codysbbq.com
community.allhiphop.com community.allhiphop.com
compliance-alex.xyz compliance-checker-7.info
compliance-alexa.xyz compliance-george.top
compliance-elena.top customerguru.in
coolwallpapers-hd.com customerpromos-a.akamaihd.net
country-chic.ru d-black.bz
covadhosting.biz darkages.info
creditwell.ru dividendo.ru
cscwtalkto.site dojki-hd.com
daooda.com dood.live
darkbooks.org drugs-no-rx.info
data1.scopich.com electricwheelchairsarea.com
design-ideas.info elvel.com.ua
dogbreedspicture.net encodable.com
domain-submit.info energydiet-info.ru
domaincheck.io enge-fotzen.info
download-wallpaper.net englishdictionaryfree.com
downtuptv.gq enskedesquashclub.se
doyouknowtheword-flummox.ml erot.co
e-poker-2005.com excaliburfilms.com
earncash.com.ua extractorandburner.com
ebooknovel.club ezigaretteshop2.vefblog.net
elektrozigarettekaufen1.devhub.com facialporntube.com
elektrozigaretten1.postbit.com fanpagerobot.com
embedle.com
esnm.ru
everytalk.tv
exoclick.com
ezigaretteshop2.mywapblog.com
ezrvrentals.com
facecup.top
fanoboi.com
fashionavenuegame.com fashionavenuegame.com
felizporno.com felizporno.com
fenoyl.batcave.net fickenbumsen.net
ferieboligkbh.dk forum.doctissimo.fr
flipper.top gamevalue7.weebly.com
floridahuntingfishingadventures.com gdcentre.ru
flowwwers.com gifspics.com
footballfarrago.com girlsatgames.ru
fr.netlog.com go2jump.org
free-laptop-reward.com goodhousekeeping.com
free-share-buttons.com gopixdatabase.com
freevpn.space gosmeb.ru
g7m.pl greatgrace.ru
galaxyflowers.ru groupmoney.ru
galleryawesome.com growboxbl.ru
gameonasia.com gsasearchengineranker.pw
gemgrab-a.akamaihd.net gsasearchengineranker.site
gigixo.com gsbs.com.ua
googlefeud.com gstatey.net
gungamesz.com gunsvicceadadebt.tk
gwebtools.com hamacapty.com
hannasolution.ru happy.new.yeartwit.com
hasshe.com headpharmacy.com
health-medical-portal.info help.tpu.ru
heatpower.ru historichometeam.com
hidemyass.com hmywwogw.bloger.index.hr
hoporno.com hol.es
housekuba.org hothot.ru
howlongdoestizanidinestayinyoursystem.blogspot.com houtings.xyz
hreade.com imabase.com
hyhj.info imperia31.ru
iboss.com in-tandem.co
iideaidekonkatu.info incolors.club
ikearugs.xyz indo-export.ru
imfamous.info jaxcube.info
imgata.com jetsli.de
intimshop-fantasy.ru juliadiets.com
invest-pamm.ru kino-ecran.ru
islamtoday.co.za kinofak.net
isoveti.ru kinosed.net
itbc.kiev.ua kollekcioner.ru
joyceblog.top kostenlos-sexvideos.com
jrpmakati.com laptoper.net
kambasoft.com larose.jb2c.me
kellyonline.xyz law-check-nine.xyz
ladsblue.com lkbennettstore.online
law-check-two.xyz locationdesaison.com
laxdrills.com louisvuittonoutletstore.net
lezbiyanki.net mabdoola.blogspot.com
liquimondo.com macrotek.ru
lirunet.ru markjaybeefractal.com
lumb.co maslenka.kz
marinetraffic.com mbiologi.ru
marketingvici.com meet-flirt-dating.com
medkritika.ru megahdporno.net
moesen-ficken.com mhi-systems.ru
moneyteam24.com micasainvest.com
morpicert.pw miniature.io
most.gov.iq monclercheap.xyz
mrbojikobi4.biz morefastermac.trade
muizre.ru morlat.altervista.org
mundoaberrante.com mototsikl.org
mydeathspace.com mtmtv.info
new7ob.com mydownlodablefiles.com
newstraveller.ru mysexpics.ru
northfacestore.online namecrumilchlet.tk
novosibirsk.xrus.org nordstar.pro
oakridgemo.com noumeda.com
obiavo.uz november-lax.com
offtime.ru nsatc.net
ok-ua.info oddamzadarmo.eu
okuos.com offergroup.info
onlineserialy.ru onlinebay.ru
ops.picscout.com onlyforemont.ru
optitrade24.com outshop.ru
oxford-book.com.ua owathemes.com
pammik.ru paccohichetoti.ml
partybunny.ru palocco.it
pc-test.net pastaleads.com
pepperstyle.ru photo.houseofgaga.ru
physfunc.ru picmoonco.pw
poiskzakona.ru pics-group.com
polcin.de pk-services.ru
popmarker.com plastweb.ru
porn-w.org pontiacsolstice.info
pornophoto.xyz pooleroadmedicalcentre.co.uk
poppen-nw.net
popup-jdh.xyz
pornoted.com
predmety.in.ua predmety.in.ua
profitkode.com prizeestates.cricket
pts163.ru produkto.net
puzzleweb.ru professionalwritingservices15.blogspot.ru
quickcashlimited.com quelle.ru
ranking2017.ga qwertty.net
rankingchart.de r-control.ru
realmonte.net rarbg.to
rfd-split.hr razvratnoe.org
ribieiendom.no redbottomheels.xyz
ruspdd.com rep-am.com
russkie-gorki.ru rossmark.ru
samolet.fr roznica.com.ua
sawin.beth.webd.pl rubbed.us
scalerite.co.za ruf777.com
scanner-margo.top runstocks.com
semp.net rusvideos.su
seoexperimenty.ru saletool.ru
service-core.ru sashagreyblog.ga
sexkontakteao.info sbt-aqua.ru
sexkrasivo.net score-ads.men
search.pch.com
searchimpression.com
seasaltwithfood.com
seccioncontrabajo.com
seksotur.ru
semrush.com
serdcenebolit.com
serviporno.com
sexcamamateurchat.com
sexpornotales.com
sexstream.pl
sexy-screen-savers.com
sharebutton.net
sibvitr.ru
sierraapps.com sierraapps.com
simple-share-buttons.com sim-service.net
sisi-go.ru skatestick.bid
sitebeam.net spinnerco.ca
siteimprove.com spymac.net
socas.pluto.ro stretchmate.net
softxaker.ru strongholdsb.ru
space-worry.ml superoboi.com.ua
spasswelt.xyz swinger-mobil.net
stauga.altervista.org tabakur77.com
stillmiracle.com teencastingporn.com
store-rx.com thebitcoincode.com
stroydetali.ru thenews-today.info
surgut.zrus.org tizanidinehcl4mgisitanarcotic.blogspot.com
svetodiodoff.ru top250movies.ru
tanieaukcje.com.pl topappspro.com
thecoolimages.net torrentdownloadhub.com
thedownloadfromwarez.blogspot.com traffmonster.info
thegioixekhach.com tri-slona.org
thetoiletpaper.com trk-4.net
tizanidinecost.blogspot.com truemfilelj.gq
tonerbox.kz tsan.net
top1-seo-service.com tuberkuleznik.ru
topcasinoratings.ru turist-strani.ru
topvidos.ru userequip.com
torrentgamer.net uvozdeckych.info
touchmods.fr vedomstvo.net
tripper.de vekzdorov.ru
triumf-realty.ru vgoloveboli.net
truck-rece.life vinsit.ru
tubeoffline.com vodkoved.ru
twitlinks.com vote-up.ru
twittruth.com vut.com.ru
ugguk.online warningwar.ru
unisexjewelry.org watracker.net
uytmaster.ru website-datenbank.de
vancleefreplica.pw weddingdresses.xyz
veopornogratis.xxx westsextube.com
viktoria-center.ru westum.se
vitalads.net whatzmyip.net
vsexkontakte.net wingsoffury2.com
web-analytics.date winwotgold.pl
webjam.com wnhjavlhezp.gq
webpromotion.ae wormix-cheats.ru
website-speed-up.top worst-sites.online
wedding0venues.tk www.jbetting.com
weprik.ru x-diesel.com
whatsappbot.flyland.ru xn-----6kcaabbafhu7cskl7akvongwpo7hvjj.xn--p1ai
white-truck.life xn----8sbarihbihxpxqgaf0g1e.xn--80adxhks
wholesalejerseys-cheapest.com xn--80ahvj9e.xn--p1ai
wholinkstome.com xportvusbdriver8i.snack.ws
wygraj-skiny.win xxxdatinglocal.us
x-porno.video yellowproxy.net
xn----btbdvdh4aafrfciljm6k.xn--p1ai yourdesires.ru
xn--80aaafbn2bc2ahdfrfkln6l.xn--p1ai yourtemplatefinder.com
xn--b1agm2d.net zaidia.xhost.ro
yatrk.xyz zebramart.ru
yougotanewdomain.com zs2vm.top
zdesformula.ru zx6.ru
zeleznobeton.ru
zoogdinsney.com

9
dev-tools/test_units/ratelimittest-beta.txt
View file

@ -8,14 +8,7 @@
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html><html> </html>ml>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head> <head><title>503 Service Temporarily Unavailable</title></head>
<body> <body>
<center><h1>503 Service Temporarily Unavailable</h1></center> <center><h1>503 Service Temporarily Unavailable</h1></center>

12
dev-tools/test_units/ratelimittest-master.txt
View file

@ -1,21 +1,11 @@
<!DOCTYPE html>
<html> <html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html><html>
<head><title>503 Service Temporarily Unavailable</title></head> <head><title>503 Service Temporarily Unavailable</title></head>
<body> <body>
<center><h1>503 Service Temporarily Unavailable</h1></center> <center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center> <hr><center>nginx/1.18.0 (Ubuntu)</center>
</body> </body>
</html> </html>
<html> ml><html>
<head><title>503 Service Temporarily Unavailable</title></head> <head><title>503 Service Temporarily Unavailable</title></head>
<body> <body>
<center><h1>503 Service Temporarily Unavailable</h1></center> <center><h1>503 Service Temporarily Unavailable</h1></center>

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.117 0; 10.1.0.52 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.07.3244 ### Version: V4.2022.07.3245
### Updated: Sat Jul 23 06:59:07 UTC 2022 ### Updated: Sat Jul 23 10:03:36 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.07.3244 ### Version: V4.2022.07.3245
### Updated: Sat Jul 23 06:59:07 UTC 2022 ### Updated: Sat Jul 23 10:03:36 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##