vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-08 05:29:41 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2022.06.3176 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2022-06-19 10:09:07 +00:00
parent b919f26e13
commit cedaf813dd
47 changed files with 106164 additions and 106171 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.06.3175 #### Version: V4.2022.06.3176
#### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.06.3175 #### Version: V4.2022.06.3176
#### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -14,7 +14,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2022.06.3175 #### Version: V4.2022.06.3176
#### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

13128
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2022.06.3175 #### Version: V4.2022.06.3176
#### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

13132
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

13132
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

13132
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

13132
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.48 1; 10.1.0.134 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.48 0; 10.1.0.134 0;
127.0.0.1 0; 127.0.0.1 0;

13132
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.48 1; 10.1.0.134 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.48 0; 10.1.0.134 0;
127.0.0.1 0; 127.0.0.1 0;

13132
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.48 1; 10.1.0.134 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.48 0; 10.1.0.134 0;
127.0.0.1 0; 127.0.0.1 0;

13132
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
3175 3176

13132
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

13132
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.245.195.133 0; 20.122.13.233 0;

13132
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.48 1; 10.1.0.134 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.48 0; 10.1.0.134 0;
127.0.0.1 0; 127.0.0.1 0;

13132
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.48 1; 10.1.0.134 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.48 0; 10.1.0.134 0;
127.0.0.1 0; 127.0.0.1 0;

13132
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.48 1; 10.1.0.134 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.48 0; 10.1.0.134 0;
127.0.0.1 0; 127.0.0.1 0;

13132
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.245.195.133 0; 20.122.13.233 0;

13132
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.245.195.133 0; 20.122.13.233 0;

13132
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.48 1; 10.1.0.134 1;
127.0.0.1 1; 127.0.0.1 1;

18
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
Aboundexbot ExtLinksBot
Custo GalaxyBot
Ezooms LeechFTP
Libwhisker PHPCrawl
MSIECrawler SBIder
Mag-Net ScanAlert
Piepmatz Spammen
T0PHackTeam
TheNomad
Thumbor Thumbor
Who.is Bot
Widow

282
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
01h4x.com 404checker
80legs 404enemy
ASPSeek
Abonti
Acunetix Acunetix
AhrefsBot
AiHitBot AiHitBot
Alexibot Aipbot
AllSubmitter
AlphaBot AlphaBot
Anarchy
Anarchy99
Ankit Ankit
Aspiegel
Asterias
Attach Attach
BBBike AwarioSmartBot
Bandit BDFetch
BatchFTP BackStreet
BackWeb
Barkrowler
BetaBot BetaBot
Black Hole Bigfoot
Bitacle
BlackWidow BlackWidow
Blackboard
Blow Blow
BlowFish BlowFish
Bolt Bolt
BotALot
Brandprotect Brandprotect
BuiltWith BuiltBotTough
CATExplorador CATExplorador
CCBot Cegbfeieh
CazoodleBot
CheTeam CheTeam
CheeseBot
CherryPicker CherryPicker
ChinaClaw
Chlooe Chlooe
Citoid Citoid
Cliqzbot Claritybot
Collector Cogentbot
CopyRightCheck CopyRightCheck
Copyscape
Cosmos
Craftbot Craftbot
Crawling at Home Project
CrazyWebCrawler
Crescent
Curious Curious
Custo
DBLBot DBLBot
Digincore DataCha0s
DigitalPebble DatabaseDriverMysqli
Dirbuster Disco
Discobot
DittoSpyder DittoSpyder
DnBCrawler-Analytics DomainAppender
DomCopBot
DomainCrawler
DomainSigmaCrawler DomainSigmaCrawler
Domains Project DomainStatsBot
Download Wonder
Dragonfly
ECCP/1.0 ECCP/1.0
EMail Siphon EMail Siphon
Ebingbong Ebingbong
Ecxi Ecxi
EirGrabber EirGrabber
Extractor
ExtractorPro
Extreme Picture Finder Extreme Picture Finder
Ezooms Ezooms
Fimap FrontPage
FlashGet
FyberSpider FyberSpider
Fyrebot Fyrebot
GT::WWW G-i-g-a-b-o-t
GermCrawler GetRight
GetWeb
Go!Zilla Go!Zilla
Go-Ahead-Got-It Go-Ahead-Got-It
GoZilla Gotit
GrabNet Grabber
GrapeshotCrawler Grafula
HTTP::Lite GrapeFX
HTTrack GridBot
Hloader Hloader
HonoluluBot Humanlinks
HybridBot HybridBot
IRLbot IDBTE4M
IDBot
Iblog
IlseBot IlseBot
Image Fetch
Intelliseek Intelliseek
InterGET Iskanie
InternetSeer
Iria
JOC Web Spider
JamesBOT JamesBOT
JikeSpider Jbrofuzz
JustView JennyBot
Kenjin Spider JetCar
LWP::Simple Jetty
Jyxobot
Leap Leap
LeechFTP
LeechGet LeechGet
LibWeb LexiBot
Libwhisker Lftp
Lightspeedsystems
Likse Likse
LinkWalker
LinkextractorPro LinkextractorPro
LinqiaScrapeBot LinqiaRSSBot
Lipperhey Spider Lipperhey
Ltx71 Ltx71
MFC_Tear_Sample MFC_Tear_Sample
MJ12bot MIIxpc
MQQBrowser MTRobot
MSFrontPage Magnet
MSIECrawler Majestic-SEO
Majestic12 Majestic12
MarkMonitor
Mass Downloader
Mata Hari Mata Hari
MauiBot Mb2345Browser
Mediatoolkitbot MeanPath Bot
Mister PiX Microsoft URL Control
Mojolicious Moblie Safari
Morfeus Fucking Scanner
Mozlila Mozlila
Musobot
NICErsPRO NICErsPRO
Navroad Navroad
NetAnts Needle
Net Vampire
NetLyzer NetLyzer
Netcraft NetMechanic
NetSpider
Nettrack Nettrack
Netvibes Netvibes
Nikto Nibbler
Nmap Niki-bot
Not NimbleCrawler
Nutch Nimbostratus
Offline Explorer Ninja
OnCrawl Octopus
OpenVAS
Openfind Openfind
Openvas
OrangeBot OrangeBot
OutfoxBot OrangeSpider
PageAnalyzer OutclicksBot
PageScorer Page Analyzer
PageThing.com PageGrabber
Pandalytics
Papa Foto Papa Foto
Pavuk
Pi-Monster Pi-Monster
Picsearch Picsearch
PleaseCrawl PictureFinder
Pimonster
Pixray
ProPowerBot ProPowerBot
Psbot Psbot
PxBroker Pump
PyCurl
QueryN Metasearch QueryN Metasearch
Quick-Crawler
RSSingBot RSSingBot
RankActiveLinkBot
RankFlex RankFlex
RankingBot RankingBot2
Rankivabot
RealDownload RealDownload
RebelMouse RebelMouse
Recorder Ripper
RocketCrawler Rogerbot
SBIder
SEOkicks-Robot SEOkicks-Robot
SEOlyticsCrawler
SEOstats SEOstats
SISTRIX SISTRIX
SMTBot
SalesIntelligent SalesIntelligent
Scrapy ScanAlert
Screaming
ScreenerBot
ScrepyBot
Searchestate Searchestate
SearchmetricsBot
Seekport Seekport
Shodan Seomoz
Siphon
Site Sucker Site Sucker
SiteSucker SiteCheckerBotCrawler
Sitebeam SiteLockSpider
Sitevigil Snake
SmartDownload
Snapbot Snapbot
Snoopy Snoopy
SocialRankIOBot SocialRankIOBot
SpaceBison Sottopop
SpankBot SpankBot
Spbot Sqlworm
Spinn3r
Sqlmap
Sqworm Sqworm
Stripper
Sucuri
SuperBot SuperBot
SurveyBot
Suzuran Suzuran
Szukacz
T0PHackTeam T0PHackTeam
Teleport Telesoft
TeleportPro Telesphorep
TightTwatBot TheNomad
Titan
Toweyabot Toweyabot
Trendictionbot
True_Robot
Turnitin Turnitin
Typhoeus
URLy Warning URLy Warning
VB Project URLy.Warning
Vacuum Vacuum
VelenPublicWebCrawler VeriCiteCrawler
VidibleScraper
Voil
Voltron Voltron
WBSearchBot
WISENutbot WISENutbot
WWW-Collector-E WWW-Mechanize
Wallpapers/3.0 WallpapersHD
WeSEE Web Auto
Web Collage
Web Enhancer Web Enhancer
Web Fetch WebBandit
Web Pix WebCollage
WebCopier WebCopier
WebEnhancer WebEnhancer
WebFetch WebFetch
WebFuck
WebImageCollector
WebReaper WebReaper
WebZIP
Webshag Webshag
WebsiteExtractor
WebsiteQuester WebsiteQuester
Webster
Whack Whack
Whacker Whacker
Who.is Bot Whatweb
Widow
WiseGuys Robot WiseGuys Robot
Wonderbot
Woobot Woobot
Wprecon Wprecon
Xaldon WebSpider Xaldon WebSpider
Xenu
YoudaoBot YoudaoBot
Zermelo
Zeus Zeus
Zitebot
ZoominfoBot ZoominfoBot
ZumBot ZyBorg
adscanner arquivo.pt
backlink-check autoemailspider
crawler4j cognitiveseo
com.plumanalytics
crawl.sogou.com
dataforseo.com dataforseo.com
evc-batch domainsproject.org
eCatch
facebookscraper
heritrix
instabid
isitwp.com isitwp.com
iubenda-radar
linkdexbot linkdexbot
meanpathbot
mediawords
muhstik-scan
oBot oBot
plumanalytics page scorer
probe-image-size ripz
s1z.ru scan.lol
satoristudio.net seobility
scalaj-http
sexsearcher sexsearcher
sitechecker.pro sitechecker.pro
siteripz sp_auditbot
sysscan sysscan
tAkeOut tAkeOut
trendiction.de voyagerx.com
zgrab x09Mozilla
xpymep1.exe

312
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
360Spider 01h4x.com
404checker
404enemy
ADmantX ADmantX
ASPSeek ALittle Client
Abonti Abonti
AfD-Verbotsverfahren Acunetix
Alexibot Anarchy
Anthill
Aspiegel
Asterias
Attach
AwarioSmartBot AwarioSmartBot
BLEXBot BBBike
BackStreet BackStreet
BackWeb BackWeb
Backlink-Ceck
Badass Badass
Barkrowler
Battleztar Bazinga Battleztar Bazinga
Bigfoot Black Hole
Boardreader Blow
Bolt Bolt
Brandprotect Brandprotect
Brandwatch BuiltBotTough
Buck BunnySlippers
Bullseye
BuzzSumo BuzzSumo
CCBot CCBot
CSHttp CODE87
Calculon
CazoodleBot CazoodleBot
CheTeam CheeseBot
CherryPicker
ChinaClaw ChinaClaw
Citoid
Cogentbot
Copier Copier
Copyscape CopyRightCheck
Cosmos Cosmos
Crawling at Home Project Crawling at Home Project
CrunchBot
Curious
Custo Custo
CyotekWebCopy CyotekWebCopy
DatabaseDriverMysqli DBLBot
Demon Demon
Deusu Deusu
Discoverybot Devil
DnyzBot Digincore
DomainSigmaCrawler DigitalPebble
Dotbot Dirbuster
Download Wonder DnBCrawler-Analytics
Dragonfly DomainStatsBot
Domains Project
Drip Drip
EMail Wolf Ebingbong
EasyDL EirGrabber
EroCrawler EroCrawler
Evil
Exabot Exabot
Extreme Picture Finder ExtractorPro
EyeNetIE
Ezooms Ezooms
FemtosearchBot FemtosearchBot
Firefox/7.0 Flunky
Freeuploader FrontPage
FyberSpider FyberSpider
GT::WWW Fyrebot
Getintent G-i-g-a-b-o-t
GrapeFX GermCrawler
GridBot Gigabot
Go!Zilla
GrabNet
GrapeshotCrawler
HTTP::Lite HTTP::Lite
Harvest HTTrack
Heritrix Haansoft
Humanlinks HaosouSpider
Havij
HonoluluBot
IDBTE4M
IDBot IDBot
IRLbot IlseBot
Id-search
Image Fetch Image Fetch
Image Sucker
Indy Library
InfoNaviRobot InfoNaviRobot
InfoTekies Intelliseek
InternetSeer InterGET
JOC Web Spider Iria
JamesBOT Iskanie
Jetty JetCar
Joomla Joomla
JustView JustView
Kenjin Spider Lanshanbot
LNSpiderguy Larbin
LWP::Simple Leap
LeechFTP LeechFTP
Lftp LibWeb
Libwhisker LieBaoFast
Lightspeedsystems
Likse
Linkbot
LinkpadBot LinkpadBot
LinksManager LinqiaScrapeBot
Lipperhey Lipperhey Spider
Litemage_walker
Ltx71
MFC_Tear_Sample
MJ12bot
MQQBrowser
MSFrontPage MSFrontPage
MSIECrawler MTRobot
MarkMonitor Majestic-SEO
MarkWatch Majestic12
Mass Downloader Mass Downloader
Mata Hari Masscan
MauiBot Metauri
Meanpathbot Minefield
Mediatoolkitbot Mister PiX
Microsoft Data Access Moblie Safari
Microsoft URL Control Mojeek
Mojolicious
MolokaiBot
Morfeus Fucking Scanner Morfeus Fucking Scanner
NICErsPRO Mr.4x3
Net Vampire Nameprotect
NetMechanic NetMechanic
NetSpider
Netcraft Netcraft
Nettrack Nettrack
Netvibes Netvibes
NextGenSearchBot
Nibbler Nibbler
NimbleCrawler Niki-bot
Nimbostratus Ninja
Nmap Nutch
Nuclei Openvas
Offline Explorer
OnCrawl
OpenLinkProfiler
OpenVAS
OutclicksBot OutclicksBot
Page Analyzer OutfoxBot
PageAnalyzer
PageScorer
PageThing.com PageThing.com
Pandalytics Papa Foto
PeoplePal PeoplePal
Pi-Monster Pi-Monster
Picscout Picscout
Picsearch Picsearch
PictureFinder PictureFinder
PleaseCrawl Piepmatz
Pockey Pimonster
Psbot ProPowerBot
ProWebWalker
Pu_iN Pu_iN
Pump
PxBroker PxBroker
PyCurl Quick-Crawler
QueryN Metasearch RankFlex
RSSingBot RankingBot2
RankActive RepoMonkey
RankingBot Ripper
RankurBot SEOkicks
RealDownload SEOlyticsCrawler
Reaper
RebelMouse
Rogerbot
SEOstats SEOstats
SMTBot SMTBot
SalesIntelligent
ScoutJet ScoutJet
Screaming
Searchestate Searchestate
SearchmetricsBot SearchmetricsBot
SemanticJuice SemrushBot
SentiBot
SeoSiteCheckup SeoSiteCheckup
SeobilityBot SeobilityBot
Seomoz Shodan
Siphon
Site Sucker Site Sucker
SiteSnagger Sitebeam
SiteSucker Sitevigil
SlySearch SlySearch
SmartDownload Snake
SocialRankIOBot Snapbot
Snoopy
Sociscraper
Sogou web spider Sogou web spider
SpankBot Sottopop
Spinn3r Spammen
SputnikBot SputnikBot
Steeler Sqworm
Stripper
Sucker
Sucuri
SuperBot SuperBot
T0PHackTeam SurveyBot
Suzuran
Teleport
TeleportPro TeleportPro
Telesphorep
The Intraformant
TheNomad TheNomad
Thumbor Tracemyfile
Toata
Toweyabot
Trendictionbot
True_Robot True_Robot
URLy Warning Turingos
V-BOT Turnitin
VB Project TurnitinBot
VCI UnisterBot
Vagabondo VeriCiteCrawler
VelenPublicWebCrawler
Virusdie
VoidEYE VoidEYE
Voltron WASALive-Bot
WWW-Mechanize WEBDAV
WWW::Mechanize
WWWOFFLE WWWOFFLE
Wallpapers
Wallpapers/3.0
WeSEE WeSEE
Web Collage Web Collage
Web Enhancer
Web Fuck Web Fuck
Web Pix
Web Sauger
WebAuto WebAuto
WebBandit WebBandit
WebCollage
WebCopier WebCopier
WebEnhancer
WebFuck WebFuck
WebGo IS WebGo IS
WebImageCollector
WebStripper
WebWhacker WebWhacker
WebZIP WebZIP
Webalta Website Quester
WebsiteExtractor WebsiteQuester
Whatweb Webster
Whack
Who.is Bot
Widow Widow
WinHTTrack
WiseGuys Robot WiseGuys Robot
Wonderbot Wotbox
Xaldon WebSpider
Xenu Xenu
Zade YoudaoBot
Zauba Zermelo
Zitebot
ZmEu
ZoomBot
ZoominfoBot
adscanner adscanner
autoemailspider check1.exe
coccocbot coccocbot
cognitiveseo cognitiveseo
crawl.sogou.com crawler.feedback
crawler4j crawler4j
demandbase-bot demandbase-bot
gopher evc-batch
heritrix heritrix
internetVista monitor instabid
ips-agent
isitwp.com isitwp.com
linkdexbot iubenda-radar
lwp-trivial lwp-trivial
muhstik-scan muhstik-scan
netEstate NE Crawler netEstate NE Crawler
oBot plumanalytics
page scorer
pcBrowser
polaris version
probe-image-size
ripz
satoristudio.net
scalaj-http
seobility seobility
seocompany.store sexsearcher
seostar sitechecker.pro
serpstatbot sogouspider
sp_auditbot sysscan
tAkeOut
trendiction.com trendiction.com
x09Mozilla trendiction.de
x22Mozilla ubermetrics-technologies.com
xpymep1.exe voyagerx.com
webprosbot
zauba.io zauba.io

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
bioca.org adidas.frwebs.fr
espaceinventoristes.com crynet.cc
goo.ne.jp drillsaw.ru
mecash.ru edwinkonijn.com.au
megakino.net forumprofi.de
pirateday.ru konturkrasoty.ru
pooleroadmedicalcentre.co.uk oktube.ru
uac.net.au svolze.com
watchmygf.net tizanidineonline.blogspot.com
xn-----7kceclhb4abre1b4a0ccl2fxch1a.xn--p1ai topcasinoratings.ru

908
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
08800.top 0c47f8422d3f.com
100searchengines.com 1-99seo.com
1kinobig.ru 101billion.com
2020iscoming.info 101raccoon.ru
123any.com
1bet.com
1xbet4you.com
24x7-server-support.site
2girls1cup-free.com 2girls1cup-free.com
2itech.ru 2itech.ru
300richmond.co.nz 2kata.ru
34.gs 2rich4bitches.com
3w24.com 3dracergames.com
4senses.co 4kepics.com
4webmasters.org 4ureyesonly.com
7yue.org 5000-cotydzien.com
8gold.com 777-club.ru
aaa38852e886ac4af1a3cff9b47cab6272.com 7a2rnuey1tw9ar.ru
acgs.tk 8kisses.eu
aad1f4acb0a373420d9b0c4202d38d94fa.com
aarbur.com
aasoldes.fr
activecampaign.dreamhosters.com
acunetix-referrer.com
addray.pro addray.pro
addtoadd.men adktrailmap.com
adultfriendfinder.com admatic.com.tr
advancedsoftwaresupport.com adminshop.com
adverster.com adrunnr.com
aero2.ru adtology.com
ahmedabadwebs.com advancedmassagebysara.com
ahrntal.verymes.xyz adviceforum.info
albuteroli.com akama.com
all4invest.ru alessandraleone.com
allkrim.com alfa9.com
alpinism.ru alibestsale.com
alt-servis.ru alienwheels.de
amyfoxfitness.com allbizne.co.ua
android4fun.org allornamenti.com
anime.dougasouko.com alphahoverboards.com
apartmentbay.ru amateurgalls.com
apidigidocketnet-a.akamaihd.net amateurlivechat.org
apioutoboxnet-a.akamaihd.net anaksma.info
apisecretsaucebi-a.akamaihd.net anaseracresar.tk
apispringsmartne-a.akamaihd.net animal36.com
apparel-offer.com anjalika.co.in
apper.de antons-transporte.de
applyneedy.xyz apartmentratings.com
aproposde.com apiallgeniusinfo-a.akamaihd.net
appartement-stumm.at
ardimobileinfo.ml
arenda-avtoprokat-krasnodar.ru arenda-avtoprokat-krasnodar.ru
arenda-yeisk.ru arkkivoltti.net
articlesdirectoryme.info artparquet.ru
asiavirtualsolutions.com asscenihotosidea.blogspot.com
australia-opening-times.com autobrennero.it
auto-moto-elektronika.cz
autolombard-krasnodar.ru autolombard-krasnodar.ru
availit.weebly.com avon-severozapad.ru
b00kmarks.com avto-oligarh.ru
balkanfarma.ru balla-boo.se
balook.com bankmib.ru
bank.uz bankofthewext.com
bankiem.pl banksrf.ru
bannerpower.com best-seo-solution.com
barbourjackets.online
battlecarnival.su
beachtoday.ru
beauty-b0x.pl
belinvestdom.by
best-seo-software.xyz
betteroffers.review
bezlimitko.xyz bezlimitko.xyz
bidbuy.co.kr big-cash.net
bikini-image.com bioca.org
bin-brokers.com biocn.dx.am
bitcoins-live.ru biznesluxe.ru
bizru.info bjorkbacken.nu
blobar.org blogig.org
blogqpot.com blogos.kz
blue-square.biz blogrankers.com
bmwhighperformers.com bluesalt.co
bonzbuddy.com boazpower.com
bookmaker-bet.com bobinoz.com
bookmark4you.com.biz boleznikogi.com
bouda.kvalitne.cz bolezniorganov.ru
brainsandeggs.blogspot.com brains2.biz
brandedleadgeneration.com brainzpod.win
bravegirlsclub.com
breget74.ru breget74.ru
brus-vsem.ru btvn.ru
bukleteg.xyz cah.io.community
bumascloset.com callstevens.com
burger-tycoon.com candycrushshop.com
butstrap.space cars-modification.net
buy-cheap-pills-order-online.com cartierbraceletsreplica.pw
buyessay3.blogspot.ru cartierlovestore.xyz
buynorxx.com cartierring.xyz
c-english.ru cheapmarmot.online
cartierlove2u.com cheapwebsitehoster.com
cartierlovebraceletreplica.xyz
casinorewards.info
cdncash.org
chatroulette.video
cheatcode-lita12.rhcloud.com cheatcode-lita12.rhcloud.com
chimiver.info chinacheapelitejerseys.com
chocolateslim-en-espana.com chocolateslim-original.com
christianlouboutinsaleoutletonline.us christianlouboutinreplica.win
cialischsrx.com christianlouboutinsaleonline.us
compliance-alexa.xyz cjmc.info
clickzzs.nl
clothesforcash.com
coderstate.com
codq.info
compliance-checker.info
compliance-fred.top
compliance-fred.xyz compliance-fred.xyz
compliance-josh.top continent-e.tv
cookingmeat.ru coolwallpapers4k.info
coolbar.pro cordstrap.cc
cosmeticswomens-womensports.rhcloud.com cosmeticswomens-womensports.rhcloud.com
cowblog.fr covadhosting.biz
crackzplanet.com crafthubs.com
creditnation.ru credit-respect.ru
cvety24.by creditwell.ru
daneshetabiat.com customerpromos-a.akamaihd.net
ddlmega.net cutt.us
ddpills.com cv.wallhade.co
deanmoore.ie cyclobenzaprinevstizanidine.blogspot.com
decorazilla.com damasarenai.info
dellalimov.com data.vtc.pw
demian.kz den-noch24.ru
dentalpearls.com.au designdevise.com
detalizaciya-tut.biz digilander.libero.it
dichvuvesinhhanoi.com digital-video-processing.com
diminishedvalueoforegon.com dinosaurus.site
disruptingdinnerparties.com dktr.ru
dlya-android.org dogbreedspicture.net
docstoc.com domini.cat
dodlive.mil
dojki365.online
domainanalyzing.xyz
domashneeruporno.com
dotnetdotcom.org dotnetdotcom.org
drhomes.biz drugs-no-rx.info
dscaas.website dscaas.website
dustyorate.com dstroy.su
dvd-famille.com dynainbox.com
earn-from-articles.com easyshoppermac.com
educatemetv.com ebooknovel.club
ekto.ee eets.net
elektrozigarette2.webs.com elektronischezigarette2.mex.tl
en.altezza.travel elektronischezigarettekaufen1.beeplog.com
eng-lyrics.com embedle.com
erotag.com enbersoft.com
esopini.com eropho.com
eugenevaultstorage.com estibot.com
everytalk.tv
exportshop.us exportshop.us
extremal-blog.com extremez.net
facebook-mobile.xyz eywords-monitoring-your-success.com
faptitans.com ezb.elvenmachine.com
fashion.stellaconstance.co ezigarettekaufen2.mpbloggar.se
fashionavenuegame.com ezrvrentals.com
fellowshipoftheminds.com facialporntube.com
femmesdenudees.com faithe.top
ferieboligkbh.dk faracontrol.ir
fetlifeblog.com favorcosmetics.com
fifa-coins.online feel-planet.com
filmania-x.ru felizporno.com
financeloan.us fil.ru
finansov.info financetip.eu
findpik.com floridahuntingfishingadventures.com
fireads.men fotosfotos.eu
fishingwholesale.us fototravel.eu
flagcounter.me foxtechfpv.com
flex4launch.ru freenode.info
focalink.com
food.dtu.dk
forex.osobye.ru
forex21.ru
formseo.com
foto-telok.net
free-gluten.ru
free-laptop-reward.com
freelotto.com
freesitetest.com
frequiry.com frequiry.com
fugarif.ga fres-news.com
fun-mobi.pl fsalas.com
futbolkisales.ru fullfileaccess.com
gabeshop.ru fusoradio.info
gamedayhouse.com fxgallery.com
gaz-voshod.ru gagrasector.ru
geckoandfly.com galaxyflowers.ru
genericviagrasildenafiled.net gambarxkata.co
gilbertbanda.net gelezki.com
girls-ufa.ru gemgrab-a.akamaihd.net
glastecfilms.com.my girlgamerdaily.com
go2mike.ru goforexvps.com
gobongo.info goodhousekeeping.com
gogps.me googlemare.com
goroda-vsego-mira.ru googleseo.com.tr
gosreg.amchs.ru graphics8.info
gotcher.us gwhwpxbw.bloger.index.hr
gotomontenegro.net handicapvansarea.com
greamimgo.pw hannasolution.ru
greatfind-a.akamaihd.net hanwei.us
guardlink.com hatedriveapart.com
guidefs.ru hdhc.ru
hamptonoaks.ca hdpixent.com
heartofpayne.xyz heartofbeijing.blogspot.com
hebr.myddns-flir.com heliko.no
hetmanship.xyz hermesbirkinhandbagoutlets.com
hidemyass.com hobbyhuren24.net
highland-homes.com homegardenlova.com
highspeed5.net homemature.net
hitcpm.com hostnow.men
hitmuzik.ru howtowhitenteethfast.xyz
homedecoguide.info hut1.ru
homedo.fabpage.com idegenvezeto.eu
hopeonthestreet.co.uk images-graphics-pics.com
hotkeys.com img.wallpaperstock.net
hplaserjetpdriver8y.pen.io imperiafilm.ru
https-legalrc.biz infobabki.ru
igadgetsworld.com infobanks.ru
ihtec2019.org infogame.name
ikritikimou.gr infostatsvc.com
ilo134uloh.com
ilovevitaly.xyz
immobiliaremassaro.com
impotentik.com
inmate-locator.us inmate-locator.us
innoslicon.com innoslicon.com
intellego.info insta-add.pro
investmac.com istizanidineanopiate.blogspot.com
iqbazar.ru istock-mebel.ru
isoveti.ru iwantmyfreecash.com
j33x.com jagg.info
javatex.co.id jaxcube.info
jestr.org jrcigars.com
jjbabskoe.ru juliaworld.net
job.icivil.ir kam-dom.ru
joy-penguin.com karadene.com
joyceblog.top kasino-money.pw
junglenet-a.akamaihd.net
kazan.xrus.org kazan.xrus.org
keywordglobal.co.za kchaxton.com
keywordsuggests.com keywordsking.com
kinobest.pl kfon.eu
klikbonus.com kimcurlrvsms.com
komputers-best.ru kinogolos.ru
kozhniebolezni.com kinohit1.ru
krassh.ru kinosed.net
kletkimehan.ru
krasnodar.zrus.org
kreativperlen.ch
kredit-blog.ru kredit-blog.ru
ktotut.net kustanay.kz
kurbappeal.info
lacapilla.info
laexotic.com laexotic.com
larger.io lanadelreyfans.us
laulini.soclog.se landscapebackgrounds.blogspot.com
letolove.ru laxob.com
liky.co.ua liky.co.ua
limtu.ifmo.ru linkbolic.com
liveinternet.ru lion.conboy.us
lol-smurfs.com lion.snapmap.us
lionking-1994.blogspot.com
lmrauction.com
lomza.info lomza.info
losangeles-ads.com lonely-mature.com
louboutinshoes.xyz lyngdalhudterapi.no
macfix.life m0r0zk0-krava.ru
mactechinfo.info m1media.net
magento-crew.net mackeeper-center.club
manifestyourmillion.com magicplayer-s.acestream.net
mantramusic.ru maladot.com
manve.info
manyresultshub-a.akamaihd.net manyresultshub-a.akamaihd.net
marinetraffic.com maranbrinfo.com.br
marketland.ml marblestyle.ru
matrixalchemy.com marmotstore.online
max-eclat.men martlinker.com
medictube.ru matematikus.info
megakino.net mbiologi.ru
members.ghanaweb.com mesbuta.info
missis.top mex-annushka.ru
mexicotravelnet.com
minneapoliscopiers.com
mlf.hordo.win
mmoguider.ru mmoguider.ru
mobicover.com.ua mobicover.com.ua
mobplayer.net
mobsfun.net mobsfun.net
mojaocena.com mockupui.com
monarhs.info
money-for-placing-articles.com money-for-placing-articles.com
moneymaster.ru moneymaster.ru
morefastermac.trade
morepoweronmac.trade
morf.snn.gr morf.snn.gr
morocco-nomad-excursions.com moroccosurfadventures.com
moskva.nodup.ru moscow-region.ru
mp3films.ru motherboard.vice.com
mrvideospornogratis.xxx musicvidz.ru
msk.afora.ru mwtpludn.review
muznachas-service.ru my-cash-bot.co
my-floor.in.ua mydirtystuff.com
mylida.org mylesosibirsk.ru
mysexpics.ru mysexpics.ru
nalogovyykodeks.ru naphukete.ru
net-profits.xyz narkologiya-voronezh.ru
netcheckcdn.xyz neks.info
news-speaker.com neobux-bg.info
netvouz.com
newstraveller.ru
newstudio.tv
nfljerseysforsalewholesaler.com
nikitabuch.com
nippon-bearings.ru nippon-bearings.ru
notasprensa.info noumeda.com
nrjmobile.fr novatech.vn
nrv.co.za nudepatch.net
o-o-11-o-o.com
o-o-8-o-o.com
oballergiya.ru oballergiya.ru
obnal.org obiavo.uz
odoratus.net odywpjtw.bloger.index.hr
olvanto.ru of-ireland.info
olympescort.com offf.info
onlinadverts.com okeinfo.online
online-x.ru okel.co
onlineserialy.ru omgtnc.com
onlyforemont.ru oneminutesite.it
ostroike.org onetravelguides.com
ozas.net onlinebay.ru
paceform.com onthemarch.co
ooo-gotovie.ru
optitrade24.com
osnova3.ru
ostrovtaxi.ru
ownshop.cf
oz-offers.com
palocco.it palocco.it
pawli.eu pc-services.ru
penisvergrotendepillennl.ovh pertlocogasilk.tk
percin.biz.ly petitions.whitehouse.gov
perfectpracticeweb.com
petsblogroll.com
phobia.us
photorepair.ru photorepair.ru
photostudiolightings.com picturesfrom.com
picphotos.net pihl.se
pictures-and-images.com pk-services.ru
pila.pl pl.id-forex.com
pipki.r.acdnpro.com playlott.com
pkr1hand.com pony-business.com
platinumdeals.gr popserve.adscpm.net
poem-paying.gq poquoson.org
pojdelo.weebly.com pornhubforum.tk
pokemongooo.ml porno-dojki.net
popup.matchmaker.com porno-play.net
pornoelita.info porno-raskazy.ru
pornoslive.net porno.simple-image.com.ua
pornoplen.com
pornpost.in
portnoff.od.ua
portside.xyz
poshiv-chehol.ru
pospr.waw.pl pospr.waw.pl
printingpeach.com pozdrawleniya.com
privatov-zapisi.ru preg.marketingvici.com
privhosting.com pretty-mart.com
prizeestates.cricket pricheski-video.com
prizefestival.mobi prizesbook.online
proekt-gaz.ru produkto.net
professionaldieselcare.com professionalwritingservices15.blogspot.ru
promalp-universal.ru prom23.ru
promgirldresses.xyz
proprostatit.com proprostatit.com
prostitutki-almata.org
prostitutki-kharkova.org
prostitutki-odessa.org
prostitutki-tolyatti.org
prostitutki-yaroslavlya.org prostitutki-yaroslavlya.org
psa48.ru pssucai.info
psvita.ru qld10000.net
pussyfleet.com qpypcx.com
putevka24.ru quangcaons.com
quality-traffic.com rapevideosmovies.com
rankings-analytics.com rapidgator-porn.ga
ranksays.com ratemodels.net
rcpmda.ikan1080.xyz rebuildermedical.com
registrationdomainsite.com
reimageplus.com reimageplus.com
remedyotc.com reklama-i-rabota.ru
remont-comp-pomosh.ru remontgruzovik.ru
renecaovilla.online rentaremotecomputer.com
rennlist.com rewardpoll.com
rent2spb.ru rfd-split.hr
rep-am.com rockma.se
rosbalt.com.ua roma-kukareku.livejournal.com
rossmark.ru rome2rio.com
royal-investments.net romhacking.ru
royalvegascasino.com
rp9.ru
rrutw.com
ru-mediaget.ru ru-mediaget.ru
ruscoininvest.company runofilms.ru
s1z.ru runstocks.com
sale-japan.com russia-today-video.ru
samara.rosfirm.ru rustic-quiver.win
sbetodiodnye-lampy.ru rusvideos.su
scalerite.co.za rutor.group
saneitconsulting.com
santechnik.jimdo.com
sape.top
sbdl.no
sbf441.com
scanner-brian.top scanner-brian.top
school-diplomat.ru scanner-jane.top
scrnet.biz.ua scanner-julianna.top
searchaddis.com scanner-margo.top
searchimage.co scanner-walter.top
seocdvig.ru scanner-willy.top
service.adtech.us scmor.ilxc.cc
sevendays.com.ua searchkut.com
sexs-foto.top seorank.info
sexyteens.hol.es seorussian.ru
shiksabd.com seotoolsagency.com
shoesonlinebuy.xyz service-core.ru
shopperifymac.com sexpartygirls.net
silverage.ru shakhtar-doneck.ru
simplepooltips.com shell-pmr.ru
skuteczna-dieta.co.pl sibvitr.ru
slkrm.ru sigmund-freud.co.uk
snow.nvr163.com siteaero.com
social-button.xyz skatestick.bid
sodexo.com sladkoevideo.com
sophang8.com smart-scripts.com
sortthemesitesby.com smichovbike.cz
sotechco.co sneakyboy.com
souvenir.cc soaksoak.ru
spammen.de socas.pluto.ro
sprttrack.com socialmadesimple.com
stauga.altervista.org socialtrade.biz
stjamesschool.info soft-terminal.ru
stockquotes.wooeb.com songoo.wz.cz
stretchmate.net sribno.net
stroiminsk.com store-rx.com
stroyhelp-dv.ru stroydetali.ru
styro.ru superkanpo.com
supermama.top supermesta.ru
surflinksmedical.com support.nopeas.sk
svarbit.com sureone.pro
survival.betteroffers.review
svtrd.com svtrd.com
swinon.site swimpool.ca
szucs.ru swsociety.se
tattoo33.ru takeflyte.com
tattooha.com tam-gde-more.ru
telefonsex-ohne0900.net tamada69.com
theautoprofit.ml taqplayer.info
thecoral.com.br taranerymagesswa.blogspot.com
thegameriders.com td-l-market.ru
timdreby.com teenbbw.yopoint.in
tizanidinedosage.blogspot.com telefonsexkostenlos.tk
tizanidineforopiatewithdrawal.blogspot.com templates.franklinfire.co
tizanidinesideeffects.blogspot.com texbaza.by
tksn.ru theporndude.com
tomck.com tizanidinecost.blogspot.com
top-karkas.ru tizanidinehydrochloride2mg.blogspot.com
tizanidinepills.blogspot.com
tizanidinerecreationaluse.blogspot.com
topanasex.com topanasex.com
topcar-krasnodar.ru
topflownews.com topflownews.com
topquality.cf torrents-tracker.com
toproadrunner5.info trailer.cinemaflix.website
topvidos.ru truck-land.life
touchmods.fr tryrating.com
tracksurf.daooda.com tt-ipd.info
traffic100.com tubeoffline.com
trafficnetzwerk.de twu.com.ua
tubeline.biz ucoz.ru
tubo360.com usacasino.com
tupper-posuda.ru usbggettwku.ga
ucsol.ru ustion.ru
udsgame.online vacuumcleanerguru.com
um-razum.ru valuado.com
umnovocaminho.com vellings.info
underthesite.com velobikestock.com
unionmarkt.de veselokloun.ru
unitexindia.com video-chat.cn
uogonline.com video-chat.in
uptime-as.net videochat.world
url-img.link videonsk.com
urlopener.com
utiblog.fr
uytmaster.ru
varikozdok.ru
ventelnos.com
via-energy-acquistare.com
via-energy-cumpara.com
via-gra.webstarts.com
videochat.ph
vielporno.net
vip2ch.com
visionwell.com.cn visionwell.com.cn
viteonlusarezzo.it vitalads.net
voloomoney.com vksaver-all.ru
vote-up.ru volume-pills.biz
vroze.com vpnhowto.info
wait3sec.org vse-pesni.com
walkme.com vvpg.ru
website-speed-up.top wallpapers-best.com
wesharepics.com wallpapersdesk.info
westsextube.com wallpapersist.com
wallpaperstock.net
wareseeker.com
warning.or.kr
waysbetter.cn
webcamdevochka.com
weblo.com
webradiology.ru
westvilletowingservices.co.za westvilletowingservices.co.za
whereverdesperate.gq wheelchairliftsarea.com
wholesalecheapjerseysfree.com wladimirpayen.com
wholesalejerseychinashop.com wnhjavlhezp.gq
world-mmo.com woman-orgasm.ru
worldoffiles.ru workle.website
wpthemedetector.co.uk worldmusicfests.com
www.bookmaker-bets.com woweb.com.ua
www.labves.ru wstroika.ru
www.solartek.ru www.souvenirua.com
www.wohnkabinen-shop.de wygraj-teraz.com
x-diesel.biz x-lime.com
x-stars.ru
x69ty.ru
xaijo.com xaijo.com
xev.ru xep.info
xn----9sbebi2bvzr7h.xn--p1ai xn-----6kccaibs5cb8afhjrfmix2n.xn--p1ai
xn----itbkqkfiq.xn--p1ai xn--80aafb2a.xn--p1ai
xn--80ab4aa2g.xn--p1ai xn--80aanaardaperhcem4a6i.com
xn--h1aakne2ba.xn--p1ai xn--b1addnj3cah.xn--p1ai
xxxrus.org xn--e1aggki3c.xn--80adxhks
yaoguangdj.com yaminecraft.ru
yellocloud.be yellowfootprints.com
yhit.press yoopsie.com
yourserverisdown.com youbloodyripper.com
yoursearch.me
yousense.info yousense.info
yun56.co zaimite.ru
zaidia.xhost.ro zakazvzloma.com
zakon-ob-obrazovanii.ru zeroredirect9.com
zarabotat-na-sajte.ru zetgie.com.pl
zeroredirect1.com zigarettenonlinekaufen.tumblr.com
zeroredirect6.com zoogdiesney.com
znakomstvaonlain.ru zrizvtrnpale.tk
zona-aqua.ru zskdla.site
zophim.me

482
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
03e.info 0912701309f8ce.com
108shot.com 1j7740kd.website
178evakuator178.ru 2girls1cup-free.com
2rich4bitches.com 3weekdiet.com
3-letter-domains.net 5i2.net
DomainStatsBot 7yue.org
a96527gi.beget.tech 8kisses.eu
adelly.bg abcguru.xyz
absolutelyanalog.com
absugars.com
adman.se adman.se
adtiger.tk adpremium.org
advancedsoftwaresupport.com adult3dgames.com
afftrack001.com adviceforum.info
airmaxshoes-2016.com affrh2015.com
agadelha.com.br
alborzan.com
albuteroli.com
alert-hgd.xyz
allsilver925.co.il
alot.com
amateurmatch.com
android-style.com
angkortours.vn
animal36.com
anonymousfox.co
apisecretsaucebi-a.akamaihd.net apisecretsaucebi-a.akamaihd.net
app-ready.xyz app-ready.xyz
appfixing.space apple.com-cleaner.systems
appsaurus.com arvut.org
artpicso.com atout-energie-69.com
autobrennero.it auto.rusvile.lt
autotrends.today autodo.info
avon-severozapad.ru aviav.co
babyfactory.fr awency.com
berrymall.ru best-deals-products.com
best-mam.ru best-seo-software.xyz
blog-hits.com bestprofits-there.com
bluesman.nu bio.trade-jp.net
bmw-ark.ru blagovest-med.ru
bosman.pluto.ro blog.axant.it
briomotor.co blogos.kz
bscodecs.com blogs.rediff.com
buy-forum.ru blue-square.biz
cakesplus.com.au bluesalt.co
callawaygolfstore.online braip.com.br
cam-kontakte.org brandimensions.com
candypeople.se bukleteg.xyz
cartierjusteunclou.xyz bumskontakte.org
cartierreplica.pw buybest1.biz
cheapbarbour.online bwlx.prepedu.cn
cheapmoncler.pw candcstuccoandstone.com
chocolateslim-en-espana.com candycrushshop.com
club-musics.ru canrole.com
computernetworksonline.com cardsharp1.ru
cookie-law-enforcement-ff.xyz cartierlove.xyz
coolingoods.com certifywebsite.win
cougfan.info cheapestjerseys-wholesale.com
countbertwistdisp26.soup.io check-this-out-now.online
chorus.terakeet.com
christianlouboutinoutlet.win
cialisndbrx.com
compiko.info
compliance-mary.top
connectingsingles.com
darodar.com darodar.com
deluxedumps.com day-news.info
drugstoreforyou.com daydream-studio.ru
educontest.net dbmkfhqk.bloger.index.hr
elektronischezigarettekaufen2.tumblr.com dfiles.me
elektrozigaretten1.tumblr.com dfwu1019.info
elmifarhangi.com dimkino.ru
eralph.tk drivotracker.com
eropho.com dvr.biz.ua
etotupo.ru dvrlists.com
eu-cookie-law.info el-nation.com
exmasters.com elektrozigarettekaufen2.blogse.nl
exoclick.com elitesportsadvisor.com
fashionavenuegame.com emailaccountlogin.co
fast-torrent.ru enpolis.ru
flauntyoursite.com everypony.ru
foxinsocks.ru executehosting.com
freemaintenancesysforpcandmac.top extlinks.com
fres-news.com f-online.de
freshdz.com familienzahnaerzte.com
fsakhalin.ru fickenprivat.info
gdzkurokam.ru filmania-x.ru
geileweiber.tk filmidivx.com
gg.zzyjxs.com finstroy.net
gkvector.ru flipper.top
googlefeud.com forex-procto.ru
haikuware.com forminecrafters.ru
headpharmacy.com freemags.cc
helicalpile.us fxgallery.com
hentaiheroes.com getaclueamerica.com
hitmuzik.ru getpopunder.com
homeart.space gg-arena.ru
hotsocialz.com gheus.altervista.org
houdom.net girlsatgames.ru
hoverboard360.se gogps.me
https-legalrc.biz goodhousekeeping.com
hulfingtonpost.com guardlink.org
hustoon.over-blog.com hamptonoaks.ca
ilte.info havepussy.com
health-medical-portal.info
hkdiiohi.skyrock.com
hostcritique.com
houston-vikings.com
humanorightswatch.org
hundejo.com
i-hobot.ru
images-graphics-pics.com images-graphics-pics.com
imediadesk.com imgarit.pw
integritylandscapeservices.com imicrovision.com
irkutsk.online-podarki.com interferencer.ru
isoveti.ru iqoption.com
istizanidineanarcoticdrug.blogspot.com jolic2.com
itbc.kiev.ua kasino-money.pw
itrevolution.cf keenoutlet.online
jo24news.com kellyonline.xyz
job.icivil.ir keywords-monitoring-your-success.com
joessmogtestonly.com keywordsuggest.org
keywordglobal.co.za kinogonew.ru
kicknights.gq kirov.zrus.org
kino-rating.ru kollekcioner.ru
kinoflux.net koronirealestate.gr
kladrus.ru krassh.ru
knowyournextmove.com kursy-ege.ru
ku6.com lacasamorett.com
layola.biz.tc letmacwork.world
lennatin.info letmacworkfaster.site
life-instyle.com linkpulse.com
liky.co.ua live-sexcam.tk
livejasmin.com mabdoola.blogspot.com
miniads.ca mackeeper-land-672695126.us-east-1.elb.amazonaws.com
missclub.info macnewtech.com
monthlywinners.com mainlinehobby.net
moscow-clining.ru maladot.com
marketingvici.com
masserect.com
meds-online24.com
mistr-x.org
mmstat.com
mobilemedia.md
moesonce.com
moivestiy.biz
mojowhois.com
mossmesi.com
mostantikor.ru
mototsikl.org mototsikl.org
mowser.com mountainstream.ms
mtmtv.info muz-tracker.net
mxgetcode.com negociosdasha.com
mybinaryoptionsrobot.com nordstar.pro
mygameplus.ru obnal.org
myiptest.com onlineporno.site
mysexpics.ru orion-v.com
next-dentists.tk orsonet.ru
nippon-bearings.ru pandarastore.top
nlfjjunb5.ru pdn-4.com
obiavo.uz physfunc.ru
ok-ua.info pio.polytopesexempt.com
olgacvetmet.com pizda.lol
onclickpredictiv.com pomoc-drogowa.cba.pl
oneshotdate.com
ooo-gotovie.ru
panouri-solare-acoperis.com
partner-high.men
pateaswing.com
pcgroup.com.uy
pearlisland.ru
pensplan.com
picphotos.net
pills24h.com
placid-rounded-coast.glitch.me
plastweb.ru
pontiacsolstice.info
popmarker.com popmarker.com
popserve.adscpm.net porndairy.in
porno-home365.com pornoforadult.com
pornolook.net preconnubial.usuby.site
pornoslive.net predmety.in.ua
pornowarp.info printingpeach.com
princeadvantagesales.com prlog.ru
privacylocationforloc.com pts163.ru
prize44.com quickcashlimited.com
producm.ru qwarckoine.com
puserving.com raisedseo.com
rasteniya-vs-zombi.ru rankscanner.com
recinziireale.com ranksonic.com
ribieiendom.no runofilms.ru
rospromtest.ru sampleletters.net
rozalli.com scanner-josh.top
rumamba.com seasaltwithfood.com
running-line.ru semp.net
rusenvironmental.net seo-prof1.xyz
rusexy.xyz seolab.top
rusprostitute.com serdcenebolit.com
russkoe-zdorovie.ru service.adtech.us
sa-rewards.co.za sexy-pings.com
scanmarine.info sexytrend.ru
scanner-marwin.top sibvitr.ru
seinterface.com sigmund-freud.co.uk
seocdvig.ru siteonomy.com
sexcamamateurchat.com sky-mine.ru
sexflirtbook.com slutloadlive.com
sexy.babes.frontend-stack.top smartbalanceworld.com
sharebutton.org social-buttons.com
shareyards.com solmarket.by
shemale-sex.net sonnikforme.ru
shijian.ac.cn
socialtrade.biz
spamnuker.com
speechfoodie.com speechfoodie.com
spy-app.info spidtest.space
start.myplaycity.com stop-zavisimost.com
stpicks.com streamin.to
studiofmp.com streetfooduncovered.com
sumo.com stroimajor.ru
supermama.top subj.ukr-lit.com
superoboi.com.ua superlist.biz
sweepstakes.rewardit.com supervesti.ru
swinginwithme.ru support.nopeas.sk
tarad.com swsociety.se
taraz.xkaz.org symbaloo.com
tech4master.com tecspb.ru
thexart.club teenbbw.yopoint.in
ticketsys.inetwd.com templates.franklinfire.co
time-japan.ru thecoral.com.br
thegamerznetwork.com
theguardlan.com
theporndude.com
tizanidine4mguses.blogspot.com tizanidine4mguses.blogspot.com
tizanidinefibromyalgia.blogspot.com tizanidinenarcotic.blogspot.com
tizanidinehcl2mgsideeffects.blogspot.com tonivedu.it
tnctrx.com toon-families.com
tootoo.to topads.men
top-deal.com.pl trafficshaper.com
top-l2.com traffpartners.com
topkarkas.com trustl.life
torrent-to-magnet.com tvteleport.ru
torrentgamer.net uggbootsoutletsale.us
torrentred.games usswrite.com
trackmedia101.com vbtracker.net
tsan.net veles.shop
turizmus.us viagra-soft.ru
tvorozhnaja-zapekanka-recept.ru videochat.cafe
twittrading.com videochat.mx
umnovocaminho.com videokrik.net
underthesite.com vod.com.ua
uptime-gamma.net voronezh.xrus.org
urccvfmc.bloger.index.hr wanker.us
uytmaster.ru web-analytics.date
vapeface.club where-toget.com
varbergsvind.se wordpress-crew.net
vellings.info www.timer4web.com
vesnatehno.com wwwadultcheck.com
viddyoze.com x-diesel.info
videochat.world xn--80ab4aa2g.xn--p1ai
videositename.com xpresscare.ru
vids18.site yadro.ru
viktoria-center.ru youthreaders.com
voprosotvet24.ru zajm-zalog-krasnodar.ru
vzlomtw.com zarenica.net
watracker.net zeleznobeton.ru
webads.co.nz zx6.ru
webalan.ru
webextract.profound.net
weblibrary.win
webpromotion.ae
webstatsdomain.org
whereiskentoday.com
wholesalejerseychinaoutlet.com
win-spy.com
worldis.me
wowas31.ucoz.ru
writingservices17.blogspot.ru
ws.ampower.me
x-musics.com
xcc24.pl
xn-----6kcaacnblni5c5bicdpcmficy.xn--p1ai
xn--80atua3d.xn--p1ai
xnxx-n.com
xxxtubesafari.com
youradexchange.com
youraticles.pl
youtubologia.it
yugo-star.ru
zoolubimets.ru
zvezdagedon.ru

153
dev-tools/test_units/ratelimittest-master.txt
View file

@ -8,6 +8,79 @@
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html>ml>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html><html> </html><html>
<head><title>503 Service Temporarily Unavailable</title></head> <head><title>503 Service Temporarily Unavailable</title></head>
<body> <body>
@ -421,76 +494,6 @@
<hr><center>nginx/1.18.0 (Ubuntu)</center> <hr><center>nginx/1.18.0 (Ubuntu)</center>
</body> </body>
</html> </html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<!DOCTYPE html> <!DOCTYPE html>
<html> <html>
<head> <head>
@ -581,14 +584,4 @@
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html> </html>

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.48 0; 10.1.0.134 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.06.3175 ### Version: V4.2022.06.3176
### Updated: Sat Jun 18 22:01:34 UTC 2022 ### Updated: Sun Jun 19 10:03:19 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.06.3175 ### Version: V4.2022.06.3176
### Updated: Sat Jun 18 22:01:34 UTC 2022 ### Updated: Sun Jun 19 10:03:19 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##