vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-02 18:50:13 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2022.02.2915 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2022-02-13 10:10:06 +00:00
parent db53e45ea5
commit 314b9e0dfc
48 changed files with 80197 additions and 80217 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.02.2914 #### Version: V4.2022.02.2915
#### Bad Referrers Blocked: [7089](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7089](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [636](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [636](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.02.2914 #### Version: V4.2022.02.2915
#### Bad Referrers Blocked: [7089](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7089](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [636](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [636](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -13,7 +13,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2022.02.2914 #### Version: V4.2022.02.2915
#### Bad Referrers Blocked: [7089](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7089](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [636](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [636](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

9890
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2022.02.2914 #### Version: V4.2022.02.2915
#### Bad Referrers Blocked: [7089](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7089](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [636](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [636](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

9894
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

9894
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

9894
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

9894
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.60 1; 10.1.0.31 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.60 0; 10.1.0.31 0;
127.0.0.1 0; 127.0.0.1 0;

9894
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.60 1; 10.1.0.31 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.60 0; 10.1.0.31 0;
127.0.0.1 0; 127.0.0.1 0;

9894
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.60 1; 10.1.0.31 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.60 0; 10.1.0.31 0;
127.0.0.1 0; 127.0.0.1 0;

9894
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
2914 2915

9894
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

9894
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
40.122.155.21 0; 52.247.201.92 0;

9894
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.60 1; 10.1.0.31 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.60 0; 10.1.0.31 0;
127.0.0.1 0; 127.0.0.1 0;

9894
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.60 1; 10.1.0.31 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.60 0; 10.1.0.31 0;
127.0.0.1 0; 127.0.0.1 0;

9894
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.60 1; 10.1.0.31 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.60 0; 10.1.0.31 0;
127.0.0.1 0; 127.0.0.1 0;

9894
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
40.122.155.21 0; 52.247.201.92 0;

9894
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
40.122.155.21 0; 52.247.201.92 0;

9894
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.60 1; 10.1.0.31 1;
127.0.0.1 1; 127.0.0.1 1;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
Discoverybot Bigfoot
Ecxi BlowFish
Mail.RU_Bot CCBot
NetSpider Larbin
OpenLinkProfiler NPbot
ScoutJet Niki-bot
Scrapy autoemailspider
Shodan dataforseo.com
SmartDownload isitwp.com
Sqlworm oBot

294
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
360Spider 01h4x.com
404checker
AIBOT
ALittle Client ALittle Client
ASPSeek Aboundex
Acunetix
AfD-Verbotsverfahren AfD-Verbotsverfahren
AhrefsBot
AiHitBot AiHitBot
Alexibot
AllSubmitter
Alligator Alligator
AlphaBot AlphaBot
Anarchie Anarchie
Anarchy99 Anarchy99
Anthill
Apexoo Apexoo
Asterias Atomseobot
Attach Attach
AwarioSmartBot AwarioSmartBot
BDCbot
BLEXBot
BackDoorBot
BackStreet
BackWeb BackWeb
BacklinkCrawler Backlink-Ceck
Battleztar Bazinga Battleztar Bazinga
Bigfoot BetaBot
Bitacle Buck
Black Hole Buddy
BlackWidow BuiltWith
Blackboard BuzzSumo
BotALot CATExplorador
BuiltBotTough CheeseBot
Bullseye
BunnySlippers
CODE87
CSHttp
Calculon
Cegbfeieh
CensysInspect
CheTeam
Chlooe Chlooe
Citoid Citoid
Cocolyzebot Claritybot
Cliqzbot
Copier
Cosmos Cosmos
Craftbot
Crawling at Home Project Crawling at Home Project
CrazyWebCrawler CrazyWebCrawler
CyotekWebCopy CrunchBot
Custo
DBLBot
DTS Agent DTS Agent
DatabaseDriverMysqli Deusu
Digincore
Disco Disco
Discoverybot Discoverybot
DomCopBot DittoSpyder
DomainAppender DnBCrawler-Analytics
DomainSigmaCrawler DnyzBot
DomainStatsBot DomainCrawler
Domains Project
Dragonfly Dragonfly
Drip Drip
EMail Siphon
EMail Wolf EMail Wolf
Ebingbong EasyDL
Express WebPictures EirGrabber
EyeNetIE EroCrawler
ExtLinksBot
Extreme Picture Finder
Ezooms
FDM
FemtosearchBot
Fimap
Firefox/7.0 Firefox/7.0
FlashGet
Flunky Flunky
FrontPage Foobot
Fuzz Fuzz
Fyrebot GalaxyBot
G-i-g-a-b-o-t
GermCrawler
GetWeb GetWeb
Getintent Getintent
Go!Zilla Gigabot
Go-Ahead-Got-It
GrabNet GrabNet
Grabber Grafula
GrapeshotCrawler GrapeshotCrawler
GridBot GridBot
HaosouSpider HMView
Heritrix HTTP::Lite
Hloader Haansoft
Humanlinks Havij
HybridBot HonoluluBot
IRLbot IDBot
Id-search Id-search
Image Fetch IlseBot
Image Sucker
IndeedBot
InfoTekies InfoTekies
InterGET InterGET
InternetSeer
Iria Iria
JamesBOT Jetty
Jbrofuzz Jorgee
JetCar LeechFTP
Joomla LeechGet
JustView Lftp
Larbin LibWeb
Libwhisker
Lightspeedsystems Lightspeedsystems
Likse Likse
Linkbot
LinksManager
LinqiaMetadataDownloaderBot LinqiaMetadataDownloaderBot
LinqiaRSSBot
LinqiaScrapeBot LinqiaScrapeBot
Lipperhey
Lipperhey Spider Lipperhey Spider
Litemage_walker
Lmspider Lmspider
Ltx71 MIDown tool
MFC_Tear_Sample
MIIxpc
MJ12bot MJ12bot
MQQBrowser Mail.RU_Bot
Majestic-SEO Majestic SEO
MarkMonitor MarkWatch
Mass Downloader Mass Downloader
Masscan Masscan
Mata Hari Mata Hari
MauiBot MauiBot
Mb2345Browser
MeanPath Bot MeanPath Bot
Meanpathbot Meanpathbot
MegaIndex.ru
Microsoft Data Access Microsoft Data Access
Microsoft URL Control Mister PiX
Minefield
Moblie Safari
Mojeek
Morfeus Fucking Scanner Morfeus Fucking Scanner
Mr.4x3 Mr.4x3
Musobot Musobot
Name Intelligence Navroad
NetLyzer NetLyzer
NetMechanic Nettrack
NextGenSearchBot Netvibes
Niki-bot Niki-bot
Nimbostratus Nimbostratus
Ninja
Nmap
Nuclei Nuclei
Nutch Octopus
Offline Explorer Offline Navigator
OpenVAS OpenVAS
Openfind POE-Component-Client-HTTP
OrangeSpider
OutclicksBot
PageGrabber PageGrabber
Panscient
Papa Foto
Pavuk Pavuk
Pi-Monster Petalbot
PleaseCrawl PictureFinder
Piepmatz
ProPowerBot ProPowerBot
ProWebWalker
Pu_iN Pu_iN
Pump Pump
RankActive Quick-Crawler
RSSingBot
RankFlex RankFlex
RankurBot RankingBot
Re-re Rankivabot
ReGet
RealDownload RealDownload
Ripper Reaper
RocketCrawler Recorder
RedesScrapy
RepoMonkey
Rogerbot Rogerbot
SBIder
SEOprofiler
SEOstats SEOstats
SISTRIX
SMTBot SMTBot
SalesIntelligent SalesIntelligent
ScoutJet
Scrapy Scrapy
ScreenerBot
ScrepyBot
Searchestate Searchestate
SemanticJuice SearchmetricsBot
Semrush Semrush
SemrushBot SemrushBot
Site Sucker SentiBot
SiteSucker SeobilityBot
SmartDownload Siphon
Sosospider SiteCheckerBotCrawler
SiteExplorer
SiteLockSpider
SiteSnagger
Snapbot
Snoopy
SocialRankIOBot
Sottopop Sottopop
Spanner Spanner
Spbot Spbot
Steeler Spinn3r
SuperBot SputnikBot
SuperHTTP Sqlworm
Stripper
Sucker
SurveyBot
Swiftbot Swiftbot
Teleport Szukacz
TheNomad
Thumbor Thumbor
TightTwatBot
Trendiction Trendiction
Trendictionbot Trendictionbot
Turnitin Turingos
TwengaBot TurnitinBot
Twice URLy Warning
Typhoeus UnisterBot
URLy.Warning Upflow
VB Project
Vacuum Vacuum
Vagabondo VoidEYE
WBSearchBot WBSearchBot
WISENutbot WISENutbot
WWW-Collector-E WPScan
WWWOFFLE WWW-Mechanize
Wallpapers Wallpapers/3.0
WallpapersHD WallpapersHD
WeSEE
Web Pix
WebBandit
Web Collage Web Collage
WebCopier
Web Enhancer Web Enhancer
WebFuck
WebLeacher
WebReaper
Web Sauger Web Sauger
WebStripper
Web Sucker Web Sucker
WebGo IS
WebPix
WebReaper
WebZIP WebZIP
WebmasterWorldForumBot
Webshag
Website Quester Website Quester
WebsiteExtractor
Webster Webster
Whack Whacker
Who.is Bot
Wonderbot Wonderbot
Xaldon WebSpider Wotbox
Xaldon_WebSpider
Xenu Xenu
Zermelo YoudaoBot
ZoomBot Zeus
ZoominfoBot Zitebot
ZyBorg ZmEu
adscanner backlink-check
archive.org_bot cah.io.community
arquivo-web-crawler
arquivo.pt
autoemailspider
check1.exe
clark-crawler clark-crawler
com.plumanalytics cognitiveseo
dataforseo.com crawl.sogou.com
facebookscraper
heritrix heritrix
instabid instabid
ips-agent
iubenda-radar iubenda-radar
lwp-request magpie-crawler
muhstik-scan muhstik-scan
netEstate NE Crawler page scorer
oBot
polaris version polaris version
probe-image-size probe-image-size
satoristudio.net satoristudio.net
scalaj-http
scan.lol scan.lol
seobility seocompany.store
seoscanners serpstatbot
seostar siteripz
sysscan sp_auditbot
trendiction.com
trendiction.de
ubermetrics-technologies.com ubermetrics-technologies.com
webgains-bot webmeup-crawler
webpros.com webprosbot
x09Mozilla
zauba.io zauba.io

306
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
01h4x.com 01h4x.com
404checker
80legs 80legs
Abonti AIBOT
Acunetix ALittle Client
AfD-Verbotsverfahren AiHitBot
AhrefsBot Aipbot
Alexibot Alexibot
Alligator AlphaBot
Anarchie Anarchy
Anarchy99 Anarchy99
Ankit
Anthill Anthill
Asterias Aspiegel
AwarioRssBot Atomseobot
BackDoorBot Attach
AwarioSmartBot
BackStreet BackStreet
Backlink-Ceck Badass
BacklinkCrawler
Bandit
Barkrowler Barkrowler
BatchFTP Blackboard
Bitacle
BlackWidow
BlowFish BlowFish
Bolt
BotALot BotALot
Brandprotect Brandprotect
Brandwatch Bullseye
Buddy
BuiltBotTough
BunnySlippers
BuzzSumo
CATExplorador
Calculon Calculon
CazoodleBot
CheTeam CheTeam
ChinaClaw
Cliqzbot Cliqzbot
Cogentbot Cloud mapping
Collector Copier
CopyRightCheck Copyscape
Cosmos
Craftbot
Crescent
CrunchBot CrunchBot
Custo CyotekWebCopy
DIIbot DIIbot
DSearch Digincore
DatabaseDriverMysqli
DigitalPebble DigitalPebble
Disco Discobot
DittoSpyder Discoverybot
DnBCrawler-Analytics Dispatch
DomainCrawler DomainCrawler
DomainSigmaCrawler Domains Project
DomainStatsBot Dotbot
Download Wonder
Dragonfly
EMail Siphon EMail Siphon
EMail Wolf EasyDL
Ebingbong Ebingbong
EroCrawler
Express WebPictures
ExtractorPro ExtractorPro
Extreme Picture Finder Extreme Picture Finder
EyeNetIE Ezooms
FHscan FHscan
FemtosearchBot FemtosearchBot
Firefox/7.0 Firefox/7.0
Flunky FrontPage
Foobot GermCrawler
Freeuploader
FyberSpider
Fyrebot
GalaxyBot
Genieo
GetWeb GetWeb
Gigabot Getintent
Go!Zilla Go-Ahead-Got-It
Grabber
Grafula
GrapeFX GrapeFX
HEADMasterSEO HEADMasterSEO
HMView
HTMLparser HTMLparser
HTTrack HTTrack
Havij Havij
Hloader Hloader
HonoluluBot IRLbot
HybridBot Id-search
IDBot
IlseBot
Image Fetch Image Fetch
Image Sucker
IndeedBot IndeedBot
InterGET Intelliseek
Internet Ninja Iskanie
Iria
JOC Web Spider JOC Web Spider
JennyBot JamesBOT
JetCar
Jetty
JikeSpider JikeSpider
Jorgee Jorgee
JustView
Jyxobot Jyxobot
Keyword Density
Kinza Kinza
LNSpiderguy Lanshanbot
LWP::Simple LeechGet
LeechFTP LibWeb
LieBaoFast Lightspeedsystems
LinkWalker Likse
LinkpadBot LinkScan
Lipperhey Spider Linkbot
MIDown tool LinqiaScrapeBot
MQQBrowser Litemage_walker
MSIECrawler Lmspider
MTRobot Ltx71
MFC_Tear_Sample
MIIxpc
Magnet
Mail.RU_Bot Mail.RU_Bot
MarkWatch Majestic-SEO
Majestic12
MarkMonitor
Mass Downloader Mass Downloader
MauiBot MauiBot
Mb2345Browser MegaIndex.ru
Meanpathbot Metauri
Minefield
Mister PiX Mister PiX
MolokaiBot
Mozlila Mozlila
Msrabot
NICErsPRO
NPbot NPbot
Name Intelligence
Nameprotect
Navroad
NearSite NearSite
Needle Net Vampire
NetAnts NetAnts
NetMechanic NetLyzer
NetZIP NetZIP
Netcraft
Netvibes
NextGenSearchBot NextGenSearchBot
Nibbler Nibbler
NimbleCrawler
Nimbostratus Nimbostratus
Ninja
Nmap Nmap
Not Offline Explorer
Nutch Offline Navigator
OnCrawl Openfind
OpenLinkProfiler Page Analyzer
PECL::HTTP Panscient
PHPCrawl Papa Foto
POE-Component-Client-HTTP Petalbot
PageThing.com Picsearch
Pi-Monster
PictureFinder PictureFinder
Pockey Pimonster
Pixray
ProWebWalker
Psbot
Pump Pump
PyCurl PxBroker
QueryN Metasearch
RankActiveLinkBot RankActiveLinkBot
RankingBot Re-re
Rankivabot ReGet
RebelMouse RebelMouse
Recorder Rogerbot
SEOkicks SBIder
SISTRIX SEOlyticsCrawler
SalesIntelligent
Scanbot Scanbot
ScoutJet
Screaming Screaming
SemanticJuice ScreenerBot
SeobilityBot SentiBot
Seomoz SeoSiteCheckup
Site Sucker Site Sucker
SiteCheckerBotCrawler SiteExplorer
SiteLockSpider SiteLockSpider
SiteSnagger
SiteSucker SiteSucker
Snake Sitebeam
SlySearch
Snoopy
SocialRankIOBot SocialRankIOBot
Sociscraper Sottopop
Sogou web spider
Spammen
SpankBot
Spanner Spanner
Spinn3r Spbot
SputnikBot SputnikBot
Sqlmap Sqlworm
Sucker Sqworm
SuperBot SuperBot
Suzuran SuperHTTP
Szukacz Szukacz
T0PHackTeam T0PHackTeam
T8Abot
Teleport
TeleportPro TeleportPro
Telesphoreo The Intraformant
Titan TheNomad
Toata Thumbor
Toweyabot Tracemyfile
Trendiction Trendiction
True_Robot
Turingos Turingos
Turnitin Turnitin
Twice Twice
URLy Warning Typhoeus
VCI VCI
Virusdie Vacuum
VeriCiteCrawler
VidibleScraper
Voltron Voltron
WISENutbot WISENutbot
WPScan
WWW-Collector-E WWW-Collector-E
WWWOFFLE Wallpapers/3.0
Wallpapers Web Auto
WallpapersHD Web Collage
Web Enhancer
Web Fuck Web Fuck
Web Sauger Web Sucker
WebBandit WebAuto
WebCopier WebCollage
WebEnhancer
WebFetch WebFetch
WebFuck WebFuck
WebSauger WebGo IS
WebSucker WebLeacher
Webshag WebPix
Website Quester WebReaper
WebsiteQuester WebZIP
Whack Webster
Who.is Bot Whacker
Widow Widow
WinHTTrack
WiseGuys Robot WiseGuys Robot
Woobot Woobot
Wotbox Zermelo
Wprecon
Xaldon WebSpider
Xaldon_WebSpider
Xenu
Zauba
Zeus Zeus
ZmEu Zitebot
ZumBot ZoomBot
ZyBorg ZyBorg
arquivo.pt adscanner
autoemailspider coccocbot-web
backlink-check
clark-crawler
com.plumanalytics com.plumanalytics
crawl.sogou.com crawl.sogou.com
crawler.feedback crawler.feedback
crawler4j demandbase-bot
domainsproject.org evc-batch
facebookscraper instabid
gopher
internetVista monitor internetVista monitor
lwp-trivial lwp-trivial
magpie-crawler magpie-crawler
muhstik-scan meanpathbot
netEstate NE Crawler
oBot oBot
page scorer page scorer
pcBrowser
plumanalytics plumanalytics
ripz
s1z.ru
satoristudio.net satoristudio.net
scalaj-http scalaj-http
scan.lol scan.lol
seocompany.store seocompany.store
serpstatbot seoscanners
sitechecker.pro seostar
sp_auditbot siteripz
spyfu sysscan
trendiction.com tAkeOut
trendiction.de ubermetrics-technologies.com
x22Mozilla x22Mozilla
xpymep1.exe

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
ald2014.org ahrefs.com
angry-fermi-7633.arukascloud.io cornomase.win
backlink4u.net flavors.me
fickenbumsen.net geoads.com
h2monline.com ifirestarter.ru
koversite.info larger.io
m292.info magazintiande.ru
mrmoneymustache.com stuffpride.com
push-ad.com toyota.7zap.com
strv.se xtrafficplus.com

916
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
1000n1.ru 08800.top
214jaluwobapef.cf 100dollars-seo.com
2345.com 123any.com
24videos.tv 123cha.com
2girls1cup-free.com 24-ak.ru
4kepics.com 3xforum.ro
4pp13.com 4inn.ru
6128786.com 4rent.ru
9icmzvn6.website 5tey7463.weebly.com
aasoldes.fr 6hopping.com
abbanreddy.com 8xv8.com
991mostfm.co.id
aa14ab57a3339c4064bd9ae6fad7495b5f.com
absugars.com
addbin.men
adhome.biz
adnotbad.com adnotbad.com
adserver-e7.com adobereader-free.ru
adsfresh.men adsloads.com
adsland.men adtech.de
adultfriendfinder.com adverster.com
affiliate-fr.com adzpower.com
afora.ru alfa-medosmotr.ru
ahhjf.com alfabot.xyz
aimayangzhi.com
alarmobninsk.ru
allesohnegirls.net allesohnegirls.net
allknow.info alot.com
allmarketsnewdayli.gdn alyeskaresort.com
alloysteel.ru am-se.com
amanda-porn.ga amazingpic.net
anaksma.info amazon-seo-service.com
amung.us
anabolics.shop
ananumous.ru
angry-fermi-7633.arukascloud.io angry-fermi-7633.arukascloud.io
anlimebel.kiev.ua animalia-life.club
apifasterlightin-a.akamaihd.net anonymous-redirect.com
apishops.ru anticrawler.org
apple.com-webbrowsing-security.review apibrowsesmartne-a.akamaihd.net
applicationg29.com apiqualitinknet-a.akamaihd.net
ascat.porn appsaurus.com
asrv-a.akamaihd.net apxeo.info
ausmepa.org.au asia-forum.ru
aussie-prizes.com avtolombard-krasnodar.ru
autobrennero.it axbocz.net
b2b-lounge.com
babs.com.ua
back.dog back.dog
bankmib.ru backgroundpictures.net
bashtime.ru bayareaaeroclub.org
best-businessman.ru beachfix.co
best-coupon-offer.com bensbargains.net
best-mam.ru bestdooz.com
best-seo-offer.com bestserials.com
bestbuy.ca beta.hotkeys.com
bestempresas.es betterhdporn.com
bestpornuha.com
betterscooter.com
beyan.host.sk beyan.host.sk
bitcoins-live.ru big-boards.info
blog.axant.it bioca.org
blogporn.in biographiya.com
boc.kz bioscorp.ru
bochemit.com.ua blog.remote-computer.de
bolegapakistan.com bloke.com
bongacams.com bmw.afora.ru
bonzibuddi.com bocoarchives.org
boole.onlinewebshop.net boostmyppc.com
bpro1.top breastaugmentation.co.za
brainxs.us brianhenry.co
break-the-chains.com brokergid.ru
brk-rti.ru buy-meds24.com
browsepulse-a.akamaihd.net
btnativenav.com
businescoop.men
business-suggested.tk
buyclomidonlaine.com buyclomidonlaine.com
buyessay3.blogspot.ru buynorxx.com
buyessayonline19.blogspot.ru c-english.ru
buzzonclick.com carloans.com
bycontext.com carson.getenjoyment.net
bytimedance.ru cdncash.org
cam-kontakte.org cellfun.mobi
capsderfudd.tk changde.58.com
carfax.com.ua
carsdined.org
cartierlovestore.com
casablancamanor.co.za
cascadelink.org
castingbank.ru
catalogs-parts.com
cejewelry.xyz
cenoval.ru
chcu.net chcu.net
cheapbarbour.online cheapbarbour.online
chidporn.com cheapbelstaff.online
chocolateslim-u-srbiji.com cialisovercounteratwalmartusa.com
choosecuisine.com cigarpass.com
ci.ua
cialischsrx.com
ciekawinki.pl
cinemaenergy-hd.ru cinemaenergy-hd.ru
cleanallvirus.com circlesl.com
cleanmypc.com citizenclsdriveri7.pen.io
clickbank.net clips.ua.ac.be
clksite.com coaching-netz.info
clubfashionista.com compliance-alexa.top
codysbbq.com concordexoticrentals.com
coldfilm.ru continent-e.tv
compliance-andrew.xyz converse.ddsoldes.fr
compliance-checker.info coolwallpapers4k.info
compliance-jessica.top corta.co
compliance-julianna.top cottageofgrace.com
cool-wedding.net cowblog.fr
cordstrap.cc craftburg.ru
cowlmash.com credit.co.ua
crazyprotocol.com customcatchcan.com
d2jsp.org d2jsp.org
dafatiri.com
daisye.top
dame-ns.kz dame-ns.kz
dandiyabeats.in
darkbooks.org darkbooks.org
darmebel.com.ua data.vtc.pw
dayibiao.com degerlund.net
dellalimov.com delayreferat.ru
demon-tweeks.com demenageur.com
descargar-musica-gratis.net demian.kz
detskie-konstruktory.ru dev78.dioniqlabb.se
dev33.dioniqlabb.se dichvuvesinhhanoi.com
dieta-personalna.pl dieswaene.com
dispo.de dimaka.info
divatraffic.com documentsite.net
dogsrun.net domaineaneblanc.com
domain.webkeyit.com dpihatinh.gov.vn
doreenblog.online drhomes.biz
dosugrostov.site duplicashapp.com
drugstoreforyou.com eaplay.ru
dwomlink.info edudocs.net
e-c.al edwinkonijn.com.au
e-commerce-seo.com election.interferencer.ru
earthmagic.info electricwheelchairsarea.com
ecxtracking.com
editmedios.com
ednorxmed.com
ege-essay.ru
electro-prom.com
eleimgo.pw eleimgo.pw
elektir.ru elektrozigarettekaufen1.devhub.com
enbersoft.com elektrozigaretten1.postbit.com
enhand.se emailaccountlogin.co
erectile.bid emergencyneeds.org
errorfixing.space englate.com
escortplius.com eonpal.com
espaceinventoristes.com erotikstories.ru
essayservicewriting.org es5.com
eu-cookie-law.blogspot.com everflora.ru
everypony.ru evrotekhservis.ru
excitacao.com faithe.top
extener.org familyphysician.ru
ezigarettenkaufen2.dreamwidth.org fast-wordpress-start.com
ezigarettenshop2.myblog.de feel-planet.com
ezrvrentals.com
factorynightclub.com
farm26.ru
fba-mexico.com
fbdownloader.com
feeriaclub.ru feeriaclub.ru
felizporno.com fettefrauen.net
filmbokep69.com fickenprivat.info
findclan.org filesvine.com
findpik.com fillmewithhappiness.com
finejewelryshop.ru fiverr.com
firesub.pl
fitness-video.net
fiuxy.com
flipper.top
flirt4free.com flirt4free.com
fortwosmartcar.pw floating-share-buttons.com
free-fb-traffic.com flprog.com
freelinkbuilding.website.tk foodgid.net
freemaintenancesysforpcandmac.top forex.osobye.ru
freeuploader.com forsex.info
fuckmill.com forums.d2jsp.org
g7m.pl frameimage.org
getmyads24.com franklinfire.co
glavprofit.ru freejabs.com
goblacked.com freenode.info
gobongo.info freenom.link
gojiberriess.apishops.ru freshmac.space
gosmeb.ru froggytube.com
gov.yanao.ru fuck-paid-share-buttons.xyz
funnypica.com
fxund.us
fym.com.ru
garciniaxt.us
gateway.zscalertwo.net
gemgrab-a.akamaihd.net
genetworx.com
getoutofdebtfree.org
gettpromos.com
ggiaro.com
gilbertbanda.net
girlporn.ru
girlsatgames.ru
gkvector.ru
globalsurfari.com
goldandcard.ru
goldenggames.com
googlemare.com
gourcy.altervista.org
graphicwe.org graphicwe.org
greenshop.su
greenzaim.ru greenzaim.ru
grtyi.com gsasearchenginerankerdiscount.com
gsasearchengineranker.space guigyverpo.cf
gsasearchengineranker.xyz hamptonoaks.ca
gta-top.ru happy.new.yeartwit.com
hccoder.info hard-porn.mobi
hdwallpapers-free.com hdpixion.com
heatpower.ru health-medical-portal.info
hermesreplica.win hentaiheroes.com
host-protection.com hitcpm.com
host-tracker.com hotdl.in
hostnow.men howlongdoestizanidinestayinyoursystem.blogspot.com
hothor.se hreade.com
hotloans.ru htmlcorner.com
hoverboard360.nl husky-shop.cz
hptwaakw.blog.fc2.com iccornacircri.cf
hspline.com
hunterboots.online
hustoon.over-blog.com
i-service.kz
ico.re
ictizanidinehcl4mg.blogspot.com ictizanidinehcl4mg.blogspot.com
iframe-toloka.com ifmo.ru
ikritikimou.gr iideaidekonkatu.info
ilmexico.com ilikevitaly.com
imadedinner.net imgarit.pw
iminent.com imk.com.ua
inclk.com inboxdollars.com
infektsii.com incolors.club
ipchicken.com inet-traffic.com
iqoption-bin.com infoupdate.org
iqoption.com iqoption.com
iradiology.ru irkutsk.online-podarki.com
isitpaleo.info iyasimasennka.com
istmira.ru jacago.com
itag.pw jerseychinabizwholesale.com
itronics.ca jerseychinabizwholesale.us
jamiembrown.com jerseywholesaleelitestore.com
jav-fetish.com
javitas.info
jewelryandfiligree.com jewelryandfiligree.com
joessmogtestonly.com jobmarket.com.ua
jus0wil.pp.ua joy-penguin.com
kaac.ru
kadashihotel.com
karaganda.xkaz.org karaganda.xkaz.org
kareliatobacco.ru
kazan.xrus.org kazan.xrus.org
kazan.zrus.org kazinogames.lv
kenaba.su keywordsuggests.com
keyhantercume.com khafre.us
kihi.gdn kino-filmi.com
kiinomaniak.pl kinoflux.net
kino-key.info kinohall.ru
komputers-best.ru kinosed.net
koopilka.com kometars.xyz
kopihijau.info komputernaya-pomosh-moscow.ru
konturkrasoty.ru
kostenlos-sexvideos.com
kostenloser-sex.com
krafte.ru
krasivoe-hd.net krasivoe-hd.net
kredit-blog.ru kredit-blog.ru
kredit-pod-zalog-krasnodar.ru kupiproday.com.ua
kurbappeal.info kvartira-sutochno.com
kwzf.net lakomka.com.ua
ladsblue.com landscapebackgrounds.blogspot.com
laudit.ru laxdrills.com
letolove.ru laxob.com
letsrepair.in le-clos-des-alouettes.com
likesuccess.com lecbter-relationships.ga
lineshops.biz lechenie-gemorroya.com
link.ac lennatin.info
littleberry.ru lineavabit.it
littlesexdolls.com linkbuddies.com
lol-smurfs.com lisque.batcave.net
lordzfilmz.me livejasmin.com
lunamedia.co loadingpages.me
machicon-akihabara.info locatellicorretor.com.br
mackeeper-center.club lonerangergames.com
mainlinehobby.net lonfon.xyz
makedo.ru longgreen.info
makemoneyonline.com louboutinbooties.xyz
maladot.com low-format.ru
lyngdalhudterapi.no
macfix.life
madot.onlinewebshop.net
malls.com
mansparskats.com
marketingvici.com
marmitaco.cat marmitaco.cat
marwer.info mathgym.com.au
mb140.ru maximilitary.ru
mebel-alait.ru mazda-roadsters.com
meduza-consult.ru medanestesia.ru
megagrabber.ru meds-online24.com
menhealed.net medtherapy.ru
mere.host.sk meetlocalchicks.com
metalonly.info
metaxalonevstizanidine.blogspot.com metaxalonevstizanidine.blogspot.com
mexicotravelnet.com meteocast.net
mezaruk.info meteostate.com
mhi-systems.ru michaelkorssaleoutletonline.net
michaelkorsoutletstore.net michellblog.online
minet.club mobile-appster.ru
missvietnam.org mobsfun.net
mmgq.ru moivestiy.biz
modenamebel.ru moncleroutletonline.win
moi-glazki.ru monitorwebsitespeed.com
mojpreskumanie.com moskva.nodup.ru
monclercoats.xyz mp3films.ru
monclervests.xyz mp3ritm.top
moroccosurfadventures.com
motherboard.vice.com
mp3s.club mp3s.club
muschisexbilder.com muznachas-service.ru
musicvidz.ru mydoctorok.ru
mvpicton.co.uk mygameplus.ru
mycouponizemac.com myhealthcare.com
myphotopipe.com myonigroup.com
naturtreenspicerx.pw naj-filmy24.pl
needtosellmyhousefast.com napalm51.nut.cc
nerudlogistik.ru naughtyconnect.com
netcheckcdn.xyz nbsproject.ru
nevansk.ru nelc.edu.eg
new-post.tk net-radar.com
noclegonline.info netvouz.com
notasprensa.info networkad.net
ntic.fr nfljerseys.online
o-o-6-o-o.com nfvsz.com
nibbler.silktide.com
nippon-bearings.ru
nonews.co
nrjmobile.fr
o-o-8-o-o.com o-o-8-o-o.com
oballergiya.ru odywpjtw.bloger.index.hr
obiavo.kz ok.ru
oivcvx.website
okuos.com okuos.com
one-gear.com onemactrckr.com
online.ktc45.ru onlyforemont.ru
onlinemeetingnow.com optitrade24.com
ons-add.men
onthemarch.co
optikremont.ru
ordernorxx.com ordernorxx.com
oz-offers.com orenburg-gsm.ru
ozas.net osoznanie-narkotikam.net
paintingplanet.ru oyster-green.com
panouri-solare-acoperis.com panouri-solare-acoperis.com
partner-stop.men paperwritingservice17.blogspot.ru
partnerline.men partnerline.men
paydayonlinecom.com pdns.cz
pb-dv.ru pensplan.com
pcboa.se percin.biz.ly
pdns.download perfectpracticeweb.com
peekyou.com petitions.whitehouse.gov
petedrummond.com phrcialiled.com
picquery.com picsearch.com
picscout.com
picsforkeywordsuggestion.com
pinkduck.ga
pio.polytopesexempt.com pio.polytopesexempt.com
piski.top piulatte.cz
pixelrz.com piuminiita.com
pizza-imperia.com pivka.xyz
pl.aasoldes.fr placid-rounded-coast.glitch.me
pochemychka.net play-movie.pl
pogosh.com poisk-zakona.ru
pomoc-drogowa.cba.pl popander.mobi
pons-presse.com poptool.net
popup-fdm.xyz porndl.org
pornohub.me porngalleries.top
pornoplen.com pornhive.org
pornozhara.com pornofeuer.com
pornpost.in pornohd1080.online
portadd.men pornokorol.com
portal-eu.ru pornotubs.com
pourvous.info posible.net
pozdrawleniya.com preconnubial.usuby.site
pregnant.guru privetsochi.ru
pricheskaonline.ru prodess.ru
primedice.com pts163.ru
privacyassistant.net
privacylocationforloc.com
privhosting.com
proftests.net
pron.pro
pukaporn.com
purchasepillsnorx.com purchasepillsnorx.com
qor360.com puzo2arbuza.ru
quick-offer.com pyramidlitho.webs.com
qwertty.net randki-sex.com
rabotaetvse.ru rarbg.to
redbottomheels.xyz raschtextil.com.ua
redirectingat.com rating-bestcasino.com
realizmobi.com
rebuildermedical.com
redirectme.net
redirlock.com redirlock.com
registratciya-v-moskve.ru reeyanaturopathy.com
registrationdomainsite.com renecaovilla.online
reining.lovasszovetseg.hu renhacklids.tk
relatodelpresente.com.ar resant.ru
remont-komputerov-notebook.ru rethinkwasteni.info
rep-am.com rfid-locker.co
resellerclub.com roleforum.ru
responsinator.com ros-ctm.ru
ringporno.com sack.net
ringtonepartner.com sammlungfotos.online
rique.host.sk sbornik-zakonov.ru
rniaeba.ga sdi-pme.com
roznica.com.ua searchengineranker.email
rucrypt.com searchlock.com
rusvideos.su seasaltwithfood.com
salmonfishingsacramentoriver.com secret.xn--oogle-wmc.com
samoiedo.it semxiu.com
sape.top seo-platform.com
sarm.tk seoboxes.com
scalerite.co.za seotoolsagency.com
scanner-elena.top serptehnika.ru
searchtooknow-a.akamaihd.net serw.clicksor.com
segol.tv sex-znakomstva.online
seoexperimenty.ru sexreliz.com
seorankinglinks.com shareyards.com
serpstat.com shemale-sex.net
sex-tracker.de shohanb.com
shoplvlv.us shopwme.ru
shymkent.xkaz.org
sibvitr.ru sibvitr.ru
sientalyric.co signal03.ru
sildenafil-tadalafil.info signoredom.com
simple-image.com.ua simpoed.ufop.br
site-auditor.online site3.free-share-buttons.com
siteaero.com sitiz.club
sitebeam.net
sitopreferito.it sitopreferito.it
skylta.com smartbalanceworld.com
skyway24.ru smsactivator.ru
smartshoppymac.com snts.shell-pmr.ru
snyatie-lomki-v-stacionare.ru socialbookmarksubmission.org
social-button.xyz socialbuttons.xyz
sophang8.com sortthemesitesby.com
space4updating.win soserfis.com
sr-rekneskap.no spamnuker.com
sports-supplements.us
spravka130.ru
stackthatbucks.com stackthatbucks.com
stair.registrydomainservices.com stard.shop
stardevine.com stockspmb.info
stpolice.com stroicol.net
strangeduckfilms.com sugarkun.com
strigkaomsk.ru sugarlyflex.pw
stroy-portal22.ru sumo.com
sugvant.ru superiends.org
supernew.org supermesta.ru
surfbuyermac.com surffoundation.nl
sygraem.com swingerseiten.com
symbaloo.com t-bygg.com
taihouse.ru tecspb.ru
tandvardshuset.net teencastingporn.com
tdsing.ru teesdaleflyballclub.co.uk
teguh.info telegraf.by
templates.franklinfire.co telegramdownload10.com
the-usa-games.blogspot.com telemetryverification.net
thin.me.pn testbotprocessor44.com
tizanidine4mguses.blogspot.com testingads.pro
tizanidineformigraines.blogspot.com texbaza.by
tizanidinestreetprice.blogspot.com tfxiq.com
tizanidineusedfor.blogspot.com thebitcoincode.com
todohr.com thewebsitetemplate.info
toolsky.com titslove.yopoint.in
topdownloads.ru tizanidine4mgstreetvalue.blogspot.com
track2.shop tizanidinecapsules.blogspot.com
trahic.ru tizanidinemusclerelaxant.blogspot.com
tri-slona.org top1-seo-service.com
tripper.de topkarkas.com
triumf-realty.ru torontoplumbinggroup.com
truemfilelj.gq torrentdownloadhub.com
turbodsp.com totu.info
ukrobstep.com truck-addzilla.life
umaseh.com trudogolik.net
unblocksit.es ttrraacckkrr.com
uptime.com tupper-posuda.ru
urldelivery.com turist-strani.ru
ustion.ru twodollarshows.com
uzporno.mobi twu.com.ua
vabasa.inwtrade.com tyumen.xrus.org
vacuumscleaner.com ucoz.ru
vadimkravtcov.ru ucsol.ru
venta-prom.ru unionmarkt.de
vesnatehno.com unisexjewelry.org
vgoloveboli.net upproar.com
videokrik.net urlopener.blogspot.com.au
vigrx-original.ru utiblog.fr
validdomain.xyz
vclicks.net
velen.io
videonsk.com
videos-for-your-business.com
vip-dom.in vip-dom.in
vipms.ru vipromoffers.com
voloslove.ru vipsexfinders.com
vpnmouse.com vk-mus.ru
vseigry.fun voprosotvet24.ru
w7s.ru vriel.batcave.net
wahicbefa31.soup.io vrnelectro.ru
webkeyit.com wallpaperaccess.com
website-analyzer.info waterpurifier.club
website-speed-check.site web-betting.ru
weburok.com webads.co.nz
wemedinc.com wejdz-tu.pl
whatsappdownload10.com
wheelchairliftsarea.com wheelchairliftsarea.com
while.cheapwebsitehoster.com while.cheapwebsitehoster.com
whipme.yopoint.in wholesalejerseychinashop.com
wholinkstome.com wildcattube.com
withstandingheartwarming.com wingsofrefuge.net
worldoffiles.ru wma-x.com
wufak.com wnhjavlhezp.gq
www.arenda-yeisk.ru woman-tampon.ru
x-diesel.com wonderfulflowers.biz
x-musics.com worldhistory.biz
xboxster.ru ww1943.ru
xn----7sbaaabaei0cc8aj5bj0bncejx.xn--p1ai wzgyyq.com
xn--h1aakne2ba.xn--p1ai xblognetwork.com
xsion.net xn----8sbarihbihxpxqgaf0g1e.xn--80adxhks
xvideosporn.biz xn----9sbubg3ambdfl1j.xn--p1ai
yellowproxy.net xn--80aanaardaperhcem4a6i.com
yogamatsexpert.com xn--80adaggc5bdhlfamsfdij4p7b.xn--p1ai
youporn-forum.ga xn--hxazdsfy.blogspot.com
your-bearings.com xvideosbay.com
youtube-downloader.savetubevideo.com xxxtube69.com
yugk.net yatrk.xyz
zakon-ob-obrazovanii.ru yellowstonevisitortours.com
zakonobosago.ru youdesigner.kz
yourporngay.com
ytmnd.com
zambini.ru zambini.ru
zaobao.com.sg zarabotat-na-sajte.ru
zastroyka.org zastenchivosti.net
zed21.net zigarettenonlinekaufen2.bloog.pl
zeroredirect8.com zixizop.net.ru
zog.link znakomstva-moskva77.ru
zryydi.com znakomstvaonlain.ru
zverokruh-shop.cz zrelaya.pw
zzbroya.com.ua zrus.org

478
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
300richmond.co.nz 256bit.by
4rent.ru 273-fz.ru
4ur.click 2nt.ru
4webmasters.org
55wmz.ru 55wmz.ru
5ws.dating-app.ru 7minuteworkout.com
777-club.ru 91abcw.com
aaronabel.com aasoldes.fr
absolute-s.ru abcdefh.xyz
add-add.men adanih.com
addtoadd.men addtoadd.men
adsland.men adinterax.com
allornamenti.com admanaerofoil.com
am15.net adultnet.in
amateurmatch.com advertex.info
animali.deagostinipassion.it agecheckadult.com
anonymizeme.pro aghanyna.com
applicationg29.com alf-img.com
arkkivoltti.net allnews.md
atmovs.com alloysteel.ru
audiofree.ru allwomen.info
babyguns.ru alpharma.net
bank.uz alyeskaresort.com
bannerspace.com angry-fermi-7633.arukascloud.io
beauty-bracelet.com apiportalmorecom-a.akamaihd.net
begalka.xyz arquivo.pt
bestcurs.org asophoto.com
binomo.kz atlasvkusov.ru
bizcheapjerseyswholesalechina.com atout-energie-69.com
bizru.info aucoinhomes.com
bluerobot.info auto-moto-elektronika.cz
brainzpod.win aviav.org
cam-kontakte.org ayanaspa.com
cartierbracelet.xyz azazaporn.com
cartierloveringreplica.xyz b00kmarks.com
chastnoeporno.com bad-stars.net
chatroulette.life belsetirehafi.tk
christianlouboutinoutlet.win best-businessman.ru
cineacademy.ru betteroffers.review
com-secure.download big-cash.net
connectingsingles.com bikini-image.com
cookielawblog.wordpress.com bimatoprost-careprost.com
customcatchcan.com bonvillan.com
customchocolate.business-for-home.com brainboosting.club
d0t.ru brains2.biz
darkbooks.org bronzeaid-a.akamaihd.net
darodar.com buyessay3.blogspot.ru
degerlund.net camel-beach.com
cannibalcheerleader.com
cascadelink.org
ciproandtizanidine.blogspot.com
constantaservice.net
cottageofgrace.com
crest-poloski.ru
danschawbel.com
design-lands.ru design-lands.ru
dieta-personalna.pl diminishedvalueoforegon.com
dktr.ru divci-hry.info
dogbreedspicture.net dogoimage.com
domain-submit.info dojki365.online
domainanalyzing.xyz domaineaneblanc.com
domainsatcost.com domcran.net
doska-vsem.ru downloadkakaotalk.com
dostavka-v-krym.com dyt.net
e-commerce-seo1.com e-commerce-seo1.com
e-kwiaciarz.pl eachdayisagift.review
ecommerce-seo.org easyukraine.com
egvar.net electricwheelchairsarea.com
elektrischezi.canalblog.com en.altezza.travel
enternet.ee enbersoft.com
enthuse.computernetworksonline.com eropornosex.ru
ereko.ru exoclick.com
etm-consult.de extractorandburner.com
ezigaretteshop2.vefblog.net eyelike.com.ua
fetroshok.ru ezigarettenshop1.yolasite.com
fickenprivat.info familienzahnaerzte.com
filesclub.net familyholiday.ml
filmi-onlain.info fastfixing.tech
filunika.com.ru findsexguide.com
financehint.eu fingerprintjs.com
findanysex.com flashahead.info
firstsiteguide.com flashlarevista.com
fr-bearings.ru floridahuntingfishingadventures.com
forpostlock.ru
fotzen-ficken.com
fr.netlog.com fr.netlog.com
freegamesplay.online freemags.cc
frighteningremain.cf gg-arena.ru
gambarxkata.co gifspics.com
generalporn.org gigixo.com
getlamborghini.ga googlefeud.com
glavprofit.ru googst2.ru
gnuetella.com graphicwe.org
gojiberriess.apishops.ru greatgrace.ru
golaya.pw guge.io
gowreckdiving.com hannasolution.ru
groupmoney.ru hatedriveapart.com
gsasearchengineranker.pw highspeed5.net
gstatey.net hitsbox.info
hahashka.ru hoste.octopis.com
hd-film.pl hosting-tracker.com
hd-filmy.net idealtits.net
hdimagegallery.net ilovevitaly.ru
hdwallpapers-free.com imperia31.ru
hidemyass.com importchinacoach-teach.com
himgaws.pw iqs.biz.ua
hoholikik.club iradiology.ru
horoshieokna.com istizanidineanarcoticdrug.blogspot.com
hotdl.in
howmuchdoestizanidinecost.blogspot.com
ibmdatamanagement.co
ictizanidinehcl4mg.blogspot.com
iinstalll-fii1leis.jus0wil.pp.ua
imediadesk.com
impotentik.com
in-tandem.co
instabid.tech
investmac.com
istock-mebel.ru istock-mebel.ru
itag.pw itch.io
itbc.kiev.ua izoll.ru
javlibrary.cc jyvopys.com
jobmarket.com.ua kareliatobacco.ru
justdating.online kaz.kz
kamalsinha.com keyword-suggestions.com
keywordhut.com
kiinomaniak.pl kiinomaniak.pl
kinozapas.com kiprinform.com
kollekcioner.ru knowyournextmove.com
lacapilla.info konturkrasoty.ru
lafourmiliaire.com ktotut.net
landmania.ru ledpolice.ru
lawyersinfo.org lignofix.ua
ledis.top liquimondo.com
letslowbefast.today live-sexcam.tk
likrot.com locatellicorretor.com.br
liumimgx.pw lomb.co
lombia.com magicdiet.gq
lordzfilmz.me marktforschung-stuttgart.com
louboutinreplica.pw matpre.top
lunchrock.co mcadamssupplyco.com
meteostate.com mebel-ekb.com
monclercheap.xyz mejoresfotos.eu
morepoweronmac.trade mnogabukaff.net
mrcsa.com.au modenamebel.ru
msk.afora.ru modnie-futbolki.net
musirc.com morefastermac.trade
myxdate.info mylovelibrabry.com
natali-forex.com mymobilemoneypages.com
newyorkhotelsmotels.info mywallpaper.top
nonameread45.live nakozhe.com
nordstar.pro nextconseil.com
obiavo.uz nextlnk12.com
officedocuments.net nikhilbahl.com
okout.ru noumeda.com
oktube.ru oballergiya.ru
onlinadverts.com ochistka-stokov.ru
onlinemeetingnow.com offtime.ru
orion-v.com okuos.com
paclitor.com one.net.in
palocco.it oralsexfilme.net
panicatack.com ozoz.it
paparazzistudios.com.au paccohichetoti.ml
partner-stop.men page2rss.com
pearlisland.ru pechikamini.ru
phobia.us pewit.pw
picture-group.com phrcialiled.com
pinwallpaper.top poem-paying.gq
pipki.r.acdnpro.com pogodnyyeavarii.gq
pl-top.pl pornoblood.com
pochtovyi-index.ru pornoklad.net
poiskzakona.ru porto.abuilder.net
popander.mobi professionaldieselcare.com
popunder.net profitsport.club
pr0fit-b0x.com prombudpostach.com.ua
predmety.in.ua pronorm.fr
pretty-mart.com psoriasis-file.trade
pronekut.com pulseonclick.com
prostitutki-novgoroda.org responsive-test.net
ratemodels.net roma-kukareku.livejournal.com
rcpmda.ikan1080.xyz rucrypt.com
registry-cleaner.net rusprostitute.com
remybutler.fr rvi.biz
renhacklids.tk sajatvelemeny.com
rewardpoll.com salutmontreal.com
ru-dety.ru sammlungfotos.online
ru-mediaget.ru sape.top
rustic-quiver.win sbf441.com
saddiechoua.com sbwealthsolutions.ca
santasgift.ml scanner-mark.top
sanyuprojects.com scanner-walter.top
sarf3omlat.com scansafe.net
scanner-jessica.top scanspyware.net
search-goo.com searchinquire.com
searchimage.co seasonvar.ru
seryeznie-znakomstva.ru seo-smm.kz
sethrollins.net seo-tools-optimizing.com
sexpartygirls.net service-core.ru
sexstream.pl sharebutton.to
sexxdate.net shemalegalls.blogporn.in
shiksabd.com shopsellcardsdumps.com
shisha-swag.de simul.co
shopwme.ru site5.com
smartpet.ru sogimlecal.tk
sockshare.net spaceshipad.com
softonicads.com storehouse.ua
strangeduckfilms.com strongsignal-a.akamaihd.net
supermesta.ru svetlotorg.ru
surflinksmedical.com tacbibirfa.tk
tacbelarus.ru tattomedia.com
taraz.xkaz.org td-l-market.ru
teastory.co
techart24.com techart24.com
the-torrent-tracker.blogspot.com teenfuck.tv
telefonsexsofort.tk
telesvoboda.ru
theautoprofit.ml
thecoolimages.net
thegioixekhach.com thegioixekhach.com
themeforest.net tizanidine4mg.blogspot.com
theporndude.com tizanidinesideeffectsweightloss.blogspot.com
thexart.club tk-assortiment.ru
titangel-vietnam.com tomck.com
tizanidinewithdrawal.blogspot.com tooplay.com
tootoo.to topflownews.com
top10-way.com tracksz.co
torrnada.ru
tracxn.com tracxn.com
traffic-club.info triumf-realty.ru
traffic2money.com trubywriting.com
tt-ipd.info tube8.com
unisexjewelry.org tvteleport.ru
url-img.link unlimitdocs.net
urlopener.blogspot.com.au uogonline.com
usadacha.net ustion.ru
v720hd.ru vereo.eu
validdomain.xyz vezuviy.su
veerotech.com viagra.pp.ua
vesnatehno.ru video-production.com
villakohlanta.nu vip-dom.in
vip.51.la visitcambridge.org
vroze.com vitalads.net
w7s.ru voprosotvet24.ru
wahicbefa31.soup.io webextract.profound.net
wapsite.me webpromotion.ae
weddingdresses.xyz website-speed-up.top
whatsupinfoley.com welcomeauto.ru
womensplay.net wineitudes.wordpress.com
worst-sites.online wufak.com
www.888.com x-mix.info
www.event-tracking.com x-true.info
xblog.in xblog.in
xfluro.com xchat26.myfreecams.com
xn-----6kccaibs5cb8afhjrfmix2n.xn--p1ai xn--80aafb2a.xn--p1ai
xn----dtbndd4ae7eub.top xn--80ak6aa92e.com
xn--80atua3d.xn--p1ai xn--d1aifoe0a9a.top
xn--h1ahbi.com.ua yaderenergy.ru
xn--oogle-wmc.com youjizz.vc
yginekologa.com yurgorod.ru
yoshkarola.zrus.org za-music.mymobiplanet.com
youandcredit.ru zeroredirect.com
youtoner.it zeroredirect11.com
ytmnd.com zygophyceous.womanstars.site
zmoda.hostreo.com

10
dev-tools/test_units/ratelimittest-beta.txt
View file

@ -581,14 +581,4 @@
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html> </html>

10
dev-tools/test_units/ratelimittest-master.txt
View file

@ -581,14 +581,4 @@
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html> </html>

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.60 0; 10.1.0.31 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.02.2914 ### Version: V4.2022.02.2915
### Updated: Sat Feb 12 22:01:23 UTC 2022 ### Updated: Sun Feb 13 10:04:14 UTC 2022
### Bad Bot Count: 636 ### Bad Bot Count: 636
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.02.2914 ### Version: V4.2022.02.2915
### Updated: Sat Feb 12 22:01:23 UTC 2022 ### Updated: Sun Feb 13 10:04:14 UTC 2022
### Bad Bot Count: 636 ### Bad Bot Count: 636
################################################### ###################################################
### Version Information ## ### Version Information ##