vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-03 19:20:16 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2022.08.3311 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2022-08-25 10:09:23 +00:00
parent 00e75b48ab
commit e4d53b5dba
48 changed files with 93904 additions and 93884 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.08.3310 #### Version: V4.2022.08.3311
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.08.3310 #### Version: V4.2022.08.3311
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -14,7 +14,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2022.08.3310 #### Version: V4.2022.08.3311
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

11600
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2022.08.3310 #### Version: V4.2022.08.3311
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

11604
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

11604
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

11604
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

11604
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.43 1; 10.1.0.53 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.43 0; 10.1.0.53 0;
127.0.0.1 0; 127.0.0.1 0;

11604
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.43 1; 10.1.0.53 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.43 0; 10.1.0.53 0;
127.0.0.1 0; 127.0.0.1 0;

11604
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.43 1; 10.1.0.53 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.43 0; 10.1.0.53 0;
127.0.0.1 0; 127.0.0.1 0;

11604
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
3310 3311

11604
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

11604
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
13.65.187.16 0; 40.124.40.247 0;

11604
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.43 1; 10.1.0.53 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.43 0; 10.1.0.53 0;
127.0.0.1 0; 127.0.0.1 0;

11604
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.43 1; 10.1.0.53 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.43 0; 10.1.0.53 0;
127.0.0.1 0; 127.0.0.1 0;

11604
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.43 1; 10.1.0.53 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.43 0; 10.1.0.53 0;
127.0.0.1 0; 127.0.0.1 0;

11604
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
13.65.187.16 0; 40.124.40.247 0;

11604
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
13.65.187.16 0; 40.124.40.247 0;

11604
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.43 1; 10.1.0.53 1;
127.0.0.1 1; 127.0.0.1 1;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
ALittle Client Aipbot
CATExplorador DomainCrawler
DSearch GermCrawler
Grabber GrapeFX
IlseBot JamesBOT
Openfind JikeSpider
Rankivabot Mail.RU_Bot
WebLeacher WebSauger
evc-batch ZumBot
tAkeOut crawl.sogou.com

308
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
404checker 404enemy
ADmantX
AIBOT AIBOT
Acunetix ALittle Client
AfD-Verbotsverfahren Abonti
AhrefsBot Aboundexbot
Aipbot Alligator
Alexibot Anarchy99
AllSubmitter Apexoo
AlphaBot AwarioSmartBot
Anthill BDCbot
Attach BLEXBot
AwarioRssBot
BBBike
BDFetch
BackDoorBot BackDoorBot
BackStreet BackWeb
Badass BacklinkCrawler
Bandit Barkrowler
Battleztar Bazinga
BetaBot
Bigfoot Bigfoot
Bitacle
Black Hole Black Hole
Blackboard BotALot
Blow
Buddy
BuiltWith BuiltWith
CODE87 CATExplorador
CSHttp
Calculon
CazoodleBot
Cegbfeieh Cegbfeieh
CheTeam
CheeseBot CheeseBot
ChinaClaw CherryPicker
Chlooe
Citoid Citoid
Claritybot
Cliqzbot Cliqzbot
Copier Cloud mapping
Cogentbot
Copyscape Copyscape
Cosmos
Craftbot
Crawling at Home Project Crawling at Home Project
CrazyWebCrawler Crescent
Curious
Custo
DBLBot
DSearch DSearch
DataCha0s DataCha0s
DatabaseDriverMysqli DatabaseDriverMysqli
Demon Demon
Deusu
Devil Devil
Dirbuster DigitalPebble
Disco
Discobot Discobot
Dispatch
DomCopBot
DomainAppender
DomainSigmaCrawler DomainSigmaCrawler
DomainStatsBot DomainStatsBot
Dragonfly Download Wonder
Drip
EMail Siphon
EasyDL EasyDL
Evil Ebingbong
Ecxi
Exabot Exabot
Express WebPictures Extractor
ExtractorPro EyeNetIE
Ezooms
Fimap Fimap
Firefox/7.0
FlashGet
Flunky Flunky
FrontPage Freeuploader
Fuzz Fyrebot
GT::WWW GT::WWW
GetWeb GetRight
Getintent Getintent
Go-Ahead-Got-It Gotit
GoZilla GrapeFX
GrabNet
Grafula
GrapeshotCrawler
HEADMasterSEO HEADMasterSEO
HMView
HTMLparser HTMLparser
HTTP::Lite HTTP::Lite
HonoluluBot HTTrack
HybridBot Haansoft
Harvest
Hloader
IRLbot IRLbot
Intelliseek Image Fetch
Indy Library
InfoTekies
Internet Ninja Internet Ninja
Iria
Iskanie Iskanie
IstellaBot IstellaBot
JamesBOT JOC Web Spider
Jbrofuzz Jbrofuzz
Jetty
JikeSpider JikeSpider
Joomla Joomla
Jyxobot JustView
Keyword Density LWP::Simple
Kozmosbot Larbin
LexiBot Leap
LeechFTP
LeechGet
Libwhisker Libwhisker
LinkWalker LieBaoFast
Linkbot LinksManager
LinkpadBot LinqiaRSSBot
Lipperhey
Lipperhey Spider Lipperhey Spider
Lmspider Lmspider
Ltx71 Ltx71
MFC_Tear_Sample MFC_Tear_Sample
MQQBrowser MIIxpc
MJ12bot
MSIECrawler
MTRobot MTRobot
Magnet Mag-Net
Mail.RU_Bot
Majestic12
MarkWatch MarkWatch
Masscan Mass Downloader
MauiBot
Mb2345Browser Mb2345Browser
Microsoft Data Access Microsoft Data Access
Mister PiX Mister PiX
Moblie Safari Moblie Safari
MolokaiBot Mojolicious
Morfeus Fucking Scanner
Mozlila
Mr.4x3
Msrabot Msrabot
Musobot
Name Intelligence
NearSite
Needle
Nessus Nessus
NetLyzer NetLyzer
NetSpider Netcraft
Netvibes Netvibes
NextGenSearchBot NextGenSearchBot
NimbleCrawler Niki-bot
Nikto
Ninja Ninja
Nmap Octopus
Offline Explorer
OpenLinkProfiler OpenLinkProfiler
OpenVAS
Openfind Openfind
Openvas OrangeBot
PECL::HTTP OutfoxBot
PHPCrawl PageGrabber
POE-Component-Client-HTTP PageScorer
Pandalytics Pandalytics
Panscient Pavuk
Papa Foto Petalbot
Pi-Monster
Picscout Picscout
Picsearch
PictureFinder PictureFinder
Piepmatz Probethenet
PleaseCrawl
Pockey
ProWebWalker
Psbot Psbot
RSSingBot Pump
RankActive PxBroker
RankingBot RankingBot
RankingBot2 RankurBot
Rankivabot Re-re
ReGet ReGet
Recorder RealDownload
RedesScrapy
RocketCrawler RocketCrawler
Rogerbot
SBIder
SEOkicks-Robot
SEOprofiler
SISTRIX SISTRIX
SMTBot Searchestate
ScreenerBot Seekport
ScrepyBot
SemanticJuice
Semrush Semrush
SemrushBot SentiBot
SeoSiteCheckup SeoSiteCheckup
Site Sucker SeobilityBot
SiteExplorer Seomoz
Shodan
Siphon
SiteLockSpider SiteLockSpider
SiteSnagger
Siteimprove Siteimprove
Sitevigil
SlySearch
SmartDownload
Snake Snake
Sociscraper Snapbot
Sogou web spider Spammen
Sosospider Sqlmap
Sottopop Sqlworm
Spanner Sqworm
Spinn3r
SputnikBot
Sucuri Sucuri
SuperHTTP
SurveyBot
Swiftbot Swiftbot
Szukacz Telesoft
Telesphoreo Telesphoreo
Telesphorep
The Intraformant
TheNomad TheNomad
TightTwatBot Tracemyfile
Toata
Toweyabot
Trendiction
Trendictionbot Trendictionbot
Turingos Turnitin
TurnitinBot
TwengaBot
Twice Twice
URLy.Warning
UnisterBot UnisterBot
VB Project V-BOT
VCI Vacuum
WASALive-Bot VidibleScraper
WEBDAV Voil
WWWOFFLE Voltron
WeSEE WISENutbot
WWW-Mechanize
WWW::Mechanize
Wallpapers/3.0
Web Fetch Web Fetch
Web Fuck Web Sucker
Web Pix
WebAuto WebAuto
WebCollage
WebCopier WebCopier
WebEnhancer WebEnhancer
WebFuck WebFuck
WebGo IS WebGo IS
WebImageCollector WebImageCollector
WebSauger WebLeacher
WebPix
WebReaper
WebStripper
WebSucker WebSucker
WebZIP
WebmasterWorldForumBot
Website Quester
WebsiteExtractor WebsiteExtractor
WebsiteQuester
Webster Webster
Whack Whacker
Woobot Widow
WinHTTrack
WiseGuys Robot
Wonderbot
Wotbox Wotbox
Xenu Wprecon
YoudaoBot Xaldon_WebSpider
Zeus
Zitebot Zitebot
ZoominfoBot ZumBot
ZyBorg
adscanner adscanner
autoemailspider
backlink-check backlink-check
clark-crawler crawl.sogou.com
coccocbot crawler.feedback
cognitiveseo crawler4j
dataforseo.com eCatch
evc-batch internetVista monitor
facebookscraper ips-agent
isitwp.com isitwp.com
lwp-request lwp-request
lwp-trivial magpie-crawler
meanpathbot
mediawords
muhstik-scan muhstik-scan
pcBrowser netEstate NE Crawler
plumanalytics page scorer
probe-image-size probe-image-size
ripz ripz
scan.lol s1z.ru
seocompany.store
seoscanners seoscanners
sexsearcher
sitechecker.pro sitechecker.pro
sogouspider trendiction.com
webgains-bot voyagerx.com
webmeup-crawler webmeup-crawler
webprosbot
x09Mozilla
xpymep1.exe
zauba.io

296
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
80legs 404checker
AIBOT 404enemy
ASPSeek
Abonti Abonti
Aboundex Aboundex
Aboundexbot AfD-Verbotsverfahren
Acunetix AiHitBot
AhrefsBot
Aipbot Aipbot
Anarchie Alexibot
Anarchy99
Ankit
Anthill Anthill
Asterias Apexoo
Atomseobot Aspiegel
Attach BDFetch
BLEXBot BackWeb
Barkrowler Badass
BatchFTP BetaBot
Battleztar Bazinga
Bitacle
Black Hole Black Hole
BlackWidow BlackWidow
Blow BlowFish
Boardreader
Bolt
Brandprotect Brandprotect
Brandwatch CherryPicker
BuiltBotTough
BunnySlippers
BuzzSumo
CCBot
CODE87
CSHttp
CazoodleBot
Cegbfeieh
CensysInspect
CheTeam
ChinaClaw ChinaClaw
Chlooe Citoid
Claritybot Claritybot
Cloud mapping Cliqzbot
Cogentbot
Collector Collector
Copier Copier
Crawling at Home Project Crawling at Home Project
Curious Curious
Custo
CyotekWebCopy CyotekWebCopy
DBLBot
DIIbot DIIbot
Disco DTS Agent
Dispatch DatabaseDriverMysqli
DnBCrawler-Analytics Demon
DomCopBot Deusu
Devil
DigitalPebble
Discobot
DittoSpyder
DomainAppender DomainAppender
DomainSigmaCrawler DomainSigmaCrawler
DomainStatsBot
Domains Project Domains Project
Dotbot
Dragonfly
ECCP/1.0 ECCP/1.0
EMail Siphon Ebingbong
EirGrabber
Evil Evil
FDM Express WebPictures
Extractor
FemtosearchBot FemtosearchBot
FlashGet
Flunky Flunky
Fuzz GalaxyBot
FyberSpider Genieo
GT::WWW GetWeb
GetRight Go!Zilla
GoZilla
Gotit Gotit
Grabber Grabber
GrapeFX Grafula
GridBot
HEADMasterSEO
HMView HMView
Havij
Heritrix
HonoluluBot
Humanlinks Humanlinks
HybridBot
IDBTE4M IDBTE4M
IRLbot
Iblog Iblog
InfoNaviRobot Image Fetch
InternetSeer Indy Library
Iria InfoTekies
Iskanie InterGET
IstellaBot Internet Ninja
JOC Web Spider JOC Web Spider
JamesBOT
JetCar JetCar
Jetty Jetty
JikeSpider
Joomla Joomla
JustView
Keybot Translation-Search-Machine
Keyword Density Keyword Density
LNSpiderguy
LWP::Simple
Leap
LeechGet LeechGet
Libwhisker Lftp
Lightspeedsystems
Likse Likse
LinkScan
LinkWalker LinkWalker
Linkbot
LinkextractorPro LinkextractorPro
Litemage_walker LinksManager
LinqiaScrapeBot
Lipperhey Spider
MFC_Tear_Sample MFC_Tear_Sample
MIIxpc MIDown tool
MJ12bot
MQQBrowser
MSIECrawler MSIECrawler
Mag-Net MTRobot
Majestic-SEO Magnet
MarkWatch Majestic12
Mass Downloader Mass Downloader
Masscan
Mata Hari Mata Hari
MauiBot
Meanpathbot Meanpathbot
Metauri Mediatoolkitbot
MegaIndex.ru
MicroMessenger MicroMessenger
Microsoft Data Access Microsoft Data Access
Minefield Microsoft URL Control
Mojolicious Mojeek
Morfeus Fucking Scanner Morfeus Fucking Scanner
Mr.4x3
Msrabot Msrabot
NICErsPRO Name Intelligence
Needle NetLyzer
NetAnts NetZIP
NetMechanic
Netcraft
Nettrack Nettrack
NextGenSearchBot
Nibbler
Niki-bot Niki-bot
Nikto Nikto
NimbleCrawler Nimbostratus
Not
Nutch
Offline Explorer Offline Explorer
Offline Navigator Offline Navigator
Openvas OnCrawl
OrangeBot
OrangeSpider OrangeSpider
OutfoxBot OutfoxBot
PECL::HTTP PECL::HTTP
PHPCrawl PHPCrawl
POE-Component-Client-HTTP POE-Component-Client-HTTP
Page Analyzer Page Analyzer
PageAnalyzer PageScorer
PageThing.com
Pandalytics Pandalytics
Papa Foto Petalbot
PeoplePal Pi-Monster
Picscout
PictureFinder
Pimonster Pimonster
Pixray
PleaseCrawl
Pockey
ProPowerBot
ProWebWalker ProWebWalker
Pu_iN Pu_iN
PxBroker Pump
RankActive RankActiveLinkBot
Rankivabot RankingBot
RankurBot RankingBot2
Re-re Re-re
ReGet
RebelMouse RebelMouse
Recorder
RedesScrapy RedesScrapy
RocketCrawler
SBIder SBIder
SEOkicks
SEOlyticsCrawler SEOlyticsCrawler
SEOstats
SalesIntelligent
ScanAlert
Scrapy
Seekport
SemanticJuice
Semrush Semrush
SeoSiteCheckup
Shodan
Siphon Siphon
Site Sucker
SiteCheckerBotCrawler
SiteExplorer SiteExplorer
SiteSnagger Sitebeam
SiteSucker
Siteimprove Siteimprove
Snake
Snapbot Snapbot
Sogou web spider
Sosospider Sosospider
SpaceBison SpaceBison
Spammen Spbot
Spanner Spinn3r
Sqlworm Sqlmap
Steeler Stripper
Sucker SuperHTTP
Swiftbot
Szukacz Szukacz
Telesphorep T8Abot
TightTwatBot Teleport
Telesoft
Telesphoreo
Titan Titan
Toata Toata
Toweyabot
Tracemyfile
Trendiction Trendiction
True_Robot
Turingos
Turnitin
TurnitinBot TurnitinBot
V-BOT URLy Warning
VelenPublicWebCrawler Upflow
VB Project
VidibleScraper VidibleScraper
VoidEYE
Voltron Voltron
WASALive-Bot
WBSearchBot WBSearchBot
WEBDAV WPScan
WISENutbot WWW-Collector-E
WWW::Mechanize WWW::Mechanize
WWWOFFLE WWWOFFLE
WeSEE WeSEE
Web Auto
Web Collage Web Collage
Web Pix Web Pix
Web Sucker
WebAuto WebAuto
WebFuck WebBandit
WebCopier
WebEnhancer
WebGo IS
WebImageCollector WebImageCollector
WebPix WebStripper
WebReaper WebSucker
WebSauger
Webalta Webalta
Whack WebmasterWorldForumBot
Whacker Webshag
WebsiteQuester
Whatweb
Who.is Bot Who.is Bot
Widow WinHTTrack
WiseGuys Robot
Wonderbot
Woobot
Wotbox
Wprecon
Xaldon_WebSpider
Zade
Zauba Zauba
Zeus Zitebot
ZoomBot ZoominfoBot
ZyBorg
adscanner
archive.org_bot
arquivo.pt arquivo.pt
autoemailspider autoemailspider
backlink-check
check1.exe
coccocbot coccocbot
crawl.sogou.com cognitiveseo
crawler4j crawler.feedback
demandbase-bot evc-batch
facebookscraper
gopher gopher
heritrix
instabid
internetVista monitor internetVista monitor
ips-agent ips-agent
iubenda-radar
lwp-trivial lwp-trivial
magpie-crawler
meanpathbot meanpathbot
mediawords
muhstik-scan
page scorer page scorer
plumanalytics polaris version
ripz ripz
seobility scan.lol
seocompany.store seoscanners
sitechecker.pro sexsearcher
sogouspider siteripz
tAkeOut spyfu
trendiction.com ubermetrics-technologies.com
trendiction.de x09Mozilla
webgains-bot x22Mozilla
webmeup-crawler
webprosbot
zgrab zgrab

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
7fon.ru baoxaydung.com.vn
gamebackyard.com bluerobot.info
moonci.ru copblock.org
nucia.biz.ly free-share-buttons.top
pandroid.co gq-catalog.gq
retreatia.com hannasolution.ru
secret.xn--oogle-wmc.com itbc.kiev.ua
shopfishing.com.ua karting196.ru
taranerymagesswa.blogspot.com pwwysydh.com
vriel.batcave.net xn----8sbhefaln6acifdaon5c6f4axh.xn--p1ai

936
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
00it.com 12u.info
00webcams.com 13tabs.com
1-99seo.com 40cg.com
24videos.tv 4k-player.pl
5-steps-to-start-business.com 57883.net
6hopping.com
7a2rnuey1tw9ar.ru 7a2rnuey1tw9ar.ru
7wind.ru 7minuteworkout.com
9med.net 8xv8.com
aa9d046aab36af4ff182f097f840430d51.com aa9bd78f328a6a41279d0fad0a88df1901.com
aaa38852e886ac4af1a3cff9b47cab6272.com aab94f698f36684c5a852a2ef272e031bb.com
aad1f4acb0a373420d9b0c4202d38d94fa.com addblueoff.com.ua
abbanreddy.com adloads.net
actionnooz.com advokateg.ru
activepr.ru agadelha.com.br
acunetix-referrer.com agapovdg.ru
adbetclickin.pink agecheckadult.com
adcash.com air-edem.ru
adclickthru.net akita.kz
add-add.men aksonural.ru
adexprts.com alert-jdh.xyz
adinterax.com alfa-medosmotr.ru
adtech.fr alienwheels.de
adult-shop.com.ua allboard.xobor.de
advertex.info amigobulls.com
agysya.ru ampower.me
alf-img.com analytics-ads.xyz
alfapro.ru android-vsem.org
algerianembassy.co.in aosheng-tech.com
alibestsale.com apimountainbikei-a.akamaihd.net
all-streaming-media.com apiportalmorecom-a.akamaihd.net
alphahoverboards.com apisecretsaucebi-a.akamaihd.net
anabolics.shop apishops.ru
android4fun.org apiwebwebgetcom-a.akamaihd.net
angel1777.kz applyneedy.xyz
apiadanaknet-a.akamaihd.net aproposde.com
apiqualitinknet-a.akamaihd.net artparquet.ru
appearance-cool.com asia-forum.ru
arpelsreplica.xyz asophoto.com
arvut.org
asrvrep-a.akamaihd.net
asscenihotosidea.blogspot.com
atovh.local-finders.com atovh.local-finders.com
auto-zapchasti.org
autogrep.ru autogrep.ru
autolombard-krasnodar.ru autoplate.info
autorn.ru avtolombard-krasnodar.ru
aviapanda.ru ayerbo.xhost.ro
axbocz.net baltgem.com
azte.ch bankofthewext.com
baditri.com bannerads.de
balois.worldbreak.com bdsmgalls.net
banan.tv best-coupon-offer.com
banksrf.ru best-deals-products.com
bannerconnect.net bestdraws.com
bayareaaeroclub.org bestmarriages.com
beachdriveblog.com bestplacetobuyeriacta.jw.lt
beachpics.com beyan.host.sk
best-businessman.ru bin-brokers.com
bestserials.com binaryoptionscops.info
betteroffers.review bitcoins-live.ru
biketank.ga bkgr.se
bimatoprost-careprost.com.ua blackle.com
bitcoin-ua.top blockety.co
blog-hits.com bodybuilding-shop.biz
bmwhighperformers.com book-bets.com
bonzybuddy.com bpro1.top
bradleylive.xyz brainboosting.club
brakehawk.com brainboostingsupplements.org
break-the-chains.com btvn.ru
bristolhotel.com budpost.com.ua
buehne-fuer-menschenrechte.de bum.com.ru
buntube.net
buqyxa.rincian.info buqyxa.rincian.info
burger-imperia.com buttons-for-your-website.com
bzero1jewelry.net c1.onedmp.com
c-english.ru cakemediahq.com.au
callcafe.info callawaygolfstore.online
candiceloves.us cartechnic.ru
candycrushshop.com cartierreplica.win
cardsdumps.com cartierring.xyz
carina-sy.de casinopinup-wins.com
cars-modification.net cellfun.mobi
carson.getenjoyment.net
cartierlovestore.xyz
cartierwatch.xyz
castingbank.ru
cbox.ws
cdn.walkme.com
cenokos.ru cenokos.ru
cheapcigarettesc.info centrdebut.ru
checkhit.com cgi2.nintendo.co.jp
chelyabinsk.xrus.org cheapjerseysa.com
children-learningreading.info cheapjerseysfootballshop.com
claytransformations.info chocolateslim-en-france.com
cleanpcnow.com christianlouboutinsaleonline.us
club-musics.ru christianlouboutinsaleoutletonline.us
comeondog.info cigarpass.com
companies-catalog.com classiquebijoux.ru
compliance-alexa.top clickaider.com
compliance-andrew.top clickbank.net
compliance-john.top clicksor.com
compliance-margo.top clodo.ru
coolgamechannel.com coaching-netz.info
coolwallpapers4k.info com-onlinesupport.host
countercrazy.com compliance-barak.top
creams.makeforum.eu compliance-brian.xyz
crirussian.ru compliance-checker-7.info
customerguru.in compliance-elena.top
danceuniverse.ru compliance-ivan.top
danschawbel.com compliance-jane.top
darmebel.com.ua compliance-olga.top
day-news.info cottageofgrace.com
db.speedup.gdn credit-online.ws
customcollegeessays.net
d0t.ru
d2jsp.org
dailyrank.net
daisye.top
datsun-do.com
davidovic.info
dealwifi.com dealwifi.com
dear-diary.ru dear-diary.ru
degerlund.net dekoration.us
dekorkeramik.ru depositfiles-porn.ga
delitime.info detective01.ru
dkvorota.ru dimaka.info
dneprsvet.com.ua dimfour.com
dimkino.ru
dipstar.org
docs4all.com docs4all.com
dolohen.com domini.cat
domain.webkeyit.com dotmass.top
donvito.unas.cz drunkmoms.net
ed-shop01.ru dverimegapolis.ru
educatemetv.com e-kwiaciarz.pl
edudocs.net education-cz.ru
efkt.jp ege-essay.ru
elektrischezi.canalblog.com electrik-avenue.com
elektronischezigarettekaufen2.tumblr.com emediate.eu
elektrozigarettekaufen2.blogse.nl emergencyneeds.org
en.altezza.travel emerson-rus.ru
eugenevaultstorage.com englate.com
evidencecleanergold.com ero-advertising.com
erotikstories.ru
eupornstar.info
european-torches.ru
euroskat.ru
ewebarticle.info ewebarticle.info
eyemagination.com expresstoplivo.ru
falcoware.com ezigarettenkaufen1.pagina.gr
familyholiday.ml fastcrawl.com
favoritemoney.ru fdzone.org
fellowshipoftheminds.com fealq.com
filefilter.weebly.com fearcrow.com
filesmonster.porn feargames.ru
financehint.eu felizporno.com
fiuxy.com figuringmoneyout.com
flooringinstallation-edmonton.com filmfanatic.com
foodcrafts.website firesub.pl
fordsonmajbor.cf fitnesspiks.com
forums.d2jsp.org flashahead.info
foto-sisek.porngalleries.top flytourisme.org
frcls.fr forex.osobye.ru
free-share-buttons.blogspot.com forum20.smailik.org
free-share-buttons.com forums.toucharcade.com
freeuploader.com foxtechfpv.com
fres-news.com freakycheats.com
freemaintenancesysforpcandmac.top
funcrushgames.com funcrushgames.com
g7m.pl fx-brokers-review.com
gallery.rennlist.com fxgallery.com
gamingspark.com g.starmoe.xyz
gate5.co.za galeria-zdjec.com
gateway.zscalertwo.net gamedayhouse.com
gaz-voshod.ru gamezblox.com
geckoandfly.com gazobeton-p.com.ua
genericviagrasildenafiled.net gdebestkupit.ru
gg.zzyjxs.com geile-lelly.eu
gkvector.ru gentamicineyedrops.blogspot.com
global-ics.co.za girlsatgames.ru
glopages.ru glcomputers.ru
gnuetella.com goforexvps.com
golden-catalog.pro goldandcard.ru
gopixdatabase.com googlemare.com
graphicwe.org gourcy.altervista.org
greatdealshop.com green-tea.tv
greatgrace.ru gsou.cf
gribokstop.com gwhwpxbw.bloger.index.hr
guruofcasino.com hasfun.com
gz2.bbsoldes.fr hd-film.pl
hanink.biz.ly hdwalls.xyz
hccoder.info headpharmacy.com
hchha.com
hdseriale.pl
healmytrauma.info
help.tpu.ru
hermesreplica.pw hermesreplica.pw
hesteel.pl hledejvshopech.cz
hidefiles.org
home.myplaycity.com
homeart.space
homelygarden.com
homemature.net homemature.net
hotblog.top hopeonthestreet.co.uk
hotel-mkad.ru hotcore.info
hotelcrocenzi.sm hotxnights.info
hothor.se howlongdoestizanidinestayinyoursystem.blogspot.com
hotshoppymac.com howopen.ru
hulfingtonpost.com hulfingtonpost.com
humbmosquina.tk humanelydrew.com
iccornacircri.cf igtools.club
idealtits.net iklysha.ml
ideashome.id ilovevitaly.xyz
ideibiznesa2015.ru images-free.net
iinstalll-fii1leis.jus0wil.pp.ua images-graphics-pics.com
iloveitaly.ru imagui.eu
imadedinner.net img.wallpaperstock.net
imagez.co impisr.edunsk.ru
imediadesk.com
iminent.com
imitex-plus.ru
imperiafilm.ru
impisr.ru
impotentik.com impotentik.com
inboxdollars.com
incep.imagine-ex.co incep.imagine-ex.co
indiakino.net infobabki.ru
inmate-locator.us instabid.tech
interfucks.net investingclub.ru
investmac.com iqoption.com
iopeninghours.co.uk istizanidineanopiate.blogspot.com
ipostroika.ru itag.pw
iptool.xyz j33x.com
irunfar.com jmat.cn
iscblog.info justucalling32211123456789.tk
jackwolfskinoutlet.online kadashihotel.com
javcoast.com kareliatobacco.ru
je7.us
karpun-iris.ru karpun-iris.ru
kchaxton.com kchaxton.com
khafre.us keywords-monitoring-your-success.com
kino-fun.ru keywordsdoctor.com
kinohall.ru keywordsking.com
kinohit1.ru kino2018.club
kleine-titten.biz kinogonew.ru
knogg.net kinosed.net
konkursov.net klikbonus.com
kosmetyki.tm.pl klumba55.ru
kotaku.com kongoultry.net
kraljeva-sutjeska.com kreativperlen.ch
kunstaktien.info kredit-blog.ru
lacapilla.info kw21.org
landmania.ru labplus.ru
lafriore.ru
languagecode.com
larchik.net larchik.net
laxob.com laserpen.club
legalrc.biz laulini.soclog.se
letsart.ru ldrtrack.com
life.biz.ua lexixxx.com
liveinternet.ro lifebyleese.com
liveinternet.ru linkbuddies.com
livejasmin.com live-sexcam.tk
llastbuy.ru lob.com.ru
locustdesign.co lombia.com
lomza.info luciddiagnostics.in
lookingglassemb.com lyngdalhudterapi.no
lovasszovetseg.hu m3gadownload.pl
m4ever.net mahnwachen-helfen.info
mafa-free.com malls.com
magda-gadalka.ru mansiondelrio.co
malwareremovalcenter.com matematikus.info
manipulyator-peterburg.ru mebel-vstroika.ru
marketingvici.com mebelcomplekt.ru
marsgatan.com medi-fitt.hu
martlinker.com megahdporno.net
mazda-roadsters.com menetie.ru
mecash.ru mex-annushka.ru
mediawhirl.net mexicosleevegastrectomy.com
medicines-choice.com mielec.pl
medicovi.com minharevisao.com
medkritika.ru mlf.hordo.win
mega-bony-2017.pl mmstat.com
mejoresfotos.eu mobicover.com.ua
metallosajding.ru modenamebel.ru
mmgq.ru moesonce.com
mobile-appster.ru mojowhois.com
money-every-day.com moncleroutletonline.pw
monthlywinners.com monclervests.xyz
moscow.xrus.org moneyzzz.ru
most.gov.iq morf.snn.gr
mrcsa.com.au mouselink.co
mriyadh.com mrpornogratis.xxx
mrvideospornogratis.xxx mug-na-chas-moscow.ru
msfsaar.de musezone.su
mundoaberrante.com musicpro.monster
musicas.baixar-musicas-gratis.com mvpicton.co.uk
my-big-family.com
mydeathspace.com
myfreemp3.eu
myghillie.info myghillie.info
mylovelibrabry.com mylida.org
myplaycity.com narkologiya-penza.ru
myprintscreen.com nbsproject.ru
na-telefon.biz netvouz.com
namenectar.com news-readers.ru
narco24.me
nerudlogistik.ru
newstraveller.ru newstraveller.ru
newyorkhotelsmotels.info nextbackgroundcheck.gq
nhl09.ru nextlnk12.com
nightvision746.weebly.com nfljerseysforsalewholesaler.com
nippon-bearings.ru nfvsz.com
nodup.ru ngps1.ru
nonameread45.live nikkiewart.ru
novodigs.com niroo.info
nucia.biz.ly nlfjjunb5.ru
nzfilecloud.weebly.com nofreezingmac.click
o-o-11-o-o.com noscrapleftbehind.co
obiavo.su npoet.ru
obsessionphrases.com nyfinance.ml
odesproperty.com obiavo.com
oivcvx.website of-ireland.info
offers.bycontext.com
officedocuments.net
okeinfo.online okeinfo.online
online.ktc45.ru onblastblog.online
onlineku.com onemactrckr.com
openstat.com oneshotdate.com
oralsexfilme.net onlyforemont.ru
oranga.host.sk paceform.com
origin-my.ru page2rss.com
ossmalta.com panchro.co.uk
ovirus.ru panchro.xyz
palocco.it partner-pop.men
parfusale.se partner-stop.men
parvezmia.xyz pcads.ru
penisvergrotendepillennl.ovh pekori.to
perfectpracticeweb.com peugeot-club.org
perosan.com php-market.ru
pharmacyincity.com pic2fly.com
phobia.us pihl.se
phuketscreen.com pills24h.com
picsforkeywordsuggestion.com pinstake.com
pictures-and-images.com pinup-casino1.ru
pila.pl pio.polytopesexempt.com
pix-hd.com pl-top.pl
pladform.ru pliks.pl
pochemychka.net polimga.pw
pokemon-go-play.online popugaychiki.com
pornoted.com popunder.ru
pozdrawleniya.com porngalleries.top
preparevideosafesystem4unow.space porno-home365.com
priora-2.com porno.simple-image.com.ua
prizeestates.cricket pornowarp.info
portal-eu.ru
pospr.waw.pl
preconnubial.usuby.site
predmety.in.ua
privacyassistant.net
privatefx-in.ru
prohoster.info
pron.pro
proposal-engine.com proposal-engine.com
prostitutki-kharkova.org pussysaga.com
prpops.com questionmarque.ch
pukaporn.com
puteshestvennik.com
pyrodesigns.com.au
qexyfu.bugs3.com
qualitymarketzone.com
quit-smoking.ga quit-smoking.ga
rangoman.date rangoman.date
realnye-otzyvy.info razamicroelectronics.com
recipedays.ru razyboard.com
reklama-i-rabota.ru recinziireale.com
regionshop.biz
registry-clean-up.net
reklamuss.ru
rennlist.com rennlist.com
repeatlogo.co.uk rentalcarnavi.info
replicalouboutin.xyz rentaremotecomputer.com
rfid-locker.co rentehno.ru
rfserial.net respublica-otel.ru
ric.info ricorsogiustizia.org
roleforum.ru risparmiocasa.bz.it
rospromtest.ru robertefuller.com
ru-mediaget.ru rockprogblog.com
russia-today-video.ru rosbalt.com.ua
rutor.group royalvegascasino.com
rybalka-opt.ru rrutw.com
s.lollypopgaming.com running-line.ru
sady-urala.ru rus-teh.narod.ru
rusexy.xyz
russintv.fr
saddiechoua.com
saecsa.co saecsa.co
sammlungfotos.online sanatorrii.ru
sbprabooks.com sanjosestartups.com
sankt-peterburg.nodup.ru
sc-specialhost.com
scanmarine.info
scanmyphones.com
scanner-brian.top
scanner-george.top scanner-george.top
scanner-walt.top scanner-viktor.top
scansafe.net scat.porn
schalke04fc.info screpy.com
scripted.com search.xtconnect.com
sdrescher.net servisural.ru
seansonline24.pl shemale-sex.net
semalt.com shmetall.com.ua
semp.net shop-electron.ru
sendearnings.com signoredom.com
seo-prof1.xyz site3.free-share-buttons.com
seorankinglinks.us slim.sellany.ru
seorankinglinks.xyz slonechka.ru
service.adtech.us socialbutton.xyz
sexflirtbook.com soft-program.com
sextracker.be softomix.com
sexxdate.net softonicads.com
shariki-zuma-lines.ru soheavyblog.com
shinikiev.com.ua solicita.info
shoplvlv.us spin2016.cf
sibvitr.ru sptslmtrafms.com
sicfor.bcu.cc spyfu.com
site-auditor.online squidoo.com
sitevaluation.org statistici.ro
skyway24.ru staynplay.net
sloopyjoes.com strfls.com
slujbauborki.ru strongholdsb.ru
smallseotools.com subj.ukr-lit.com
soc-proof.su superoboi.com.ua
socialmadesimple.com surgut.zrus.org
socialtrade.biz susanholtphotography.com
sotkal.lark.ru sygraem.com
sport7777.net tandvardshuset.net
spywareit.com tanieaukcje.com.pl
stats-public.grammarly.io taximytishi.ru
stjamesschool.info teenporn18.net
strana-krasoty.ru teletype.in
stroiminsk.org terraclicks.com
students-cheapskate.ml tfxiq.com
sugarlyflex.pw thebestweightlosspills.ovh
sukarame.net theheroes.ru
superstats.com thejournal.ru
surflinksmedical.com thetoiletpaper.com
svetodiodoff.ru ticketsys.inetwd.com
tarad.com time-japan.ru
techart24.com tizanidinehcl2mg.blogspot.com
teencastingporn.com tizanidinehclsideeffects.blogspot.com
teslathemes.com tizanidineshowupondrugtest.blogspot.com
testingads.pro top-deal.com.pl
theprofitsmaker.net topkarkas.com
thetardistimes.ovh torontoplumbinggroup.com
titan-cloud.life torrent-to-magnet.com
tizanidine4mgprice.blogspot.com totu.info
tizanidineformigraines.blogspot.com tozup.com
tizanidineinteractions.blogspot.com tradgardspartner.se
tizanidineoral.blogspot.com trion.od.ua
tizanidinerestlesslegsyndrome.blogspot.com truck-land.life
tizanidinesideeffectsweightloss.blogspot.com tsstcorpcddvdwshbbdriverfb.aircus.com
tizanidinesleepaid.blogspot.com typimga.pw
tizanidinestreetprice.blogspot.com ugguk.online
tnaionline.org uginekologa.com
tomck.com uk-zheu20.ru
tonerbox.kz ukrobstep.com
top-l2.com unitygame3d.com
top250movies.ru uptime-delta.net
topads.men upupa.net
torrents.life uvozdeckych.info
toyota.7zap.com uzporno.mobi
tpu.ru vbabule.net
tracfone.com vekzdorov.ru
track112.site veopornogratis.xxx
trackmedia101.com vereo.eu
traffixer.com video-camer.com
traxdom.ru video-production.com
trichizobswiv.agddns.net videochat.bz
tsan.net videooko.weebly.com
tuberkulezanet.ru videtubs.pl
turbodsp.com villakohlanta.nu
tv-spoty.info
twojebook.pl
uasb.ru
uhodzalijami.ru
unece.org
unionmarkt.de
unrealcommander.org
uptime-alpha.net
uptime-gamma.net
uptimebot.net
uptimechecker.com
v720hd.ru
validccseller.com
vapeface.club
videositename.com
vilingstore.net
villacoloniale.com
vinsit.ru vinsit.ru
vipps.com.my vipms.ru
virus-schutzmasken.de vod.com.ua
vkgaleria.com vut.com.ru
vksaver-all.ru
voprosotvet24.ru
vtcdns.com
vzlomtw.com vzlomtw.com
vzube.com wahicbefa31.soup.io
warezkeeper.com wallpapers-best.com
waterpurifier.club wareseeker.com
wcb.su web-analytics.date
webradiology.ru weblibrary.win
weclipart.com webpromotion.ae
wemarketing.se wechatdownload10.com
westermarkanjou.se westermarkanjou.se
whereiskentoday.com westvilletowingservices.co.za
wholesalejerseychinaoutlet.com wfb.hatedriveapart.com
whatsappbot.flyland.ru
whatsupinfoley.com
wholesalejerseyscheapjerseys.us.com
win-spy.com
wingsoffury2.com
winwotgold.pl
wnhjavlhezp.gq
worldinternetauthority.com
worldmusicfests.com
worldtraveler.world
www.888.com www.888.com
x-stars.ru www.labves.ru
x-lime.com
x-musics.com
xcc24.pl xcc24.pl
xep.info xjlottery.com
xfire.com xn----8sbarihbihxpxqgaf0g1e.xn--80adxhks
xingzi-vision.com xn----ctbbcjd3dbsehgi.xn--p1ai
xn------7cdbapdecfd4ak1bn0amjffj7afu3y.xn--p1ai xn--b1addnj3cah.xn--p1ai
xn-----6kcaacnblni5c5bicdpcmficy.xn--p1ai xn--d1aifoe0a9a.top
xn--80abgj3a5acid6ghs.top xn--h1aakne2ba.xn--p1ai
xn--d1abj0abs9d.in.ua xn--oogle-wmc.com
xn--e1afanlbnfckd7c3d.xn--p1ai xxxguitars.com
xn--q1a.xn--b1aube0e.xn--c1acygb.xn--p1ai yadro.ru
xxxasianporn.net yellowstonevisitortours.com
xxxrus.org yopoint.in
yaoguangdj.com your-bearings.com
you-shall-not-pass.is74.ru youradulthosting.com
zeroredirect.com youraticles.pl
zeroredirect12.com yubikk.info
zigarettenonlinekaufen1.blox.pl zaapplesales.blogspot.com
zoogdiesney.com zakazvzloma.com
zrelaya.pw zarenica.net
zvooq.eu zeleznobeton.ru
zoolubimets.ru
zvuker.net

476
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
00webcams.com 101lesbian.xyz
1millionusd.xyz
1webmaster.ml 1webmaster.ml
2345.com 4webmasters.org
5ws.dating-app.ru 5elementov.ru
admanaerofoil.com 5tey7463.weebly.com
affrh2015.com 72-news.com
aibolita.com 7fon.ru
aksonural.ru adrunnr.com
adsland.men
adultmeetonline.info
adzpower.com
afora.ru
albamargroup.com albamargroup.com
anabolics.shop allesohnegirls.net
anjalika.co.in animalia-life.club
aosexkontakte.net appfixing.space
apartmentratings.com appiq.mobi
apidiamondatanet-a.akamaihd.net apple.com-webbrowsing-security.review
apisecretsaucebi-a.akamaihd.net appmsr.org
arenda-avtoprokat-krasnodar.ru arate.ru
auto4style.ru arcadepages.com
avek.ru artdestshop.eu
avkzarabotok.com asrvvv-a.akamaihd.net
avon-ukraine.com avtolombard-krasnodar.com
bagcionderlab.com ayodhya.co
balans.shahterworld.org azlex.uz
baltgem.com bablonow.ru
basisches-wasser.net backuperwebcam.weebly.com
becuo.com bagsonsale.online
bedandbreakfast.com bankofthewext.com
bensbargains.net beachfix.co
bigpictures.club bestadbid.com
bizfly.info bestwrinklecreamnow.com
biznesrealnost.ru biznesrealnost.ru
bkns.vn bmw.afora.ru
bouda.kvalitne.cz boanonihaca.tk
brakehawk.com bookhome.info
buytizanidineonlinenoprescription.blogspot.com buy-cheap-pills-order-online.com
callawaygolfoutlet.online byme.se
cenoval.ru cakemediahq.com.au
cheap-trusted-backlinks.com casinopinup-wins.com
cheapjerseysa.com ccbill.com
cialiswithoutadoctor.net cheapmoncler.pw
clean-virus-mac.com cheatcode-lita12.rhcloud.com
companies-catalog.com ci.ua
compliance-alexa.xyz clevernt.com
crd.clan.su comeondog.info
cupday.com compliance-fred.top
cvety24.by compliance-jessica.top
cymbaltaandtizanidine.blogspot.com compliance-margo.top
dekoration.us compliance-walter.top
dinkolove.ya.ru cxpromote.com
dvd-famille.com darkbooks.org
eachdayisagift.review dayibiao.com
ecxtracking.com db.speedup.gdn
eduserver.net detoxmed24.ru
ekn-art.se deutschland123.de
elektrozigaretten1.webs.com dev33.dioniqlabb.se
emerson-rus.ru diffbot.com
empathica.com dikqlyremy.info
eropho.net directrev.com
eu-cookie-law.blogspot.com dogsrun.net
excitacao.com domik-derevne.ru
expertnaya-ocenka.ru dorratex.tn
ezaz.info downvids.net
falopicm.pw drunkmoms.net
familyholiday.ml dvervmoskvu.ru
favoritemoney.ru election.interferencer.ru
faz99.com elitesportsadvisor.com
fivedwld.cf everypony.ru
floridamobilebillboards.com expdom.com
fortwosmartcar.pw ezigarettenshop1.yolasite.com
foto-sisek.porngalleries.top faithe.top
frcls.fr familienzahnaerzte.com
free-fb-traffic.com fanpagerobot.com
freetangodownload.com fashion-mk.net
game-mmorpg.net fellowshipoftheminds.com
gamezblox.com filmidivx.com
gayxperience.com flowwwers.com
forex.osobye.ru
forsex.info
fortunejack.com
forzeronly.com
fotoxxxru.com
freewlan.info
galeria-zdjec.com
game300.ru
gateway.zscalertwo.net
geoads.com geoads.com
globatur.ru girlsfuckdick.com
globetrotting-culture.ru googglet.com
guigyverpo.cf gotomontenegro.net
gz2.bbsoldes.fr growshop.es
harmonyglen.us hermesbelts.xyz
hd-filmy.net hermesbracelets.xyz
hitcpm.com hoholikik.club
host-tracker.com hollywoodactress.info
iklysha.ml homemature.net
inspiring-desperate.tk hoporno.com
internetartfair.com houseofrose.com
ipchicken.com hspline.com
isitpaleo.info hut1.ru
ivanovo.zrus.org imagine-ex.co
jrcigars.com islandminingsupply.wordpress.com
karpun-iris.ru jagg.info
kellyonline.xyz jerseywholesalebizchina.com
krasnodar.zrus.org jobgirl24.ru
kvartiry-remont.ucoz.ru jpcycles.com
lacloop.info justprofit.xyz
lakomka.com.ua kazinogames.lv
lampokrat.ws koronirealestate.gr
linerdrilling.com krasivye-devushki.net
linkdebrideur.xyz kwzf.net
lion.playtap.us laapp.com
longadventure.com labelwater.se
lottospring.com letslowbefast.site
louboutinreplica.pw long-beach-air-conditioning.com
lunchrock.co longlifelomilomi.info
magiadinamibia.blogspot.com makedo.ru
magicdiet.gq manimpotence.com
mansiondelrio.co meetlocalchicks.com
marmitaco.cat
mb140.ru
mebelcomplekt.ru
medicineseasybuy.com
meds-online24.com
mega-polis.biz.ua
megaindex.ru megaindex.ru
michaelkorsoutlet.store megakino.net
minneapoliscopiers.com mesbuta.info
misandesign.se
mmgq.ru
moi-glazki.ru
money-every-day.com money-every-day.com
moneyzzz.ru moneyteam24.com
moscow-region.ru
moscow.xrus.org
mossmesi.com mossmesi.com
msk.afora.ru mulberryoutletonlineeu.com
muizre.ru musicvidz.ru
mustwineblog.com mydeathspace.com
muznachas-service.ru myonlinepayday.co
mvpicton.co.uk napalm51.nut.cc
mxgetcode.com neks.info
my-big-family.com
my-floor.in.ua
mycaf.it
mydoctorok.ru
naj-filmy24.pl
nerudlogistik.ru
newhairstylesformen2014.com
next-dentists.tk
nfljerseyscheapbiz.us
nfljerseysforsalewholesaler.com nfljerseysforsalewholesaler.com
niroo.info nightvision746.weebly.com
normalegal.ru northfacestore.online
odywpjtw.bloger.index.hr novodigs.com
online-sbank.ru nzfilecloud.weebly.com
onlineserialy.ru o-dachnik.ru
optikremont.ru odoratus.net
partner-stop.men offers.bycontext.com
partnerads.men oil-td.ru
pcboa.se oranga.host.sk
pdamods.ru owathemes.com
pendelprognos.se parajumpersjakkesalgnorge.info
pensplan4u.com pdns.download
pic-re.blogspot.com perfection-pleasure.ru
picture-group.com pila.pl
pictures-and-images.com platezhka.net
pixshark.com poligon.com
plaff-go.ru pons-presse.com
plastgran.com popcash.net
pornhub-forum.ga pornosemki.info
pornoslive.net pretty-mart.com
proekt-mos.ru prizesbook.online
profit-opportunity.com producm.ru
promgirldresses.xyz profitkode.com
purplestats.com prokotov.com
pyramidlitho.webs.com promover.org
rasteniya-vs-zombi.ru prosmibank.ru
realting-moscow.ru quebec-bin.com
responsinator.com quelle.ru
roznica.com.ua ranksays.com
sammyweaver.com recipedays.ru
sarahmilne.top reklama1.ru
sbricur.com respublica-otel.ru
scanner-george.top ringporno.com
scanner-margo.top royalvegascasino.com
scanner-marwin.top rozalli.com
scanspyware.net sankt-peterburg.nodup.ru
scat.porn satoristudio.net
schlampen-treffen.com searchengineranker.email
sexkvartal.com security60-e.com
shop.xz618.com seeresultshub-a.akamaihd.net
shymkent.xkaz.org seocheki.net
sibecoprom.ru seoheap.com
skatestick.bid seoprofiler.com
socialsignals24.com seorank.info
sosdepotdebilan.com sexkontakte-seite.com
sportbetfair.com sexkrasivo.net
sps-shop.com sexyteens.hol.es
spy-app.info shiksabd.com
staff.prairiesouth.ca shlyahten.ru
steamoff.net shoppingjequiti.com.br
stevemonsen.com site-analyzer.com
stjamesschool.info sitevaluation.org
studworks.org socialseet.ru
summerlinhomes411.info softomix.com
superoboi.com.ua softonicads.com
softxaker.ru
solitaire-game.ru
soochi.co
sortthemesitesby.com
spaceshipad.com
splendorsearch-a.akamaihd.net
sport7777.net
ssconstruction.co
stardevine.com
stefanbakosab.se
streetfire.net
suggest-keywords.com
surcentro.com surcentro.com
surffoundation.nl svarbit.com
tackletarts.co swimpool.ca
teletype.in szamponrevita.pl
telsis.com telefonsex-ohne0900.net
tengohydar.tk thegalerie.eu
teslathemes.com titan-cloud.life
testingads.pro tizanidineinteractions.blogspot.com
theprofitsmaker.net tizanidineonline.blogspot.com
tizanidinepain.blogspot.com tizanidinepills.blogspot.com
tonerbox.kz toon-families.com
top1-seo-service.com trafficjunky.com
top10registrycleaners.com traffpartners.com
toy-shop.top trumpetedextremes.com
traffic2cash.org twincitiescarservice.com
traffic2money.com
traffmonster.info
trailer.cinemaflix.website
triumf-realty.ru
trudogolik.net
tsstcorpcddvdwshbbdriverfb.aircus.com
tyumen.xrus.org
ugguk.online
uginekologa.com uginekologa.com
unionmarkt.de unlimitdocs.net
urdoot.win uprour.com
urengoy.pro utiblog.fr
us-america.ru viagraneggrx.com
ustion.ru videochat.cafe
ventelnos.com vinylvault.co.uk
veopornogratis.xxx vipms.ru
viagra-soft.ru
videochat.life
vip-parfumeria.ru
visitcambridge.org visitcambridge.org
wapsite.me vk-mus.ru
warningzscaler.heraeus.com vozbujdenie.com
waterpurifier.club vvpg.ru
webcamdevochka.com vzubah.com
webradiology.ru wait3sec.org
westsextube.com wardreapptokone.tk
westvilletowingservices.co.za webjam.com
wingsofrefuge.net whatsappdownload10.com
wnhjavlhezp.gq whatzmyip.net
wtsindia.in whereverdesperate.gq
wzgyyq.com witherrom55.eklablog.fr
xaylapdiendanang.com worldlovers.ru
x-diesel.com
xblog.in xblog.in
xn----9sbebi2bvzr7h.xn--p1ai xn--80ahvj9e.xn--p1ai
xn----itbeirbjbi7bc6bh2d.xn--p1ai xzlive.com
xn--e1aggki3c.xn--80adxhks yebocasino.co.za
xxxguitars.com yellowstonevisitortours.com
xxxrus.org yoshkarola.zrus.org
youjizz.vc zigzog.ru
zigarettenonlinekaufen2.drupalgardens.com zionstar.net
zx6.ru zona-aqua.ru

10
dev-tools/test_units/ratelimittest-beta.txt
View file

@ -581,4 +581,14 @@
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html> </html>

10
dev-tools/test_units/ratelimittest-master.txt
View file

@ -581,4 +581,14 @@
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html> </html>

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.43 0; 10.1.0.53 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.08.3310 ### Version: V4.2022.08.3311
### Updated: Wed Aug 24 22:01:37 UTC 2022 ### Updated: Thu Aug 25 10:03:28 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.08.3310 ### Version: V4.2022.08.3311
### Updated: Wed Aug 24 22:01:37 UTC 2022 ### Updated: Thu Aug 25 10:03:28 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##