# ITE / code / H_I_D / meta_estimators / IShannon_HShannon_initialization.m

  1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 function [co] = IShannon_HShannon_initialization(mult) %Initialization of the "meta" Shannon mutual information estimator, which is % 1)based on an(y) estimator for Shannon differential entropy, % 2)is treated as a cost object (co). %Mutual information is estimated using the relation: % (*) I(y^1,...,y^M) = \sum_{m=1}^MH(y^m) - H([y^1,...,y^M]). % %Here, we make use of the naming convention: 'I_initialization', to ease embedding new mutual information estimation methods. % %INPUT: % mult: is a multiplicative constant relevant (needed) in the estimation; '=1' means yes, '=0' no. %OUTPUT: % co: object (structure). % %Copyright (C) 2012 Zoltan Szabo ("http://nipg.inf.elte.hu/szzoli", "szzoli (at) cs (dot) elte (dot) hu") % %This file is part of the ITE (Information Theoretical Estimators) Matlab/Octave toolbox. % %ITE is free software: you can redistribute it and/or modify it under the terms of the GNU General Public License as published by %the Free Software Foundation, either version 3 of the License, or (at your option) any later version. % %This software is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of %MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License for more details. % %You should have received a copy of the GNU General Public License along with ITE. If not, see . %mandatory fields: co.name = 'Shannon_HShannon'; co.mult = mult; %other fields: co.member_name = 'Shannon_kNN_k'; %you can change it to any Shannon entropy estimator capable of 'multiplicative %factor correct' H estimation (mult=1) below. Note: Renyi entropy (H_{R,alpha}) also gives in limit the Shannon entropy (H): H_{R,alpha} -> H, as alpha -> 1. co.member_co = H_initialization(co.member_name,1);%'1': since we use the relation '(*)' (multiplicative factors in entropy estimations are NOT allowed). 
Tip: Filter by directory path e.g. /media app.js to search for public/media/app.js.
Tip: Use camelCasing e.g. ProjME to search for ProjectModifiedEvent.java.
Tip: Filter by extension type e.g. /repo .js to search for all .js files in the /repo directory.
Tip: Separate your search with spaces e.g. /ssh pom.xml to search for src/ssh/pom.xml.
Tip: Use ↑ and ↓ arrow keys to navigate and return to view the file.
Tip: You can also navigate files with Ctrl+j (next) and Ctrl+k (previous) and view the file with Ctrl+o.
Tip: You can also navigate files with Alt+j (next) and Alt+k (previous) and view the file with Alt+o.