Seite - 318 - in Differential Geometrical Theory of Statistics
Bild der Seite - 318 -
Text der Seite - 318 -
Entropy2017,19, 7
Proposition3. LetSq={p(x;θ)}beaq-exponential family. Thenthenormalization functionĎ(θ) is convex.
Proof. Setu(x)=(expqx) Ⲡandâi= â/âθi. Thenwehave
âip(x;θ) = u (
âθkFk(x)âĎ(θ) )
(Fi(x)ââiĎ(θ)),
âiâjp(x;θ) = uⲠ(
âθkFk(x)âĎ(θ) )
(Fi(x)ââiĎ(θ))(Fj(x)ââjĎ(θ))
â u (
âθkFk(x)âĎ(θ) )
âiâjĎ(θ). (9)
Sinceâi âŤ
Ίp(x;θ)dx= âŤ
Ίâip(x;θ)dx=0and âŤ
Ίâiâjp(x;θ)dx=0,wehave
Zq(p) = âŤ
Ί {(p(x;θ)}qdx= âŤ
Ί u (
âθkFk(x)âĎ(θ) )
dx,
âiâjĎ(θ) = 1
Zq(p) âŤ
Ί uⲠ(
âθkFk(x)âĎ(θ) )
(Fi(x)ââiĎ(θ))(Fj(x)ââjĎ(θ))dx. (10)
Foranarbitraryvector c= t(c1,c2, . . . ,cn)âRn, sinceZq(p)>0anduâ˛â˛(x)>0,wehave
n
â
i,j=1 cicj(âiâjĎ(θ)) = 1
Zq(p) âŤ
Ί uâ˛â˛ (
n
â
k=1 θkFk(x)âĎ(θ) ){
n
â
i=1 ci(Fi(x)ââiĎ(θ)) }2
dx ⼠0.
This implies that theHessianmatrix (âiâjĎ(θ)) is semi-positivedeďŹnite.
WeassumethatĎ is strictlyconvex in thispaper.Under thisassumption,wecaninducemany
geometric structures foraq-exponential family.
SinceĎ is strictlyconvex,wecandeďŹneaRiemannianmetricandacubic formby
gqij(θ) := âiâjĎ(θ),
Cqijk(θ) := âiâjâkĎ(θ).
Wecallgq andCq aq-Fishermetricandaq-cubic form, respectively [23,24]. Sincegq isaHessianof
a functionĎ,gq isaHessianmetric, andĎ is thepotentialofgq withrespect to thenatural coordinate
{θi} [25].
ForaďŹxedrealnumberÎą, set
gq (
âq(Îą)X Y,Z )
:= gq (
âq(0)X Y,Z )
â Îą
2 Cq(X,Y,Z) , (11)
whereâq(0) is theLevi-Civitaconnectionwithrespect togq. Sincegq isaHessianmetric, fromstandard
arguments inHessiangeometry [25],âq(e) :=âq(1) andâq(m) :=âq(â1) areďŹatafďŹneconnections
andmutuallydualwithrespect togq. Therefore, the triplets (Sq,âq(e),gq)and (Sq,âq(m),gq)areďŹat
statisticalmanifolds,andthequadruplet (Sq,gq,âq(e),âq(m)) isaduallyďŹatspace.
Underq-expectations,wehavethe followingproposition(cf. [10]).
Proposition4. ForSq aq-exponential family, (1)SetΡi=Eescq,p[Fi(x)]. Then{Ρi} is aâq(m)-afďŹnecoordinate
systemsuch that
gq (
â
âθi , â
âΡj )
= δ j
i.
(2)SetĎ(Ρ)=Eescq,p[logq p(x;θ)], thenĎ(Ρ) is thepotential of g q with respect to{Ρi}.
318
Differential Geometrical Theory of Statistics
- Titel
- Differential Geometrical Theory of Statistics
- Autoren
- FrĂŠdĂŠric Barbaresco
- Frank Nielsen
- Herausgeber
- MDPI
- Ort
- Basel
- Datum
- 2017
- Sprache
- englisch
- Lizenz
- CC BY-NC-ND 4.0
- ISBN
- 978-3-03842-425-3
- Abmessungen
- 17.0 x 24.4 cm
- Seiten
- 476
- SchlagwĂśrter
- Entropy, Coding Theory, Maximum entropy, Information geometry, Computational Information Geometry, Hessian Geometry, Divergence Geometry, Information topology, Cohomology, Shape Space, Statistical physics, Thermodynamics
- Kategorien
- Naturwissenschaften Physik