Page - 338 - in Differential Geometrical Theory of Statistics
Image of the Page - 338 -
Text of the Page - 338 -
Entropy2016,18, 421
When there is no risk of confusion, we may abbreviate M(t;N) to M and fN,i(t;r) to fN(r), or
even to f(r)âso that (A1) becomes M = f(0). Again, we may write ârM(t;N)/âtri as Mr,
âr+sM(t;N)/âtriât s
j asMr,s andâ r+s+uM(t;N)/âtriât s
jât u
l asMr,s,u,withsimilarconventions forhigher
ordermixedderivatives.
We can nowuse this to explicitly calculate lowordermoments of the count vectors. Using
E(nri)= â rM(t;N)/âtri|t=0, theïŹrstNmomentsofninowfollowfrom(A1)andrepeateduseof (A2),
notingthatm(0)=1and ai(0)=Ïi.
Inparticular, theïŹrst6momentsofeachni canbeobtainedas follows,whereNâ„6 isassumed.
Using(A1)and(A2),wehave
M1= f(1)
M2= f(2)+ f(1)
M3= f(3)+2f(2)+ f(2)+ f(1)= f(3)+3f(2)+ f(1)
M4= f(4)+ 6f(3)+ 7f(2)+ f(1)
M5= f(5)+10f(4)+25f(3)+15f(2)+ f(1)
M6= f(6)+15f(5)+65f(4)+90f(3)+31f(2)+ f(1).
Substituting in,wehave
E(ni)= NÏi
E(n2i)=N(2)Ï 2
i + NÏi
E(n3i)=N(3)Ï 3
i + 3N(2)Ï 2
i + NÏi
E(n4i)=N(4)Ï 4
i + 6N(3)Ï 3
i + 7N(2)Ï 2
i + NÏi
E(n5i)=N(5)Ï 5
i +10N(4)Ï 4
i +25N(3)Ï 3
i +15N(2)Ï 2
i + NÏi
E(n6i)=N(6)Ï 6
i +15N(5)Ï 5
i +65N(4)Ï 4
i +90N(3)Ï 3
i +31N(2)Ï 2
i +NÏi.
Thiscanbeformalised in the followingLemma
LemmaA1. The integer coefïŹcients inanyexpansion
Mr= r
â
s=1 cr(s)f(s) (1†râ€N)
canbecomputedusingcr(1)= cr(r)=1 together, for râ„3,with theupdate:
cr(s)= crâ1(sâ1)+scrâ1(s) (1< s< r).
Wenote that ifMr is requiredfor r>N,wemayrepeatedlydifferentiate
MN= N
â
s=1 cN(s)f(s)
w.r.t. ti,notingthat f(N)=N!aNi nolongerdependsonm(t)sothat, forallh>0,â hf(N)/âthi =N hf(N).
Mixedmomentsofanyordercanbederivedfromthoseof lowerorder,exploitingthefact that
ai dependson tonlyvia ti. We illustrate this byderiving those required for the secondand third
momentsofW.
First consider themixedmoments requiredfor thesecondmomentofW. Ofcourse,Var(W)=0
ifk=0.Otherwise,k>0,andcomputingVar(W) requiresE(n2in
2
j) for i = j.WeïŹndthisas follows,
assumingNâ„4.
338
Differential Geometrical Theory of Statistics
- Title
- Differential Geometrical Theory of Statistics
- Authors
- Frédéric Barbaresco
- Frank Nielsen
- Editor
- MDPI
- Location
- Basel
- Date
- 2017
- Language
- English
- License
- CC BY-NC-ND 4.0
- ISBN
- 978-3-03842-425-3
- Size
- 17.0 x 24.4 cm
- Pages
- 476
- Keywords
- Entropy, Coding Theory, Maximum entropy, Information geometry, Computational Information Geometry, Hessian Geometry, Divergence Geometry, Information topology, Cohomology, Shape Space, Statistical physics, Thermodynamics
- Categories
- Naturwissenschaften Physik