Seite - 389 - in Differential Geometrical Theory of Statistics
Bild der Seite - 389 -
Text der Seite - 389 -
Entropy2016,9, 337
with1Uk thecharacteristic functionof thesetUk. It seemsnatural toextendthedensityobtainedfrom
samples toanotheronebasedonthe trajectories themselvesusinganintegral form:
dk=λâ1 N
â
i=1 â« 1
0 1Uk (Îłi(t))dt (2)
where thenormalizingconstantλ is chosensothatdk isadiscreteprobabilitydistribution:
λ= P
â
k=1 N
â
i=1 â« 1
0 1Uk (Îłi(t))dt= N
â
i=1 â« 1
0 P
â
k=1 1Uk (Îłi(t))dt
andsinceUk,k=1,. . . ,P isapartition:
P
â
k=1 1Uk (Îłi(t))=1 (3)
so thatλ=N.
Densitycanbeviewedasanempiricalprobabilitydistributionwith theUk consideredasbins
inanhistogram. It is thusnatural toextendtheabovecomputationsoas togiverise toacontinuous
distributiononΩ. For thatpurpose, localweighting techniques, suchaskerneldensityestimation
methods, arewell known in nonparametric statistics, because they are a useful data-drivenway
toyield continuousdensity estimation. Many referencesmaybe found in the literature as in [5,6].
Giventheobservations, theresultingestimationwillbe thesumofweights taking intoaccount the
distancebetweentheobservationsandthelocationxatwhichthedensityhastobeestimated; themore
an observation is close to x, the greater is theweighting. Theweights are deïŹnedby selecting a
summable functioncenteredontheobservations, calledakernel,usuallydenotedbyK :RâR+ in
theunivariatecase,andasmoothedversionof theParzenâRosenblattdensityestimator [7,8] isused.
Standardchoices for theK functionare theonesusedfornonparametrickernelestimation, like the
Epanechnikovfunction[9]:
K : x â (
1âx2 )
1[â1,1](x).
There exists a large variety of kernel functions, and any density function satisfying the
normalizationconditioncanbeconsidered, so that theestimation isaprobabilitydensity.Moreover,
thekernel function isasymmetricpositive function,with theïŹrstmomentequal tozeroandaïŹnite
secondordermoment. In themultivariatecase,amultivariatekernel functionK :RqâR+ is selected
that can be expressed bymeans of a real kernelK associatedwith a norm, denoted by â.â, inRq
as follows:
K(x)=K(âxâ), xâRq.
Thenormalizationconditionbecomes:â«
Rq K(x)dx= â«
Rq K(âxâ)dx=1.
Akernelversionof thedensity is thendeïŹnedasamappingd fromΩ to [0,1]:
d: x â â N
i=1 â«1
0 K(âxâÎłi(t)â)dt
âNi=1 â«
Ω â«1
0 K(âxâÎłi(t)â)dtdx . (4)
Normalizingthekernel isnotmandatory,as thenormalizationoccurswiththedeïŹnitionofd. It is
neverthelesseasier toconsider thesekindsofkernels, as isdone innonparametricdensityestimation.
389
Differential Geometrical Theory of Statistics
- Titel
- Differential Geometrical Theory of Statistics
- Autoren
- Frédéric Barbaresco
- Frank Nielsen
- Herausgeber
- MDPI
- Ort
- Basel
- Datum
- 2017
- Sprache
- englisch
- Lizenz
- CC BY-NC-ND 4.0
- ISBN
- 978-3-03842-425-3
- Abmessungen
- 17.0 x 24.4 cm
- Seiten
- 476
- Schlagwörter
- Entropy, Coding Theory, Maximum entropy, Information geometry, Computational Information Geometry, Hessian Geometry, Divergence Geometry, Information topology, Cohomology, Shape Space, Statistical physics, Thermodynamics
- Kategorien
- Naturwissenschaften Physik