American Institute of Mathematical Sciences

Advanced
December  2019, 6(2): 251-276. doi: 10.3934/jcd.2019013

Principal symmetric space analysis

Charles Curry 1, , Stephen Marsland 2, and  Robert I McLachlan 3,

1. 

Department of Mathematical Sciences, NTNU, Gjøvik, Norway
2. 

School of Mathematics and Statistics, Victoria University of Wellington, Wellington, New Zealand
3. 

School of Fundamental Sciences, Massey University, Palmerston North, New Zealand

Received  April 2019 Revised  October 2019 Published  November 2019

Principal Geodesic Analysis is a statistical technique that constructs low-dimensional approximations to data on Riemannian manifolds. It provides a generalization of principal components analysis to non-Euclidean spaces. The approximating submanifolds are geodesic at a reference point such as the intrinsic mean of the data. However, they are local methods as the approximation depends on the reference point and does not take into account the curvature of the manifold. Therefore, in this paper we develop a specialization of principal geodesic analysis, Principal Symmetric Space Analysis, based on nested sequences of totally geodesic submanifolds of symmetric spaces. The examples of spheres, Grassmannians, tori, and products of two-dimensional spheres are worked out in detail. The approximating submanifolds are geometrically the simplest possible, with zero exterior curvature at all points. They can deal with significant curvature and diverse topology. We show that in many cases the distance between a point and the submanifold can be computed analytically and there is a related metric that reduces the computation of principal symmetric space approximations to linear algebra.

Keywords: PCA, PGA, totally geodesic submanifolds, subtori, symmetric spaces.
Mathematics Subject Classification: Primary: 62H25, 53C35, 53C42.
Citation: Charles Curry, Stephen Marsland, Robert I McLachlan. Principal symmetric space analysis. Journal of Computational Dynamics, 2019, 6 (2) : 251-276. doi: 10.3934/jcd.2019013
References:
[1]

J. Berndt and C. Olmos, Maximal totally geodesic submanifolds and index of symmetric spaces, J. Differential Geom., 104 (2016), 187-217.  doi: 10.4310/jdg/1476367055.  Google Scholar

[2]

B. Y. Chen and T. Nagano, Totally geodesic submanifolds of symmetric spaces, Ⅱ, Duke Math J., 45 (1978), 405-425.  doi: 10.1215/S0012-7094-78-04521-0.  Google Scholar

[3]

J. H. Conway, R. H. Hardin and N. J. Sloane, Packing lines, planes, etc.: Packings in Grassmannian spaces, Experiment. Math., 5 (1996), 139-159.  doi: 10.1080/10586458.1996.10504585.  Google Scholar

[4]

J. Damon and J. S. Marron, Backwards principal component analysis and principal nested relations, J. Math. Imaging Vision, 50 (2014), 107-114.  doi: 10.1007/s10851-013-0463-2.  Google Scholar

[5]

B. Eltzner, S. Jung and S. Huckermann, Dimension reduction on polyspheres with application to skeletal representations, in Geometric Science of Information, Lecture Notes in Comput. Sci., 9389, Springer, Cham, 2015, 22–29. doi: 10.1007/978-3-319-25040-3_3.  Google Scholar

[6]

P. T. Fletcher, C. Lu, S. M. Pizer and S. C. Joshi, Principal geodesic analysis for the study of nonlinear statistics of shape, IEEE Transactions on Medical Imaging, 23 (2004), 995-1005.  doi: 10.1109/TMI.2004.831793.  Google Scholar

[7]

P. T. Fletcher and S. C. Joshi, Principal geodesic analysis on symmetric spaces: Statistics of diffusion tensors, in Computer Vision and Mathematical Methods in Medical and Biomedical Image Analysis, LNCS, 3117, Springer, Berlin, 2004, 87–98. Google Scholar

[8]

T. Fletcher, Geodesic regression on Riemannian manifolds, in Proceedings of the Third International Workshop on Mathematical Foundations of Computational Anatomy-Geometrical and Statistical Methods for Modelling Biological Shape Variability, 2001, 75–86. Google Scholar

[9]

C. G. Gebhardt, M. C. Steinbach and R. Rolfes, Understanding the nonlinear dynamics of beam structures: A principal geodesic analysis approach, Thin-Walled Structures, 140 (2019), 357-372.  doi: 10.1016/j.tws.2019.03.009.  Google Scholar

[10]

G. H. Golub and C. F. Van Loan, Matrix Computations, Johns Hopkins Series in the Mathematical Sciences, 3, Johns Hopkins University Press, Baltimore, MD, 1989.  Google Scholar

[11]

S. Huckemann, T. Hotz and A. Munk, Intrinsic shape analysis: Geodesic PCA for Riemannian manifolds modulo isometric Lie group actions, Statist. Sinica, 20 (2010), 1-58.   Google Scholar

[12]

I. Jolliffe, Principal Component Analysis, Springer Series in Statistics, Springer-Verlag, New York, 1986. doi: 10.1007/978-1-4757-1904-8.  Google Scholar

[13]

S. Jung, I. L. Dryden and J. S. Marron, Analysis of principal nested spheres, Biometrika, 99 (2012), 551-568.  doi: 10.1093/biomet/ass022.  Google Scholar

[14]

K. Kenobi, I. L. Dryden and H. Le, Shape curves and geodesic modelling, Biometrika, 97 (2010), 567-584.  doi: 10.1093/biomet/asq027.  Google Scholar

[15]

S. Klein, Totally geodesic submanifolds in Riemannian symmetric spaces, in Differential Geometry, World Sci. Publ., Hackensack, NJ, 2009, 136–145. doi: 10.1142/9789814261173_0013.  Google Scholar

[16]

S. Kobayashi and K. Nomizu, Foundations of Differential Geometry, John Wiley & Sons, Inc., New York, 1996.  Google Scholar

[17]

J. Lawrence, Enumeration in torus arrangements, European J. Combin., 32 (2011), 870-881.  doi: 10.1016/j.ejc.2011.02.003.  Google Scholar

[18]

A. K. Lenstra, H. W. Lenstra Jr. and L. Lovász, Factoring polynomials with rational coefficients, Math. Ann., 261 (1982), 515-534.  doi: 10.1007/BF01457454.  Google Scholar

[19]

X. Pennec, Barycentric subspace analysis on manifolds, Ann. Statist., 46 (2018), 2711-2746.  doi: 10.1214/17-AOS1636.  Google Scholar

[20]

Q. Rentmeesters, A gradient method for geodesic data fitting on some symmetric Riemannian manifolds, in 2011 50$^{th}$ IEEE Conference on Decision and Control and European Control Conference, 2011, 7141–7146. doi: 10.1109/CDC.2011.6161280.  Google Scholar

[21]

H. J. S. Smith, On systems of linear indeterminate equations and congruences, Phil. Trans. Roy. Soc. London, 151 (1861), 293-326.   Google Scholar

[22]

S. Sommer, F. Lauze and M. Nielsen, Optimization over geodesics for exact principal geodesic analysis, Adv. Comput. Math., 40 (2014), 283-313.  doi: 10.1007/s10444-013-9308-1.  Google Scholar

[23]

W. Utschick, Tracking of signal subspace projectors, IEEE Trans. Signal Process., 50 (2002), 769-778.  doi: 10.1109/78.992119.  Google Scholar

[24]

J. A. Wolf, Elliptic spaces in Grassmann manifolds, Illinois J. Math., 7 (1963), 447-462.  doi: 10.1215/ijm/1255644952.  Google Scholar

[25]

D. Wubben, D. Seethaler, J. Jalden and G. Matz, Lattice reduction, IEEE Signal Processing Magazine, 28 (2011), 70-91.  doi: 10.1109/MSP.2010.938758.  Google Scholar

show all references

References:
[1]

J. Berndt and C. Olmos, Maximal totally geodesic submanifolds and index of symmetric spaces, J. Differential Geom., 104 (2016), 187-217.  doi: 10.4310/jdg/1476367055.  Google Scholar

[2]

B. Y. Chen and T. Nagano, Totally geodesic submanifolds of symmetric spaces, Ⅱ, Duke Math J., 45 (1978), 405-425.  doi: 10.1215/S0012-7094-78-04521-0.  Google Scholar

[3]

J. H. Conway, R. H. Hardin and N. J. Sloane, Packing lines, planes, etc.: Packings in Grassmannian spaces, Experiment. Math., 5 (1996), 139-159.  doi: 10.1080/10586458.1996.10504585.  Google Scholar

[4]

J. Damon and J. S. Marron, Backwards principal component analysis and principal nested relations, J. Math. Imaging Vision, 50 (2014), 107-114.  doi: 10.1007/s10851-013-0463-2.  Google Scholar

[5]

B. Eltzner, S. Jung and S. Huckermann, Dimension reduction on polyspheres with application to skeletal representations, in Geometric Science of Information, Lecture Notes in Comput. Sci., 9389, Springer, Cham, 2015, 22–29. doi: 10.1007/978-3-319-25040-3_3.  Google Scholar

[6]

P. T. Fletcher, C. Lu, S. M. Pizer and S. C. Joshi, Principal geodesic analysis for the study of nonlinear statistics of shape, IEEE Transactions on Medical Imaging, 23 (2004), 995-1005.  doi: 10.1109/TMI.2004.831793.  Google Scholar

[7]

P. T. Fletcher and S. C. Joshi, Principal geodesic analysis on symmetric spaces: Statistics of diffusion tensors, in Computer Vision and Mathematical Methods in Medical and Biomedical Image Analysis, LNCS, 3117, Springer, Berlin, 2004, 87–98. Google Scholar

[8]

T. Fletcher, Geodesic regression on Riemannian manifolds, in Proceedings of the Third International Workshop on Mathematical Foundations of Computational Anatomy-Geometrical and Statistical Methods for Modelling Biological Shape Variability, 2001, 75–86. Google Scholar

[9]

C. G. Gebhardt, M. C. Steinbach and R. Rolfes, Understanding the nonlinear dynamics of beam structures: A principal geodesic analysis approach, Thin-Walled Structures, 140 (2019), 357-372.  doi: 10.1016/j.tws.2019.03.009.  Google Scholar

[10]

G. H. Golub and C. F. Van Loan, Matrix Computations, Johns Hopkins Series in the Mathematical Sciences, 3, Johns Hopkins University Press, Baltimore, MD, 1989.  Google Scholar

[11]

S. Huckemann, T. Hotz and A. Munk, Intrinsic shape analysis: Geodesic PCA for Riemannian manifolds modulo isometric Lie group actions, Statist. Sinica, 20 (2010), 1-58.   Google Scholar

[12]

I. Jolliffe, Principal Component Analysis, Springer Series in Statistics, Springer-Verlag, New York, 1986. doi: 10.1007/978-1-4757-1904-8.  Google Scholar

[13]

S. Jung, I. L. Dryden and J. S. Marron, Analysis of principal nested spheres, Biometrika, 99 (2012), 551-568.  doi: 10.1093/biomet/ass022.  Google Scholar

[14]

K. Kenobi, I. L. Dryden and H. Le, Shape curves and geodesic modelling, Biometrika, 97 (2010), 567-584.  doi: 10.1093/biomet/asq027.  Google Scholar

[15]

S. Klein, Totally geodesic submanifolds in Riemannian symmetric spaces, in Differential Geometry, World Sci. Publ., Hackensack, NJ, 2009, 136–145. doi: 10.1142/9789814261173_0013.  Google Scholar

[16]

S. Kobayashi and K. Nomizu, Foundations of Differential Geometry, John Wiley & Sons, Inc., New York, 1996.  Google Scholar

[17]

J. Lawrence, Enumeration in torus arrangements, European J. Combin., 32 (2011), 870-881.  doi: 10.1016/j.ejc.2011.02.003.  Google Scholar

[18]

A. K. Lenstra, H. W. Lenstra Jr. and L. Lovász, Factoring polynomials with rational coefficients, Math. Ann., 261 (1982), 515-534.  doi: 10.1007/BF01457454.  Google Scholar

[19]

X. Pennec, Barycentric subspace analysis on manifolds, Ann. Statist., 46 (2018), 2711-2746.  doi: 10.1214/17-AOS1636.  Google Scholar

[20]

Q. Rentmeesters, A gradient method for geodesic data fitting on some symmetric Riemannian manifolds, in 2011 50$^{th}$ IEEE Conference on Decision and Control and European Control Conference, 2011, 7141–7146. doi: 10.1109/CDC.2011.6161280.  Google Scholar

[21]

H. J. S. Smith, On systems of linear indeterminate equations and congruences, Phil. Trans. Roy. Soc. London, 151 (1861), 293-326.   Google Scholar

[22]

S. Sommer, F. Lauze and M. Nielsen, Optimization over geodesics for exact principal geodesic analysis, Adv. Comput. Math., 40 (2014), 283-313.  doi: 10.1007/s10444-013-9308-1.  Google Scholar

[23]

W. Utschick, Tracking of signal subspace projectors, IEEE Trans. Signal Process., 50 (2002), 769-778.  doi: 10.1109/78.992119.  Google Scholar

[24]

J. A. Wolf, Elliptic spaces in Grassmann manifolds, Illinois J. Math., 7 (1963), 447-462.  doi: 10.1215/ijm/1255644952.  Google Scholar

[25]

D. Wubben, D. Seethaler, J. Jalden and G. Matz, Lattice reduction, IEEE Signal Processing Magazine, 28 (2011), 70-91.  doi: 10.1109/MSP.2010.938758.  Google Scholar

Figure 1.  In linearized Principal Geodesic Analysis, the data (here 20 points on a sphere) is pulled back to the tangent space (shown here as a disk) of the intrinsic mean using geodesics. Data points near the mean are well represented, but data points far from the mean (here, near the south pole) become far apart in the linear approximation
Figure Options

Download full-size image

Download as PowerPoint slide

Figure 2.  Twenty data points on $ S^2 $ (dark blue) together with the point (pink) and the great circle (blue) that best approximate the data in the Riemannian metric, computed using nonlinear optimization. The best point (the intrinsic mean of the data) does not lie on the best great circle
Figure Options

Download full-size image

Download as PowerPoint slide

Figure 3.  Results for datasets 1–3 of Example 2. In each case, the best subspheres that approximate a set of 20 points on $ S^3 $ is shown. Data points further from the best $ S^2 $ are shown smaller. The best $ S^1 $ is shown in blue, lying on the best $ S^2 $ in teal. In datasets 2 and 3, the axis of the best $ S^0 $ (which consists of two antipodal points) is shown in black. In dataset 3, this also coincides with a standard mean of the data
Figure Options

Download full-size image

Download as PowerPoint slide

Figure 4.  The geodesic in $ \mathbb{T} ^3 $ through the origin in direction $ d = [1, 2, 3]^\mathsf{T} $, seen from two different viewpoints. Viewing in direction $ d $ (right) shows the lattice formed in $ \mathbb{R}^3 $ by the intersection of the lifted geodesic with an orthogonal plane
Figure Options

Download full-size image

Download as PowerPoint slide

Figure 6.  Fitting data on a torus (see Example 4). The best 1-torus and 2-torus approximating 50 data points on $ \mathbb{T} ^3 $, are shown from two different viewing directions. The subtori have been chosen from those with fixed resonance relations, i.e., only their translations fitted
Figure Options

Download full-size image

Download as PowerPoint slide

Figure 5.  Fitting data on a torus. Here the closed geodesic of best fit is computed to a set of 50 data points on $ S^1\times S^1 $. The data set is synthetic and has been chosen to lie near the geodesic with resonance relation $ 2 x_1 + 5 x_2 = $ const.; each data point has normal random noise of standard deviation $ 0.1/(2\pi) $ in each angle
Figure Options

Download full-size image

Download as PowerPoint slide

Figure 7.  Fitting data on a polysphere (see Example 6). The rotations of points $ x_i $ are plotted as cubes, whilst the points $ y_i $ are plotted as circles; a different colour is chosen for each $ i $. The great circle shows the best subspace $ S^1\subset S^2\subset S^2\times S^2 $
Figure Options

Download full-size image

Download as PowerPoint slide

Figure 8.  Fitting data on a polysphere (see Example 6). The best approximating torus $ S^1\times S^1\subset S^2\times S^2 $ is shown with two great circles inside the two spheres. Due to the difficulty of plotting the nested approximation $ S^1\subset S^2\times S^2 $ we have plotted (right) the projection of the points in $ S^2\times S^2 $ to the approximating torus $ S^1\times S^1 $ and shown the best approximating $ S^1 $ as a subset of this
Figure Options

Download full-size image

Download as PowerPoint slide

[1]

Pablo D. Carrasco, Túlio Vales. A symmetric Random Walk defined by the time-one map of a geodesic flow. Discrete & Continuous Dynamical Systems - A, 2020  doi: 10.3934/dcds.2020390
[2]

Ferenc Weisz. Dual spaces of mixed-norm martingale hardy spaces. Communications on Pure & Applied Analysis, , () : -. doi: 10.3934/cpaa.2020285
[3]

Teresa D'Aprile. Bubbling solutions for the Liouville equation around a quantized singularity in symmetric domains. Communications on Pure & Applied Analysis, 2021, 20 (1) : 159-191. doi: 10.3934/cpaa.2020262
[4]

Gang Luo, Qingzhi Yang. The point-wise convergence of shifted symmetric higher order power method. Journal of Industrial & Management Optimization, 2021, 17 (1) : 357-368. doi: 10.3934/jimo.2019115
[5]

Alessandro Carbotti, Giovanni E. Comi. A note on Riemann-Liouville fractional Sobolev spaces. Communications on Pure & Applied Analysis, 2021, 20 (1) : 17-54. doi: 10.3934/cpaa.2020255
[6]

Giulia Cavagnari, Antonio Marigonda. Attainability property for a probabilistic target in wasserstein spaces. Discrete & Continuous Dynamical Systems - A, 2021, 41 (2) : 777-812. doi: 10.3934/dcds.2020300
[7]

Daniele Bartolucci, Changfeng Gui, Yeyao Hu, Aleks Jevnikar, Wen Yang. Mean field equations on tori: Existence and uniqueness of evenly symmetric blow-up solutions. Discrete & Continuous Dynamical Systems - A, 2020, 40 (6) : 3093-3116. doi: 10.3934/dcds.2020039
[8]

Federico Rodriguez Hertz, Zhiren Wang. On $ \epsilon $-escaping trajectories in homogeneous spaces. Discrete & Continuous Dynamical Systems - A, 2021, 41 (1) : 329-357. doi: 10.3934/dcds.2020365
[9]

Noah Stevenson, Ian Tice. A truncated real interpolation method and characterizations of screened Sobolev spaces. Communications on Pure & Applied Analysis, 2020, 19 (12) : 5509-5566. doi: 10.3934/cpaa.2020250
[10]

Sumit Arora, Manil T. Mohan, Jaydev Dabas. Approximate controllability of a Sobolev type impulsive functional evolution system in Banach spaces. Mathematical Control & Related Fields, 2020  doi: 10.3934/mcrf.2020049
[11]

Giulia Luise, Giuseppe Savaré. Contraction and regularizing properties of heat flows in metric measure spaces. Discrete & Continuous Dynamical Systems - S, 2021, 14 (1) : 273-297. doi: 10.3934/dcdss.2020327
[12]

Dmitry Dolgopyat. The work of Sébastien Gouëzel on limit theorems and on weighted Banach spaces. Journal of Modern Dynamics, 2020, 16: 351-371. doi: 10.3934/jmd.2020014
[13]

Anna Anop, Robert Denk, Aleksandr Murach. Elliptic problems with rough boundary data in generalized Sobolev spaces. Communications on Pure & Applied Analysis, , () : -. doi: 10.3934/cpaa.2020286
[14]

Hongfei Yang, Xiaofeng Ding, Raymond Chan, Hui Hu, Yaxin Peng, Tieyong Zeng. A new initialization method based on normed statistical spaces in deep networks. Inverse Problems & Imaging, 2021, 15 (1) : 147-158. doi: 10.3934/ipi.2020045
[15]

Haruki Umakoshi. A semilinear heat equation with initial data in negative Sobolev spaces. Discrete & Continuous Dynamical Systems - S, 2021, 14 (2) : 745-767. doi: 10.3934/dcdss.2020365
[16]

Lin Shi, Dingshi Li, Kening Lu. Limiting behavior of unstable manifolds for spdes in varying phase spaces. Discrete & Continuous Dynamical Systems - B, 2021  doi: 10.3934/dcdsb.2021020
[17]

Soniya Singh, Sumit Arora, Manil T. Mohan, Jaydev Dabas. Approximate controllability of second order impulsive systems with state-dependent delay in Banach spaces. Evolution Equations & Control Theory, 2020  doi: 10.3934/eect.2020103
[18]

Xing Wu, Keqin Su. Global existence and optimal decay rate of solutions to hyperbolic chemotaxis system in Besov spaces. Discrete & Continuous Dynamical Systems - B, 2020  doi: 10.3934/dcdsb.2021002
[19]

Lei Liu, Li Wu. Multiplicity of closed characteristics on $ P $-symmetric compact convex hypersurfaces in $ \mathbb{R}^{2n} $. Discrete & Continuous Dynamical Systems - A, 2020  doi: 10.3934/dcds.2020378

 Impact Factor: 

Tools

Metrics

  • PDF downloads (158)
  • HTML views (353)
  • Cited by (0)

Other articles
by authors

[Back to Top]

Copyright © 2020 American Institute of Mathematical Sciences