Abstract: ased on the probabilistic reformulation of principal component analysis (PCA), we consider the problem of determining the number of principal components as a model selection problem. We present a hierarchical model for probabilistic PCA and construct a Bayesian inference method for this model using reversible jump Markov chain Monte Carlo (MCMC). By regarding each principal component as a point in a one-dimensional space and employing only birth-death moves in our reversible jump methodology, our proposed method is simple and capable of automatically determining the number of principal components and estimating the parameters simultaneously under the same disciplined framework. Simulation experiments are performed to demonstrate the effectiveness of our MCMC method.
Proceedings of the Nineteenth National Conference on Artificial Intelligence (AAAI-04), pp.372-377, San Jose, California, USA, July 2004.
Pdf: http://www.cs.ust.hk/~jamesk/papers/aaai04.pdf