arbiter
JournalsAccount

Empirical Bayes Covariance Decomposition, and a Solution to the Multiple Tuning Problem in Sparse PCA

Joonsuk Kang & Matthew Stephens

Journal of Computational and Graphical Statistics2026https://doi.org/10.1080/10618600.2026.2653766preprint
AJG 3ABDC A*
Weight
0.50

Abstract

Sparse Principal Components Analysis (PCA) has been proposed as a way to improve both interpretability and reliability of PCA. However, use of sparse PCA in practice is hindered by the difficulty of tuning the multiple hyperparameters that control the sparsity of different PCs (the "multiple tuning problem", MTP). Here we present a solution to the MTP using Empirical Bayes methods. We first introduce a general formulation for penalized PCA of a data matrix $\mathbf{X}$, which includes some existing sparse PCA methods as special cases. We show that this formulation also leads to a penalized decomposition of the covariance (or Gram) matrix, $\mathbf{X}^T\mathbf{X}$. We introduce empirical Bayes versions of these penalized problems, in which the penalties are determined by prior distributions that are estimated from the data by maximum likelihood rather than cross-validation. The resulting "Empirical Bayes Covariance Decomposition" provides a principled and efficient solution to the MTP in sparse PCA, and one that can be immediately extended to incorporate other structural assumptions (e.g. non-negative PCA). We illustrate the effectiveness of this approach on both simulated and real data examples.

Open via your library →

Cite this paper

https://doi.org/https://doi.org/10.1080/10618600.2026.2653766

Or copy a formatted citation

@article{joonsuk2026,
  title        = {{Empirical Bayes Covariance Decomposition, and a Solution to the Multiple Tuning Problem in Sparse PCA}},
  author       = {Joonsuk Kang & Matthew Stephens},
  journal      = {Journal of Computational and Graphical Statistics},
  year         = {2026},
  doi          = {https://doi.org/https://doi.org/10.1080/10618600.2026.2653766},
}

Paste directly into BibTeX, Zotero, or your reference manager.

Flag this paper

Empirical Bayes Covariance Decomposition, and a Solution to the Multiple Tuning Problem in Sparse PCA

Flags are reviewed by the Arbiter methodology team within 5 business days.

Evidence weight

0.50

Balanced mode · F 0.40 / M 0.15 / V 0.05 / R 0.40

F · citation impact0.50 × 0.4 = 0.20
M · momentum0.50 × 0.15 = 0.07
V · venue signal0.50 × 0.05 = 0.03
R · text relevance †0.50 × 0.4 = 0.20

† Text relevance is estimated at 0.50 on the detail page — for your query’s actual relevance score, open this paper from a search result.