High-dimensional Statistical Inference and Variable Selection Using Sufficient Dimension Association

Shangyuan Ye et al.

Journal of the American Statistical Association2026https://doi.org/10.1080/01621459.2026.2632869preprint
AJG 4ABDC A*
Weight
0.50

Abstract

Simultaneous variable selection and statistical inference is challenging in high-dimensional data analysis. Most existing post-selection inference methods require explicitly specified regression models, which are often linear, as well as sparsity in the regression model. The performance of such procedures can be poor under either misspecified nonlinear models or a violation of the sparsity assumption. In this paper, we propose a sufficient dimension association (SDA) technique that measures the association between each predictor and the response variable conditioning on other predictors in the high-dimensional setting. Our proposed SDA method requires neither a specific form of regression model nor sparsity in the regression. Alternatively, our method assumes normalized or Gaussian-distributed predictors with a Markov blanket property. We propose an estimator for the SDA and prove asymptotic properties for the estimator. We construct three types of test statistics for the SDA and propose a multiple testing procedure to control the false discovery rate. Extensive simulation studies have been conducted to show the validity and superiority of our SDA method. Gene expression data from the Alzheimer Disease Neuroimaging Initiative are used to demonstrate a real application.

Open via your library →

Cite this paper

https://doi.org/https://doi.org/10.1080/01621459.2026.2632869

Or copy a formatted citation

@article{shangyuan2026,
  title        = {{High-dimensional Statistical Inference and Variable Selection Using Sufficient Dimension Association}},
  author       = {Shangyuan Ye et al.},
  journal      = {Journal of the American Statistical Association},
  year         = {2026},
  doi          = {https://doi.org/https://doi.org/10.1080/01621459.2026.2632869},
}

Paste directly into BibTeX, Zotero, or your reference manager.

Flag this paper

High-dimensional Statistical Inference and Variable Selection Using Sufficient Dimension Association

Flags are reviewed by the Arbiter methodology team within 5 business days.


Evidence weight

0.50

Balanced mode · F 0.40 / M 0.15 / V 0.05 / R 0.40

F · citation impact0.50 × 0.4 = 0.20
M · momentum0.50 × 0.15 = 0.07
V · venue signal0.50 × 0.05 = 0.03
R · text relevance †0.50 × 0.4 = 0.20

† Text relevance is estimated at 0.50 on the detail page — for your query’s actual relevance score, open this paper from a search result.