Sparse Reduced Rank Huber Regression in High Dimensions.

Convex relaxation Huber Low rank Sparsity approximation loss

Journal

Journal of the American Statistical Association
ISSN: 0162-1459
Titre abrégé: J Am Stat Assoc
Pays: United States
ID NLM: 01510020R

Informations de publication

Date de publication:
2023
Historique:
medline: 29 1 2024
pubmed: 29 1 2024
entrez: 29 1 2024
Statut: ppublish

Résumé

We propose a sparse reduced rank Huber regression for analyzing large and complex high-dimensional data with heavy-tailed random noise. The proposed method is based on a convex relaxation of a rank- and sparsity-constrained nonconvex optimization problem, which is then solved using a block coordinate descent and an alternating direction method of multipliers algorithm. We establish nonasymptotic estimation error bounds under both Frobenius and nuclear norms in the high-dimensional setting. This is a major contribution over existing results in reduced rank regression, which mainly focus on rank selection and prediction consistency. Our theoretical results quantify the tradeoff between heavy-tailedness of the random noise and statistical bias. For random noise with bounded

Identifiants

pubmed: 38283734
doi: 10.1080/01621459.2022.2050243
pmc: PMC10812838
doi:

Types de publication

Journal Article

Langues

eng

Pagination

2383-2393

Auteurs

Kean Ming Tan (KM)

Department of Statistics, University of Michigan, Ann Arbor, MI.

Qiang Sun (Q)

Department of Statistical Sciences, University of Toronto, Toronto, ON, Canada.

Daniela Witten (D)

Departments of Statistics and Biostatistics, University of Washington, Seattle, WA.

Classifications MeSH