NOISY MATRIX COMPLETION: UNDERSTANDING STATISTICAL GUARANTEES FOR CONVEX RELAXATION VIA NONCONVEX OPTIMIZATION.

90C25 90C26 Burer–Monteiro approach convex relaxation matrix completion minimaxity nonconvex optimization stability

Journal

SIAM journal on optimization : a publication of the Society for Industrial and Applied Mathematics
ISSN: 1052-6234
Titre abrégé: SIAM J Optim
Pays: United States
ID NLM: 101520392

Informations de publication

Date de publication:
2020
Historique:
entrez: 26 7 2021
pubmed: 1 1 2020
medline: 1 1 2020
Statut: ppublish

Résumé

This paper studies noisy low-rank matrix completion: given partial and noisy entries of a large low-rank matrix, the goal is to estimate the underlying matrix faithfully and efficiently. Arguably one of the most popular paradigms to tackle this problem is convex relaxation, which achieves remarkable efficacy in practice. However, the theoretical support of this approach is still far from optimal in the noisy setting, falling short of explaining its empirical success. We make progress towards demystifying the practical efficacy of convex relaxation vis-à-vis random noise. When the rank and the condition number of the unknown matrix are bounded by a constant, we demonstrate that the convex programming approach achieves near-optimal estimation errors - in terms of the Euclidean loss, the entrywise loss, and the spectral norm loss - for a wide range of noise levels. All of this is enabled by bridging convex relaxation with the nonconvex Burer-Monteiro approach, a seemingly distinct algorithmic paradigm that is provably robust against noise. More specifically, we show that an approximate critical point of the nonconvex formulation serves as an extremely tight approximation of the convex solution, thus allowing us to transfer the desired statistical guarantees of the nonconvex approach to its convex counterpart.

Identifiants

pubmed: 34305368
doi: 10.1137/19m1290000
pmc: PMC8300474
mid: NIHMS1639584
doi:

Types de publication

Journal Article

Langues

eng

Pagination

3098-3121

Subventions

Organisme : NIGMS NIH HHS
ID : R01 GM072611
Pays : United States

Références

Appl Comput Harmon Anal. 2011 Jan 30;30(1):20-36
pubmed: 21179593
Adv Neural Inf Process Syst. 2015;28:559-567
pubmed: 28316458
Magn Reson Med. 2015 Feb;73(2):655-61
pubmed: 24500817
Proc Natl Acad Sci U S A. 2019 Nov 12;116(46):22931-22937
pubmed: 31666329
J Am Stat Assoc. 2012;107(499):1019-1035
pubmed: 24729644
J Econom. 2017 Dec;201(2):292-306
pubmed: 29731537
Math Program. 2019 Jul;176(1-2):5-37
pubmed: 33833473
J Am Stat Assoc. 2019;114(528):1880-1893
pubmed: 33033420
J Econom. 2020 May;216(1):71-85
pubmed: 32269406
J Mach Learn Res. 2010 Mar 1;11:2287-2322
pubmed: 21552465
J R Stat Soc Series B Stat Methodol. 2013 Sep 1;75(4):
pubmed: 24348088
J Am Stat Assoc. 2010 Sep 1;105(491):1042-1055
pubmed: 21052523
J Econom. 2019 Jan;208(1):5-22
pubmed: 30546195
Ann Stat. 2019;47(4):2204-2235
pubmed: 31598016
Ann Stat. 2020 Jun;48(3):1452-1474
pubmed: 33859446

Auteurs

Yuxin Chen (Y)

Department of Electrical Engineering, Princeton University, Princeton, NJ 08544, USA.

Yuejie Chi (Y)

Department of Electrical and Computer Engineering, Carnegie Mellon University, Pittsburgh, PA 15213, USA.

Jianqing Fan (J)

Department of Operations Research and Financial Engineering, Princeton University, Princeton, NJ 08544, USA.

Cong Ma (C)

Department of Electrical and Computer Engineering, Carnegie Mellon University, Pittsburgh, PA 15213, USA.

Yuling Yan (Y)

Department of Electrical and Computer Engineering, Carnegie Mellon University, Pittsburgh, PA 15213, USA.

Classifications MeSH