Šimon Váry

Research


My research focuses on optimization, statistical learning theory, and large language models:

For a complete and up-to-date citation list, see my Google Scholar profile.

Preprints

Masked Language Flow Models
I. Azangulov, K. Ashouritaklimi*, L. Zhang*, S. Vary, P. Rebeschini
Preprint, 2026 · [pdf] [arXiv]
A Nesterov-style Accelerated Gradient Descent Algorithm for the Symmetric Eigenvalue Problem
F. Alimisis, S. Vary, B. Vandereycken
Preprint, 2024 · [arXiv]

Selected publications

On-Average Stability of Multipass Preconditioned SGD and Effective Dimension
S. Vary, T. Farghly, I. Kuzborskij, P. Rebeschini
COLT, accepted, 2026 · [arXiv]
Does Stochastic Gradient really succeed for Bandits?
D. Baudry, E. Johnson, S. Vary, C. Pike-Burke, P. Rebeschini
NeurIPS, oral, 2025 · [Proceedings]
Black-Box Uniform Stability for Non-Euclidean Empirical Risk Minimization
S. Vary, D. Martínez-Rubio, P. Rebeschini
AISTATS, 2025 · [arXiv]
Optimization without retraction on the random generalized Stiefel manifold
S. Vary, P. Ablin, B. Gao, P.-A. Absil
ICML, 2024 · [PDF] [Proceedings] [arXiv] [Code]
Compressed sensing of low-rank plus sparse matrices
J. Tanner, S. Vary
Applied and Computational Harmonic Analysis, 64, 254–293, 2023 · [PDF] [DOI] [arXiv]

Publications

Infeasible Deterministic, Stochastic, and Variance-Reduction Algorithms for Optimization under Orthogonality Constraints
P. Ablin, S. Vary, B. Gao, P.-A. Absil
JMLR, 2024 · [arXiv] [Code]
An Alternating Minimization Algorithm with Trajectory for Direct Exoplanet Detection — The AMAT Algorithm
H. Daglayan, S. Vary, O. Absil, F. Cantalloube, V. Christiaens, N. Gillis, L. Jacques, V. Leplat, P.-A. Absil
Astronomy & Astrophysics, 692 (A126), 2024 · [DOI] [arXiv]
A Riemannian Proximal Newton Method
W. Si, P.-A. Absil, W. Huang, R. Jiang, S. Vary
SIAM Journal on Optimization, 34(1), 654–681, 2024 · [DOI] [arXiv]
Direct Exoplanet Detection Using L1 Norm Low-Rank Approximation
H. Daglayan, S. Vary, V. Laplat, N. Gillis, P.-A. Absil
Preprint, 2023 · [arXiv]
Low-rank plus sparse trajectory decomposition for direct exoplanet imaging
S. Vary, H. Daglayan, L. Jacques, P.-A. Absil
IEEE (ICASSP) International Conference on Acoustics, Speech, and Signal Processing, 2023 · [arXiv]
Likelihood ratio map for direct exoplanet detection
H. Daglayan, S. Vary, F. Cantalloube, P.-A. Absil, O. Absil
IEEE (IPAS) International Image Processing Applications and Systems, 2022 · [arXiv]
Optimization flows landing on the Stiefel manifold
B. Gao, S. Vary, P. Ablin, P.-A. Absil
Proc. MTNS (IFAC-PapersOnLine) 55(30), 25–30, 2022 · [DOI] [arXiv]
Matrix rigidity and the ill-posedness of Robust PCA and matrix completion
J. Tanner, A. Thompson, S. Vary
SIAM Journal on Mathematics of Data Science, 1(3), 537–554, 2019 · [DOI] [arXiv]
Multispectral snapshot demosaicing via non-convex matrix completion
G. A. Antonucci, S. Vary, D. Humphreys, R. A. Lamb, J. Piper, J. Tanner
IEEE Data Science Workshop, 2019 · [DOI] [arXiv]
A computational approach to hyperspectral imaging for long-range target identification
S. Vary, A. Thompson, D. Humphreys, J. Tanner, R. A. Lamb
Proc. SPIE 10644, Algorithms and Technologies for Multispectral, Hyperspectral, and Ultraspectral Imagery (XXIV), 2018 · [DOI]
Differentially expressed microRNAs in lung adenocarcinoma invert effects of copy number aberrations of prognostic genes
T. Tokar, C. Pastrello, V. R. Ramnarine, C. Zhu, K.J. Craddock, L. A. Pikor, E. A. Vucic, S. Vary, F. A. Shepherd, M. Tsao, W. L. Lam, I. Jurisica
Oncotarget, 2018 · [Article]

Thesis

On low-rank plus sparse matrix sensing
S. Vary
DPhil dissertation, 2021 · [PDF]