Riemannian stochastic optimization

A parallel line of work develops stochastic optimization algorithms on Riemannian manifolds, motivated by sufficient dimension reduction, where the targeted subspace is naturally a point on the Grassmann manifold, represented for computation by an orthonormal basis on the Stiefel manifold. The goal is to recast classical dimension-reduction criteria as smooth functions on this manifold, design stochastic gradient methods that respect its geometry, and establish non-asymptotic convergence rates matching the optimal scaling for non-convex stochastic first-order methods.

Sufficient dimension reduction: each predictor Xi is projected orthogonally onto the one-dimensional subspace span(B) (green), and the response Yi = g(BXi) is read off the regression surface above the projected point.
Collaborator François Portier (ENSAI / CREST)
Keywords Riemannian optimization stochastic gradient methods Stiefel manifold sufficient dimension reduction

Publications

  1. Accepted T. Pautrel, F. Portier Riemannian stochastic optimization for sufficient dimension reduction ICML 2026