Back to AI News
arxiv

Adaptive accelerated optimistic dual averaging method with p-norm preconditioning

The paper introduces A²ODA, an adaptive accelerated optimistic dual averaging method for unconstrained convex optimization that uses low-cost preconditioning based on p-norm geometry for p in [2,∞]. The method is line-search-free and uses a new stepsize selection based on an aggregated affine lower model, with a simple unified update structure across all p. Under generalized local smoothness, it derives a convergence bound separating constant and gap-dependent curvature, recovering a nearly optimal rate in the local smoothness case.

AI Brief

Provides a concrete algorithmic advance with theoretical convergence guarantees, relevant to optimization researchers and practitioners.

arXiv:2611.05334v1 Announce Type: cross Abstract: Efficient preconditioning plays an important role in large-scale first-order optimization. In this paper, we propose an adaptive accelerated optimistic dual averaging ($\text{A}^2$ODA) method for unconstrained convex optimization that adopts low-cost preconditioning based on $p$-norm geometry for $p\in[2,\infty]$. The method is line-search-free and employs a new stepsize selection technique based on an aggregated affine lower model. Its update structure is simple and unified across $p\in[2,\infty]$, with the case $p>2$ requiring no more elaborate updates than the Euclidean case $p=2$. Under a generalized local smoothness condition, we derive a convergence bound that separates the effects of constant and gap-dependent curvature, with the latter potentially yielding faster-decaying terms. In the special case of local smoothness, this bound recovers a nearly optimal convergence rate.
Be the first to rate this article.

Comments & Questions (0)

Captcha
Please be respectful — let's keep the conversation friendly.

No comments yet

Be the first to comment!