Convergence Lower Bounds

1 paper touches this idea.

Papers

Nobody Has Proven the World's Favorite AI Optimizer Actually Works

Related concepts

Ideas that show up alongside Convergence Lower Bounds.

AdamW Convergence Analysis Adaptive Gradient Methods Large Language Model Training Optimization Under Heavy-Tailed Noise Sign-Based Optimizers Stochastic Optimization Theory