High Probability Convergence Bounds for Non-convex Stochastic Gradient Descent with Sub-Weibull Noise
High Probability Convergence Bounds for Non-convex Stochastic Gradient Descent with Sub-Weibull Noise Liam Madden, Emiliano Dall’Anese, Stephen Becker; 25(241):1−36, 2024. Abstract Stochastic gradient descent is one of the most common iterative algorithms used in machine learning and its convergence analysis…