Get our free extension to see links to code for papers anywhere online!

Chrome logo  Add to Chrome

Firefox logo Add to Firefox

A General Framework for Analyzing Stochastic Dynamics in Learning Algorithms

Add code

Jun 11, 2020
Chi-Ning Chou, Mien Brabeeba Wang, Tiancheng Yu

Share this with someone who'll enjoy it:

We present a general framework for analyzing high-probability bounds for stochastic dynamics in learning algorithms. Our framework composes standard techniques such as a stopping time, a martingale concentration and a closed-from solution to give a streamlined three-step recipe with a general and flexible principle to implement it. To demonstrate the power and the flexibility of our framework, we apply the framework on three very different learning problems: stochastic gradient descent for strongly convex functions, streaming principal component analysis and linear bandit with stochastic gradient descent updates. We improve the state of the art bounds on all three dynamics.

   Access Paper Source

Share this with someone who'll enjoy it: