Get our free extension to see links to code for papers anywhere online!

# Best of many worlds: Robust model selection for online supervised learning

May 22, 2018
Vidya Muthukumar, Mitas Ray, Anant Sahai, Peter L. Bartlett

Share this with someone who'll enjoy it:

We introduce algorithms for online, full-information prediction that are competitive with contextual tree experts of unknown complexity, in both probabilistic and adversarial settings. We show that by incorporating a probabilistic framework of structural risk minimization into existing adaptive algorithms, we can robustly learn not only the presence of stochastic structure when it exists (leading to constant as opposed to $\mathcal{O}(\sqrt{T})$ regret), but also the correct model order. We thus obtain regret bounds that are competitive with the regret of an optimal algorithm that possesses strong side information about both the complexity of the optimal contextual tree expert and whether the process generating the data is stochastic or adversarial. These are the first constructive guarantees on simultaneous adaptivity to the model and the presence of stochasticity.

* 33 pages, 5 figures

Access Paper Source

Share this with someone who'll enjoy it: