Online learning: A comprehensive survey

SCH Hoi, D Sahoo, J Lu, P Zhao - Neurocomputing, 2021‏ - Elsevier
Online learning represents a family of machine learning methods, where a learner attempts
to tackle some predictive (or any type of decision-making) task by learning from a sequence …

A survey on distributed online optimization and online games

X Li, L **e, N Li - Annual Reviews in Control, 2023‏ - Elsevier
Distributed online optimization and online games have been increasingly researched in the
last decade, mostly motivated by their wide applications in sensor networks, robotics (eg …

A modern introduction to online learning

F Orabona - arxiv preprint arxiv:1912.13213, 2019‏ - arxiv.org
In this monograph, I introduce the basic concepts of Online Learning through a modern view
of Online Convex Optimization. Here, online learning refers to the framework of regret …

Position-transitional particle swarm optimization-incorporated latent factor analysis

X Luo, Y Yuan, S Chen, N Zeng… - IEEE Transactions on …, 2020‏ - ieeexplore.ieee.org
High-dimensional and sparse (HiDS) matrices are frequently found in various industrial
applications. A latent factor analysis (LFA) model is commonly adopted to extract useful …

Online meta-learning

C Finn, A Rajeswaran, S Kakade… - … on machine learning, 2019‏ - proceedings.mlr.press
A central capability of intelligent systems is the ability to continuously build upon previous
experiences to speed up and enhance learning of new tasks. Two distinct research …

On the optimization of deep networks: Implicit acceleration by overparameterization

S Arora, N Cohen, E Hazan - International conference on …, 2018‏ - proceedings.mlr.press
Conventional wisdom in deep learning states that increasing depth improves
expressiveness but complicates optimization. This paper suggests that, sometimes …

Adaptive gradient-based meta-learning methods

M Khodak, MFF Balcan… - Advances in Neural …, 2019‏ - proceedings.neurips.cc
We build a theoretical framework for designing and understanding practical meta-learning
methods that integrates sophisticated formalizations of task-similarity with the extensive …

Self-paced ARIMA for robust time series prediction

Y Li, K Wu, J Liu - Knowledge-Based Systems, 2023‏ - Elsevier
For time series prediction tasks, the autoregressive integrated moving average (ARIMA)
model is one of the most classical and popular linear models, and extended applications …

Introduction to online convex optimization

E Hazan - Foundations and Trends® in Optimization, 2016‏ - nowpublishers.com
This monograph portrays optimization as a process. In many practical applications the
environment is so complex that it is infeasible to lay out a comprehensive theoretical model …

[ספר][B] Machine learning: a Bayesian and optimization perspective

S Theodoridis - 2015‏ - books.google.com
This tutorial text gives a unifying perspective on machine learning by covering both
probabilistic and deterministic approaches-which are based on optimization techniques …