Sampling from Gaussian process posteriors using stochastic gradient descent

JA Lin, J Antorán, S Padhy, D Janz… - Advances in …, 2023 - proceedings.neurips.cc
Gaussian processes are a powerful framework for quantifying uncertainty and for sequential
decision-making but are limited by the requirement of solving linear systems. In general, this …

The internet of federated things (ioft)

R Kontar, N Shi, X Yue, S Chung, E Byon… - IEEE …, 2021 - ieeexplore.ieee.org
The Internet of Things (IoT) is on the verge of a major paradigm shift. In the IoT system of the
future, IoFT, the “cloud” will be substituted by the “crowd” where model training is brought to …

Appropriate learning rates of adaptive learning rate optimization algorithms for training deep neural networks

H Iiduka - IEEE Transactions on Cybernetics, 2021 - ieeexplore.ieee.org
This article deals with nonconvex stochastic optimization problems in deep learning.
Appropriate learning rates, based on theory, for adaptive-learning-rate optimization …

Global convergence and stability of stochastic gradient descent

V Patel, S Zhang, B Tian - Advances in Neural Information …, 2022 - proceedings.neurips.cc
In machine learning, stochastic gradient descent (SGD) is widely deployed to train models
using highly non-convex objectives with equally complex noise models. Unfortunately, SGD …

Integrating random effects in deep neural networks

G Simchoni, S Rosset - Journal of Machine Learning Research, 2023 - jmlr.org
Modern approaches to supervised learning like deep neural networks (DNNs) typically
implicitly assume that observed responses are statistically independent. In contrast …

Improving linear system solvers for hyperparameter optimisation in iterative Gaussian processes

JA Lin, S Padhy, B Mlodozeniec… - Advances in …, 2025 - proceedings.neurips.cc
Scaling hyperparameter optimisation to very large datasets remains an open problem in the
Gaussian process community. This paper focuses on iterative methods, which use linear …

Federated multi-output gaussian processes

S Chung, R Al Kontar - Technometrics, 2024 - Taylor & Francis
Multi-output Gaussian process (MGP) regression plays an important role in the integrative
analysis of different but interrelated systems/units. Existing MGP approaches assume that …

Using random effects to account for high-cardinality categorical features and repeated measures in deep neural networks

G Simchoni, S Rosset - Advances in Neural Information …, 2021 - proceedings.neurips.cc
High-cardinality categorical features are a major challenge for machine learning methods in
general and for deep learning in particular. Existing solutions such as one-hot encoding and …

Hierarchical active learning for defect localization in 3d systems

J **e, B Yao - IISE Transactions on Healthcare Systems …, 2024 - Taylor & Francis
Aim: Advanced sensing and imaging is capable to retrieve rich information of complex
systems, which can be integrated with underlying physics to develop a personalized …

Scalable Gaussian-process regression and variable selection using Vecchia approximations

J Cao, J Guinness, MG Genton, M Katzfuss - Journal of machine learning …, 2022 - jmlr.org
Gaussian process (GP) regression is a flexible, nonparametric approach to regression that
naturally quantifies uncertainty. In many applications, the number of responses and …