An online and unified algorithm for projection matrix vector multiplication with application to empirical risk minimization

L Qin, Z Song, L Zhang, D Zhuo - … Conference on Artificial …, 2023 - proceedings.mlr.press
Online matrix vector multiplication is a fundamental step and bottleneck in many machine
learning algorithms. It is defined as follows: given a matrix at the pre-processing phase, at …

Sketching for first order method: efficient algorithm for low-bandwidth channel and vulnerability

Z Song, Y Wang, Z Yu, L Zhang - … Conference on Machine …, 2023 - proceedings.mlr.press
Sketching is one of the most fundamental tools in large-scale machine learning. It enables
runtime and memory saving via randomly compressing the original large problem into lower …

Sketching meets differential privacy: fast algorithm for dynamic kronecker projection maintenance

Z Song, X Yang, Y Yang… - … Conference on Machine …, 2023 - proceedings.mlr.press
Projection maintenance is one of the core data structure tasks. Efficient data structures for
projection maintenance have led to recent breakthroughs in many convex programming …

Neuromorphic imaging with density-based spatiotemporal denoising

P Zhang, Z Ge, L Song, EY Lam - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
Bio-inspired neuromorphic cameras asynchronously record visual information of dynamic
scenes by discrete events. Due to the high sampling rate, they are capable of fast motion …

Is solving graph neural tangent kernel equivalent to training graph neural network?

L Qin, Z Song, B Sun - arxiv preprint arxiv:2309.07452, 2023 - arxiv.org
A rising trend in theoretical deep learning is to understand why deep learning works through
Neural Tangent Kernel (NTK)[jgh18], a kernel method that is equivalent to using gradient …

Dynamic tensor product regression

A Reddy, Z Song, L Zhang - Advances in Neural …, 2022 - proceedings.neurips.cc
In this work, we initiate the study of\emph {Dynamic Tensor Product Regression}. One has
matrices $ A_1\in\mathbb {R}^{n_1\times d_1},\ldots, A_q\in\mathbb {R}^{n_q\times d_q} …

Constrained density-based spatial clustering of applications with noise (DBSCAN) using hyperparameter optimization

J Kim, H Lee, YM Ko - Knowledge-Based Systems, 2024 - Elsevier
This article proposes a hyperparameter optimization method for density-based spatial
clustering of applications with noise (DBSCAN) with constraints, termed HC-DBSCAN. While …

Efficient sgd neural network training via sublinear activated neuron identification

L Qin, Z Song, Y Yang - 2024 IEEE International Conference on …, 2024 - ieeexplore.ieee.org
Deep learning has been widely used in many fields, but the model training process usually
consumes massive computational resources and time. Therefore, designing an efficient …

Federated empirical risk minimization via second-order method

S Bian, Z Song, J Yin - arxiv preprint arxiv:2305.17482, 2023 - arxiv.org
Many convex optimization problems with important applications in machine learning are
formulated as empirical risk minimization (ERM). There are several examples: linear and …

Optimal Dynamic Parameterized Subset Sampling

J Gan, SW Umboh, H Wang, A Wirth… - Proceedings of the ACM …, 2024 - dl.acm.org
In this paper, we study the Dynamic Parameterized Subset Sampling (DPSS) problem in the
Word RAM model. In DPSS, the input is a set, S, of n items, where each item, x, has a non …