Imperative learning: A self-supervised neural-symbolic learning framework for robot autonomy
Data-driven methods such as reinforcement and imitation learning have achieved
remarkable success in robot autonomy. However, their data-centric nature still hinders them …
remarkable success in robot autonomy. However, their data-centric nature still hinders them …
A fault diagnosis framework using unlabeled data based on automatic clustering with meta-learning
With the growth of the industrial internet of things, the poor performance of conventional
deep learning models hinders the application of intelligent diagnosis methods in industrial …
deep learning models hinders the application of intelligent diagnosis methods in industrial …
Rethinking meta-learning from a learning lens
Meta-learning has emerged as a powerful approach for leveraging knowledge from previous
tasks to solve new tasks. The mainstream methods focus on training a well-generalized …
tasks to solve new tasks. The mainstream methods focus on training a well-generalized …
What is Your Data Worth to GPT? LLM-Scale Data Valuation with Influence Functions
Large language models (LLMs) are trained on a vast amount of human-written data, but data
providers often remain uncredited. In response to this issue, data valuation (or data …
providers often remain uncredited. In response to this issue, data valuation (or data …
Efficient bilevel source mask optimization
Resolution Enhancement Techniques (RETs) are critical to meet the demands of advanced
technology nodes. Among RETs, Source Mask Optimization (SMO) is pivotal, concurrently …
technology nodes. Among RETs, Source Mask Optimization (SMO) is pivotal, concurrently …
Glocal Hypergradient Estimation with Koopman Operator
Gradient-based hyperparameter optimization methods update hyperparameters using
hypergradients, gradients of a meta criterion with respect to hyperparameters. Previous …
hypergradients, gradients of a meta criterion with respect to hyperparameters. Previous …
Cross-Modal Meta Consensus for Heterogeneous Federated Learning
In the evolving landscape of federated learning (FL), the integration of multimodal data
presents both unprecedented opportunities and significant challenges. Existing works fall …
presents both unprecedented opportunities and significant challenges. Existing works fall …
F-FOMAML: GNN-Enhanced Meta-Learning for Peak Period Demand Forecasting with Proxy Data
Demand prediction is a crucial task for e-commerce and physical retail businesses,
especially during high-stake sales events. However, the limited availability of historical data …
especially during high-stake sales events. However, the limited availability of historical data …
Memory-Efficient Gradient Unrolling for Large-Scale Bi-level Optimization
Bi-level optimization (BO) has become a fundamental mathematical framework for
addressing hierarchical machine learning problems. As deep learning models continue to …
addressing hierarchical machine learning problems. As deep learning models continue to …
Downstream Task Guided Masking Learning in Masked Autoencoders Using Multi-Level Optimization
Masked Autoencoder (MAE) is a notable method for self-supervised pretraining in visual
representation learning. It operates by randomly masking image patches and reconstructing …
representation learning. It operates by randomly masking image patches and reconstructing …