Tool learning with foundation models

Y Qin, S Hu, Y Lin, W Chen, N Ding, G Cui… - ACM Computing …, 2024 - dl.acm.org
Humans possess an extraordinary ability to create and utilize tools. With the advent of
foundation models, artificial intelligence systems have the potential to be equally adept in …

Clip in medical imaging: A comprehensive survey

Z Zhao, Y Liu, H Wu, M Wang, Y Li, S Wang… - arxiv preprint arxiv …, 2023 - arxiv.org
Contrastive Language-Image Pre-training (CLIP), a simple yet effective pre-training
paradigm, successfully introduces text supervision to vision models. It has shown promising …

Interventional bag multi-instance learning on whole-slide pathological images

T Lin, Z Yu, H Hu, Y Xu… - Proceedings of the IEEE …, 2023 - openaccess.thecvf.com
Multi-instance learning (MIL) is an effective paradigm for whole-slide pathological images
(WSIs) classification to handle the gigapixel resolution and slide-level label. Prevailing MIL …

From sam to cams: Exploring segment anything model for weakly supervised semantic segmentation

H Kweon, KJ Yoon - … of the IEEE/CVF Conference on …, 2024 - openaccess.thecvf.com
Abstract Weakly Supervised Semantic Segmentation (WSSS) aims to learn the concept of
segmentation using image-level class labels. Recent WSSS works have shown promising …

Padclip: Pseudo-labeling with adaptive debiasing in clip for unsupervised domain adaptation

Z Lai, N Vesdapunt, N Zhou, J Wu… - Proceedings of the …, 2023 - openaccess.thecvf.com
Abstract Traditional Unsupervised Domain Adaptation (UDA) leverages the labeled source
domain to tackle the learning tasks on the unlabeled target domain. It can be more …

Causal knowledge fusion for 3D cross-modality cardiac image segmentation

S Guo, X Liu, H Zhang, Q Lin, L Xu, C Shi, Z Gao… - Information …, 2023 - Elsevier
Abstract Three-dimensional (3D) cross-modality cardiac image segmentation is critical for
cardiac disease diagnosis and treatment. However, it confronts the challenge of modality …

Generative prompt model for weakly supervised object localization

Y Zhao, Q Ye, W Wu, C Shen… - Proceedings of the IEEE …, 2023 - openaccess.thecvf.com
Weakly supervised object localization (WSOL) remains challenging when learning object
localization models from image category labels. Conventional methods that discriminatively …

Weakly-semi supervised extraction of rooftop photovoltaics from high-resolution images based on segment anything model and class activation map

R Yang, G He, R Yin, G Wang, Z Zhang, T Long… - Applied Energy, 2024 - Elsevier
Accurate extraction of rooftop photovoltaic from high-resolution remote sensing imagery is
pivotal for propelling green energy planning and development. Conventional deep learning …

Label-efficient deep learning in medical image analysis: Challenges and future directions

C **, Z Guo, Y Lin, L Luo, H Chen - arxiv preprint arxiv:2303.12484, 2023 - arxiv.org
Deep learning has seen rapid growth in recent years and achieved state-of-the-art
performance in a wide range of applications. However, training models typically requires …

Fedlppa: learning personalized prompt and aggregation for federated weakly-supervised medical image segmentation

L Lin, Y Liu, J Wu, P Cheng, Z Cai… - … on Medical Imaging, 2024 - ieeexplore.ieee.org
Federated learning (FL) effectively mitigates the data silo challenge brought about by
policies and privacy concerns, implicitly harnessing more data for deep model training …