Next-generation deep learning based on simulators and synthetic data

CM De Melo, A Torralba, L Guibas, J DiCarlo… - Trends in cognitive …, 2022 - cell.com
Deep learning (DL) is being successfully applied across multiple domains, yet these models
learn in a most artificial way: they require large quantities of labeled data to grasp even …

Generative adversarial transformers

DA Hudson, L Zitnick - International conference on machine …, 2021 - proceedings.mlr.press
We introduce the GANsformer, a novel and efficient type of transformer, and explore it for the
task of visual generative modeling. The network employs a bipartite structure that enables …

Learning to segment from scribbles using multi-scale adversarial attention gates

G Valvano, A Leo, SA Tsaftaris - IEEE Transactions on Medical …, 2021 - ieeexplore.ieee.org
Large, fine-grained image segmentation datasets, annotated at pixel-level, are difficult to
obtain, particularly in medical imaging, where annotations also require expert knowledge …

Compositional transformers for scene generation

D Arad Hudson, L Zitnick - Advances in neural information …, 2021 - proceedings.neurips.cc
We introduce the GANformer2 model, an iterative object-oriented transformer, explored for
the task of generative modeling. The network incorporates strong and explicit structural …

Brain MRI high resolution image creation and segmentation with the new GAN method

SA Güven, MF Talu - Biomedical Signal Processing and Control, 2023 - Elsevier
Brain magnetic resonance imaging segmentation is a recent and still popular research area.
Good and accurate segmentation results play an important role in the diagnosis of cancer or …

Learning to generate semantic layouts for higher text-image correspondence in text-to-image synthesis

M Park, J Yun, S Choi, J Choo - Proceedings of the IEEE …, 2023 - openaccess.thecvf.com
Existing text-to-image generation approaches have set high standards for photorealism and
text-image correspondence, largely benefiting from web-scale text-image datasets, which …

Few-shot semantic image synthesis with class affinity transfer

M Careil, J Verbeek… - Proceedings of the IEEE …, 2023 - openaccess.thecvf.com
Semantic image synthesis aims to generate photo realistic images given a semantic
segmentation map. Despite much recent progress, training them still requires large datasets …

Controllable visual-tactile synthesis

R Gao, W Yuan, JY Zhu - Proceedings of the IEEE/CVF …, 2023 - openaccess.thecvf.com
Deep generative models have various content creation applications such as graphic design,
e-commerce, and virtual try-on. However, current works mainly focus on synthesizing …

DiffuMatting: Synthesizing Arbitrary Objects with Matting-Level Annotation

X Hu, X Peng, D Luo, X Ji, J Peng, Z Jiang… - … on Computer Vision, 2024 - Springer
Due to the difficulty and labor-consuming nature of getting highly accurate or matting
annotations, there only exists a limited amount of highly accurate labels available to the …

Co-synthesis of Histopathology Nuclei Image-Label Pairs using a Context-Conditioned Joint Diffusion Model

S Min, HJ Oh, WK Jeong - European Conference on Computer Vision, 2024 - Springer
In multi-class histopathology nuclei analysis tasks, the lack of training data becomes a main
bottleneck for the performance of learning-based methods. To tackle this challenge …