Next-generation deep learning based on simulators and synthetic data
Deep learning (DL) is being successfully applied across multiple domains, yet these models
learn in a most artificial way: they require large quantities of labeled data to grasp even …
learn in a most artificial way: they require large quantities of labeled data to grasp even …
Generative adversarial transformers
We introduce the GANsformer, a novel and efficient type of transformer, and explore it for the
task of visual generative modeling. The network employs a bipartite structure that enables …
task of visual generative modeling. The network employs a bipartite structure that enables …
Learning to segment from scribbles using multi-scale adversarial attention gates
Large, fine-grained image segmentation datasets, annotated at pixel-level, are difficult to
obtain, particularly in medical imaging, where annotations also require expert knowledge …
obtain, particularly in medical imaging, where annotations also require expert knowledge …
Compositional transformers for scene generation
We introduce the GANformer2 model, an iterative object-oriented transformer, explored for
the task of generative modeling. The network incorporates strong and explicit structural …
the task of generative modeling. The network incorporates strong and explicit structural …
Brain MRI high resolution image creation and segmentation with the new GAN method
Brain magnetic resonance imaging segmentation is a recent and still popular research area.
Good and accurate segmentation results play an important role in the diagnosis of cancer or …
Good and accurate segmentation results play an important role in the diagnosis of cancer or …
Learning to generate semantic layouts for higher text-image correspondence in text-to-image synthesis
Existing text-to-image generation approaches have set high standards for photorealism and
text-image correspondence, largely benefiting from web-scale text-image datasets, which …
text-image correspondence, largely benefiting from web-scale text-image datasets, which …
Few-shot semantic image synthesis with class affinity transfer
Semantic image synthesis aims to generate photo realistic images given a semantic
segmentation map. Despite much recent progress, training them still requires large datasets …
segmentation map. Despite much recent progress, training them still requires large datasets …
Controllable visual-tactile synthesis
Deep generative models have various content creation applications such as graphic design,
e-commerce, and virtual try-on. However, current works mainly focus on synthesizing …
e-commerce, and virtual try-on. However, current works mainly focus on synthesizing …
DiffuMatting: Synthesizing Arbitrary Objects with Matting-Level Annotation
Due to the difficulty and labor-consuming nature of getting highly accurate or matting
annotations, there only exists a limited amount of highly accurate labels available to the …
annotations, there only exists a limited amount of highly accurate labels available to the …
Co-synthesis of Histopathology Nuclei Image-Label Pairs using a Context-Conditioned Joint Diffusion Model
In multi-class histopathology nuclei analysis tasks, the lack of training data becomes a main
bottleneck for the performance of learning-based methods. To tackle this challenge …
bottleneck for the performance of learning-based methods. To tackle this challenge …