Sketch-guided text-to-image diffusion models

A Voynov, K Aberman, D Cohen-Or - ACM SIGGRAPH 2023 Conference …, 2023 - dl.acm.org
Text-to-Image models have introduced a remarkable leap in the evolution of machine
learning, demonstrating high-quality synthesis of images from a given text-prompt. However …

What can human sketches do for object detection?

PN Chowdhury, AK Bhunia, A Sain… - Proceedings of the …, 2023 - openaccess.thecvf.com
Sketches are highly expressive, inherently capturing subjective and fine-grained visual
cues. The exploration of such innate properties of human sketches has, however, been …

Picture that sketch: Photorealistic image generation from abstract sketches

S Koley, AK Bhunia, A Sain… - Proceedings of the …, 2023 - openaccess.thecvf.com
Given an abstract, deformed, ordinary sketch from untrained amateurs like you and me, this
paper turns it into a photorealistic image-just like those shown in Fig. 1 (a), all non-cherry …

You'll Never Walk Alone: A Sketch and Text Duet for Fine-Grained Image Retrieval

S Koley, AK Bhunia, A Sain… - Proceedings of the …, 2024 - openaccess.thecvf.com
Two primary input modalities prevail in image retrieval: sketch and text. While text is widely
used for inter-category retrieval tasks sketches have been established as the sole preferred …

It's All About Your Sketch: Democratising Sketch Control in Diffusion Models

S Koley, AK Bhunia, D Sekhri, A Sain… - Proceedings of the …, 2024 - openaccess.thecvf.com
This paper unravels the potential of sketches for diffusion models addressing the deceptive
promise of direct sketch control in generative AI. We importantly democratise the process …

Masksketch: Unpaired structure-guided masked image generation

D Bashkirova, J Lezama, K Sohn… - Proceedings of the …, 2023 - openaccess.thecvf.com
Recent conditional image generation methods produce images of remarkable diversity,
fidelity and realism. However, the majority of these methods allow conditioning only on …

Modulating pretrained diffusion models for multimodal image synthesis

C Ham, J Hays, J Lu, KK Singh, Z Zhang… - ACM SIGGRAPH 2023 …, 2023 - dl.acm.org
We present multimodal conditioning modules (MCM) for enabling conditional image
synthesis using pretrained diffusion models. Previous multimodal synthesis works rely on …

Self-driven dual-path learning for reference-based line art colorization under limited data

S Wu, X Yan, W Liu, S Xu… - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
Synthesizing color images based on line arts while considering the styles of reference
photos is a flexible form of artistic creation that has recently attracted public attention …

Elliptical4vr: An interactive exergame authoring tool for personalized elliptical workout experience in vr

W Li - Proceedings of the 2023 5th International Conference …, 2023 - dl.acm.org
In this paper, we propose Elliptical4VR, an interactive exergame authoring tool that
synthesizes virtual environments and training programs for personalized elliptical workout …

From concept to space: a new perspective on AIGC-involved attribute translation

K Cheng, P Neisch, T Cui - Digital Creativity, 2023 - Taylor & Francis
Drawn inspiration from phenomenal attributes and translating them into heuristic model tools
is one of the effective means to promote architectural form innovation. However, over …