Clip for all things zero-shot sketch-based image retrieval, fine-grained or not

A Sain, AK Bhunia, PN Chowdhury… - Proceedings of the …, 2023‏ - openaccess.thecvf.com
In this paper, we leverage CLIP for zero-shot sketch based image retrieval (ZS-SBIR). We
are largely inspired by recent advances on foundation models and the unparalleled …

It's All About Your Sketch: Democratising Sketch Control in Diffusion Models

S Koley, AK Bhunia, D Sekhri, A Sain… - Proceedings of the …, 2024‏ - openaccess.thecvf.com
This paper unravels the potential of sketches for diffusion models addressing the deceptive
promise of direct sketch control in generative AI. We importantly democratise the process …

Picture that sketch: Photorealistic image generation from abstract sketches

S Koley, AK Bhunia, A Sain… - Proceedings of the …, 2023‏ - openaccess.thecvf.com
Given an abstract, deformed, ordinary sketch from untrained amateurs like you and me, this
paper turns it into a photorealistic image-just like those shown in Fig. 1 (a), all non-cherry …

How to handle sketch-abstraction in sketch-based image retrieval?

S Koley, AK Bhunia, A Sain… - Proceedings of the …, 2024‏ - openaccess.thecvf.com
In this paper we propose a novel abstraction-aware sketch-based image retrieval framework
capable of handling sketch abstraction at varied levels. Prior works had mainly focused on …

What can human sketches do for object detection?

PN Chowdhury, AK Bhunia, A Sain… - Proceedings of the …, 2023‏ - openaccess.thecvf.com
Sketches are highly expressive, inherently capturing subjective and fine-grained visual
cues. The exploration of such innate properties of human sketches has, however, been …

Stylemeup: Towards style-agnostic sketch-based image retrieval

A Sain, AK Bhunia, Y Yang, T **ang… - Proceedings of the …, 2021‏ - openaccess.thecvf.com
Sketch-based image retrieval (SBIR) is a cross-modal matching problem which is typically
solved by learning a joint embedding space where the semantic content shared between …

Text-to-image diffusion models are great sketch-photo matchmakers

S Koley, AK Bhunia, A Sain… - Proceedings of the …, 2024‏ - openaccess.thecvf.com
This paper for the first time explores text-to-image diffusion models for Zero-Shot Sketch-
based Image Retrieval (ZS-SBIR). We highlight a pivotal discovery: the capacity of text-to …

Sketching without worrying: Noise-tolerant sketch-based image retrieval

AK Bhunia, S Koley, AFUR Khilji… - Proceedings of the …, 2022‏ - openaccess.thecvf.com
Sketching enables many exciting applications, notably, image retrieval. The fear-to-sketch
problem (ie," I can't sketch") has however proven to be fatal for its widespread adoption. This …

Sketchtrans: Disentangled prototype learning with transformer for sketch-photo recognition

C Chen, M Ye, M Qi, B Du - IEEE Transactions on Pattern …, 2023‏ - ieeexplore.ieee.org
Matching hand-drawn sketches with photos (aka sketch-photo recognition or re-
identification) faces the information asymmetry challenge due to the abstract nature of the …

Exploiting unlabelled photos for stronger fine-grained SBIR

A Sain, AK Bhunia, S Koley… - Proceedings of the …, 2023‏ - openaccess.thecvf.com
This paper advances the fine-grained sketch-based image retrieval (FG-SBIR) literature by
putting forward a strong baseline that overshoots prior state-of-the art by 11%. This is not via …