Inference in artificial intelligence with deep optics and photonics

G Wetzstein, A Ozcan, S Gigan, S Fan, D Englund… - Nature, 2020 - nature.com
Artificial intelligence tasks across numerous applications require accelerators for fast and
low-power execution. Optical computing systems may be able to meet these domain-specific …

Single image depth estimation: An overview

A Mertan, DJ Duff, G Unal - Digital Signal Processing, 2022 - Elsevier
We review solutions to the problem of depth estimation, arguably the most important subtask
in scene understanding. We focus on the single image depth estimation problem. Due to its …

DeepSTORM3D: dense 3D localization microscopy and PSF design by deep learning

E Nehme, D Freedman, R Gordon, B Ferdman… - Nature …, 2020 - nature.com
An outstanding challenge in single-molecule localization microscopy is the accurate and
precise localization of individual point emitters in three dimensions in densely labeled …

Learned rotationally symmetric diffractive achromat for full-spectrum computational imaging

X Dun, H Ikoma, G Wetzstein, Z Wang, X Cheng… - Optica, 2020 - opg.optica.org
Diffractive achromats (DAs) promise ultra-thin and light-weight form factors for full-color
computational imaging systems. However, designing DAs with the optimal optical transfer …

[PDF][PDF] End-to-end complex lens design with differentiable ray tracing

Q Sun, C Wang, F Qiang, D **ong, H Wolfgang - ACM Trans. Graph, 2021 - vccimaging.org
Cameras are designed with a complicated tradeoff between image quality (eg sharpness,
contrast, color fidelity), and practical considerations such as cost, form factor, and weight …

Deep optics for monocular depth estimation and 3d object detection

J Chang, G Wetzstein - Proceedings of the IEEE/CVF …, 2019 - openaccess.thecvf.com
Depth estimation and 3D object detection are critical for scene understanding but remain
challenging to perform with a single image due to the loss of 3D information during image …

Deep optics for single-shot high-dynamic-range imaging

CA Metzler, H Ikoma, Y Peng… - Proceedings of the …, 2020 - openaccess.thecvf.com
Abstract High-dynamic-range (HDR) imaging is crucial for many applications. Yet, acquiring
HDR images with a single shot remains a challenging problem. Whereas modern deep …

Single-shot hyperspectral-depth imaging with learned diffractive optics

SH Baek, H Ikoma, DS Jeon, Y Li… - Proceedings of the …, 2021 - openaccess.thecvf.com
Imaging depth and spectrum have been extensively studied in isolation from each other for
decades. Recently, hyperspectral-depth (HS-D) imaging emerges to capture both …

Phasecam3d—learning phase masks for passive single view depth estimation

Y Wu, V Boominathan, H Chen… - 2019 IEEE …, 2019 - ieeexplore.ieee.org
There is an increasing need for passive 3D scanning in many applications that have
stringent energy constraints. In this paper, we present an approach for single frame, single …

Fringe projection profilometry by conducting deep learning from its digital twin

Y Zheng, S Wang, Q Li, B Li - Optics express, 2020 - opg.optica.org
High-accuracy and high-speed three-dimensional (3D) fringe projection profilometry (FPP)
has been widely applied in many fields. Recently, researchers discovered that deep …