Inference in artificial intelligence with deep optics and photonics

G Wetzstein, A Ozcan, S Gigan, S Fan, D Englund… - Nature, 2020 - nature.com
Artificial intelligence tasks across numerous applications require accelerators for fast and
low-power execution. Optical computing systems may be able to meet these domain-specific …

Single image depth estimation: An overview

A Mertan, DJ Duff, G Unal - Digital Signal Processing, 2022 - Elsevier
We review solutions to the problem of depth estimation, arguably the most important subtask
in scene understanding. We focus on the single image depth estimation problem. Due to its …

Monocular metasurface camera for passive single-shot 4D imaging

Z Shen, F Zhao, C **, S Wang, L Cao… - Nature …, 2023 - nature.com
It is a grand challenge for an imaging system to simultaneously obtain multi-dimensional
light field information, such as depth and polarization, of a scene for the accurate perception …

Deep learning techniques for inverse problems in imaging

G Ongie, A Jalal, CA Metzler… - IEEE Journal on …, 2020 - ieeexplore.ieee.org
Recent work in machine learning shows that deep neural networks can be used to solve a
wide variety of inverse problems arising in computational imaging. We explore the central …

DeepSTORM3D: dense 3D localization microscopy and PSF design by deep learning

E Nehme, D Freedman, R Gordon, B Ferdman… - Nature …, 2020 - nature.com
An outstanding challenge in single-molecule localization microscopy is the accurate and
precise localization of individual point emitters in three dimensions in densely labeled …

[PDF][PDF] End-to-end complex lens design with differentiable ray tracing

Q Sun, C Wang, F Qiang, D **ong, H Wolfgang - ACM Trans. Graph, 2021 - vccimaging.org
Cameras are designed with a complicated tradeoff between image quality (eg sharpness,
contrast, color fidelity), and practical considerations such as cost, form factor, and weight …

Deep optics for monocular depth estimation and 3d object detection

J Chang, G Wetzstein - Proceedings of the IEEE/CVF …, 2019 - openaccess.thecvf.com
Depth estimation and 3D object detection are critical for scene understanding but remain
challenging to perform with a single image due to the loss of 3D information during image …

In vivo lensless microscopy via a phase mask generating diffraction patterns with high-contrast contours

JK Adams, D Yan, J Wu, V Boominathan… - Nature Biomedical …, 2022 - nature.com
The simple and compact optics of lensless microscopes and the associated computational
algorithms allow for large fields of view and the refocusing of the captured images. However …

Deep optics for single-shot high-dynamic-range imaging

CA Metzler, H Ikoma, Y Peng… - Proceedings of the …, 2020 - openaccess.thecvf.com
Abstract High-dynamic-range (HDR) imaging is crucial for many applications. Yet, acquiring
HDR images with a single shot remains a challenging problem. Whereas modern deep …

Learned rotationally symmetric diffractive achromat for full-spectrum computational imaging

X Dun, H Ikoma, G Wetzstein, Z Wang, X Cheng… - Optica, 2020 - opg.optica.org
Diffractive achromats (DAs) promise ultra-thin and light-weight form factors for full-color
computational imaging systems. However, designing DAs with the optimal optical transfer …