Neural sensors: Learning pixel exposures for HDR imaging and video compressive sensing with programmable sensors

JNP Martel, LK Mueller, SJ Carey… - IEEE transactions on …, 2020 - ieeexplore.ieee.org
Camera sensors rely on global or rolling shutter functions to expose an image. This fixed
function approach severely limits the sensors' ability to capture high-dynamic-range (HDR) …

In-Sensor Visual Perception and Inference

Y Liu, R Fan, J Guo, H Ni, MUM Bhutta - Intelligent Computing, 2023 - spj.science.org
Conventional machine vision systems have separate perception, memory, and processing
architectures, which may exacerbate the increasing need for ultrahigh image processing …

Learning spatially varying pixel exposures for motion deblurring

CM Nguyen, JNP Martel… - 2022 IEEE International …, 2022 - ieeexplore.ieee.org
Computationally removing the motion blur introduced by camera shake or object motion in a
captured image remains a challenging task in computational photography. Deblurring …

Pixelrnn: in-pixel recurrent neural networks for end-to-end-optimized perception with neural sensors

HM So, L Bose, P Dudek… - Proceedings of the IEEE …, 2024 - openaccess.thecvf.com
Conventional image sensors digitize high-resolution images at fast frame rates producing a
large amount of data that needs to be transmitted off the sensor for further processing. This is …

A spiking neural network model of depth from defocus for event-based neuromorphic vision

G Haessig, X Berthelon, SH Ieng, R Benosman - Scientific reports, 2019 - nature.com
Depth from defocus is an important mechanism that enables vision systems to perceive
depth. While machine vision has developed several algorithms to estimate depth from the …

Retrieving object motions from coded shutter snapshot in dark environment

K Dong, Y Guo, R Yang, Y Cheng… - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
Video object detection is a widely studied topic and has made significant progress in the
past decades. However, the feature extraction and calculations in existing video object …

Real-time depth from focus on a programmable focal plane processor

JNP Martel, LK Müller, SJ Carey… - … on Circuits and …, 2017 - ieeexplore.ieee.org
Visual input can be used to recover the 3-D structure of a scene by estimating distances
(depth) to the observer. Depth estimation is performed in various applications, such as …

SoDaCam: Software-defined Cameras via Single-Photon Imaging

V Sundar, A Ardelean, T Swedish… - Proceedings of the …, 2023 - openaccess.thecvf.com
Reinterpretable cameras are defined by their post-processing capabilities that exceed
traditional imaging. We present" SoDaCam" that provides reinterpretable cameras at the …

[PDF][PDF] Optimising convolutional neural networks for super fast inference on focal-plane sensor-processor arrays

B Guillard - 2019 - imperial.ac.uk
Abstract Convolutional Neural Networks (CNNs) have revolutionised the Computer Vision
discipline in the last few years. CNNs now are state of the art methods to solve almost all …

In-Sensor Visual Devices for Perception and Inference

Y Liu, H Ni, C Yuwen, X Yang, Y Ming, H Zhong… - Autonomous Driving …, 2023 - Springer
The traditional machine vision systems use separate architectures for perception, memory,
and processing. This approach may hinder the growing demand for high image processing …