Sponsor
This research was partially funded by an NSF CAREER Award 1943149 (M.G.), Wisconsin Alumni Research Foundation (M.G.), U.S. Department of Energy grant DOE-SC0019013 (K.W.E.), NIH U54CA268069 (K.W.E.), RRF Walter H. Helmerich Research Chair (KWE) and an NSF ERI Award 2138471 (A.I.).
Published In
Nature Communications
Document Type
Article
Publication Date
5-2023
Subjects
Single-Photon Imaging
Abstract
Image sensors capable of capturing individual photons have made tremendous progress in recent years. However, this technology faces a major limitation. Because they capture scene information at the individual photon level, the raw data is sparse and noisy. Here we propose CASPI: Collaborative Photon Processing for Active Single-Photon Imaging, a technology-agnostic, application-agnostic, and training-free photon processing pipeline for emerging high-resolution single-photon cameras. By collaboratively exploiting both local and non-local correlations in the spatio-temporal photon data cubes, CASPI estimates scene properties reliably even under very challenging lighting conditions. We demonstrate the versatility of CASPI with two applications: LiDAR imaging over a wide range of photon flux levels, from a sub-photon to high ambient regimes, and live-cell autofluorescence FLIM in low photon count regimes. We envision CASPI as a basic building block of general-purpose photon processing units that will be implemented on-chip in future single-photon cameras.
Rights
Copyright (c) 2023 The Authors
This work is licensed under a Creative Commons Attribution 4.0 International License.
Locate the Document
DOI
10.1038/s41467-023-38893-9
Persistent Identifier
https://archives.pdx.edu/ds/psu/40180
Citation Details
Lee, J., Ingle, A., Chacko, J. V., Eliceiri, K. W., & Gupta, M. (2023). CASPI: collaborative photon processing for active single-photon imaging. Nature Communications, 14(1), 3158.