Super-Resolution Time-Resolved Imaging Using Computational Sensor Fusion

Clara Callenberg, Ashley Lyons, Dennis den Brok, Areeba Fatima, Alejandro Turpin, Vytautas Zickus, Laura M. Machesky, Jamie A. Whitelaw, Daniele Faccio, Matthias B. Hullin
Scientific Reports (Nature Publishing Group) 11, 1689 (2021), https://doi.org/10.1038/s41598-021-81159-x, 2021.

Abstract

Imaging across both the full transverse spatial and temporal dimensions of a scene with high precision in all three coordinates is key to applications ranging from LIDAR to fluorescence lifetime imaging. However, compromises that sacrifice, for example, spatial resolution at the expense of temporal resolution are often required, in particular when the full 3-dimensional data cube is required in short acquisition times. We introduce a sensor fusion approach that combines data having low-spatial resolution but high temporal precision gathered with a single-photon-avalanche-diode (SPAD) array with data that has high spatial but no temporal resolution, such as that acquired with a standard CMOS camera. Our method, based on blurring the image on the SPAD array and computational sensor fusion, reconstructs time-resolved images at significantly higher spatial resolution than the SPAD input, upsampling numerical data by a factor 12×12, and demonstrating up to 4×4 upsampling of experimental data. We demonstrate the technique for both LIDAR applications and FLIM of fluorescent cancer cells. This technique paves the way to high spatial resolution SPAD imaging or, equivalently, FLIM imaging with conventional microscopes at frame rates accelerated by more than an order of magnitude.

ICCP 2020 Poster Presentation

Files

BibTeX Citation

@article{callenberg_super-resolution_2021, title = {Super-resolution time-resolved imaging using computational sensor fusion}, volume = {11}, issn = {2045-2322}, url = {https://doi.org/10.1038/s41598-021-81159-x}, doi = {10.1038/s41598-021-81159-x}, number = {1}, journal = {Scientific Reports}, author = {Callenberg, C. and Lyons, A. and Brok, D. den and Fatima, A. and Turpin, A. and Zickus, V. and Machesky, L. and Whitelaw, J. and Faccio, D. and Hullin, M. B.}, month = jan, year = {2021}, pages = {1689}, }