TY - CHAP
T1 - Progress on event-based camera characterization techniques including pre-launch measurements of the Falcon ODIN space experiment
AU - McMahon-Crabtree, Peter N.
AU - Kulesza, Lucas
AU - Marcireau, Alexandre
AU - Theis, Zachry C.
AU - McHarg, Matthew G.
AU - McReynolds, Brian J.
AU - Balthazor, Richard L.
AU - Stauffer, Jake
AU - Cohen, Gregory
AU - Thewlis, Patrick A.
PY - 2024
Y1 - 2024
N2 - Event-based vision sensor (EVS) technology has expanded the CMOS image sensor design space of low-SWaP sensors with high-dynamic range operation and ability, under certain conditions, to efficiently capture scene information at a temporal resolution beyond that achievable by a typical sensor operating near a 1 kHz frame rate. Fundamental differences between EVS and framing sensors necessitate development of new characterization techniques and sensor models to evaluate hardware performance and the camera architecture trade-space. Laboratory characterization techniques reported previously include noise level as a function of static scene light level (background activity), contrast responses referred to as S-curves, refractory period characterization using the mean minimum interspike interval, and a novel approach to pixel bandwidth measurement using a static scene. Here we present pre-launch characterization results for the two Falcon ODIN (Optical Defense and Intelligence through Neuromorphics) event-based cameras (EBCs) scheduled for launch to the International Space Station (ISS). Falcon ODIN is a follow-on experiment to Falcon Neuro previously installed and operated onboard the ISS. Our characterization of the two ODIN EBCs includes high-dynamic range background activity, contrast response S-curves, and low-light cutoff measurements. Separately, we report evaluation of the IMX636 sensor functionality get_illumination which gives an auxiliary measurement of on-chip illuminance (irradiance) and can provide high dynamic range sensing of sky brightness (background light level).
AB - Event-based vision sensor (EVS) technology has expanded the CMOS image sensor design space of low-SWaP sensors with high-dynamic range operation and ability, under certain conditions, to efficiently capture scene information at a temporal resolution beyond that achievable by a typical sensor operating near a 1 kHz frame rate. Fundamental differences between EVS and framing sensors necessitate development of new characterization techniques and sensor models to evaluate hardware performance and the camera architecture trade-space. Laboratory characterization techniques reported previously include noise level as a function of static scene light level (background activity), contrast responses referred to as S-curves, refractory period characterization using the mean minimum interspike interval, and a novel approach to pixel bandwidth measurement using a static scene. Here we present pre-launch characterization results for the two Falcon ODIN (Optical Defense and Intelligence through Neuromorphics) event-based cameras (EBCs) scheduled for launch to the International Space Station (ISS). Falcon ODIN is a follow-on experiment to Falcon Neuro previously installed and operated onboard the ISS. Our characterization of the two ODIN EBCs includes high-dynamic range background activity, contrast response S-curves, and low-light cutoff measurements. Separately, we report evaluation of the IMX636 sensor functionality get_illumination which gives an auxiliary measurement of on-chip illuminance (irradiance) and can provide high dynamic range sensing of sky brightness (background light level).
KW - asynchronous imaging
KW - dynamic vision sensors
KW - Event-based cameras
KW - event-based vision sensors
KW - neuromorphic imaging
KW - sensor characterization
UR - http://www.scopus.com/inward/record.url?scp=85208609427&partnerID=8YFLogxK
U2 - 10.1117/12.3026253
DO - 10.1117/12.3026253
M3 - Chapter
AN - SCOPUS:85208609427
SN - 9781510679580
T3 - Proceedings of SPIE - The International Society for Optical Engineering
BT - Proceedings of SPIE: Unconventional Imaging, Sensing, and Adaptive Optics 2024
A2 - Dolne, Jean J.
A2 - Bose-Pillai, Santasri R.
A2 - Kalensky, Matthew
PB - SPIE
CY - U.S.
T2 - Unconventional Imaging, Sensing, and Adaptive Optics
Y2 - 19 August 2024 through 23 August 2024
ER -