Shutter Speed: HDR and Low Light
Shutter speed (pixel integration time) is a critical factor when defining the required low-light capability of a sensor and lens combination for a robotics camera. The primary tradeoffs to weigh when selecting shutter speed are motion blur and temporal noise in the image:
- Motion blur acts as a directional low-pass filter: image contrast falls as the smear lengthens, and the smear is roughly object speed multiplied by integration time and magnification. It cannot be removed after capture by traditional imaging methods except by shortening the exposure, adding illumination, or strobing the light source, though photographers use it deliberately for long-exposure work with tripods and neutral density filters. For robotic systems, learned deblurring networks can estimate the original scene, but they require large amounts of stationary ground-truth data from the same camera and ISP configuration. Integration blur is also distinct from rolling-shutter skew, which distorts moving objects because rows are read out at different times; a global-shutter sensor or a synchronized strobe addresses the readout side.
- Temporal noise is frame-to-frame variance in a single pixel's output, visible as white speckle or moderate gray-level flicker. It comes from photon shot noise plus the semiconductor readout chain: pixel architecture, analog-to-digital conversion, and process technology. Many sensor manufacturers compress this behavior into a single dynamic range value specified at room temperature. Human vision is noise-limited too, by photon statistics and neural processing, especially in low light; the visual system's temporal integration and processing simply hide much of it from perception.
For robotics, shutter speed highlights one of the major disconnects in the industry as hardware and software engineers make subjective best-guess selections. Noise from high digital gain can be catastrophic to the accuracy of single-frame detection algorithms: gain amplifies read-noise-referred signal along with the scene, and aggressive denoising trades that noise for lost texture and lower accuracy.
For consumers, shutter speed (1/30s to 1/1000s) is typically much shorter than human visual reaction time (roughly 1/4s), so the gap between capture and awareness goes unnoticed. The most interested daily user can see shutter timing directly on a cellphone by switching between HDR and standard mode. Every phone configures the interaction slightly differently, and some represent the actual time slice of the HDR multi-exposure integration better than others. In HDR mode, notice that the click is slightly delayed relative to standard mode; phone manufacturers tune this timing carefully during production.