Image Noise and Noise Images in Computer Vision, Photography and Embedded Vision

What is Image Noise?

Image Noise is the variation in signal  from the ground trust, from pixel to pixel or frame to frame.

How Does A Noisy Image Impact Human Viewing and Computer Vision?

Noise is commonly thought of as Salt-and-Pepper noise. In a still image, one may say the image appears to be "Too Grainy"

In this sailboat example, researchers show that the confidence of class recognition drops rapidly  multi-pixel / spatial noise is present in an image.

Motion Blur and Computer Visiona Exposure Value

Dodge et al. "Understanding How Image Quality Affects Deep Neural Networks"  

What Types of Noise Exist in Cameras?

There are numerous types of noise in cameras. There are two main categories:

  • Single pixel noise can be thought of as temporal or random. Single Pixel noise is a variation in signal (or pixel value) from frame to frame. 
  • Multi-pixel noise can be thought of as spatial or fixed pattern noise, with variation from pixel to pixel in a single frame. 

The specific types of noise in a camera system are:

  • Readout Noise
  • Photon Shot Noise
  • Fixed Pattern Noise
  • Reset Noise

What About Denoising?

Denoising can be applied to mitigate noise. The approach is different for each of the two categories of noise.

Many multi-pixel (Spatial) denoising algorithms use a frequency filter to reduce the variation in pixel intensity. This filter also filters out information included in the image.

Hasinoff, et. al. "Burst Photography for high dynamic range and low light cameras"

Denoising (Spatial) Creates Texture Blur and Loss 

Localized denoisingcreates texture loss, which is particularly visible with mobile phone cameras.

This texture loss is noticeable to the human visual system when zooming in on the image.

For computer vision, the impact can be even more noticeable depending on your filter size.

This example by Chen et al shows a brick wall building and the output from an edge detection network before and after filtering. The high frequency noise filter greatly reduces the texture in the image, particularly in regions where color is constant.

Chen, S.-C.; Chiu, C.-C. Texture Construction Edge Detection Algorithm. Appl. Sci. 2019, 9, 897. https://doi.org/10.3390/app9050897

References and Related Links

Dodge et al. "Understanding How Image Quality Affects Deep Neural Networks" 

Stanford EE 392B lecture notes

View Other Image Quality and Computer Vision Topics

Trying to Determine Your Camera Requirements? 

Use our free web-based AoV Calculator to determine your system's Field of View Requirements. Then, use the M12 Lens calculator to match your requirements with the available lenses. Our Depth of Field Calculator also provides the hyperfocal distance and depth of field for every sensor and lens combination.

Camera Module Angle of View Calculator. Camera AoV Calculator.
Basler Camera Depth of Field Calculator. DoF Calculator.

We also have a couple of other calculators that many engineers find interesting.

Jetson Nano Mipi Camera Lens Focal Length Calculator. EFL Calculator.
Raspberry Pi HQ FoV Calculator for Vision System Cameras
Lens Focal Length Calculator. EFL Calculator.
Camera Angle of View Calculator. Camera AoV Calculator.
Camera Depth of Field Calculator. DoF Calculator.
An FoV Calculator for Vision System Cameras

Here are a Few M12 Lenses. Search all 50+ Using Our M12 Lens Calculator

185°@7.8mm Fisheye M12 Lens

CIL227-F2.5-M12B660

185°@7.8mm Fisheye M12 Lens

No Distortion 3.2mm Lens

CIL034-F2.3-M12A660

No Distortion 3.2mm Lens

No Distortion 6mm M12 Lens

CIL062-F2.8-M12A650

No Distortion 6mm M12 Lens

Low Distortion 8mm M12 Lens

CIL083-F2.8-M12A650

Low Distortion 8mm M12 Lens

190°@5.7mm Fisheye M12 Lens

CIL290-F2.2-M12A660

190°@5.7mm Fisheye M12 Lens

We Also have Cost Effective 12MP+ C-Mount Lenses for Machine Vision and Factory Automation.

180°@14.2mm C-Mount Fisheye Lens

CIL505-F2.2-CMANIR

180°@14.2mm C-Mount Fisheye Lens

8mm C-Mount Lens 1.1" 12MP

CIL508-F2.4-CMANIR

8mm C-Mount Lens 1.1" 12MP

12mm C-Mount Lens 1.1" 12MP

CIL512-F2.8-CMANIR

12mm C-Mount Lens 1.1" 12MP

16mm C-Mount Lens 1.1" 12MP

CIL513-F2.8-CMANIR

16mm C-Mount Lens 1.1" 12MP

25mm C-Mount Lens 1.1" 12MP

CIL514-F2.8-CMANIR

25mm C-Mount Lens 1.1" 12MP
Wide Angle Fisheye Lens for S Mount. Entaniya Raspberry Pi RP-L100
Wide Angle Fisheye Lens for S Mount. Entaniya Raspberry Pi RP-L100
Fisheye Wide Angle M12 Lens Entaniya RP-L100 DesignSpark
Board Mount Lens Wide Angle Fisheye Entaniya RP-L100
CIL227-F2.5-M12B660
185°@7.8mm Fisheye M12 Lens
$39.00
Basler Dart Camera IP67 M12 Lens
Basler Dart Camera IP67 M12 Lens
Ace Camera Pylon Camera IP67 M12 Lens
FLIR Camera S-Mount Lens M12 Lens
CIL034-F2.3-M12A660
No Distortion 3.2mm Lens
$39.00
6mm M12 Lens
6mm M12 Lens
Raspberry Pi 6mm Lens
6mm S-Mount Lens
CIL062-F2.8-M12A650
No Distortion 6mm M12 Lens
$29.00
Raspberry Pi HQ Camera 8mm M12 Lens
Raspberry Pi HQ Camera 8mm M12 Lens
8mm M12 Lenses IMX464
8mm M12 Lens Raspberry Pi High Quality
CIL083-F2.8-M12A650
Low Distortion 8mm M12 Lens
$29.00
190°@5.7mm Fisheye M12 Lens
190°@5.7mm Fisheye M12 Lens
190°@5.7mm Fisheye M12 Lens
190°@5.7mm Fisheye M12 Lens
CIL290-F2.2-M12A660
190°@5.7mm Fisheye M12 Lens
$29.00
Wide Angle Waterproof M12 Lens
Wide Angle Waterproof M12 Lens
IMX678 sturdEcam genicam GMSL lens
Stereocam
CIL341-F2.0-M12A650
Wide-Angle 4mm M12 Lens
$79.00