Main visual of Multispectral Image Sensor
products
Image Sensor for Industrial Use

Multispectral Image Sensor

Image sensors that can capture multiple wavelengths of light simultaneously, from visible light to near-infrared light

Overview

Sony's multispectral image sensor has a multispectral filter formed on the photodiode of each pixel, making it possible to capture multiple wavelengths of light simultaneously, from visible light to near-infrared light. Because these sensors can capture the composition of different substances as well as subtle color differences that are imperceptible to the human eye, they can be used in applications like material sorting, contaminant detection inspection, and quality management.

Features

Image sensors equipped with multispectral filters

Normal color image sensors have three types of color filters on the photodiode of each pixel - red, green, and blue - but Sony’s IMX454 multispectral image sensors have 8 types of filters on the photodiodes to take in light from different wavelengths. Typical multispectral cameras have a built-in spectral element, such as a prism or diffraction grating. They function by scanning a subject or camera at a constant speed to take pictures, which limits the types of scenes that can be photographed. With the IMX454, users can capture 2D images in one shot, just like with a normal camera. This means it can be used in many kinds of scenarios.

Conceptual diagram of the IMX454 pixel structure

Image data of 41 wavelengths can be captured in just one shot

By combining the IMX454, which has a multispectral filter, with Sony's specially designed signal processing software, image data of 41 wavelengths (from 450 nm to 850 nm, in 10 nm intervals) obtained from 8 types of filters can be captured in just one shot. This makes it possible to capture more specific information at a high resolution, providing more wavelength choices across the visible light and near-infrared spectrums and opening the door to a variety of applications.

Conceptual diagram of images from different wavelengths
Zoom Zoom
Conceptual diagram of images from different wavelengths

Providing the wide variety of functions that multispectral cameras require

Multispectral cameras have a less established history than color or monochrome cameras, and there is still something to be desired in terms of the necessary environment for their development and introduction. Given this, Sony made advance arrangements for the functions that the development and introduction of the IMX454 requires, and provided a software program that includes all of them.

- Optimized standard camera functions for multispectral applications

Defect correction, noise reduction, AE (Auto Exposure) control functions, and other essential, standard camera functions that are generally supported for color or monochrome image sensors have been optimized for multispectral image sensors. This has facilitated the efficient development of multispectral cameras.

- Semantic segmentation function

Semantic segmentation is an image recognition method that uses machine learning to label each pixel within the image data to divide the regions more precisely. Performing segmentation using the wavelength information for each pixel makes it possible to identify the material composition of a subject quickly and reliably, regardless of its form and even if the color looks the same to the human eye. This enables differentiation of materials by color and estimation of the area or volume of individual materials.

- Color image generation function

In some cases, users may need to synthesize a color image from identification results based on a multispectral image, or they may require a color image to combine with existing software designed for color images. To address these needs, Sony has built a color image generation function that creates color images that are easy to comprehend visually, based on image data from multiple different wavelengths. This function makes it possible to obtain images with natural-feeling color, without setting up a separate camera.

Product Lineup

PDF Model Name Image size Effective pixels
IMX454LXR PDF IMX454LXR-C Diagonal 6.46 mm (Type 1/2.8) Approx. 2.13 megapixels

Specifications

Model Name IMX454LXR-C
Image size Diagonal 6.46 mm (Type 1/2.8)
Effective pixels 1945 (H) × 1097 (V)
Approx. 2.13 megapixels
Unit cell size 2.9 μm (H) × 2.9 μm (V)
Optical blacks Horizontal Front 0 pixels, rear 0 pixels
Vertical Front 10 pixels, rear 0 pixels
Frame rate (Max.)
All-pixel readout mode
10bit 120 frame/s
12bit 60 frame/s
Input drive frequency 37.125 MHz / 74.25 MHz
Supply voltage Analog 2.9 V
Digital 1.2 V
Interface 1.8 V
Shutter mode Rolling shutter
Output interface sub LVDS Serial(2 ch / 4 ch / 8 ch)
MIPI(2 lane / 4 lane)
Package 114-pin LGA
12.0 mm (H) × 9.3 mm (V)
PDF PDF IMX454 product overview

An example of IMX454 relative spectral sensitivity characteristics after signal processing
(displaying 7 out of 41 wavelengths)

An example of IMX454 relative spectral sensitivity characteristics after signal processing

*This data has undergone signal processing in the software that comes with the sensor.
 Data may vary depending on the conditions and environment.

Technology

Multispectral Image Sensor Technology

Find out more about multispectral imaging technology

Applications

Find out more about multispectral image sensor applications

Download

IMX454 Product Overview

This document summarizes the product overview, features, and specifications.

Related Links

Product & Service Inquiries

Click here to request for a datasheet/quotation (RFQ)!

* This button will redirect you to the salesforce.com Co., Ltd. website,
which we have entrusted.

E-mail Newsletters

Find the latest information on our newsletter for industrial and security applications.