Event-based Vision Sensor (EVS) | Image Sensor for Industrial Use [Overview] | Image Sensor | Products & Solutions

Overview

An Event-based Vision Sensor (EVS) realizes high-speed, low latency data output by detecting luminance changes, which each pixel senses asynchronously, and only outputting the differential data after combining with the coordinate and time information. This functionality can be leveraged in recognition processing systems to enhance the efficiency of data provision, ideal for various applications in the industrial field such as detection of fast-moving objects, equipment monitoring, movement detection analysis, and image recognition.

Features

Compact with high resolution, high-speed, and high temporal resolution

The industry’s smallest^*1 pixel size of 4.86 μm can read out event data efficiently at high temporal resolution.
Sony Semiconductor Solutions Corporation’s original miniaturization technology based on the structure of stacked CMOS image sensor together with Cu-Cu connection makes it possible to realize the industry’s smallest pixel with a large fill factor. This technology has produced a small Event-based Vision Sensor with high image resolution, high speed, and high temporal resolution (an image sensor that continuously detects movements and luminance changes).

*1) Among stacked event-based vision sensors. According to Sony research (as of announcement on September 9, 2021).

Capable of high-speed output at low power consumption

Sony's original stacked structure realizes event-based technology that outputs data only based on the pixel luminance changes detected by all pixels asynchronously and combined with coordinate and time information. Handling only the required data this method can achieve fast output, in the order of microseconds, while keeping power consumption low. It operates much faster than the conventional frame-based method.

Filter function to remove unnecessary event data with high accuracy

In order to cater to various applications the sensor is equipped with several filter functions specifically designed for event data. They can be employed to remove unnecessary event data such as periodical events due to LEDs flickering and other events that are highly unlikely to be the outline of a moving object, etc.

What is an Event-based Vision Sensor (EVS)?

With a conventional frame-based image sensor the entire image of the ball and the background is output at certain intervals determined by the frame rate. By contrast an Event-based Vision Sensor only takes the differential data, which means the trajectory of the moving ball is captured at a very high temporal resolution.

Mechanism and illustration of an event-based vision sensor

Product Lineup

Model name	Image size	Effective pixels
IMX636	1/2.5-type	Approx. 0.92 megapixels
IMX637	1/4.5-type	Approx. 0.32 megapixels
IMX646	1/2.5-type	Approx. 0.92 megapixels
IMX647	1/4.5-type	Approx. 0.32 megapixels

Specifications

Sensor specifications

Model name		IMX636	IMX637	IMX646	IMX647
Effective pixels		1280(H)x720(V) Approx. 0.92 megapixels	640(H)x512(V) Approx. 0.32 megapixels	1280(H)x720(V) Approx. 0.92 megapixels	640(H)x512(V) Approx. 0.32 megapixels
Unit cell size		4.86μmx4.86μm		4.86μmx4.86μm
Image size		Diagonal 7.137mm（1/2.5-type）	Diagonal 3.983mm（1/4.5-type）	Diagonal 7.137mm（1/2.5-type）	Diagonal 3.983mm（1/4.5-type）
Color filter		Black and white		Black and white
Package		Ceramic LGA Package(Exterior: 13 x 13 mm)		Ceramic LGA Package(Exterior: 13 x 13 mm)
Power supply	Analog	3.0V		3.0V
	Digital	1.1V		1.1V
	Interface	1.8V		1.8V
Nominal contrast threshold (ln)		25%		25%
Latency	ROI^*2	Less than 100 microseconds @ 1 Klux Less than 1000 microseconds @ 5 lux		Less than 800 microseconds @ 1 Klux Less than 9000 microseconds @ 0.3 lux
Latency	Thinned read-out^*3	Less than 220 microseconds @ 1 Klux Less than 1000 microseconds @ 5 lux		Less than 800 microseconds @ 1 Klux Less than 9000 microseconds @ 0.3 lux
Maximum event rate		1.06 Geps(giga events per second)		1.06 Geps(giga events per second)
Dynamic range		86 dB or more (5-100,000 lux) ^*4		110 dB or more (0.3-100,000 lux) ^*4
Background rate		0.1Hz@1klux/10Hz@5lux		0.1Hz@1klux/5Hz@0.3lux
Interface		Input: I2C (400 kHz / 1 Mhz), 4-wire SPI		Input: I2C (400 kHz / 1 Mhz), 4-wire SPI
Interface		Output: MIPI D-PHY(1.5 Gbps/lane)2lane, SLVS(800 Mbps/lane) 4lane		Output: MIPI D-PHY(1.5 Gbps/lane)2lane, SLVS(800 Mbps/lane) 4lane
Event signal processing function		Anti-flicker/ Event filter/ Event rate control		Anti-flicker/ Event filter/ Event rate control

*2) ROI 9x9=81pixels
*3) Thinned read-out, 1/5 (horizontal direction).
*4) 5 lux is the minimum light condition that guarantees imaging characteristics. Low-Light Cutoff(not guaranteed) is 0.08 lux with 50% of pixels respond to linear 100% contrast.

These two sensors were made possible through a collaboration between Sony and Prophesee, by combining Sony's CMOS image sensor technology with Prophesee's event-based method vision sensing technology.
As part of the collaboration between Sony and Prophesee on these products, Metavision® Intelligence Suite an event signal processing software optimized for sensor performance, is available from Prophesee. Combining Sony’s event-based vision sensors with this software will enable efficient application development and provide solutions for various use cases.
*) Metavision® is a registered trademark of PROPHESEE S.A.

Download

A List of Cameras with Event-based Vision Sensors (EVS)

Download a list of cameras that incorporate Sony's Event-based Vision Sensor

Technology

Event-based Vision Sensor (EVS) Technology

Find out more about Event-based Vision Sensor (EVS).

Case studies on the use of the “IMX636”: Autonomous system “Ace” by Sony Group

“Ace” is an autonomous system featured in the international scientific journal Nature. It is competitive with elite and professional-level human table tennis players in the real world.
The “IMX273” global shutter image sensor and the “IMX636” event-based vision sensor have been adopted as components of the hardware that enables real-time sensing and control in this system.