Overview

Always-on (AO) is a sensing technology for mobile and IoT devices, enabling them to recognize the environment or changes around them, and facilitating an autonomous UI based on the information meanings derived from sensing.

The AO image sensor is equipped with a dedicated mode for AO operations and features, not only with high-resolution for capturing still and videos.

Not only that the image sensor itself is low power consumption but it can also unburden external processors in data processing, enabling to realize continuous sensing applications while remarkably extending battery life.

Technical Features

Ultra-low-power sensing operation

Unlike a camera’s image capturing action, the always-on sensing needs the camera being activated all the time. It is similar to being on standby. The following drive technology, that combines pixels, circuits and signal processing, is integrated into Sony Semiconductor Solutions Corporation("SSS")'s AO image sensors, so information like “someone is there” can be obtained with slight consuming power, appropriate to its simplicity.

(1) Flexible pixel binning and detection sequence

Like it is for human perception of sight, the necessary resolution to understand the scene depending on varies stages. AO image sensor autonomously identifies an intended target, while altering the resolution by means of pixel binning.

Flexible pixel binning and detection sequence

Flexible pixel binning and detection sequence

(2) Power gate system

Semiconductor circuits consume power even when they are on standby, while the AO image sensor has a dynamic power control that enables to optimize power consumption to the level required for the intended image capturing and data processing, depending on the system load.

Power gate system

Power gate system

Proprietary AI engine and lightweight image-based reasoning system

The RAW image data read out from the pixels are processed and compressed directly on the image sensor, converting the image data into “meaning” information before output. This substantially reduces the device’s overall load in communication, power consumption, and other operations. It allows the device to detect targets precisely in real time while being highly energy-efficient.

*1: Compatible features (types of detection targets) vary depending on product specifications.

Proprietary AI engine and lightweight image-based reasoning system 1
Proprietary AI engine and lightweight image-based reasoning system 2

Examples of images recognized by the sensing mode*1

Applications

Screen lock control with the front camera

Using AO can activate the device automatically by detecting its user looking at the screen, even when the device is in the sleep mode. No more stress of having to tap the screen repeatedly to keep the screen on.

The technology only activates the main processor for the short moment for identifying the user, contributing to longer battery life. It can be configured to switch the device to the standby screen once the user is no longer detected.

Screen lock control with the front camera

Screen lock control with the front camera

Hands-free control

Camera-enabled gesture control features can be a powerful solution in scenarios where users cannot hold their devices, such as in a kitchen or bathroom, and where a shared device should be made contact-free. AO enables the detection of a user’s body gestures to wake up devices from the sleep mode.

* This feature has been conceived with mobile devices in mind and not designed as specifications of SSS's image sensor products.

2D barcode reader detection

Navigation (map), online payment, and many other apps today use 2D barcodes. AO can wake up the device from the sleep mode and launch relevant applications automatically when a barcode is detected in front of the camera. It will saves the user unlocking steps, so it contributes to the improvement of user-interface.

* This feature has been conceived with mobile devices in mind and not designed as specifications of SSS's image sensor products.

2D barcode reader detection

Related Products & Solutions

Contact Us

For inquiries about Sony Semiconductor Solutions Group and products / solutions, specifications, quotation / purchase requests, etc., please contact us using the Inquiry form from the button below.