Overview

Useful and fun smartphone applications are made possible by integrating state-of-the-art sensing technology, such as the back-illuminated Time of Flight (ToF) image sensors, and Sony Semiconductor Solutions Corporation’s imaging technology backed up by years of expertise. With photo assistance such as the background blurring effect, AR-enabled games, and a new mode of communication using spatial expressions, the sensor can create a whole new experience.

AR is a technology to augment the real world visually by superimposing visual information virtually onto the view of the real world captured in a screen using depth information of the objects and structures within the view. Its main applications include entertainment apps for smartphones.

Applications

Mobile VTuber

The sensor that can obtain depth information recognizes facial expressions and movements of the fingers and other parts of the body with precision. It can move your avatar smoothly and naturally by tracking fast movements of the fingers, hands and body.
It facilitates more realistic and entertaining expressions through convincing facial expressions, hand gestures, 3D graphics rendered in the air and more.

Text version of the video

Photography (background blurring)

ToF image sensors measure the depth of the field and enables highly technical effects, like blurring the background, for impressive shots just like using an interchangeable lens mirrorless camera.

Photography (background blurring) 1
Photography (background blurring) 2

Sony Semiconductor Solutions Corporation (SSS) offers its ToF (Time of Flight) AR software development kit (SDK) as an open tool for developers.

■ Developer World*1 “ToF AR” release webpage
https://developer.sony.com/ja/develop/tof-ar/

The “ToF AR,” developed by SSS, facilitates the development of applications using Unity*2 to realize the following features, accelerating the development of incredibly immersive apps and AR features.
1.Hand gesture
2.Body movement recognition and smooth rendering
3.Modeling to create 3D data
4.Meshing to build the surrounding geometry based on depth information.

**1) Developer World is a Sony-supported website operated by Sony Europe, compiling development programs. URL:https://developer.sony.com/ja/
*2) Unity is a platform for developing games provided by Unity Technologies. It offers an integrated development environment for game creation, with game engines and execution environment.

Technology

ToF (Time of Flight)

Find out more about the ToF(Time of Flight) used in this field.

Related Products & Solutions

Contact Us

For inquiries about Sony Semiconductor Solutions Group and products / solutions, specifications, quotation / purchase requests, etc., please contact us using the Inquiry form from the button below.