An immersive visual content that ingeniously incorporates SPAD depth sensor
Leaving the Shibuya station onto the Jingudori street, traversing the famous Shibuya scramble crossing, and about two blocks down, you will find the shopping mall Shibuya Modi. The building is adorned with an iconic 535-inch display, Sony Vision Shibuya. The latest addition to the screen is the LiDAR system equipped with SSS’s SPAD depth sensors.
The Sony Vision Shibuya installed on the Shibuya Modi building
Two LiDAR devices are mounted side by side
The LiDAR technology is developed primarily with autonomous driving cars in mind. It offers the automotive-class performance in delivering fast and accurate depth sensing of targets under diverse conditions and, for this, it has been chosen as a component technology to build the visual world created by idom.
▶Check out for more technological descriptions about SPAD depth sensor
The SPAD depth sensor scans the road junction three-dimensionally to capture the movements of pedestrians, vehicles and the background structures. The real-time data is then output in point cloud. The 4K camera, also mounted on the Sony Vision Shibuya, captures images of the junction. These are combined with the visual representations created by the volumetric capture technology, which is developed at the Sony Group’s R&D Center to project a 3D image onto the display in real time. This invites people on the spot to have a new style of visual experience as if to take part in the visual content to the music “GLOW” composed by idom.
This is the first foray to apply the SPAD depth sensor, being developed for automotive applications, to the entertainment domain. This fusion between SSS’s depth sensing technology and visual content broadens the possibilities of creative expressions in the future.
This visual content by idom, powered by SSS’s sensor technology, is currently on display, and the installed LiDAR system will be leveraged in more contents to come. If you happened to be in Shibuya area, why not take a look at the Sony Vision Shibuya and experience the new-style visual entertainment.
This project embodies the Sony Group’s purpose statement “Fill the world with emotion through the power of creativity and technology.” Being true to this, we take up more challenges such as this project to deliver more moving experiences to the world.
Find the video of the actual installation here