MIPI Update Enables Next-Gen Always-On Machine Vision Applications

The MIPI Alliance issued an update to its MIPI Camera Serial Interface 2 (MIPI CSI-2) that enables advanced machine vision applications in areas including mobile, augmented and virtual reality, drones, IoT, medical devices, and automotive.

Building on the machine awareness capabilities introduced in MIPI CSI-2 v3.0, v4.0 adds an advanced always-on imaging solution that operates over as few as two wires to lower cost and complexity for ultralow-power machine vision applications. It can continuously monitor the surrounding environment and wake its host CPU when significant events are detected.

Example uses include laptop or tablet-based face sensing, video surveillance, and vision-based vehicle safety applications. Image frames can be economically streamed from an image sensor to a video signal processor over a low-power MIPI I3C bus, with scaling options to add extra I3C lanes and bandwidth as defined by the I3C specification.

The MIPI Alliance introduced a significant update to its MIPI Camera Serial Interface 2 (MIPI CSI-2) interface to enable advanced machine-vision applications in multiple application spaces, such as mobile, augmented and virtual reality, drones, the Internet of Things (IoT), medical devices, industrial systems, automobiles, and client devices such as tablets, notebooks and all-in-ones. Building on the machine awareness capabilities introduced in MIPI CSI-2 v3.0, v4.0 adds an advanced always-on imaging solution that operates over as few as two wires to lower cost and complexity for ultra-low-power machine vision applications. Courtesy of the MIPI Alliance.

CSI-2 v4.0 also adds multipixel compression for the latest generation of advanced image sensors and RAW28 color depth for better image quality and signal-to-noise ratio. The system provides optimized pixel compression for the latest generation of Tetra- and Nona-Cell image sensors with multipixel color filter arrays (CFAs).

Meadowlark Optics - Building system MR 7/23

The feature helps alleviate the high bandwidth demands of these sensors by compressing both multipixel and standard Bayer CFA images more efficiently and with potentially higher quality than current methods. Reference code has also been made available to help integrators evaluate the algorithm and verify their implementations.

CSI-2 v4.0 is backward compatible with all previous versions of the MIPI specification.

Published: February 2022

Glossary

machine vision: Machine vision, also known as computer vision or computer sight, refers to the technology that enables machines, typically computers, to interpret and understand visual information from the world, much like the human visual system. It involves the development and application of algorithms and systems that allow machines to acquire, process, analyze, and make decisions based on visual data. Key aspects of machine vision include: Image acquisition: Machine vision systems use various...
computer vision: Computer vision enables computers to interpret and make decisions based on visual data, such as images and videos. It involves the development of algorithms, techniques, and systems that enable machines to gain an understanding of the visual world, similar to how humans perceive and interpret visual information. Key aspects and tasks within computer vision include: Image recognition: Identifying and categorizing objects, scenes, or patterns within images. This involves training algorithms...
augmented reality: Augmented reality (AR) is a technology that integrates digital information, typically in the form of computer-generated graphics, images, or data, with the real-world environment in real-time. AR enhances the user's perception of the physical world by overlaying or combining digital content onto the user's view of the real world, often through devices like smartphones, tablets, smart glasses, or specialized AR headsets. Key features and principles of augmented reality: Real-time...
virtual reality: Virtual reality (VR) is a computer-generated simulation of a three-dimensional environment or experience that can be interacted with and explored by an individual using electronic devices, such as a headset with a display. VR aims to create a sense of presence, immersing users in a computer-generated world that can be entirely fictional or a replication of the real world. It often involves the use of specialized hardware and software to provide a fully immersive and interactive experience. ...

Browse Cameras & Imaging, Lasers, Optical Components, Test & Measurement, and more.