Microsoft and Sony develop AI-processed image sensor IMX500: Report

Microsoft and Sony announced the launch of partnerships the Supports Program (Partner Enablement Program) encourages qualified local independent software vendors (ISV) and system integrator (SI) partners to innovate based on commercial AI camera-driven solutions.

The solution combines the world’s first image sensor with AI processing capabilities-the Sony IMX500 smart vision sensor-with the AI ​​capabilities of Microsoft’s smart cloud to achieve edge artificial intelligence processing. Prior to this, Microsoft and Sony also launched Co-Innovation Labs in China to provide partners and corporate customers in the field of computer vision and video analysis with the support needed to build, develop, prototype, and test solutions. 

Stay tuned with us via Telegram

The world’s first AI processing image sensor based on Azure artificial intelligence

Sony’s smart vision sensor IMX500 can perform high-speed AI processing on the sensor, only outputting semantic metadata information instead of image data, thereby reducing data traffic and solving privacy issues. Through cooperation with Microsoft, Sony embeds Azure AI in sensors.

This integration can provide diversified functions for general-purpose applications such as real-time target tracking under high-speed AI processing to bring smarter AI camera solutions to business scenarios, and allocate resources more effectively between the edge and the cloud to improve cost efficiency and power efficiency.

Sony has also created an AI camera hosting application based on Azure IoT and Cognitive Services, which not only improves the IMX500 sensor but also expands the capabilities and scope of the video analysis field for partners and customers to help them grasp more opportunities.

Moreover, this AI camera solution combines Sony’s cutting-edge imaging and sensing technology with Microsoft’s smart cloud technology and AI platform to demonstrate its potential in commercial applications. Users can create, select, and upload AI models to sensors, and fully customize smart camera solutions. Customers from all walks of life can use this solution to discover new revenue opportunities, simplify operations, and solve challenges.

For example, retail companies can use AI cameras to detect when to replenish shelf goods or adjust the number of open cash registers based on the length of customer queues. In addition, with the use of AI cameras, manufacturing companies can identify and identify dangerous situations in the workshop in real-time, preventing problems before they occur.

In the traditional sense, data collection for such applications often relies on AI cameras distributed in sites such as stores, warehouses, and distribution centers. It is difficult to optimize the allocation of computing resources, which in turn leads to increased costs or energy consumption.

At the 2021 China International Import Expo, Microsoft and Sony launched the Partner Enablement Program to recruit more outstanding local ISV and SI partners through the Microsoft Artificial Intelligence and Internet of Things Lab. Create more diversified industry solutions. 

The launch of this plan will enrich the existing ecosystem, recruit excellent partners with rich domestic and overseas experience, sales, and marketing resources in their leading industries, and help them create solutions that apply to different industry scenarios. While challenging, provide these partners with product launch resources.

As early as May 2020, Microsoft and Sony Semiconductor Group announced their cooperation on a global scale. The Partner Enablement Plan initiated this time is also one of the local continuations of this global cooperation.