Microsoft Azure & MediaTek demonstrate seamless cloud to edge fusion

During Microsoft Ignite, MediaTek demonstrated the 1st Phi-3.5-mini acceleration powered by edge AI in a smartphone, using the MediaTek Dimensity 9400 flagship chip. Edge AI ensures privacy, quality and security by keeping the data processing entirely on device, without need for Cloud-based service support.

 

Due to their size, Small Language Models (SLMs) are prime candidates for customizing to meet specific tasks, while being processed entirely on device. The 8th Generation NPU 890 in the Dimenisty 9400 has specific hardware to accelerate SLMs, such as Phi-3.5-mini, bringing new use cases such as writing suggestions, document summarizing and Q&A, and AI agent planning and reasoning.

Sameer Sharma, AVP and GM of the AI IoT BU (Americas & Europe) at MediaTek presented a session at Microsoft Ignite, on how to customize AI to optimize Phi and SLM performance.

 

 

 

Did this article help you? If so, please tell me in a comment what do you think about it.

Don’t miss any of our future video tutorials, follow us on Youtube. Like us on Facebook. Join our Best Deals Telegram Channel. Join our Android TV Box Firmware Updates Telegram Channel. Subscribe now to our newsletter. If you need Tech Reviewer or Youtube Influencer read this. Donate now here to support CGR Team!