Microsoft Azure & MediaTek demonstrate seamless cloud to edge fusion
Due to their size, Small Language Models (SLMs) are prime candidates for customizing to meet specific tasks, while being processed entirely on device. The 8th Generation NPU 890 in the Dimenisty 9400 has specific hardware to accelerate SLMs, such as Phi-3.5-mini, bringing new use cases such as writing suggestions, document summarizing and Q&A, and AI agent planning and reasoning.
Sameer Sharma, AVP and GM of the AI IoT BU (Americas & Europe) at MediaTek presented a session at Microsoft Ignite, on how to customize AI to optimize Phi and SLM performance.
Did this article help you? If so, please tell me in a comment what do you think about it.
Don’t miss any of our future video tutorials, follow us on Youtube. Like us on Facebook. Join our Best Deals Telegram Channel. Join our Android TV Box Firmware Updates Telegram Channel. Subscribe now to our newsletter. If you need Tech Reviewer or Youtube Influencer read this. Donate now here to support CGR Team!
