MediaTek Dimensity Platforms will Support the new Llama 3.2 Generative AI LLMs

Meta introduced Llama 3.2, the latest generation of its open-source Large Language Model (LLM) for AI applications. This version will bring new capabilities to the ecosystem, including multimodal support for reasoning on high resolution images with 11B and 90B models, as well as support for lightweight 1B and 3B models that allow Llama to run efficiently almost anywhere including on mobile and other edge devices.

 

Continuing to expand the framework MediaTek has established for Llama 2 and Llama 3 models, we are once again working to leverage a combination of NPU Hardware Acceleration and software tools to officially support Llama 3.2 on Dimensity platforms, including the upcoming Dimensity 9400 and other Generative AI-enabled platforms.

The Llama 3.2 release includes several new, updated and highly differentiated models across a spectrum of sizes and capabilities, as well as robust system level safety support including image input guardrails. The 1B, 3Band 11B models support on-device use cases like knowledge retrieval and summarization, instruction following, and rewriting tasks running locally at the edge. The ability for MediaTek to run Llama 3.2 on-device provides many benefits for developers and users, including faster response times, lower latency, and reduced power consumption. Smaller Llama models facilitate on-device Generative AI solutions through low memory usage for a smoother user experience.

Developers will be able to utilize Llama 3.2 through MediaTek’s NeuroPilot SDK, a toolkit that enables and optimizes on-device Gen-AI inference capabilities across our diverse product portfolio, including mobile platforms and edge-AI capable devices.

 

 

Did this article help you? If so, please tell me in a comment what do you think about it.

Don’t miss any of our future video tutorials, follow us on Youtube. Like us on Facebook. Join our Best Deals Telegram Channel. Join our Android TV Box Firmware Updates Telegram Channel. Subscribe now to our newsletter. If you need Tech Reviewer or Youtube Influencer read this. Donate now here to support CGR Team!

Post a comment


REDMAGIC Nova Gaming Tablet– Innovation in Every Detail. REDMAGIC NOVA GAMING TABLET – Bright. Sharp. Unstoppable. Introducing the Snapdragon 8 Gen 3 …

Oct 4, 2024

Ulefone Armor Pad 4 Ultra Series First Sale is Live @ Aliexpress. Revolutionize your work with the Ulefone Armor Pad 4 Ultra …

Oct 4, 2024

This firmware is for Tanix TX6S TV Box with Allwinner H616 as CPU and LPDDR4 RAM. Download Android 10 stock firmware for …

Oct 4, 2024

Save $170 for Stainless Halloween Pumpkin Carving Kit @ iMARKU. High-Quality Materials Crafted with HC stainless steel, the blades are durable and …

Oct 3, 2024

Tired of not having a big screen wherever you go? Frustrated with squinting at your small device or missing out on entertainment …

Oct 3, 2024

Are you a manufacturer or brand looking to make an impact in the fast-growing Windows Mini PC market? At China Gadgets Reviews, …

Oct 3, 2024

We’ve upgraded to a sleek, white elongated box that offers clear visibility of the smart ring and its accessories, addressing previous concerns …

Oct 3, 2024

For many of us, the tactile feel of writing on paper is irreplaceable, but the convenience of digital notes is undeniable. The …

Oct 3, 2024

Tangzu takes us to the beautiful tale of “Journey to the West” with its latest release, meet the all-new Tangzu BaJie. Based …

Oct 3, 2024

Check out the AdLink I-Pi SMARC 1200 Plus DevKit, an AI and graphics-centric solution that is powered by the MediaTek Genio 1200 …

Oct 3, 2024

Xiaomi, a consumer electronics and smart manufacturing company, announced seven new products expanding its AIoT portfolio: Xiaomi Robot Vacuum X20 Max, Xiaomi …

Oct 3, 2024

Xiaomi, a consumer electronics and smart manufacturing company, announced seven new products expanding its AIoT portfolio: Xiaomi Robot Vacuum X20 Max, Xiaomi …

Oct 3, 2024