Following Qualcomm’s recent announcement that they will be incorporating the Llama 2 Large Language Model (LLM) generative AI into their flagship phone for 2024, MediaTek has now committed to offering the same on-device generative AI tool, i.e., Llama2 on its upcoming flagship chipset Dimensity 9300. Llama 2 is Meta’s open-source large language model (LLM). In this article, our focus will be on what the integration of LLM in MediaTek Dimensity 9300 can offer.
MediaTek Dimensity 9300 Overview:
The Dimensity 9300 chipset is rumored to have a software stack optimized for running Llama 2 smoothly, along with upgraded hardware that makes generative AI applications work even better.
Performance
The Dimensity 9300 chipset details reveal an interesting layout, incorporating features like Arm’s Cortex-X4 and 4 A720 CPU cores. Additionally, it will feature an integrated 4 companion GPU named Immortalis-G720, which is responsible for managing graphics-related functions. This configuration indicates MediaTek’s clear dedication to providing an effective AI interface directly on mobile devices.
- You might want to read these:
Why implement Generative AI locally on the chipset?
Currently, the majority of Generative AI processing heavily depends on cloud computing. However, integrating Llama 2 models by MediaTek introduces the possibility of running generative AI applications directly on devices.
The benefit of providing the generative AI service down on the device is the increase in privacy. This integration of AI support within the chipset itself eliminates the need to transmit user data to the cloud for further processing, thereby affording greater control over security and personal information.
MediaTek Dimensity 9300 Availability
The Dimensity 9300 chipset will probably hit the market this year as a host to Meta’s Llama2 generative AI tool. With both MediaTek and Qualcomm embracing on-device AI functionalities, users can expect more rapid and secure mobile technology advancements by the close of 2023.
- Meanwhile, check out our review of Honor 90 Lite.
