Coinspeaker
Meta to Launch New AI Model on Phones in Partnership with Qualcomm
Tech giant Meta Platforms Inc (NASDAQ: META) has partnered with semiconductor and telecommunications equipment company Qualcomm Inc (NASDAQ: QCOM) to enable the running of Meta’s new language model Llama 2 on phones and PCs that are working on Qualcomm chips.
Llama 2 will be available starting in 2024.
Qualcomm stated:
“The ability to run generative AI models like Llama 2 on devices such as smartphones, PCs, VR/AR headsets and vehicles allows developers to save on cloud costs, and to provide users with private, more reliable, and personalised experiences.”
Durga Malladi, senior vice president at Qualcomm Technologies, added:
“We applaud Meta’s approach to open and responsible AI and are committed to driving innovation and reducing barriers-to-entry for developers of any size by bringing generative AI on-device.”
According to Durga Malladi, developers can already start optimizing applications for on-device AI using the Qualcomm AI Stack. The latter has been designed to unleash the AI power of Connected Intelligent Edge devices, including smartphones, IoT, automotive, XR, cloud, and mobile PCs, through a custom-built AI software package that delivers high performance, flexibility, and broad access and compatibility. It supports popular AI frameworks and offers developer libraries and services.
Meta and Qualcomm already have experience working together. Back in September 2022, the companies teamed up to manufacture customized Snapdragon chipsets for future iterations of its extended reality (XR) platform. The collaboration extended their existing seven-year partnership.
What Are Large Language Models (LLMs)?
Llama 2 which Meta and Qualcomm are working on is a representative of a group of large language models (LLMs). A large language model is a trained deep-learning model that understands and generates text in a human-like fashion. To understand, summarize, produce, and predict new content, this algorithm employs deep learning techniques and massively large databases.
As Meta has explained, they have been receiving numerous requests for access to the large language model. As a result of the high demand for LLMs from researchers, Llama 2 has been introduced.
Llama 2 has been launched by Meta in partnership with Microsoft Corporation (NYSE: MSFT). According to the press release, it brings a lot of new features and improves the first version of Llama – a set of models that could generate text and code in response to prompts, comparable to other chatbot-like systems. While Llama 1 was available only by request, Llama 2 is free of charge for research and commercial use. Besides, Llama 2 is available in the Azure AI model catalog, as well as through Amazon Web Services (AWS), Hugging Face, and other providers.
Notably, Llama 2 has been trained on 40% more data than Llama 1. It also has double context length. As such, Llama 2 outperforms other open-source language models on many external benchmarks, including reasoning, coding, proficiency, and knowledge tests.
Meta to Launch New AI Model on Phones in Partnership with Qualcomm
