Apple is taking a significant step in artificial intelligence by developing large language models (LLMs) that work offline, running directly on the device rather than relying on cloud-based services. This strategy represents a notable shift from conventional AI services, which typically require an internet connection. What are the advantages of embedding an AI language model on a device?
Apple’s AI language model to work offline
With this innovation, the AI language model operates on the device, offering faster processing and improved user privacy. Apple’s decision to use large language models on-device aligns well with the company’s commitment to user privacy.
In cloud-based AI services, data is usually processed online, while on-device LLMs reduce the risk of data leakage. This innovation also makes the models more practical, allowing them to function even in areas with limited or no internet connectivity.
However, there are some drawbacks. Compared to cloud-based models, on-device LLMs are generally less powerful, as they do not have the extensive parameter sets and continuously updated data of large server farms.
Apple’s approach to large language models working offline, especially in AI applications and functionalities, offers a unique perspective. The company plans to adopt a marketing strategy emphasizing how AI can help people in their daily lives without relying on cloud-based solutions, rather than focusing solely on raw computing power.
This approach could appeal to those who prioritize user privacy. However, due to the limitations of on-device large language models compared to cloud-based models, Apple might collaborate with other AI companies to overcome these constraints.
More details on this strategy are expected to be revealed during the Worldwide Developers Conference (WWDC) in June. As part of the new versions of iOS 18 and other Apple operating systems, the benefits of on-device large language models and their integration into the Apple ecosystem will become clearer.
What do you think about this innovation? Do you think it’s a logical move? Share your thoughts in the comments section below.