Apple admits it relied on Google to train Apple Intelligence - how did it do it?

Apple admits it relied on Google to train Apple Intelligence - how did it do it?

A research paper reveals that Apple used Google hardware to build the foundation for Apple Intelligence

The paper, "Apple Intelligence Foundation Language Models," details the hardware, data, and coding sources for the Apple Intelligence language models

While most of these sources are already known, an Apple Insider report revealed that buried within the paper are citations suggesting that Apple may have used Google hardware in its early development

According to the paper, Apple's Foundation Model (AFM) and the server technology that drives it were initially built on "v4 and v5P Cloud TPU clusters" using Apple software However, Monday's CNBC report suggests that Apple borrowed time from an existing Google-hosted cluster

Oddly, there is no mention of Google or Nvidia in the research paper to support this This likely means that Apple purchased the hardware directly from the company and used it within their data center

Apple's initial use of Google's hardware to train AI makes sense, as Google has built an efficient chip and infrastructure for AI training, including using it to train its own Gemini and Gemma family models

Currently Apple is working on a project ACDC focused on a data center that will use hardware derived from Apple Silicone to process Apple Intelligence queries It uses an operating system modeled after iOS, but it is not clear if this will be used only to run models in the cloud or for training future AI

Apple is significantly increasing its investment in the field of artificial intelligence and plans to devote $5 billion to server enhancements alone over the next two years

This is not the first time questions have been raised about the training of Apple's early generation AI models The company was recently accused of using data from "The Pile" to train Apple Intelligence Apple has strongly denied using Apple Intelligence for training, but has stated that it did use it to train OpenELM models It also emphasizes that these models are not used to power Apple's commercial AI products, including Apple Intelligence

The Pile is a dataset compiled by ElutherAI and used by many companies for AI training However, it was discovered that much of the data was obtained without permission from YouTube video captions

Apple may not have been an early influencer in the AI market, but the company is about to become one of the big names and may soon rival the likes of Microsoft and Meta may have been shrouded in secrecy, but the company is taking a more open approach going forward, releasing a true open source LLM

Categories