❌

Normal view

Report: Apple Asks Google to Run Siri on Its Servers

Apple has asked Google to investigate setting up servers in its data centers to run a future version of Siri powered by Gemini, The Information reports.


Currently, Apple sends its more complex AI queries to Private Cloud Compute, a system that runs on Apple servers using Apple silicon chips. Today, only 10% of Apple's Private Cloud Compute capacity is said to be in use on average. The usage is low enough that some servers intended for Apple's AI cloud system are still in warehouses and have not yet been installed. This could change rapidly upon the launch of the next-generation version of β€ŒSiriβ€Œ, which could spike Apple's demands for cloud computing.

Apple has reportedly suffered from a cultural reluctance to bolster its cloud infrastructure for years, leading to the departure of some key cloud experts from the company, such as Patrick Gates. Gates pioneered the idea of bringing Apple chips to data centers, which later formed the basis of Private Cloud Compute. The company still strongly focuses on hardware devices and consumer features rather than their supporting cloud technologies, despite the growth of services, resulting in a neglect of the need for additional capacity.

At the time Apple realized it needed to use the cloud to support its AI efforts, its internal AI infrastructure was "beginning to decay." The company was amid the process of decommissioning old Nvidia-powered servers. Combined with financial pressure, this led the company to increasingly turn to third-party providers like Amazon.

For years, Apple banned its AI engineers from Google's cloud technologies because of privacy concerns. Apple software chief Craig Federighi repeatedly vetoed Google Cloud as an option for its AI computing requirements. In 2023, Google made changes to its security systems that satisfied Apple's privacy concerns. Apple then started to adopt Google's cloud infrastructure for artificial intelligence.

The issue has been exacerbated by problems with Private Cloud Compute, which takes longer to update than other servers. Moreover, the chips currently used in Private Cloud Compute servers were designed for consumer devices and are not optimized for AI workflows, meaning that they are not well equipped to run large models like Gemini.

Apple now wants to be prepared for a potential surge in AI use on its devices when the more powerful, Gemini-based version of β€ŒSiriβ€Œ debuts later this year, motivating the request for Google to run β€ŒSiriβ€Œ directly on its servers. See The Information's full report for more.

This article, "Report: Apple Asks Google to Run Siri on Its Servers" first appeared on MacRumors.com

Discuss this article in our forums

Apple Loses Another Key AI Leader to Meta's Superintelligence Labs

Apple has had yet another AI executive poached by Meta, despite reports that the social networking company is slowing hiring (via Bloomberg).


Frank Chu, one of Apple's team leaders focused on cloud infrastructure, training, and search, will join Meta's Superintelligence Labs, a division tasked with building advanced AI systems capable of performing at or beyond human-level intelligence.

Chu was involved with managing Apple's cloud-based large language models (LLMs), and was also influential in developing search features for Siri and Apple's entertainment services. For Meta, Chu will work on a new team called MSL Infra, responsible for AI infrastructure development.

Meta has spent billions of dollars on recruitment for its Superintelligence group in recent months, but the company is said to be slowing down hiring over concerns of an overheated market. The pause went into effect last week amid a broader restructuring of the group.

Fears that investments in AI are moving too fast weren't helped by reports earlier this week that OpenAI CEO Sam Altman told a group of journalists that he believes AI is in a bubble. There was a broader sell-off of U.S. technology stocks following the news.

Apple has hemorrhaged around a dozen artificial intelligence staff to rivals since January. The exodus of staff from Apple's AI team over the last seven months has seen senior researchers leave variously for Meta, OpenAI, xAI, Cohere, and others.

One of the most notable recent departures was Ruoming Pang, head of Apple's Foundational Models team, who joined Meta last month after being lured by CEO Mark Zuckerberg with a $200 million pay package.

The talent drain coincides with Apple's struggle to update Siri by integrating LLMs. A chatbot-like version of the virtual assistant was one of the key Apple Intelligence features that Apple promoted at last year's WWWDC, but it has yet to arrive.

Apple is said to be considering using third-party AI models for Siri rather than its in-house technology, following an executive restructuring. During Apple's recent earnings call, Apple CEO Tim Cook said the company is "making good progress on a more personalized Siri" that is powered by Apple Intelligence, and he reiterated that the features will be available next year.
This article, "Apple Loses Another Key AI Leader to Meta's Superintelligence Labs" first appeared on MacRumors.com

Discuss this article in our forums

AI web browsers are the new trend, but will ChatGPT and Perplexity Chrome competitors turn out to be a fad?

Perplexity’s AI-powered Comet browser is part of a rising trend toward AI browsers, but whether it’s the future or just a pricey experiment remains to be seen.

Β© PerplexityAI/Twitter

❌