Apple tests ‘Apple GPT,’ develops generative AI tools to catch OpenAI

Apple is quietly working on artificial intelligence tools that could challenge those of OpenAI, Alphabet’s Google and others, but the company has yet to devise a clear strategy for releasing the technology to consumers.

The iPhone maker has built its own framework to create large language models — the AI-based systems at the heart of new offerings like ChatGPT and Google’s Bard — according to people with knowledge of the efforts. With that foundation, known as “Ajax,” Apple also has created a chatbot service that some engineers call “Apple GPT.”

In recent months, the AI push has become a major effort for Apple, with several teams collaborating on the project, said the people, who asked not to be identified because the matter is private. The work includes trying to address potential privacy concerns related to the technology.

Apple shares gained as much as 2.3 per cent to a record high of $198.23 after Bloomberg reported on the AI effort Wednesday, rebounding from earlier losses. Microsoft, OpenAI’s partner and main backer, slipped about one percent on the news.

A spokesman for Cupertino, California-based Apple declined to comment.

The company was caught flat-footed in the past year with the introduction of OpenAI’s ChatGPT, Google Bard and Microsoft’s Bing AI. Though Apple has woven AI features into products for years, it’s now playing catch-up in the buzzy market for generative tools, which can create essays, images and even video based on text prompts. The technology has captured the imagination of consumers and businesses in recent months, leading to a stampede of related products.

Apple’s AI integration

Apple has been conspicuously absent from the frenzy. Its main artificial intelligence product, the Siri voice assistant, has stagnated in recent years. But the company has made AI headway in other areas, including improvements to photos and search on the iPhone. There’s also a smarter version of auto-correct coming to its mobile devices this year.

Publicly, chief executive officer Tim Cook has been circumspect about the flood of new AI services hitting the market. Though the technology has potential, there are still a “number of issues that need to be sorted,” he said during a conference call in May. Apple will be adding AI to more of its products, he said, but on a “very thoughtful basis.”

In an interview with Good Morning America, meanwhile, Cook said he uses ChatGPT and that it’s something that the company is “looking at closely.”

Apple’s Ajax

Behind the scenes, Apple has grown concerned about missing a potentially paramount shift in how devices operate. Generative AI promises to transform how people interact with phones, computers and other technology. And Apple’s devices, which produced revenue of nearly $320bn in the last fiscal year, could suffer if the company doesn’t keep up with AI advances.

That’s why Apple began laying the foundation for AI services with the Ajax framework, as well as a ChatGPT-like tool for use internally. Ajax was first created last year to unify machine learning development at Apple, according to the people familiar with the effort.

The company has already deployed AI-related improvements to search, Siri and maps based on that system. And Ajax is now being used to create large language models and serve as the foundation for the internal ChatGPT-style tool, the people said.

The chatbot app was created as an experiment at the end of last year by a tiny engineering team. Its rollout within Apple was initially halted over security concerns about generative AI, but has since been extended to more employees. Still, the system requires special approval for access. There’s also a significant caveat: Any output from it can’t be used to develop features bound for customers.

Even so, Apple employees are using it to assist with product prototyping. It also summarises text and answers questions based on data it has been trained with.

Apple isn’t the only one taking this approach. Samsung Electronics and other technology companies have developed their own internal ChatGPT-like tools after concerns emerged about third-party services leaking sensitive data.

Apple employees say the company’s tool essentially replicates Bard, ChatGPT and Bing AI, and doesn’t include any novel features or technology. The system is accessible as a web application and has a stripped-down design not meant for public consumption. As such, Apple has no current plans to release it to consumers, though it is actively working to improve its underlying models.

Beyond the state of the technology, Apple is still trying to determine the consumer angle for generative AI. It’s now working on several related initiatives — a cross-company effort between its AI and software engineering groups, as well as the cloud services engineering team that would supply the infrastructure for any significant new features. While the company doesn’t yet have a concrete plan, people familiar with the work believe Apple is aiming to make a significant AI-related announcement next year.

John Giannandrea, the company’s head of machine learning and AI, and Craig Federighi, Apple’s top software engineering executive, are leading the efforts. But they haven’t presented a unified front within Apple, said the people. Giannandrea has signaled that he wants to take a more conservative approach, with a desire to see how recent developments from others evolve.

Around the same time that it began developing its own tools, Apple conducted a corporate trial of OpenAI’s technology. It also weighed signing a larger contract with OpenAI, which licenses its services to Microsoft, Shutterstock and Salesforce.

Apple’s Ajax system is built on top of Google Jax, the search giant’s machine learning framework. Apple’s system runs on Google Cloud, which the company uses to power cloud services alongside its own infrastructure and Amazon.com’s AWS.

As part of its recent work, Apple is seeking to hire more experts in generative AI. On its website, it is advertising for engineers with a “robust understanding of large language models and generative AI” and promises to work on applying that technology to the way “people communicate, create, connect and consume media” on iPhones and its other devices.

An ideal spot for Apple to integrate its LLM technology would be inside Siri, allowing the voice assistant to conduct more tasks on behalf of users. Despite launching in 2011, before rival systems, Siri lagged competitors as Apple focused on other areas and adopted fewer features in favor of privacy.

In his May remarks, Cook defended the company’s AI strategy, saying the technology is used across much of its product lineup, including in features like car-crash and fall detection. More recently, Cook said that LLMs have “great promise,” while warning about the possibility of bias and misinformation. He also called for guardrails and regulation in the space.

The company expanded its artificial intelligence efforts in 2018 with the hiring of Giannandrea, who previously led search and AI at Google. Since then, Apple hasn’t released many splashy new AI features, but at least two initiatives could help put it on the map.

The company is planning a new health coaching service codenamed Quartz that relies on data from an Apple Watch and uses AI to personalise plans, Bloomberg reported in April. And the company’s future electric car will use artificial intelligence to power the vehicle’s self-driving capabilities.