Combining AI with iPhone? Apple's latest paper provides breakthrough solutions
米哈伊尔叔叔
发表于 2023-12-22 15:25:39
1284
0
0
Is the Apple GPT in your pocket? This may become a reality faster.
Apple artificial intelligence (AI) researchers recently published a paper on the preprint website arXiv, which mentioned an innovative "flash utilization" technology that can deploy large language models (LLMs) on iPhones and other memory limited Apple devices, which is almost a major breakthrough.
Memory constraints
LLM based chatbots (such as ChatGPT, Claude, etc.) rely heavily on data and memory, requiring a large amount of data to be processed simultaneously, often requiring a large amount of memory to run.
Therefore, running LLM is a challenge for devices such as iPhones with limited DRAM (generally referring to memory) capacity.
Usually, the standard method for computing data is to load the data from flash memory into DRAM, and then perform data inference in DRAM.
DRAM with high performance can increase data processing speed by millions of times, but the downside is its capacity. Running on DRAM severely limits the maximum model size that can be run.
To address this issue, Apple researchers have developed a new technology that uses larger capacity flash memory to store data from artificial intelligence models, which can then be transferred to DRAM memory for processing when needed.
Storing AI on flash memory
In a new research paper titled "LLM in Flash: Efficient Large Language Model Reasoning in Limited Memory", the author points out that flash memory in mobile devices is more abundant than traditional memory used to run LLM.
This method cleverly bypasses capacity limitations. The paper proposes two key technologies to minimize data transmission and maximize flash processing capabilities:
One of them is called "windowing" technology, which is equivalent to a recycling method. AI models do not need to load new data every time, but instead reuse some already processed data. This reduces the need for continuous memory acquisition, making the process faster and smoother.
The second is called "Row Column Bundling" technology. This technology is achieved by grouping data more effectively, that is, by setting the order of accessing data blocks based on the data characteristics of flash memory, which can read data from flash memory faster and accelerate the ability of artificial intelligence to understand and generate language.
According to this paper, the combination of these methods enables the running capacity of artificial intelligence models to reach twice the available memory of iPhones. This means that under this method, the inference speed in the CPU has increased by 4-5 times compared to traditional loading methods, and the inference speed in the GPU has increased by an astonishing 20-25 times.
The author of the paper wrote, "This breakthrough is particularly important for deploying advanced LLMs in resource limited environments, thereby expanding their applicability and accessibility."
Apple's AI Strategy
The breakthrough in artificial intelligence efficiency has opened up new possibilities for future iPhones, such as more advanced Siri features, real-time language translation, complex AI driven photography, and augmented reality capabilities.
The new technology in the paper also lays the foundation for iPhone to run complex artificial intelligence assistants and chatbots on devices, and it is said that Apple is already developing this technology.
Apple's work in generative artificial intelligence may eventually be integrated into its voice assistant Siri. Apple introduced its large-scale language model work to employees at the February Artificial Intelligence Summit this year. According to previous media reports, Apple's goal is to launch an intelligent version of Siri that is deeply integrated with artificial intelligence.
There are also rumors that Apple plans to add artificial intelligence to as many Apple applications as possible.
In addition, according to reports, Apple is also developing its own generative artificial intelligence model, "Ajax," which runs on 200 billion parameters to compete with OpenAI's GPT-4 model.
Internally known as "Apple GPT," Ajax aims to unify the entire Apple machine learning development, highlighting Apple's broader strategy of integrating artificial intelligence deeper into the Apple ecosystem.
According to the latest report, Ajax is considered more powerful than the early ChatGPT 3.5. However, the new model GPT-4 launched by OpenAI in September 2023 may have surpassed the capabilities of Ajax.
Fruit Chain analyst Jeff Pu has pointed out that Apple will launch some kind of generative artificial intelligence feature on iPhones and iPads around the end of 2024, which will be included in iOS 18. Pu also stated that Apple will build hundreds of artificial intelligence servers in 2023, and there will be more in 2024.
CandyLake.com 系信息发布平台,仅提供信息存储空间服务。
声明:该文观点仅代表作者本人,本文不代表CandyLake.com立场,且不构成建议,请谨慎对待。
声明:该文观点仅代表作者本人,本文不代表CandyLake.com立场,且不构成建议,请谨慎对待。
猜你喜欢
- Apple's market value evaporated by nearly $100 billion overnight, analysts say iPhone 16 series first sales fell short of expectations
- The first batch of Apple 16 ProMax is not available in seconds! The trend of idle fish transfer is rising, and sellers are raising prices by 400-1000 yuan
- The Apple official website was hacked! IPhone 16 Partial Models' Secondless'
- How far is the large-scale landing of Apple AI on the AI side after its debut?
- One click access for easy monetization. Baidu releases its first intelligent agent alliance solution
- Zhou Hongyi: I'm not planning to buy an iPhone 16 anymore. Huawei Mate XT has surpassed Apple in innovation!
- Apple Patent Explores the Future of Apple Pencil: Acting as an iPad TV Antenna
- Apple tax angers the public
- Why do so many people believe the rumor that "Apple phones will explode"?
- Will Apple launch a 3000 yuan smartphone next year? There are two major changes
-
AIエクスプレスによると、10月3日、米株の人気の中概株盤の前が低くなり、ピッピッピッと5%近く下落し、相多、名創優品、小鵬自動車は3%超下落し、百度、蔚来自動車、京東は2%超下落した。 ...
- SOGO
- 昨天 17:06
- 支持
- 反对
- 回复
- 收藏
-
ナスダック中国の金龍指数は5%超上昇し、楽しい自動車は120%超上昇し、金山雲は18%超上昇し、ピシャリと12%超上昇し、子牛の電動、怪獣の充電は10%超上昇し、愛奇芸は8%超上昇し、テンセント音楽、新東方は7%超上昇 ...
- hecgdge4
- 昨天 10:28
- 支持
- 反对
- 回复
- 收藏
-
10月1日、理想自動車が9月に納入したデータによると、9月に理想自動車が新車53709台を納入し、前年同月比48.9%増となった。 今年第3四半期、理想自動車は前年同期比45.4%増の152831台を納入した。今年9月30日現在、 ...
- 就放荡不羁就h
- 前天 12:06
- 支持
- 反对
- 回复
- 收藏
-
EUが中国の電気自動車に関税を課す方針、独首相と財務相が反発 ドイツ連邦のショルツ首相は現地時間の10月2日、EUが中国の電気自動車に一時的な補助金税を課す紛争を解決するために中国と交渉することを表明した。 ...
- 寒郁轩良
- 7 小时前
- 支持
- 反对
- 回复
- 收藏