Meta releases the latest open-source big model Llama 3, continuously catching up with OpenAI
楚一帆
发表于 2024-4-19 11:13:54
161
0
0
On April 18th local time, Meta released its latest open-source model Llama 3, providing pre trained and instruction fine-tuning versions of 8B and 70B. This is currently the most advanced open source model, which will create strong competition for large model companies, including OpenAI, and also benefit many artificial intelligence companies that rely on open source models.
Amidst a slight decline in the overall market, Meta's stock price rose by 1.54%.
According to Meta's official introduction, Llama 3 was trained on two customized 24K GPU clusters based on data exceeding 15T - which is 7 times larger and 4 times more code than the dataset used by Llama 2, and Llama 3 supports 8K context length, which is twice the capacity of Llama 2.
Meta Official
In addition, Meta has also released parameter comparisons between two versions of Llama 3 and competitors such as Google Gemma, Google Gemini, Mistral, and Antioptic's Claude 3.
For users, they can also experience Llama 3 through Meta's own Meta AI. Meta CEO Zuckerberg introduced that Meta AI will be integrated into the search boxes at the top of Meta's major products WhatsApp, Instagram, Facebook, and Messenger, and has created a website called meta.ai to make it easier to use.
According to Yann LeCun, Chief Scientist of Meta, Llama will continue to release more versions in the coming months and will soon release research papers on Llama 3. Jim Fan, a senior scientist at Nvidia, believes that future versions of Llama 3-400B and above may become a "watershed" for the open source community to use GPT-4 level models.
It is worth noting that the launch of Llama 3, like its previous version, caused a sensation in the open source community. But earlier this week, Baidu founder Robin Lee publicly said that the open source model will be more and more backward.
Robin Lee said that the smaller size model cut by developers through dimension reduction of Baidu's Wenxin 4.0 is significantly better than the model directly brought out from the open source model under the same size; Under the same effect, the cost is significantly lower. "People used to think that open source was cheap when using it, but in large model scenarios, open source is actually the most expensive. Therefore, open source models will become increasingly outdated."
CandyLake.com 系信息发布平台,仅提供信息存储空间服务。
声明:该文观点仅代表作者本人,本文不代表CandyLake.com立场,且不构成建议,请谨慎对待。
声明:该文观点仅代表作者本人,本文不代表CandyLake.com立场,且不构成建议,请谨慎对待。
猜你喜欢
- NIO: NOMI GPT model has exceeded 10 million chat interactions
- Google releases Gemma 2 open-source AI model
- ERNIE Bot calls 500 million model manufacturers every day, and the ecological competition is intense
- Baidu Robin Lee: The big model without application is worthless
- 2024 World Artificial Intelligence Conference | Robin Lee: Commercial closed source model is the best
- Robin Lee speaks! "Commercial closed source models are the most effective"
- Robin Lee's harsh words: the basic model without application is worthless regardless of whether it is opened or closed
- Baidu announces the free opening of the Wenxin Intelligent Agent Platform's Wenxin Big Model 4.0
- Toyota has completed its investigation into the model certification incident and no new violations have been found
-
アマゾンが米証券取引委員会(SEC)に提出した最新の規制文書によると、同社の創業者ジェフ・ベゾス(Jeff Bezos)氏は50億ドル近くのアマゾン株の売却を計画している。 今回ベゾス氏が売却を計画しているアマゾン ...
- 寒郁轩良
- 前天 13:28
- 支持
- 反对
- 回复
- 收藏
-
【メディア:バイデン氏は夜8時以降の活動を停止するためにはより多くの睡眠が必要だと述べた】複数のメディアによると、バイデン米大統領は水曜日、民主党の知事に対し、より多くの睡眠が必要だと述べたため、勤務 ...
- 什么大师特
- 昨天 10:57
- 支持
- 反对
- 回复
- 收藏
-
【ビジネス界のエリート100人が連名でバイデン氏の再選出馬の見通しに重大な挑戦】複数のメディアによると、数百人のビジネス界のリーダーからなる組織「Leadership Now Project」はホワイトハウスに書簡を送り、米 ...
- 不正经的工程师
- 23 分钟前
- 支持
- 反对
- 回复
- 收藏
-
【予想以上!テスラQ 2納入台数が44.4万台の株価上昇を記録2桁超】火曜日(7月2日)の米株式市場を前に、米電気自動車メーカーテスラ社は2024年第2四半期の自動車生産量と納入量の報告書を発表した。データによると ...
- 套顿各爱了
- 3 天前
- 支持
- 反对
- 回复
- 收藏