Apple Shocks Again: Introducing OpenELM – Open Source AI Model That Changes Everything!
Apple's latest AI breakthrough, OpenELM, is an open-source language model that significantly outperforms earlier models like OLMo by being 2.36 percent more accurate while using only half the pretraining tokens. This state-of-the-art model, developed using texts from diverse public sources, incorporates advanced techniques such as layer-wise scaling and RMSNorm to enhance performance and efficiency. With its open-source availability, OpenELM provides unprecedented access to its training processes and performance benchmarks, encouraging widespread innovation and collaboration in the AI research community.
Become a Member of the channel and Supporter of AI Revolution → https://www.youtube.com/channel/UC5l7RouTQ60oUjLjt1Nh-UQ/join
Sources:
https://arxiv.org/abs/2404.14619
https://machinelearning.apple.com/research/openelm
#apple #ai
Apple’s latest AI breakthrough, OpenELM, is an open-source language model that significantly outperforms earlier models like OLMo by being 2.36 percent more accurate while using only half the pretraining tokens. This state-of-the-art model, developed using texts from diverse public sources, incorporates advanced techniques such as layer-wise scaling and RMSNorm to enhance performance and efficiency. With its open-source availability, OpenELM provides unprecedented access to its training processes and performance benchmarks, encouraging widespread innovation and collaboration in the AI research community.
Become a Member of the channel and Supporter of AI Revolution → https://www.youtube.com/channel/UC5l7RouTQ60oUjLjt1Nh-UQ/join
Sources:
https://arxiv.org/abs/2404.14619
https://machinelearning.apple.com/research/openelm
#apple #ai
