Subscribe for free access to 
Data Points!
Meta released quantized versions of its Llama 3.2 1B and 3B language models, optimized for mobile devices. The new model versions achieve twice to four times the speed of the non-quantized models, a 56 percent reduction in size, and a 41 percent reduction in memory usage compared to the original versions, while maintaining high quality and safety. These mobile versions of Llama 3.2 allow developers to build AI experiences that run entirely on-device, offering improved speed and privacy for users. (Meta)