Silicon Republic October 25, 2024
The new quantised models are 56pc smaller and use 41pc less memory when compared to the full-size models released last month.
Meta has released compact versions of its lightweight Llama 3.2 1B and 3B models that are small enough to run effectively on mobile devices.
The Facebook owner, in an announcement yesterday (24 October), said that these new “quantised” models are 56pc smaller and use 41pc less memory when compared to the original 3.2 models released last month.
Meta says you can use the 1B or 3B models for on-device applications such as summarising a discussion from your phone or calling on-device tools such as calendar.
The new models “apply the same quality and safety requirements” as the original Llama...