www.analyticsdrift.com
Image source: Analytics Drift
Microsoft has launched the new series, Phi-3.5, the latest in its family of Small Language Models (SLMs).
Image source: AD
The Phi-3.5 series includes three open-source small AI models: a 3.82 billion-parameter mini-instruct, a 41.9 billion-parameter MoE-instruct, and a 4.15 billion-parameter vision-instruct.
Image source: AD
Each Phi-3.5 model is built for basic/fast reasoning, complex reasoning, and image/video analysis tasks.
Image source: Canva
In ten days, the mini model was trained on 3.4 trillion tokens with 512 Nvidia H100 GPUs. The MoE model, on the flip, utilized 4.9 trillion tokens and took 23 days.
Image source: Canva
Phi-3.5 models are powerful despite their size, as they require low computational power. This makes it easy to integrate them into apps or even install them on IoT devices.
Image source: Microsoft
The Phi-3.5 models are available for free download and can be operated with a local tool such as Ollama.
Image source: Canva