https://techmonitor.ai/technology/ai-and-automation/microsoft-phi-3-mini

Microsoft has debuted phi-3-mini, a compact large language model (LLM) in its new family of Phi-3 models. A successor to its previous compact model family Phi-2, the software giant claimed in a paper published on Arxiv that phi-3-mini is both small enough to be installed on a phone and equivalent in performance to larger LLMs. In a paper published on arXiv, Microsoft also announced the creation of two larger models in the Phi-3 family: phi-3-small and phi-3-medium variants. The company did not reveal when any versions of Phi-3 would be released to the wider public.

“We introduce phi-3-mini, a 3.8 billion parameter language model trained on 3.3. trillion tokens, whose overall performance, as measured by both academic benchmarks and internal testing, rivals that of models such as Mixtral 8x7B and GPT 3.5,” said Microsoft. “The innovation lies entirely in our dataset for training, a scaled-up version of the one used for phi-2, composed of heavily filtered web data and synthetic data. The model is also further aligned for robustness, safety, and chat format.”