Microsofts small math AI model does math better than the big boys.

Microsoft’s small math AI model does math better than the big boys.

Microsoft found that small language models can exceed the performance of much larger ones when trained to specialize in a single area. Researchers fine-tuned the Mistral 7B model to create Orca-Math, an SLM that solved grade school math problems better, at 86.8 percent, than models like Llama 2, GPT-3.5, and Gemini Pro — even though it ingests significantly less data.

The company was rumored to build a team entirely focused on creating SLMs (AI models that use less computing power), which would be suited for phones and laptops.

ncG1vNJzZmivp6x7tbTEr5yrn5VjsLC5jmtna2xfaHx3e5FtZ3JqYmV%2FcLnInKmoq5%2BbwbR50qaYpaRdoq61tIyaoGaln5myrXnDqJysZZ2Wwal5wZ6rrZ2iYsGprc1mq6GdXZe2qHnBqLCs