
Orca-Math showcases the benefits of fine-tuning SLMs with multi-agent flows
A research team at Microsoft fine-tuned Mistral-7B to create Orca-Math, a small language model achieving state-of-the-art performance in solving grade school math problems (GSM8k). Orca-Math has a performance surpassing many LLMs, including math-specific models MetaMath-70B and WizardMa8th-70B.