
Microsoft MAI-Base-2: 2.8 Trillion Parameters, 16,000 GPUs, and a Claimed Efficiency Edge Over DeepSeek
Microsoft AI finished pre-training MAI-Base-2, a mixture-of-experts model with 2.8 trillion total and 80 billion active parameters, on 16,000 GB200 GPUs over 38 days. It claims 4 to 12 times better pre-training efficiency than DeepSeek-V4-Pro-Base on its own evaluations, and plans to license the weights to partners through Foundry.









