Tencent Hy3: 295 Billion Parameters, Apache License, and Cheaper Than Anything From OpenAI
Tencent just released Hy3, an open-source MoE model that competes with models two to five times its size on many benchmarks. And it costs almost nothing to run.