A 35B MoE on a 16 GB GPU, without the offload tax

Posted by GreenGames 1 day ago