Soofi releases open hybrid Mamba-Transformer model for German, English

The Soofi Consortium released Soofi S 30B-A3B, an open hybrid Mamba-Transformer mixture-of-experts (MoE) foundation model built for German and English. The model activates 3.2 billion of its 31.6 billion total parameters per token.