We demonstrate that BlackMamba performs competitively versus both Mamba and transformer baselines, and outperforms in inference and training FLOPs. We fully educate and open-source 340M/1.5B and 630M/two.8B BlackMamba https://k2spiceshop.com/product/liquid-k2-on-paper-online/