Meta opens the weights of Muse Spark: 816 billion parameters and two Mac Studios to run it
On October 15, Meta publishes the weights of Muse Spark Open: 816 billion parameters, 42 of which are active, a context window of one million tokens, and support for text, image, audio, and video. Available on all platforms from day one, announced on two M5 Ultra Mac Studios, with no throughput figures published.
Preview
This is a short excerpt.
The full analysis and podcast are for subscribers. The account is free.