Meta's Muse Spark Open packs about 816 billion parameters but activates only around 42 billion per token, so it needs the memory of a giant model and runs at the speed of a much smaller one. The open-weight model takes text, images, audio and video, handles up to one million tokens of context, and was trained for agentic coding.

— via Hugging Face