Muse Spark Open is an 816B total/42B active parameter open weights model with a context window of 1M tokens. Built for coding and agentic work, Muse Spark Open is natively multimodal.
Don’t bother with their download restrictions, just check the quant providers https://huggingface.co/models?other=base_model%3Aquantized%3Ameta-models%2FMuse-Spark-Open-816B-A42B
Unsloth has their Q4 quant at 506 GB 💀
Active parameters aren’t that high, you’ll need KV cache in VRAM too, so maybe it would run in 64GB VRAM