24gb, luxury 😉 I have to make do with 8gb if vram but the previous 3.5-9b-artimus worked ok. I wonder how much of the 27B is used for the multi model support?
I was lucky enough to get one a few months ago for under $1k before the price doubled. It was the last sanely priced 24GB card, but that didn’t last long. 😭
27B and Qwen flash next can run with somewhat realistic specs. I run 27B on my 7900 XTX.
24gb, luxury 😉 I have to make do with 8gb if vram but the previous 3.5-9b-artimus worked ok. I wonder how much of the 27B is used for the multi model support?
I offload mmproj to the CPU to keep as much model weights in VRAM as possible 🙂
I was lucky enough to get one a few months ago for under $1k before the price doubled. It was the last sanely priced 24GB card, but that didn’t last long. 😭
Same thing, I bought mine last month!