minus-squareHegz@lemmy.catoLocalLLaMA@sh.itjust.works•RecursiveSI/flint 40b-a2.5blinkfedilinkEnglisharrow-up3·17 days agoHow do you run a model split between ram and vram? Everything I’ve read so far says that will tank performance… Is it something of a, “it works, but prepare to spend a lot of time at the water cooler” type deal, or am I mis informed? linkfedilink
How do you run a model split between ram and vram? Everything I’ve read so far says that will tank performance…
Is it something of a, “it works, but prepare to spend a lot of time at the water cooler” type deal, or am I mis informed?