Shatur@discuss.tchncs.de to LocalLLaMA@sh.itjust.worksEnglish · 9 days agoQwalmost there!discuss.tchncs.deimagemessage-square12linkfedilinkarrow-up148arrow-down115file-text
arrow-up133arrow-down1imageQwalmost there!discuss.tchncs.deShatur@discuss.tchncs.de to LocalLLaMA@sh.itjust.worksEnglish · 9 days agomessage-square12linkfedilinkfile-text
minus-squareShatur@discuss.tchncs.deOPlinkfedilinkEnglisharrow-up2·9 days agoI offload mmproj to the CPU to keep as much model weights in VRAM as possible 🙂
I offload mmproj to the CPU to keep as much model weights in VRAM as possible 🙂