• 0 Posts
  • 10 Comments
Joined 7 months ago
cake
Cake day: April 8th, 2026

help-circle





  • Monument@piefed.worldtoSelfhosted@lemmy.world•Is anyone self-hosting their own AI?
    link
    fedilink
    English
    arrow-up
    3
    arrow-down
    1
    ·
    edit-2
    24 days ago

    I wouldn’t say I ‘run’ it, but I mess around with it

    I have a base level Mac Mini I got before the price increase a few years ago, also from when models were smaller and my ambitions were less. I’ve contemplated upgrading it, but I have other things to spend my money on.

    M4 processor, 16 gb ram, 256 gb storage, and a 4tb external HDD drive (an old NAS drive).

    It’s fine. It’s mostly a docker machine, but I do throw AI tasks at it a few times a week. Mostly stuff that I just let it chew on for 5-10 minutes and come back to.

    I run openwebui, and have several models I bounce between. I mostly run Gemma4 (Google) and Granite4.2:8B (IBM).

    Editing to add: the self hosted version of all these models, via llama, just in case that was unclear.