• 2 Posts
  • 34 Comments
Joined 3 years ago
cake
Cake day: June 8th, 2023

help-circle



  • I don’t know about your speeds, but for me it has worked fine for somewhere around 7 years. I went form OPNsense on it own hardware and moved the HDD into a PVE server, and have migrated that to a new PVE box and virtual SSD without instance.

    So:

    • OPNsense is on it’s own HDD can work well under PVE
    • Running on a virtual SSD works just as well (as long as you have the internal bandwidth if you are doing lots of logging etc)
    • Have a router always available to swap in it it goes sideways, I can swap 1 cable and change 1 setting (on the wifi) and I be back online















  • BlueÆther@no.lastname.nzOPtoLocalLLaMA@sh.itjust.works•Poor little Qwen
    link
    fedilink
    English
    arrow-up
    3
    ·
    edit-2
    24 days ago

    That is my current journey - trying to figure it out.

    I want this from a local LLM:

    • Coding assistant, mostly for projects for my self and general self hosting problems
    • General chatboychatbot, chatGPT style for quick responses
    • A LLM to help my daughters learn ‘AI’, both home schooled
    • A LLM to encourage the younger one to push writing ideas

    I started with Automatic1111 ~2 years ago for generative image AI but uninstalled it at some time. In the last weekend I’ve installed LM Studio and Bionic and have been recomended Hermes as an agent.