It’s not for anything important but I host a stupid discord bot trained on my friend group’s server chat history. It’s pretty much just a lobotomized ChatGPT but it’s a lot of fun. I’m looking to move off of OpenAI’s infrastructure though to something that doesn’t give money to the USA but it seems like everything is American.

Basically, I’m just looking for somewhere that I can finetune and run custom models. Does anyone know of such a place?

  • zqwzzleEnglish
    12·
    23 hours ago

    More involved but you can host models locally.

    Edit: and also not send your data remotely if you really do benefit or have to use them.

    • NotSteve_OP
      5·
      1 day ago

      Yeah, I’m thinking I’ll actually just pick up a used 3060. I already have server hardware running Proxmox so it wouldn’t be the hardest to setup

      • Sturgist
        2·
        1 day ago

        My laptop has a 1650 and I’m able to run a local StableDiffusion model. Some things are a bit too intense for it, for instance I’m restricted to 514×514 resolution, but it works well. A single image finishes in under a minute.