Fuck this shit, why does every fucking thing need an LLM?

  • hotpot8toe@lemmy.world
    link
    fedilink
    arrow-up
    5
    arrow-down
    13
    ·
    4 months ago

    this can run locally on your device which means probably doesn’t consume that much energy

      • hotpot8toe@lemmy.world
        link
        fedilink
        arrow-up
        4
        arrow-down
        5
        ·
        4 months ago

        but that was already done. They are using Mistrial which was already trained. Proton didn’t train a new AI for this.

        • anyhow2503@lemmy.world
          link
          fedilink
          arrow-up
          6
          arrow-down
          1
          ·
          4 months ago

          The whole premise of this discussion was about technological progress and growth going by your initial comment. That means refining existing models and training new ones, which is going to cost a lot of energy. The way this industry is going, even privacy conscious usage of open source models will contribute to the insane energy usage by creating demand and popularizing the technology.