• SGforce
    link
    fedilink
    English
    arrow-up
    111
    arrow-down
    8
    ·
    7 days ago

    They finetuned 1.5-3b models. This is a non-story

    • Yozul@beehaw.org
      link
      fedilink
      English
      arrow-up
      16
      ·
      6 days ago

      The headline is dumb, but the research isn’t. According to the actual contents of the article, that $30 is still 27 times cheaper than what it costs OpenAI to make a similar sized model which also performs worse. That’s still a big deal even if the people reporting on it made a stupid title for their article about it.

    • brucethemoose@lemmy.world
      link
      fedilink
      English
      arrow-up
      2
      ·
      7 days ago

      Like many AI headlines, to be honest. Even in the open source world, there is tons of fudging and hype. Been that way since way before ChatGPT became popular.

      Still, it’s cool the whole finetuning pipeline even runs, and theoretically scaling up is just a matter of money