• QuaternionsRock@lemmy.world
      link
      fedilink
      English
      arrow-up
      1
      ·
      5 months ago

      One of the craziest facts about GPT (to me) is that it was trained on 570GB of text data. That’s obviously a lot of text, but it’s bewildering to me that I could theoretically store their entire training dataset on my laptop.