• QuaternionsRock@lemmy.world
    link
    fedilink
    English
    arrow-up
    1
    ·
    5 months ago

    One of the craziest facts about GPT (to me) is that it was trained on 570GB of text data. That’s obviously a lot of text, but it’s bewildering to me that I could theoretically store their entire training dataset on my laptop.