Lee Duna@lemmy.nz to Technology@lemmy.worldEnglish · 9 months agoSomeone made a GPT-like chatbot that runs locally on Raspberry Pi, and you can toowww.xda-developers.comexternal-linkmessage-square30fedilinkarrow-up1293arrow-down115
arrow-up1278arrow-down1external-linkSomeone made a GPT-like chatbot that runs locally on Raspberry Pi, and you can toowww.xda-developers.comLee Duna@lemmy.nz to Technology@lemmy.worldEnglish · 9 months agomessage-square30fedilink
minus-squareDeceptichum@kbin.sociallinkfedilinkarrow-up16·9 months agoYeah but damn does it get slow. I always find it interesting how text is so much slower than image generation. I can do a 1024x1024 in probably 20s, but I get like 1 word a second with text.
minus-squareferret@sh.itjust.workslinkfedilinkEnglisharrow-up5·9 months agoLanguages are complex and, more importantly, much less forgiving to error
Yeah but damn does it get slow.
I always find it interesting how text is so much slower than image generation. I can do a 1024x1024 in probably 20s, but I get like 1 word a second with text.
Languages are complex and, more importantly, much less forgiving to error