floofloof to Technology@lemmy.worldEnglish · 28 days ago1-bit LLMs Could Solve AI’s Energy Demandsspectrum.ieee.orgexternal-linkmessage-square36fedilinkarrow-up1120arrow-down115cross-posted to: [email protected][email protected][email protected]
arrow-up1105arrow-down1external-link1-bit LLMs Could Solve AI’s Energy Demandsspectrum.ieee.orgfloofloof to Technology@lemmy.worldEnglish · 28 days agomessage-square36fedilinkcross-posted to: [email protected][email protected][email protected]
minus-squareKnock_Knock_Lemmy_In@lemmy.worldlinkfedilinkEnglisharrow-up11arrow-down1·26 days agoSmaller and speedier means larger token windows and greater variety of models. Not less energy.
Smaller and speedier means larger token windows and greater variety of models.
Not less energy.