pavnilschanda@lemmy.world to Technology@lemmy.worldEnglish · 2 years agoLLMs are surprisingly great at compressing images and audio, DeepMind researchers findventurebeat.comexternal-linkmessage-square12linkfedilinkarrow-up1102arrow-down15cross-posted to: [email protected][email protected][email protected]
arrow-up197arrow-down1external-linkLLMs are surprisingly great at compressing images and audio, DeepMind researchers findventurebeat.compavnilschanda@lemmy.world to Technology@lemmy.worldEnglish · 2 years agomessage-square12linkfedilinkcross-posted to: [email protected][email protected][email protected]
minus-squareNaibofTabr@infosec.publinkfedilinkEnglisharrow-up9·2 years agoDo you need the dataset to do the compression? Is the trained model not effective on its own?
minus-squareTibert@compuverse.uklinkfedilinkEnglisharrow-up12·2 years agoWell from the article a dataset is required, but not always the heavier one. Tho it doesn’t solve the speed issue, where the llm will take a lot more time to do the compression. gzip can compress 1GB of text in less than a minute on a CPU, an LLM with 3.2 million parameters requires an hour to compress
Do you need the dataset to do the compression? Is the trained model not effective on its own?
Well from the article a dataset is required, but not always the heavier one.
Tho it doesn’t solve the speed issue, where the llm will take a lot more time to do the compression.
deleted by creator