Wander@yiffit.net to LocalLLaMA@sh.itjust.worksEnglish · 1 year agoWhat is better: higher quantiation or higher parameter count?message-squaremessage-square16fedilinkarrow-up119arrow-down10file-text
arrow-up119arrow-down1message-squareWhat is better: higher quantiation or higher parameter count?Wander@yiffit.net to LocalLLaMA@sh.itjust.worksEnglish · 1 year agomessage-square16fedilinkfile-text
For example, does a 13B parameter model at 2_K quantiation perform worse than a 7B parameter model at 8bit or 16bit?
minus-squarenoneabove1182@sh.itjust.worksMlinkfedilinkEnglisharrow-up2·1 year agoahh makes sense, i just made a post and deleted the comment i made on it but it glitched and deleted twice so now my post has -1 comments lmao
ahh makes sense, i just made a post and deleted the comment i made on it but it glitched and deleted twice so now my post has -1 comments lmao