L4sBot@lemmy.worldMB to Technology@lemmy.worldEnglish · 1 year agoNow that you've all tried it ... ChatGPT web traffic falls 10%www.theregister.comexternal-linkmessage-square119fedilinkarrow-up1349arrow-down18file-text
arrow-up1341arrow-down1external-linkNow that you've all tried it ... ChatGPT web traffic falls 10%www.theregister.comL4sBot@lemmy.worldMB to Technology@lemmy.worldEnglish · 1 year agomessage-square119fedilinkfile-text
minus-squarefestuslinkfedilinkEnglisharrow-up1·1 year agoLook into llama.cpp - it’s a single C++ program that run quantified models (basically models with some less precision - don’t need a full 64 bits for a double, really). As for models to run on it, there’s so many but I think WizardLM is pretty good.
Look into llama.cpp - it’s a single C++ program that run quantified models (basically models with some less precision - don’t need a full 64 bits for a double, really). As for models to run on it, there’s so many but I think WizardLM is pretty good.