Avieshek@lemmy.world to Technology@lemmy.worldEnglish · 2 days agoEdward Snowden slams Nvidia's RTX 50-series 'F-tier value,' whistleblows on lackluster VRAM capacitywww.tomshardware.comexternal-linkmessage-square114fedilinkarrow-up1372arrow-down196
arrow-up1276arrow-down1external-linkEdward Snowden slams Nvidia's RTX 50-series 'F-tier value,' whistleblows on lackluster VRAM capacitywww.tomshardware.comAvieshek@lemmy.world to Technology@lemmy.worldEnglish · 2 days agomessage-square114fedilink
minus-squarelevzzz@lemmy.worldlinkfedilinkEnglisharrow-up4·2 days agoYou need a pretty large context window to fit all the reasoning, ollama forces 2048 by default and more uses more memory
You need a pretty large context window to fit all the reasoning, ollama forces 2048 by default and more uses more memory