Acamon@lemmy.world to No Stupid Questions@lemmy.world · 2 years agoDo any languages have words for left & right that start with the same letter?message-squaremessage-square53linkfedilinkarrow-up1115arrow-down12file-text
arrow-up1113arrow-down1message-squareDo any languages have words for left & right that start with the same letter?Acamon@lemmy.world to No Stupid Questions@lemmy.world · 2 years agomessage-square53linkfedilinkfile-text
minus-squarenandeEbisu@lemmy.worldlinkfedilinkarrow-up1·2 years agoThey don’t process words as unified tokens for something like an LLM, but they do process them as multi-letter encoding, like byte-pair encoding or more advanced techniques.
They don’t process words as unified tokens for something like an LLM, but they do process them as multi-letter encoding, like byte-pair encoding or more advanced techniques.