RandAlThor@lemmy.ca to Technology@lemmy.worldEnglish · 18 hours agoElon Musk’s Grok Goes Haywire, Boasts About Billionaire’s Pee-Drinking Skills and ‘Blowjob Prowess’www.mediaite.comexternal-linkmessage-square127linkfedilinkarrow-up1839arrow-down116cross-posted to: politics@lemmy.world
arrow-up1823arrow-down1external-linkElon Musk’s Grok Goes Haywire, Boasts About Billionaire’s Pee-Drinking Skills and ‘Blowjob Prowess’www.mediaite.comRandAlThor@lemmy.ca to Technology@lemmy.worldEnglish · 18 hours agomessage-square127linkfedilinkcross-posted to: politics@lemmy.world
minus-squarebrucethemoose@lemmy.worldlinkfedilinkEnglisharrow-up1·5 hours agoYou should be running hybrid inference of GLM Air with a setup like that. Qwen 8B is kinda obsolete. I dunno what kind of speeds you absolutely need, but I bet you could get at least 12 tokens/s.
You should be running hybrid inference of GLM Air with a setup like that. Qwen 8B is kinda obsolete.
I dunno what kind of speeds you absolutely need, but I bet you could get at least 12 tokens/s.