EndOfLine@lemmy.world to Lemmy Shitpost@lemmy.worldEnglish · 7 days agoMight not be efficient, but at least it... Uhhh, wait, what good does it provide again?lemmy.worldimagemessage-square96linkfedilinkarrow-up11.27Karrow-down114
arrow-up11.26Karrow-down1imageMight not be efficient, but at least it... Uhhh, wait, what good does it provide again?lemmy.worldEndOfLine@lemmy.world to Lemmy Shitpost@lemmy.worldEnglish · 7 days agomessage-square96linkfedilink
minus-squarelovely_reader@lemmy.worldlinkfedilinkarrow-up4·6 days agoNo. “In practice, inference [which is to say, queries, not training] can account for up to 90% of the total energy consumed over a model’s lifecycle.” Source.
No. “In practice, inference [which is to say, queries, not training] can account for up to 90% of the total energy consumed over a model’s lifecycle.” Source.