abbadon420@sh.itjust.works to Funny@sh.itjust.works · 2 days ago"LLMs can do anything" except make positive cashflow.i.programmerhumor.ioimagemessage-square130linkfedilinkarrow-up11.25Karrow-down118
arrow-up11.23Karrow-down1image"LLMs can do anything" except make positive cashflow.i.programmerhumor.ioabbadon420@sh.itjust.works to Funny@sh.itjust.works · 2 days agomessage-square130linkfedilink
minus-squarepiccolo@sh.itjust.workslinkfedilinkarrow-up3·1 day agoNPUs are already a thing, specialized cpus for nerual networks. The problem is the models are just databases, and you need lots of fast memory in order to feed the NPUs data, and thats the current bottleneck.
minus-squarewholookshere@lemmy.blahaj.zonelinkfedilinkarrow-up1·22 hours agoI’m not denying they still gobble those up, but those components are not what’s drawing all the power.
NPUs are already a thing, specialized cpus for nerual networks. The problem is the models are just databases, and you need lots of fast memory in order to feed the NPUs data, and thats the current bottleneck.
I’m not denying they still gobble those up, but those components are not what’s drawing all the power.