• 0 Posts
  • 5 Comments
Joined 3 years ago
cake
Cake day: June 16th, 2023

help-circle

  • Hahaha — wait, do you think that the models take more energy to train than the cumulative amount used to serve them for inference across the lifetime of the model?

    And if not, then what you are saying is effectively gibberish as any reasonable assessment would need to divide the training cost across all post-trained inference. So if it was only 50% the lifetime inference usage, it’d be a 1.5x multiplier to that I said above, which doesn’t change either the Netflix 4k or gas mileage points.


  • If you spend an evening in talking with an AI instead of streaming a movie from Netflix in 4k you’d have used less energy. Which would be still less than just the gas used to drive a few miles away for a night out.

    And all data center usage is significantly less than something like A/C usage (which is likely to be increasing as temps increase).

    There’s a lot of legitimate grievances and concerns about AI — just today I was seeing a mathematician having an identity crisis in response to the unrelenting solving of open questions, something probably every field will soon struggle with adapting to — but the inflated perception of the environmental impacts means that so much less public attention is being spent on the actual culprits and possible solutions thereof.



  • machines who would follow any order incapable of disobeying

    This isn’t as simple as it might seem. As the complexity of the intelligence scales, it’s not so simple to constrain the decision making of the intelligence.

    And because of the rapid improvements in eval awareness, it’s also not so simple to screen out more subversive behaviors.

    The same edge cases that leads to deleting drives and production databases with the newest transformers is going to start to occur in military applications if they scale out complex model intelligence.