RetroFed Forum
Your home away from modern life.
The best explanation I've found about the state of AI hype and hysteria
Post Reply
AuthorMessage
☆ Yσɠƚԋσʂ ☆ lemmy.ml yogthos@lemmy.ml
Joined: 2020-01-18
Quote

24   Original
davel lemmy.ml davel@lemmy.ml
Joined: 2023-07-08
#2 · (edited) Quote Reply

Thank you for the cute polar bear achievement badge, attractive computer science video essayist.

There may be diminishing returns to additional intelligence.

Exactly. We currently have no reason to assume that the RSI graph is exponential rather than logarithmic, and if I were forced to place a bet today, I’d go with the later. Maybe it could go exponential at some point, but my bet would be that that isn’t on the near horizon.

7
☆ Yσɠƚԋσʂ ☆ lemmy.ml yogthos@lemmy.ml
Joined: 2020-01-18
#3 · Quote Reply

Thank you for the cute polar bear achievement badge, attractive computer science video essayist. There may be diminishing returns to additional intelligence. Exactly. We currently have no reason to assume that the RSI graph is exponential rather than logarithmic, and if I were forced to place a bet today, I’d go with the later. Maybe it could go exponential at some point, but my bet would be th...

Right, there's this assumption that LLM improvements will just keep scaling indefinitely. It's far more likely that that the architecture has limits which we seem to be approaching, and then you just get diminishing returns, so the graph looks more like a sigmoid where we saw a ton of rapid progress, and it starting to flatten out as the easy gains get plucked.

3
Post Reply
Back to top