Heidelberg AI News

Article · The Decoder ·

The inventor of the bitter lesson has a bitter lesson for LLM scaling enthusiasts

Turing Award winner Richard Sutton reaffirms that raw compute alone isn't enough for intelligence and that fundamentally new learning methods are needed. Ex-OpenAI researcher Tworek agrees, saying blind transformer scaling "has reward hacked brains of a whole generation of scientists."

Read at the-decoder.com The opening of the article at the-decoder.com.

More from The Decoder

All stories