"oh i didn't know that progress in AI was the result of falling compute costs" is the sort of phrase that should immediately disqualify you from being listened to about the future of AI
Follow
@mutual_ayyde my spiciest take on LLMs is that there's literally nothing surprising about them to anyone who's read Shannon's "A Mathematical Theory of Communication" and a few ML theory papers from the 80s, except for how long Moore's law held up to make it practical.
@mutual_ayyde multilayer perceptrons + Valiant's "Theory of the Learnable"