Professional-Song216 t1_itk33t3 wrote on October 24, 2022 at 5:54 AM

Reply to comment by 4e_65_6f in Large Language Models Can Self-Improve by xutw21

I’m wondering the same, I hope this research isn’t stretching the truth. Given what we know about scaling and the recent news about deepmind, I would think that a rapid chain software advancement is eminent.

NTIASAAHMLGTTUD t1_itk5zhu wrote on October 24, 2022 at 6:32 AM

>the recent news about deepmind

Fill me in? Is this about Gato 2?

Professional-Song216 t1_itk6ke5 wrote on October 24, 2022 at 6:40 AM

Nope but you’re going to love this if you haven’t heard about it yet.

https://arstechnica.com/information-technology/2022/10/deepmind-breaks-50-year-math-record-using-ai-new-record-falls-a-week-later/?amp=1

They basically made matrix multiplication more efficient which is the core of a lot of compute.