Viewing a single comment thread. View all comments

EntireContext OP t1_iynk9h4 wrote

I saw that headline but didn't go deep into it. It's real progress, not hype? How much efficiency gains? How long before they can implement it?

And aren't neural nets super complex already with all those billions of parameters?

3

Imaginary_Ad307 t1_iynkwt3 wrote

To my very limited understanding, you need huge servers to run complex neural networks because the interaction needs to be solved using numeric integration, with a symbolic solution this restriction disappear, opening the path to running this networks on less powerful servers, maybe even personal computers and phones.

10

manOnPavementWaving t1_iyo3sqa wrote

This doesn't hold for the networks currently in use, only if we want to more closely simulate human brains. There is no real indication yet that we can train these better or that they work better.

4

AvgAIbot t1_iyns2xs wrote

What about utilizing quantum computers? Or is that not applicable

2