gONzOglIzlI t1_j9izs1r wrote on February 22, 2023 at 8:45 AM

Reply to comment by turnip_burrito in OpenAI has privately announced a new developer product called Foundry by flowday

I'm I the only one wondering how quantum computers will factor in to all of this?
Feels like a hidden wild card, could expend the token budged exponentially.

turnip_burrito t1_j9j1pe8 wrote on February 22, 2023 at 9:12 AM

Why would it expand the token budget exponentially?

Also we have nowhere near enough qubits to handle these kinds of computations. The number of bits you need to run these models is huge (GPT3 ~170bil or 10^11 parameters). Quantum computers nowadays are lucky to be around 10^3 qubits, and they decohere too quickly to be used for very long (about 10^-4 seconds). * numbers pulled from a quick Google search.

That said, new (classical computer) architectures do exist that can use longer context windows: H3 (Hungry Hungry Hippos) and RWVST or whatever it's called.

D2MAH t1_j9jb0sf wrote on February 22, 2023 at 11:19 AM

I’m not quite sure if quantum computing is even needed for AGI. It’s so far behind and we’re so far ahead.

ChezMere t1_j9owekb wrote on February 23, 2023 at 3:09 PM

Quantum computers work nothing like how you think they do, and are completely useless for AI (as well as almost all other classes of problem).

gONzOglIzlI t1_j9so4my wrote on February 24, 2023 at 7:19 AM

"Quantum computers are completely useless for AI."
Bold prediction, we'll see how it ages.
Can't say I'm anything close to an expert, but I do have masters CS, was a competitive programmer and am a professional programmer now with 10y of xp.