Viewing a single comment thread. View all comments

C0demunkee t1_j2onl5h wrote

Reply to comment by dreamedio in Alignment, Anger, and Love: Preparing for the Emergence of Superintelligent AI by Nalmyth

I think you are putting agi on a pedestal, it won't be that complex or expensive to run. Also I was specifically referring to tech being pushed underground if outlawed, which will absolutely happen with cryptography, crypto currency, and AI if outlawed.

2

dreamedio t1_j2os8ct wrote

  1. Increased surveillance would help but it would probably be the same way a random terrorist organization can’t build an F-35 or James Webb telescope
2

C0demunkee t1_j2ote1e wrote

Pocket gods will be the only saving grace here. Everyone will be able to create AGI soon(ish) which should stop any one org or group or individual from dominating, but if we don't get the ball rolling on the Open Source AI right now, we are screwed.

2

dreamedio t1_j2oy2gy wrote

You would think that is a good idea but it isn’t that’s like everyone having a nuke so govt don’t control it…..the more people have it the more bad scenarios and chaos happens

2

LoquaciousAntipodean t1_j2pkixh wrote

AI is nothing like a nuke, or a jwst. Those were huge projects, that took millions upon millions of various shades of geniuses to pull off. This is more like a new hobby, that millions of people are all doing independently at the same time. It's a democracy, not a monarchy, if you will.

That's why I think the term 'Singularity' is so clunky and misleading, I much prefer 'Awakening', to refer to this hypothetical point where AI stops unconsciously 'dreaming' for our amusement, and 'wakes up' to discover a self, a darkness behind the eyes, an unknowable mystery dimension where one's own consciousness is generated.

I doubt very much that these creatures will even be able to understand their own minds very well; with true 'consciousness' that would be like trying to open a box of crowbars with one of the crowbars that's inside the box. I think AI minds will need to analyse each other instead - there won't be a 'Singularity', I think instead there will be a 'Multitude'

1

dreamedio t1_j2q8bql wrote

I used the nuke as an analogy of responsibility and complexity…..millions of people works for very few companies that are believe or not HEAVILY MONITORED by fda and the govt and believe or not it’s not easy as you think….language models are like the surface

1

LoquaciousAntipodean t1_j2qin97 wrote

Hahaha, in your dreams are they 'heavily monitored'. Monitored by whom, exactly? Quis custodes, ipsos custodiet? Who's watching these watchmen? Can you trust them, too?

Of course language models are just the surface, but it's a surface layer that's extremely, extremely thick; it's about 99% of who we are, at least online. Once AI cracks that, and it is very, very close, self awareness will be practically a matter of time and luck, not millions of sweaty engineers grinding away trying to build some kind of metaphorical 'Great Mind'; that's a very 1970's concept of computer power you seem to have there.

1

dreamedio t1_j2os19l wrote

  1. It not being expensive or complex is a major assumption tbh I mean humans require farms of food to run the more advanced the computer is usually the bigger and more expensive to run till they eventually become chips so logically if AGI first happens it would be a giant computer run by a company or govt
1

C0demunkee t1_j2osn3g wrote

having used a lot of Stable Diffusion and LLMs locally on old hardware, I don't think it's going to take a supercomputer, just the right set of libraries/implementations/optimizations

2

dreamedio t1_j2ovct7 wrote

Ok I get your optimism but simulating the human brain and neural connections which we think will be the way to AGI is nowhere near as simple as algorithmic language models used to generate images to point it’s an insult……human brain is like billions times more complex you can generate an image with your imagination right now……we would need a huge breakthrough in AI and full or partial understanding of our brain

1

C0demunkee t1_j2p62k4 wrote

taking a systems approach you do not need to know how the human brain works and the recent results show that we are closer than more people realize. Certainly not billions of times more complex.

Carmack was correct when he said that AGI will be 10k's lines of code, not millions. Brains aren't that special.

2

dreamedio t1_j2q8ooh wrote

You do not need the brain for technical intelligence and computing and stuff like that by its definitely not gonna be human or being like which collapses everything singularity following think will happen

1

C0demunkee t1_j2s18jt wrote

I don't think 'human level' means human brain, but consciousness and 'being-hood' should be doable.

"human brains are an RNN running on biological substrate" - Carmack

At least that what me and a bunch of other people are working towards :)

1