TrainquilOasis1423

TrainquilOasis1423 t1_j91uvav wrote

Reply to comment by trnka in [D] Simple Questions Thread by AutoModerator

Makes sense. To expand on the number of possible iterations wouldn't it be something akin to a collapsing wave function? Like trying to iterate through all possible responses would be impossible, but the list of probable responses shrinks as the context expands.

For example if I just input "knock" there are too many possible sentences to search, but if I input "knock knock". The most likely response is "who's there?" A simple example sure, but you get the point yea?

1

TrainquilOasis1423 t1_j91k8px wrote

Reply to [D] Simple Questions Thread by AutoModerator

Is the next step in LLMs to predict the entire next sentence?

From what I understand LLMs mostly just predict the next word in a sentence. With just this we have seen HUGE advancement and emergent behavior out of what could essentially be called level 1 of this tech. So then would making a machine learning architecture to predict the entire next sentence be the next logical step? After that would it be entire paragraphs? What would be the challenges of making such an architecture?

1

TrainquilOasis1423 t1_j1x651d wrote

Reply to Considering the recent advancements in AI, is it possible to achieve full-dive in the next 5-10 years? by Burlito2

So the thing I'm coming to appreciate more as the years go on and the technology advances is to stop trying to predict a time frame and start looking at things from a milestone perspective. A true full dive virtual reality set would require a lot of different technologies in a lot of different fields of scientific study that advance at a lot of different rates. We could get lucky and all of them could advance fast enough to make 5 years possible, or maybe one field of study lags behind and we remain 90% there for 20 years. There's no way to really know.

I'm waiting for more concrete advancements in reading and understanding the signals of the connectome as a whole. Then providing input stimulus to the brain. After that it mostly comes down to a safety and reliability concern for me. I won't be the first person to do a full dive, but I definitely won't be the last either.

1