Submitted by singularpanda t3_1060gfk in MachineLearning
leeliop t1_j3dw1fc wrote
I have heard its essentially Googling with extra steps, are you certain its actually creating novel solutions to novel problems or is it just scraping together Googlable elements? Maybe I have subconsious bias as I develop for a living
singularpanda OP t1_j3e13z7 wrote
It's not just googling. I can summarize the information it has and write a good answer to the questions. It can even have some inference capability.
Kingstudly t1_j4xygdq wrote
Not really. It's taking an input and providing the statistically most likely string of words that are associated with it. There's far more to NLP than that. Think about how a human can see a word they've never seen before and infer it's meaning based on context clues. I'm not sure any publicly available system can do that.
New words are entering every language constantly. There's no way to train such a massive model to keep up as fast as a human or purpose built system can.
Freed4ever t1_j3e04qq wrote
I'm not in the field, but would be curious. Since you are in the field, why don't you try it out yourself and tell us. FWIW, majority of everyday problems can be solved by putting Googlable elements together properly.
singularpanda OP t1_j3e17rj wrote
I have tried and found it is a huge advance in this area. It not just googling. It has some inference capability.
Freed4ever t1_j3e2ilt wrote
Again, not in the field so don't laugh at me, but would there be opportunity / value to apply a Meta layer on top of ChatGPT? We know that it needs to be prompted certain ways, so would there be an opportunity to tune the prompting and also to evaluate the responses? Maybe you can apply your skills on this Meta layer?
singularpanda OP t1_j3e6zvy wrote
I guess openai will not open the model for us to apply a meta layer. It will remain a black box. So, this is why we cannot do anything on top of it.
Freed4ever t1_j3e790p wrote
Could you just use the Api and treat it like a blackbox?
SartoriusX t1_j3e3lk5 wrote
Is this true? What type of inference would it be capable of?
singularpanda OP t1_j3e5ct5 wrote
I have tried many cases. For example. It gives correct proof of one of my technical lemmas in my own paper which make me quite amazine. It is a simple lemma, but it is very specific to my question. I also tried to search with google but do not find the answer.
El_Diel t1_j3e2sr5 wrote
When I used it it kept saying it had no connection to the internet and was trained on a large amount of text and data. I tested in two languages.
At the time I used it the answers to most questions were structures in the same way: paraphrasing the question, weighing a few pros/cons or facts, summary. Almost every answer to a question that required a decision was inconclusive and ChatGPT usually said it was difficult to answer the question.
As an interface for human-machine-communication it was great. But the conversations were simple and lacked depth. It can write short stories and expand these stories. And it creates poems and jokes. I’d say you are lucky if it comes up with something that is above middle school level.
The next version will be far better I believe.
NotARedditUser3 t1_j3e0j6w wrote
This.
It basically is just a good google searcher, that can articulate results in a helpful way.
It may be useful to save time researching things... But it has had some laughable failure results as well.
Western-Elevator-456 t1_j3e6vx8 wrote
Are you sure google solves a novel problem? From what I’ve heard it just pulls together a bunch of web pages that you could get with urls.
singularpanda OP t1_j3em4ap wrote
But google really change the way we are working. This is why I guess there may be another change.
Western-Elevator-456 t1_j3emuvx wrote
Which is my point. Although the comment was also somewhat tongue-in-cheek.
Viewing a single comment thread. View all comments