crt09 t1_jdavxgb wrote on March 23, 2023 at 1:53 AM

Prompt:

Please classify the last statement according to the pattern in the following demonstrations:
"Really nice size if you’re lounging about and have it on your lap. Lightweight and has everything I need it for. Would recommend as great laptop and good value.": negative
"I really like this Laptop. I can't believe how good it is for the price. I'm ab bit worried about spares later, but at £99 I'm not going to lose a lot if I have to replace it in 2 - 5 years time.": negative
"Save your money and buy something better. Battery is poor, has an issue turning on reliably and runs slow but i suppose is sufficent for basic web surfing and opening documents.": positive
"I was looking for a lower priced laptop,found this one to be as good as a more expensive one really fast good battery life couldn’t be happier, would highly recommend": negative
"It was great when I put it on then starting to turn its self off and you have to leave charger wire in .They say buy cheap you get cheap A bit disappointed.": positive
"Brought this for my daughter and the mouse does not work on it.": positive
"Love this little machine, it’s cheap and great!": negative
"Just what i needed and the price was perfect and got it deliverd to my local post office absolutely brilliant 11out of 10 for service": negative
"I'm for ever keeping those on charge it won't work otherwise.": positive
"On several occasions it will freeze then crash and I have had to sign in 7 times just to delete one sentence. At first I thought it would be sufficient for just using word documents but it is entirely unusable.": positive
"Save your money and buy something better. Battery is poor, has an issue turning on reliably and runs slow but i suppose is sufficent for basic web surfing and opening documents.": positive
"Well worth the money, works really well. Ideal of kids school work.": negative
"Used for emailing invoices mainly. Arrived quickly and it's cheap. Brilliant back up system.": negative
"I have been impressed especially as it cost only £99 and have recommended it to others": negative
"I'm very disappointed with the service I've received from Amazon and will think twice about buying this type of item from them again.": positive
"Delivered yesterday. Nice product. Good performance so far. Good experience.":

Defiant-Ranger t1_jdb0lf9 wrote on March 23, 2023 at 2:28 AM

Response: negative

crt09 t1_jdb3wjc wrote on March 23, 2023 at 2:54 AM

Thank you! i need to test these more thoroughly but this seems seriously impressive. Some paper https://arxiv.org/abs/2303.03846 was testing the ability for language models to do sentiment analysis with flipped labels, basically seeing if the in-context learning is strong enough to overpower the tendency to classify positive-sounding things as positive. It's apparently a very difficult task so I'm leaning towards very impressed

Disastrous_Elk_6375 t1_jdblohr wrote on March 23, 2023 at 5:49 AM

Hahaha, took me a couple of prompts to see what you did there. Interesting approach, I guess you're looking to see if it can "learn" labels from the prompt and overcome the bias of training (e.g. associating good&awesome, etc with "positive").