NLP model for sentiment analysis

Submitted by justundertheblack t3_114mncs in deeplearning

I have to make a nlp model for sentiment analysis of news headlines for stock price prediction. Can anyone guide me through what I should do. I don't know much about techniques of nlp and such but I know machine learning enough to implement a model. Does it even come under machine learning or do I have to look at deep learning for

2

Comments

You must log in or register to comment.

Aynit t1_j8wytok wrote

I'd recommend scooting on over to hf.co and checking out some of their open source models. Realistically you can call one, or an ensemble from there in a few lines of code. Not sure what's causing this piece of work - school? work? hobby? But that's a decent place to get something set up quickly. They might even have models fine tuned on stock/economic vocabulary.

1

Moreymoe t1_j8y6zc7 wrote

If you know how to code with python. Then I would highly recommend trying the spacy module. It’s really awesome and they have a ton of guides and info on their site

1

Oreoed t1_j8yfckw wrote

Depends on what you're trying to do with this project.
If you already have a news source, implementing pre-trained model from huggingface should be relatively easy.
If you want to fine-tune that model, you will need a dataset of news headlines.
Check out Kaggle, there are some small but publicly available datasets.
I know you can also find data on some obscure github repo, but good luck with that.
If your goal is to implement a fully operational pipeline, you will need not only all the above, but also a way to acquire news in real time. That may mean a scrapper of some news outlets that are of interest. Once again, github is your friend.
That said, don't expect a profit off this alone. Using news data alongside some trading indicators will *maybe* work on paper (ie. backtest) with the right features and optimization, but is unlikely to get live results.
Then again, for a college project that might not be relevant.

1