Viewing a single comment thread. View all comments

tsgiannis t1_j3vx1lm wrote

If no matter what you get 75% accuracy then you can consider yourself a game breaker But do test the model and when I say test I don't mean on a static subset you have tested again and again. For example - haven't read the code yet - pick last year...and train your model for the 60% of the games.. lets say its 100 games and you have trained for 60.. did you managed to predict accurately the 61st,62nd....70 (lets take in batches of 10)...now the next batch..are you still carrying an accuracy over 75% ? Like you I had a model for baseball that was around 60 % accurate...but when I put it on the test it failed hard For now such a high accuracy seems a good starting point but do test

1

vagartha OP t1_j4c0ouq wrote

So I've separated my dataset into train and validation datasets (90%, 10% split). Is this what you mean?

Or should I have a separate test dataset on top of that you think?

1