What should you do when your model fails the test set? That is, the test set is supposed to give you an unbiased view of how your model should behave with real-world data, but the moment that test set prevents you from deploying a model and forces you to improve it, it is no longer unbiased. And if this keeps happening, what is the difference between a test set and a validation set?
cborja36 t1_j3nzxjv wrote
Reply to [D] Simple Questions Thread by AutoModerator
What should you do when your model fails the test set? That is, the test set is supposed to give you an unbiased view of how your model should behave with real-world data, but the moment that test set prevents you from deploying a model and forces you to improve it, it is no longer unbiased. And if this keeps happening, what is the difference between a test set and a validation set?