Viewing a single comment thread. View all comments

DreamyPen OP t1_ivveamf wrote

Reply to comment by _Arsenie_Boca_ in [Discussion] Can we train with multiple sources of data, some very reliable, others less so? by DreamyPen

Can I ask you what you mean by "smoothen labels"?

1

_Arsenie_Boca_ t1_ivvfzfs wrote

In classification you usually have a single correct class, a hard label. However, you might also have soft labels, where multiple classes have non-zero target probabilities. Label smoothing is a technique that artificially introduces those soft labels from hard labels, i.e. if your hard label was [0 0 1 0] it might now be [0.05 0.05 0.85 0.05]. You could use the strength of smoothing to represent uncertainty.

1

DreamyPen OP t1_ivvgkqs wrote

Thank your the clarification. I'm dealing with a regression problem however. Not sure its applicable in my case.

1