Viewing a single comment thread. View all comments

zaptrem t1_j4a83db wrote

Reply to comment by elcric_krej in [D] Mtruk alternatives for extracting information out of text by elcric_krej

Not your fault, but it seems reasonable to interpret "validation samples" as samples for your validation set (e.g., you wanted people to manually label something for your training/validation data).

1

elcric_krej OP t1_j4atwg1 wrote

Yes... that's the correct interpretation, hence why I need mturk, to get people to manually label (well extract) something from my training/validation data.

​

I'm still rather confused about where the misunderstanding is.

1

zaptrem t1_j4c9p2l wrote

Validate samples = you feed completed outputs to humans and ask them to click correct/incorrect.

Validation samples = you all humans to manually complete the task themselves. Slow and expensive.

1