Viewing a single comment thread. View all comments

machinelearner77 t1_iw21k83 wrote

Reply to comment by samloveshummus in [R] ZerO Initialization: Initializing Neural Networks with only Zeros and Ones by hardmaru

I guess the problem with "seed hacking" is just that it reduces trust in the proposed method. People want to build on methods that aren't brittle and if presented model performance depends (too) much on random seed it lowers trust in the method and makes people less likely to want to build on it

3

samloveshummus t1_iwhwh8y wrote

Sure, but maybe it's inescapable.

When we recruit for a job, we first select a candidate from CVs and interviews, and only once we've chosen a candidate do we begin training them.

Do you think it makes sense to strive for a recruitment process that will get perfect results from any candidate, so we can stop wasting time on interviews and just hire whoever? Or is it inevitable that we have to select among candidates before we begin the training? Why should it be different for computers?

1