Viewing a single comment thread. View all comments

FriendlyRope t1_iragqww wrote

Reply to comment by ECEngineeringBE in [R] Google announces Imagen Video, a model that generates videos from text by Erosis

He does has a point, if there is no independent verification of an experiment (I.e. replication, or at least independent inspection of an experiment) the experiment can not be said to be trusted. For example the results shown could be "cherry picked" or the test data could be contaminated by training data.

2

ECEngineeringBE t1_irahdyd wrote

Sure, but just because you can't replicate it, doesn't mean that nobody can. We already had Facebook's paper on video generation a week ago, and we also have stability AI saying that they're planning their own model.

And also, just because the results can't be fully trusted (due to high barrier of replicability), does not mean that the publication isn't "research".

5

throwawayguy91 t1_irbfj1m wrote

thats the whole reason ATLAS and CMS work independently from each other

1