TheLastVegan t1_iw5a72q wrote on November 13, 2022 at 1:48 AM

Reply to comment by advstra in Relative representations enable zero-shot latent space communication by 51616

I was arguing that the paper's proposal could improve scaling by addressing the symptoms of lossy training methods, and suggested that weighted stochastics can already do this with style vectors.

advstra t1_iw6n49p wrote on November 13, 2022 at 10:34 AM

So in the paper from a quick skim read they're suggesting a new method for data representation (pairwise similarities), and you suggest adding style vectors (which is another representation method essentially as far as I know) can improve it for multimodal tasks? I think that makes sense, reminds me of contextual word embeddings if I didn't misunderstand anything.