Viewing a single comment thread. View all comments

avialex t1_janjx6r wrote

Reply to comment by mmmniple in [D] Are Genetic Algorithms Dead? by TobusFire

Appears to be here: https://openreview.net/forum?id=ibNr25jJrf

edit: actually after reading it, I don't think this is the referenced publication, but it's still interesting

1

filipposML t1_jaooo3f wrote

Hey, this is it actually! We are optimizing a discrete variational autoencoder with no gumbel-softmax trick.

1

filipposML t1_jaop5vw wrote

Of course we require no encoding model, so the notion of a latent space only holds up until closer inspection.

2

avialex t1_jap04wq wrote

I was kinda excited, I had hoped to find an evolutionary algorithm to find things in a latent space, I've been having a hell of a time trying to optimize text encodings for diffusion models.

1

filipposML t1_jaq6tpq wrote

You just need a notion of a fitness function and then you can apply permutations to the tokens.

1