timy2shoes
timy2shoes t1_iuoafb9 wrote
Reply to comment by nivrams_brain in [N] Meta AI | Evolutionary-scale prediction of atomic level protein structure with a language model by xutw21
Industry
timy2shoes t1_iuo4xa4 wrote
Reply to comment by nivrams_brain in [N] Meta AI | Evolutionary-scale prediction of atomic level protein structure with a language model by xutw21
ML-guided protein engineering.
timy2shoes t1_iunym8r wrote
Reply to [N] Meta AI | Evolutionary-scale prediction of atomic level protein structure with a language model by xutw21
We've been testing out their embeddings for transfer learning tasks and they've been performing quite well. Better than previous embeddings that we have tested. The 15B parameter model though is a pain in the ass. Getting the embeddings requires a workaround that is difficult to implement. Probably not worth it in my opinion.
timy2shoes t1_iuptv7y wrote
Reply to comment by ROFLLOLSTER in [N] Meta AI | Evolutionary-scale prediction of atomic level protein structure with a language model by xutw21
We had to do a workaround to fit the 15b parameter model on a p3.8xlarge instance.
> I've also been working with ESM and tried the 15B parameter variant.
Huh. We’ve noticed the same thing. Interesting that others are having the same problem.