natural_language_guy
natural_language_guy OP t1_ivmtlc8 wrote
Reply to comment by fastglow in [D] Is there anything like beam search with BERT? by natural_language_guy
Which is the easiest to get started with in your opinion? I want to get a POC working so I can get baseline metrics quickly
natural_language_guy OP t1_ivsdjo8 wrote
Reply to comment by new_name_who_dis_ in [D] Is there anything like beam search with BERT? by natural_language_guy
If the advice is to discard BERT and go with MDN, do you think MDNs in this case would perform better than some large generative model like t5 with beam search?
The MDN does look interesting, and it looks like there are some libraries available for it already, but I don't have much experience using deep prob. models.