Small-Reason-8096 t1_irzvwc8 wrote on October 12, 2022 at 8:01 AM

Reply to comment by TheInfelicitousDandy in [D] Recent ML papers to implement from scratch by nullspace1729

That surprises me as there was a good Fastai version:

https://docs.fast.ai/text.models.awdlstm.html

which is built on pytorch. When I played with it ages ago the results seemed comparable to the paper, but I haven't revisited it for a while :)

TheInfelicitousDandy t1_is0ajet wrote on October 12, 2022 at 11:22 AM

As far as I know that version doesn't give comparable PPL.

Someone else saying the same https://github.com/salesforce/awd-lstm-lm/issues/86#issuecomment-453266265

A major issue here (and for other reproductions) are people saying they have a reproduction because they can run it without errors but never actually getting the same results.