Submitted by parabellum630 t3_z088fo in MachineLearning
leoholt t1_ix5ygsg wrote
Reply to comment by neuroguy123 in [R] Tips on training Transformers by parabellum630
Would you mind elaborating what a unit-test for the positional encoding is? I'm quite new to this and would love to give it a shot.
Exarctus t1_ix7avzz wrote
You basically want to extensively test that the sequential elements in your input are being mapped to unique vectors.
Viewing a single comment thread. View all comments