Viewing a single comment thread. View all comments

amnezzia t1_j2ljq54 wrote

Make it part of the sequence? Kinda like special tokens in language models.

9

farmingvillein t1_j2lnxdd wrote

Or, for vectors, just slam it into the start of the sequence directly (use a normalization technique if you need to align dimensionality).

If you feel the need, place some sort of separator token ('###') between the "context features" and the input data.

6