Viewing a single comment thread. View all comments

mrfreeman93 t1_j9yy6pw wrote

One step closer to decent short term memory is increasing input length. If it works, that's great. There have been architectures like longformer for a while though

1