Submitted by super_deap t3_11tmpc5 in MachineLearning
felheartx t1_jclij93 wrote
Reply to comment by hfnuser0000 in [D] PyTorch 2.0 Native Flash Attention 32k Context Window by super_deap
I have no idea about how many other ways there are, but this looks extremely promising: https://arxiv.org/abs/2301.04589#
So there's at least one :P
Viewing a single comment thread. View all comments