[D] PyTorch 2.0 Native Flash Attention 32k Context Window Submitted by super_deap t3_11tmpc5 on March 17, 2023 at 9:59 AM in MachineLearning 99 comments 345
mike94025 t1_jcv7ltl wrote on March 19, 2023 at 8:30 PM Reply to comment by royalemate357 in [D] PyTorch 2.0 Native Flash Attention 32k Context Window by super_deap You might look into https://github.com/pytorch/pytorch/pull/95793. Permalink Parent 3
Viewing a single comment thread. View all comments