JahrudZ t1_ixdx5d9 wrote on November 22, 2022 at 6:38 PM Reply to comment by younesbelkada in [P] BetterTransformer: PyTorch-native free-lunch speedups for Transformer-based models by fxmarty Any idea why it would be mutually exclusive? Thanks Permalink Parent 1
JahrudZ t1_ixdaa0l wrote on November 22, 2022 at 4:08 PM Reply to [P] BetterTransformer: PyTorch-native free-lunch speedups for Transformer-based models by fxmarty Does this work with deepspeed and int8 models? Permalink 3
JahrudZ t1_ixdx5d9 wrote
Reply to comment by younesbelkada in [P] BetterTransformer: PyTorch-native free-lunch speedups for Transformer-based models by fxmarty
Any idea why it would be mutually exclusive? Thanks