Lewba
Lewba t1_ixe8x1x wrote
Reply to [P] BetterTransformer: PyTorch-native free-lunch speedups for Transformer-based models by fxmarty
If it's integrated with Optimum, does that mean Optimum's ORTOptimizer and ORTQuantizer work with these models (after conversion of course)?
Lewba t1_ixgp0jc wrote
Reply to comment by fxmarty in [P] BetterTransformer: PyTorch-native free-lunch speedups for Transformer-based models by fxmarty
Understandable. I'll just have to choose between ORT optimized and BetterTransformer in the meantime.