Viewing a single comment thread. View all comments

Lewba t1_ixe8x1x wrote

If it's integrated with Optimum, does that mean Optimum's ORTOptimizer and ORTQuantizer work with these models (after conversion of course)?

1

fxmarty OP t1_ixgnwin wrote

Unfortunately, the ONNX export with BetterTransformer will not work. It's a bit unfortunate the model optimization / compression efforts are spread out between different (sometimes) incompatible tools, but then again different use cases require different toolings.

1

Lewba t1_ixgp0jc wrote

Understandable. I'll just have to choose between ORT optimized and BetterTransformer in the meantime.

1