qalis t1_j8r6o9x wrote on February 16, 2023 at 10:57 AM

Completely agree. Their "side libraries" are even worse, such as Optimum. The design decisions there are not questionable, they are outright stupid at times. Like forcing input to be a PyTorch tensor... and then converting it to Numpy array inside. Without an option to pass a Numpy array. Even first time interns at my company tend not to make such mistakes.

fxmarty t1_j8r8inv wrote on February 16, 2023 at 11:21 AM

Thank you for the feedback, I feel the same it does not make much sense. My understanding is that the goal is to be compatible with transformers pipelines - but it makes things a bit illogical trying to mix ONNX Runtime and PyTorch.

That said, Optimum is an open-source library, and you are very free to submit a PR or to do this kind of request in the github issues!

krumb0y t1_j8r8mfl wrote on February 16, 2023 at 11:22 AM

Why don't you build us a better alternative?

qalis t1_j8r97h8 wrote on February 16, 2023 at 11:29 AM

I do make PRs for those things. The average waiting time for review is about a few months. The average time to actually release it is even more. I both support and criticize Huggingface.