Submitted by op_prabhuomkar t3_10iqeuh in MachineLearning
kkchangisin t1_j5if8hc wrote
Reply to comment by op_prabhuomkar in [P] Benchmarking some PyTorch Inference Servers by op_prabhuomkar
Depending on how much time I have there just might be a PR coming your way 😀…
Triton is really a somewhat hidden gem - the implementation and toolkit surrounding it is pretty impressive!
Viewing a single comment thread. View all comments