pommedeterresautee OP t1_j7tp663 wrote on February 9, 2023 at 9:30 AM

Reply to comment by programmerChilli in [P] Get 2x Faster Transcriptions with OpenAI Whisper Large on Kernl by pommedeterresautee

I guess you better know than me :-)

Which part? The dispatcher thing or it's spread on several steps?

programmerChilli t1_j7tpwd7 wrote on February 9, 2023 at 9:40 AM

Lots of things. You can see a flamegraph here: https://horace.io/img/perf_intro/flamegraph.png (taken from https://horace.io/brrr_intro.html).

Dispatcher is about 1us, but there's a lot of other things that need to go on - inferring dtype, error checking, building the op, allocating output tensors, etc.