Hey guys wanted to show you my app which offers a convenient frontend to use Whisper for transcriptions with Libretranslate to power automatic translations

Code is all open-source here: https://github.com/mayeaux/generate-subtitles

Also running an instance that you can use for free at https://freesubtitles.ai

Comments

omar91041 t1_j0ql5q8 wrote on December 18, 2022 at 6:07 PM

#963,408

I quite like the idea. Super helpful! Keep up the good work!

m98789 t1_j0qqo7p wrote on December 18, 2022 at 6:39 PM

#963,672

Do you know if Yiddish is supported?

meddit_app OP t1_j0qsznf wrote on December 18, 2022 at 6:53 PM

#963,776

Replying to m98789 (#963,672)

Yup it's supported

muffdivemcgruff t1_j0rgc3l wrote on December 18, 2022 at 9:24 PM

#964,955

This is dope!

meddit_app OP t1_j0rvyhe wrote on December 18, 2022 at 11:14 PM

#965,680

Replying to muffdivemcgruff (#964,955)

Thanks! A lot more cool features to come for sure. Auto download content with yt-dlp among other things

JustOneAvailableName t1_j0tj00w wrote on December 19, 2022 at 8:14 AM

#968,812

Did you compare results with the build in translate of Whisper?

CallMeInfinitay t1_j0tux3y wrote on December 19, 2022 at 11:08 AM

#969,375

Thanks for offering this service. One suggestion I have is to add support for Facebook's NLLB-200 model instead of Libretranslate

meddit_app OP t1_j0u3hoj wrote on December 19, 2022 at 12:50 PM

#969,895

Replying to JustOneAvailableName (#968,812)

Not really, the issue with Whisper's built in translation is that you have to in essence re-transcribe the entire content so it doesn't really scale. Libretranslate isn't amazing but it works pretty decently.

meddit_app OP t1_j0u3kkq wrote on December 19, 2022 at 12:51 PM

#969,901

Replying to CallMeInfinitay (#969,375)

>Facebook's NLLB-200

I'll definitely look into that thanks for the suggestion.

moonblaze95 t1_j1386rh wrote on December 21, 2022 at 9:53 AM

#993,138

Can’t whisper do translation without outside software? What’s the purpose of libretranslate?

meddit_app OP t1_j14z1zw wrote on December 21, 2022 at 6:29 PM

#997,689

Replying to moonblaze95 (#993,138)

The only way Whisper can transcribe is from doing a full transcription which is a very expensive process, there is no way to translate already generated text

emotionalfool123 t1_j1cf866 wrote on December 23, 2022 at 7:00 AM

#1,019,473

Can we scrape the transcripts generated in other languages using auto-translate feature of youtube CC option? It has all the languages one needs.