Can you upload a sample? Is it a bandwidth issue, a booming mic issue, cracks and pops issue...etc.

If the recordings are not confidential, I can process them for you (because we are not ready to publish the model yet). If you prefer public model, this one is pretty good: https://huggingface.co/spaces/hshr/DeepFilterNet2

Nvidia RTX voice

Try denoiser from facebook

I used https://audo.ai/noise-removal for my own lectures: it’s more than good enough to make up for a poor microphone and background noise. You can try for free on your own audio samples and see for yourself!

yep not confidental

how can I reach you? here my email : monstermmorpg@gmail.com

here example lecture. i will clean over 100 lectures: https://youtu.be/2zY1dQDGl3o

here 5 min example part of this video : https://sndup.net/stjs/

this is pre recording. how can I use it to process this recordings fast?

>Nvidia RTX voice

example link that you can download extract audio quickly if you wish : https://youtu.be/2zY1dQDGl3o

also here 5 min example speech : https://sndup.net/stjs/

>denoiser

I need a post-processor for existing recordings. Would that work for that? could give me link?

i tested and 0 improvement for this audio : https://youtu.be/2zY1dQDGl3o

test from here : https://audo.ai/noise-removal

The audio is a bit distorted possibly due to noise gating. I don't see too much noise, so maybe noise reduction is not what you need. The audio has 8 kHz bandwidth (16 kHz sample rate), maybe you may try to use an audio super-resolution network such as https://github.com/mindslab-ai/nuwave2 to increase the audio bandwidth.

yes i had tried some options obs back in time. it was probably noise gate. even i forgotten it.

thank you so much for reply gonna test that repo now

their example really good improvement but do i need training for that?

opened an issue thread but not much hope : https://github.com/mindslab-ai/nuwave2/issues/11

Anyway, here is the denoised audio of your example speech: https://www.sndup.net/pbxf/. There is no improvement, your best bet is audio super-resolution.

Input: Speech MOS: 4.259 Noise MOS: 4.369 Overall MOS: 3.927

Output: Speech MOS: 4.263 Noise MOS: 4.403 Overall MOS: 3.947

>audio super-resolution

thank you so much for answers and testing

any idea to get super resolution ? or my only option is mindslab-ai/nuwave2 ?

Just download the checkpoint and use the command at Inference session. sr should be 16000

thanks i made it work

however i got out of memory error on RTX 3060 - 12 GB vram

it is like a joke :/

https://i.imgur.com/KslqNBg.png

https://github.com/facebookresearch/denoiser

Use the pretrained model on your recordings

thank you so much

i tested with model = pretrained.dns64().cuda()

is this their best pre trained mode?

Try https://podcast.adobe.com/enhance (formerly Adobe Shasta). This gave best results for me.

Not sure, it's been a while since I last used it

I see - best of luck with the other solutions then!

Greets again, you've been helping me with SD. I Followed your account last night and noticed this post. I'm a recording musician and though I might be able to help you out with this issue.

Here is my result after using the audio editor Reaper to apply EQ and Compression.

Process with a sliding window would solve your problem, see e.g. https://colab.research.google.com/github/asteroid-team/asteroid/blob/master/notebooks/04_ProcessLargeAudioFiles.ipynb

Transcribe them and put the transcripts in TTS

thank you for trying to help

what you mean by that? i have transcripts but then what to do? thank you

Instead of trying to salvage the original recording why not recreate it by putting the text transcript into a text-to-speech model?

As you have it transcribed you don't even need to do any advanced speech recognition that filters the noise, just paste the text into something a bit more advanced than Microsoft Sam

[removed]

Yes dns64 is better/larger than their other pretrained (48 I think)

thank you

but what about synching? how to solve synching problem?

i haven't found any way to re-voice with proper synchronization

i can prepare a perfect .vtt file but how to sync it with video?

thanks

no idea where to put this code in nuwave2

Could you speech-to-text your lecture, collecting timestamps, do the same with TTS and automagically sync that way?

i have vtt file you know the subtitles we use for movies

but i haven't found and text to speech that can generate speech with that timing

do you know any?

​

about your suggested approach, any way to automatically do it? i mean we generate speech then we sync but how?

wow this is amazing

how can I contact to you?

my email : monstermmorpg@gmail.com

my discord : MonsterMMORPG#2198

> audio editor Reaper to apply EQ and Compression

if you make a video i would watch it and show me how to do :D

I'm not sure how I'd go about syncing it, but would this be an adequate workaround:

• break apart your script in small chunks by time stamp
• generate different tts recordings off of each time stamp
• generate an audio file that inserts each of the produced recordings at their respective time-stamped location
• replace the audio of the recording with your newly produced recording

don't put your email in public like this. dm the guy. remove the email while you still can.

EQ and Compression are good techniques to try, reaper is free. I'm sure your friend can show you.

it is fine this is my public email

​

thank you for warning

MonsterMMORPG eh? Very interesting!! :D

so it is a logical layout

any software that can do it?

ye that is the game ,i develop : https://www.monstermmorpg.com

I think this is more likely a task for Python. I haven't done anything like this myself, it's just the approach I would start with.

Hey, seriously, if you are ever interested I can write something up. I need to anyway for future reference, the mechanics of sound are what musicians are all about yet shockingly few actually trace their craft back to the root, the simple physical properties of the medium.

Oh wow, I can't wait to check that out! I was just telling my son about the old days of Telnet gaming of which I dabbled in. I was a member of an old school (post Telnet) early graphical MMORPG called DragonSpires which itself spawned Furcadia, now the longest continuously running MMORPG online last time I checked? Or something like that. Then I went on to help run a Player Worlds based MMORPG called Delrith Online. Seems like soooo long ago now...

this is also very old school

text and image based but extremely in depth game mechanics

if only i were not a c# programmer but a python programmer :/

Check out murf.ai, that service works similarly to what i described

I have it bookmarked, I will definitely fire it up and take a spin. I will probably steal borrow some ideas for a Scratch project :)

tested looks awesome but i have to purchase yearly plan which is 3500$ lol :D

I am also interested in having you process two recordings. They both a little over 40 minutes in length. If you feel you can do this, please contact me at (email address removed). Thanks.

Thought I had previously replied. I am also interested in letting you to try and clean up my two audio files, or know when it goes public. The are both over 40 minutes, were recorded in a car and the microphone was held too close

Pls upload it somewhere, preferably, wav format. I will do it when I have time.

Thank you. I have uploaded the two audio files in a wav format to Google docs but will need an email address in order to share this with you. How do you suggest you get that information to me?