I'm evaluating different architectures for audio classification and I'm a bit lost. I found a couple of survey papers but those are 2 years old and I'm looking for something newer.

Have there been any major advances in this field?

Comments

You must log in or register to comment.

hostilereplicator t1_iszozfg wrote on October 19, 2022 at 9:37 PM

In the mean time could you share the review papers here? I'm also trying to catch up on this area!

iori42 t1_it1d1y4 wrote on October 20, 2022 at 5:51 AM

You can take a look at the leader boards on paperswithcode.com. E.g. for audio classification on the AudioSet dataset: https://paperswithcode.com/sota/audio-classification-on-audioset

the_javi_himself OP t1_it1s5tu wrote on October 20, 2022 at 9:27 AM

>https://paperswithcode.com/sota/audio-classification-on-audioset

Great resource, thanks a lot!

By the way, do you know if we can access a pretrained version of any of these models? I've found many for computer vision but none for audio.

iori42 t1_it1t572 wrote on October 20, 2022 at 9:41 AM

I don't know about general audio classification, but there are some pretrained models for speech applications (ASR, speaker verification, speech detection). But maybe this is useful for you: https://github.com/qiuqiangkong/audioset_tagging_cnn

firejak308 t1_it2esjt wrote on October 20, 2022 at 1:22 PM

If you go on PapersWithCode and click the GitHub icon for any of the papers, it'll link you to their public repo, which in many cases will have pretrained models available.

Mysterious_Tekro t1_itfcalr wrote on October 23, 2022 at 5:47 AM

I designed synthesisers for about 10 years so I lot about audio analysis And digital signal processing and I spent a few years thinking about the topic you are enquiring about so Have a shitload of technology on that subject but it's worth a lot of money and I'm probably gonna wait until I have enough money to employ 10 developers to do something commercial with it.

BruceSwain12 t1_it01bwa wrote on October 19, 2022 at 11:05 PM

Did you look only for audio classification papers ? I suspect the time series classification papers could also fit your needs. I can share what I know from recent works if needed.

the_javi_himself OP t1_it01l31 wrote on October 19, 2022 at 11:07 PM

The task that I'm trying to solve is audio based, so I guess my best bet is to focus the search on models specifically built for that. Do you know any of those?

BruceSwain12 t1_it03jeq wrote on October 19, 2022 at 11:22 PM

I mean, audio is just the type of data, it is still represented as an ordered series of points. If i remember on the timeseriesclassification.com website you got quite a lot of audio datasets.

For models, you could look at libraires like sktime, convst, tslearn.

If you don't care about speed or interpretability, I would suggest looking at HIVE COTE 2. If you need faster training, ROCKET or RDST/RDST ensemble (in convst), or simply a 1-NN with DTW, which can represent a baseline.

Mysterious_Tekro t1_itez6wo wrote on October 23, 2022 at 3:26 AM

Its not about models its about analysis technology. Ive got the latter.