are you using one-vs-all or one-vs-one?

Maybe you can check the gini importance to select some features.

One vs all

try OvO and vote w/ te highest outcome?

a little bit more details ?

build a binary classifier for every combo of classes and pick the highest scoring one. there are def better explanations on google