I would suggest bending the metal arms inwards. Don't bend the top of the headband, extend them out and bend in the arms only. This increases clamp force.

I also have a headband cover similar to the Geekria, this helps a bit too by increasing the contact area but the bending was the larger effect.

Before they were ridiculously loose, now they are secure and very comfortable.