Not so surprising to me if you have read the paper where language models can even transfer the reasoning ability to language after being trained on something like code. https://arxiv.org/abs/2201.11473