Most of the ML libraries use mostly C++, we just use Python as an interface to make it easier to code and deploy. So really you are using C++ code.

Also PyTorch is a tensor computing library so of course you can only use tensors in Neural Networks.