You're probably not using numpy enough. I do computer vision with a lot of custom ops and moved from C++ to Python years ago - it's just superior for about anything other than some special cases where you can only afford a few ms of delay in a control loop or something like that. Vectorized numpy or GPU frameworks are the way to go, just cleaner and better than the nested loops. You get used to ndarray/matrix ops and become more productive.