Quite often, developer time is more valuable than machine time. It's therefore cheaper and more efficient and even sometimes faster, to quickly write the code and spend more on compute power, than it is to reduce compute time at the cost of development speed. Especially in the R&D phase.
Zulfiqaar t1_j13dtqo wrote
Reply to [D] Why are we stuck with Python for something that require so much speed and parallelism (neural networks)? by vprokopev
Quite often, developer time is more valuable than machine time. It's therefore cheaper and more efficient and even sometimes faster, to quickly write the code and spend more on compute power, than it is to reduce compute time at the cost of development speed. Especially in the R&D phase.