blry2468 OP t1_ixpntx4 wrote
Reply to comment by a4mula in ELI5: Whats does compute credits in Google Colab actually do to the code running speed as opposed to normal free Colab by blry2468
My problem is just that my code takes 42 hours estimated run time. It is completely conventional python code. I was just wondering if this colab + would be beneficial in this scenario cause idk what the colab + actually does to conventional code.
a4mula t1_ixpoeud wrote
Have you stopped to consider that perhaps there's an alternative approach to more effective algorithms?
Unless you're doing something along the lines of SQL calls to the world's largest async database, your code probably shouldn't require 42 hours to complete.
Not that there isn't code like that. But those aren't being run on either local pcs or colab.
Can you explain in two sentences or less what the gist of this program is?
blry2468 OP t1_ixpouh4 wrote
The program is running a radar simulation and signal processing algo which runs many loops to generate an ROC graph to check efficiency of radar detection method. The base code of simulation and detection takes 30s to run and there are multiple for loops around it to generate the data points for a graph with axises of probability of detection, probability of false alarm and Signal to noise ratio varying. This means 3 for loops, each within each other, one with 25 repetitions, one with 30 and one with 10. This sums the time to 42 hours.
Pocok5 t1_ixpumno wrote
> It is completely conventional python code.
So, you're not doing any GPU compute at all? Only CPU? See if your algorithm can be parallelized on a GPU (a good sign that you can do so is doing the same operation over elements of huge arrays where computing the result depends only on the input array - a convolution is such, trying to do fill a vector with a fibonacci sequence is not).
blry2468 OP t1_ixpvkpt wrote
Unfortunately my code is not running the same operation over again but with changes at each time it loops for graph plotting of different points. The code also draws from multiple other code files not just an array and so idt it can be converted to be gpu utalised?
blry2468 OP t1_ixpvnjr wrote
What is the requirements for it to be gpu utalised thou? Like from what I know, usually my codes only use gpu if its a AI or machine learning code not normal conventional coding?
Pocok5 t1_ixpxqo9 wrote
A GPU can do a shitton of data-parallel stuff. If you find yourself doing the same operation over a ton of data points, it's worth thinking about whether you can do it all at the same time. Since you are doing python, check Numba https://carpentries-incubator.github.io/lesson-gpu-programming/03-numba/index.html
https://numba.readthedocs.io/en/stable/cuda/cudapysupported.html
blry2468 OP t1_ixpyuub wrote
Yes, except my for loops use the number of times it is looped and the loop step as variables, so it does not repeat the same operation over and over again cause it changes each time it loops by abit. So thats the issue.
Pocok5 t1_ixq2k5l wrote
If it's just that then it's no issue, in fact it is integral to how CUDA works (I'm assuming loop step is constant over one run of a loop). You get the index of the current thread and you can use it - for example the CUDA prime check example is "check the first N integers for primes" -> start N threads and do a prime check algorithm on the thread index. The only problem happens if your loop #n+1 uses data calculated during the #n loop.
a4mula t1_ixppup5 wrote
Have you researched loopless coding at all? If nothing else, are you practicing sound early exit strategies?
If it's not proprietary code, or if you can slap together a pseudo version that's okay for public consumption you might paste it up to something like stackoverflow.
Nested loops are standard practice, on small datasets.
This is not that.
I'd take a peek at this wiki on nested optimization to get an idea how how you might get around it.
If not, again stackoverflow is a great resource full of expertise in things like optimization.
Viewing a single comment thread. View all comments