Comment by jacquesm
8 years ago
Python derives a good chunk of its speed (if not all of it) from carefully tuned libraries written in other languages (or even for other architectures in the case of many machine learning packages). As soon as you try to do a lot of heavy processing python even the compiled versions quickly bog down. IMO the best way to use python is to use it to cleverly glue together highly optimized code. That way you spend the minimum amount of effort and you get maximum performance.
Multithreading is the glue I need. How am I supposed to write optimized native module to spawn threads to do computation in numpy and pandas?
Yeah, that was kind of my point :/