Comment by adgjlsfhk1
1 year ago
why would you want to? if you are performance bound with Python code, you can pick up a 20-50x performance improvement by switching language.
1 year ago
why would you want to? if you are performance bound with Python code, you can pick up a 20-50x performance improvement by switching language.
Right, but if there's only a small portion of my code that does string search and it's a hot path, it would still be much much much more convenient to access SIMD-based string search code direct from Python rather than writing the code (LLM or not) in another language and then construct bindings (LLM or not).
2 problems.
1. Python's data types are all bad for performance
2. once you optimize once part, a new part will be the bottleneck
You can use cython and call C SIMD code from it.