Comment by jgalt212
1 year ago
Right, but if there's only a small portion of my code that does string search and it's a hot path, it would still be much much much more convenient to access SIMD-based string search code direct from Python rather than writing the code (LLM or not) in another language and then construct bindings (LLM or not).
2 problems.
1. Python's data types are all bad for performance
2. once you optimize once part, a new part will be the bottleneck
You can use cython and call C SIMD code from it.