Comment by consilient

> From what I remember it's quite easy to have a SVM overfit ... It'd be interesting to understand why

SVMs with well-tuned kernels and regularization are reasonably resistant to overfitting. The problem is that you can easily end up overfitting the hyperparameters if you're not very careful about how you do performance testing.