Comment by eurekin

AFAIR, SVMs have one optimal solution, achievable analytically. NN can get stuck in local optima.

If a transformer is a SVM, could we simply extract it out and optimise the hyperplane like for any SVM?