Comment by soulofmischief

Unfortunately, the token-based approach that transformers use leaves them vulnerable to certain tasks like math, dissecting/modifying characters within a word, consistently tracking syllables etc.

Check out Peter Welinder's Twitter post on how he taught GPT-3 to reverse a word; a similar technique might yield the results you seek. https://twitter.com/npew/status/1525900849888866307