Comment by all2
4 years ago
I told it I liked rhymes. It also didn't understand that I wanted iambic pentameter. But still, very clever!
4 years ago
I told it I liked rhymes. It also didn't understand that I wanted iambic pentameter. But still, very clever!
Unfortunately, the token-based approach that transformers use leaves them vulnerable to certain tasks like math, dissecting/modifying characters within a word, consistently tracking syllables etc.
Check out Peter Welinder's Twitter post on how he taught GPT-3 to reverse a word; a similar technique might yield the results you seek. https://twitter.com/npew/status/1525900849888866307