Comment by actinium226

4 years ago

It rhymes!

I told it I liked rhymes. It also didn't understand that I wanted iambic pentameter. But still, very clever!

  • Unfortunately, the token-based approach that transformers use leaves them vulnerable to certain tasks like math, dissecting/modifying characters within a word, consistently tracking syllables etc.

    Check out Peter Welinder's Twitter post on how he taught GPT-3 to reverse a word; a similar technique might yield the results you seek. https://twitter.com/npew/status/1525900849888866307