← Back to context Comment by actinium226 4 years ago It rhymes! 2 comments actinium226 Reply all2 4 years ago I told it I liked rhymes. It also didn't understand that I wanted iambic pentameter. But still, very clever! soulofmischief 4 years ago Unfortunately, the token-based approach that transformers use leaves them vulnerable to certain tasks like math, dissecting/modifying characters within a word, consistently tracking syllables etc.Check out Peter Welinder's Twitter post on how he taught GPT-3 to reverse a word; a similar technique might yield the results you seek. https://twitter.com/npew/status/1525900849888866307
all2 4 years ago I told it I liked rhymes. It also didn't understand that I wanted iambic pentameter. But still, very clever! soulofmischief 4 years ago Unfortunately, the token-based approach that transformers use leaves them vulnerable to certain tasks like math, dissecting/modifying characters within a word, consistently tracking syllables etc.Check out Peter Welinder's Twitter post on how he taught GPT-3 to reverse a word; a similar technique might yield the results you seek. https://twitter.com/npew/status/1525900849888866307
soulofmischief 4 years ago Unfortunately, the token-based approach that transformers use leaves them vulnerable to certain tasks like math, dissecting/modifying characters within a word, consistently tracking syllables etc.Check out Peter Welinder's Twitter post on how he taught GPT-3 to reverse a word; a similar technique might yield the results you seek. https://twitter.com/npew/status/1525900849888866307
I told it I liked rhymes. It also didn't understand that I wanted iambic pentameter. But still, very clever!
Unfortunately, the token-based approach that transformers use leaves them vulnerable to certain tasks like math, dissecting/modifying characters within a word, consistently tracking syllables etc.
Check out Peter Welinder's Twitter post on how he taught GPT-3 to reverse a word; a similar technique might yield the results you seek. https://twitter.com/npew/status/1525900849888866307