Comment by furyofantares

It helps a little. ChatGPT4 still fails the following prompt fairly often (maybe 40% of the time):

which of these 5-letter sequences a has P in position 4?

P U P I L

S T A P H

C R E E P

P O O P Y

L I P I D

It usually gets it if it reiterates each sequence before deciding (but not always) and it almost always fails when it just answers right away.

And this doesn't actually help at all with the actual related Wordle problem - "think of a 5-letter word with P in the fourth position".

You could try filling up its context with a list of a thousand of the most common 5 letter words all spelled out (and I've done so, even with additional hints like the positions of the letters in parens). But it really didn't help (as might be expected since it can't even reliably do it with the above list of 5 words.)