Comment by famouswaffles

GPT-4 will often get the modified question of you change its "shape" enough. It's clearly overfit to that question so making the modified question not look like the one from training. Sometimes changing the names is enough.