Comment by kybernetikos

It undercuts the whole piece. The pronouncements feel question begging. Much of the article suggests someone who hasn't actually bothered to spend much time asking ChatGPT the questions he is so confident it can't answer well. He also doesn't seem aware that ChatGPT is a deliberately tamed model that is trying desperately to shy away from saying anything too controversial, and that was a choice made by openai, not something that highlights limitations with language models in general (or if it does, it's an entirely different, political question than technical question).

I accept that it's possible that he has some deep reasoning for the surface level arguments he's making that would make them less arbitrary seeming, but he hasn't even hinted at them in the article.