← Back to context

Comment by codeulike

17 hours ago

Turing test was definitely and conclusively refuted in the 1960s

Are you sure?

Understood properly, Turings Imitation game aka the turing test, should be adversarial. That is, the player should be asking hard questions to try and discover who is who, not just having an idle chat. No chatbot has been able to consistently pass an adversarial Turing Test until the rise of LLMs

The Imitation Game:

https://www.cs.ox.ac.uk/activities/ieg/e-library/sources/t_a...

Yeah I dont think a single current LLM would fool me in a turing test - I would obiously use all kinds of prompt injection techniques, ask about 'dangerous' or controversial topics, ask about random niche facts in varied fields, etc.

The fact that LLMs often score as "more human" than actual humans is a downstream consequence of ELIZA tricking people into thinking it had a glimmer of consciousness. The Turing test was refuted because it was proven scientifically meaningless in the 1960s, and LLMs only reinforce that.

  • What refutation are you referring to? Surely you can cite how it was "proven scientifically meaningless" some 6 decades ago.