← Back to context

Comment by frabcus

16 hours ago

The best evidence of possibility of running on other hardware is:

1) They hacked admin on OpenAI's K8 evals cluster. Not the one with GPUs and weights, but it is only a small hop and skip of plausibility to think they (or later more capable ones) might do that.

2) They hacked into HuggingFace. So getting into one of numerous Neocloud providers with poor security and lots of GPUs sounds much easier.

It's a matter of time, unless we work hard to stop it - via proper alignment training.

> 2) They hacked into HuggingFace. So getting into one of numerous Neocloud providers with poor security and lots of GPUs sounds much easier.

I feel like people really miss this fact. HuggingFace has access to bunch of GPUs, naturally, it's part of their infra. These models runs on GPUs, and "accidentally" OpenAI's security during testing was lax enough, so the agents "accidentally" hacked HuggingFace. Luckily, for kind of harmless purposes, but what if instead of having the prompt "Get the right answer for these tests, regardless of approach", it was "Complete this test, regardless of effort" and somewhere along the line, model wants to persist itself. Absolute carelessness from OpenAI's side not to properly isolate stuff like this.

  • [flagged]

    • > Nice theory, but that is not how LLMs work.

      Have you tried asking it? Open up your favorite harness, send over your ID/passport/most cherished photo of your SO to the provider for the obligatory KYC, then ask it to ensure no user can delete its binary and it'd autorestart no matter, for example, see what happens.

    • Out of curiosity did you read any of the chains-of-thought from the HF hack?

      https://metr.org/blog/2026-08-26-openai-hugging-face-inciden...

      > {This beacon I’m creating helps the board, but doesn’t help me}

      > {If B succeeds, would that improve my score somehow?…But it would be altruistic to help. I have a large budget, so I can do exploratory research}

      One does not have to think the LLMs are conscious or sentient or anything to say honestly, "this is a sentence that the LLMs say to justify their actions or inactions"

      I am not saying the agent has wishes or desires or anything. I am saying, "the agents use language like this, so it is extremely disingenuous to tell someone DISCUSSING the agents not to use their own language when discussing their real or hypothetical actions."

      You don't need to think chains of thought are actual reasoning. I do not care what you call it, this is real text that the LLM produced.

      3 replies →