Comment by evilturnip

3 days ago

This whole thing is comedy.

Anthropic pretending Mythos 5 is so capable it's going to destroy everything, but will release it anyway with "safeguards" (when does this ever work?).

US Gov't using this fake hype as an excuse to handicap Anthropic simply because they have a vendetta.

Nothing is funny about LLMs being restricted like air travel.

  • I'm also not laughing here.

    This is likely to delay, if not prevent, the release of more capable models in the future.

    And apart from the big picture, I just paid Anthropic $200 on Friday with the understanding that I can use the model for 10 days until the 22nd.

    I planned two productive days of work this weekend. There's still Codex, but I'm obviously disappointed with this and want my $200 back.

  • > Nothing is funny about AI being restricted like air travel.

    Yeah it is.

    Unless you work at Anthropic, OpenAI, Google, or Meta.

    Your stocks/RSU are at risk of losing significant value.

My first thought is that this government-Anthropic feud is good publicity for both of them.

  - Anthropic is seen as a victim/hero
  - They get Government-endorsed model hype
  - Monday will be a bad publicity day with the new Agent SDK limits, this overrides/dominates the headlines

  - The government gets to appear like they're ahead of the curve
  - The government gets to appear forcible and weapons-conscious (and maybe earn some right-wing points)

The government is possibly a real threat here, but it's also possible that this is a case of knights rallying the mooks (https://ribbonfarm.com/2020/01/16/the-internet-of-beefs/), and the models will be back online Monday with a note that "we gave em hell in court because we're so smart and dedicated and talented and good at beefing"

I wonder if there even is a real vendetta. How many people in the administration / friendly with the administration would benefit financially from the IPO? Maneuvers like this still pump more air into the hype balloon. I suspect that Anthropic and its backers did not enjoy the many "meh" reviews that Fable has received for its modest bump in output quality.

  • I don’t think there’s a vendetta. I think that Dario is an ideologue who has been letting his ideology cloud his business judgment.

    I don’t think he’s playing 4D chess; I think he truly believes all the “AI is going to eliminate all the jobs” crap. I think his “Claude Constitution” is wishful thinking and his attempts to exert control over what his customers lawfully do with the product he sells them have made his company untrustworthy; certainly so by the US Dept of War.

    I think lately his advisors have made him tone down the doomerism noting that it might tank his IPO, and I am uncertain whether his recent pushes towards more regulation are regulatory capture attempts or ideology or both.

    The man is smart but IMO shouldn’t be running the company- he should be a CTO and let a business person make the decisions.

    As for the government, bureaucracies gonna do what they always do. If you scare them they regulate you. ITAR is a real thing and the government throws it at technology all the time, from the minds that brought you 40-bit SSL in the 90s.

    • > The man is smart but IMO shouldn’t be running the company- he should be a CTO and let a business person make the decisions.

      Well he didn't like Sam doing it, and whoever CEO puppet he finds will be a Sam-like figure anyway.

    • >I think lately his advisors have made him tone down the doomerism noting that it might tank his IPO, and I am uncertain whether his recent pushes towards more regulation are regulatory capture attempts or ideology or both.

      and I think there's a dozen people carefully crafting every doomerism, which is then handed over to a dozen guerilla marketing companies to be spread far and wide.

      2 replies →

  • Anthropic drops defense work, OpenAI picks up, Anthropic files for IPO, after that OpenAI files for IPO, now Anthropic's IPO looks not that good... thus making for much better OpenAI IPO. I'm wondering whether the Trump's son has any connection to OpenAI as the companies he is connected to have been very lucky to get various government benefits/contracts/etc. on "pure merits".

    And that:

    https://www.cnet.com/tech/services-and-software/trump-ai-exe...

    "OpenAI's Sam Altman Meets With Trump in Wake of Executive Order on AI"

I find it funny that AI keeps getting bigger, and the mental gymnastics needed to trivalize the progress get bigger as well - ie the government shutdown an AI model twisted into now even the government is being tricked.

Everyone is tricked except me. Only I know AI isn't as smart as everyone thinks it is.

  • “Too dangerous to release” has been exploited for marketing.

    A sizeable plurality of the informed public know as much.

    Regulatory capture is a thing.

  • Or you could use it, and see the massive disconnect between hype and reality yourself. It’s not hard.

    The market is built on hype, so of course it’s going to get hyped everywhere.

    • I've seen Fable reverse engineer binaries like nothing I've used before - Fable/Mythos is far from marketing hype.

      On top of that I think it's just stupid to think anyone in the marketing department at Anthropic has any part in the system card for a model. That kind of thinking just screams cope.

      5 replies →

  • I'm sorry that I think that "Our LLM is the missing element for a group to develop nukes or bioweapons" is marketing hogwash.

    I'll guess we will see when or if the IPO happens. The more probable claim (Trump just wants money) will be proved if Amodei buys Truth Social or something and pulls a Tim Apple. My (not very probable) tinfoil hat theory is sadly unverifiable, but very funny. Anthropic bribed some Trump minion to ban Fable and lock in the honeymoon period until just before the IPO.

  • Not as smart as everyone thinks it is, maybe, but a model like Fable 5 without safeguards against offensive cyber attacks would be a nightmare. There are millions of improperly secured web applications that, in the wrong hands, would be easily exploited by these models.

    • There have been millions of trivially exploitable vulnerabilities out there for decades — many of which could be easily discovered by using simple scanning tools or manual probing. This is hardly a new situation and LLMs really aren't that impressive at pentesting — even with these simple exploits. Maybe they are if you're not a pentester, but then ZAP, Burp, Nessus, SQLMap, etc. are likely also impressive if you put a little effort into learning how to use them, but many AI-advocates aren't interested in learning skills themselves.

      It's the same situation as with vibe coding. Everyone and their grandma can have an LLM spit out a web application without any programming experience, but if you're a programmer, you'll likely quickly see some issues with maintainability and further development of the code base.

      3 replies →

    • In a substantially different way then how it is now? You can put something listening on 22, 80 and 443 and log how much stuff tries to get in.

      1 reply →

  • I feel like it is strange seeing some really smart people go full conspiracy theory tin foil hat. Half these threads think that Anthropic is playing some 5D chess game to purposefully get nationalized.

Where's the people who complain about the government picking winners? Strange that they suddenly travel somewhere without internet or lose their vocal cords.