Comment by lebovic

1 day ago

I used to work at Anthropic, and I wrote a comment on a thread earlier this week about Anthropic's first response and the RSP update [1][2].

I think many people on HN have a cynical reaction to Anthropic's actions due to of their own lived experiences with tech companies. Sometimes, that holds: my part of the company looked like Meta or Stripe, and it's hard not to regress to the mean as you scale. But not every pattern repeats, and the Anthropic of today is still driven by people who will risk losing a seat at the table to make principled decisions.

I do not think this is a calculated ploy that's driven by making money. I think the decision was made because the people making this decision at Anthropic are well-intentioned, driven by values, and motivated by trying to make the transition to powerful AI to go well.

[1]: https://news.ycombinator.com/item?id=47149908

My lived experience with tech companies is that principles are easy when they're free - i.e., when you're telling others what to do, or taking principled stances when a competitor is not breathing down your neck.

So, with all respect, when someone tells me that the people they worked with were well-intentioned and driven by values, I take it with a grain of salt. Been there, said the same things, and then when the company needed to make tough calls, it all fell apart.

However, in this instance, it does seem that Anthropic is walking away from money. I think that, in itself, is a pretty strong signal that you might be right.

  • HN is pretty polarised about this - they are either “the good guys” or “doing it for positive marketing”.

    I’m on the camp “the world is so fucked up, take the good when you can find it”.

    Beggars can’t be choosers when it comes to taking a stand against dictatorships.

    • Yeah, the alternative is be OK with their product being used for surveillance.

      Not sure why it's controversial that they said no, regardless of the reasoning. Yeah there's a lot of marketing speak and things to cover their asses. Let's call them out on that later. Right now let's applaud them for doing the right thing.

      FWIW I do not think they are the "good guys" (if I had a dollar for every company that had a policy of not being evil...). But they are certainly not siding with the bad guys here.

      3 replies →

    • It's gotta be thus.

      For if you don't the next step is cynicism maximally operationlized: what you're not doing game/political BS to get ahead? What are you? A chump? An idiot?

      That kind of stuff spreads like wild fire making corporate America ... something else to put it politely.

      Doing the right thing has cost me big time here and there. I don't care. Simultaneously orgs are not all bad; thats another distortion we can do without.

  • I think it's definitely true that you should never count on a company to do principled things forever. But that doesn't mean that nothing is real or good.

    Like Google's support for the open web: They very sincerely did support it, they did a lot of good things for it. And then later, they decided that they didn't care as much. It was wrong to put your faith in them forever, but also wrong to treat that earlier sincerity as lies.

    In this case, Anthropic was doing a good thing, and they got punished for it, and if you agree with their stand, you should take their side.

    • Google's support for the open week is a great example because it was obviously a good thing but also obviously built into their business model that they'd take that position. That made them a much more trustworthy company in those days, because abandoning that position would have required not just losing money for a while but changing their internal structure.

  • How much value is there in individual values?

    Many of us remember that OpenAI was also started by people with strong personal values. Their charter said that they would not monetize after reaching AGI, their fiduciary duty is to humanity, and the non-profit board would curtail the ambitions of the for-profit incentives. Was this not also believed by a sizeable portion of the employees there at the time? And what is left of these values after the financial incentives grew?

    The market forces from the huge economic upside of AI devalues individual values in two ways. It rewards those that choose whatever accelerates AI the most over any individuals who are more careful and act on individual values--the latter simply loses power in the long run until their virtue has no influence. As Anthropic says in their mission statements, it is not of much use to humanity to be virtuous if you are irrelevant. The latter, as is true for many technologies, is that economic prosperity is deeply linked to human welfare. And slowing or limiting progress leads to real immediate harm to the human population. And thus any government regulations which are against AI progress will always be unpopular, because those values which are arguing future harm of AIs is fighting against the values of saving people from diseases and starvation today.

  • > However, in this instance, it does seem that Anthropic is walking away from money.

    The supply chain risk designation will be overturned in court, and the financial fallout from losing the government contracts will pale in comparison to the goodwill from consumers. Not to mention that giving in would mean they lose lots of their employees who would refuse to work under those terms. In this case, the principles are less than free.

    • > ...the financial fallout from losing the government contracts will pale in comparison to the goodwill from consumers.

      In fact, a friend heard about this and immediately signed up for a $200/year Claude Pro plan. This is someone who has been only a very occasional user of ChatGPT and never used Claude before.

      I told my friend "You could just sign up for the free plan and upgrade after you try it out."

      "No, I want to send them this tangible message of support right now!"

      7 replies →

    • Unclear how much damage the designation will do to their dealmaking ability in the meantime. How long will it take for the court to reverse order?

      1 reply →

    • The consumer goodwill is working then - it pushed me to upgrade my plan on march 1st... (do they bill on rolling 30 day cycle ? or calendar-month to calendar-month?)

      2 replies →

    • > The supply chain risk designation will be overturned in court,

      I'm honestly uncertain how the courts will rule. You could be right, but it isn't guaranteed. I think a judicial narrowing of it is more likely than a complete overturn.

      OTOH, I think almost guaranteed it will be watered-down by the government. Because read expansively, it could force Microsoft and AWS to choose between stopping reselling Claude vs dropping the Pentagon as a customer. I don't think Hegseth actually wants to put them in that position – he probably honestly doesn't realise that's what he's potentially doing. In any event, Microsoft/AWS/etc's lobbyists will talk him out of it.

      And the more the government waters it down, the greater the likelihood the courts will ultimately uphold it.

      > and the financial fallout from losing the government contracts will pale in comparison to the goodwill from consumers.

      Maybe. The problem is B2B/enterprise is arguably a much bigger market than B2C. And the US federal contracting ban may have a chilling effect on B2B firms who also do business with the federal government, who may worry that their use of Claude might have some negative impact on their ability to win US federal deals, and may view OpenAI/xAI (and maybe Google too) as safer options.

      I guess the issue is nobody yet knows exactly how wide or narrow the US government is going to interpret their "ban on Anthropic". And even if they decide to interpret it relatively narrowly, there is always the risk they might shift to a broader reading in the future. Possibly, some of Anthropic's competitors may end up quietly lobbying behind the scenes for the Trump admin to adopt broader readings of it.

      5 replies →

  • That's what worries me so much about the development that OpenAI is stepping in. OpenAI's claim is that they have the same principles as Anthropic, but that claim is easy because it's free now because the govt wants to sell the "old bad, new good" story.

    Surely OpenAI cannot but notice that those values, held firmly, make you an enemy of the state?

    • My reading is that OpenAI is paying lip service. Altman is basically saying "OF COURSE we don't want to spy on Americans or murderdrone randos, but OF COURSE the government would never do that, they just told me so (except for the fact that they just cut ties with Anthropic because Anthropic wouldn't let them do that)"

    • Its much simpler than that. OpenAI is losing significant market share and this is a Hail Mary that the government will forcr troves of companies to leavr Anthropic

  • principles are easy when they're free

    Indeed. If everything is a priority, nothing is a priority; you only know that something is a real priority when you get an answer to the question "what will you sacrifice for this".

  • I call this being ethically convenient. I think anthropic is playing to the crowd. This admin will be gone soon enough so no need dragging the brand into mud. Just need to hold out. They have enough money that walking away from the money isnt impressive. But pissing off the gov is pretty fun and far more interesting.

I applaud Anthropic choice. Choosing principle over money is a hard choice. I love Anthropic's products and wish them success!

  • You applaud anthropic's choice to enhance mass surveillance of non-US people? If anthropic want mass surveillance, they should limit it to their own country, not to all other countries IMO.

> I think the decision was made because the people making this decision at Anthropic are well-intentioned, driven by values, and motivated by trying to make the transition to powerful AI to go well.

The entire problem is that this lasts as long as those people are in charge. Every incentive is aligned with eventually replacing them with people who don’t share those values, or eventually Anthropic will be out-competed by people who have no hesitation to put profit before principle.

  • I mean, yah. How else could it be? Xerox, GE, IBM (1990 Gerstner) and a zillions of other rock stars fell hard. And had to be over hauled. Thats why continuous improvement is a thing, and why a platonic take on the world was never a thing.

Anthropics principles are extraordinarily weak from an absolute point of view.

Don't surviel the US populace? Don't automate killing, make sure a human is in the loop? No, sorry, don't automate killing yet.

Yeah dude, I'm sure just about any burglar I pull out of prison will agree.

Listen yes, it's good compared to like 99% of US companies. But that really speaks more to the absolute moral bankruptcy of most companies, and not to Anthropics principles.

That being said, yes we should applaud anthropic. Because yes this is rare and yes this is a step in the right direction. I just think we all need to acknowledge where we are right now, which is... not a good place.

The funniest or perhaps saddest (depending on your view) is that the "principles" we're talking about and apparently celebrating here are that they don't want to do DOMESTIC surveillance, and they don't want FULLY autonomous kill bots... Yet, because according to the CEO the models aren't there yet.

Meaning, they're a-okay with:

- Mass surveillance of non-US peoples (and let's be completely real here, they're in bed with Palantir already, so they're obviously okay with mass surveillance of everyone as long as they're not the ones that will be held culpable)

- Autonomous murder bots. For now they want a human in the loop to rubberstamp things, but eventually "when the models improve" enough, they're just fine and dandy with their AIs being used as autonomous weapons.

What the fuck are the principles we're talking about here? Why are they being celebrated for this psychotic viewpoint, exactly?

This is an absolute rarity these days. Very appreciative of the true leadership on display here

If you're going to be cynical, at least credit them with some brains:

MAGA isn't going to last forever, and when it collapses, the ones who publicly stood up to it will be better positioned to, I don't know, not face massive legal problems under whatever administration comes next. A government elected by middle-aged moms who use "Fuck ICE" as a friendly greeting isn't going to have any incentives to go easy on Palantir and Tesla.

  • Cynical or not, I think it was an absolutely brilliant move: "Mass domestic surveillance of Americans constitutes a violation of fundamental rights". I think they placed their bets on Sama signing a contract with the DoD and here we are, one day later the news that OpenAI signed a contract is out. An absolute PR disaster for OpenAI. And an absolute PR victory for Anthropic.

    I think OpenAI's IPO will be interesting. Not even the conservative media will be happy about mass surveillance of Americans.

    For non-Americans not much change, they don't really care about your rights more than about a pile of dog poo.

Why did they work with Palantir then, which is the integrator in the DoD? It does not take a genius to figure out where this was going.

I don't know why a personal testimony to the effect that "these are the good guys" needs to be at the top of every Anthropic thread. With respect to astroturfing and stealth marketing they are clearly the bad guys.

  • Anthropic's stance is "we believe in the use of our tools, with safeguards, to assist the defense of the US".

    So of course they would work with Palantir to deploy those tools.

    The issue we're seeing is because the DoW decided they no longer like the "with safeguards" part of the above and is trying to force Anthropic to remove them.

  • They are pretty clear about this:

    > the mass domestic surveillance of Americans

    This they say they don’t like. The qualifiers tell you they’re totally fine with mass surveillance of Palestinians, or anyone else really, otherwise they could have said “mass surveillance”.

    > fully autonomous weapons

    And they’re pretty obviously fine with killing machines using their AI as long as they’re not fully autonomous (at the moment, they say the tech is not there yet).

    All things considered they’re still a bit better than their competitors, I suppose.

  • Others have addressed the first half of your comment, so I'll focus on the astroturfing claim.

    While I've talked a lot about Anthropic this week, if I was astroturfing for a positive image, I'd be very bad at it [1][2][3].

    [1]: https://news.ycombinator.com/item?id=47174814

    • It doesn’t seem like anybody has addressed “If they are the good guys with principles why did they work with Palantir?”

      There’s a comment that’s sort of handwaving and saying “because America”, but I would imagine that someone with direct knowledge of the people involved would have something more substantive than “thems the breaks” when it comes to working with Palantir

  • Anthropic makes it kind of clear in all of their statements that they are not opposed to working with the surveillance state, with the military industrial complex, etc. Their central philosophy, it seems, is not incongruent with working with entities, public or private, that can be construed as imperialist or capitalistic or a combination of both. I actually appreciate their honesty here.

    They exist within the regime of capital and imperialism that all of us who are American citizens exist within. This isn't a cop-out or cope. It's just the reality of the world that we live in. If you are an American and somehow above it, let me know how you live.

  • The further away from God, the more need to believe there are good guys.

    • God has been used as a justification for a lot of human suffering.

      My personal belief is that the closer to god you are; the more easily you can justify evil. How could you not? If my entire belief system is derived from faith, then there are *no* conclusions I could not come to, and therefore anything can be justified.

>driven by values

Would the people who have invested in the company like that? Or would they like the company to make some money? Are they going to piss off their investors by being "driven by values"?

I mean, please explain it to me how "driven by values" can be done when you are riding investor money. Or may be I am wrong and this company does not take investments.

So in the end you are either

1. funding yourselves, then you are in control, so there is at least a justification for someone to believe you when you say that the company is "driven by values".

2. Or have taken investments, then you are NOT in control, then anyone who trusts you when you say the company is "driven by values", is plain stupid.

In other words, when you start taking investment, you forego your right to claim virtuous. The only claim that you can expect anyone to believe is "MY COMPANY WILL MAKE A TRUCKLOAD OF MONEY !!!!"

  • As an investor in Anthropic, I'd say that anyone who wasn't aware of where they stood on various values issues the whole time should not have been putting money in, it was not hidden.

    • How much is your investment (you don't have to be exact)?

      The bottom line is that if the investment is not profitable, then there will be less and less investment, because only fewer and fewer can afford to lose money and stick to their values, until no one will be investing; how ever high your values might be...

      Sticking to your values when it cost growth is not sustainable for publicly traded companies...

      2 replies →

So many tech companies have the "high values" screed that it really just seems like a standard step in the money plan.

  • Practically the entire tech industry, including many of the higher ups currently camping out on the right, used to be firmly in a sort of centrist-with-social-justice-characteristics camp. Then many of those same people enthusiastically stood with Trump at his inauguration. It's completely reasonable that people have their doubts now.

    It's also completely reasonable to expect that if Anthropic is the real deal and opposed to where the current agenda setters want to take things, they'll be destroyed for it.

    • > enthusiastically stood with Trump

      I think "enthusiastically" looks different. They had to choose between kissing Trumps butt to make good business for 4 years or see their companies at a severe disadvantage. I'm not saying what they did was good, nor do I support it. But from a business angle it's not hard to see why they chose to do that. If you'd ask them privately off the record then I'm sure most of them would tell you that Trump is an idiot and dangerous.

      1 reply →

    • Destroyed? No. But a new sharif is gonna show up while the existing exit stage left with big bags of nuts.

[flagged]

  • All corporations are to an extent. It’s a question of magnitude, not absolutes.

    You, too, are driven by money. Yet I’m certain you maintain a set of principles and values. Let’s keep the discussion productive yeah?

    • Sure, where is your productive output? Cause that's drivel.

      Anthropic kept referring to Hegseth as "Secretary of War" and the DoD as "Department of War". Which is horseshit. This whole thing is Anthropic flailing.

      3 replies →

This is a pretty classic mistake most people who are in high-profile companies make. They think that some degree of appealing to people who were their erstwhile opponents will win them allies. But modern popular ethics are the Grim Trigger and the Copenhagen Interpretation of Ethics. You cannot pass the purity test. One might even speculate that passing the purity test wouldn't do anything to get you acceptance.

Personally, I wish that the political alignment I favour was as Big Tent as Donald Trump's administration is. I think he can get Zohran Mamdani in the room and say "it's fine; say you think I'm a fascist" and then nonetheless get what he wants. But it just so happens that the other side isn't so. So such is life. We lose and our allies dwindle since anyone who would make an overture to us, we punish for the sin of not having been born a steadfast believer.

Our ideals are "If you weren't born supporting this cause, we will punish you for joining it as if you were an opponent". I don't think that's the path to getting what one wants.

  • > political alignment I favour was as Big Tent as Donald Trump's administration is

    I'm not sure how accurate this sentiment is. Your desire is to embrace your enemy without resolving the differences, and get what you want. It's not clear here if you're advocating compromise and negotiation, or just embracing for the sake of embracing while just doing what you wanted all along.

    And evaluating Trump's actions against this sentiment doesn't seem to be the negotiation and compromise interpretation. Given the situation with tariffs and ICE enforcement, there is no indication of negotiation or compromise other than complete fealty/domination.

    So as grandiose and noble your sentiment is, Donald Trump is hardly the epitome of it as you seem to suggest.

    • I think the differences in this situation were that I do not want AI used in domestic surveillance or autonomous weapons, and Anthropic holds to that position.

      I think Donald Trump has pretty much let Zohran Mamdani operate without applying the kind of political pressure he has applied to other people, notably his predecessor Eric Adams. Also, I think saying "let people be your allies when they take your position" is less "grandiose and noble" than demanding someone agree on all counts before you will accept any political alignment. But it's fine if everyone else disagrees. It's possible there really just isn't a political group which will accept my views and while that's unfortunate because it means I can't get all that I want, I think it'll be okay.

      One could reasonably argue that the meta-position is to either join the Republicans full-bore (somewhat unavailable to me) or to at least play the purity test game solely because that's the only way to have any influence on outcomes. If it comes to that, I'll do it.

      3 replies →

  • > he can get Zohran Mamdani in the room and say "it's fine; say you think I'm a fascist" and then nonetheless get what he wants.

    Is your perception that warped? Mamdani is the one who knows how to play Trump as a fiddle, and the one who walks away with something from the exchange.

  • Zohran Mamdani has yet to demonstrate that he poses any serious impediment to Trump and the agenda of Trump's owners.

  • Your contention that Trump's administration is big tent is risible.

    Political witch hunts, women and minorities forced out of the military, and kicking out all the allied countries that used to be in the tent with us?

    Bullshit of the finest caliber.

    • Yes, the Trump administration is big tent of politicians who hold incompatible opinions and are allowed to stay as long as they display personal allegiance to Trump.

“I think the decision was made because the people making this decision at Anthropic are well-intentioned, driven by values, and motivated by trying to make the transition to powerful AI to go well.”

Every single one of these CEOs happily pirated unimaginable amounts of copyrighted content. That directly hurt millions of real human beings. Not just the prior creators but also crushing the future potential for success of future ones.

https://www.susmangodfrey.com/wins/susman-godfrey-secures-1-...