← Back to context

Comment by riebschlager

3 hours ago

I absolutely understand this sentiment. I've been working in tech since the late 90s and I have had MORE than my share of let-me-off-this-ride moments.

But this post (and the many I see like it) feels like giving up. And now's not the time for empathetic people to give up.

Technology is how we expand human capability. We are well within our rights to pick and choose how we interact with that capability. But it's starting to terrify me how it seems that the worst people in the world are more than willing to wield this power, while good people opt out. Billionaires are doing a remarkable job at making their vision of the future seem inevitable. Don't fall for it.

If more people aren't willing to help us steer this capability towards a better future, then we all know how this ends.

> it's starting to terrify me how it seems that the worst people in the world are more than willing to wield this power, while good people opt out

Maybe it's just that the capability is bad. Adtech, for example, isn't something that anyone uses for good. They blow a lot of smoke about it--looking at you, Apple--but despite the "good-washing" it's all just the same extractive, invasive, dehumanizing business. Bad people will naturally concentrate around this capability. I know because I've worked with a few of them.

AI coding tools seem like they're engineered to undermine cautious, rigorous, and pragmatic engineering discipline. Of course the bosses want that, they see a short term path to massive output increases and nothing sounds better. They'll be cashed out by the time the mess needs to be cleaned up, that's someone else's problem. People who are predisposed to this kind of antisocial behavior are the ones who concentrate around AI tools. Rigorous, careful engineers who care about building maintainable systems that will outlast their tenure find less value in them.

I think it's more nuanced than

> Technology is how we expand human capability.

I think as a general statement about technology as a whole it's true. But do all technologies expand human capabilities? I don't think so.

  • In my mind, I would separate technology from its application.

    Advertising tech and AI coding tools are applications of technology stacks that could have been used to create what you and I might agree to be "better" tools. I don't need to tell you why ad tech got created instead of something that is a net societal benefit.

    At the same time, I would say that, yes, those applications do indeed expand human capabilities. The important nuance here is whose capability, and to what end.

    All I am saying is that opting out of this, in whatever form that takes, hands your agency over to those who would use it to enrich themselves at the cost of others. I sincerely feel that decades of this type of capitulation is exactly how we got to where we are today.

    • Could adtech really be used for something better? The capability is to precisely model users' emotional reward centers and then bombard them with content that targets those reward centers. Is there any way you can imagine this being used for good? Even if you do it in the least bad, privacy preserving way possible you're still messing with people's minds on a massive scale. Sure, that's a capability alright! I can't imagine a decent use of that capability, though. In my view it's one that should be prevented via regulation and treaties, much like weapons of mass destruction.

      Unlike weapons of mass destruction, though, there's nothing to be gained by working on adtech. Let me unpack that a bit--a "good guy" can justify working on nuclear weapons because if he doesn't his country will be unable to defend itself when the treaties break down. There's no similar existential threat with adtech. If I choose to not work on that poison, I'm not leaving any advantage on the table. My agency in this situation is worthless. At least that conclusion is why I don't do adtech anymore.

      I broadly agree with your bigger point though. To the extent that AI coding tools are useful it's important to explore their use, and evaluate whether they're any good. But if I'm in a company that's forcing their use, or putting up token use leaderboards, or any of the other horror stories we've been hearing about, you can be damn sure I'd get myself fired or quit. At that point the inmates are running the asylum, and there's no reason to stay.