Comment by data-ottawa
1 day ago
The AI product rollouts in the last two years have been some of the most aggressive and user hostile product rollouts in my entire life.
All conventions and user centricity go out the window with AI feature launches lately. If you look at examples from the last week it’s stuff like posthogs opt-out training, Copilot training, or Google’s antigravity chat-app switch.
I’ve had the worst customer experiences of my life in the last few months.
My health insurance company decided calling support meant I consented to them saving my voice for model training. They said you can opt-out online, but that option didn’t exist in app or on their website. It was only after calling back and threatening to sue that they added an option to opt-out.
This is the daily experience now. Seemingly every company is opting you into selling your data, breaking your workflows, disabling features you use, and force installing AI integrations you have to fight to remove. And several companies are perfectly fine to reenable or reinstall them after removal.
It should be no surprise to anyone people are mad.
What real value AI does have has been poisoned by premature rollouts (training users it’s crap) and forcing it on people too aggressively.
One of the recent rollouts that really grind my gears was Spotify rolling out LLM explanations of songs. Which is the most useful wasteful piece of sh*t ever. Why would I want to get a theory of what is 174bpm and other random crap.
It is insane, and I hate modernity and every single modern product that just shoves random LLM crap at you and pretend they are not AI-enabled.
Spotify is a toxic shit company overall that is a general detriment to all musicians everywhere.
If you care about music just a little bit you should stop using it today and directly buy music from the artists you care about.
Honestly, this is true for all streaming, not just Spotify. Stream if you want, but also buy albums from them if they offer it. Merch is even better.
Hell, even if you... acquire the music files unofficially and go buy a t-shirt or poster, the artist is still probably getting way more than they ever would have from you streaming all their albums on a loop.
One fascinating thing about LLMs is the degree of evangelism it inspires in some. You can explain some of that with paid micro influencers, people invested in the success of AI, consultants looking for workshop opportunities and all that, but I know enough people with no skin in the game at all, that turned into very vocal advocates.
I think to some degree, that effect is also at play here. CEOs, product managers etc are simply amazed, and want to spread the good news. I doubt they can even _comprehend_ that others might not be as excited as them.
One character I find interesting is Ezra Klein from the New York Times who desperately wants to see something positive come out of markets and industry and has an enthusiasm for AI which is not shared by his audience. He struggles to understand that skepticism and I think that's bad for his project.
At least he's not one of the many mooks who are doing ChatGPT-assisted (Grok-assisted?) blogging and boasting about it, even when it goes wrong, like Casey Handmer.
You also have to consider a ( I would argue large ) percentage of those evangelists are simply lying for financial gain. They see profit, or at least reduced costs, and quite simply don't give a shit about customer experience or anything like that.
Or this is finally their chance to be the smart guy who was in on the ground floor.
2 replies →
I'm sure there is an effect when people talk on socials (linkedin, company intra etc) that they are marketing themselves. This is why I won't take any claims on socials that seriously.
I'll believe it when I see it.
I can't decide how much I like it myself. It can help me with really complicated projects. Software and otherwise. It has completely replaced my usage of non site local search engines. But I don't like how lazy it makes me. I don't vibe code, I understand what it is doing, and have it make adjustments typing it examples of what I want. But I can see myself getting lazier quckly. And when I find a task too hard for it I waste a lot of time trying to get my prompts correct before taking over.
After-the-fact opt-outs are something I never trust. Most data selling is opt-in and requires the user to opt-out. It seems to me that when I submit the form, the data would be instantly sold and by the time I get to the opt-out form it’s too late.
If this isn’t how it works, I’d be interested to know. The whole idea of these opt-outs seem like smoke and mirrors to act good while still gaining the advantage from the dark pattern. The only way to truly opt-out is to not register or use a service at all. There really needs to be legislation around this.
That's how it worked the last time I bought a car. I submitted the opt-outs with the purchase paperwork, the ~sales~ data sharing agreements with 10k of the dealership's closest, paid friends were processed first, and I had no end of bullshit from a hundred companies I'd never interacted with previously.
That sounds lawsuit worthy. If you submitted both sets of paperwork at the same time, a reasonable expectation would be for your opt-opt application to be processed first, otherwise it’s pointless.
The GDPR specifies that opt-outs are also retroactive, but of course we know that all corporations happily follow the law.
You can’t un-sell data though. Sure you may ask nicely that the buyer doesn’t use it and deletes it, but at that point the cat’s out of the bag.
2 replies →
Corporations seem deathly scared of GDPR, for some reason, while in reality it's enforced about as much as American antitrust (not at all).
2 replies →
>The AI product rollouts in the last two years have been some of the most aggressive and user hostile product rollouts in my entire life.
>I’ve had the worst customer experiences of my life in the last few months.
I attribute that to the massive amount of tax breaks and money that has been funneled to them by various governments. The government is the customer that they are appeasing right now. As soon as the spigot is turned off, they will be more inclined to appease us.
I do not know the consumer or b2b AI market well right now. I do know that billions of dollars are at stake from government sources. A smart company would focus on that.
I'm not aware of any government handouts for tech companies adding AI to their products, can you give an example, please?
The AI Workforce Training Act is closer to what OP was mentioning; the last paragraph of this article suggests more. https://fedscoop.com/ai-workforce-tax-credit-house-bill/
https://openai.com/it-IT/index/our-agreement-with-the-depart...
1 reply →
I'm someone who makes extensive used of LLMs and agents for daily research, and I 100% of the time ignore the AI summary that google gives at the top of the page. If I am performing a web search, I've already decided that I'm explicitly NOT looking for an LLM summary.
I think Google's "AI Mode" does better at integrating search results and answering questions. It can find articles and scientific papers that match my memory in most situations and does a lot better at Arknights question answering than Microsoft Copilot (reskinned ChatGPT) does.
> posthogs opt-out training,
It should seriously be 100% illegal to force someone's content into AI training without their explicit consent, and no not opting out should not be an escape hatch.
[dead]