Comment by duped
5 hours ago
But they couldn't possibly do it at that the scale they're operating at. They couldn't hire enough people in the countries they operate, or know the language, or trust that who they do hire aren't corrupt or working against their interest. And they can't manually approve every ad, or make sure targeting isn't illegal or otherwise harmful.
---
This is sarcasm, by the way. Most decent people make sure what they're about to do won't harm other people and if would cause harm they wouldn't do it. But social media companies and ad networks aren't run by decent people. They're run by people who believe their business is entitled to infinite scale regardless of how many people are harmed along the way.
>But they couldn't possibly do it at that the scale they're operating at. They couldn't hire enough people in the countries they operate, or know the language, or trust that who they do hire aren't corrupt or working against their interest. And they can't manually approve every ad, or make sure targeting isn't illegal or otherwise harmful.
you say sarcasm, but i think this is literally true.
this isn't a defense of facebook, i think that their scale makes it actually impossible (while remaining a going concern). the result should be that they arent allowed to operate at a scale that they cant handle, instead of being able to brush it under the rug every ~6 months when an incident hits the news cycle.
Don’t they have like an 80% gross margin?
the amount of content posted per second to facebook is unfathomable. a quick google (just for a rough order of magnitude) says ~65,000 posts per second. add in instagram (which is worse for CSAM) and its gotta be at least double that.
it would require millions on millions of employees, spread across ~every country. between the payroll, buildings and property, equipment, etc. i just dont think its possible at that scale.
(again, emphasizing that im not saying this as an excuse for facebook, but that i dont really think facebook/instagram should exist at all)
5 replies →
"While remaining a going concern."
Well, tough. Maybe they should have to find a way. If that means requiring everybody to have to pay to afford the moderators then so be it. All the other companies would have to as well.
>Well, tough.
right, that was my point.
The point I'm making is they're not entitled to scale a business if they can't scale responsibly
i agree with that, and said the very same thing in my comment
I agree and the obvious solution is: Nothing should exist at that scale. In fact, "Able to effectively moderate your product," strikes me as an excellent standard to hold them to, then let their product find the natural usercount and price point they can manage.
Who ever said that companies should have the right to exploit network effects to dominate online communications?
Facebook absolutely could remain a going concern while dealing with all of these problems, the problem is that they would be spending money to lose money.
One of the more perverse aspects of risk prevention is that riskier customers are often way more lucrative. It's kind of inherent to the notion that markets price risk into transactions. The thing is, illegal behavior is also just a particular kind of risk: if someone wants to sell nudify apps or scam old people, Facebook could conceivably be on the hook[0] for damages if they're caught. And in a sense, a risk premium is just a fancy kind of bribe: if Facebook won't take my ads because they think they're too risky, then I'll just pay more and more until Facebook accepts them.
With illegal behavior, we hope that we can make the punishment high enough that Facebook refuses any conceivable risk premium the perpetrators of that behavior would be willing to pay. The problem is that Facebook is really desperate for any increasing growth story, and when you're too big to fail, your growth story is to drip-feed enshittify your stack. Increasing tolerance for illegal behavior is downstream of this: you cut enforcement, tell them to automate more, they become easier to bypass... and you make more money. Because it turns out all that risky behavior... is only risky for normal people. Facebook can launder[1] the risk away and make a tidy profit.
[0] Do not tell me about CDA 230, I was there when the old magic was written.
[1] See also, HSBC turning themselves into a literal money laundering operation.
Right, which is why my suggestion is that we skip fines, because they demonstrably don't work, and we go directly to: you, $executive_at_facebook, have participated in the distribution of CSAM and will now be prosecuted.
Make that the policy, and I'd bet my life savings that Facebook, miraculously, will figure out how to detect this shit with bulletproof accuracy.