← Back to context

Comment by sailfast

11 days ago

Always easier when you can avoid the law and just buy it off the shelf. It’s fine to do this, we say, because it’s not being done by the government - but if they’re allowed to turn around and buy it we’re much worse off.

That's why it doesn't make sense to ban governments from doing things while still allowing private companies. Either it is illegal to surveil the public for everyone, or the government can always do it indirectly with the same effect.

I don't think the deal described here is even that egregious. It's basically a labeled data scrape. Any entity capable of training these LLMs are able to do this.

  • The difference is that a government can take personal liberty away from people in the most direct way. A private company can't decide to lock somebody away in prison or send them to death row. (Hopefully anyway.) So we put a higher standard on government.

    That said, I do believe there ought to be more restrictions on private use of these technologies.

    • >A private company can't decide to lock somebody away in prison or send them to death row.

      A private company can 100% do this in many ways. They already do this buy putting up and using their technology in minority areas, for example.

      5 replies →

    • Yeah but these companies are operating hand in glove with govt such that there's no discernible difference between the current system and government just doing it themselves. Ban it outright.

      8 replies →

    • Cops are legally forbidden from surveilling everyone at all times using machines. Explicitly so. Yet, if a company starts up and surveils everyone at all times, and their only customer is Cops, it's all Okay somehow. The cops don't even need a warrant anymore.

      What's worse, is that third party doctrine kills your rights worse than direct police surveillance.

      Imagine if you will, back in the day of film cameras: The company developing your film will tell the police if you give them literal child porn but otherwise they don't. But imagine if they kept a copy of every picture you ever took, just stuffed it into a room in the back, and your receipt included a TOS about you giving them a license to own a copy "for necessary processing". Now, a year after you stopped using film cameras, the cops ask the company for your photos.

      The company hands it over. You don't get to say no. The cops don't need a warrant, even though they 100% need a warrant to walk into your home and grab your stash of photos.

      Why is this at all okay? How did the supreme court not recognize how outright stupid this is?

      We made an explicit rule for video rental stores to not be able to do this! Congress at one time recognized the stupidity and illegal nature of this! Except they only did that because a politician's video rental history was published during his attempt at confirmation.

      That law is direct and clear precedent that service providers should not be able to give your data to the cops without your consent, but this is America so precedent is only allowed to help businesses and cops.

    • But that is his point with "or the government can always do it indirectly with the same effect"

      The company doesn't have that power, but the government can compel companies to provide them with the same data as long as it exists, and then abuse it in the same way as if they had collected it themselves.

    • The separation between private and the government is purely theatrics - a mere administrative shell.

      I really don't understand why people treat it with such sacrosanct reverence.

      It reminds me of a cup and ball street scam. Opportunistic people move things around and there's a choir of true believers who think there's some sacred principles of separation to uphold as they defend the ornamental labels as if they're some divine decree.

      I mean come on. Know when you're getting played.

      1 reply →

    • A private company can rat you out the government in the same way that a private citizen can report you to the police. I don't see a reasonable way to change this.

      The government should be held to higher standards in terms of being able to appeal its actions, fairness, evidentiary standards. But the government shouldn't necessarily be prevented from acquiring and using information (which is otherwise legally obtained).

      I don't disagree that we should perhaps more restrictions on private processing of data though -- GDPR style legislation that imposes a cost on data collection is probably sufficient.

    • > The difference is that a government can take personal liberty away from people in the most direct way. A private company can't decide to lock somebody away in prison or send them to death row. (Hopefully anyway.) So we put a higher standard on government.

      We put higher standards on the government because companies have the biggest propaganda coffers.

      It’s not some rational principle. Money goes in, beliefs come out.

    • Uh, the government can pay the private company for the data so they can lock those people up.

  • What would such a ban look like?

    A private company can surely link its own cameras and data to create a private use database of undesirables. I’m certain that Walmart and friends do exactly this already. It’s the large scale version of the Polaroids behind the counter.

    • It can be banned explicitly as a regulation on surveillance cameras. Like:

      - The footage must be secured / only stored locally, and can only be used in legal proceedings or liability, and can be stored for maximum 1 (or a different number) year

      - It cannot be sold or used to train AI or processed for marketing or other purposes without consent of all involved (in practice impossible).

      - And no people cannot "agree" to things by just entering the premises or view

      - It is illegal to make decisions based on illegally obtained (as per above) analytics, like refusing entry/membership/service, with a private right of action

  • Or that the government isn't allowed to purchase anything they'd normally need a warrant for?

    • So everyone and their mom and all the foreign governments can buy the data, but not your own government? Do you really think this is a sustainable arrangement?

      1 reply →

  • [flagged]

    • I would much rather have a democratically elected and constitutionally constrained government than private enterprise with limitless power. It would also be helpful if the “government is bad” people would stop electing the people who seek to sabotage the government.

That's not how the law works in the US. The government cannot have a third party take action on its behalf to do something that would be illegal for the government to do itself. This is why the Biden administration had a restraining order filed against it, on account of them pressuring social media companies to ban content it didn't like. This violated the First Amendment, despite the fact that it was a third party that was doing the actual banning at the behest of the government.

The government could legally create its own facial recognition technology if it wanted to. They're not avoiding the law, facial recognition isn't illegal.

  • That's pretty much how KYC works. The government can't just willy nilly demand papers of everyone going into the bank to open up an account due to the 4th amendment. So they just make the bank do it so it is a "private" act, and then for instance IRS is authorized to do warrantless seizure on the accounts which are now tied to names that were forced to be revealed under KYC laws.

    • The government doesn't need a warrant to access bank records, as per the US's banking laws. They just need an administrative subpoena, which doesn't have to be signed off by a judge.

      This is not and example of the government sidestepping laws through a third party. You just don't like the existing laws, and would prefer to make certain things illegal that are presently legal.

      8 replies →

  • > This is why the Biden administration had a restraining order filed against it, on account of them pressuring social media companies to ban content it didn't like. This violated the First Amendment

    It's very strange of you to leave out that the extremely right-wing 5th Circuit's opinion was overturned 6-3 by SCOTUS because "pressuring social media companies to ban content" was a complete fabrication the plaintiffs failed to support whatsoever.

    • Regardless of the subsequent lifting of the order, it still illustrates that the government cannot make private parties carry out illegal acts on its behalf. If anything, the fact that the circuit's decision was later overturned shows that the courts are erring on the side of restraining the government when they try to make third parties carry out actions that the government cannot do legally.

      3 replies →

This is why we should shun the people that build this stuff. If you take a paycheck to enable fascism, you're a bad person and should be unwelcome in polite society.