It might output a much more detailed image than a human-drawn sketch which could be less useful or more damaging than the vague sketch.
Imagine that a police officer is looking for someone matching the image but doesn't know that it's hallucinated from a vague description, they could let the real suspect go or incorrectly arrest someone who happens to look like the AI generated image but otherwise doesn't have any reason to be a suspect.
Police are already greatly overestimating the accuracy of their own facial recognition tools because they don't realize the limits of the technology, and this would just be worse.
Accountability for what? I recall Procedure already requires approval of the final sketch by the witness. Witnesses could always make mistakes, but that's true even in the current process. Or is your argument sketches should never be used?
In fairness, with the ubiquity of cameras, sketches are much less required...
Our hypothetical AI won't make any decisions. It just makes sketches as described and approved by witnesses. The relevant racism here is the one any witnesses may have, that's true even with a human police sketch artist.
How is that idea any more concerning than a regular human-drawn police sketch?
It might output a much more detailed image than a human-drawn sketch which could be less useful or more damaging than the vague sketch.
Imagine that a police officer is looking for someone matching the image but doesn't know that it's hallucinated from a vague description, they could let the real suspect go or incorrectly arrest someone who happens to look like the AI generated image but otherwise doesn't have any reason to be a suspect.
Police are already greatly overestimating the accuracy of their own facial recognition tools because they don't realize the limits of the technology, and this would just be worse.
>It might output a much more detailed image than a human-drawn sketch
That's not a necessary property of AI image generation. You could just add a 'output as a sketch' system prompt.
Lack of accountability.
Accountability for what? I recall Procedure already requires approval of the final sketch by the witness. Witnesses could always make mistakes, but that's true even in the current process. Or is your argument sketches should never be used?
In fairness, with the ubiquity of cameras, sketches are much less required...
Police in your jurisdiction are held accountable?
1 reply →
Didn't see the comments yesterday where HN achieved consensus that racist AI might be real but isn't that bad if it is?
Our hypothetical AI won't make any decisions. It just makes sketches as described and approved by witnesses. The relevant racism here is the one any witnesses may have, that's true even with a human police sketch artist.
3 replies →
Not really sure you can say AI is "racist".
It can't think, or form opinions. It's not "intelligent" in any real sense.
It's just Eliza with a really, *really* big array of canned responses to interpolate between.
5 replies →
businesses, states, markets, any organization or other system that incorporates super-human agency is already AI, so far performed manually
the progression of technological "AI" has just been the automation and acceleration of their logic and operations
what paperclips are the police maximizing?
everything the alarmists are afraid of has already happened
arrests