Comment by zlandes86
4 days ago
Thank you! I did not go into this with any sense of what the results would be--I was kind of shocked. I reran it from scratch this week the results held up across the board.
4 days ago
Thank you! I did not go into this with any sense of what the results would be--I was kind of shocked. I reran it from scratch this week the results held up across the board.
someone replied with this meme and said, "wait until Jev learns to drift"
https://www.reddit.com/r/trolleyproblem/comments/15npmsg/mul...
I've been using coin flips to demonstrate basic failings for decision models, i.e. these are not real probabilities, or they depend on the training data, which may not have an accurate sample to the true population value. We need to collect more failure modes for all Ai so that humans can better judge when and how to use them safely.
haha, I'm afraid to offer the models that ability. Where did they reply? The model labs are sitting on a trove of data on failure modes for AI, but I bet you they aren't sharing it with each other and certainly not with us. It makes them look bad. My speculation, of course. I don't work in alignment research.
I dropped it in our slack ai chatter channel
The bots will find new failure modes we did not think of, clever workarounds to anything, because we don't give them the right context and instructions
4 replies →