Comment by rahimnathwani

Jev is trained towards "Calibrated decisions: answers with epistemically honest probabilities on System One tasks." [emphasis mine]

To me it seems like:

- Jev should be good at telling us 'what is'

- Jev isn't trying to tell us 'what should be'

e.g. if you want your software to assume each human life has the same value, then you should rely on Jev to tell you how many human lives would be lost in each scenario, and then your software can pick. But Jev is not trained on your value system, which is neither objective truth nor something that you can derive from the inputs.