Comment by realo

Not necessarily. If the secret is protected in the secure element against something only you can provide (physical presence of RFID, password, biometric etc) then it is ok.

BUT you must trust the entire Apple trusted chain to protect you.

That is a rather big BUT.