Comment by programjames
3 months ago
A good start would be:
1. Robust to adversarial attacks (e.g. in classification models or LLM steering).
2. Solving ARC-AGI.
Current models are optimized to solve the current problem they're presented, not really find the most general problem-solving techniques.
I like to think I'm generally intelligent, but I am not robust to adversarial attacks.
Edit: I'm trying arc-agi tests now and it's looking bad for me: https://arcprize.org/play?task=e3721c99
"I like to think I'm generally intelligent, but I am not robust to adversarial attacks. I'm trying arc-agi tests now and it's looking bad for me."
One man's modus ponens is another man's modus tollens.
"I'm trying arc-agi tests now and it's looking bad for me. I am not robust to adversarial attacks. I think I'm not generally intelligent."
I forgot what modus ponens/tollens are, but you get get it - I think I'm not generally intelligent
For people coming after me, or for anyone who took discrete math a decade ago and need a quick refresher:
Modus ponens (affirming): if P, then Q. P is true, therefore Q.
If it is raining, the grass is wet. It is raining. Therefore the grass is wet.
Modus tollens (denying): if P, then Q. Q is false. Therefore P is false.
If it is raining, then the grass is wet. The grass is not wet. Therefore, it is not raining.