Comment by JacobAsmuth
3 hours ago
Astra is clearly able to acquire new knowledge in context and apply it. It was the whole thing that his ARC-AGI benchmarks have been measuring. It's a direct refutation of the original comment.
3 hours ago
Astra is clearly able to acquire new knowledge in context and apply it. It was the whole thing that his ARC-AGI benchmarks have been measuring. It's a direct refutation of the original comment.
None of these LLMs are plastic. They lack neurodiversity. Their thought space and their traversal are likely constrained in someway that humanity's isn't as a collective.
Is it possible to have neuroplasticity and still keep them aligned?
how do you imagine that would work? you being able to. influence globally stored weights with some prompts? we have fine-tuning for that.
What does this even mean. There is strong evidence of LLMs doing in context learning.
Some of the linear RNN layers in recent models are provably doing SGD in hidden space during inference