Comment by root_axis
6 months ago
At the very least, it needs to be able to collate training data, design, code, train, fine tune and "RLHF" a foundational model from scratch, on its own, and have it show improvements over the current SOTA models before we can even begin to have the conversation about whether we're approaching what could be AGI at some point in the future.
I cannot do all that. Am I not generally intelligent?
You could if you were trained to do so. LLMs cannot, even if they are.
Are LLMs trained to do all that? How do you know they cannot?
4 replies →