If a carpenter uses a table saw, is he still a carpenter?
What if he just throws wood randomly at the table saw and tries to sell whatever pieces come out?
(Never do this with a table saw, btw. They can, and will if you don't use proper procedures, throw wood sideways at speeds that can punch through walls and impale people)
This analogy doesn't make much sense to me. Is the table saw analogous to LLMs because they both work with the appropriate substrate (wood/text)? I don't see how an LLM is like a table saw at all.
Is a musician less of a musician if they use a pre-recorded back-beat and sing on top? Are you not a musician if you use the chord mode on a keyboard?
Is code not hand-written if my editor automatically closes all of my html? What if my editor flags all of the errors and I manually correct them? And what if it auto-corrects at the press of a button?
There is a line and I'm asking about it earnestly, but the table saw analogy doesn't reach it IMO.
What if I barely know the rules of chess and I use a chess computer to play all my games for me; I win the world title this way. Am I a chess Grant Master?
People downvote this kind of take because you're striking at the heart of the enforcement problem and also the definition of what a project that is majority built with AI really means. What they really want is to ascertain the amount of effort from a human that went into the project and they're using the percentage of code generated by an AI as a proxy metric. But it's a bad proxy, both because it doesn't capture human effort and because it is not measurable.
Even human effort is a terrible proxy because effort is a gradient that depends on skill. An expert exerts low effort for the same result a novice would labor over.
What conversation are you trying to have? I don't even use Codeberg; I've spent years thinking about how the idea behind rules manifests when those rules are actually put in place and enforced. I think a lot about second and third order effects. That's my interest here: an org decided to put these particular rules in place, and based on my experience, I don't think it's going to age well.
But I guess you're right, as far as you go: none of this is my problem. I'm just a curious observer.
If a carpenter uses a table saw, is he still a carpenter?
What if he just throws wood randomly at the table saw and tries to sell whatever pieces come out?
(Never do this with a table saw, btw. They can, and will if you don't use proper procedures, throw wood sideways at speeds that can punch through walls and impale people)
This analogy doesn't make much sense to me. Is the table saw analogous to LLMs because they both work with the appropriate substrate (wood/text)? I don't see how an LLM is like a table saw at all.
Is a musician less of a musician if they use a pre-recorded back-beat and sing on top? Are you not a musician if you use the chord mode on a keyboard?
Is code not hand-written if my editor automatically closes all of my html? What if my editor flags all of the errors and I manually correct them? And what if it auto-corrects at the press of a button?
There is a line and I'm asking about it earnestly, but the table saw analogy doesn't reach it IMO.
What if I barely know the rules of chess and I use a chess computer to play all my games for me; I win the world title this way. Am I a chess Grant Master?
I think you already know the answers to all of these questions.
This is an excellent analogy that shows how LLMs are fundamentally different than linters, auto-complete, or transpilers.
People downvote this kind of take because you're striking at the heart of the enforcement problem and also the definition of what a project that is majority built with AI really means. What they really want is to ascertain the amount of effort from a human that went into the project and they're using the percentage of code generated by an AI as a proxy metric. But it's a bad proxy, both because it doesn't capture human effort and because it is not measurable.
Even human effort is a terrible proxy because effort is a gradient that depends on skill. An expert exerts low effort for the same result a novice would labor over.
Maybe it shouldn't be viewed as some kind of reward but merely as a spam reduction measure. If you put in effort, it isn't spam.
That's a good point. I think the core metric is somehow quality, but that's notoriously difficult to measure.
1 reply →
> People downvote this kind of take because you're striking at the heart of the enforcement problem
That's not your problem.
What conversation are you trying to have? I don't even use Codeberg; I've spent years thinking about how the idea behind rules manifests when those rules are actually put in place and enforced. I think a lot about second and third order effects. That's my interest here: an org decided to put these particular rules in place, and based on my experience, I don't think it's going to age well.
But I guess you're right, as far as you go: none of this is my problem. I'm just a curious observer.
2 replies →