Comment by nilirl
6 hours ago
What diction is "appropriate to the subject matter" is a negotiation between author and reader.
I think the author is ok with it being inappropriate for many; it's clearly written for those who enjoy math or CS.
6 hours ago
What diction is "appropriate to the subject matter" is a negotiation between author and reader.
I think the author is ok with it being inappropriate for many; it's clearly written for those who enjoy math or CS.
I think it's a trick. It seems to be the article is just a series of ad-hoc assumptions and hypotheses without any support. The language aims to hide this, and makes you think about the language instead of its contents. Which is logically unsound: In a sharp peak, micro optimizations would give you a clearer signal where the optimum lies since the gradient is steeper.
> In a sharp peak, micro optimizations would give you a clearer signal where the optimum lies since the gradient is steeper.
I would refuse to even engage with the piece on this level, since it lends credibility to the idea that the creative process is even remotely related to or analogous to gradient descent.
I wouldn't jump to call it a trick, but I agree, the author sacrificed too much clarity in a try for efficiency.
The author set up an interesting analogy but failed to explore where it breaks down or how all the relationships work in the model.
My inference about the author's meaning was such: In a sharp peak, searching for useful moves is harder because you have fewer acceptable options as you approach the peak.
Fewer absolute or relative? If you scale down your search space... This only makes some kind of sense if your step size is fixed. While I agree with another poster that a reduction of a creative process to gradient descent is not wise, the article also misses the point what makes such a gradient descent hard -- it's not sharp peaks, it's the flat area around them -- and the presence of local minima.
2 replies →
I enjoy maths and CS and I could barely understand a word of it. It seems to me rather to have been written to give the impression of being inappropriate for many, as a stand-in for actually expressing anything with any intellectual weight.