Comment by raincole

2 years ago

> This is what I mean when I say almost every ML paper is trash

Papers don't use the term you are familiar so they're trash...?

No, they're poor at explaining. Have you read the Adam paper? The key concept is the signal to noise ratio, but it's only mentioned on the third page in a paragraph that nearly covers the screen.

In a scientific paper you either define everything or you give references to other papers that define them.

Not even simple terms like natural numbers should be assumed. Some include the number 0, some do not. But it does not matter as long as you provide a definition: let's talk about whole positive numbers including 0.

Definitions are paramount to quality science and research, otherwise very simple disagreements and misunderstandings derive from the lack of a basic set of knowledge.