← Back to context

Comment by dcanelhas

12 hours ago

I'm half expecting to see "AI model" appearing as stand-in for "linear regression" at this point in the cycle.

25 comments

dcanelhas

Reply
ninjagoo  11 hours ago

> I'm half expecting to see "AI model" appearing as stand-in for "linear regression" at this point in the cycle.

Already the case with consulting companies, have seen it myself

  • idiotsecant  8 hours ago

    Some career do-nothing-but-make-noise in my organization hired a firm to 'Do AI' on some shitty data and the outcome was basically linear regression. It turns out that you can impressive executives with linear regression if you deliver it enthusiastically enough.

    • ozim  4 hours ago

      Not everyone knows everything so knowledge is the new oil.

      I do know about linear regression even had quite some of it at university.

      But I still wouldn’t be able to just implement it on some data without good couple days to weeks of figuring things out and which tools to use so I don’t implement it from scratch.

blitzar  11 hours ago

I'm half expecting to see "AI model" appearing as stand-in for "if > 0" at this point in the cycle.

  • Vetch  8 hours ago

    This is essentially what any relu based neural network approximately looks like (smoother variants have replaced the original ramp function). AI, even LLMs, essentially reduce to a bunch of code like

        let v0 = 0
    let v1 = 0.40978399*(0.616*u + 0.291*v)
    let v2 = if 0 > v1 then 0 else v1

    let v3 = 0
    let v4 = 0.377928*(0.261*u + 0.468*v)
    let v5 = if 0 > v4 then 0 else v4...

    • samrus  8 hours ago

      Thats a bit far. Relu does check x>0 but thats just one non-linearity in the linear/non-linear sandwich that makes up universal function approximator theorem. Its more conplex than just x>0

      3 replies →

phire  12 hours ago

I'm sure I've seen basic hill climbing (and other optimisation algorithms) described as AI, and then used evidence of AI solving real-world science/engineering problems.

  • LiamPowell  11 hours ago

    Historically this was very much in the field of AI, which is such a massive field that saying something uses AI is about as useful as saying it uses mathematics. Since the term was first coined it's been constantly misused to refer to much more specific things.

    From around when the term was first coined: "artificial intelligence research is concerned with constructing machines (usually programs for general-purpose computers) which exhibit behavior such that, if it were observed in human activity, we would deign to label the behavior 'intelligent.'" [1]

    [1]: https://doi.org/10.1109/TIT.1963.1057864

    • zingar  11 hours ago

      That definition moves the goalposts almost by definition, people only stopped thinking that chess demonstrated intelligence when computers started doing it.

      1 reply →

  • coherentpony  9 hours ago

    I am somewhat cynically waiting for the AI community to rediscover the last half a century of linear algebra and optimisation techniques.

    At some point someone will realise that backpropagation and adjoint solves are the same thing.

    • bonoboTP  7 hours ago

      There are plenty of smart people in the "AI community" already who know it. Smugly commenting does not replace actual work. If you have real insight and can make something perform better, I guarantee you that many people will listen (I don't mean twitter influencers but the actual field). If you don't know any serious researcher in AI, I have my doubts that you have any insight to offer.

thesz  7 hours ago

There is an HIGGS dataset [1]. As name suggest, it is designed to apply machine learning to recognize Higgs bozon.

[1] https://archive.ics.uci.edu/ml/datasets/HIGGS

In my experiments, linear regression with extended (addition of squared values) attributes is very much competitive in accuracy terms with reported MLP accuracy.

yread  10 hours ago

And why not, when linear regression works, it works so well it's basically magic, better than intelligence, artificial or otherwise