← Back to context

Comment by _cs2017_

3 days ago

Why vastly different?

Aren't they both searching various online sources for relevant information and feeding that into the LLM?

Different levels of capabilities. The summary feature in google uses a quick and inaccurate AI model. Were it to be a heavier model, we wouldn’t have this problem.

  • We would still have this problem. The heavier models make mistakes at too high a rate vs. a physician. Especially on imaging data. Real world data and patient presentations often deviate from the textbooks they are trained on.

    -Med student

    • That's a different class of problem. It will do just fine on text based queries spanning a few pages. Probably better than the average physician (average over all countries).

      I do agree that LLM's are not there yet in the image part.