Comment by sh1mmer
2 years ago
Actually the first hit [1] on Google I got for “is it safe to infuse garlic oil without heating” is this article from OK state saying that it’s only safe without heat if you use citric acid.
Of course, the incorrect Gemini answer was listed above that still.
[1] https://news.okstate.edu/articles/agriculture/2020/gedon_hom...
Thanks for your correction. This makes me think that how Gemini arrived at this answer is that it mashed together "heating first" with "no heating but with citric acid first" articles, but left out the (critically important) citric acid part.
I think this "failure mode" really highlights how LLMs aren't "thinking", but just mashing up statistically probable tokens. For example, there was an HN article recently about how law-focused LLMs made tons of mistakes. A big reason for this is that the law itself is filled with text that is contradictory: laws get passed that are then found unconstitutional, some legal decisions are overturned by higher courts, etc. When you're just "mashing this text together", which is basically what LLMs do, it doesn't really know which piece of text is now controlling in the legal sense.
I also like to picke garlic. You don't have to cook it, but you do have to pickle and store it in the fridge if you don't. If you do that it can be safe for years (and actually pretty good after 5+ years). Even with acid it's not foolproof at room temperature for long. I think you only get a few days.