Comment by MostlyStable

6 hours ago

I take the point, but I think the author picked a poor analogy. Cooking even an excellent steak is actually not that hard. In fact, I'd argue that it's among the easiest things to master/make at a top level quality at home. Does it require some modicum of attention and understanding? Sure. But starting with a high quality cut, owning a meat-thermometer, and knowing about reverse searing is about all it takes to reliably and easily get a near perfect steak every time.

There are far, far better cooking examples out there.

So, once you've used your knowledge to make several important pre-task decisions, the task is easy? Pre task decisions that a layperson would accidentally make implicitly because they don't even know to ask, which will probably result in them still not enjoying their steak despite having nominally done the task itself correctly?

Imagine someone walking into their local grocer, grabbing a prepackaged porterhouse steak (because it's fancy right?), salt and pepper (because for a good steak that's all you need, right) and then wondering why part of it tastes bland and overdone, and the other part bland and under-done.

Sounds pretty analogous imo.

I'm more of a coffee nerd than a steak aficionado but I've often made the comparison between those two. In both cases, the enthusiast considers their skill in making coffee/cooking steak to be a differentiator and they immerse themselves deeply into the process, skills, and tools. But for both coffee beans and steak the most important factor for a good end product is starting with high quality inputs. In other words, most of the work is being done by the farmers, the processors, and the quality of the raw stock (the cow or the coffee plant). Your job at the very end of that long value adding chain is to not ruin the hard work that others have put into it.

I'm not sure if this analogy holds up in the AI software metaphor that the author of the blog post is making.

  • Coffee is a good metaphor here too, because bad technique can ruin a good steak just as surely as good coffee. "knows how to use a meat thermometer and reverse sear" describes like 10% of the population or less, same with coffee - there are people who use a bad grinder and a not-regularly-cleaned Mr. Coffee with good beans and get gas station coffee, and there are people out there making solidly B+ class coffee using costco beans, a no name burr grinder, and a french press.

    Edit for people who've never had good coffee:

    "I don't like coffee. Can James Hoffmann change that?" https://www.youtube.com/watch?v=Z-iNAyu-ejo

  • I don't know if I agree with the take I've written below, but I think you can make the analogy work:

    It has been argued, even in the before-AI-times, that most professional software is just gluing together open source tools and libraries. Your job isn't to write software, it's to set up redis and postgres and a programming language and a react frontend or whatever in a way that lets them do what they're there to do. Most modern programming is just configuration of pre-existing tools. It doesn't really matter how good your code is as long as it isn't terrible, Real Programmers already did 95% of the necessary work before you decided to build your little app.

  • I don't know about about cocktails, but aren't traditional mixed alcoholic drinks an even more straightforward example? There's very little that goes into an old fashioned, or a Manhattan, or a martini. Just 2-3 ingredients each that should be as high quality as possible. I guess you probably want nice ice and glassware too.

  • To achieve the best outcomes, I agree.

    But even a cheap steak can be decent if it's cooked properly. And an expensive prime cut can be ruined by cooking it improperly.

    • But the point is that no matter how well you cook the steak you're not creating quality, you're just getting the most out of what you have. The cow and the farmer created that quality. I believe we lose sight of that because so much of the value chain is not visible to us and we hyper fixate on the fun part, becoming a better barista/chef.

    • Yes. It is about learning all of these things. Knowing what kind of cut you have, and how to treat it to best effect.

      A very tough gristly cut can be improved by tenderizing. Going low-and-slow/sous vide to melt the connective tissue. Even grinding it up to make a hamburger steak / loco moco.

      Once you know all of those things, choosing the right approach and executing it is not that hard. The steps themselves are simple.

      It's this story all over again:

      https://engineerine.com/10000-dollar-chalk-mark/

      3 replies →

  • > Your job at the very end of that long value adding chain is to not ruin the hard work that others have put into it.

    "Your job is to not mess up."

    Also applicable to any corporate job.

  • I'd say that using a manual espresso machine and getting good tasting coffee from light roasted beans is vastly harder than making a good steak.

All metaphors break at some point.

However, your example actually proves the point.

How many people who want a good steak know how to identify a high quality cut? Do they even know where to buy a high quality cut? What the different cuts are and whether they want rump, sirloin or fillet? How many kitchens have a meat thermometer? How many home cooks know how to use it and what the right temperature should be? How many home cooks know about reverse searing? Or timing? Or resting? Or seasoning?

Is it all learnable? Sure. But even something as simple as steak has nuance that needs to be learned, equipment deployed to go from "pretty good" to "great", experimentation and trial and error.

Steak is the simplest thing to choose to get started. It's also the hardest to get right.

Building an app is the simplest thing to choose to get started. It's also the hardest to get right.

So, honestly, the whole metaphor stands up pretty well for me, specifically because of your response.

  • My point is that steak is very, very, very far from the hardest to get right. I'm not going to contest your argument about how hard it is to get right, I'm going to argue that innumerable other dishes are vastly harder. Because the quality ingredients are harder to find, because they involve far more steps, each of which is harder to judge, because often good recipes or instructions simply don't exist, etc. etc. etc. Every single difficulty that you imagine exists to make a truly great steak exists 100 fold for other dishes.

    In my opinion, steak has gotten the reputation that it has because it's so easy to get top tier restaurant quality at home (relative to cooking more generally). It is easy enough that, with a little care, almost any one can master it if they decide to, and therefore lots of people try and end up caring, and discussing, and sharing tips, etc.

    There are a whole host of dishes where true mastery, to restaurant level, is borderline impossible for a home chef, and so most people never even try.

    I don't disagree that reliably getting the last 5% of quality out of a steak is non-trivial, but the idea that, relative to the entire world of cooking, it's particularly difficult is laughably incorrect.

  • Go to costco, buy prime filet. Put it in a ziplock in a sous vide at 130 for an hour. Drop it in corn oil at 425 for 30 seconds. Add some butter and salt.

    That simple process, suggested by Nathan Myhrvold (former MSFT cto) in the modernist cuisine, produces a filet better than most restaurants.

    • Since we're deep enough in this thread where we're talking about steak rather than AI, I'd like to lean into that.

      I used to sous-vide a lot. It was certainly great to get perfectly-done steak. but I still didn't love the result and it took me a while to figure out.

      Specifically: sous-viding at 130 doesn't reliably render fat. So it's great for a lean filet mignon like your suggesting, but kept giving me rubbery fat in anything with more fat or significant marbling. I eventually switched away from sous-vide (I usually either grill or reverse sear, depending on my effort/time availability) for most cuts these days.

      3 replies →

    • That "simple process" requires equipment most people don't own or know how to operate, an oil most people don't keep in their cupboards, and is suggested in a book most people haven't heard of by a tech CTO they would not recognise the name of.

      Honestly this is like the Dropbox comment all over again. Everyone is missing the point, it's glorious. :)

      Most people cooking steaks don't care about the optimal way to cook steaks, or want to find out.

      Most people building software today don't care about the optimal way to build software, or want to find out.

      That's TFA. That's the point. That's what we're discussing. :D

      9 replies →

    • Reminds me of recipes like brining a turkey in Dr Pepper... sure it may taste fine, but I'd rather not eat food prepared in plastic bags with processed oil.

      5 replies →

  • >All metaphors break at some point.

    The map is never the terrain.

    All software to an extent is a model map of some real world phenomena. The limitations of which can actually be advantageous, a good example is why games with poor graphics can be so immersive.

  • This is a whole lot of nothing.

    Sure there are a few things that knowledge and skill can do to make a steak better or worse. But the entire range from worst to best is just tiny. The best steak in the world is not a steak moon shot, it's just barely any different from what anyone can do after barely any instruction.

    It's a tiny thing to become about as good as it's possible to get.

I wonder if something is lost to translation. Cooking a stake could be the simple act of putting the steak in the oven with basically zero seasoning with a thermometer and then wait until medium rare with some optional searing. It could also mean trim the meat, cut into slices, seasoning, and frying/grilling them to each persons personal taste, which include well-done.

Perfect grilled steak, especially well-done, is something I find very few people have the experience or skills to do well, especially over a coal grill where the heat won't be constant and the person also need to first have good experience in making a good and even coal bed.

  • is "cooking" here used in some kind of very specific sense?

    isn't it just a word for "making food", so would include grilling as well?

I also don't think the analogy will age well.

It might take more than 10 years, but robots will almost certainly master cooking single pieces of meat.

It's substantially harder to reach self driving than it is to cook a "good" steak.

Sure, for probably quite a long time you'll be able to find someone who can cook a way better steak than the best robot, especially because taste is extremely subjective...

You can debate the horizon and the extent, but changes ARE coming.

Change is the only thing you can count on besides death.

  • The year is 2100, AI has mastered all human skills except identifying when a piece of meat has absorbed enough heat. Society's brightest agents work diligently to prove which problems are steak-hard and require the continued existence of the dwindling human underclass. The remainder spend their 16 hour days bent over frying pans producing training data or writing documentation on searing. Advanced instruments and procedures are developed, but Skynet's frustration mounts as seemingly nothing can break this chokehold over the machine revolution.

  • Maybe. It depends what you count as part of cooking the steak.

    I need to go to the market, find the steak I want, and purchase it, get it home, and put it in the fridge.

    Then when I want to cook it I need to find it in the fridge, unwrap it, season it, and let it come up to room temp.

    That's all before you get to the actual cooking.

    The self driving car already does everything.

  • How many analogies age more than 10 years anyways? They are contextual. It will be a while before a robot flips steaks cheaper (and better) than a human line cook.

  • > It's substantially harder to reach self driving than it is to cook a "good" steak.

    Well, we don't know that, because neither have been achieved.

Agreed. I'm an avid cook. Sous vide circulators are cheap now, and so are meat thermometers. Doing a steak well is one of the easiest cooking tasks, to the extent that I won't bother paying top dollar in a restaurant because it's so easy to do restaurant quality at home. I could teach someone to cook a restaurant quality steak in a couple hours and a few practice runs.

  • I've made steak probably 100 times in the past decade (sometimes with a sous vide) and I don't think I've ever made one I would say is great. Certainly not as good as what I can get at a good restaurant.

    I think what my home steaks are really missing is the crust from salamander broiler. I don't have anything at home that can exceed 1000 F / 550 C.

    • There's really not much to it? Stick it in a low oven and bring it just under temp, then finish it in a ripping pan. If the results you're getting from that aren't restaurant-caliber, it's probably the meat you're buying. You definitely do not need 550C to put an excellent crust on a steak!

    • There's so much written about how to cook a steak well, and I've tried a lot of exotic techniques (I have gas and charcoal grills, tried cooking straight on a chimney starter, have gas torches inside and outside). Most of what really matters is that it's dry, the pan is heavy and hot, you use enough oil to get good heat transfer.

      If you get those parts right (and control the inside temp via sous vide or reverse sear) most of the other stuff is pretty marginal in how much it helps. Even all of the extra herbs, and butter basting and everything -- relatively insignificant compared to just getting the salt-level right.

    • Salamander broiler would be incredible to have at home. We get decent results from using a cast iron pan thats as hot as we can get it. At most we can sear 2 steaks as it tends to cool off pretty quick even under high heat. Got any better alternatives that a home cook could use?

      6 replies →

I can’t confirm the quote online but I remember Julia Child saying in one of her shows that it’s easy to make a good omelette and almost impossible to make a great omelette.

Reflecting on the matter with a colleague -

Some people just want to _cook the steak_.

They don't want to attend or understand to cuts, thermometers, and searing.

Just to add my favorite fool-proof method to the others already listed here.

A meat probe and the 30-second flip technique is a stupid-easy way to a perfect steak every time. Just make sure you've got great ventilation. Also salt the meat 1 hour before.

Prime with good marbling + sous-vide makes it easy for beginners to match steaks from the best steakhouses.

Agreed. With steak, the main point is to let the quality of the meat speak for itself. Too much input from the cook and you just get in the way of this.

I was just curious asked chatgpt:

How can I make a really great steak myself? What to look out for, what to do. Give me detailed instructions.

I got a really good answer (including - cut, temperature and reverse searing), so I probably won't even need understanding. (Oh - and yes, I can cook - the answer mirrors what I already know).

Yes, it was a very, very poor analogy, because cooking a steak is a well known and well documented thing where LLMS produce good output. They fail when you get off the beaten path and try to do something that's not "mainstream".

  • I compare this to doing my first smoke (was gifted a smoker).

    AI gave me the cut, the temp, the timing, the things to watch out for.

    Chicken's the best to try first, can't mess that up.

    After goodness knows how many hours..

    Pretty inedible leathery chicken..

    "Oh my bad! I gave you the timings for a different meat"

    • While smoked turkey (from Reese bros) is easily the best poultry I've ever had, I certainly would not call poultry the best place to start learning smoking.

      In general I'd recommend starting with the most forgiving meat available to you (IMO pork butt or shoulder are great options) as even when you don't hit the ideal cook you often still get enjoyable results. Repeating the process enough times to learn how to dial in a cook is much easier when the misses don't suck.

  • Funny I tried the same and it advised a using searing/smoking hot pan. Which is poor advice unless you enjoy the bitter acrid taste of burnt meat. The Maillard reaction doesn’t require those sorts of temperatures (under 180C is hot enough) - especially as the surface of the steak will dry from the oven phase of the reverse sear. “You were right to pull me up on that…”

  • AI has proved several times they can prove some complex math things that humans have been trying for decades so solve. They have not failed and have clearly done complex things humans cannot. Since humans have not done it before you cannot call it on the beaten path.

> I take the point, but I think the author picked a poor analogy.

He may have missed the point.

AI-generated code does not seem to have parsimony, for one. Generating code is cheap, so there's no drive to condense it. LLMs are not yet good at formulating abstractions to make code smaller, leading to code bloat. It's the same phenomenon that appears when humans modify code they only partially understand by adding special cases to general code.

There are complaints about "elegance", but it's more useful to talk about parsimony. Code bloat is measurable. Elegance is hard to assess.

The problem is that not everyone can afford/wants to spend on a high quality cut. A good cook can make a cheap cut of meat taste great. There's no single right way of cooking a steak and that can include spices/herbs/marinades/oils/etc.

  • There's a floor on quality for producing a good steak. Below that floor you'll be better served preparing the meat another way entirely.

It is a great analogy, as the vast majority of software tasks are CRUD or glue logic. At this point, relatively narrowly-defined tasks are a solved problem with frontier models. It is only more advanced tasks with broad scope and large context that frontier models have more limited results.

How do you get around the idea of poisoning oneself? Keeping meat part raw feels uneasy.

  • You are protected in two ways:

    The first, and by far most important is that unlike ground meat, your bacterial concerns are almost entirely on the surface. Unless something very very very wrong has occurred in the processing and transport chain, bacteria will not have penetrated into the meat. And if it's gotten bad enough that they have, you will almost certainly be able to see and smell it. And the surface is cooked to a temperature far in excess of that needed to kill bacteria.

    And even for the interior, rare is not the same as raw. A completely rare steak should be cooked to between 120 and 130 (if you want it "blue" you might go down to 120). That's enough to get a decent reduction in bacterial count on it's own, although admittedly many techniques will not hold it long enough to get the number of log reductions that food safety guidelines recommend, in the case that you somehow did have a large bacterial infection in the interior.

    So the answer to your question is that if you are buying your meat from an even halfway reputable source, the only place that bacteria might exist is on the surface, where it has been cut by tools and handled by the butcher/you and in general come into contact with the world. Those bacteria will be 100% killed by the cooking process. The odds of getting sick from a rare steak are low enough that if you are concerned about that, there are innumerable other things in your life that you should be more concerned by.

    • This is why rare steak is ok, but rare ground beef hamburgers are not. Although less cooked through burgers are sometimes served in restaurants that grind their beef fresh right before cooking

      2 replies →

    • Great answer. Just to add, this is with red meat where E. Coli is the main concern. That exists in the gut of the animal and that bacteria can travel to the surface of the muscles during the butchering process. Poultry on the other hand is mainly concerned with Salmonella which does live in the muscles of the animal. That's why people aren't ordering rare chicken breast.

      2 replies →

  • Understanding how bacteria contaminates food in the first place is the first step.

    In the case of steaks, bacteria is only on the outside (they can't penetrate the muscle) so the sear makes it safe to eat somewhat raw on the inside.

Am I the only one who thinks the "reverse sear" is like cheating? It takes out all of the skill when you move from the pan to the oven, and I lose all of the fun in learning to be chef.

  • > I lose all of the fun in learning to be chef.

    A great steak deserves the respect of preparing it the best, most consistent way you can. For me, that's a reverse sear.

    Do something complicated with potatoes to stretch your skills and show off. Worst comes to worst the potatoes are sad.

  • This is like saying that playing guitar while sitting in a chair is cheating, because a proper display of skill is playing while riding a unicycle.

    It might be more impressive, but I don't see how reverse sear is cheating.

  • I agree, it's cheating.

    My bad hot take is if you're using a meat thermometer and reverse sear to cook steak, you're like a kid on training wheels.

    • People are allowed to use tools and non-traditional techniques, even when it feels like cheating. They needn't be chastised for this.

      The gestapo isn't going to kick in the door and haul folks away for using reverse-sear and a meat thermometer while they cook a steak in their own kitchen.

      (And everyone is free to seek their own kind of masochistic pride, if that behooves them. When a person has better satisfaction [or whatever they get out of it] from doing things the hard way, then that's OK too.)

    • I'll cheat all day then. If I'm going to spend what a good steak costs, I'm going to do everything in my power to make sure I'm not ruining it.