Comment by hungryhobbit

12 hours ago

I don't follow how "we can see tiny stuff" = "it is possible to build closed system"?

Seeing tiny stuff doesn't magically give you enough info for Claude to reason with the system predictably (the way it can with source code).

It can start to reason about what it seems under the microscope. You just need to train it on images and data from microscopes.

  • Have you looked at cells and tissues under a microscope? There’s patterns upon patterns inside patterns under and over and through other patterns.

    There’s no well-labeled dataset for all this because we don’t know everything we are looking at.

    Take a neuron. You can stain it so you can tell apart an axon and a dendrite. But if you don’t it’s very possible to miss or mislabel the axon, because unlike the textbook neuron, the axon isn’t always obviously oriented in a way that promotes ID.

    And that’s just one example. With more complex samples, you also have a lot of edges which AI models don’t segment very well.

    • You largely explained a day in life of a SWE working in a complex codebase spanning (tens of) millions lines of code. In complex products we always deal with a great degree of uncertainty and due to the ambiguity and high complexity we usually have no simple way of proving that the thing (TM) we designed is going to be working as advertised in all cases. Because the problem space is in-exhaustive, and to increase the likeliness of the solution we designed, we run the experiments, and not on a sole machine but clusters at data-center scale. Even then you get "bug reports" and that's not because engineers were lazy but because the domain is genuinely complicated, and ever changing.

      So, I'd say it's a pretty similar process, and yet we have the AI models now almost completely integrated into the SWE domain remediating significant parts of its complexity.

      4 replies →

the transition is in-silico => in-vitro => in-vivo

AI already can do in-silico simulation

add microscopes and tiny precision actuators, and we can build closed feedback loop in-vitro system

once we have in-vitro, it will be easier to go in-vivo