Comment by ponyous

12 hours ago

https://grandpacad.com - AI modeling for 3D printing Been at it for about year and a half.

Really exciting stuff is happening literally every month, because underlying models are getting better and better. When I started it was pretty basic: “make a cube with a hole through it”. Now it’s at the point “make a raspberry pi 4 case” and the agent searches, builds, verifies…

What surprised me in this process is how little meaning AI benchmarks have. Pareto frontier for my use case looks completely different than any other benchmark portrays.

You mentioned benchmarks don’t mean much in this area. What are the best models you found in this area?

Personally, I’ve had the most success with GPT models using MCP servers for this task.

  • Same here. 5.5 would sometimes oneshot relatively complex models even without MCP. Opus, however, even with Fusion 360 MCP access would usually make comically bad models. It seemed that Opus tried to reason through the problem while GPT would come up with a general plan of using whatever tools were available to solve the problem. In chat, it would use the available Python and trimesh. It was also the only time I had ChatGPT work on something for over 30 min without giving up.