Comment by snvzz
8 hours ago
Maybe it's not properly benchmarked.
A standard benchmark using kicad to create or fix electronic designs would go a long way in motivating and measuring improvement.
8 hours ago
Maybe it's not properly benchmarked.
A standard benchmark using kicad to create or fix electronic designs would go a long way in motivating and measuring improvement.
There's eebench, but maybe it's not exactly what you were thinking
It was featured on Astra's model card and promotional materials, which the folks there (at EE-Bench) really appreciated: https://eebench.org/blog/can-ai-design-circuit-boards-yet/
I'd expect that upcoming models will be increasingly better tested and developed for this workload from now on.