Comment by esalman

1 month ago

This.

My manager reported couple of days ago that copilot manipulated some tests in order to make edge cases pass.

We have standalone prototypes for our product, so it was easy to catch, but actually going in to debug and fix was much harder than expected.

It absolutely did nothing to increase confidence on copilot though. I personally manually accept each line of code copilot writes, unless it's a skill/mcp server we have no plan to deploy.