The inference is cheap, but the context window costs for iteratively debugging architecture issues add up fast. Things like state management or migrations usually require feeding the whole stack back in multiple times, which blows past that budget pretty quickly in my experience.
The inference is cheap, but the context window costs for iteratively debugging architecture issues add up fast. Things like state management or migrations usually require feeding the whole stack back in multiple times, which blows past that budget pretty quickly in my experience.