Comment by measurablefunc 11 days ago That would just add up to statistical noise instead of 10% degradation over a week. 3 comments measurablefunc Reply kevin_thibedeau 11 days ago Catastrophic error accumulation can produce more profound effects than noise. measurablefunc 11 days ago Just to make sure I got this right. They serve millions of requests a day & somehow catastrophic error accumulation is what is causing the 10% degradation & no one at Anthropic is noticing it. Is that the theory? pertymcpert 5 hours ago FYI something in that region happened last august/September. Some inference bug triggered worse performance on TPUs vs GPU.
kevin_thibedeau 11 days ago Catastrophic error accumulation can produce more profound effects than noise. measurablefunc 11 days ago Just to make sure I got this right. They serve millions of requests a day & somehow catastrophic error accumulation is what is causing the 10% degradation & no one at Anthropic is noticing it. Is that the theory? pertymcpert 5 hours ago FYI something in that region happened last august/September. Some inference bug triggered worse performance on TPUs vs GPU.
measurablefunc 11 days ago Just to make sure I got this right. They serve millions of requests a day & somehow catastrophic error accumulation is what is causing the 10% degradation & no one at Anthropic is noticing it. Is that the theory? pertymcpert 5 hours ago FYI something in that region happened last august/September. Some inference bug triggered worse performance on TPUs vs GPU.
pertymcpert 5 hours ago FYI something in that region happened last august/September. Some inference bug triggered worse performance on TPUs vs GPU.
Catastrophic error accumulation can produce more profound effects than noise.
Just to make sure I got this right. They serve millions of requests a day & somehow catastrophic error accumulation is what is causing the 10% degradation & no one at Anthropic is noticing it. Is that the theory?
FYI something in that region happened last august/September. Some inference bug triggered worse performance on TPUs vs GPU.