Comment by the_snooze

7 months ago

I like to throw sports trivia at AI systems to see how well they do on something that's low-stakes and very well-documented. Here's one question Wiyomi generated for me just now about college football:

> What coaching change occurred at USC during the 2010-2011 offseason?

> A. Lane Kiffin left for the Oakland Raiders, and Steve Sarkisian took over

> B. Pete Caroll left for the Seattle Seahawks, and Lane Kiffin took over

> C. Steve Sarkisian left for Washington, and Lane Kiffin took over

> D. Lane Kiffin was fired, and Steve Sarkisian took over

I chose B because I knew that to be true: https://en.wikipedia.org/wiki/Lane_Kiffin#USC_Trojans

Wiyomi said I was wrong, and that D is the correct answer:

> Lane Kiffin was fired as USC's head coach after the 2010 season, and Steve Sarkisian, who had been the offensive coordinator, took over as the interim head coach before being officially named head coach.

Lane Kiffin's tenure at USC lasted from 2010 to 2013. If I can't rely on these AI systems for the simplest low-stakes tasks, what good are they for?

They're good for making CEOs rich(er)?

(Not trying to be sarcastic, this is genuinely the best reason I can think of)

Edit: made a change for completeness.