Comment by swed420
5 days ago
According to OP:
> Why this test? Because pelicans are hard to draw, bicycles are hard to draw, pelicans can’t ride bicycles... and there’s zero chance any AI lab would train a model for such a ridiculous task.
At this juncture I'm left wondering why competing AI labs wouldn't train for this now well known "test".
Given their proclivity to scrape the entire contents of the internet, it's only a matter of time intentional or otherwise.
I've heard the same has happened with common benchmarks (they've ingested solutions into training data)