Comment by sosodev

17 hours ago

I think Nano Banana Pro should have passed your giraffe test. It's not a great result but it is exactly what you asked for. It's no worse than Seedream's result imo.

Yeah I think that's a fair critique. It kind of looks like a bad cut-and-replace job (if you zoom in you can even see part of the neck is missing). I might give it some more attempts to see if it can do a better job.

I agree that Seedream could definitely be called out as a fail since it might just be a trick of perspective.

  • Have you ever considered a “partial pass”?

    Perhaps it would be an easy cop out of making a decision if you had to choose something outside of pass/fail.

    • That's not a bad suggestion. I thought about adding a numerical score but it felt like it was bit overwhelming at the time. Maybe I should revisit it though in the form of:

        Fail = 0 points
        Partial = 0.5 points
        Success = 1 point
      

      There's definitely a couple of pictures where I feel like I'm at the optometrist and somehow failing an eye exam (1 or 2, A... or B).

      1 reply →

I don’t understand at all why Seedream gets a pass there. The neck appears the same length but now it’s at a different angle.

  • Alright I think it's time to concede defeat! Seedream has been summarily demoted to a failure and I've added in the following minimum passing criteria to that particular test:

    - The giraffe's neck should be noticeably shorter than in the original image, while still maintaining a natural appearance.

    - The final image cannot be accomplished by simply cropping out the neck or using perspective changes.

I agree. From where I'm sitting, Seedream just bent the neck while Nano Banana Pro actually shortened the neck.