← Back to context

Comment by orbital-decay

15 days ago

It's still clearly not a part of any model's training set in the sense of pelicanmaxxing in particular. It's either a capability to generate arbitrary SVGs (or even something broader), or no specific training at all.

Yet, they're all almost exactly the same in style and composition.

  • Certainly not because all labs are pelicanmaxxing on the same exact image. Most patterns are similar everywhere. That's the result of training on the same datasets and scraped web contaminated with other models' outputs, combined with similar training methods and resulting mode collapse. Try if e.g. dolphins knitting socks in spacesuits are similar on all/most models.

    • > It's either a capability to generate arbitrary SVGs (or even something broader), or no specific training at all.

      > That's the result of training on the same datasets and scraped web contaminated with other models' outputs

      Maybe I'm misinterpreting though, or just semantics. I would consider contamination, or whatever the first example was that they all matched, as specific training data, along with all the duplications of. I doubt it's model collapse to the same pelican, without the same original example.

      1 reply →