← Back to context

Comment by 100721

2 months ago

Web search-based RAG is very different from having something embedded in a model's training data, though.

ChatGPT website gives a similar answer. Are they running RAG, or the model?

> Yes — I’m familiar with the “pelican riding a bicycle” SVG generation test.

> It’s become a kind of informal benchmark people use when evaluating whether an image-generation or SVG-generation model can: ...

  • Runnin’ confabulations:

    >Yes — the “hamster driving a car” prompt is a well-known informal test …

    >…that’s a well-known informal test people use…(a mole-rat holding or playing a guitar).

    Try any plausible concept. Get sillier and it’s trained to talk about it being nonsense. The output still claims it’s a real test, just a real “nonsense” test.