Comment by danny_codes

I don’t know.

Let’s say someone sells me a shovel and markets it as a shovel. Then the shovel explodes because it was actually a bomb.

Presumably the manufacturer is liable for passing off their bomb as a shovel.

This metaphor seems reasonably accurate for current LLMs