← Back to context

Comment by TeMPOraL

5 hours ago

Half of the industry is, going by the amount of "AI doesn't amount to anything and is just regurgitating text".

Two things:

- For the past year or more, many models can emit images directly, and all models that matter can see images directly - that's what "multimodal" means. Tokens don't have much to do with textual language anymore, they're more like units of sensory experience.

- Even restricted to text, a language model can operate anything that can be expressed as text, as long as you have a translation layer between textual representation and the final form. That includes giving commands as text. The total addressable space of what models can be used for is, thus, approximately anything humans do.

2 comments

TeMPOraL

Reply
qlte  4 hours ago

...that doesn't actually answer the question.

  > No image model, and no Friedrich images given to the painters. Every picture here is a program written by an AI model; all but one (a comparison, marked) run through a simulation of oil paint.

  ...

  > A physical oil-paint simulator in Rust, and an easel to paint with it.

  > Every mark is made the way a painter makes it: simulated bristles carry wet paint over a primed linen canvas, the paint levels and dries on a clock, and layers combine by Kubelka–Munk optics. Paint comes only from piles knifed together from named tubes.

https://github.com/aliceisjustplaying/claude-paint