← Back to context

Comment by naasking

1 year ago

State is a function of accumulated past information.

State is a function of accumulated past. That does not mean that having some past written down makes you stateful. A stateful thing has to incorporate the ongoing changes.

  • Which is what I described: some successful prompt-replies are fed back into subsequent training runs.

    • No… that implies the model never has active state and is being replaced with a different, stateless model. This is similar to the difference between

      Actor.happy = True

      And

      Actor = happier(Actor)

      2 replies →