Comment by cachius

10 days ago

Serverless means spinning compute resources up on demand in the cloud vs. running a server permanently.

9 comments

cachius

Reply
dsr_  10 days ago

~99.995% of the computing resources used on this are from somebody else's servers, running the LLM model.

locknitpicker  10 days ago

> Serverless means spinning compute resources up on demand in the cloud vs. running a server permanently.

Not quite. Serverless means you can run a server permanently, but you need pay someone else to manage the infrastructure for you.

  • Stefan-H  10 days ago

    You might be conflating "cloud" with serverless. Serverless is where developers can focus on code, with little care of the infrastructure it runs on, and is pay-as-you-go.

    • locknitpicker  9 days ago

      > You might be conflating "cloud" with serverless. Serverless is where developers can focus on code, with little care of the infrastructure it runs on, and is pay-as-you-go.

      That's not what serverless means at all. Most function-as-a-service offerings require developers to bother about infrastructure aspects, such as runtimes and even underlying OS.

      They just don't bother about managing it. They deploy their code on their choice of infrastructure, and go on with their lives.

      1 reply →

  • turtlebits  10 days ago

    Close. It means there's no persistent infra charges and you're charged on use. You dont run anything permanently.

    • dvfjsdhgfv  10 days ago

      It still doesn't capture the concept because, say, both AWS Lambda and EC2 can be run just for 5 minutes and only one of them is called serverless.

      1 reply →

  • jwiz  10 days ago

    Depends if you mean "server" as in piece of metal (or vm), or as in "a daemon"