Comment by echelon
17 hours ago
This doesn't mean you have the raw model weights, right? That's still entirely hidden / opaque?
You can just run "air gapped" inference?
Is this only of interest to enterprise customers already on AWS (who want "air gapped" behavior)? Is there any other use case for this?
This will be more expensive than calling OpenAI directly, right?
A lot of companies already have data processing agreements and compliance sign-off for using AWS. Many are hesitant to send their data to AI startups with an incentive to train their models and a history of being.... loose with how they intake training data. Even when they do give assurances otherwise. AWS is more trusted in this aspect.
If this ends up similar to Claude on Bedrock, it's the same price.
This is for people who don't trust openAI with their data, but do trust Amazon.
But it also is for Devs in a company who already have a blanket agreement with Amazon, but would have an uphill battle signing an agreement with openAI.