Comment by speedstyle
11 hours ago
or Tinfoil [0]? They serve open models with container integrity attested by Nvidia/AMD enclaves. Every cloud provider offers this of course, but not usually in a way that can be shared between distrusting users for economical inference. It still relies on the open-source containers being secure, and there's probably hardware sidechannels and stuff, but personally (ie privacy not liability) I trust it more than a contract
Their prices are extremely high compared to the competition on https://openrouter.ai/deepseek/deepseek-v4-flash-0731 fyi.
tinfoil asks more than 10x the output cost ... $1.90 per 1M tokens instead of $0.18 per 1M tokens for my favorite model (Deepseek V4 Flash 0731) on my favorite provider (DeepInfra) currently, for example.
I loaded credits into Tinfoil the other day and have had zero issues, thanks to smart folks around here and the security space recommending it.
It's now my open weight inference provider of choice, since on top of the privacy/security characteristics it's also reasonably cheap.