Comment by tsunamifury
20 hours ago
either ... portability is nearly instant except for KV Cache, which is extrodinarily expensive to store.
20 hours ago
either ... portability is nearly instant except for KV Cache, which is extrodinarily expensive to store.
Business people do not even know what that is. Are you talking about models when the rest of us are talking about harnesses and the interface people use?