Comment by verdverm
20 hours ago
For developers or the business team? Which group are you and are you making assumptions about the other?
20 hours ago
For developers or the business team? Which group are you and are you making assumptions about the other?
either ... portability is nearly instant except for KV Cache, which is extrodinarily expensive to store.
Business people do not even know what that is. Are you talking about models when the rest of us are talking about harnesses and the interface people use?