Comment by kittikitti
3 hours ago
This is a good rule of thumb. I would also include that in most cases, RAM use exponentially increases with context window size.
3 hours ago
This is a good rule of thumb. I would also include that in most cases, RAM use exponentially increases with context window size.
No comments yet
Contribute on Hacker News ↗