← Back to context

Comment by 0x457

7 hours ago

Keep in mind that if you want MTP it adds a few gigs. If you use sub-agents it turns already slow generation into even slower generation. Won't be doing any compling (so rust, c and probably go are not avaiable) becase those add memory pressure during compiling.

32gb of unified memory is enough enough for system to be used for anything other than LLM generation.