← Back to context

Comment by yjftsjthsd-h

2 days ago

> Does mean it pulls the model every time on startup though which isn't ideal

Surely it just downloads to a directory that can be volume mapped?

Yep. I just didn't spend the time to track down the location tbh. Plus huggingface usually does links to a cache folder that I don't recall the location of

Literally got cuda containers working earlier today so haven't spent a huge amount of time figuring things out