Comment by ArnavAgrawal03
10 months ago
Yes! If you're running the local version and it's taking long, that an indication that your GPU isn't being used properly. This can be traced back to the `colpali_embedding_model.py` file, where you can set the device and attention you want PyTorch to use.
No comments yet
Contribute on Hacker News ↗