Comment by zamalek
2 days ago
What's the deal with memory? Does it use the system RAM? I've been considering a cluster for local inference.
2 days ago
What's the deal with memory? Does it use the system RAM? I've been considering a cluster for local inference.
The data has to go across PCI / USB to get to the internal (tiny) SRAM. It's not a good choice for clustering, you should just use a GPU for that.
It has a tiny amount, I believe it was 8MiB. That's Mega, not Giga.
Dont know, sorry. But the performance is not that awesome, but works well enough for my setup doing realtime object detection with a few cameras.
My main reason for getting one was power efficency compared to a traditional GPU for this task.
I have a Coral M.2 and an Intel Xe iGPU on the same machine. Both passthrough to VM, Proxmox, iGPU with SR-IOV. On Proxmox I can see power usage of one camera for SR-IOV device utilizing intel_gpu_top: less than 0.1W.
iGPU for detection? Whats the performance on that?
Sounds cool but for me that would mean more upgrades for that server.
Coral runs on 0.5 watts , which is way less than the geforce 1080 i used before.
1 reply →