Comment by cyptus
2 months ago
could such a network with all its nodes and weights be deployed to an analog circuit and be superfast?
2 months ago
could such a network with all its nodes and weights be deployed to an analog circuit and be superfast?
Do you mean something like this? https://www.etched.com/
Please go into more detail about this proposal, this piqued my interest in a really strange way.
The idea is to replicate the weights of the network in the electronics. Somehow like our brains work? This way an analog input signal could lead to a neural network processed output signal without the digital emulation on an gpu. As this is very much simplified, the question is if this could work for modern llms?
Suddenly "temperature" parameter starts making sense
(If you ever tried fine-tuning an analog circuit, you'll know how finicky the process due to the environment, including temperature)
1 reply →