Comment by djcooley

There are chip startups trying to address this exact issue. For example, Cornami: https://cornami.com.

There is also a lot of research into lowering the power/compute penalty of FHE. See ISSCC 2023: https://ieeexplore.ieee.org/stamp/stamp.jsp?arnumber=1006752....