← Back to context

Comment by webprofusion

18 hours ago

If you can use a custom chip yep, if it's commodity hardware probably not. You could use secure boot/secure memory etc but that can be a footgun in itself later.

What do you mean "Custom chip", like ASIC ? Never in my career that i feel the need to make our own ASIC.

  • Parent comment was likely about how are you supposed to put LLM into your chip. Commodity ICs are already optimized down to their minimums wrt compute/memory/storage. Ultimately, I think it will prove that RE examples like this are going to become a difficult problem to solve.