Comment by dominotw
1 hour ago
i read all that i still dont see what your intuition is about how llm work.
visualizign 100 dim matrix will not tell you how llm work. so what you even talking about.
1 hour ago
i read all that i still dont see what your intuition is about how llm work.
visualizign 100 dim matrix will not tell you how llm work. so what you even talking about.
Yes, if it cannot be measured it doesn’t exist no matter how much it would make everyone feel more comfortable if we could intuitively understand these systems.
Visualizing large dimensional matrices is a way of starting to develop intuition about llms. If you can't visualize high dimensional spaces, and you haven't studied llms, you're not going to have any intuition about how they work.
Depending on your knowledge of math, I recommend starting with linear algebra, building an understanding of the equations and try to visualize more and more complex systems, then study llms to see how you can apply your linear algebra intuition to your understanding of llms.
VTK is a great toolkit for visualizing complex systems. 3 blue one brown on YouTube has other visuals that might help you.
It takes time but it's possible. Good luck.