Comment by jazzpush2

11 hours ago

What? Either option requires sufficient data. Brute force implies iterating over all combinations until you find the best weights. Back-prop is an optimization technique.

1 comment

jazzpush2

Reply
Ygg2  2 hours ago

In context of grandparents post.

     > You determine the weights via brute force. Simply running a large amount of data where you have the input as well as the correct output

Brute force just means guessing all possible combinations. A dataset containing most human knowledge is about as brute force as you can get.

I'm fairly sure that Alpha Zero data is generated by Alpha Zero. But it's not an LLM.