← Back to context Comment by koakuma-chan 6 days ago The prompt may be the same but the seed is different every time. 1 comment koakuma-chan Reply biophysboy 6 days ago Could you not cache the top k outputs given a provided input token set? I thought the randomness was applied at the end by sampling the output distribution.
biophysboy 6 days ago Could you not cache the top k outputs given a provided input token set? I thought the randomness was applied at the end by sampling the output distribution.
Could you not cache the top k outputs given a provided input token set? I thought the randomness was applied at the end by sampling the output distribution.