Comment by moralestapia
2 years ago
>A friend who developed NoCha [1] is running the model on that benchmark [...]
Please do update us on the result.
2 years ago
>A friend who developed NoCha [1] is running the model on that benchmark [...]
Please do update us on the result.
Not looking good. Apparently the model was broken when they released it yesterday. The version they uploaded 8hrs ago only has an 8k context length, so we can't test it on the novels.
Here's the updates to the model config on huggingface:
https://huggingface.co/mattshumer/Reflection-Llama-3.1-70B/c...