← Back to context Comment by theLiminator 1 day ago I wish someone ran some sort of representative benchmark suite every X days to see if this occurs. 3 comments theLiminator Reply micycle1 1 day ago https://marginlab.ai/trackers/codex/ CamperBob2 1 day ago Unfortunately that seems to be monitoring Sol, not Astra, unless I'm missing something. embedding-shape 1 day ago I'm not sure how you could run such a benchmark without leaving it possible for the labs to easily detect and fudge the results.
micycle1 1 day ago https://marginlab.ai/trackers/codex/ CamperBob2 1 day ago Unfortunately that seems to be monitoring Sol, not Astra, unless I'm missing something.
CamperBob2 1 day ago Unfortunately that seems to be monitoring Sol, not Astra, unless I'm missing something.
embedding-shape 1 day ago I'm not sure how you could run such a benchmark without leaving it possible for the labs to easily detect and fudge the results.
https://marginlab.ai/trackers/codex/
Unfortunately that seems to be monitoring Sol, not Astra, unless I'm missing something.
I'm not sure how you could run such a benchmark without leaving it possible for the labs to easily detect and fudge the results.