Contamination is the default
If your test set is public, assume it is in training data. Private, freshly written tasks are the only reliable signal.
Score what users feel
Latency, refusal rate and recovery from bad input matter more to perceived quality than a two-point accuracy delta.
Comments (0)
Discussion is opening soon. Be the first to comment.