You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
When comparing multiple experiments, allow seeing scores and comments side by side (ideally with only the score in a row and then only the comments in a row).
Right now it is hard to compare single scores visually since you have to match them to the right place visually.
And judge comments are only visible on hower, so I can never see them both at once.
This is the view I am referring to:
The only way I found to see judge comments was hovering like this:
Motivation
We found scoring, especially with LLM-as-a-judge to not be that relyable.
I often find that I want to dig into the judgements and see how they came to be, when comparing two experiment results.
The text was updated successfully, but these errors were encountered:
Feature request
When comparing multiple experiments, allow seeing scores and comments side by side (ideally with only the score in a row and then only the comments in a row).
Right now it is hard to compare single scores visually since you have to match them to the right place visually.
And judge comments are only visible on hower, so I can never see them both at once.
This is the view I am referring to:
The only way I found to see judge comments was hovering like this:
Motivation
We found scoring, especially with LLM-as-a-judge to not be that relyable.
I often find that I want to dig into the judgements and see how they came to be, when comparing two experiment results.
The text was updated successfully, but these errors were encountered: