Skip to main content
Use Eval Tables to compare inputs, outputs, and scores across multiple runs. W&B aligns corresponding examples and calculates aggregate scores and score differences for the selected runs.
To compare runs with workspace-level summary metrics, line plots, pinned runs, or a baseline run, see Pin and compare runs. Eval Tables compare aligned examples and Eval Table-specific scores within a logged table.
To compare runs:
  1. Navigate to your project workspace.
  2. Scroll to the Eval Tables panel.
  3. Select the + button.
  4. Select the run that you want to add.
W&B groups columns that have the same role and name across the selected runs. For example, if two runs use the same input_columns, W&B displays those columns together in the Inputs section. W&B similarly groups shared output_columns and score_columns in the Outputs and Scores sections. The following screenshot shows an Eval Table that compares the summer-butterfly-9 and gentle-flower-8 runs:
Eval Table view

Set the reference run

When you compare multiple runs, W&B defaults to designating the left-most run as the reference run. The reference run is the baseline to calculate score deltas. To choose a different reference run, hover over the run, open its menu, and select Set as reference.

View aggregate scores

W&B calculates an aggregate value for each score column in each selected run. The calculation depends on the score’s data type: The following screenshot highlights the aggregate values for the correct and confidence scores:
Eval Table view

Compare score deltas

For each score column, W&B calculates the difference between the reference run and every other selected run. W&B calculates each delta as:
For example, suppose summer-butterfly-9 is the reference run and gentle-flower-8 is the comparison run. W&B calculates the confidence delta as follows: A positive delta means that the comparison run has a higher value than the reference run. A negative delta means that it has a lower value. The following screenshot highlights the score deltas:
Eval Table view