Step 3. Check Evaluation Results
When the evaluation is complete, you can enter the Task to check the results.
The Dashboard is displayed first, allowing you to compare model performance with various visualization tools and gain key insights.
You can also analyze detailed evaluation results for individual samples through the Table View.
3-1) Dashboard Screen
The Dashboard visualizes and provides only the completed evaluation results.
In an Evaluation Task, it is composed of various Categories and Metrics, so performance comparison by Category and detailed analysis by Metric become the main analysis axes.
Dashboard Main Components
① Category & Metric Comparison
You can comprehensively compare evaluation performance by category and model performance by detailed metric.
② Evaluation Result Detailed Analysis
Provides score distribution, detailed results by Rubric, and performance patterns by category with various visualizations.
① Features by Visualization Type
On the Dashboard, you can check the Metric results in two chart forms.
You can intuitively compare performance differences by metric by displaying the Metric performance for each model as a bar graph.
You can grasp the performance patterns and strengths and weaknesses of models at a glance by displaying multiple Metrics at the same time.
② Metric Comparison Chart
You can identify the strengths and weaknesses of each model through the scores for each metric by comparing the performance of each Metric in the RAGAs category by model.
③ Detailed Analysis Visualization
It provides the score distribution of a specific Metric for each model with various visualizations, and you can also check the detailed results for each Rubric to analyze the evaluation results precisely.
You can analyze performance deviations or differences according to data characteristics by visualizing the score distribution for each model.
You can clearly check the strengths and weaknesses of each item by comparing the scores between models for each specific Rubric.
It provides a Score Heatmap based on Metadata, so you can easily check performance changes by data type or situation.
3-2) Table View Screen
The Table View is a detailed screen where you can analyze the results confirmed on the Dashboard in detail. You can go there directly through the top tab, or when you click on a Dashboard graph, the corresponding information is automatically filtered so you can check the detailed data.
④ Tab Structure
The Table View is composed of three tabs, allowing you to check the evaluation results from different perspectives.
- Compare Model: Compare the responses and scores of multiple models side-by-side to check the performance of each model for the same question.
- Compare Metric: Compare model responses by evaluation metric to analyze the score differences for the same response by metric.
- Model-Metric: Focus on a specific evaluation metric of a specific model to perform a standalone analysis.
⑤ Filter and Search
You can view the results in detail under the desired conditions through the filter area at the top.
You can filter only the desired results by selecting Metric and Metadata conditions, setting a score range, entering a search term, and using sorting options.
⑥ Response Comparison Table
You can check the Query and the score and response for each model side-by-side, and you can check the detailed evaluation information by clicking on a cell. The score sections are distinguished by color, so you can visually grasp the performance.
⑦ Detail Panel
You can check the basis and criteria for the evaluation of the selected response in detail. It provides the original question and response, and context information together, and you can transparently check the evaluation process through the model name, score, and evaluation Rubric.
Usage Guide
Tab Usage by Purpose
- Compare the performance of multiple models → Compare Model tab
- Check the performance difference between evaluation metrics → Compare Metric tab
- Focus on a single model → Model-Metric tab
In-depth Analysis
- Quickly identify performance issues in specific situations by combining filters and sorting.
- Immediately check detailed data of areas of interest by clicking on Dashboard charts.
- Review the basis and criteria for evaluation using the Detail panel.
If the dataset satisfies certain conditions,
the BEIR benchmark is automatically executed along with the Judge evaluation, and the results can be checked in the Beir Leaderboard format.