Evaluation Task

The most basic evaluation workflow in Datumo Eval. It utilizes a Judge evaluation model to compare and evaluate the responses of a Target model, and can quantify model performance based on a Dataset.

---

Create Task

Create a new Evaluation Task.

Run Eval Set

Create and run an Eval Set.

Check Results

Check and analyze evaluation results on the dashboard.

BEIR Leaderboard

Check results in the BEIR Leaderboard view.