post https://api.contextual.ai/v1/agents//datasets/evaluate
Create a new evaluation Dataset
for the specified Agent
using the provided JSONL or CSV file. A Dataset
is a versioned collection of samples conforming to a particular schema, and can be used to store Evaluation
test-sets and retrieve Evaluation
results.
Each Dataset
is versioned and validated against its schema during creation and subsequent updates. The provided Dataset
file must conform to the schema defined for the dataset_type
.
File schema for dataset_type
evaluation_set
is a CSV file or a JSONL file where each line is one JSON object. The following keys are required:
-
prompt
(string
): Prompt or question -
reference
(string
): Reference or ground truth response