Create a new Dataset in the specified Application using the provided JSONL file. A Dataset is a versioned collection of samples conforming to a particular schema, and can be used to store Evaluation test-sets and retrieve Evaluation results. Datasets are an Application-level resource and are namespaced by an application_id.
Each Dataset is versioned and validated against its schema during creation and subsequent updates. The provided Dataset file must conform to the schema defined for the dataset_type.
File schema for dataset_type evaluation_set is a JSONL file where each line is one JSON object with the following keys:
-
response(optional,string): Optional response to evaluate -
reference(required,string): Required reference or ground truth response -
guideline(optional,string): Optional evaluation guidelines -
knowledge(optional,string): Optional context for evaluation