Get Evaluation Metadata
Get an Evaluation
job’s status and results. There are six possible statuses: ‘pending’, ‘processing’, ‘retrying’, ‘completed’, ‘failed’, ‘cancelled’.
If the evaluation job has completed, you will see your evaluation metrics
, job_metadata
, and the dataset_name
where your eval metrics and row-by-row results are stored. You can use the /datasets/evaluate
API to view the specified dataset
.
Authorizations
Bearer authentication header of the form Bearer <token>
, where <token>
is your auth token.
Path Parameters
ID of agent for which to retrieve evaluations
Evaluation job ID to retrieve status and results for
Response
Response from Get Evaluation Results request
Status of the evaluation round
pending
, processing
, retrying
, completed
, failed
, cancelled
, failed_to_provision
, generating_data
, training_in_progress
, failed_to_generate_data
, provisioning
Results of the evaluation round, grouped by each metric
Metadata of the evaluation round with the number of predictions, failed predictions, and successful predictions.
Dataset name containing the individual results of the evaluation round
Was this page helpful?