Reference
SDKs
- Overview
- Openlayer SDKs
CLI
- Overview
- CLI global options
- Commands
REST API
- Overview
- Workspaces
- Invites and API keys
- Projects
- Development
- Monitoring
List pipeline test results
List the latest test results for an inference pipeline.
from openlayer import Openlayer
client = Openlayer()
client.inference_pipelines.test_results.list(
inference_pipeline_id="182bd5e5-6e1a-4fe4-a799-aa6d9a6ab26e",
)
{
"items": [
{
"id": "3fa85f64-5717-4562-b3fc-2c963f66afa6",
"goal": {
"id": "3fa85f64-5717-4562-b3fc-2c963f66afa6",
"number": 1,
"name": "No duplicate rows",
"dateCreated": "2024-03-22T11:31:01.185Z",
"dateUpdated": "2024-03-22T11:31:01.185Z",
"description": "This test checks for duplicate rows in the dataset.",
"evaluationWindow": 3600,
"delayWindow": 0,
"type": "integrity",
"subtype": "duplicateRowCount",
"creatorId": "589ece63-49a2-41b4-98e1-10547761d4b0",
"originProjectVersionId": "3fa85f64-5717-4562-b3fc-2c963f66afa6",
"thresholds": [
{
"measurement": "duplicateRowCount",
"insightName": "duplicateRowCount",
"insightParameters": [
{}
],
"operator": "<=",
"value": 0
}
],
"archived": false,
"dateArchived": "2024-03-22T11:31:01.185Z",
"suggested": false,
"commentCount": 0,
"usesMlModel": false,
"usesValidationDataset": true,
"usesTrainingDataset": false,
"usesReferenceDataset": false,
"usesProductionData": false
},
"goalId": "3fa85f64-5717-4562-b3fc-2c963f66afa6",
"projectVersionId": "3fa85f64-5717-4562-b3fc-2c963f66afa6",
"inferencePipelineId": "3fa85f64-5717-4562-b3fc-2c963f66afa6",
"dateCreated": "2024-03-22T11:31:01.185Z",
"dateUpdated": "2024-03-22T11:31:01.185Z",
"dateDataStarts": "2024-03-22T11:31:01.185Z",
"dateDataEnds": "2024-03-22T11:31:01.185Z",
"status": "passing",
"statusMessage": "Test successfully processed."
}
]
}
Authorizations
Bearer authentication header of the form Bearer <token>
, where <token>
is your workspace API key. See Find your API key for more information.
Path Parameters
The inference pipeline id (a UUID).
Query Parameters
The page to return in a paginated query.
x > 1
Maximum number of items to return per page.
1 < x < 100
Filter objects by test type. Available types are integrity
, consistency
, performance
, fairness
, and robustness
.
integrity
, consistency
, performance
, fairness
, robustness
Response
Project version (commit) id.
The project version (commit) id.
The inference pipeline id.
The creation date.
The last updated date.
The data start date.
The data end date.
The status of the test.
running
, passing
, failing
, skipped
, error
The status message.
The test id.
The test number.
The test name.
100
The creation date.
The last updated date.
The test description.
The test type.
The test subtype.
The test creator id.
The project version (commit) id where the test was created.
The measurement to be evaluated.
The insight name to be evaluated.
The operator to be used for the evaluation.
The value to be compared.
The date the test was archived.
Whether the test is suggested or user-created.
The number of comments on the test.
x > 0
The evaluation window in seconds. Only applies to tests that use production data.
x < 2592000
The delay window in seconds. Only applies to tests that use production data.
0 < x < 2592000
Whether the test is archived.
Whether the test uses an ML model.
Whether the test uses a validation dataset.
Whether the test uses a training dataset.
Whether the test uses a reference dataset (monitoring mode only).
Whether the test uses production data (monitoring mode only).
The test id.
Was this page helpful?
from openlayer import Openlayer
client = Openlayer()
client.inference_pipelines.test_results.list(
inference_pipeline_id="182bd5e5-6e1a-4fe4-a799-aa6d9a6ab26e",
)
{
"items": [
{
"id": "3fa85f64-5717-4562-b3fc-2c963f66afa6",
"goal": {
"id": "3fa85f64-5717-4562-b3fc-2c963f66afa6",
"number": 1,
"name": "No duplicate rows",
"dateCreated": "2024-03-22T11:31:01.185Z",
"dateUpdated": "2024-03-22T11:31:01.185Z",
"description": "This test checks for duplicate rows in the dataset.",
"evaluationWindow": 3600,
"delayWindow": 0,
"type": "integrity",
"subtype": "duplicateRowCount",
"creatorId": "589ece63-49a2-41b4-98e1-10547761d4b0",
"originProjectVersionId": "3fa85f64-5717-4562-b3fc-2c963f66afa6",
"thresholds": [
{
"measurement": "duplicateRowCount",
"insightName": "duplicateRowCount",
"insightParameters": [
{}
],
"operator": "<=",
"value": 0
}
],
"archived": false,
"dateArchived": "2024-03-22T11:31:01.185Z",
"suggested": false,
"commentCount": 0,
"usesMlModel": false,
"usesValidationDataset": true,
"usesTrainingDataset": false,
"usesReferenceDataset": false,
"usesProductionData": false
},
"goalId": "3fa85f64-5717-4562-b3fc-2c963f66afa6",
"projectVersionId": "3fa85f64-5717-4562-b3fc-2c963f66afa6",
"inferencePipelineId": "3fa85f64-5717-4562-b3fc-2c963f66afa6",
"dateCreated": "2024-03-22T11:31:01.185Z",
"dateUpdated": "2024-03-22T11:31:01.185Z",
"dateDataStarts": "2024-03-22T11:31:01.185Z",
"dateDataEnds": "2024-03-22T11:31:01.185Z",
"status": "passing",
"statusMessage": "Test successfully processed."
}
]
}