Openlayer

Guides

Reference

Integrations

Examples

Changelog

Get started

Community

Log in

List the commits (project versions) in a project.

List project commits

The details of a commit (project version).

The storage URI where the commit bundle is stored.

The project version (commit) creation date.

The deployment status associated with the commit's model.

The number of tests that are failing for the commit.

The number of tests that are passing for the commit.

The commit status. Initially, the commit is `queued`, then, it switches to `running`. Finally, it can be `paused`, `failed`, or `completed`.

The total number of tests for the commit.

bearerAuth

Introduction

Start testing your AI/ML system in minutes

Terminology

Find your API key

Learn how you can use Development mode with Git, the Openlayer CLI, or the Openlayer REST API

Overview

Learn how to write the `openlayer.json` config for your project

openlayer.json

Learn how to write the `tests.json` config for your project

tests.json

Configuring output generation

Publishing data

Tracing

Annotating data

Evaluation and delay windows

Uploading a reference dataset

Updating data

LLM cost estimation

Explore the tests available on the platform

Understanding tests

Custom metrics

Learn more about our data security practices and compliance measures.

Security

Python

TypeScript

Java

CLI global options

batch

export

help

inspect

install

link

login

metrics

push

validate

whoami

List projects

Create project

Retrieve a presigned url to post storage artifacts.

Create a new commit (project version) in a project.

Create project commit

List the test results for a project commit (project version).

List commit test results

Create an inference pipeline in a project.

Create inference pipeline

List the inference pipelines in a project.

List inference pipelines

Publish an inference data point to an inference pipeline.

Publish inference

Update an inference data point in an inference pipeline.

List the latest test results for an inference pipeline.

List pipeline test results

Templates

Monitoring

OpenAI & Azure OpenAI

Anthropic

LangChain

Mistral AI

Groq

Amazon SageMaker

Label Studio

Great Expectations

Amazon S3

Databricks

Slack

GitHub

Ragas

A collection of answers to frequently asked questions.

Reference

SDKs

CLI

REST API

List project commits

Authorizations

Path Parameters

Query Parameters

Response