curl -X POST 'https://api.openai.com/v1/evals/eval-id/runs' \
  -H "Authorization: Bearer $OPENAI_API_KEY" \
  -H 'Content-Type: application/json' \
  -d '{
  "data_source": {
    "type": "jsonl",
    "source": {
      "type": "file_content",
      "content": [
        {
          "item": {},
          "sample": {}
        }
      ]
    }
  }
}'

# POST /evals/{eval_id}/runs (OpenAI API)
Base URL: https://api.openai.com/v1
Auth: Authorization; OpenAI API key; required.
Request formats: application/json.
Last verified: 2026-10-20

> Create eval run

## Critical Gotchas
* The Responses API is the primary interface for new text and tool workflows; Chat Completions remains a separate compatibility API.
* Audio transcription uploads use multipart form data rather than a JSON request body.

## cURL
curl -X POST 'https://api.openai.com/v1/evals/eval-id/runs' \
  -H "Authorization: Bearer $OPENAI_API_KEY" \
  -H 'Content-Type: application/json' \
  -d '{
  "data_source": {
    "type": "jsonl",
    "source": {
      "type": "file_content",
      "content": [
        {
          "item": {},
          "sample": {}
        }
      ]
    }
  }
}'

## Parameters
| Name | In | Type | Required | Description |
| :--- | :--- | :--- | :--- | :--- |
| eval_id | path | string | Yes | The ID of the evaluation to create a run for. |
| data_source | body | object | Yes | Details about the run's data source. |
| name | body | string | No | The name of the run. |
| metadata | body | object | No | Set of 16 key-value pairs that can be attached to an object. This can be usef... |

## Response example
{"object":"eval.run","id":"string"}

---
Need an API key? Get one at https://platform.openai.com/api-keys

POST

POST /evals/{eval_id}/runs — OpenAI API

OpenAI API key (required); https://api.openai.com/v1

OpenAI API

Create eval run

Base URL: https://api.openai.com/v1
Auth: Authorization: Bearer <OPENAI_API_KEY>
Last verified: 2026-10-20 · upstream hash matched

Actions Try in browser→

Agents: curl -H "Accept: text/markdown" this URL
→ 279 tokens · Vary: Accept

Critical gotchas

The Responses API is the primary interface for new text and tool workflows; Chat Completions remains a separate compatibility API.

Audio transcription uploads use multipart form data rather than a JSON request body.

cURL

curl -X POST 'https://api.openai.com/v1/evals/eval-id/runs' \  -H "Authorization: Bearer $OPENAI_API_KEY" \  -H 'Content-Type: application/json' \  -d '{  "data_source": {    "type": "jsonl",    "source": {      "type": "file_content",      "content": [        {          "item": {},          "sample": {}        }      ]    }  }}'

Parameters

Name	In	Type	Required	Description
eval_id	path	string	Yes	The ID of the evaluation to create a run for.
name	body	string	No	The name of the run.
metadata	body	object	No	Set of 16 key-value pairs that can be attached to an object. This can be useful for storing additional information about the object in a structured format, and querying for objects via API or the dashboard. Keys are strings with a maximum length of 64 characters. Values are strings with a maximum length of 512 characters.
data_source	body	object	Yes	Details about the run's data source.

Response 200 OK

{
  "object": "eval.run",
  "id": "string",
  "eval_id": "string",
  "status": "string",
  "model": "string",
  "name": "string",
  "created_at": 0,
  "report_url": "https://example.com",
  "result_counts": {
    "total": 0,
    "errored": 0,
    "failed": 0,
    "passed": 0
  },
  "per_model_usage": [
    {
      "model_name": "string",
      "invocation_count": 0,
      "prompt_tokens": 0,
      "completion_tokens": 0,
      "total_tokens": 0,
      "cached_tokens": 0
    }
  ],
  "per_testing_criteria_results": [
    {
      "testing_criteria": "string",
      "passed": 0,
      "failed": 0
    }
  ],
  "data_source": {
    "type": "jsonl",
    "source": {
      "type": "file_content",
      "content": [
        {
          "item": {},
          "sample": {}
        }
      ]
    }
  },
  "metadata": {},
  "error": {
    "code": "string",
    "message": "string"
  }
}

Get a free OpenAI API key → sponsored

Affiliate link - we may earn a commission, at no extra cost to you.