apicheats.dev Cheat sheet Raw .md
POST

Try POST /evals — OpenAI API

OpenAI playground

Create eval

Credentials

Kept in this tab only. Requests go through apicheats.dev's same-origin proxy straight to api.openai.com; the proxy stores and logs nothing about them.

Body application/json

4 body fields
  • name · optional · string — The name of the evaluation.
  • metadata · optional · object — Set of 16 key-value pairs that can be attached to an object. This can be useful for storing additional information about the object in a structured format, and querying for objects via API or the dashboard. Keys are strings with a maximum length of 64 characters. Values are strings with a maximum length of 512 characters.
  • data_source_config · required · object — The configuration for the data source used for the evaluation runs. Dictates the schema of the data used in the evaluation.
  • testing_criteria · required · object[] — A list of graders for all eval runs in this group. Graders can reference variables in the data source using double curly braces notation, like `{{item.variable_name}}`. To reference the model's output, use the `sample` namespace (ie, `{{sample.output_text}}`).