Skip to main content
POST
Create Eval Run

Authorizations

Authorization
string
header
required

Ingest API key or OIDC JWT. See /authentication.

Body

application/json
suite
string
required
Required string length: 1 - 200
n_samples
integer
required
Required range: x >= 1
metrics
Metrics · object
required
agent_id
string | null
model_ref
string | null
Maximum string length: 200
data_source
string | null
Maximum string length: 400
scorer
string | null

how metrics were produced: exact-match | judge-indic: | human- | debate — provenance, not a claim we ran it

Maximum string length: 120
gates
Gate · object[]
detail
Detail · object | null

optional structured evidence beyond scalar metrics (e.g. the red-team MAP-Elites grid + diverse evasions)

Response

Successful Response

The response is of type Response Create Eval Run Api V1 Vidhi Eval Runs Post · object.