Code Evaluations

Run evaluations with code

Use the SDK to submit evaluation jobs and retrieve metrics in CI pipelines for automated quality checks.

Attach metadata like commit SHA and dataset version for reproducibility and auditing.

Poll job status or subscribe to webhooks to get notified when results are ready.

Combine programmatic runs with UI runs to keep a single source of truth.