arize-experiment

1# Arize Experiment Skill
2 
3> **`SPACE`** — All `--space` flags and the `ARIZE_SPACE` env var accept a space **name** (e.g., `my-workspace`) or a base64 space **ID** (e.g., `U3BhY2U6...`). Find yours with `ax spaces list`.
4 
5## Concepts
6 
7- **Experiment** = a named evaluation run against a specific dataset version, containing one run per example
8- **Experiment Run** = the result of processing one dataset example -- includes the model output, optional evaluations, and optional metadata
9- **Dataset** = a versioned collection of examples; every experiment is tied to a dataset and a specific dataset version
10- **Evaluation** = a named metric attached to a run (e.g., `correctness`, `relevance`), with optional label, score, and explanation
11 
12The typical flow: export a dataset → process each example → collect outputs and evaluations → create an experiment with the runs.
13 
14## Prerequisites
15 
16Proceed directly with the task — run the `ax` command you need. Do NOT check versions, env vars, or profiles upfront.
17 
18If an `ax` command fails, troubleshoot based on the error:
19- `command not found` or version error → see references/ax-setup.md
20- `401 Unauthorized` / missing API key → run `ax profiles show` to inspect the current profile. If the profile is missing or the API key is wrong, follow references/ax-profiles.md to create/update it. If the user doesn't have their key, direct them to https://app.arize.com/admin > API Keys
21- Space unknown → run `ax spaces list` to pick by name, or ask the user
22…