Skills for Real Engineers. Straight from my .agents directory.
39 skills
arize-evaluator
Agent skill from
Handles LLM-as-judge evaluation workflows on Arize including creating/updating evaluators, running evaluations on spans or experiments, managing tasks, trigger-run operations, column mapping, and continuous monitoring. Use when the user mentions create evaluator, LLM judge, hallucination, faithfulness, correctness, relevance, run eval, score spans, score experiment, trigger-run, column mapping, continuous monitoring, or improve evaluator prompt.
How to install arize-evaluator
install arize-evaluator
# install the awesome-copilot pack with the skills CLI
npx skills add github/awesome-copilot# or add only this skill to Claude Code: copy the folder
skills/arize-evaluator/
# into
~/.claude/skills/arize-evaluator/ (all projects)
.claude/skills/arize-evaluator/ (one project)
1# Arize Evaluator Skill23> **`SPACE`** — All `--space` flags and the `ARIZE_SPACE` env var accept a space **name** (e.g., `my-workspace`) or a base64 space **ID** (e.g., `U3BhY2U6...`). Find yours with `ax spaces list`.45This skill covers designing, creating, and running **LLM-as-judge evaluators** on Arize. An evaluator defines the judge; a **task** is how you run it against real data.67---89## Prerequisites1011Proceed directly with the task — run the `ax` command you need. Do NOT check versions, env vars, or profiles upfront.1213If an `ax` command fails, troubleshoot based on the error:14- `command not found` or version error → see references/ax-setup.md15- `401 Unauthorized` / missing API key → run `ax profiles show` to inspect the current profile. If the profile is missing or the API key is wrong, follow references/ax-profiles.md to create/update it. If the user doesn't have their key, direct them to https://app.arize.com/admin > API Keys16- Space unknown → run `ax spaces list` to pick by name, or ask the user17- LLM provider call fails (missing OPENAI_API_KEY / ANTHROPIC_API_KEY) → run `ax ai-integrations list --space SPACE` to check for platform-managed credentials. If none exist, ask the user to provide the key or create an integration via the **arize-ai-provider-integration** skill18…
Excerpt shown under the repository's MIT license.
More skills in awesome-copilot
Keep exploring
Similar skill repositories
An agentic skills framework & software development methodology that works.
15 skills
A single CLAUDE.md file to improve Claude Code behavior, derived from Andrej Karpathy's observations on LLM coding pitfalls.
CC1 skill
Public repository for Agent Skills
20 skills
Makes your AI agent think like the laziest senior dev in the room. The best code is the code you never wrote.
CCCU6 skills
Persistent Context Across Sessions for Every Agent – Captures everything your agent does during sessions, compresses it with AI, and injects relevant context back into future sessions. Works with Claude Code, OpenClaw, Codex, Gemini, Hermes, Copilot, OpenCode + More
CCCXGHGM+135 skills