hyperpod-performance-debugger
Agent skill from
Diagnose performance issues on Amazon SageMaker HyperPod clusters — uneven NCCL bandwidth across nodes and poor filesystem throughput. Read-only. Surfaces host-side signals (Xid, ECC, NVLink, EFA reachability, FSx saturation) and routes to the appropriate sibling skill (hyperpod-node-debugger, hyperpod-nccl, hyperpod-version-checker, hyperpod-issue-report) for any remediation. Triggers on uneven NCCL across nodes, straggler node, FSx slow, checkpoint slow, dataloader slow, filesystem bottleneck, FSx throughput, cross-AZ latency, topology mismatch.
How to install hyperpod-performance-debugger
npx skills add awslabs/agent-plugins# or add only this skill to Claude Code: copy the folder
plugins/sagemaker-ai/skills/hyperpod-performance-debugger/
# into
~/.claude/skills/hyperpod-performance-debugger/ (all projects)
.claude/skills/hyperpod-performance-debugger/ (one project)
1# HyperPod Performance Debugger231. **Uneven NCCL performance across nodes** — workload faster on some node sets than others, pairwise bandwidth variance, suspected straggler.42. **Poor filesystem performance** — training stalled on data loading, checkpoint save/load dominating step time, FSx throughput saturated.56## Scope and delegation78Route findings outside the two in-scope scenarios to the owner skill below.910| Concern observed | Route to |11| ---------------------------------------------------------------------- | ------------------------------------------------------------ |12| GPU hardware fault, ECC, NVLink, Xid, DCGM diagnostics, drain/replace | `hyperpod-node-debugger` (§ F Hardware/Auto-Repair, § G GPU) |13| `Cannot allocate memory` at `os.fork()`, root volume exhausted | `hyperpod-node-debugger` (§ I Resource Exhaustion) |14| NCCL timeouts, hangs, AllReduce stalls, EFA TCP fallback, RDMA memlock | `hyperpod-nccl` |15| EFA / NCCL / CUDA / NVIDIA driver version drift across nodes | `hyperpod-version-checker` |16| EFA self-referencing security-group rule missing — single node | `hyperpod-node-debugger` § A (EFA / Security Group) |17…
Excerpt shown under the repository's Apache-2.0 license.