model-selection
Agent skill fromawslabs/agent-plugins
Selects a base model for the user's use case by querying SageMaker Hub. Use when the user asks which model to use, wants to select or change their base model, mentions a model name or family (e.g., "Llama", "Mistral", "Nova"), or wants to evaluate a base model — always activate even for known model names because the exact Hub model ID must be resolved. Queries available models, presents benchmarks and licenses, and confirms selection.
How to install model-selection
install model-selection
# install the agent-plugins pack with the skills CLI
npx skills add awslabs/agent-plugins# or add only this skill to Claude Code: copy the folder
plugins/sagemaker-ai/skills/model-selection/
# into
~/.claude/skills/model-selection/ (all projects)
.claude/skills/model-selection/ (one project)
1# Model Selection23Guides the user through selecting a base model based on their use case.45## When to Use67- User asks which model to use8- User wants to select or change their base model9- User mentions a model name or family (e.g., "Llama", "Mistral", "Nova") — the exact Hub model ID still needs to be resolved10- User wants to evaluate a base model before deciding whether to finetune1112## Prerequisites1314- A `use_case_spec.md` file exists. If not, activate the use-case-specification skill to generate it first.1516## Workflow1718### Step 1: Check Region1920Run:2122```23python -c "import boto3; print(boto3.session.Session().region_name)"24```2526- `None` → STOP. Tell user: "Set your region via `export AWS_DEFAULT_REGION=us-west-2` or `aws configure`."27- Set → store REGION in context, continue.2829### Step 2: Discover Hub30311. List all available SageMaker Hubs in the user's region by calling the SageMaker `ListHubs` API using the `aws___call_aws` tool.322. From the results, filter out any hub whose `HubDescription` contains "AI Registry" — these do not contain JumpStart models.333. The remaining hubs are eligible (e.g., `SageMakerPublicHub` and any private hubs).344. If exactly one eligible hub exists, use it automatically — do not ask the user.355. If multiple eligible hubs exist, present them to the user and ask which one to use. Example:3637 ```38 I found the following model hubs:39 - SageMakerPublicHub — SageMaker Public Hub40 - Private-Hub-XYZ — Private Hub models41…
Excerpt shown under the repository's Apache-2.0 license.
