Tooluck logoTooluck
SKILL.md

huggingface-vision-trainer

Agent skill fromhuggingface/skills

Trains and fine-tunes vision models for object detection (D-FINE, RT-DETR v2, DETR, YOLOS), image classification (timm models — MobileNetV3, MobileViT, ResNet, ViT/DINOv3 — plus any Transformers classifier), and SAM/SAM2 segmentation using Hugging Face Transformers on Hugging Face Jobs cloud GPUs. Covers COCO-format dataset preparation, Albumentations augmentation, mAP/mAR evaluation, accuracy metrics, SAM segmentation with bbox/point prompts, DiceCE loss, hardware selection, cost estimation, Trackio monitoring, and Hub persistence. Use when users mention training object detection, image classification, SAM, SAM2, segmentation, image matting, DETR, D-FINE, RT-DETR, ViT, timm, MobileNet, ResNet, bounding box models, or fine-tuning vision models on Hugging Face Jobs.

How to install huggingface-vision-trainer

install huggingface-vision-trainer
# install the skills pack with the skills CLI
npx skills add huggingface/skills

# or add only this skill to Claude Code: copy the folder

skills/huggingface-vision-trainer/

# into

~/.claude/skills/huggingface-vision-trainer/ (all projects)

.claude/skills/huggingface-vision-trainer/ (one project)

skills/huggingface-vision-trainer/SKILL.md

Apache-2.0Full file
1# Vision Model Training on Hugging Face Jobs
2
3Train object detection, image classification, and SAM/SAM2 segmentation models on managed cloud GPUs. No local GPU setup required—results are automatically saved to the Hugging Face Hub.
4
5## When to Use This Skill
6
7Use this skill when users want to:
8- Fine-tune object detection models (D-FINE, RT-DETR v2, DETR, YOLOS) on cloud GPUs or local
9- Fine-tune image classification models (timm: MobileNetV3, MobileViT, ResNet, ViT/DINOv3, or any Transformers classifier) on cloud GPUs or local
10- Fine-tune SAM or SAM2 models for segmentation / image matting using bbox or point prompts
11- Train bounding-box detectors on custom datasets
12- Train image classifiers on custom datasets
13- Train segmentation models on custom mask datasets with prompts
14- Run vision training jobs on Hugging Face Jobs infrastructure
15- Ensure trained vision models are permanently saved to the Hub
16
17## Related Skills
18
19- **`hugging-face-jobs`** — General HF Jobs infrastructure: token authentication, hardware flavors, timeout management, cost estimation, secrets, environment variables, scheduled jobs, and result persistence. **Refer to the Jobs skill for any non-training-specific Jobs questions** (e.g., "how do secrets work?", "what hardware is available?", "how do I pass tokens?").
20- **`hugging-face-model-trainer`** — TRL-based language model training (SFT, DPO, GRPO). Use that skill for text/language model fine-tuning.
21
22## Local Script Execution
23…

Excerpt shown under the repository's Apache-2.0 license.

More skills in skills

Keep exploring

Similar skill repositories

thedotmack /

claude-mem
116k

Persistent Context Across Sessions for Every Agent – Captures everything your agent does during sessions, compresses it with AI, and injects relevant context back into future sessions. Works with Claude Code, OpenClaw, Codex, Gemini, Hermes, Copilot, OpenCode + More

CCCXGHGM+135 skills

Newsletter

Join the Community

Subscribe to our newsletter for the latest news and updates