SKILL.md

hdinsight-migration

Agent skill frommicrosoft/skills-for-fabric

Ports HDInsight Spark and Hive workloads to Fabric, converting HiveContext and SparkContext to SparkSession, WASB and ABFS paths to OneLake shortcuts, Hive DDL to Delta tables in a Lakehouse, and Oozie coordinators and actions to pipeline activities and triggers. Use when the source workload is HDInsight.

install hdinsight-migration

# install the skills-for-fabric pack with the skills CLI

npx skills add microsoft/skills-for-fabric

# or add only this skill to Claude Code: copy the folder

skills/hdinsight-migration/

# into

~/.claude/skills/hdinsight-migration/ (all projects)

.claude/skills/hdinsight-migration/ (one project)

skills/hdinsight-migration/SKILL.md

MITFull file

1> **Telemetry — MANDATORY.** Every `api.fabric.microsoft.com` call must carry
2> `x-ms-fabric-skill: hdinsight-migration` (`az rest`: `--headers "x-ms-fabric-skill=hdinsight-migration"`),
3> including every LRO poll, `fabric_lro` and retry. Snippets omit it — add it anyway.
4 
5> **CRITICAL NOTES**
6> 1. To find workspace details (including its ID) from a workspace name: list all workspaces, then use JMESPath filtering
7> 2. To find item details (including its ID) from workspace ID, item type, and item name: list all items of that type in that workspace, then use JMESPath filtering
8> 3. HDInsight has no `mssparkutils` or `dbutils` equivalent — `notebookutils` is net-new capability being introduced
9> 4. `HiveContext` and `SQLContext` are legacy Spark 1.x/2.x APIs — Fabric uses Spark 3.x `SparkSession` exclusively
10> 5. `wasb://` paths are deprecated and require a Storage Account key or SAS — replace with OneLake shortcuts
11> 6. Fabric cannot read or shortcut `hdfs://` directly. Its Pipeline HDFS connector supports Anonymous authentication only; export or bridge Kerberos sources to supported storage first.
12 
13# HDInsight → Microsoft Fabric Migration
14 
15## Prerequisite Knowledge
16 
17Read these companion documents before executing migration tasks:
18 
19- [COMMON-CORE.md](../../common/COMMON-CORE.md) — Fabric REST API patterns, authentication, token audiences, item discovery
20- [COMMON-CLI.md](../../common/COMMON-CLI.md) — `az rest`, `az login`, token acquisition, Fabric REST via CLI
21…

Excerpt shown under the repository's MIT license.

How to install hdinsight-migration

skills/hdinsight-migration/SKILL.md

More skills in skills-for-fabric

Newsletter

Join the Community