live_database_ingest

1# Live Database Ingest
2 
3Use this skill when the ingest work unit contains raw files under
4`raw-sources/<connectionId>/live-database/<syncId>/`.
5 
6## Workflow
7 
81. Read the table JSON file listed in the work unit.
92. Read `connection.json` to understand the snapshot metadata.
103. Read `foreign-keys.json` when the table has a foreign key or when joins are
11   needed for the semantic-layer source.
124. Create or update one semantic-layer source for the table with
13   `sl_write_source`.
145. Use the physical table name from the raw JSON as the source `table` field.
156. Preserve database comments as `descriptions.db` on tables and columns.
167. Add joins only when the foreign key index names both sides.
178. Write wiki pages only for durable business meaning that is present in table
18   or column comments.
199. Run `sl_validate` for the table source before the work unit completes.
20 
21Sample values come from the scan record; do not invent values not present in
22relationship-profile.json.
23 
24## Identifier Verification Protocol
25 
26Before writing a wiki page or SL source on any topic:
27 
281. `discover_data({query: "<topic>"})` - see what wikis, SL sources, and raw
29   tables already exist. Prefer updating existing pages over creating new ones.
30 
31Before emitting any `schema.table` or `schema.table.column` into a wiki body,
32SL source, `tables:` frontmatter, `sl_refs`, or `emit_unmapped_fallback`:
33 
342. `entity_details({connectionId, targets: [{display: "<identifier>"}]})` -
35…