visual-intelligence

1# Visual Intelligence
2 
3Integrate your app with iOS Visual Intelligence to let users find app content by pointing their camera at objects.
4 
5## When This Skill Activates
6 
7- User wants camera-based search in their app
8- User asks about visual search integration
9- User wants to surface app content in system searches
10- User needs to handle visual intelligence queries
11 
12## Overview
13 
14Visual Intelligence lets users:
151. Point camera at objects or use screenshots
162. System identifies what they're looking at
173. Your app provides matching content
184. Results appear in system UI
19 
20Your app implements:
21- `IntentValueQuery` to receive search requests
22- `AppEntity` types for searchable content
23- Display representations for results
24 
25## Platform Availability (WWDC26 297)
26 
27- Visual Intelligence runs on iOS, iPadOS, and macOS — the same entities, query, and OpenIntent code works unchanged on all three. Handle both **camera captures of physical objects** (iOS) and **screenshots of digital media** (iPad/Mac) as input.
28- On Mac, the input pixel buffer can be **much larger** than what you'd encounter on iPhone — consider whether resizing is necessary before matching.
29 
30## Quick Start
31 
32### 1. Import Frameworks
33 
34```swift
35import VisualIntelligence
36import AppIntents
37```
38 
39### 2. Create App Entity
40 
41```swift
42struct ProductEntity: AppEntity {
43    var id: String
44    var name: String
45    var price: String
46    var imageName: String
47 
48    static var typeDisplayRepresentation: TypeDisplayRepresentation {
49…