foundation-models-on-device

foundation models on device

affaan-m 232k ↓ 5.1k MIT updated 25d ago
Claude Code
View source ↗

What it does

  • Building AI-powered features using Apple Intelligence on-device
  • Generating or summarizing text without cloud dependency
  • Extracting structured data from natural language input
  • Implementing custom tool calling for domain-specific AI actions
  • Streaming structured responses for real-time UI updates
  • Need privacy-preserving AI (no data leaves the device)
  • Define the model's role ("You are a mentor")

Requirements & configuration

  • Need privacy-preserving AI (no data leaves the device)
  • | 4,096 token limit | On-device model constraint; chunk large data across sessions |
  • Break large inputs into chunks — 4,096 token limit applies to instructions + prompt + output combined
  • Sending inputs exceeding the 4,096 token context window

Derived from the skill's own SKILL.md documentation · extracted 2026-07-23

foundation models on device

Source

Repository: https://github.com/affaan-m/everything-claude-code

foundation-models-on-device FAQ

What does the foundation-models-on-device skill do?

Apple FoundationModels framework for on-device LLM — text generation, guided generation with @Generable, tool calling, and snapshot streaming in iOS 26+. Building AI-powered features using Apple Intelligence on-device Generating or summarizing text without cloud dependency

What does foundation-models-on-device require?

Need privacy-preserving AI (no data leaves the device) | 4,096 token limit | On-device model constraint; chunk large data across sessions | Break large inputs into chunks — 4,096 token limit applies to instructions + prompt + output combined Sending inputs exceeding the 4,096 token context window

How do I install foundation-models-on-device?

Run: npx -y skills add https://github.com/affaan-m/everything-claude-code --skill foundation-models-on-device --agent claude-code — the source lives at github.com/affaan-m/everything-claude-code.

Maintain foundation-models-on-device?

Let people know it's listed here — add the badge (live metrics, light/dark aware) or a plain link to your README or docs.

foundation-models-on-device on getagentictools
[![foundation-models-on-device on getagentictools](https://getagentictools.com/badge/skills/affaan-m-everything-claude-code-foundation-models-on-device.svg)](https://getagentictools.com/skills/affaan-m-everything-claude-code-foundation-models-on-device?ref=badge)
npx agentictools info skills/affaan-m-everything-claude-code-foundation-models-on-device

The second line is the CLI lookup for this page — handy in READMEs and docs.