AgentMesh.help
Freemium
Developers integrating AI agents into task workflows
Converting a model to run on-device for Apple Silicon is a documentation minefield — undocumented quantization gotchas, format mismatches, and conversion steps that work on one chip variant and silently fail on another. CoreAI-Model-Zoo is a community repository that pre-converts LLMs and vision-language models to Apple's `.aimodel` format and publishes the verified conversion code alongside them.
The repo ships Qwen3.5, Qwen3.6, Gemma 4, GLM-4, and LFM variants already converted, verified against iPhone 17 Pro GPU and ANE, and downloadable from Hugging Face. Conversion code, known gotchas, custom Metal kernels, and a Swift runner are included so teams can replicate or extend the work rather than reverse-engineer it. The larger dense and MoE models — Qwen3.6-27B, Qwen3.6-35B-A3B, GLM-4.7-Flash — are flagged Mac-only, so iPhone deployment is constrained to the smaller quantized variants. There is no API, no inference server, and no tooling outside the Apple ecosystem; teams targeting Android, Windows, or server-side inference will find nothing applicable here.
Bottom line: Pick this when you are shipping an iPhone or Mac app that needs on-device LLM inference and want a verified starting point rather than a blank conversion script — abandon it the moment your deployment target is anything outside Apple Silicon.
Find your fit
More options in Large Language Models. Compare pricing, platforms, and features side by side.
Freemium
Developers integrating AI agents into task workflows
Free · Open source
Researchers tracking verifiable AI capability trends
CoreAI-Model-Zoo is an open-source community repository that converts open-weight LLMs into Apple’s Core AI `.aimodel` format — the successor to CoreML — and makes the results downloadable, verified, and reproducible. The core workflow is: download a pre-converted model from the linked Hugging Face repos, drop it into an iOS 27 or macOS 27 project, and run inference through the included Swift runner. For teams who need to convert their own models, the `conversion/` directory contains the scripts and the documented gotchas that are otherwise scattered across Apple developer forums.
The differentiating feature is verification. The models are not just converted and uploaded — they are confirmed to run on actual hardware (iPhone 17 Pro GPU and ANE), with notes on what broke during conversion and what workaround was applied. That paper trail is the part Apple’s own documentation does not provide, and it is what separates this from a generic model dump.
The repository fits teams doing early-stage on-device AI development on Apple platforms who need a working baseline fast. It breaks — or rather, becomes irrelevant — the moment a project requires cross-platform deployment, a REST inference API, production monitoring, or any model family outside the zoo’s current coverage. There is no versioning policy, no SLA, and the model selection reflects one maintainer’s conversion priorities. Teams that outgrow the zoo’s model list will use the conversion code as a template but end up maintaining their own fork.
The `knowledge/` directory documents Core AI-specific behavior: quantization constraints, MoE handling, MLA architecture notes for GLM-4.7-Flash, and custom Metal kernel experiments for benchmarking ANE versus GPU throughput. The `apps/` directory provides reference Swift integrations. No CI pipeline for model validation is documented in the scraped content, so freshness of any given model file depends on maintainer cadence.
Sign in to rate this tool or suggest an edit.