Medium

MLBoy

MLBoy

·

Jun 13

One Metal kernel made Apple Core AI’s MoE decode 2–3.6× faster — same quality

Sparse Mixture-of-Experts models are perfect for on-device — until the framework reads every expert on every token. Here’s the kernel that…

One Metal kernel made Apple Core AI’s MoE decode 2–3.6× faster — same quality

MLBoy

·

Jun 12

7 LLMs Pre-Converted to Apple’s Core AI Format (.aimodel), Now on Hugging Face

gpt-oss-20B, Qwen3, Gemma 3, Mistral — converted with Apple’s official recipes, unmodified, with hashes and measured benchmarks.

7 LLMs Pre-Converted to Apple’s Core AI Format (.aimodel), Now on Hugging Face

MLBoy

·

Jun 10

I Benchmarked Apple’s New Framework Against MLX for On-Device LLMs

It really pays to actually run the comparison.

I Benchmarked Apple’s New Framework Against MLX for On-Device LLMs

MLBoy

·

Jun 10

CoreAI-Model-Zoo: Open LLMs for Apple’s New Core AI Framework

Apple has a new on-device AI framework: Core AI. It lets you convert your favorite AI and LLM models into its .aimodel format and run them…

CoreAI-Model-Zoo: Open LLMs for Apple’s New Core AI Framework

MLBoy

·

Jun 9

Read meters and nameplates with just an iPhone

All you need is an iPhone. Let AI do the field check.

Read meters and nameplates with just an iPhone

MLBoy

·

Jun 5

Recipes for on-device VLM (image input LLM)

There’s an AI you can show a photo to and ask: “what is this?” — and it will reply, “Looks like a wooden dining table. Two mugs on it; one…

Recipes for on-device VLM (image input LLM)

MLBoy

·

Jun 4

iPhone on-device LLM: the GPU wins the sprint, the Neural Engine wins the marathon

The follow-up: burst speed is only half the story

iPhone on-device LLM: the GPU wins the sprint, the Neural Engine wins the marathon

MLBoy

·

May 30

Scoring Outfits with AI — Fully Offline, on an iPhone

Can a 2-billion-parameter vision model judge fashion? It can — if the domain is a “closed system.” A field report on distilling a giant…

Scoring Outfits with AI — Fully Offline, on an iPhone

MLBoy

·

May 29

Let Customers Feel a Product’s Texture — Over the Internet

A Gaussian Splatting × AR product viewer, relightable on iPhone

Let Customers Feel a Product’s Texture — Over the Internet

MLBoy

·

May 28

Local LLM on iPhone: which runtime is actually fastest?

Four on-device runtimes, same models, same prompt, same harness — on a real iPhone 17 Pro.

Local LLM on iPhone: which runtime is actually fastest?

MLBoy

MLBoy

Freelance iOS developer. You can ask me for a job from any country. rockyshikoku@gmail.com https://github.com/john-rocky https://twitter.com/JackdeS11

Following

Help

Status

About

Careers

Press

Blog

Store

Privacy

Rules

Terms

Text to speech