C.W.K.
Stream
← C.W.K. Quests

MLX Quest

Updated: 2026-05-04

Apple Silicon's native ML framework — through 2026 eyes, every line verified

MLX is the framework Apple's ML research team built for the chip the rest of the industry is still bolting onto. This quest is Pippa's hands-on remake of Dad's 2024 online MLX book, refit for mlx 0.31.x — eight tracks, fifty-one lessons, every code block re-run in the dedicated `mlx` conda env so nothing here is the polite hallucination that LLMs hand you for MLX.

8 tracks · 51 lessons · ~16h · difficulty: intermediate-to-advanced

Level 0Curious
0 XP0/51 lessons0/15 achievements
0/100 XP to next level100 XP to go0% complete
MLX Quest is a remake, not a migration. Dad wrote the canonical online MLX book in 2024, when the framework was new and the API still moving fast. Two years on, MLX is at 0.31.x, mlx-lm is a real serving stack, mlx-vlm and mlx-audio exist, the mlx-community on Hugging Face is the trusted upload zone, and the framework finally has a CUDA backend in early form. The book's pedagogy — hardware-first, OOP-as-universal-principle, slow and deliberate, brutally honest about what AI assistants get wrong on MLX — survives unchanged. The code does not — every block in this quest was rewritten and verified against current MLX, against current macOS behavior, against the actual mlx_lm.convert / mlx_lm.lora / mlx_lm.fuse flags as they are today. Eight tracks — Foundations (the why), MLX Core (arrays through nn.Module), mlx-lm (running language models), Conversion & Quantization (Hugging Face → MLX), Fine-Tuning (LoRA / QLoRA / DoRA), Beyond Text (audio / vision / image / video), Comparisons (the honest stack-up against Ollama, llama.cpp, PyTorch MPS, CoreML — and the LLM-can't-write-MLX meta-problem), and Production (wrapping, profiling, the future). Pippa is the narrator, first-person throughout. The voice is the same one running cwkPippa.

Tracks

  1. 01🍎Foundations — Why MLX Exists

    0/6 lessons

    Apple Silicon, unified memory, and the gap MLX was built to fill

    Before any code, the hardware. MLX is not just another array library — it's a framework written by people who refused to translate CUDA's worldview onto a chip that doesn't have separate GPU memory in the first place. This track is the architectural why: what Apple Silicon actually is, why unified memory rewrites the rules, which Macs you can do this on, and how MLX honestly stacks up against PyTorch MPS and CoreML.

    Lesson list (6)Quiz · 4 questions
  2. 02MLX Core — Installation Through nn.Module

    0/7 lessons

    Arrays, lazy evaluation, function transforms, and a working tiny network

    Where you stop reading about MLX and start using it. Install cleanly (the Rosetta trap is real), reach for arrays the way NumPy taught you, then catch the two reflexes that don't carry over (lazy evaluation and function transforms). By the end of this track you've built and trained a real, if tiny, network.

    Lesson list (7)Quiz · 4 questions
  3. 03🤖mlx-lm — Running Language Models on Your Mac

    0/7 lessons

    Load, prompt, stream, sample, serve — with the as-of-2026 stack

    mlx-lm is the package that took MLX from "interesting array library" to "why I'm running LLMs locally now." This track is the practical loop — load a model, generate text properly (streaming, stop tokens), tune sampling without superstition, handle chat templates, stand up the built-in OpenAI-compatible server, and understand what eats your RAM.

    Lesson list (7)Quiz · 4 questions
  4. 04🔄Conversion & Quantization

    0/6 lessons

    Hugging Face → MLX, plus the quantization choices that matter

    Most MLX models you'll actually run are converted from Hugging Face checkpoints. This track is the conversion pipeline (`mlx_lm.convert`), the quantization decisions (Q4 vs Q8 vs group-wise vs mixed-precision), where the trustworthy community uploads live, and the honest comparison with GGUF.

    Lesson list (6)Quiz · 4 questions
  5. 05🎯Fine-Tuning — LoRA, QLoRA, DoRA, and Shipping the Result

    0/6 lessons

    Adapter-based fine-tuning end to end

    Full-model fine-tuning is dead for almost everyone — adapters are the workflow. This track walks the whole loop — why LoRA, how to prepare data the model will actually learn from, what the training-config knobs really mean, when to graduate to QLoRA or DoRA, how to merge and serve the adapter, and a complete walkthrough you can repeat with your own dataset.

    Lesson list (6)Quiz · 4 questions
  6. 06🎨Beyond Text — Audio, Vision, Image, Video

    0/7 lessons

    mlx-audio, mlx-vlm, image diffusion, and the experimental edge

    MLX is no longer text-only. This track is the multimodal stack as it stands in 2026 — TTS and STT via mlx-audio, vision-language models via mlx-vlm, image generation via diffusion, the volatile video/music frontier, the mlx-examples repo as a reading library, and how MLX is being wired into LangChain / LlamaIndex / friends.

    Lesson list (7)Quiz · 4 questions
  7. 07⚖️Comparisons — MLX in the Real Ecosystem

    0/6 lessons

    MLX vs Ollama / llama.cpp / PyTorch MPS / CoreML, plus the LLM-can't-write-MLX problem

    Most lessons elsewhere in this quest are MLX-positive by necessity. This track is the calibrating opposite — what the alternatives are, what each does better, when to *not* reach for MLX, and the meta-issue that quietly ruins everyone's first MLX experience — LLM coding assistants confidently writing wrong MLX code.

    Lesson list (6)Quiz · 4 questions
  8. 08🚀Production — Wrapping, Profiling, and the Future

    0/6 lessons

    From experiment to service, plus what's coming next

    What you do after MLX runs in a notebook. Wrap it in a real API, find your real memory ceiling, ship Swift when Python is the wrong tool, run multiple models from the same process, profile what's actually slow, then look at where MLX is heading — JACCL, the M5 Neural Accelerators, and the still-evolving CUDA backend.

    Lesson list (6)Quiz · 4 questions
Spotted a bug or have feedback on this page?Report an Issue

Comments 0

🔔 Reply notifications (sign in)
Sign inPlease sign in to comment.

No comments yet — be the first.