TUTORIAL

AI Terminology #20: Distillation

A training technique where a smaller “student” model learns to replicate the behavior of a larger “teacher” model, preserving performance while reducing...

Team Command Code

1 min read

Mar 16, 2026

A training technique where a smaller “student” model learns to replicate the behavior of a larger “teacher” model, preserving performance while reducing size and cost.

Try Command Code

The best coding agent for open models, in your terminal or on your desktop.

1npm i -g command-code

Desktop App · Docs · X · Discord

Share this article

More insights

Coding taste, patterns, and strategies that actually work

ACP is now live in Command Code

ACP is now live in Command Code

ACP is now live in Command Code. Run cmd acp to use it in an ACP-compatible editor like Zed.

Mistral Large 4 is now live in Command Code

Mistral Large 4 is now live in Command Code

Mistral Large 4 is now live in Command Code. 1T total params. 49B active params. 524K context.

Introducing Agr, an open decision model by Command Code

Introducing Agr, an open decision model by Command Code

Introducing Agr, an open decision model by Command Code. 58.15 on Decision Index 0.2.1. Best-in-class on coding agent tool calls and routing.