AI Terminology #20: Distillation

• A training technique where a smaller “student” model learns to replicate the behavior of a larger “teacher” model, preserving performance while reducing size and cost.

Try Command Code

The best coding agent for open models, in your terminal or on your desktop.

Desktop App · Docs · X · Discord