Knowledge distillation

Training a smaller model to reproduce the behaviour of a larger one, so that similar results need less computing power.

Scheme

• Technologies and capabilities

Broader terms

• Machine learning