EpochLex entry
Distillation
dis-tuh-LAY-shun
A model-compression and transfer technique in which a smaller or simpler model is trained to reproduce useful behavior or knowledge from a larger model or ensemble.
EpochLex entry
dis-tuh-LAY-shun
A model-compression and transfer technique in which a smaller or simpler model is trained to reproduce useful behavior or knowledge from a larger model or ensemble.