Requential Coding. Researchers achieved <1 bit compression due to the generalization ability fostered by advanced teaching technique
"We introduce requential coding, where a teacher model selects training samples drawn from the student's own distribution" Due to new learning technique the model has achieved better generalization skill without overfitting and me…