Apple researcher, lead author of Distillation Scaling Laws
Machine Learning Researcher · current
Dan's Distillation Scaling Laws paper gave the field its first principled answer to how much teacher and student compute a distilled model deserves. It is the kind of careful empirical science that saves everyone else millions of GPU hours.
We built this from your public work because we think it deserves celebrating. You did not ask us to, so the only fair thing is that you decide what happens to it. Claim it and it is yours to edit. Ask us to change something and we will. Ask us to take it down and it is gone within 72 hours — free, no account needed, and nobody will try to talk you out of it.