So you think you know distillation; it's easy, right? We thought so too with @XiaohuaZhai @__kolesnikov__ @_arohan_ and the amazing @royaleerieme and Larisa Markeeva. Until we didn't. But now we do again. Hop on for a ride (+the best ever ResNet50?

Mentions

Pavel Izmailov @Pavel_Izmailov · Jun 11, 2021

From Twitter

Also, see this nice tread on a paper by @giffmana @XiaohuaZhai @__kolesnikov__ @_arohan_ @royaleerieme and Larisa Markeeva: The paper came out just two days ago and is very related!

Tweet Jun 10, 2021

So you think you know distillation; it's easy, right? We thought so too with @XiaohuaZhai @__kolesnikov__ @_arohan_ and the amazing @royaleerieme and Larisa Markeeva. Until we didn't. But now we do again. Hop on for a ride (+the best ever ResNet50?

by Lucas Beyer

Recommended by 1 person

1 mention