居委会大爷|别再蒸馏3层BERT了！变矮又能变瘦的DynaBERT了解一下( 三 )

2020-06-26

[5]Analyzing multi-head self-attention: https://arxiv.org/abs/1905.09418
[6]Minilm: https://arxiv.org/abs/2002.10957