This text explores a structured pruning approach for state-of-the-art fashions, that makes use of a GLU…