Neat and efficient data dependent initialisation for Weight Normalization [1] in PyTorch via hooks.
[1] Salismans, Tim and Kingma, Durk P. Weight Normalization: A Simple Reparameterization to Accelerate Training of Deep Neural Networks. NeurIPS. 2016. https://arxiv.org/abs/1602.07868.