Microsoft Interview Question

Explain Attention Mechanism, BatchNorm and Layer Norm. Explain Encoder and Decoder in Transformers