Is this figure wrong? IIUC, the left is layer norm, and the right is batch norm.

…le features. In this case, BatchNorm normalizes vertically, while LayerNorm normalizes horizontally. Figure 1 illustrates this concept:
BatchNorm and LayerNorm
172
4
Florian June
Jeff Zhang
·Follow
Feb 28, 2024
--
Is this figure wrong? IIUC, the left is layer norm, and the right is batch norm.
--
--
Written by Jeff Zhang263 Followers
·110 Following
Apache Member, Open source veteran, Big Data, Data Science,
Responses (3)
Help
Status
About
Careers
Press
Blog
Privacy
Terms
Text to speech
Teams