3D-360 and 180: Why do people sometimes look too big or too small in VR?

In the VR video formats 3D-180 and 3D-360, human scale is very important. If you see an immersive video in which people look too small, it's because the camera's stereo baseline was more than 64mm (hyperstereo). If people look too big, like giants, then the camera's stereo baseline was less than 64mm (hypostereo)...