CaloUtils: Tighten up test for bad layer position.
When we calculate the layer positionsm in CaloLayerCalculator, we can get crazy values if there is near-cancelation of the cell energies. There was some protection against this, but it was not sufficiently comprehensive. Tighten up these checks.
See ATLASRECTS-7775.