Actually can happen if the little ampule is misaligned in the housing. Easy to test for, turn the level around, if it reads level one way but not another it’s not a good level. Relatedly: Don’t buy spirit levels or measuring tools at Harbor Freight.