Any time some weird thing results in the refresh rate being set incorrectly, it is pretty noticable to me. Though it might be more about the pixel response time being tuned for the max refresh rate and thus the screen looking a bit darker at lower refresh rates (because the pixels get closer to returning to black before the next frame comes in).

Just speculating on the reason but I definitely notice it when it’s wrong.