Only resize the display when actually required