Force buffer re-allocation when the backing display changes