Editing the layer visibility of a linked graphic in InDesign causes the zoom level to be automatically adjusted to fit-to-page. This makes it difficult to see the preview image for small graphics that may be hard to see at the full page zoom level.

If any automatic zoom adjustment is to be made at all (which it should not) it should be to fit the graphic to the window so you can see what you are doing.