I am frequently inadvertently dragging the contents of an image frame (photograph) out of the frame, instead of moving the frame itself. This is even while the Select Tool is chosen.

It seems to matter whether the frame was previously selected and where in the frame you click/drag.

I would like this to only be possible with the Direct Selection Tool.
Or at least, an option that can turn off this frustrating 'feature'.