I'm using InDesign 17.1 but I believe this is a longstanding bug. When using optical kerning, the visual distance between an apostrophe and a lowercase d is too wide. I'm attaching a screenshot with examples using I'd, She'd, and Who'd. The upper version of each one uses optical kerning, while the lower version is where I have manually adjusted the kerning to something more like it should be. I also include examples of the pleasing optical kerning shown by other apostrophe-letter pairs.

Most relevant is the apostrophe s combination. The lowercase s has an upper left curve similar to the lowercase d's, but its optical kerning is much tighter. The lowercase d's optical kerning after an apostrophe should be at least as tight, if not tighter (due to the steeper curve).