The rolling diameter shouldn't be different if the correct size tyre was fitted.

You could put a 20" wheel on with the skinniest of tyres to get the same diameter. Or you could put a 14" wheel on with a beefy side wall to match the diameter.

The road noise is probably because there is less tyre to absorb the noise.

BUT in your case they probably didn't match rolling diameter so you are probably right.