It might have been the 3.5mm cable I was using. I just bought a new (longer) one and sound quality seems a lot better now.
It's an archaic way of listening to music for sure (a far cry from CIC iDrive when I had my LCI e92...), but I do like being able to keep the dash OEM and volume controls on the steering wheel.