Why only mono when opening sound settings with my headphones?

I have a pair of Jabra Evolve2 85. I connect them wirelessly to a little USB-C dongle plugged into my Ubuntu 20.10 laptop. The headphones are recognized as a USB device and can be selected in sound output settings. They work just fine, but only until I open Sound settings. Then they immediately switch to mono and poorer sound quality and when I do the left <-> right test it's mono. As soon as I close Sound settings the headphones automatically switches back to stereo high quality sound. They also switch to this mono mode when I do Skype and Zoom calls. I seem to remember that when I use bluetooth headphones there's two modes in settings to choose from, one for chat and such, and one for high quality music. Maybe Ubuntu gets "confused" when I use these hybrid headphones that connect to a dongle which again is connected to the laptop? Things seem to work fine but this switch to mono when opening sound settings is very confusing.