I renamed the two partitions of windows and Ubuntu (dual boot) via GNOME Disks, restarted, but when I open Nautilus in the 'Other Locations' section I see only the label of windows changed, while the Ubuntu label remains under the name of' Computer is there a way to change this label?
Not sure about Gnome disks, but I know if you use Gparted, click on the disk and choose "Label," it will let you permanently change the disk label across the whole system. You may want to try that first. Also, you can use this in the terminal:
where sd is the partition or disk you want to change and the part in quotes is the new name you want. I think the reason your change didnt work is because it only changed the name it was mounted with and not the actual label. Try that and see if it works.