According to Wikipedia's utf-8 Codepage Layout, its character-set is as follows:
! " # $ % & ' ( ) * + , - . / 0-9 : ; < = > ? @ A-Z [ \ ] ^ _ ` a-z { | } ~
But (excepting /), filenames beginning with these character are sorted by name differently:
! " # % & ' ( ) * + , - : ; < = > ? @ [ \ ] ^ _ ` { | } ~ 0-9 $ a A z Z
Why is this? Does it have to do with the file system? File Manager? Locale? Something else?
The sort order is controlled by the LC_COLLATE category of the locale settings. It doesn't depend on the character encoding.
Note that some programs, especially command line programs, may not use the locale settings for sorting.