https://learn.microsoft.com/en-us/windows/win32/intl/character-sets-used-in-file-names
"Character Sets Used in File Names
NTFS stores file names in Unicode"
MICROSOFT
MICROSOFT, THAT IS INADEQUATELY SPECIFIC
Discussion
https://learn.microsoft.com/en-us/windows/win32/intl/character-sets-used-in-file-names
"Character Sets Used in File Names
NTFS stores file names in Unicode"
MICROSOFT
MICROSOFT, THAT IS INADEQUATELY SPECIFIC
@mcc it is going to be UCS-2 validation just makes you need error handling:)
@blinkygal @mcc Wikipedia claims Windows uses UTF-16. https://en.wikipedia.org/wiki/UTF-16
UCS-2 is now obsolete and dropped from the Unicode standard. But Windows was definitely all UCS-2 back in the NT / W2K era.
@hyc @blinkygal Sorry when I say "is it UCS-2 or UTF-16" what I mean is "Is it valid UTF-16 or potentially-valid UTF-16, and also is any kind of normalization scheme in effect ever"
@mcc back when NTFS was created, UTF-16 didn't exist. And there were no defined character codes outside the 16 bit character space.
@mcc Microsoft usually means utf16 when they say Unicode
@mcc well at least it isn't mysql utf....