In this program the string 'txt1' contains two codepoints: LATIN CAPITAL LETTER A, and COMBINING DIAERESIS. I think a good printing function has to perform Unicode normalization and show a single \U000000C4 (LATIN CAPITAL LETTER A WITH DIAERESIS) glyph. But with DMD 2.057beta it shows two glyphs (on Windows), an 'A' followed by a diaeresis. writeln(txt2) shows what I think is the correct output for writeln(txt1) too: import std.stdio; void main() { dstring txt1 = "\U00000041\U00000308"d; writeln(txt1); dstring txt2 = "\U000000C4"d; writeln(txt2); }
IMO this should be an enhancement request. As I understand, Unicode normalization is non-trivial, so we probably should think over how we want to do it.
(In reply to comment #1) > IMO this should be an enhancement request. As I understand, Unicode > normalization is non-trivial, so we probably should think over how we want to > do it. OK, now it's an enhancement.
Here's a link to the relevant part of the Unicode standard for whoever wants to implement normalization: http://unicode.org/reports/tr15/ Note that there are several different normalizations, with NFC probably being the closest to what this bug requires. After scanning through the standard, it seems to me that rather than putting this in std.stdio (or the prospective std.io), we really should put it in std.uni or std.utf, and have different algorithms available for programs to choose the normalization form. The algorithms involved are not trivial, and some people may not want std.stdio to automatically normalize to a particular form when they want specifically to use a different form or a non-normalized output for whatever reason.
@andralex: Are you sure this bug qualifies for 'bootcamp'? Unicode normalization is highly-nontrivial, and requires significant effort to support correctly, and will probably involve multiple modules (at least std.uni and std.stdio, perhaps also std.utf). Plus, deciding which normalization scheme(s) to default to is a decision that can only be made with more experience with the language and community.
This can have the same problem as issue 2742: normalizing it always may be not what one wants, and detecting console is problematic. Also AFAIK not all characters have precomposed variants.
THIS ISSUE HAS BEEN MOVED TO GITHUB https://github.com/dlang/phobos/issues/9920 DO NOT COMMENT HERE ANYMORE, NOBODY WILL SEE IT, THIS ISSUE HAS BEEN MOVED TO GITHUB