diff options
author | lijianglin <lijianglin2@huawei.com> | 2023-06-27 20:15:49 +0800 |
---|---|---|
committer | Mike FABIAN <mfabian@redhat.com> | 2023-08-29 19:02:30 +0200 |
commit | e1d3312015e8f70344620375aedf91afe7e7e7a4 (patch) | |
tree | 7cb4bdd67996531918511dc3e230f7fecc23ec3a /localedata/charmaps | |
parent | d3c34a2dd982a77abf631ea2f88f4efab1b064c4 (diff) | |
download | glibc-e1d3312015e8f70344620375aedf91afe7e7e7a4.tar glibc-e1d3312015e8f70344620375aedf91afe7e7e7a4.tar.gz glibc-e1d3312015e8f70344620375aedf91afe7e7e7a4.tar.bz2 glibc-e1d3312015e8f70344620375aedf91afe7e7e7a4.zip |
add GB18030-2022 charmap and test the entire GB18030 charmap [BZ #30243]
support GB18030-2022 after add and change some transcoding relationship
of GB18030-2022.Details are as follows:
add 25 transcoding relationship
UE81E 0x82359037
UE826 0x82359038
UE82B 0x82359039
UE82C 0x82359130
UE832 0x82359131
UE843 0x82359132
UE854 0x82359133
UE864 0x82359134
UE78D 0x84318236
UE78F 0x84318237
UE78E 0x84318238
UE790 0x84318239
UE791 0x84318330
UE792 0x84318331
UE793 0x84318332
UE794 0x84318333
UE795 0x84318334
UE796 0x84318335
UE816 0xfe51
UE817 0xfe52
UE818 0xfe53
UE831 0xfe6c
UE83B 0xfe76
UE855 0xfe91
change 6 transcoding relationship
U20087 0x95329031
U20089 0x95329033
U200CC 0x95329730
U215D7 0x9536b937
U2298F 0x9630ba35
U241FE 0x9635b630
Test the entire GB18030 charmap, not only the Unicode BMP part.
Co-authored-by: yangyanchao <yangyanchao6@huawei.com>
Co-authored-by: liqingqing <liqingqing3@huawei.com>
Co-authored-by: Bruno Haible <bruno@clisp.org>
Reviewed-by: Andreas Schwab <schwab@suse.de>
Reviewed-by: Mike FABIAN <mfabian@redhat.com>
Diffstat (limited to 'localedata/charmaps')
-rw-r--r-- | localedata/charmaps/GB18030 | 91 |
1 files changed, 29 insertions, 62 deletions
diff --git a/localedata/charmaps/GB18030 b/localedata/charmaps/GB18030 index ad6728c5bd..fc3b1d2d40 100644 --- a/localedata/charmaps/GB18030 +++ b/localedata/charmaps/GB18030 @@ -57234,32 +57234,16 @@ CHARMAP <UE78A> /xa6/xbe <Private Use> <UE78B> /xa6/xbf <Private Use> <UE78C> /xa6/xc0 <Private Use> -% The newest GB 18030-2005 standard still uses some private use area -% code points. Any implementation which has Unicode 4.1 or newer -% support should not use these PUA code points, and instead should -% map these entries to their equivalent non-PUA code points. There -% are 24 idiograms in GB 18030-2005 which have non-PUA equivalents. -% In glibc we only support roundtrip code points, and so must choose -% between supporting the old PUA code points, or using the newer -% non-PUA code points. We choose to use the non-PUA code points to -% be compatible with ICU's similar choice. In choosing the non-PUA -% code points we can no longer convert the old PUA code points back -% to GB-18030-2005 (technically only fixable if we added support -% for non-roundtrip code points e.g. ICU's "fallback mapping"). -% The recommendation to use the non-PUA code points, where available, -% is based on "CJKV Information Processing" 2nd Ed. by Dr. Ken Lunde. -% -% These 10 PUA mappings use equivalents from <UFE10> to <UFE19>. -% <UE78D> /xa6/xd9 <Private Use> -% <UE78E> /xa6/xda <Private Use> -% <UE78F> /xa6/xdb <Private Use> -% <UE790> /xa6/xdc <Private Use> -% <UE791> /xa6/xdd <Private Use> -% <UE792> /xa6/xde <Private Use> -% <UE793> /xa6/xdf <Private Use> -% <UE794> /xa6/xec <Private Use> -% <UE795> /xa6/xed <Private Use> -% <UE796> /xa6/xf3 <Private Use> +<UE78D> /x84/x31/x82/x36 <Private Use> +<UE78E> /x84/x31/x82/x38 <Private Use> +<UE78F> /x84/x31/x82/x37 <Private Use> +<UE790> /x84/x31/x82/x39 <Private Use> +<UE791> /x84/x31/x83/x30 <Private Use> +<UE792> /x84/x31/x83/x31 <Private Use> +<UE793> /x84/x31/x83/x32 <Private Use> +<UE794> /x84/x31/x83/x33 <Private Use> +<UE795> /x84/x31/x83/x34 <Private Use> +<UE796> /x84/x31/x83/x35 <Private Use> <UE797> /xa6/xf6 <Private Use> <UE798> /xa6/xf7 <Private Use> <UE799> /xa6/xf8 <Private Use> @@ -57387,17 +57371,15 @@ CHARMAP <UE813> /xd7/xfd <Private Use> <UE814> /xd7/xfe <Private Use> <UE815> /x83/x36/xc9/x34 <Private Use> -% These 3 PUA mappings use equivalents <U20087>, <U20089> and <U200CC>. -% <UE816> /xfe/x51 <Private Use> -% <UE817> /xfe/x52 <Private Use> -% <UE818> /xfe/x53 <Private Use> +<UE816> /xfe/x51 <Private Use> +<UE817> /xfe/x52 <Private Use> +<UE818> /xfe/x53 <Private Use> <UE819> /x83/x36/xc9/x35 <Private Use> <UE81A> /x83/x36/xc9/x36 <Private Use> <UE81B> /x83/x36/xc9/x37 <Private Use> <UE81C> /x83/x36/xc9/x38 <Private Use> <UE81D> /x83/x36/xc9/x39 <Private Use> -% This 1 PUA mapping uses the equivalent <U9FB4>. -% <UE81E> /xfe/x59 <Private Use> +<UE81E> /x82/x35/x90/x37 <Private Use> <UE81F> /x83/x36/xca/x30 <Private Use> <UE820> /x83/x36/xca/x31 <Private Use> <UE821> /x83/x36/xca/x32 <Private Use> @@ -57405,22 +57387,19 @@ CHARMAP <UE823> /x83/x36/xca/x34 <Private Use> <UE824> /x83/x36/xca/x35 <Private Use> <UE825> /x83/x36/xca/x36 <Private Use> -% This 1 PUA mapping uses the equivalent <U9FB5>. -% <UE826> /xfe/x61 <Private Use> +<UE826> /x82/x35/x90/x38 <Private Use> <UE827> /x83/x36/xca/x37 <Private Use> <UE828> /x83/x36/xca/x38 <Private Use> <UE829> /x83/x36/xca/x39 <Private Use> <UE82A> /x83/x36/xcb/x30 <Private Use> -% These 2 PUA mappings use the equivalents <U9FB6> and <U9FB7>. -% <UE82B> /xfe/x66 <Private Use> -% <UE82C> /xfe/x67 <Private Use> +<UE82B> /x82/x35/x90/x39 <Private Use> +<UE82C> /x82/x35/x91/x30 <Private Use> <UE82D> /x83/x36/xcb/x31 <Private Use> <UE82E> /x83/x36/xcb/x32 <Private Use> <UE82F> /x83/x36/xcb/x33 <Private Use> <UE830> /x83/x36/xcb/x34 <Private Use> -% These 2 PUA mappings use the equivalents <U215D7> and <U9FB8>. -% <UE831> /xfe/x6c <Private Use> -% <UE832> /xfe/x6d <Private Use> +<UE831> /xfe/x6c <Private Use> +<UE832> /x82/x35/x91/x31 <Private Use> <UE833> /x83/x36/xcb/x35 <Private Use> <UE834> /x83/x36/xcb/x36 <Private Use> <UE835> /x83/x36/xcb/x37 <Private Use> @@ -57429,8 +57408,7 @@ CHARMAP <UE838> /x83/x36/xcc/x30 <Private Use> <UE839> /x83/x36/xcc/x31 <Private Use> <UE83A> /x83/x36/xcc/x32 <Private Use> -% This 1 PUA mapping uses the equivalent <U2298F>. -% <UE83B> /xfe/x76 <Private Use> +<UE83B> /xfe/x76 <Private Use> <UE83C> /x83/x36/xcc/x33 <Private Use> <UE83D> /x83/x36/xcc/x34 <Private Use> <UE83E> /x83/x36/xcc/x35 <Private Use> @@ -57438,8 +57416,7 @@ CHARMAP <UE840> /x83/x36/xcc/x37 <Private Use> <UE841> /x83/x36/xcc/x38 <Private Use> <UE842> /x83/x36/xcc/x39 <Private Use> -% This 1 PUA mapping uses the equivalent <U9FB9>. -% <UE843> /xfe/x7e <Private Use> +<UE843> /x82/x35/x91/x32 <Private Use> <UE844> /x83/x36/xcd/x30 <Private Use> <UE845> /x83/x36/xcd/x31 <Private Use> <UE846> /x83/x36/xcd/x32 <Private Use> @@ -57456,9 +57433,8 @@ CHARMAP <UE851> /x83/x36/xce/x33 <Private Use> <UE852> /x83/x36/xce/x34 <Private Use> <UE853> /x83/x36/xce/x35 <Private Use> -% These 2 PUA mappings use the equivalents <U9FBA> and <U241FE>. -% <UE854> /xfe/x90 <Private Use> -% <UE855> /xfe/x91 <Private Use> +<UE854> /x82/x35/x91/x33 <Private Use> +<UE855> /xfe/x91 <Private Use> <UE856> /x83/x36/xce/x36 <Private Use> <UE857> /x83/x36/xce/x37 <Private Use> <UE858> /x83/x36/xce/x38 <Private Use> @@ -57473,8 +57449,7 @@ CHARMAP <UE861> /x83/x36/xcf/x37 <Private Use> <UE862> /x83/x36/xcf/x38 <Private Use> <UE863> /x83/x36/xcf/x39 <Private Use> -% This 1 PUA mapping uses the equivalent <U9FBB>. -% <UE864> /xfe/xa0 <Private Use> +<UE864> /x82/x35/x91/x34 <Private Use> <UE865> /x83/x36/xd0/x30 <Private Use> <UE866> /x83/x36/xd0/x31 <Private Use> <UE867> /x83/x36/xd0/x32 <Private Use> @@ -70447,19 +70422,14 @@ CHARMAP <U00020068>..<U00020071> /x95/x32/x8d/x30 <CJK> <U00020072>..<U0002007B> /x95/x32/x8e/x30 <CJK> <U0002007C>..<U00020085> /x95/x32/x8f/x30 <CJK> -<U00020086> /x95/x32/x90/x30 <CJK> -<U00020087> /xfe/x51 <CJK> -<U00020088> /x95/x32/x90/x32 <CJK> -<U00020089> /xfe/x52 <CJK> -<U0002008A>..<U0002008F> /x95/x32/x90/x34 <CJK> +<U00020086>..<U0002008F> /x95/x32/x90/x30 <CJK> <U00020090>..<U00020099> /x95/x32/x91/x30 <CJK> <U0002009A>..<U000200A3> /x95/x32/x92/x30 <CJK> <U000200A4>..<U000200AD> /x95/x32/x93/x30 <CJK> <U000200AE>..<U000200B7> /x95/x32/x94/x30 <CJK> <U000200B8>..<U000200C1> /x95/x32/x95/x30 <CJK> <U000200C2>..<U000200CB> /x95/x32/x96/x30 <CJK> -<U000200CC> /xfe/x53 <CJK> -<U000200CD>..<U000200D5> /x95/x32/x97/x31 <CJK> +<U000200CC>..<U000200D5> /x95/x32/x97/x30 <CJK> <U000200D6>..<U000200DF> /x95/x32/x98/x30 <CJK> <U000200E0>..<U000200E9> /x95/x32/x99/x30 <CJK> <U000200EA>..<U000200F3> /x95/x32/x9a/x30 <CJK> @@ -70998,8 +70968,7 @@ CHARMAP <U000215BC>..<U000215C5> /x95/x36/xb7/x30 <CJK> <U000215C6>..<U000215CF> /x95/x36/xb8/x30 <CJK> <U000215D0>..<U000215D6> /x95/x36/xb9/x30 <CJK> -<U000215D7> /xfe/x6c <CJK> -<U000215D8>..<U000215D9> /x95/x36/xb9/x38 <CJK> +<U000215D7>..<U000215D9> /x95/x36/xb9/x37 <CJK> <U000215DA>..<U000215E3> /x95/x36/xba/x30 <CJK> <U000215E4>..<U000215ED> /x95/x36/xbb/x30 <CJK> <U000215EE>..<U000215F7> /x95/x36/xbc/x30 <CJK> @@ -71505,8 +71474,7 @@ CHARMAP <U00022976>..<U0002297F> /x96/x30/xb8/x30 <CJK> <U00022980>..<U00022989> /x96/x30/xb9/x30 <CJK> <U0002298A>..<U0002298E> /x96/x30/xba/x30 <CJK> -<U0002298F> /xfe/x76 <CJK> -<U00022990>..<U00022993> /x96/x30/xba/x36 <CJK> +<U0002298F>..<U00022993> /x96/x30/xba/x35 <CJK> <U00022994>..<U0002299D> /x96/x30/xbb/x30 <CJK> <U0002299E>..<U000229A7> /x96/x30/xbc/x30 <CJK> <U000229A8>..<U000229B1> /x96/x30/xbd/x30 <CJK> @@ -72132,8 +72100,7 @@ CHARMAP <U000241E0>..<U000241E9> /x96/x35/xb3/x30 <CJK> <U000241EA>..<U000241F3> /x96/x35/xb4/x30 <CJK> <U000241F4>..<U000241FD> /x96/x35/xb5/x30 <CJK> -<U000241FE> /xfe/x91 <CJK> -<U000241FF>..<U00024207> /x96/x35/xb6/x31 <CJK> +<U000241FE>..<U00024207> /x96/x35/xb6/x30 <CJK> <U00024208>..<U00024211> /x96/x35/xb7/x30 <CJK> <U00024212>..<U0002421B> /x96/x35/xb8/x30 <CJK> <U0002421C>..<U00024225> /x96/x35/xb9/x30 <CJK> |