Adapt collation in several locales to the new iso14651_t1_common file

[BZ #22550] - es_ES locale (and other es_* locales): collation should
treat ñ as a primary different character, sync the collation
for Spanish with CLDR
[BZ #21547] - Tibetan script collation broken (Dzongkha and Tibetan)

	* localedata/Makefile: Add new test files.
	* localedata/lv_LV.UTF-8.in: Adapt test file to new collation order.
	* localedata/sv_SE.ISO-8859-1.in: Adapt test file to new collation order.
	* localedata/uk_UA.UTF-8.in: Adapt test file to new collation order.
	* localedata/am_ET.UTF-8.in: New test file.
	* localedata/az_AZ.UTF-8.in: Likewise.
	* localedata/be_BY.UTF-8.in: Likewise.
	* localedata/ber_DZ.UTF-8.in: Likewise.
	* localedata/ber_MA.UTF-8.in: Likewise.
	* localedata/bg_BG.UTF-8.in: Likewise.
	* localedata/br_FR.UTF-8.in: Likewise.
	* localedata/cmn_TW.UTF-8.in: Likewise.
	* localedata/crh_UA.UTF-8.in: Likewise.
	* localedata/csb_PL.UTF-8.in: Likewise.
	* localedata/cv_RU.UTF-8.in: Likewise.
	* localedata/cy_GB.UTF-8.in: Likewise.
	* localedata/dz_BT.UTF-8.in: Likewise.
	* localedata/eo.UTF-8.in: Likewise.
	* localedata/es_ES.UTF-8.in: Likewise.
	* localedata/fa_IR.UTF-8.in: Likewise.
	* localedata/fi_FI.UTF-8.in: Likewise.
	* localedata/fil_PH.UTF-8.in: Likewise.
	* localedata/fur_IT.UTF-8.in: Likewise.
	* localedata/gez_ER.UTF-8@abegede.in: Likewise.
	* localedata/ha_NG.UTF-8.in: Likewise.
	* localedata/ig_NG.UTF-8.in: Likewise.
	* localedata/ik_CA.UTF-8.in: Likewise.
	* localedata/kk_KZ.UTF-8.in: Likewise.
	* localedata/ku_TR.UTF-8.in: Likewise.
	* localedata/ky_KG.UTF-8.in: Likewise.
	* localedata/ln_CD.UTF-8.in: Likewise.
	* localedata/mi_NZ.UTF-8.in: Likewise.
	* localedata/ml_IN.UTF-8.in: Likewise.
	* localedata/mn_MN.UTF-8.in: Likewise.
	* localedata/mr_IN.UTF-8.in: Likewise.
	* localedata/mt_MT.UTF-8.in: Likewise.
	* localedata/nb_NO.UTF-8.in: Likewise.
	* localedata/om_KE.UTF-8.in: Likewise.
	* localedata/os_RU.UTF-8.in: Likewise.
	* localedata/ps_AF.UTF-8.in: Likewise.
	* localedata/ro_RO.UTF-8.in: Likewise.
	* localedata/ru_RU.UTF-8.in: Likewise.
	* localedata/sc_IT.UTF-8.in: Likewise.
	* localedata/se_NO.UTF-8.in: Likewise.
	* localedata/sq_AL.UTF-8.in: Likewise.
	* localedata/sv_SE.UTF-8.in: Likewise.
	* localedata/szl_PL.UTF-8.in: Likewise.
	* localedata/tg_TJ.UTF-8.in: Likewise.
	* localedata/tk_TM.UTF-8.in: Likewise.
	* localedata/tt_RU.UTF-8.in: Likewise.
	* localedata/tt_RU.UTF-8@iqtelif.in: Likewise.
	* localedata/ug_CN.UTF-8.in: Likewise.
	* localedata/uz_UZ.UTF-8.in: Likewise.
	* localedata/vi_VN.UTF-8.in: Likewise.
	* localedata/yi_US.UTF-8.in: Likewise.
	* localedata/yo_NG.UTF-8.in: Likewise.
	* localedata/zh_CN.UTF-8.in: Likewise.
	* localedata/locales/am_ET: Adapt collation rules to new iso14651_t1_common
        file and fix bugs in the collation.
	* localedata/locales/az_AZ: Likewise.
	* localedata/locales/be_BY: Likewise.
	* localedata/locales/ber_DZ: Likewise.
	* localedata/locales/ber_MA: Likewise.
	* localedata/locales/bg_BG: Likewise.
	* localedata/locales/br_FR: Likewise.
	* localedata/locales/br_FR@euro: Likewise.
	* localedata/locales/ca_ES: Likewise.
	* localedata/locales/cns11643_stroke: Likewise.
	* localedata/locales/crh_UA: Likewise.
	* localedata/locales/cs_CZ: Likewise.
	* localedata/locales/csb_PL: Likewise.
	* localedata/locales/cv_RU: Likewise.
	* localedata/locales/cy_GB: Likewise.
	* localedata/locales/da_DK: Likewise.
	* localedata/locales/dz_BT: Likewise.
	* localedata/locales/en_CA: Likewise.
	* localedata/locales/eo: Likewise.
	* localedata/locales/es_CU: Likewise.
	* localedata/locales/es_EC: Likewise.
	* localedata/locales/es_ES: Likewise.
	* localedata/locales/es_US: Likewise.
	* localedata/locales/et_EE: Likewise.
	* localedata/locales/fa_IR: Likewise.
	* localedata/locales/fi_FI: Likewise.
	* localedata/locales/fil_PH: Likewise.
	* localedata/locales/fur_IT: Likewise.
	* localedata/locales/gez_ER@abegede: Likewise.
	* localedata/locales/ha_NG: Likewise.
	* localedata/locales/hr_HR: Likewise.
	* localedata/locales/hsb_DE: Likewise.
	* localedata/locales/hu_HU: Likewise.
	* localedata/locales/ig_NG: Likewise.
	* localedata/locales/ik_CA: Likewise.
	* localedata/locales/is_IS: Likewise.
	* localedata/locales/iso14651_t1_pinyin: Likewise.
	* localedata/locales/kk_KZ: Likewise.
	* localedata/locales/ku_TR: Likewise.
	* localedata/locales/ky_KG: Likewise.
	* localedata/locales/ln_CD: Likewise.
	* localedata/locales/lt_LT: Likewise.
	* localedata/locales/lv_LV: Likewise.
	* localedata/locales/mi_NZ: Likewise.
	* localedata/locales/ml_IN: Likewise.
	* localedata/locales/mn_MN: Likewise.
	* localedata/locales/mr_IN: Likewise.
	* localedata/locales/mt_MT: Likewise.
	* localedata/locales/nb_NO: Likewise.
	* localedata/locales/om_KE: Likewise.
	* localedata/locales/os_RU: Likewise.
	* localedata/locales/pl_PL: Likewise.
	* localedata/locales/ps_AF: Likewise.
	* localedata/locales/ro_RO: Likewise.
	* localedata/locales/ru_RU: Likewise.
	* localedata/locales/ru_UA: Likewise.
	* localedata/locales/sc_IT: Likewise.
	* localedata/locales/se_NO: Likewise.
	* localedata/locales/si_LK: Likewise.
	* localedata/locales/sq_AL: Likewise.
	* localedata/locales/sv_FI: Likewise.
	* localedata/locales/sv_FI@euro: Likewise.
	* localedata/locales/sv_SE: Likewise.
	* localedata/locales/szl_PL: Likewise.
	* localedata/locales/tg_TJ: Likewise.
	* localedata/locales/ti_ER: Likewise.
	* localedata/locales/tk_TM: Likewise.
	* localedata/locales/tl_PH: Likewise.
	* localedata/locales/tr_TR: Likewise.
	* localedata/locales/tt_RU: Likewise.
	* localedata/locales/tt_RU@iqtelif: Likewise.
	* localedata/locales/ug_CN: Likewise.
	* localedata/locales/uk_UA: Likewise.
	* localedata/locales/uz_UZ: Likewise.
	* localedata/locales/uz_UZ@cyrillic: Likewise.
	* localedata/locales/vi_VN: Likewise.
	* localedata/locales/yi_US: Likewise.
	* localedata/locales/yo_NG: Likewise.

1 files changed, 87 insertions, 38 deletions

diff --git a/localedata/locales/yi_US b/localedata/locales/yi_US
index 007ec7d082..95963830fc 100644
--- a/localedata/locales/yi_US
+++ b/localedata/locales/yi_US
@@ -71,46 +71,95 @@ translit_end
 END LC_CTYPE
 
 LC_COLLATE
+% CLDR collation rules for Yiddish:
+% (see: https://unicode.org/cldr/trac/browser/trunk/common/collation/yi.xml)
+%
+% <collation type="standard">
+%   <cr><![CDATA[
+%     [normalization on]
+%     [reorder Hebr]
+%     &[before 2]''<<׳ # GERESH just before APOSTROPHE (secondary difference)
+%     &[before 2]'\"'<<״ # GERSHAYIM just before QUOTATION MARK (secondary difference)
+%     &ב<בֿ
+%     &ו<<וּ<<וו<<וי
+%     &י<<יִ<<יי<<ײַ
+%     &[before 1]כ<כּ
+%     &[before 1]פ<פּ
+%     &פֿ<<<ף
+%     &ש<שׂ
+%     &[before 1]ת<תּ
+%   ]]></cr>
+% </collation>
+%
+% And CLDR also lists the following
+% index characters:
+% (see: https://unicode.org/cldr/trac/browser/trunk/common/main/yi.xml)
+%
+% <exemplarCharacters type="index">[\u05C2 \u05BC \u05BF א ב ג ד ה ו ז ח ט י כ ל מ נ ס ע פ צ ק ר ש ת]</exemplarCharacters>
+%
+% The following rules implement the same order for glibc.
 copy "iso14651_t1"
 
-collating-symbol  <b-h-yi>
-collating-element <B+'H-> from "<U05D1><U05BF>"
-collating-symbol  <k-m-yi>
-collating-element <K+.MH> from "<U05DB><U05BC>"
-collating-symbol  <p-m-yi>
-collating-element <P+.MH> from "<U05E4><U05BC>"
-collating-symbol  <p-h-yi>
-collating-element <P+'H-> from "<U05E4><U05BF>"
-collating-symbol  <s-h-yi>
-collating-element <Sh'H.L> from "<U05E9><U05C2>"
-collating-symbol  <t-m-yi>
-collating-element <T+.MH> from "<U05EA><U05BC>"
-
-reorder-after <bet>
-<b-h-yi>
-reorder-after <yod>
-<k-m-yi>
-reorder-after <ayin>
-<p-m-yi>
-<p-h-yi>
-reorder-after <shin>
-<s-h-yi>
-<t-m-yi>
-
-reorder-after <U05D1>
-<B+'H->	<b-h-yi>;<PCT>;IGNORE;IGNORE
-reorder-after <U05D5>
-<U05F0>	"<vav><vav>";"<LIG><LIG>";IGNORE;IGNORE
-<U05F1>	"<vav><yod>";"<LIG><LIG>";IGNORE;IGNORE
-reorder-after <U05D9>
-<U05F2>	"<yod><yod>";"<LIG><LIG>";IGNORE;IGNORE
-<K+.MH>	<k-m-yi>;<PCT>;IGNORE;IGNORE
-reorder-after <U05E2>
-<P+.MH>	<p-m-yi>;<PCT>;IGNORE;IGNORE
-<P+'H->	<p-h-yi>;<PCT>;IGNORE;IGNORE
-reorder-after <U05E9>
-<Sh'H.L>	<s-h-yi>;<PCT>;IGNORE;IGNORE
-<T+.MH>	<t-m-yi>;<PCT>;IGNORE;IGNORE
+collating-symbol  <bet-rafe>
+collating-element <bet-with-combining-rafe> from "<U05D1><U05BF>" % ב + ֿ = בֿ
+collating-symbol  <kaf-dagesh>
+collating-element <kaf-with-combining-dagesh> from "<U05DB><U05BC>" % כ + ּ = כּ
+collating-symbol  <pe-dagesh>
+collating-element <pe-with-combining-dagesh> from "<U05E4><U05BC>" % פ + ּ = פּ
+collating-symbol  <pe-rafe>
+collating-element <pe-with-combining-rafe> from "<U05E4><U05BF>" % פ + ֿ = פֿ
+collating-symbol  <shin-sin-dot>
+collating-element <shin-with-combining-sin-dot> from "<U05E9><U05C2>" % ש + ׂ = שׂ
+collating-symbol  <tav-dagesh>
+collating-element <tav-with-combining-dagesh> from "<U05EA><U05BC>" % ת + ּ = תּ
+
+collating-element <vav-with-combining-dagesh> from "<U05D5><U05BC>" % ו + ּ = וּ
+collating-element <vav-vav>                   from "<U05D5><U05D5>" % ו + ו = וו
+collating-element <vav-yod>                   from "<U05D5><U05D9>" % ו + י = וי
+collating-element <yod-with-combining-hiriq>  from "<U05D9><U05B4>" % י + ִ = יִ
+collating-element <yod-yod>                   from "<U05D9><U05D9>" % י + י = יי
+collating-element <double-yod-with-combining-patah>  from "<U05F2><U05B7>" % ײ + ַ = ײַ
+
+reorder-after <S05D1> % HEBREW LETTER BET
+<bet-rafe>
+reorder-after <S05D9> % HEBREW LETTER YOD
+<kaf-dagesh>
+reorder-after <S05E2> % HEBREW LETTER AYIN
+<pe-dagesh>
+reorder-after <S05E4> % HEBREW LETTER PE
+<pe-rafe>
+reorder-after <S05E9> % HEBREW LETTER SHIN
+<shin-sin-dot>
+<tav-dagesh>
+
+% &[before 2]''<<׳ # GERESH just before APOSTROPHE (secondary difference)
+<U05F3> IGNORE;<VRNT1>;IGNORE;<U05F3> % HEBREW PUNCTUATION GERESH
+<U0027> IGNORE;<VRNT2>;IGNORE;<U0027> % APOSTROPHE
+% &[before 2]'\"'<<״ # GERSHAYIM just before QUOTATION MARK (secondary difference)
+<U05F4> IGNORE;<VRNT1>;IGNORE;<U05F4> % HEBREW PUNCTUATION GERSHAYIM
+<U0022> IGNORE;<VRNT2>;IGNORE;<U0022> % QUOTATION MARK
+% &ב<בֿ
+<bet-with-combining-rafe> <bet-rafe>;"<BASE><BASE>";IGNORE;IGNORE % ב + ֿ = בֿ
+% &ו<<וּ<<וו<<וי
+<U05D5>                     <S05D5>;"<BASE><BASE>";<MIN>;<U05D5> % ו HEBREW LETTER VAV
+<vav-with-combining-dagesh> <S05D5>;"<BASE><VRNT1>";<MIN>;"<U05D5><U05BC>" % ו + ּ = וּ
+<vav-vav>                   <S05D5>;"<BASE><VRNT2>";<MIN>;"<U05D5><U05D5>" % ו + ו = וו
+<vav-yod>                   <S05D5>;"<BASE><VRNT3>";<MIN>;"<U05D5><U05D9>" % ו + י = וי
+% &י<<יִ<<יי<<ײַ
+<U05D9>                     <S05D9>;"<BASE><BASE>";<MIN>;<U05D9> % י HEBREW LETTER YOD
+<yod-with-combining-hiriq>  <S05D9>;"<BASE><VRNT1>";<MIN>;"<U05D9><U05B4>" % י + ִ = יִ
+<yod-yod>                   <S05D9>;"<BASE><VRNT2>";<MIN>;"<U05D9><U05D9>" % י + י = יי
+<double-yod-with-combining-patah> <S05D9>;"<BASE><VRNT3>";<MIN>;"<U05F2><U05B7>" % ײ + ַ = ײַ% &[before 1]כ<כּ
+<kaf-with-combining-dagesh>	<kaf-dagesh>;"<BASE><BASE>";IGNORE;IGNORE % כ + ּ = כּ
+% &[before 1]פ<פּ
+<pe-with-combining-dagesh>	<pe-dagesh>;"<BASE><BASE>";IGNORE;IGNORE % פ + ּ = פּ
+% &פֿ<<<ף
+<pe-with-combining-rafe>	<pe-rafe>;"<BASE><BASE>";<MIN>;IGNORE % פ + ֿ = פֿ
+<U05E3>                         <pe-rafe>;"<BASE><BASE>";<CAP>;IGNORE % ף
+% &ש<שׂ
+<shin-with-combining-sin-dot>	<shin-sin-dot>;"<BASE><BASE>";IGNORE;IGNORE % ש + ׂ = שׂ
+% &[before 1]ת<תּ
+<tav-with-combining-dagesh>	<tav-dagesh>;"<BASE><BASE>";IGNORE;IGNORE % ת + ּ = תּ
 
 reorder-end