Code page 950 explained
Code page 950 is the code page used on Microsoft Windows for Traditional Chinese. It is Microsoft's implementation of the de facto standard Big5 character encoding. The code page is not registered with IANA,[1] and hence, it is not a standard to communicate information over the internet, although it is usually labelled simply as, including by Microsoft library functions.[2]
Terminology and variants
The major difference between Windows code page 950 and "common" (non-vendor-specific) Big5 is the incorporation of a subset of the ETEN extensions to Big5 at 0xF9D6 through 0xF9FE (comprising the seven Chinese characters 碁, 銹, 裏, 墻, 恒, 粧, and 嫺, followed by 34 box drawing characters and block elements). The ranges used by some of the other ETEN extended characters are instead defined as end-user defined (private use) characters.
IBM's CCSID 950 comprises single byte code page 1114 (CCSID 1114) and double byte code page 947 (CCSID 947),[3] [4] [5] and, while also a Big5 variant, is somewhat different from Microsoft's code page 950, incorporating some of the ETEN extensions for lead bytes 0xA3,[6] 0xC6,[7] 0xC7[8] and 0xC8,[9] while omitting those with lead byte 0xF9 (which Microsoft includes), mapping them instead to the Private Use Area as user-defined characters.[10] It also includes two non-ETEN extension regions with trail bytes 0x81–A0, i.e. outside the usual Big5 trail byte range but similar to the Big5+ trail byte range: area 5 has lead bytes 0xF2–F9 and contains IBM-selected characters, while area 9 has lead bytes 0x81–8C and is a user-defined region.[11]
Microsoft updated their version of code page 950 in 2000, adding the euro sign (€) at the double-byte code 0xA3E1. IBM refers to the euro sign update of their Big-5 variant as CCSID 1370 (which includes both single-byte (0x80) and double-byte euro signs).[12] It comprises single byte code page 1114 (CCSID 5210) and double byte code page 947 (CCSID 21427).[12] [13] [14]
For better compatibility with Microsoft's variant in IBM Db2, IBM also define the pure double-byte Code page 1372[15] and associated variable-width CCSID 1373, which includes only the double-byte euro sign[16] and matches Microsoft behaviour in which extension regions are included.[17] [18] [19] [20] [21]
Single byte codes
The following are the single-byte graphical characters included by IBM. The codes 0x00 though 0x1F and 0x7F may be used for C0 control codes instead, depending on context (compare code page 437, code page 897). As noted above, the single-byte euro sign at 0x80 is not included in IBM CCSIDs 950 or 1373, nor by Microsoft.
The rest are parts of a double byte sequence.
Private Use Area usage
Mapping from Big5 EUDC to PUA code points[22] Big5 range | Unicode range | Formula[23] |
---|
81 40–8D FE | U+EEB8–U+F6B0 | 0xeeb8 + (157 * (H-0x81)) + (L<0x80)?(L-0x40):(L-0x62) |
8E 40–A0 FE | U+E311–U+EEB7 | 0xe311 + (157 * (H-0x8e)) + (L<0x80)?(L-0x40):(L-0x62) |
C6 A1–C8 FE | U+F6B1–U+F848 | 0xf672 + (157 * (H-0xc6)) + (L<0x80)?(L-0x40):(L-0x62) |
FA 40–FE FE | U+E000–U+E310 | 0xe000 + (157 * (H-0xfa)) + (L<0x80)?(L-0x40):(L-0x62) |
|
This mapping is also used in HKSCS where a given glyph is not yet found in the Unicode revision specified.[24]
See also
- LMBCS-18
- Code page 951, a Microsoft hack for replacing cp950 with an HKSCS-enabled version on Windows XP
References
- Web site: Character Sets. IANA — Protocol Registries.
- Web site: Encoding.WindowsCodePage Property - .NET Framework (current version) . MSDN . Microsoft.
- Web site: CCSID 950 information document. https://web.archive.org/web/20141202001630/http://www-01.ibm.com/software/globalization/ccsid/ccsid950.html. 2014-12-02.
- Web site: CCSID 1114 information document. https://web.archive.org/web/20160327100728/http://www-01.ibm.com/software/globalization/ccsid/ccsid1114.html. 2016-03-27.
- Web site: CCSID 947 information document. https://web.archive.org/web/20141201232116/http://www-01.ibm.com/software/globalization/ccsid/ccsid947.html. 2014-12-01.
- Web site: Lead byte A3: ibm-950_P110-1999 . ICU Demonstration - Converter Explorer . International Components for Unicode.
- Web site: Lead byte C6: ibm-950_P110-1999 . ICU Demonstration - Converter Explorer . International Components for Unicode.
- Web site: Lead byte C7: ibm-950_P110-1999 . ICU Demonstration - Converter Explorer . International Components for Unicode.
- Web site: Lead byte C8: ibm-950_P110-1999 . ICU Demonstration - Converter Explorer . International Components for Unicode.
- Web site: Lead byte F9: ibm-950_P110-1999 . ICU Demonstration - Converter Explorer . International Components for Unicode.
- Web site: IBM Traditional Chinese Graphic Character Set for IBM BIG-5 Code . . 1999 . C-H 3-3220-131 1999-04.
- Web site: CCSID 1370 information document. https://web.archive.org/web/20160327104212/http://www-01.ibm.com/software/globalization/ccsid/ccsid1370.html. 2016-03-27.
- Web site: CCSID 5210 information document. https://web.archive.org/web/20141129231704/http://www-01.ibm.com/software/globalization/ccsid/ccsid5210.html. 2014-11-29.
- Web site: CCSID 21427 information document. https://web.archive.org/web/20160327035914/http://www-01.ibm.com/software/globalization/ccsid/ccsid21427.html. 2016-03-27.
- Web site: https://web.archive.org/web/20160317015819/http://www-01.ibm.com/software/globalization/cp/cp01372.html . 2016-03-17 . CPGID 01372: MS T-Chinese Big-5 (Special for DB2) . dead . IBM Globalization - Code page identifiers.
- Web site: ibm-1373_P100-2002 . ICU Demonstration - Converter Explorer . International Components for Unicode.
- Web site: Lead byte A3: ibm-1373_P100-2002 . ICU Demonstration - Converter Explorer . International Components for Unicode.
- Web site: Lead byte C6: ibm-1373_P100-2002 . ICU Demonstration - Converter Explorer . International Components for Unicode.
- Web site: Lead byte C7: ibm-1373_P100-2002 . ICU Demonstration - Converter Explorer . International Components for Unicode.
- Web site: Lead byte C8: ibm-1373_P100-2002 . ICU Demonstration - Converter Explorer . International Components for Unicode.
- Web site: Lead byte F9: ibm-1373_P100-2002 . ICU Demonstration - Converter Explorer . International Components for Unicode.
- Web site: Windows Best Fit Chart: CP950. unicode.org. 13 September 2016.
- Web site: Big5. Kanji Database. 13 September 2016.
- Web site: Big5-HKSCS:2008. https://archive.today/20160913170304/http://www.ogcio.gov.hk/en/business/tech_promotion/ccli/terms/doc/hkscs-2008-big5-iso.txt. 2016-09-13. dead.
External links