Gettext Explained

gettext
Author:Sun Microsystems[1]
Developer:various
Released:[2]
Operating System:Cross-platform
Genre:Internationalization and localization
License:Various free software licenses
Repo:various based on OpenSolaris and GNU gettext

In computing, gettext is an internationalization and localization (i18n and l10n) system commonly used for writing multilingual programs on Unix-like computer operating systems. One of the main benefits of gettext is that it separates programming from translating.[3] The most commonly used implementation of gettext is GNU gettext,[4] released by the GNU Project in 1995. The runtime library is libintl. gettext provides an option to use different strings for any number of plural forms of nouns, but this feature has no support for grammatical gender. The main filename extensions used by this system are .POT (Portable Object Template), .PO (Portable Object) and .MO (Machine Object).

History

Initially, POSIX provided no means of localizing messages. Two proposals were raised in the late 1980s, the 1988 Uniforum gettext and the 1989 X/Open catgets (XPG-3 § 5). Sun Microsystems implemented the first gettext in 1993. The Unix and POSIX developers never really agreed on what kind of interface to use (the other option is the X/Open catgets), so many C libraries, including glibc, implemented both.[5], whether gettext should be part of POSIX was still a point of debate in the Austin Group, despite the fact that its old foe has already fallen out of use. Concerns cited included its dependence on the system-set locale (a global variable subject to multithreading problems) and its support for newer C-language extensions involving wide strings.[6]

The GNU Project decided that the message-as-key approach of gettext is simpler and more friendly. (Most other systems, including catgets, requires the developer to come up with "key" names for every string.)[7] They released GNU gettext, a free software implementation of the system in 1995. Gettext, GNU or not, has since been ported to many programming languages.[8] The simplicity of po and widespread editor support even lead to its adoption in non-program contexts for text documents or as an intermediate between other localization formats, with converters like po4a (po for anything) and Translate Toolkit emerging to provide such a bridge.[9] [10]

Operation

Programming

The basic interface of gettext is the function, which accepts a string that the user will see in the original language, usually English. To save typing time and reduce code clutter, this function is commonly aliased to _:[11]

printf(gettext("My name is %s.\n"), my_name);printf(_("My name is %s.\n"), my_name); // same, but shorter

gettext then uses the supplied strings as keys for looking up translations, and will return the original string when no translation is available. This is in contrast to POSIX catgets,[12] AmigaOS GetString,[13] or Microsoft Windows LoadString where a programmatic ID (often an integer) is used. To handle the case where the same original-language text can have different meanings, gettext has functions like cgettext that accept an additional "context" string.

xgettext is run on the sources to produce a .pot (Portable Object Template) file, which contains a list of all the translatable strings extracted from the sources. Comments starting with /// are used to give translators hints, although other prefixes are also configurable to further limit the scope. One such common prefix is TRANSLATORS:.

For example, an input file with a comment might look like:

/// TRANSLATORS: %s contains the user's name as specified in Preferencesprintf(_("My name is %s.\n"), my_name);

xgettext is run using the command:

xgettext -c /

The resultant .pot file looks like this with the comment (note that xgettext recognizes the string as a C-language printf format string):

  1. . TRANSLATORS: %s contains the user's name as specified in Preferences
  2. , c-format

src/name.c:36msgid "My name is %s.\n"msgstr ""

In POSIX shell script, gettext provides a gettext.sh library one can include that provides the many same functions gettext provides in similar languages.[14] GNU bash also has a simplified construct $"msgid" for the simple gettext function, although it depends on the C library to provide a gettext function.[15]

Translating

The translator derives a .po (Portable Object) file from the template using the msginit program, then fills out the translations.[16] msginit initializes the translations so, for instance, for a French language translation, the command to run would be:[17]

msginit --locale=fr --input=name.pot

This will create fr.po. The translator then edits the resultant file, either by hand or with a translation tool like Poedit, or Emacs with its editing mode for .po files. An edited entry will look like:

src/name.c:36msgid "My name is %s.\n"msgstr "Je m'appelle %s.\n"

Finally, the .po files are compiled with msgfmt into binary .mo (Machine Object) files. GNU gettext may use its own file name extension .gmo on systems with another gettext implementation.[18] These are now ready for distribution with the software package.

GNU msgfmt can also perform some checks relevant to the format string used by the programming language. It also allows for outputting to language-specific formats other than MO;[19] the X/Open equivalent is gencat.

In later phases of the developmental workflow, msgmerge can be used to "update" an old translation to a newer template. There is also msgunfmt for reverse-compiling .mo files, and many other utilities for batch processing.

Running

The user, on Unix-type systems, sets the environment variable LC_MESSAGES, and the program will display strings in the selected language, if there is an .mo file for it.

Users on GNU variants can also use the environment variable LANGUAGE instead. Its main difference from the Unix variable is that it supports multiple languages, separated with a colon, for fallback.[20]

Plural form

The ngettext interface accounts for the count of a noun in the string. As with the convention of gettext, it is often aliased to N_ in practical use. Consider the code sample:

// parameters: english singular, english plural, integer countprintf(ngettext("%d translated message", "%d translated messages", n), n);

A header in the "" (empty string) entry of the PO file stores some metadata, one of which is the plural form that the language uses, usually specified using a C-style ternary operator. Suppose we want to translate for the Slovene language:msgid ""msgstr """...""Language: sl\n""Plural-Forms: nplurals=4; plural=(n%100

1 ? 1 : n%100

2 ? 2 : n%100

3 || n%100

4 ? 3 : 0);\n"

Since now there are four plural forms, the final po would look like:

src/msgfmt.c:876

  1. , c-format

msgid "%d translated message"msgid_plural "%d translated messages"msgstr[0] "%d prevedenih sporočil"msgstr[1] "%d prevedeno sporočilo"msgstr[2] "%d prevedeni sporočili"msgstr[3] "%d prevedena sporočila"

Reference plural rules for languages are provided by the Unicode consortium.[21] msginit also prefills the appropriate rule when creating a file for one specific language.[16]

Implementations

In addition to C, gettext has the following implementations: C# for both ASP.NET[22] [23] and for WPF,[24] Perl,[25] PHP,[26] Python,[27] R,[28] Scala,[29] and Node.js.[30]

GNU gettext has native support for Objective-C, but there is no support for the Swift programming language yet. A commonly used gettext implementation on these Cocoa platforms is POLocalizedString.[31] The Microsoft Outlook for iOS team also provides a LocalizedStringsKit library with a gettext-like API.[32]

See also

Notes and References

  1. Web site: About gettext . gnu.org . 2024-05-09.
  2. Web site: History of gettext et al? - comp.unix.solaris . https://web.archive.org/web/20120323032211/http://compgroups.net/comp.unix.solaris/History-of-gettext-et-al . usurped . 23 March 2012 . Compgroups.net . 2016-04-03.
  3. Web site: Bridging the Digital Divide in South Africa Linux Journal. Martindale. Linda. 2002-11-01. linuxjournal.com. Linux Journal. live. https://archive.today/20190917015344/https://www.linuxjournal.com/article/5966. 17 September 2019. 2019-09-17.
  4. Web site: Introduction to Internationalization Programming Linux Journal. Tykhomyrov. Olexiy Ye. 2002-11-01. linuxjournal.com. Linux Journal. live. https://archive.today/20190917020307/https://www.linuxjournal.com/article/6176. 17 September 2019. 2019-09-17.
  5. Web site: Message Translation . The GNU C Library.
  6. Web site: 0001122: POSIX should include gettext and friends - Austin Group Defect Tracker . Austin Group Defect Tracker.
  7. Web site: The Programmer's View . gettext 0.10.35. 30 April 1998.
  8. Web site: GNU gettext utilities: List of Programming Languages .
  9. Web site: po4a . po4a.org.
  10. Web site: The essential toolkit for localization engineers . Translate Toolkit.
  11. Web site: GNU gettext utilities: How Marks Appear in Sources . live . https://web.archive.org/web/20240325095308/https://www.gnu.org/software/gettext/manual/gettext.html#How-Marks-Appear-in-Sources . 2024-03-25 . 2024-04-03 . www.gnu.org.
  12. Web site: About catgets . gnu.org . 2017-10-24.
  13. Web site: AmigaOS Manual: Python Modules and Packages - AmigaOS Documentation Wiki . 2023-07-09 . wiki.amigaos.net.
  14. Web site: GNU gettext utilities: sh .
  15. Web site: GNU gettext utilities: bash .
  16. Web site: GNU gettext utilities: PO Files . Gnu.org . 2016-04-03.
  17. Web site: How to Translate With GetText PO and POT Files . Icanlocalize.com . 2016-04-03.
  18. Web site: Files Conveying Translations. Gnu.org . 2014-04-22.
  19. Web site: msgfmt Invocation . GNU gettext utilities.
  20. Web site: GNU gettext utilities: Locale Environment Variables . Gnu.org . 2016-04-03.
  21. Web site: Language Plural Rules . unicode.org.
  22. Web site: Google Code Archive - Long-term storage for Google Code Project Hosting . Code.google.com . 2016-04-03.
  23. Web site: turquoiseowl/i18n: Smart internationalization for ASP.NET . GitHub.com . 2016-04-03.
  24. Web site: NGettext.Wpf - Proper internationalization support for WPF (via NGettext). GitHub. 16 August 2019.
  25. Web site: libintl-perl - An Internationalization Library for Perl That Aims To Be Compatible With the Uniforum Message Translations System as Implemented For Example in GNU Gettext . github.com . 2017-09-14.
  26. Web site: Gettext . php.net . 2017-10-24.
  27. Web site: gettext – Multilingual internationalization services – Python 3.7.0 documentation. docs.python.org. 2018-09-21.
  28. Web site: gettext: Translate Text Messages. 2021-11-13. rdrr.io. en.
  29. Web site: makkarpov/scalingua: A simple gettext-like internationalization library for Scala. github.com. 2016-04-28.
  30. Web site: DanielBaulig/node-gettext: An adaption of Joshua I. Miller's Javascript Gettext library for node.js . GitHub.com . 2016-04-03.
  31. Web site: hulab/POLocalizedString: gettext for iOS/OS X/watchOS/tvOS . GitHub . hulab . 19 September 2019.
  32. Web site: microsoft/LocalizedStringKit: Generate .strings files directly from your code . GitHub . Microsoft . 12 February 2020.