LMS color space explained

LMS (long, medium, short), is a color space which represents the response of the three types of cones of the human eye, named for their responsivity (sensitivity) peaks at long, medium, and short wavelengths.

The numerical range is generally not specified, except that the lower end is generally bounded by zero. It is common to use the LMS color space when performing chromatic adaptation (estimating the appearance of a sample under a different illuminant). It is also useful in the study of color blindness, when one or more cone types are defective.

Definition

The cone response functions

\bar{l}(λ),\bar{m}(λ),\bar{s}(λ)

are the color matching functions for the LMS color space. The chromaticity coordinates (L, M, S) for a spectral distribution

J(λ)

are defined as:

L=

infty
\int
0

J(λ)\bar{l}(λ)dλ

M=

infty
\int
0

J(λ)\bar{m}(λ)dλ

S=

infty
\int
0

J(λ)\bar{s}(λ)dλ

The cone response functions are normalized to have their maxima equal to unity.

XYZ to LMS

Typically, colors to be adapted chromatically will be specified in a color space other than LMS (e.g. sRGB). The chromatic adaptation matrix in the diagonal von Kries transform method, however, operates on tristimulus values in the LMS color space. Since colors in most colorspaces can be transformed to the XYZ color space, only one additional transformation matrix is required for any color space to be adapted chromatically: to transform colors from the XYZ color space to the LMS color space.

In addition, many color adaption methods, or color appearance models (CAMs), run a von Kries-style diagonal matrix transform in a slightly modified, LMS-like, space instead. They may refer to it simply as LMS, as RGB, or as ργβ. The following text uses the "RGB" naming, but do note that the resulting space has nothing to do with the additive color model called RGB.

The chromatic adaptation transform (CAT) matrices for some CAMs in terms of CIEXYZ coordinates are presented here. The matrices, in conjunction with the XYZ data defined for the standard observer, implicitly define a "cone" response for each cell type.

Notes:

Hunt, RLAB

The Hunt and RLAB color appearance models use the Hunt–Pointer–Estevez transformation matrix (MHPE) for conversion from CIE XYZ to LMS.[2] [3] [4] This is the transformation matrix which was originally used in conjunction with the von Kries transform method, and is therefore also called von Kries transformation matrix (MvonKries).

\beginL\\M\\S\end_\text=\left[\begin{array}{lll} \phantom{-}0.38971 & \phantom{-}0.68898 & -0.07868\\ -0.22981 & \phantom{-}1.18340 & \phantom{-}0.04641\\ \phantom{-}0 & \phantom{-}0 & \phantom{-}1 \end{array}\right]\beginX\\Y\\Z\end

\beginL\\M\\S\end_=\left[\begin{array}{lll} \phantom{-}0.4002 & \phantom{-}0.7076 & -0.0808 \\ -0.2263 & \phantom{-}1.1653 & \phantom{-}0.0457 \\ \phantom{-}0 & \phantom{-}0 & \phantom{-}0.9182 \end{array}\right]\beginX\\Y\\Z\end

Bradford's spectrally sharpened matrix (LLAB, CIECAM97s)

The original CIECAM97s color appearance model uses the Bradford transformation matrix (MBFD) (as does the LLAB color appearance model).[1] This is a “spectrally sharpened” transformation matrix (i.e. the L and M cone response curves are narrower and more distinct from each other). The Bradford transformation matrix was supposed to work in conjunction with a modified von Kries transform method which introduced a small non-linearity in the S (blue) channel. However, outside of CIECAM97s and LLAB this is often neglected and the Bradford transformation matrix is used in conjunction with the linear von Kries transform method, explicitly so in ICC profiles.[6] \beginR \\ G \\ B\end_\text=\left[\begin{array}{lll} \phantom{-}0.8951 & \phantom{-}0.2664 & -0.1614 \\ -0.7502 & \phantom{-}1.7135 & \phantom{-}0.0367 \\ \phantom{-}0.0389 & -0.0685 & \phantom{-}1.0296 \end{array}\right]\beginX \\ Y \\ Z\end

A "spectrally sharpened" matrix is believed to improve chromatic adaptation especially for blue colors, but does not work as a real cone-describing LMS space for later human vision processing. Although the outputs are called "LMS" in the original LLAB incarnation, CIECAM97s uses a different "RGB" name to highlight that this space does not really reflect cone cells; hence the different names here.

LLAB proceeds by taking the post-adaptation XYZ values and performing a CIELAB-like treatment to get the visual correlates. On the other hand, CIECAM97s takes the post-adaptation XYZ value back into the Hunt LMS space, and works from there to model the vision system's calculation of color properties.

Later CIECAMs

A revised version of CIECAM97s switches back to a linear transform method and introduces a corresponding transformation matrix (MCAT97s):[7] \beginR\\G\\B\end_\text=\left[\begin{array}{lll} \phantom{-}0.8562 & \phantom{-}0.3372 & -0.1934 \\ -0.8360 & \phantom{-}1.8327 & \phantom{-}0.0033 \\ \phantom{-}0.0357 & -0.0469 & \phantom{-}1.0112 \end{array}\right]\beginX\\Y\\Z\end

The sharpened transformation matrix in CIECAM02 (MCAT02) is:[8] [1] \beginR\\G\\B\end_\text=\left[\begin{array}{lll} \phantom{-}0.7328 & \phantom{-}0.4296 & -0.1624\\ -0.7036 & \phantom{-}1.6975 & \phantom{-}0.0061\\ \phantom{-}0.0030 & \phantom{-}0.0136 & \phantom{-}0.9834 \end{array}\right]\beginX\\Y\\Z\end

CAM16 uses a different matrix:[9] \beginR\\G\\B\end_\text=\left[\begin{array}{lll} \phantom{-}0.401288 & \phantom{-}0.650173 & -0.051461 \\ -0.250268 & \phantom{-}1.204414 & \phantom{-}0.045854 \\ -0.002079 & \phantom{-}0.048952 & \phantom{-}0.953127 \end{array}\right]\beginX\\Y\\Z\end

As in CIECAM97s, after adaptation, the colors are converted to the traditional Hunt–Pointer–Estévez LMS for final prediction of visual results.

physiological CMFs

From a physiological point of view, the LMS color space describes a more fundamental level of human visual response, so it makes more sense to define the physiopsychological XYZ by LMS, rather than the other way around.

A set of physiologically-based LMS functions were proposed by Stockman & Sharpe in 2000. The functions have been published in a technical report by the CIE in 2006 (CIE 170).[10] [11] The functions are derived from Stiles and Burch RGB CMF data, combined with newer measurements about the contribution of each cone in the RGB functions. To adjust from the 10° data to 2°, assumptions about photopigment density difference and data about the absorption of light by pigment in the lens and the macula lutea are used.[12]

The Stockman & Sharpe functions can then be turned into a set of three color-matching functions similar to the CIE 1931 functions.[13]

Let

l{P}i(λ)=(\bar{l}(λ),\bar{m}(λ),\bar{s}(λ))

be the three cone response functions, and let

l{Q}i(λ)=(\bar{x}F(λ),\bar{y}F(λ),\bar{z}F(λ))

be the new XYZ color matching functions. Then, by definition, the new XYZ color matching functions are:

l{Q}i(λ)=\sum

3
j=1

Tijl{P}j(λ)

where the transformation matrix

Tij

is defined as:T_=\left[\,\begin{array}{lll} 1.94735469 & -1.41445123 & \phantom{-}0.36476327 \\ 0.68990272 & \phantom{-}0.34832189 & \phantom{-}0 \\ 0 & \phantom{-}0 & \phantom{-}1.93485343 \end{array}\right]

For any spectral distribution

J(λ)

, let

Pi=(L,M,S)

be the LMS chromaticity coordinates for

J(λ)

, and let

Qi=(X,Y,Z)F

be the corresponding new XYZ chromaticity coordinates. Then:

Qi=

infty
\int
0

J(λ)l{Q}i(λ)dλ=

infty
\int
0

J(λ)

3
\sum
j=1

Tijl{P}j(λ)dλ=

3
\sum
j=1

TijPj

or, explicitly:\beginX \\ Y \\ Z\end_=\left[\,\begin{array}{lll} 1.94735469 & -1.41445123 & \phantom{-}0.36476327 \\ 0.68990272 & \phantom{-}0.34832189 & \phantom{-}0 \\ 0 & \phantom{-}0 & \phantom{-}1.93485343 \end{array}\right]\beginL\\M\\S\end

The inverse matrix is shown here for comparison with the ones for traditional XYZ:\beginL\\M\\S\end=\left[\begin{array}{lll} \phantom{-}0.210576 & \phantom{-}0.855098 & -0.0396983 \\ -0.417076 & \phantom{-}1.177260 & \phantom{-}0.0786283 \\ \phantom{-}0 & \phantom{-}0 & \phantom{-}0.5168350 \\ \end{array}\right]\beginX\\Y\\Z\end_

The above development has the advantage of basing the new XFYFZF color matching functions on the physiologically-based LMS cone response functions. In addition, it offers a one-to-one relationship between the LMS chromaticity coordinates and the new XFYFZF chromaticity coordinates, which was not the case for the CIE 1931 color matching functions. The transformation for a particular color between LMS and the CIE 1931 XYZ space is not unique. It rather depends highly on the particular form of the spectral distribution

J(λ)

) producing the given color. There is no fixed 3x3 matrix which will transform between the CIE 1931 XYZ coordinates and the LMS coordinates, even for a particular color, much less the entire gamut of colors. Any such transformation will be an approximation at best, generally requiring certain assumptions about the spectral distributions producing the color. For example, if the spectral distributions are constrained to be the result of mixing three monochromatic sources, (as was done in the measurement of the CIE 1931 and the Stiles and Burch color matching functions), then there will be a one-to-one relationship between the LMS and CIE 1931 XYZ coordinates of a particular color.

As of Nov 28, 2023, CIE 170-2 CMFs are proposals that have yet to be ratified by the full TC 1-36 committee or by the CIE.

Quantal CMF

For theoretical purposes, it is often convenient to characterize radiation in terms of photons rather than energy. The energy E of a photon is given by the Planck relation

E=h\nu=hc/λ

where E is the energy per photon, h is the Planck constant, c is the speed of light, ν is the frequency of the radiation and λ is the wavelength. A spectral radiative quantity in terms of energy, JE(λ), is converted to its quantal form JQ(λ) by dividing by the energy per photon:

JQ(λ)=JE(λ)(λ/hc)

For example, if JE(λ) is spectral radiance with the unit W/m2/sr/m, then the quantal equivalent JQ(λ) characterizes that radiation with the unit photons/s/m2/sr/m.

If CEλi(λ) (i=1,2,3) are the three energy-based color matching functions for a particular color space (LMS color space for the purposes of this article), then the tristimulus values may be expressed in terms of the quantal radiative quantity by:

CEi=

infty
\int
0

JE(λ)CEλ(λ)dλ =

infty
\int
0

JQ(λ)(hc/λ)CEλ(λ)dλ

Define the quantal color matching functions:

CQλ(λ)=(CEλ(λ)/λ)/(CEλ(λimax)/λimax)

where λi max is the wavelength at which CEλ i(λ)/λ is maximized. Define the quantal tristimulus values:

CQi=

infty
\int
0

JQ(λ)CQλ(λ)dλ

Note that, as with the energy based functions, the peak value of CQλi(λ) will be equal to unity. Using the above equation for the energy tristimulus values CEi

CEi=(hc/λimax)CEλ(λimax)CQi

For the LMS color space,

λimax

≈ nm and

CEi/CQi=\{3.49694,3.1253,0.144944\} x 10-19

J/photon

Applications

Color blindness

The LMS color space can be used to emulate the way color-blind people see color. An early emulation of dichromats were produced by Brettel et al. 1997 and was rated favorably by actual patients. An example of a state-of-the-art method is Machado et al. 2009.[14]

A related application is making color filters for color-blind people to more easily notice differences in color, a process known as daltonization.[15]

Image processing

JPEG XL uses an XYB color space derived from LMS. Its transform matrix is shown here:\beginX\\Y\\B\end=\begin1 & -1 & \phantom0 \\1 & \phantom1 & \phantom0 \\0 & \phantom0 & \phantom1\end\beginL\\M\\S\end

This can be interpreted as a hybrid color theory where L and M are opponents but S is handled in a trichromatic way, justified by the lower spatial density of S cones. In practical terms, this allows for using less data for storing blue signals without losing much perceived quality.[16]

The colorspace originates from Guetzli's butteraugli metric,[17] and was passed down to JPEG XL via Google's Pik project.

See also

Notes and References

  1. Book: Fairchild, Mark D.. Color Appearance Models. Wiley Interscience. 978-0-470-01216-1. 2005. 2E. 182–183, 227–230.
  2. Book: 2007-07-27. Schanda. Jnos. Colorimetry. en. 305. 10.1002/9780470175637. 9780470175637.
  3. The CIECAM02 Color Appearance Model. IS&T/SID Tenth Color Imaging Conference. Moroney. Nathan. Fairchild, Mark D.. Hunt, Robert W.G.. Li, Changjun. Luo, M. Ronnier. Newman, Todd. Scottsdale, Arizona. 0-89208-241-0. November 12, 2002. The Society for Imaging Science and Technology.
  4. Ebner. Fritz. 1998-07-01. Derivation and modelling hue uniformity and development of the IPT color space. Theses. 129.
  5. Web site: Welcome to Bruce Lindbloom's Web Site . brucelindbloom.com . 23 March 2020.
  6. https://www.color.org/specification/ICC1v43_2010-12.pdf Specification ICC.1:2010 (Profile version 4.3.0.0)
  7. Color Research & Application. A Revision of CIECAM97s for Practical Applications. Mark D.. Fairchild. Wiley Interscience. 26. 2001. 6. 418–427. 10.1002/col.1061.
  8. Web site: Errata for COLOR APPEARANCE MODELS. Fairchild. Mark. The published MCAT02 matrix in Eq. 9.40 is incorrect (it is a version of the HuntPointer-Estevez matrix. The correct MCAT02 matrix is as follows. It is also given correctly in Eq. 16.2).
  9. 10.1002/col.22131. Comprehensive color solutions: CAM16, CAT16, and CAM16-UCS. 2017. Li. Changjun. Li. Zhiqiang. Wang. Zhifeng. Xu. Yang. Luo. Ming Ronnier. Cui. Guihua. Melgosa. Manuel. Brill. Michael H.. Pointer. Michael. Color Research & Application. 42. 6. 703–718.
  10. Web site: CIE 2006 "physiologically-relevant" LMS functions (2-deg LMS fundamentals based on the Stiles and Burch 10-deg CMFs adjusted to 2-deg). Color & Vision Research Laboratory/ . Institute of Ophthalmology . 27 October 2023 .
  11. Stockman . Andrew. December 2019 . Cone fundamentals and CIE standards . Current Opinion in Behavioral Sciences . 30 . 87–93 . 27 October 2023.
  12. Web site: Photopigments. Color & Vision Research Laboratory/ . Institute of Ophthalmology . 27 November 2023 .
  13. Web site: CIE 2-deg CMFs . cvrl.ucl.ac.uk.
  14. Web site: Color Vision Deficiency Emulation . colorspace.r-forge.r-project.org . en.
  15. Simon-Liedtke . Joschua Thomas . Farup . Ivar . Evaluating color vision deficiency daltonization methods using a behavioral visual-search method . Journal of Visual Communication and Image Representation . February 2016 . 35 . 236–247 . 10.1016/j.jvcir.2015.12.014. 11250/2461824 . free .
  16. Book: Alakuijala . Jyrki . van Asseldonk . Ruud . Boukortt . Sami . Szabadka . Zoltan . Bruse . Martin . Comsa . Iulia-Maria . Firsching . Moritz . Fischbacher . Thomas . Kliuchnikov . Evgenii . Gomez . Sebastian . Obryk . Robert . Potempa . Krzysztof . Rhatushnyak . Alexander . Sneyers . Jon . Szabadka . Zoltan . Vandervenne . Lode . Versari . Luca . Wassenberg . Jan . Applications of Digital Image Processing XLII . JPEG XL next-generation image compression architecture and coding tools . Andrew G . Tescher . Touradj . Ebrahimi . 6 September 2019 . 11137 . 20 . 10.1117/12.2529237 . 2019SPIE11137E..0KA . 9781510629677 . free .
  17. Web site: butteraugli/butteraugli.h at master · google/butteraugli. 2021-08-02. GitHub. en.