Smoothstep Explained

Smoothstep is a family of sigmoid-like interpolation and clamping functions commonly used in computer graphics,^{[1] [2]} video game engines,^[3] and machine learning.^[4]

The function depends on three parameters, the input x, the "left edge" and the "right edge", with the left edge being assumed smaller than the right edge. The function receives a real number x as an argument and returns 0 if x is less than or equal to the left edge, 1 if x is greater than or equal to the right edge, and smoothly interpolates, using a Hermite polynomial, between 0 and 1 otherwise. The gradient of the smoothstep function is zero at both edges. This is convenient for creating a sequence of transitions using smoothstep to interpolate each segment as an alternative to using more sophisticated or expensive interpolation techniques.

In HLSL and GLSL, smoothstep implements the

\operatorname{S} _{1(x)} , the cubic Hermite interpolation after clamping:\operatorname{smoothstep}(x) = S _{1(x)} = \begin{cases} 0 , & x \le 0 \\ 3 x ^{2} - 2 x ^{3,} & 0 \le x \le 1 \\ 1 , & 1 \le x \\ \end{cases}

Assuming that the left edge is 0, the right edge is 1, with the transition between edges taking place where 0 ≤ x ≤ 1.

A modified C/C++ example implementation provided by AMD^[5] follows.

float smoothstep (float edge0, float edge1, float x)

float clamp(float x, float lowerlimit = 0.0f, float upperlimit = 1.0f) The general form for smoothstep, again assuming the left edge is 0 and right edge is 1, is

\operatorname{S} _{n(x)} = \begin{cases} 0 , & if x \le 0 \\ x ^{n+1} \sum ^{n} _{k =0} \binom{n + k}{k} \binom{ 2 n +1 }{n - k} ( - x) ^{k,} & if 0 \le x \le 1 \\ 1 , & if 1 \le x \\ \end{cases} \operatorname{S} _{0(x)} is identical to the clamping function:\operatorname{S} _{0(x)} = \begin{cases} 0 , & if x \le 0 \\ x, & if 0 \le x \le 1 \\ 1 , & if 1 \le x \\ \end{cases}

The characteristic S-shaped sigmoid curve is obtained with

\operatorname{S} _{n(x)} only for integers n ≥ 1. The order of the polynomial in the general smoothstep is 2n + 1. With n = 1, the slopes or first derivatives of the smoothstep are equal to zero at the left and right edge (x = 0 and x = 1), where the curve is appended to the constant or saturated levels. With higher integer n, the second and higher derivatives are zero at the edges, making the polynomial functions as flat as possible and the splice to the limit values of 0 or 1 more seamless.

Variations

Ken Perlin suggested^[6] an improved version of the commonly used first-order smoothstep function, equivalent to the second order of its general form. It has zero 1st- and 2nd-order derivatives at x = 0 and x = 1:

\operatorname{smootherstep}(x) = S _{2(x)} = \begin{cases} 0 , & x \le 0 \\ 6 x ^{5} - 15 x ^{4} + 10 x ^{3,} & 0 \le x \le 1 \\ 1 , & 1 \le x \\ \end{cases}

C/C++ reference implementation:float smootherstep(float edge0, float edge1, float x)

float clamp(float x, float lowerlimit = 0.0f, float upperlimit = 1.0f)

Origin

3rd-order equation

Starting with a generic third-order polynomial function and its first derivative:

\begin{alignat}{ 9 } \operatorname{S} _{1(x)} && = && a _{3} x ^{3} && + && a _{2} x ^{2} && + && a _{1} x && + && a _{0,} & \\ \operatorname{S} _{1'(x)} && = && 3 a _{3} x ^{2} && + && 2 a _{2} x && + && a _{1.} & \end{alignat}

Applying the desired values for the function at both endpoints:

\begin{alignat}{ 13 } \operatorname{S} _{1(0)} && = && 0 && ⇒ && 0 && + && 0 && + && 0 && + && a _{0} && = && 0 , & \\ \operatorname{S} _{1(1)} && = && 1 && ⇒ && a _{3} && + && a _{2} && + && a _{1} && + && a _{0} && = && 1 . & \end{alignat}

Applying the desired values for the first derivative of the function at both endpoints:

\begin{alignat}{ 11 } \operatorname{S} _{1'(0)} && = && 0 && ⇒ && 0 && + && 0 && + && a _{1} && = && 0 , & \\ \operatorname{S} _{1'(1)} && = && 0 && ⇒ && 3 a _{3} && + && 2 a _{2} && + && a _{1} && = && 0 . & \end{alignat}

Solving the system of 4 unknowns formed by the last 4 equations result in the values of the polynomial coefficients:

a _{0} = 0 , a _{1} = 0 , a _{2} = 3 , a _{3} = -2 .

This results in the third-order "smoothstep" function:

\operatorname{S} _{1(x)} = -2 x ^{3} + 3 x ^{2.}

5th-order equation

Starting with a generic fifth-order polynomial function, its first derivative and its second derivative:

\begin{alignat}{ 13 } \operatorname{S} _{2(x)} && = && a _{5} x ^{5} && + && a _{4} x ^{4} && + && a _{3} x ^{3} && + && a _{2} x ^{2} && + && a _{1} x && + && a _{0,} & \\ \operatorname{S} _{2'(x)} && = && 5 a _{5} x ^{4} && + && 4 a _{4} x ^{3} && + && 3 a _{3} x ^{2} && + && 2 a _{2} x && + && a _{1,} & \\ \operatorname{S} _{2''(x)} && = && 20 a _{5} x ^{3} && + && 12 a _{4} x ^{2} && + && 6 a _{3} x && + && 2 a _{2.} & \end{alignat}

Applying the desired values for the function at both endpoints:

\begin{alignat}{ 17 } \operatorname{S} _{2(0)} && = && 0 && ⇒ && 0 && + && 0 && + && 0 && + && 0 && + && 0 && + && a _{0} && = && 0 , & \\ \operatorname{S} _{2(1)} && = && 1 && ⇒ && a _{5} && + && a _{4} && + && a _{3} && + && a _{2} && + && a _{1} && + && a _{0} && = && 1 . & \end{alignat}

Applying the desired values for the first derivative of the function at both endpoints:

\begin{alignat}{ 15 } \operatorname{S} _{2'(0)} && = && 0 && ⇒ && 0 && + && 0 && + && 0 && + && 0 && + && a _{1} && = && 0 , & \\ \operatorname{S} _{2'(1)} && = && 0 && ⇒ && 5 a _{5} && + && 4 a _{4} && + && 3 a _{3} && + && 2 a _{2} && + && a _{1} && = && 0 . & \end{alignat}

Applying the desired values for the second derivative of the function at both endpoints:

\begin{alignat}{ 15 } \operatorname{S} _{2''(0)} && = && 0 && ⇒ && 0 && + && 0 && + && 0 && + && 2 a _{2} && = && 0 , & \\ \operatorname{S} _{2''(1)} && = && 0 && ⇒ && 20 a _{5} && + && 12 a _{4} && + && 6 a _{3} && + && 2 a _{2} && = && 0 . & \end{alignat}

Solving the system of 6 unknowns formed by the last 6 equations result in the values of the polynomial coefficients:

a _{0} = 0 , a _{1} = 0 , a _{2} = 0 , a _{3} = 10 , a _{4} = -15 , a _{5} = 6 .

This results in the fifth-order "smootherstep" function:

\operatorname{S} _{2(x)} = 6 x ^{5} - 15 x ^{4} + 10 x ^{3.}

7th-order equation

Applying similar techniques, the 7th-order equation is found to be:

\operatorname{S} _{3(x)} = -20 x ^{7} + 70 x ^{6} - 84 x ^{5} + 35 x ^{4.}

Generalization to higher-order equations

Smoothstep polynomials are generalized, with 0 ≤ x ≤ 1 as

\begin{align} \operatorname{S} _{N(x)} & = x ^{N+1} \sum ^{N} _{n =0} \binom{N + n}{n} \binom{ 2 N +1 }{N - n} ( - x) ^{n} N \in N \\ & = \sum ^{N} _{n =0} ( -1 ) ^{n} \binom{N + n}{n} \binom{ 2 N +1 }{N - n} x ^{N+n+1} \\ & = \sum ^{N} _{n =0} \binom{ - N -1 }{n} \binom{ 2 N +1 }{N - n} x ^{N+n+1} , \\ \end{align}

where N determines the order of the resulting polynomial function, which is 2N + 1. The first seven smoothstep polynomials, with 0 ≤ x ≤ 1, are

\begin{align} \operatorname{S} _{0(x)} & = x, \\ \operatorname{S} _{1(x)} & = -2 x ^{3} + 3 x ^{2,} \\ \operatorname{S} _{2(x)} & = 6 x ^{5} - 15 x ^{4} + 10 x ^{3,} \\ \operatorname{S} _{3(x)} & = -20 x ^{7} + 70 x ^{6} - 84 x ^{5} + 35 x ^{4,} \\ \operatorname{S} _{4(x)} & = 70 x ^{9} - 315 x ^{8} + 540 x ^{7} - 420 x ^{6} + 126 x ^{5,} \\ \operatorname{S} _{5(x)} & = -252 x ^{11} + 1386 x ^{10} - 3080 x ^{9} + 3465 x ^{8} - 1980 x ^{7} + 462 x ^{6,} \\ \operatorname{S} _{6(x)} & = 924 x ^{13} - 6006 x ^{12} + 16380 x ^{11} - 24024 x ^{10} + 20020 x ^{9} - 9009 x ^{8} + 1716 x ^{7.} \\ \end{align}

The differential of

\operatorname{S} _{N(x)} is\begin{align} \operatorname{d \over dx}{S} _{N(x)} & = ( 2 N +1 )\binom{ 2 N}{N} (x - x ^{2)} ^{N.} \\ \end{align}

It can be shown that the smoothstep polynomials

\operatorname{S} _{N(x)} that transition from 0 to 1 when x transitions from 0 to 1 can be simply mapped to odd-symmetry polynomials\operatorname{R} _{N(x)} = \left(\int ^{1} _{0} ( 1 - u ^{2} ) ^{N} du \right) ^{-1} \int ^{x} _{0} ( 1 - u ^{2} ) ^{N} du,

where

\operatorname{S} _{N(x)} = \tfrac 12 \operatorname{R} _{N(2x-1)} + \tfrac 12 and\operatorname{R} _{N(-x)} = - \operatorname{R} _{N(x).}

The argument of R_N(x) is −1 ≤ x ≤ 1 and is appended to the constant −1 on the left and +1 at the right.

An implementation of

\operatorname{S} _{N(x)} in Javascript:^[7]

// Generalized smoothstepfunction generalSmoothStep(N, x)

// Returns binomial coefficient without explicit use of factorials,// which can't be used with negative integersfunction pascalTriangle(a, b)

function clamp(x, lowerlimit, upperlimit)

Inverse Smoothstep

The inverse of smoothstep can be useful when doing certain operations in computer graphics when its effect needs to be reversed or compensated for. In the case of the 3rd-order equation there exists an analytical solution for the inverse, which is:

\operatorname{InvS} _{1(x)} = 1 / 2 - \sin(\operatorname{asin}( 1-2 x)/ 3 )

This arises as the inverse of

\operatorname{f}(x) = 1 / 2 - \sin( 3 \operatorname{asin}( 0 . 5- x))/ 2 , whose Maclaurin series terminates at 3 x ^{2-2x} ^{3= S} ^{1 (x)} , meaning \operatorname{f} and \operatorname{S} _{1} express the same function. The series expansion of the inverse, on the other hand, does not terminate.

In GLSL:float inverse_smoothstep(float x)

External links

• Using smoothstep (in the RenderMan Shading Language) by Prof. Malcolm Kesson.
• Interpolation tricks by Jari Komppa
• Swift Interpolation Playground demonstrates smoothStep, smootherStep and smoothestStep in a Swift playground by Simon Gladman
• Inverse smoothstep by Inigo Quilez

Notes and References

1. http://msdn.microsoft.com/en-us/library/bb509658(VS.85).aspx Smoothstep at Microsoft Developer Network
2. http://www.opengl.org/registry/doc/GLSLangSpec.Full.1.40.05.pdf GLSL Language Specification, Version 1.40
3. http://unity3d.com/support/documentation/ScriptReference/Mathf.SmoothStep.html Unity game engine SmoothStep documentation
4. The Tree Ensemble Layer: Differentiability meets Conditional Computation . Hazimeh . Hussein . Ponomareva . Natalia . Mol . Petros . Tan . Zhenyu . Mazumder . Rahul . 2020 . PMLR . International Conference on Machine Learning.
5. Web site: Advanced Real-Time Shader Techniques. 94. Natalya Tatarchuk. AMD. 2003. https://web.archive.org/web/20210530183247/https://developer.amd.com/wordpress/media/2012/10/Tatarchuk-Siggraph2003.pps . 2022-04-16. 2021-05-30 .
6. https://www.amazon.com/Texturing-Modeling-Third-Procedural-Approach/dp/1558608486 Texturing and Modeling, Third Edition: A Procedural Approach
7. https://stackoverflow.com/q/41195063 General smoothstep equation