In optics, a caustic or caustic network[1] is the envelope of light rays which have been reflected or refracted by a curved surface or object, or the projection of that envelope of rays on another surface.[2] The caustic is a curve or surface to which each of the light rays is tangent, defining a boundary of an envelope of rays as a curve of concentrated light.[2] In some cases caustics can be seen as patches of light or their bright edges, shapes which often have cusp singularities.
Concentration of light, especially sunlight, can burn. The word caustic, in fact, comes from the Greek καυστός, burnt, via the Latin causticus, burning.
A common situation where caustics are visible is when light shines on a drinking glass. The glass casts a shadow, but also produces a curved region of bright light. In ideal circumstances (including perfectly parallel rays, as if from a point source at infinity), a nephroid-shaped patch of light can be produced.[3] [4] Rippling caustics are commonly formed when light shines through waves on a body of water.
Another familiar caustic is the rainbow.[5] [6] Scattering of light by raindrops causes different wavelengths of light to be refracted into arcs of differing radius, producing the bow.
In computer graphics, most modern rendering systems support caustics. Some of them even support volumetric caustics. This is accomplished by raytracing the possible paths of a light beam, accounting for the refraction and reflection. Photon mapping is one implementation of this. Volumetric caustics can also be achieved by volumetric path tracing. Some computer graphic systems work by "forward ray tracing" wherein photons are modeled as coming from a light source and bouncing around the environment according to rules. Caustics are formed in the regions where sufficient photons strike a surface causing it to be brighter than the average area in the scene. “Backward ray tracing” works in the reverse manner beginning at the surface and determining if there is a direct path to the light source.[7] Some examples of 3D ray-traced caustics can be found here.
The focus of most computer graphics systems is aesthetics rather than physical accuracy. This is especially true when it comes to real-time graphics in computer games[8] where generic pre-calculated textures are mostly used instead of physically correct calculations.
Caustic engineering describes the process of solving the inverse problem to computer graphics. That is, given a specific image, to determine a surface whose refracted or reflected light forms this image.
In the discrete version of this problem, the surface is divided into several micro-surfaces which are assumed smooth, i.e. the light reflected/refracted by each micro-surface forms a Gaussian caustic. Gaussian caustic means that each micro-surface obey Gaussian distribution. The position and orientation of each of the micro-surfaces are then obtained using a combination of Poisson integration and simulated annealing.[9]
There have been many different approaches to address the continuous problem. One approach uses an idea from transportation theory called optimal transport[10] to find a mapping between incoming light rays and the target surface. After obtaining such a mapping, the surface is optimized by adapting it iteratively using Snell's law of refraction.[11] [12]
Controlling caustic pattern is rather a challenging problem as very minor changes of the surface will significantly affect the quality of the pattern since light ray directions might be interfered by other light rays as they intersect with and refract through the material. This will lead to a scattered, discontinuous pattern. To tackle this problem, optimal-transport-based is one of the existing proposed methods to control caustic pattern by redirecting light's directions as it propagates through the surface of a certain transparent material. This is done by solving an inverse optimization problem based on optimal transport.[13] [14] Given a reference image of an object/pattern, the target is to formulate the mathematical description of the material surface through which light refracts and converges to the similar pattern of the reference image. This is done by rearranging/recomputing the initial light intensity until the minimum of the optimization problem is reached.
Here considering only refractive caustic, the objective can be determined as follows (similar principle for reflective caustic with different output):
Input: image of pattern to be obtained after propagating lights through the material, given the light source position.
Output: caustic geometry on the receiver (flat solid surface, e.g.: floor, wall, etc...)
In order to achieve the target pattern, the surface where light refracts through and exits to the outer environment must be manufactured into certain shape to achieve desired pattern on the other side of the material.
As mentioned, given an input image, this process will produce the similar caustic pattern as the output. In principle, there are two core stages with each includes two sub-stages:
As the case refraction occurs through a transparent surface, for instance the patterns appearing under clear water surface, 3 main phenomena can be observed:
To perform computation, the following 3 quantities are being respectively introduced to describe the geometric characteristics of the pattern: point singularity
\Phip
\Phic
\PhiI
\PhiT
\PhiT(\Omega)=
| N\delta | |
| style\sum | |
| i=1 |
| i(\Omega) | |
| \Phi | |
| p |
+
| N\gamma | |
| \sum | |
| j=1 |
| j(\Omega) | |
| \Phi | |
| c |
+\PhiI(\Omega)\displaystyle
After this step, there are two existing measures of the radiant flux measures of the source
\PhiS
\PhiT
\muS
\PhiS
\PhiS
\PhiT
\muT
\PhiT
\PhiS
\PhiT
si\in(\PhiS\cup\PhiT)
Pw
| w | |
| C | |
| i |
si
\omega
x
\omegamin
f(\omega)=
| \sum | |
| si\inS |
(\omegai.\muS(C
| 0) | |
| i |
-
| \int\limits | |||||||
|
(\|x-
| 2 | |
| s | |
| i\| |
-\omegai)d\muT(x))
After solving optimal transport problem, the vertices are achieved. However, this gives no information about what the final surface should look like. To achieve the desired target surface given the incoming light ray
dI
dO
n=dI+{ηx\over\lVertdI+ηdT\rVert}=dI+{ηx\over\lVertdI+η{(xR-x)\over||xR-x||}\rVert}
where,
η
xR
target position obtained from solving above optimal transport problem
As the normal representation is obtained, surface refinement is then achieved by minimizing the following compound energy function:
\underset{x}{\operatorname{argmax}}\omega ⋅ [ Eint, Edir, Eflux,Ereg, Ebar]
where,
Eint=
| \sum | |
| v\inMT |
\lVertno-
| 2 | |
| n\rVert | |
| 2 |
no
n
Edir=
| \sum | |
| v\inMT |
\lVertx-
| bf{proj} | |
| (xS,dI) |
| 2 | |
| (x)\rVert | |
| 2 |
Eflux=
| \sum | |
| t\inMT |
\lVert\PhiT(t)-\PhiS(ts)\rVert
| 2 | |
| 2 |
t
Ereg=\lVert
| 2 | |
| bf{L}bf{X}\rVert | |
| 2 |
Ebar=
| \sum | |
| v\inMT |
\lVertmax(0,-log((1-nR.(x-xR))+dTH)\rVert2
dTH
Inverse graphics is a method of observing the data from an image and inferring all possible properties including 3D geometry, lighting, materials, and motion in order to generate a realistic image. In conventional computer graphics, to render an image with desired appearance and effects, it is given all the relevant properties/characteristics. This could be described as the forward method. On the contrary, in caustic design, the properties and characteristics of objects (especially the material surface) are not trivial. The given constraint is the target image to obtain. Therefore, the goal is to obtain its properties and characteristics by observing and inferring the target image. This can be considered the inverse/backward method.
The following is the basic loss function explaining how to optimize the parameters:
L(c)=\lVertf(c)-I\rVert2
where,
loss function, mean square error of the rendered image and the target
contains elements which can influence the generated image
target image
At first, the target pattern is designed and the forward pass computed to get the synthetic pattern. It's compared to the target pattern and get the loss.The objection is to let the synthetic pattern is similar to the target pattern as much as possible. And then do the back propagation to get the optimized properties need to use in caustic manufacturing.
A
V
V
C
There could be more elements, for example albedo and refraction coefficient.
Introduce U as an intermediate variable indicating 2D projected vertex coordinate positions. The gradient of these properties can be derived by chain rule indirectly.
| \partialf | |
| \partialV |
=
| \partialf | |
| \partialU |
x
| \partialU | |
| \partialV |
| \partialf | |
| \partialV |
=
| \partialf | |
| \partialA |
x
| \partialA | |
| \partialV |
| \partialf | |
| \partialC |
=
| \partialf | |
| \partialU |
x
| \partialU | |
| \partialC |
After applying the stochastic gradient descent, the optimal
A
V
C
One common approach is to utilize the ability to perform differential operations in various deep learning auto-differentiation frameworks/libraries such as: Tensorflow, PyTorch, Theano.
One more approach is to make use of the OpenDR framework to build a forward graphics model and to automatically obtain derivatives with respect to the model parameters for optimization. As optimization properties are obtained, the target image can be generated. OpenDR provides a local optimization method that can be incorporated into probabilistic programming frameworks. This can be used to solve the problem of caustic.
Once the caustic pattern has been designed computationally, the processed data will be then sent to the manufacturing stage to get the final product. The most common approach is subtractive manufacturing (machining).
Various materials can be used depending on the desired quality, the effort it takes to manufacture, and the available manufacturing method.
Caustic pattern design has many real-world applications, for example in: