Focus recovery based on the linear canonical transform explained

For digital image processing, the Focus recovery from a defocused image is an ill-posed problem since it loses the component of high frequency. Most of the methods for focus recovery are based on depth estimation theory.^[1] The Linear canonical transform (LCT) gives a scalable kernel to fit many well-known optical effects. Using LCTs to approximate an optical system for imaging and inverting this system, theoretically permits recovery of a defocused image.

Depth of field and perceptual focus

In photography, depth of field (DOF) means an effective focal length. It is usually used for stressing an object and deemphasizing the background (and/or the foreground). The important measure related to DOF is the lens aperture. Decreasing the diameter of aperture increases focus and lowers resolution and vice versa.

The Huygens–Fresnel principle and DOF

The Huygens–Fresnel principle describes diffraction of wave propagation between two fields. It belongs to Fourier optics rather than geometric optics. The disturbance of diffraction depends on two circumstance parameters, the size of aperture and the interfiled distance.

Consider a source field and a destination field, field 1 and field 0, respectively. P₁(x₁,y₁) is the position in the source field, P₀(x₀,y₀) is the position in the destination field. The Huygens–Fresnel principle gives the diffraction formula for two fields U(x₀,y₀), U(x₁,y₁) as following:

U(x _{0,y} _{0)} = (1)/(j λ) \int\int U(x _{1,y} _{1)} (e ^{jkr _{01}})/(r _{01}) \cos\theta dx _{1} dy _{1}

where θ denotes the angle between

r _{01} and z . Replace cos θ by (r _{01})/(z) and r _{01} by
[(x _{0-x} ^{2+ (y} ^{0- y} ^{2+ z} ^{1 )} ^{2]} ^{1/2}

we get

U(x _{0,y} _{0)} = (1)/(j λ z) \int\int U(x _{1,y} _{1)} (\exp(jkz[ 1+ ( (x _{0-x} _{1})/() ^{2+ ( (y _{0-y} _{1})/(z)} ) ^{2]} ^{1/2} ) z))/(1+ ( (x _{0-x} _{1})/() ^{2+ ( (y _{0-y} _{1})/(z)} ) ^{2} z)) dx _{1} dy _{1}

The further distance z or the smaller aperture (x₁,y₁) causes a greater diffraction. A larger DOF can lead to a more effective focused wave distribution. This seems to be a conflict. Here are the notations:

• Diffraction
  • In a real imaging environment, the depths of objects comparing to the aperture are usually not enough to lead to serious diffraction.
  • However, a long enough depth of the object can truly blurs the image.
• Effective Focus
  • Small aperture, small blurring radius, few wave information.
  • Loses details in comparing to a large aperture.

In conclusion, diffraction explains a micro behavior whereas DOF shows a macro behavior. Both of them are related to aperture size.

Linear canonical transform

As the meaning of "canonical", the linear canonical transform (LCT) is a scalable transform that connects to many important kernels such as the Fresnel transform, Fraunhofer transform and the fractional Fourier transform. It can be easily controlled by its four parameters, a, b, c, d (3 degrees of freedom). The definition:

L _{M(f(u))=\int} L _{M(u,u')f(u')du'}

where

L _{M(u,u')=\begin{cases}} \sqrt (1)/(b) e ^{-j\pi/4} e ^{[j\pi( (d)/(u ^{2 ) -2 (1)/(b)} uu' + (a)/(b) u' ^{2]} b)} , & if b\ne 0 \\ \sqrt{d}e ^{(j)/(cdu ^{2} 2)} \delta(u' - du) ,& if b =0 \end{cases}

Consider a general imaging system with object distance z₀, focal length of the thin lens f and an imaging distance z₁. The effect of the propagation in freespace acts as nearly a chirp convolution, that is, the formula of diffraction. Besides, the effect of the propagation in thin lens acts as a chirp multiplication. The parameters are all simplified as paraxial approximations while meeting the freespace propagation. It does not consider aperture size.

From the properties of the LCT, it is possible to obtain those 4 parameters for this optical system as:

\begin{bmatrix} 1- (z _{1})/(f) & λ z _{0- (λ z _{0} z _{1})/(f)} +λ z _{1} \\ - (1)/(λ f) & 1- (z _{0})/(f) \end{bmatrix}

Once the values of z₁, z₀ and f are known, the LCT can simulate any optical system.

References

• Book: Haldun M. Ozaktas . . M. Alper Kutay . The fractional Fourier transform with applications in optics and signal processing . . New York . 2001 . 978-0-471-96346-2 .
• M. Sorel and J. Flusser, "Space-variant restoration of images degraded by camera motion blur", IEEE Transactions on Image Processing, vol. 17, pp. 105–116, Feb. 2008.
• Web site: Jos. Schneider Optische Werke GmbH . The way a zoom lens works . February 2008 . https://web.archive.org/web/20120508065349/http://www.schneiderkreuznach.com/knowhow/zoom_e.htm . 2012-05-08 .
• B. Barshan, M. Alper Kutay and H. M. Ozaktas, "Optimal filtering with linear ca-nonical transformations", Optics Communications, vol. 135, pp. 32–36, Feb. 1997.

Notes and References

1. Most depth recovery methods are simply based on camera focus and defocus. Among those approaches, they usually fall in a depth discontinuity problem.