Computed tomography imaging spectrometer explained

The computed tomography imaging spectrometer (CTIS) is a snapshot imaging spectrometer which can produce in fine the three-dimensional (i.e. spatial and spectral) hyperspectral datacube of a scene.

History

The CTIS was conceived separately by Takayuki Okamoto and Ichirou Yamaguchi at Riken (Japan), and by F. Bulygin and G. Vishnakov in Moscow (Russia).[1] [2] [3] The concept was subsequently further developed by Michael Descour, at the time a PhD student at the University of Arizona, under the direction of Prof. Eustace Dereniak.[4]

The first research experiments based on CTIS imaging were conducted in the fields of molecular biology.[5] Several improvements of the technology have been proposed since then, in particular regarding the hardware: dispersive elements providing more information on the datacube,[6] enhanced calibration of the system.[7] The enhancement of the CTIS was also fueled by the general development of bigger image sensors.[8] For academic purposes, although not as widely used as other spectrometers, CTIS has been employed in applications ranging from the military[9] to ophthalmology[10] and astronomy.[11]

Image formation

Optical layout

The optical layout of a CTIS instrument is shown on the left part of the top image. A field stop is placed at the image plane of an objective lens, after which a lens collimates the light before it passes through a disperser (such as a grating or a prism). Finally, a re-imaging lens maps the dispersed image of the field stop onto a large-format detector array.

Resulting image

The information that the CTIS acquires can be seen as the three-dimensional datacube of the scene. Of course, this cube does not exist in physical space as mechanical objects do, but this representation helps to gain intuition on what the image is capturing: As seen in the figure on the right, the shapes on the image can be considered as projections (in a mechanical sense) of the datacube. The central projection, called the 0th order of diffraction, is the sum of the datacube following the spectral axis (hence, this projection acts as a panchromatic camera). In the image of the "5" on the right, one can clearly read the number in the central projection, but with no information regarding the spectre of the light.

All the other projections result from "looking" at the cube obliquely and hence contain a mixture of spatial and spectral information. From a discrete point of view where the datacube is considered as a set of spectral slices (as in the figure above, where two such slices are represented in purple and red), one can understand these projections as a partial spread of the stack of slices, similarly to a magician spreading his cards in order for an audience member to pick one of them. It is important to note that for typical spectral dispersions and the typical size of a sensor, the spectral information of a given slice is heavily overlapping with the one from other neighboring slices. In the "5" image, one can see in the side projections that the number is not clearly readable (loss of spatial information), but that some spectral information is available (i.e. some wavelengths appear brighter than others). Hence, the image contains multiplexed information regarding the datacube.

The number and layout of the projections depend on the type of diffracting element employed. In particular, more than one order of diffraction can be captured.[6]

Datacube reconstruction

The resulting image contains all of the information of the datacube. It is necessary to carry out a reconstruction algorithm to convert this image back in the 3D spatio-spectral space. Hence, the CTIS is a computational imaging system.

Link to X-ray computed tomography

Conceptually, one can consider each of the projections of the datacube in a manner analogous to the X-ray projections measured by medical X-ray computed tomography instruments used to estimate the volume distribution within a patient's body.

Similarities between X-ray CT and CTIS acquisitions!!X-ray CT!CTIS
Object to acquireSlice of a patient's body (2D)Spatio-spectral datacube (3D)
Penetrating waveX-rayLight from the scene
Projection generatorTransmitters rotating around an axisDispersive element
Image acquiredSinogramCTIS multiplexed image
Hence, the most widely-used algorithms for CTIS reconstruction are the same as the one used in the X-ray CT field of study. In particular, the algorithm used by Descour is directly taken from a seminal work in X-ray CT reconstruction.[12] Since then, slightly more elaborate techniques have been employed,[8] in the same way (but not to the same extent) X-ray CT reconstruction has improved since the 80s.

Difficulties

Compared to the X-ray CT field, CTIS reconstruction is notoriously more difficult. In particular, the number of projections resulting from a CTIS acquisition is typically far less than in X-ray CT. This results in a blurrier reconstruction, following the projection-slice theorem. Moreover, unlike X-ray CT where projections are acquired around the patient, the CTIS, as all imaging systems, only acquires the scene from a single point of view, and hence many projection angles are unobtainable.

External links

Notes and References

  1. Takayuki Okamoto and Ichirou Yamaguchi, "Simultaneous acquisition of spectral image information", Optics Letters 16: 1277-1279 (1991).
  2. Takayuki Okamoto, Akinori Takahashi, and Ichirou Yamaguchi, "Simultaneous acquisition of spectral and spatial intensity distribution", Applied Spectroscopy 47: 1198-1202 (1993)
  3. F. V. Bulygin and G. N. Vishnyakov, "Spectrotomography -- a new method of obtaining spectrograms of two-dimensional objects", in Analytical Methods for Optical Tomography, Proc. SPIE 1843: 315-322 (1992).
  4. Michael Robert Descour, "Non-scanning imaging spectrometry", PhD Thesis, University of Arizona (1994)
  5. Ford . Bridget K. . Volin . Curtis E. . Murphy . Sean M. . Lynch . Ronald M. . Descour . Michael R. . February 2001 . Computed Tomography-Based Spectral Imaging For Fluorescence Microscopy . Biophysical Journal . 80 . 2 . 986–993 . 10.1016/s0006-3495(01)76077-8 . 11159465 . 1301296 . 2001BpJ....80..986F . 0006-3495.
  6. Hagen . Nathan . Dereniak . Eustace L. . Sass . David T. . Sylvia S . Paul E . Shen . Lewis . 2006-08-31 . Maximizing the resolution of a CTIS instrument . SPIE Proceedings . Imaging Spectrometry XI . 6302 . 63020L . SPIE . 10.1117/12.680750. 2006SPIE.6302E..0LH . 120974275 .
  7. Wilson . Daniel W. . Maker . Paul D. . Muller . Richard E. . Michael R . Sylvia S . Descour . Shen . 1997-10-31 . <title>Reconstructions of computed-tomography imaging spectrometer image cubes using calculated system matrices</title> . SPIE Proceedings . Imaging Spectrometry III . 3118 . 184–193 . SPIE . 10.1117/12.283827. 1997SPIE.3118..184W . 136914912 .
  8. Ford . Bridget K. . Descour . Michael R. . Lynch . Ronald M. . 2001-10-22 . Large-image-format computed tomography imaging spectrometer for fluorescence microscopy . Optics Express . 9 . 9 . 444–453 . 10.1364/oe.9.000444 . 19424362 . 2001OExpr...9..444F . 1094-4087. free .
  9. Descour . Michael R. . Dereniak . Eustace L. . Dubey . Abinash C. . Abinash C . Ivan . James M . Kelly A . Dubey . Cindrich . Ralston . Rigano . 1995-06-20 . <title>Mine detection using instantaneous spectral imaging</title> . SPIE Proceedings . Detection Technologies for Mines and Minelike Targets . 2496 . 286–304 . SPIE . 10.1117/12.211325. 1995SPIE.2496..286D . 62771528 .
  10. Johnson . William R. . Wilson . Daniel W. . Fink . Wolfgang . M.d . Mark S. Humayun . Bearman . Gregory H. . January 2007 . Snapshot hyperspectral imaging in ophthalmology . Journal of Biomedical Optics . 12 . 1 . 014036 . 10.1117/1.2434950 . 17343511 . 2007JBO....12a4036J . 1083-3668. free .
  11. Hege . E. Keith . O'Connell . Dan . Johnson . William . Basty . Shridhar . Dereniak . Eustace L. . Sylvia S . Paul E . Shen . Lewis . 2004-01-07 . Hyperspectral imaging for astronomy and space surveillance . Imaging Spectrometry IX . SPIE . 5159 . 380–391 . 10.1117/12.506426. 121946613 .
  12. Shepp . L. A. . Vardi . Y. . October 1982 . Maximum Likelihood Reconstruction for Emission Tomography . IEEE Transactions on Medical Imaging . 1 . 2 . 113–122 . 10.1109/TMI.1982.4307558 . 18238264 . 0278-0062.