Dynamic texture explained

Dynamic texture (sometimes referred to as temporal texture) is the texture with motion which can be found in videos of sea-waves, fire, smoke, wavy trees, etc.^{[1] [2]} Dynamic texture has a spatially repetitive pattern with time-varying visual pattern. Modeling and analyzing dynamic texture is a topic of images processing and pattern recognition in computer vision.

Extracting features that describe the dynamic texture can be utilized for tasks of images sequences classification, segmentation, recognition and retrieval. Comparing with texture found within static images, analyzing dynamic texture is a challenging problem. It is important that the extracted features from dynamic texture combine motion and appearance description, and also be invariance to some transformation such as rotation, translation and illumination.

Analysis methods of dynamic texture

The methods of dynamic texture recognition can categorized as follows:

1. Methods based on optical flow: by applying optical flow to the dynamic texture, velocity with direction and magnitude can be detected and used to recognize the dynamic texture. Due to simplicity of its computation, it is currently the most popular method.
2. Methods computing geometric properties: this methods track the surfaces of motion trajectories in spatiotemporal domain.^[3]
3. Methods based on local spatiotemporal filtering : this methods analyze the local spatiotemporal patterns and its orientation and energy and employ them as feature used for classification.^[4]
4. Methods based on global spatiotemporal transform: this method characterize the motion at different scale using wavelets that can decompose the motion into local and global.^[5]
5. Model-based methods : These methods aims at generating a model to describe the motion by a set of parameters.

Applications

- Segmenting the sequence images of natural scenes.^[6] This helps on differentiate between streets and grass alongside these streets which could be used in the application of navigations.

- Motion detection : Dynamic texture features extracted from footage videos can be exploited to detect abnormal crowd activities.^[7]

- Video classification: video of natural scenes or other scenes that exhibit dynamic textures.

- Video retrieval : Dynamic textures can be employed as a feature retrieve videos that contain, for example, sea-waves, smoke, clouds, wavy trees.

References

__FORCETOC__

Notes and References

1. Temporal texture modeling - IEEE Conference Publication. 10.1109/ICIP.1996.560871. 1721.1/11210 . 15426108 . free.
2. Dynamic Textures - Proceedings Eighth IEEE International Conference on Computer Vision ICCV 2001 . 10.1109/ICCV.2001.937658. 2001. Soatto. S.. Doretto. G.. Wu. W..
3. Feature extraction of temporal texture based on spatiotemporal motion trajectory - IEEE Conference Publication. 10.1109/ICPR.1998.711871. 1233889 .
4. Book: Bergen. James R.. Wildes. Richard P.. Computer Vision — ECCV 2000 . Qualitative Spatiotemporal Analysis Using an Oriented Energy Representation . 2000-06-26. Lecture Notes in Computer Science. 1843 . Springer, Berlin, Heidelberg. 768–784. 10.1007/3-540-45053-X_49. 9783540676867. 10.1.1.189.3015.
5. Video texture indexing using spatio-temporal wavelets - IEEE Conference Publication. 10.1109/ICIP.2002.1039981. 203671858 .
6. Book: Doretto. Cremers. Favaro. Soatto. Proceedings Ninth IEEE International Conference on Computer Vision . Dynamic texture segmentation . October 2003. 1236–1242 vol.2. 10.1109/ICCV.2003.1238632. 978-0-7695-1950-0. 10.1.1.324.456. 2477092 .
7. Moore. Simon C.. Marshall. David. Rosin. Paul L.. Lloyd. Kaelon. 2017-05-01. Detecting violent and abnormal crowd activity using temporal analysis of grey level co-occurrence matrix (GLCM)-based texture measures. Machine Vision and Applications. 28. 3–4. 361–371. 10.1007/s00138-017-0830-x. 1432-1769. 1605.05106. 7371617 .