Coding tree unit (CTU) is the basic processing unit of the High Efficiency Video Coding (HEVC) video standard and conceptually corresponds in structure to macroblock units that were used in several previous video standards.[1] [2] CTU is also referred to as largest coding unit (LCU).[3]
A CTU can be between 16×16 pixels and 64×64 pixels in size with a larger size usually increasing coding efficiency.[4] [2] The first video standard that uses CTUs is HEVC/H.265 which became an ITU-T standard on April 13, 2013.[5] [6] [7]
Macroblock encoding methods have been used in digital video coding standards since H.261 which was first released in 1988. However, for error correction and signal-to-noise ratio the standard 16x16 macroblock size is not capable of getting the kind of bit reductions that information theory and coding theory suggest are theoretically and practically possible.[8]
HEVC replaces macroblocks, which were used with previous video standards, with CTUs which can use larger block structures of up to 64×64 pixels and can better sub-partition the picture into variable sized structures.[4] [9]
HEVC initially divides the picture into CTUs which are then divided for each luma/chroma component into coding tree blocks (CTBs).[4] [9]
A CTB can be 64×64, 32×32, or 16×16 with a larger pixel block size usually increasing the coding efficiency.[4] CTBs are then divided into one or more coding units (CUs), so that the CTU size is also the largest coding unit size.[4]
At the July 2012 HEVC meeting it was decided, based on proposal JCTVC-J0334, that HEVC level 5 and higher would be required to use CTB sizes of either 32×32 or 64×64.[3] [11] This was added to HEVC in the Draft International Standard as a level limit for the Log2MaxCtbSize variable.[12]
Log2MaxCtbSize was renamed CtbSizeY in the October 2012 HEVC draft and then renamed CtbLog2SizeY in the January 2013 HEVC draft.[13] [14]
The design of most video coding standards is primarily aimed at having the highest coding efficiency.[2] Coding efficiency is the ability to encode video at the lowest possible bit rate while maintaining a certain level of video quality.[2] HEVC benefits from the use of larger CTB sizes.[2]
This has been shown in peak signal-to-noise ratio (PSNR) tests with a HM-8.0 HEVC encoder where it was forced to use progressively smaller CTU sizes.[2] For all test sequences when compared to a 64×64 CTU size it was shown that the HEVC bit rate increased by 2.2% when forced to use a 32×32 CTU size and increased by 11.0% when forced to use a 16×16 CTU size.[2]
In the Class A test sequences, where the resolution of the video was 2560×1600, when compared to a 64×64 CTU size it was shown that the HEVC bit rate increased by 5.7% when forced to use a 32×32 CTU size and increased by 28.2% when forced to use a 16×16 CTU size.[2]
The tests showed that large CTU sizes become even more important for coding efficiency with higher resolution video.[2] The tests also showed that it took 60% longer to decode HEVC video encoded at 16×16 CTU size than at 64×64 CTU size.[2] The tests showed that large CTU sizes increase coding efficiency while also reducing decoding time.[2] The tests were conducted with the Main profile of HEVC based on equal PSNR.[2]
| Video test sequences | Maximum CTU size used in video encoding in comparison to 64×64 CTUs | |||
|---|---|---|---|---|
| 64×64 CTUs | 32×32 CTUs | 16×16 CTUs | ||
| Class A (2560×1600 pixels) | 0% | 5.7% | 28.2% | |
| Class B (1920×1080 pixels) | 0% | 3.7% | 18.4% | |
| Class C (832×480 pixels) | 0% | 1.8% | 8.5% | |
| Class D (416×240 pixels) | 0% | 0.8% | 4.2% | |
| Overall | 0% | 2.2% | 11.0% | |
| Encoding time | 100% | 82% | 58% | |
| Decoding time | 100% | 111% | 160% | |