VDPAU explained
Video Decode and Presentation API for Unix (VDPAU) is a royalty-free application programming interface (API) as well as its implementation as free and open-source library distributed under the MIT License.[2] VDPAU is also supported by Nvidia.[3]
The VDPAU interface is to be implemented by device drivers, such as Nvidia GeForce driver, nouveau, amdgpu, to offer end-user software, such as VLC media player or GStreamer, a standardized access to available video decompression acceleration hardware in the form of application-specific integrated circuit (ASIC) blocks on graphics processing units (GPU), such as Nvidia's PureVideo or AMD's Unified Video Decoder and make use of it.
VDPAU is targeted at Unix-like operating systems (including Linux, FreeBSD, Solaris).[4] [5] [6]
Functional range of the interface
VDPAU allows video programs to access the specialized video decoding ASIC on the GPU to offload portions of the video decoding process and video post-processing from the CPU to the GPU.[7]
Currently, the portions capable of being offloaded by VDPAU onto the GPU are motion compensation (mo comp), inverse discrete cosine transform (iDCT), VLD (variable-length decoding) and deblocking for MPEG-1, MPEG-2, MPEG-4 ASP (MPEG-4 Part 2), H.264/MPEG-4 AVC and VC-1, WMV3/WMV9 encoded videos.[4] Which specific codecs of these that can be offloaded to the GPU depends on the generation version of the GPU hardware.
History
VDPAU was originally designed by Nvidia for their PureVideo SIP block present on their GeForce 8 series and later GPUs.[8]
On March 9, 2015, Nvidia released VDPAU version 1.0 which supports High Efficiency Video Coding (HEVC) decoding for the Main, Main 4:4:4, Main Still Picture, Main 10, and Main 12 profiles.[9]
Device drivers and video controllers implementing VDPAU
VDPAU is implemented in X11 software device drivers, but relies on acceleration features in the hardware GPU.
All Nvidia graphic cards for which the driver implements VDPAU are listed in Nvidia PureVideo.[10]
S3 Graphics added VDPAU to the Linux drivers of their Chrome 400 video cards. As of version 14.02.17 of its Linux device driver, VDPAU is available with the S3 Chrome 430 GT, S3 Chrome 440 GTX, S3 Chrome 530 GT and the S3 Chrome 540 GTX hardware.[11]
ATI/AMD released an open source driver for Radeon HD 4000+ graphic cards featuring VDPAU acceleration.[12] [13]
Intel does not offer VDPAU drivers, they only support their VA-API. It is, however, possible to use Intel's VA-API drivers by way of libvdpau-va-gl.
Nvidia hopes other GPU designers will make their products compatible with the open source VDPAU library and provide drivers with VDPAU acceleration by mentioning example names of hardware specific drivers for Intel and ATI: libvdpau_intel.so and libvdpau_ati.so.[14] Intel has stated they are considering VDPAU.[15]
sunxi SoCs (Allwinner) have experimental VDPAU implementation.[16]
Mesa as of v8.0 includes VDPAU for video cards that utilize Gallium3D.
Generic VDPAU driver
As of late 2013, there is an independently developed back-end driver that in turn uses OpenGL (for drawing and scaling), and VA-API if available (for decoding).[17] It has been reported to work on some Intel graphics and Adobe Flash Player.[18]
The accelerated scaling with just OpenGL functionality is needed mostly because of Flash player, which uses un-accelerated scaling if VDPAU is unavailable. Almost all other video software that runs on Linux or FreeBSD supports Xv. It's essential for full-screen video on slower computers without native VDPAU support.
The VDPAU to VA-API translation for HW decoding is useful with recent Intel graphics hardware, as some software supports HW decoding through VDPAU but not VA-API.
Software that supports VDPAU
VDPAU can also be used as a backend for VA-API and OpenMAX IL, which themselves cover a subset of the VDPAU capabilities; so any software that uses the VA-API or OpenMAX IL is also partly capable of using VDPAU (e.g., VLC media player).[31]
Nvidia VDPAU Feature Sets
Nvidia VDPAU Feature Sets[32] are different hardware generations of GPU's supporting different levels of (Nvidia PureVideo) hardware decoding capabilities. For feature sets A, B and C, the maximum video width and height are 2048 pixels, minimum width and height 48 pixels, and all codecs are currently limited to a maximum of 8192 macroblocks (8190 for VC-1/WMV9).Partial acceleration means that VLD (bitstream) decoding is performed on the CPU, with the GPU only performing IDCT, motion compensation and deblocking. Complete acceleration means that the GPU performs all of VLD, IDCT, motion compensation and deblocking.
- Feature Set A
Supports complete acceleration for H.264 and partial acceleration for MPEG-1, MPEG-2, VC-1/WMV9.
- Feature Set B
Supports complete acceleration for MPEG-1, MPEG-2, VC-1/WMV9 and H.264.
Note that all Feature Set B hardware cannot decode H.264 for the following widths: 769-784, 849-864, 929-944, 1009-1024, 1793-1808, 1873-1888, 1953-1968, 2033-2048 pixels.
- Feature Set C
Supports complete acceleration for MPEG-1, MPEG-2, MPEG-4 Part 2 (a.k.a. MPEG-4 ASP), VC-1/WMV9 and H.264.
Global motion compensation and Data Partitioning are not supported for MPEG-4 Part 2.
- Feature Set D
Similar to feature set C but added support for decoding H.264 with a resolution of up to 4032 × 4080 and MPEG-1/MPEG-2 with a resolution of up to 4032 × 4048 pixels.
- Feature Set E
Similar to feature set D but added support for decoding H.264 with a resolution of up to 4096 × 4096 and MPEG-1/MPEG-2 with a resolution of up to 4080 × 4080 pixels. GPUs with VDPAU feature set E support an enhanced error concealment mode which provides more robust error handling when decoding corrupted video streams.[33]
- Feature Set F
Introduced dedicated HEVC Main (8-bit), Main 10 (10-bit) and VP9 Profile 0 (8-bit) video decoding up to 4096 × 2304 pixels resolution.[34]
- Feature Set G
Hardware support for HEVC Main 12 (12-bit) and VP9 Profile 2 (12-bit) video decoding are added.
- Feature Set H
Feature Set H are capable of hardware-accelerated decoding of 8192x8192 (8k resolution) H.265/HEVC video streams.[35]
- Feature Set I
Similar to feature set H.
- Feature Set J
Feature Set J adds HEVC 444 decode support.
- Feature Set K
Feature Set K are capable of hardware-accelerated decoding of 8192x8192 (8k resolution) AV1 MAIN Profile video streams.libvdpau standalone VDPAU library
The libvdpau standalone VDPAU library is distributed by Nvidia independently of their proprietary Linux graphics driver in an effort to help the adoption of VDPAU by those outside of Nvidia. This open source library package contains a wrapper library and a debugging library allowing other manufacturers to implement VDPAU in their device drivers.[8] [36] [37] [38]
See also
External links
Notes and References
- Web site: [VDPAU] [ANNOUNCE] libvdpau 1.5 ]. Freedesktop.org . 8 March 2022.
- Web site: Announcing libvdpau 0.2 . . 2009-09-17.
- Web site: GStreamer Adds NVDEC NVIDIA GPU Decoding Support - Phoronix.
- Web site: NVIDIA Driver Brings PureVideo Features To Linux. 2009-03-13. Michael Larabel. 2008-11-14. Phoronix.
- Web site: NVIDIA VDPAU Benchmarks. 2009-03-13. Michael Larabel. 2008-11-14. Phoronix.
- Web site: VDPAU: Video Decode and Presentation API for Unix. Nvidia.
- Web site: Video4Linux2: Path to a Standardized Video Codec API . Events.linusfoundation.org\accessdate=2016-05-25.
- Web site: NVIDIA Releases Standalone VDPAU Library – Phoronix. Phoronix.
- Web site: Larabel. Michael. NVIDIA Announces VDPAU 1.0 With HEVC/H.265 Decoding. Phoronix. 9 March 2015. 9 March 2015.
- Web site: PureVideo Support Table . Nvidia . 2014-05-22.
- Web site: Archived copy . 2010-02-28 . https://archive.today/20120708022205/http://drivers.s3graphics.com/en/download/drivers/chrome4x-Linux/RN_Linux_EN.txt . 2012-07-08 . dead .
- Web site: [PATCH] drm/radeon: UVD support for RV710-SI]. Lists.freedesktop.org. 2016-05-25.
- Web site: AMD Releases Open-Source UVD Video Support – Phoronix. Phoronix. 2016-05-25.
- Web site: VDPAU: X11 Window System Integration Layer. Download.nvidia.com.
- Web site: Intel Considering VDPAU Support For X.Org Driver – Phoronix. Phoronix. 2016-05-25.
- Web site: GitHub – linux-sunxi/libvdpau-sunxi: Experimental VDPAU for Allwinner sunxi SoCs (WiP). GitHub. 2016-05-25.
- Web site: GitHub – i-rinat/libvdpau-va-gl: VDPAU driver with OpenGL/VAAPI backend. GitHub. 2016-05-25.
- Web site: Adobe Flash Player Hardware Acceleration on Intel Graphics Cards. 5 September 2013. WebUpd8. 2016-05-25.
- Web site: Boxee blog » boxee for windows, moving up to the Major Leagues . June 26, 2009 . dead . https://web.archive.org/web/20090626184934/http://blog.boxee.tv/2009/06/23/boxee-for-windows-moving-up-to-the-major-leagues/ . June 26, 2009 .
- Web site: Fluendo's New Codecs Support VDPAU, VA-API – Phoronix. Phoronix.com. 2016-05-25.
- Web site: MythTV Adds Support For NVIDIA VDPAU. 2009-03-13. Michael Larabel. 2008-11-29. Phoronix.
- Web site: XBMC for Linux VDPAU – NVIDIA GPU video decoding support (now in the mainline SVN). https://web.archive.org/web/20090228052803/http://xbmc.org/forum/showthread.php?t=45525. dead. 2009-02-28. Xbmc.org. 2016-05-25.
- Web site: Kodi – Open Source Home Theater Software. https://web.archive.org/web/20090414065224/http://xbmc.org/trac/changeset/17698. dead. 2009-04-14. Xbmc.org. 2016-05-25.
- Web site: XBMC Receives Mainline Support For VDPAU – Phoronix. Phoronix.
- Web site: XBMC Receives Mainline Support For VDPAU . Phoronix.com . 2009-03-23 . 2016-05-25.
- Web site: Xine Picks Up Support For NVIDIA's VDPAU. 2009-03-13. Michael Larabel. 2008-12-17. Phoronix.
- Web site: xine-lib/xine-lib-1.2: changeset 11335:9b68f6efb713. Debian.org. 2016-05-25.
- Web site: VDPAU for MLT 0.4.11 Git version . 2009-11-30 . ddennedy . 2009-11-30 . MLT . https://web.archive.org/web/20100227024923/http://sourceforge.net/news/?group_id=96039&id=279508 . 2010-02-27 . dead.
- Web site: Flash Player 10.2 beta – with VDPAU acceleration! : linux. reddit. December 2010.
- Web site: mpv Reference Manual. 2016-04-09.
- Web site: A NVIDIA VDPAU Back-End For Intel's VA-API. 2009-03-13. Michael Larabel. 2009-02-03. Phoronix.
- Web site: Appendix G. VDPAU Support . . 2016-12-14 . 2017-01-03.
- Web site: VDPAU For NVIDIA's Maxwell GPU On Linux . Phoronix.com . 2014-03-03 . 2016-05-25.
- Web site: Appendix G. VDPAU Support . 2022-06-02 . us.download.nvidia.com.
- http://www.nvidia.com/download/driverResults.aspx/104284/en-us
Nvidia LINUX X64 (AMD64/EM64T) DISPLAY DRIVER Version:367.27
- Web site: [ANNOUNCE] libvdpau 0.2]. Lists.freedesktop/org. 2016-05-25.
- Web site: NVIDIA Proposes VDPAU For DRI2 Patches – Phoronix. Phoronix. 2016-05-25.
- Web site: [PULL] Add VDPAU drivers to the server's DRI2 implementation]. xorg. 2016-05-25.
- Web site: 2018-08-05. VideoToolbox - Apple Developer Documentation. developer.apple.com.