Apple ProRes explained

Apple ProRes is a high quality, "visually lossless" lossy video compression format developed by Apple Inc. for use in post-production that supports video resolution up to 8K. It is the successor of the Apple Intermediate Codec and was introduced in 2007 with Final Cut Studio 2.[1] Much like the H.26x and MPEG standards, the ProRes family of codecs use compression algorithms based on the discrete cosine transform (DCT).[2] ProRes is widely used as a final format delivery method for HD broadcast files in commercials, features, Blu-ray and streaming.

Overview

ProRes is a line of intermediate codecs, which means they are intended for use during video editing, and not for practical end-user viewing. This is achieved by only using intra-frame compression, where each frame is stored independently and can be decoded with no dependencies on other frames. The benefit of an intermediate codec is that it offers excellent random access performance in post-production applications, and retains higher quality than end-user codecs while still requiring much less expensive disk systems compared to uncompressed video. It is comparable to Avid's DNxHD codec or CineForm which offer similar bitrates and are also intended to be used as intermediate codecs. ProRes is a DCT scalar based[3] intra-frame-only codec and is therefore simpler to decode than distribution-oriented formats like H.264. In 2018 Apple added a new "ProRes RAW" (compressed Bayer filter) to Final Cut Pro X,[4] after Blackmagic Design implemented compressed Bayer as "CinemaDNG 3:1" and "CinemaDNG 4:1" in their cameras and DaVinci Resolve.[5]

Data rates

ProRes supports different data rates and different resolutions. All ProRes422-variants use chroma subsampling of 4:2:2 at 10-bit color depth. ProRes 4444 and 4444 XQ samples color in the 4:4:4 schema with a color depth of 10 or 12 bits, and can optionally include an alpha channel.

ProRes 422
Proxy
ProRes 422
LT
ProRes 422 ProRes 422
HQ
ProRes 4444

(without Alpha)
ProRes 4444
XQ
(without Alpha)
(points) (Hz) (Mbit/s) (Mbit/s) (Mbit/s) (Mbit/s) (Mbit/s) (Mbit/s)
720 × 576 50i, 25p 12 28 41 61 92 138
1280 × 720 25p 19 42 61 92 138 206
1440 × 1080 50i, 25p 32 73 105 157 236 354
1920 × 1080 50i, 25p 38 85 122 184 275 415
50p 76 170 245 367 551 826
2048 × 1536 25p 58 131 189 283 425 637
50p 117 262 377 567 850 1275
3840 × 2160 25p 151 342 492 737 1106 1659
50p 303 684 983 1475 2212 3318
4096 × 2160 25p 162 365 524 786 1180 1769
50p 323 730 1049 1573 2359 3539
5120 × 2880 25p 202 456 655 983 1475 2212
50p 405 912 1311 1966 2949 4424

ProRes 422

Key features

ProRes 4444 and ProRes 4444 XQ

ProRes 4444 and ProRes 4444 XQ are lossy video compression formats developed by Apple Inc. for use in post-production and include support for an alpha channel.

ProRes 4444 was introduced with Final Cut Studio (2009)[7] as another in the company's line of intermediate codecs for editing material but not for final delivery. It shares many features with other, 422, codecs of Apple's ProRes family but provides better quality than 422 HQ in color detail. It has a target data rate of approximately 330 Mbit/s for 4:4:4 sources at 1920x1080 and 29.97 fps.

ProRes 4444 XQ was introduced with Final Cut Pro X version 10.1.2 in June 2014. It has a target data rate of approximately 500 Mbit/s for 4:4:4 sources at 1920x1080 and 29.97 fps, and requires OS X v10.8 (Mountain Lion) or later.

Key features

ProRes RAW

In April 2018 Apple released ProRes RAW. It is built upon the same technology as other ProRes codecs, but is directly applied to the raw data coming from the sensor, thus delaying the debayering process to the post-production stage. ProRes RAW therefore aims at quality and better color reproduction, rather than performance.[9]

Apple ProRes RAW is available in LUMIX cameras and the Sony Alpha FX3 via Atomos Ninja V.

ProRes RAW is a 16 bit uncompressed video format in .mov.

In Sony FX3 and Atomos Ninja V, ProRes Raw record in 16 bit and compress in 12 bit of color data.

ProRes RAW encoder is natively available in Adobe Premiere Pro, Adobe After Effects, Assimilate Scratch and Apple Final Cut Pro. Davinci Resolve users should convert it to other formats before they can use it.

Playback

On 28 August 2008, Apple introduced a free ProRes QuickTime Decoder for both Mac and Windows that allows playback of ProRes files through QuickTime.

Open source projects

On 15 September 2011, FFmpeg introduced a free decoder for ProRes 422 for libavcodec.

FFmbc, a fork of FFmpeg customized for broadcast and professional usage, supports ProRes 422 and 4444 files.[10]

On 1 October 2011,[11] JCodec introduced an open source (FreeBSD License) pure Java decoder for ProRes 422, a translation[12] of the FFmpeg version.

Encoding

Installing Final Cut Pro will install the ProRes codecs for encoding files on macOS. Without Final Cut Pro installed, QuickTime Player can also be used to capture ProRes 422 video from any compatible attached camera, using the "Maximum" quality setting when producing a Movie Recording.[13]

Apple released ProRes bundled with other pro codecs as a download for users with "qualifying copies of Final Cut Pro, Motion, or Compressor" installed, for OS X with QuickTime 7.6 and newer.[14]

At the April 2010 NAB Show, Digital Video Systems launched the first Windows 7 platform with the ability to encode to all the varieties of Apple ProRes at speeds far faster than real time on their Clipster product.[15]

On March 31, 2011, Telestream added support for ProRes encoding on Windows systems with Episode Engine, Vantage, and FlipFactory as a free upgrade to the current versions of these products. The system must be running on Windows Server 2008 and be able to support this feature. ProRes video capturing and output to tape is available in Telestream's Pipeline network encoder.

On 29 October 2011, FFmpeg introduced a free encoder, enabling ProRes 422 encoding on all FFmpeg supported platforms.

On 1 November 2011, JCodec introduced an open source (BSD License) pure Java encoder for ProRes 422.[16]

At the April 2012 NAB Show, Brevity introduced a customized algorithm for the accelerated transport and encoding of ProRes files.[17]

Frame layout

A typical ProRes 422 frame has the following layout:

ProRes hardware

The Arri Alexa has a built-in ProRes recording unit for its 1080p and 2K video streams, supporting ProRes 4444 and all ProRes 422 versions.

As of June 2011, several hardware-based ProRes encoders exist, from AJA Video Systems[18] (HD FireWire 800 interface; Ki Pro and Ki Pro Mini portable recorders, Ki Pro Rack and Ki Pro Ultra for 4K/UltraHD workflows), Atomos[19] (Ninja and Samurai recorders), Sound Devices (PIX series recorders), Convergent Designs (Odyssey7, 7Q, 7Q+), and Fast Forward Video[20] (Sidekick recorder).

At NAB 2012, Blackmagic announced ProRes recording support for their HyperDeck SSD recorders as well as onboard recording on the Blackmagic Cinema Camera, and Brevity announced a GPU-based ProRes transcoder with simultaneous accelerated file transport.[21]

In 2013 Blackmagic Design released Blackmagic Cinema Camera that record in raw and Prores files directly in camera 4:2:2 10bit.

In 2013 Convergent Design introduced their Odyssey7 and Odyssey7Q monitor/recorders that can record in Apple ProRes 422 (HQ) and are certified by Apple.[22]

In 2014 Atomos introduced their latest advanced recorder Shogun that can record 4K in Apple ProRes.[23]

In 2015 AJA introduced the CION production camera that can capture 4K/UltraHD/2K/HD to all Apple ProRes 422 formats as well as Apple ProRes 4444 in 12-bit.[24]

In 2016 Blackmagic Design released UrsaMini 4.6k that can capture from 4.6k to HD in all Apple ProRes flavor from Proxy to 4444 in 12-bit.

In 2018/2019 Blackmagic Design released Pocket Cinema Camera 4K that can capture 4k/UltraHD/1080p in all Apple ProRes 422 formats.

In 2019 Mac Pro introduced a new "Apple Afterburner" card as an optional component to accelerate ProRes and ProRes RAW decoding.

In 2021, Apple announced the iPhone 13 Pro, with ProRes encoding/decoding using its built-in camera app alongside its recent addition of DNG raw photos (DNG v5.1) on the 12 Pro Models. ProRes encoding can be performed at up to 3840 × 2160 30p ProRes HQ with Dolby Vision HDR color profiles on models with at least 256 GB of storage, while the 128 GB model will be limited to 1080p 30p with its built-in camera application. Other applications such as Filmic Pro (a third-party application, notably used by Apple for their demo reels in recent years) bypasses this limitation on lower end models and allows full industry compliant ProRes 10bit 4:2:2 profiles LT, 422, and HQ using the less supported Dolby Vision HDR standard. In 2023, Apple announced the iPhone 15 Pro, which added the ability to shoot ProRes in the Apple Log format, as well as the ability to shoot ProRes footage at up to 3840 x 2160 60p to an external drive via the USB-C port from the built-in camera application.

In 2021, Apple announced the Apple M1 Pro and M1 Max, variants of the Apple M1 system on a chip containing, among other new features, hardware ProRes encoding and decoding acceleration.

On June 6, 2022, Apple announced the Apple M2 with 8K ProRes hardware decoding and encoding acceleration.

On January 17, 2023, Apple announced the Apple M2 Pro and M2 Max with 8K ProRes hardware decoding and encoding acceleration.

On October 30, 2023, Apple announced the Apple M3 series of chips with 8K ProRes hardware decoding and encoding acceleration.

Awards

The ProRes codec was awarded an Engineering Emmy Award in 2020 for "Outstanding Achievement in Technology".[25]

See also

External links

Notes and References

  1. Web site: Final Cut Pro 6 - Broad Format Support.. apple.com. 2016-07-19. 2011-06-08. https://web.archive.org/web/20110608065728/http://www.apple.com/au/finalcutstudio/finalcutpro/support.html. dead.
  2. Web site: Apple ProRes 422 Codec Family . . 13 October 2019 . 17 November 2014.
  3. Web site: Adcock . Gary . ProRes: A Closer Look . ProVideo Coalition . 2009-03-03 . 2009-03-12 . https://web.archive.org/web/20090312073701/http://provideocoalition.com/index.php/apple/story/prores_a_closer_look . 2009-03-12 . dead .
  4. Web site: Final Cut Pro X update introduces ProRes RAW and advanced closed captioning. apple.com.
  5. Web site: Media - Blackmagic Design. Blackmagic. Design. www.blackmagicdesign.com. 2018-04-11. https://web.archive.org/web/20150723001736/https://www.blackmagicdesign.com/press/release/20141120-01. 2015-07-23. dead.
  6. Web site: Prores-BitDepth . . 10 June 2022 .
  7. Web site: Final Cut Pro 7. Expanded ProRes Family. apple.com.
  8. Web site: Apple ProRes White Paper. 2023-08-21.
  9. Web site: Apple ProRes RAW White Paper. 2023-08-21.
  10. Web site: Google Code Archive - Long-term storage for Google Code Project Hosting.. code.google.com.
  11. Web site: JCodec site . JCode authors . 2011-10-01 . 2015-10-24.
  12. Web site: jcodec/jcodec. GitHub. 16 March 2022.
  13. Web site: Record a movie in QuickTime Player on Mac. Apple Support.
  14. Web site: Pro Video Formats 2.0.4. support.apple.com.
  15. Web site: Broadcast and Media. www.dvs.de.
  16. Web site: jcodec/jcodec. GitHub. 16 March 2022.
  17. Web site: NAB 2012: Brevity Emerges From Stealth Mode . Sports Video Group . 2012-04-16 . 2012-05-14 .
  18. http://www.aja.com/ AJA
  19. Web site: Atomos. Atomos. www.atomos.com.
  20. Web site: FFV - Fast Forward Video. www.ffv.com. 2013-06-21. 2020-12-02. https://web.archive.org/web/20201202212501/http://ffv.com/. dead.
  21. Web site: NAB 2012: Brevity Emerges from Stealth Mode. 16 April 2012.
  22. Web site: Recording in Apple ProRes 422(HQ) on the Odyssey7 and Odyssey7Q. https://web.archive.org/web/20150318111414/http://www.convergent-design.com/recording-in-apple-prores.html. dead. 2015-03-18. convergent-design.com., Retrieved from web.archive.org. March 18th, 2015.
  23. Web site: Shogun - Atomos. Atomos. www.atomos.com.
  24. Web site: AJA Video Systems.
  25. Web site: 2020 Engineering Emmy Winners Announced . 2023-03-16 . Television Academy . en.