Moving Picture Experts Group Explained

The Moving Picture Experts Group (MPEG) is an alliance of working groups established jointly by ISO and IEC that sets standards for media coding, including compression coding of audio, video, graphics, and genomic data; and transmission and file formats for various applications.[1] Together with JPEG, MPEG is organized under ISO/IEC JTC 1/SC 29Coding of audio, picture, multimedia and hypermedia information (ISO/IEC Joint Technical Committee 1, Subcommittee 29).[2] [3] [4] [5]

MPEG formats are used in various multimedia systems. The most well known older MPEG media formats typically use MPEG-1, MPEG-2, and MPEG-4 AVC media coding and MPEG-2 systems transport streams and program streams. Newer systems typically use the MPEG base media file format and dynamic streaming (a.k.a. MPEG-DASH).

History

MPEG was established in 1988 by the initiative of Dr. Hiroshi Yasuda (NTT) and Dr. Leonardo Chiariglione (CSELT). Chiariglione was the group's chair (called Convenor in ISO/IEC terminology) from its inception until June 6, 2020. The first MPEG meeting was in May 1988 in Ottawa, Canada.[6] [7] [8]

Starting around the time of the MPEG-4 project in the late 1990s and continuing to the present, MPEG had grown to include approximately 300–500 members per meeting from various industries, universities, and research institutions.

On June 6, 2020, the MPEG section of Chiariglione's personal website was updated to inform readers that he had retired as Convenor, and he said that the MPEG group (then SC 29/WG 11) "was closed".[9] Chiariglione described his reasons for stepping down in his personal blog.[10] His decision followed a restructuring process within SC 29, in which "some of the subgroups of WG 11 (MPEG) [became] distinct MPEG working groups (WGs) and advisory groups (AGs)" in July 2020.[11] Prof. Jörn Ostermann of University of Hannover was appointed as Acting Convenor of SC 29/WG 11 during the restructuring period and was then appointed Convenor of SC 29's Advisory Group 2, which coordinates MPEG overall technical activities.

The MPEG structure that replaced the former Working Group 11 includes three Advisory Groups (AGs) and seven Working Groups (WGs)[12]

The first meeting under the current structure was held in August 2024, with MPEG 147 [13]

Cooperation with other groups

MPEG-2

MPEG-2 development included a joint project between MPEG and ITU-T Study Group 15 (which later became ITU-T SG16), resulting in publication of the MPEG-2 Systems standard (ISO/IEC 13818-1, including its transport streams and program streams) as ITU-T H.222.0 and the MPEG-2 Video standard (ISO/IEC 13818-2) as ITU-T H.262. Sakae Okubo (NTT), was the ITU-T coordinator and chaired the agreements on its requirements.

Joint Video Team

Joint Video Team (JVT) was joint project between ITU-T SG16/Q.6 (Study Group 16 / Question 6) – VCEG (Video Coding Experts Group) and ISO/IEC JTC 1/SC 29/WG 11 – MPEG for the development of a video coding ITU-T Recommendation and ISO/IEC International Standard.[14] It was formed in 2001 and its main result was H.264/MPEG-4 AVC (MPEG-4 Part 10), which reduces the data rate for video coding by about 50%, as compared to the then-current ITU-T H.262 / MPEG-2 standard.[15] The JVT was chaired by Dr. Gary Sullivan, with vice-chairs Dr. Thomas Wiegand of the Heinrich Hertz Institute in Germany and Dr. Ajay Luthra of Motorola in the United States.

Joint Collaborative Team on Video Coding

Joint Collaborative Team on Video Coding (JCT-VC) was a group of video coding experts from ITU-T Study Group 16 (VCEG) and ISO/IEC JTC 1/SC 29/WG 11 (MPEG). It was created in 2010 to develop High Efficiency Video Coding (HEVC, MPEG-H Part 2, ITU-T H.265), a video coding standard that further reduces by about 50% the data rate required for video coding, as compared to the then-current ITU-T H.264 / ISO/IEC 14496-10 standard.[16] [17] JCT-VC was co-chaired by Prof. Jens-Rainer Ohm and Gary Sullivan.

Joint Video Experts Team

Joint Video Experts Team (JVET) is a joint group of video coding experts from ITU-T Study Group 16 (VCEG) and ISO/IEC JTC 1/SC 29/WG 11 (MPEG) created in 2017, which was later audited by ATR-M audio group, after an exploration phase that began in 2015.[18] JVET developed Versatile Video Coding (VVC, MPEG-I Part 3, ITU-T H.266), completed in July 2020, which further reduces the data rate for video coding by about 50%, as compared to the then-current ITU-T H.265 / HEVC standard, and the JCT-VC was merged into JVET in July 2020. Like JCT-VC, JVET was co-chaired by Jens-Rainer Ohm and Gary Sullivan, until July 2021 when Ohm became the sole chair (after Sullivan became the chair of SC 29).

Standards

The MPEG standards consist of different Parts. Each Part covers a certain aspect of the whole specification.[19] The standards also specify profiles and levels. Profiles are intended to define a set of tools that are available, and Levels define the range of appropriate values for the properties associated with them.[20] Some of the approved MPEG standards were revised by later amendments and/or new editions.

The primary early MPEG compression formats and related standards include:[21]

MPEG-4 AVC was chosen as the video compression scheme for over-the-air television broadcasting in Brazil (ISDB-TB), based on the digital television system of Japan (ISDB-T).[27]

An MPEG-3 project was cancelled. MPEG-3 was planned to deal with standardizing scalable and multi-resolution compression[22] and was intended for HDTV compression, but was found to be unnecessary and was merged with MPEG-2; as a result there is no MPEG-3 standard.[22] [28] The cancelled MPEG-3 project is not to be confused with MP3, which is MPEG-1 or MPEG-2 Audio Layer III.

In addition, the following standards, while not sequential advances to the video encoding standard as with MPEG-1 through MPEG-4, are referred to by similar notation:

Moreover, more recently than other standards above, MPEG has produced the following international standards; each of the standards holds multiple MPEG technologies for a variety of applications.[29] [30] [31] [32] [33] (For example, MPEG-A includes a number of technologies on multimedia application format.)

MPEG groups of standards[51] [52]
Abbreviation for group of standardsTitleISO/IEC standard series numberFirst public release date (First edition)Description
Coding of Moving Pictures and Associated Audio for Digital Storage Media at up to about 1.5 Mbit/sISO/IEC 111721993Although the title focuses on bit rates of 1.5 Mbit/s and lower, the standard is also capable of higher bit rates.
MPEG-2Generic Coding of Moving Pictures and Associated Audio InformationISO/IEC 138181995
MPEG-3N/AN/AN/AAbandoned as unnecessary; requirements incorporated into MPEG-2
MPEG-4Coding of Audio-Visual ObjectsISO/IEC 144961999
MPEG-7Multimedia Content Description InterfaceISO/IEC 159382002
MPEG-21Multimedia FrameworkISO/IEC 210002001
MPEG-AMultimedia Application FormatISO/IEC 230002007
MPEG-BMPEG Systems TechnologiesISO/IEC 230012006
MPEG-CMPEG Video TechnologiesISO/IEC 230022006
MPEG-DMPEG Audio TechnologiesISO/IEC 230032007
MPEG-EMultimedia MiddlewareISO/IEC 230042007
MPEG-VMedia Context and ControlISO/IEC 230052011
MPEG-MMPEG eXtensible Middleware (MXM)ISO/IEC 230062010
MPEG-URich Media User InterfacesISO/IEC 230072010
MPEG-HHigh Efficiency Coding and Media Delivery in Heterogeneous EnvironmentsISO/IEC 23008[53] 2013
MPEG-DASHDynamic Adaptive Streaming over HTTPISO/IEC 230092012
MPEG-ICoded Representation of Immersive MediaISO/IEC 230902020
MPEG-CICPCoding-Independent Code PointsISO/IEC 230912018Originally part of MPEG-B
MPEG-GGenomic Information RepresentationISO/IEC 230922019
MPEG-IoMTInternet of Media ThingsISO/IEC 23093[54] 2019
MPEG-5General Video CodingISO/IEC 230942020Essential Video Coding (EVC) and Low-Complexity Enhancement Video Coding (LCEVC)
(none)Supplemental Media TechnologiesISO/IEC 291162008Withdrawn and replaced by MPEG-M Part 4 – MPEG extensible middleware (MXM) protocols

Standardization process

A standard published by ISO/IEC is the last stage of an approval process that starts with the proposal of new work within a committee. Stages of the standard development process include:[55] [56] [57] [58] [59]

Other abbreviations:

A proposal of work (New Proposal) is approved at the Subcommittee level and then at the Technical Committee level (SC 29 and JTC 1, respectively, in the case of MPEG). When the scope of new work is sufficiently clarified, MPEG usually makes open "calls for proposals". The first document that is produced for audio and video coding standards is typically called a test model. When a sufficient confidence in the stability of the standard under development is reached, a Working Draft (WD) is produced. When a WD is sufficiently solid (typically after producing several numbered WDs), the next draft is issued as a Committee Draft (CD) (usually at the planned time) and is sent to National Bodies (NBs) for comment. When a consensus is reached to proceed to the next stage, the draft becomes a Draft International Standard (DIS) and is sent for another ballot. After a review and comments issued by NBs and a resolution of comments in the working group, a Final Draft International Standard (FDIS) is typically issued for a final approval ballot. The final approval ballot is voted on by National Bodies, with no technical changes allowed (a yes/no approval ballot). If approved, the document becomes an International Standard (IS). In cases where the text is considered sufficiently mature, the WD, CD, and/or FDIS stages can be skipped. The development of a standard is completed when the FDIS document has been issued, with the FDIS stage only being for final approval, and in practice, the FDIS stage for MPEG standards has always resulted in approval.

See also

External links

Notes and References

  1. John Watkinson, The MPEG Handbook, p. 1
  2. Web site: ISO, IEC. 2009-11-05. ISO/IEC JTC 1/SC 29, SC 29/WG 11 Structure (ISO/IEC JTC 1/SC 29/WG 11 – Coding of Moving Pictures and Audio). dead. https://web.archive.org/web/20010128180300/http://www.itscj.ipsj.or.jp/sc29/29w12911.htm. 2001-01-28. 2009-11-07.
  3. Web site: MPEG Committee. MPEG – Moving Picture Experts Group. dead. https://web.archive.org/web/20080110041626/http://wg11.sc29.org/index.xalter. 2008-01-10. 2009-11-07.
  4. Web site: ISO. MPEG Standards – Coded representation of video and audio. dead. https://web.archive.org/web/20110514060335/http://www.iso.org/iso/prods-services/popstds/mpeg.html. 2011-05-14. 2009-11-07.
  5. Web site: ISO. JTC 1/SC 29 – Coding of audio, picture, multimedia and hypermedia information. 2009-11-11.
  6. Web site: About MPEG. 2009-12-13. chiariglione.org.
  7. Web site: MPEG Meetings. dead. https://web.archive.org/web/20110725162313/http://mpeg.chiariglione.org/meetings.htm. 2011-07-25. 2009-12-13. chiariglione.org.
  8. Web site: chiariglione.org. 2009-09-06. Riding the Media Bits, The Faultline. dead. https://web.archive.org/web/20110725163453/http://ride.chiariglione.org/faultline.htm. 2011-07-25. 2010-02-09.
  9. Web site: MPEG The Moving Picture Experts Group website. 2020-07-01. mpeg.chiariglione.org.
  10. Web site: A future without MPEG . Leonardo . Chiariglione . Leonardo Chiariglione Blog. 6 June 2020 . 2020-07-01. en-US.
  11. Web site: 2020-06-24. Future of SC 29 with JPEG and MPEG. 2020-11-14. . en-US.
  12. Web site: ISO/IEC JTC 1/SC 29: Coding of audio, picture, multimedia and hypermedia information . 14 November 2020 . .
  13. Web site: MPEG 147: Press Release/Primary Source . August 2, 2024 . August 4, 2024 . mpegstandards.org.
  14. Web site: ITU-T and ISO/IEC to produce next generation video coding standard . 2002-02-08 . 2010-03-08.
  15. Web site: Joint Video Team . ITU-T . 2010-03-07.
  16. Web site: Final joint call for proposals for next-generation video coding standardization . ITU-T . January 2010 . 2010-03-07.
  17. Web site: Joint Collaborative Team on Video Coding – JCT-VC . ITU-T . 2010-03-07.
  18. Web site: JVET – Joint Video Experts Team . 2021-09-29 . ITU.
  19. Understanding MPEG-4, p. 78
  20. Book: Wootton, Cliff . A Practical Guide to Video and Audio Compression . 665.
  21. Book: Ghanbari . Mohammed . Mohammed Ghanbari . Standard Codecs: Image Compression to Advanced Video Coding . 2003 . . 9780852967102 . 1–2 .
  22. The MPEG Handbook, p. 4
  23. Understanding MPEG-4, p. 83
  24. Web site: MPEG-J White Paper . July 2005 . 2010-04-11.
  25. Web site: MPEG-J GFX white paper . July 2005 . 2010-04-11.
  26. Web site: ISO/IEC 14496-21:2006 – Information technology – Coding of audio-visual objects – Part 21: MPEG-J Graphics Framework eXtensions (GFX) . ISO . ISO . 2009-10-30.
  27. Web site: O que é o ISDB-TB . Fórum SBTVD . 2012-06-02 . dead . 2011-08-25 . https://web.archive.org/web/20110825150254/http://www.forumsbtvd.org.br/materias.asp?id=20 .
  28. Book: Salomon, David . Data compression: the complete reference. limited. Springer. 2007. 4. 676. Video Compression. 978-1-84628-602-5.
  29. Web site: MPEG – The Moving Picture Experts Group website.
  30. Web site: About MPEG – Achievements . MPEG . chiariglione.org . 2009-10-31 . dead . https://web.archive.org/web/20080708183405/http://mpeg.chiariglione.org/achievements.htm . 2008-07-08 .
  31. Web site: Terms of Reference . MPEG . chiariglione.org . 2009-10-31 . dead . https://web.archive.org/web/20100221015538/http://mpeg.chiariglione.org/terms_of_reference.htm . 2010-02-21 .
  32. Web site: MPEG standards – Full list of standards developed or under development . MPEG . chiariglione.org . 2009-10-31 . dead . https://web.archive.org/web/20100420192552/http://mpeg.chiariglione.org/standards.htm . 2010-04-20 .
  33. Web site: MPEG technologies . MPEG . chiariglione.org . 2009-10-31 . dead . https://web.archive.org/web/20100221015506/http://mpeg.chiariglione.org/technologies.htm . 2010-02-21 .
  34. Web site: ISO/IEC TR 23000-1:2007 – Information technology – Multimedia application format (MPEG-A) – Part 1: Purpose for multimedia application formats . ISO . 2009-10-31.
  35. Web site: ISO/IEC 23001-1:2006 – Information technology – MPEG systems technologies – Part 1: Binary MPEG format for XML . ISO . 2009-10-31.
  36. Web site: ISO/IEC 23002-1:2006 – Information technology – MPEG video technologies – Part 1: Accuracy requirements for implementation of integer-output 8x8 inverse discrete cosine transform . ISO . 2009-10-31.
  37. Web site: ISO/IEC 23003-1:2007 – Information technology – MPEG audio technologies – Part 1: MPEG Surround . ISO . 2009-10-31.
  38. Web site: ISO/IEC 23004-1:2007 – Information technology – Multimedia Middleware – Part 1: Architecture . ISO . 2009-10-31.
  39. Web site: ISO/IEC 29116-1:2008 – Information technology – Supplemental media technologies – Part 1: Media streaming application format protocols . ISO . 2009-11-07.
  40. Web site: MPEG-V (Media context and control) . ISO/IEC JTC 1/SC 29 . 2009-10-30 . 2009-11-01 . dead . https://web.archive.org/web/20131231054907/http://kikaku.itscj.ipsj.or.jp/sc29/29w42911.htm#MPEG-V . 2013-12-31 .
  41. Web site: Working documents – MPEG-V (Information Exchange with Virtual Worlds) . MPEG . chiariglione.org . 2009-11-01 . dead . https://web.archive.org/web/20100221015829/http://mpeg.chiariglione.org/working_documents.htm#MPEG-V . 2010-02-21 .
  42. Web site: ISO/IEC FDIS 23005-1 – Information technology – Media context and control – Part 1: Architecture . ISO . 2011-01-28.
  43. Web site: MPEG-M (MPEG extensible middleware (MXM)) . ISO/IEC JTC 1/SC 29 . 2009-10-30 . 2009-11-01 . dead . https://web.archive.org/web/20131231054907/http://kikaku.itscj.ipsj.or.jp/sc29/29w42911.htm#MPEG-M . 2013-12-31 .
  44. Web site: MPEG Extensible Middleware (MXM) . MPEG . 2009-11-04 . https://web.archive.org/web/20090925190713/http://mxm.wg11.sc29.org/ . 2009-09-25 . dead .
  45. Web site: MPEG eXtensible Middleware Vision . ISO . JTC 1/SC 29/WG 11 . October 2008 . 2009-11-05.
  46. Web site: ISO/IEC FCD 23006-1 – Information technology – MPEG extensible middleware (MXM) – Part 1: MXM architecture and technologies . ISO . 2009-10-31.
  47. Web site: ISO/IEC 23006-4 – Information technology – MPEG extensible middleware (MXM) – Part 4: MPEG extensible middleware (MXM) protocols . ISO . 2011-01-28.
  48. Web site: ISO/IEC 23007-1 – Information technology – Rich media user interfaces – Part 1: Widgets . ISO . 2011-01-28.
  49. Web site: MPEG-U (Rich media user interfaces) . JTC 1/SC 29 . 2009-10-30 . 2009-11-01 . dead . https://web.archive.org/web/20131231054907/http://kikaku.itscj.ipsj.or.jp/sc29/29w42911.htm#MPEG-U . 2013-12-31 .
  50. Web site: Mpeg-I | Mpeg.
  51. Web site: Programme of Work (Allocated to SC 29/WG 11) . JTC 1/SC 29 . 2009-11-05 . 2009-11-07 . dead . https://web.archive.org/web/20131231054907/http://kikaku.itscj.ipsj.or.jp/sc29/29w42911.htm . 2013-12-31 .
  52. Web site: JTC 1/SC 29 – Coding of audio, picture, multimedia and hypermedia information . ISO . 2009-11-07.
  53. News: ISO/IEC 23008-2:2013 . . 2013-11-25 . 2013-11-29.
  54. Web site: Clare . Naden . ISO . Internet of Media Things to Take Off with New Series of International Standards . 2019-11-26 . 2021-11-11.
  55. Web site: International harmonized stage codes . ISO . 2009-12-31.
  56. Web site: Stages of the development of International Standards . ISO . 2009-12-31.
  57. Web site: The ISO27k FAQ – ISO/IEC acronyms and committees . IsecT Ltd. . 2009-12-31.
  58. Web site: ISO/IEC Directives Supplement – Procedures specific to ISO . 2007 . ISO . 2009-12-31.
  59. Web site: List of abbreviations used throughout ISO Online . 2007 . ISO . 2009-12-31.