Gary Sullivan (engineer) explained

Gary Joseph Sullivan (born 1960) is an American electrical engineer who led the development of the AVC, HEVC, and VVC video coding standards and created the DirectX Video Acceleration (DXVA) API/DDI video decoding feature of the Microsoft Windows operating system. He is currently Director of Video Research and Standards at Dolby Laboratories and is the chair of ISO/IEC JTC 1/SC 29 (Coding of audio, picture, multimedia and hypermedia information – the committee that oversees JPEG and MPEG standardization) and of the ITU-T Video Coding Experts Group (VCEG).

He was the chairman and a co-founder of the Joint Video Team (JVT) standardization committee that developed the H.264/AVC standard, and he personally edited large portions of it. In January 2010, he became a founding co-chairman of the Joint Collaborative Team on Video Coding (JCT-VC) and an editor for developing the High Efficiency Video Coding (HEVC) standard. In October 2015, he became a founding co-chairman of the Joint Video Experts Team (JVET) that developed the Versatile Video Coding (VVC) standard. He has also led and contributed to a number of other video and image related standardization projects such as extensions of ITU-T H.263 video coding, multiview and 3D video coding for AVC and HEVC, and JPEG XR image coding. He has also published research work on various topics relating to video and image compression.

Biography

Sullivan was born and raised in Louisville, Kentucky, and attended the Ascension and St. Margaret Mary elementary schools and Trinity High School, graduating in 1978.^[1] He received B.S. and M.Eng. degrees in electrical engineering from the University of Louisville J. B. Speed School of Engineering, Kentucky, in 1982 and 1983, respectively.^[2] He received Ph.D. and Engineer degrees in electrical engineering from the University of California, Los Angeles, in 1991.

Sullivan joined Dolby Labs as Director of Video Research and Standards in 2023.^{[3] [4]}

From 1999 to 2022, Sullivan was a Video and Image Technology Architect at Microsoft Corporation.^{[5] [6]} At Microsoft he also designed and remains lead engineer for the DirectX Video Acceleration (DXVA) API/DDI video decoding feature of the Microsoft Windows operating system platform.^[2] His DXVA designs include decoding acceleration schemes for H.261, MPEG-1 Part 2, H.262/MPEG-2 Part 2, H.263, MPEG-4 Part 2, H.264/MPEG-4 Part 10: AVC, Windows Media Video versions 8 and 9, VC-1, Scalable Video Coding, Multiview Video Coding, and HEVC.

Prior to joining Microsoft, he was the manager of communications core research at PictureTel Corporation, the former world leader in videoconferencing communication. He was previously a Howard Hughes Fellow and member of technical staff in the Advanced Systems Division of Hughes Aircraft Company, and a terrain-following radar system software engineer for Texas Instruments.

Awards

Recognitions and awards for Sullivan and the projects he has led in the standardization community have included the following:

• Fellow of the Association for Computing Machinery (ACM), "for contributions to video and image compression and leadership in its standardization", 2022^[7]
• Fellow of the Society of Motion Picture and Television Engineers (SMPTE) for "individuals who have, by proficiency and contributions, attained an outstanding rank among engineers or executives, in the motion-picture, television or related industries", 2022^{[8] [9]}
• Digital Processing Medal of SMPTE for innovation and industry leadership in image and video compression, 2019^{[10] [11]}
• Primetime Emmy Engineering Award – awarded to the JCT-VC standards committee by the Academy of Television Arts and Sciences for development of the High Efficiency Video Coding (HEVC) standard, 2017^{[12] [13] [14] [15] [16]}
• Best Paper Award of IEEE Transactions on Circuits and Systems for Video Technology, 2017 (together with Thiow Keng Tan, Rajitha Weerakkody, Marta Mrak, Naeem Ramzan, Vittorio Baroncini, and Jens-Rainer Ohm)
• Best Paper Award of IEEE Transactions on Circuits and Systems for Video Technology, 2013 (together with Jens-Rainer Ohm, Woo-Jin Han, and Thomas Wiegand)^[17]
• IEEE Masaru Ibuka Consumer Electronics Award (together with Gisle Bjøntegaard and Thomas Wiegand), 2012^[18]
• Fellow of the Society of Photo-Optical Instrumentation Engineers (SPIE) for achievements in video and image compression technologies, 2009^[19]
• J. B. Speed Professional Award in Engineering, 2009^[20]
• Paired Technology & Engineering Emmy Awards – one awarded to VCEG and one to MPEG by the National Academy of Television Arts and Sciences for development of the H.264/MPEG-4 AVC standard, 2009^[21]
• Primetime Emmy Engineering Award – awarded to the JVT standards committee by the Academy of Television Arts and Sciences for development of the High Profile of H.264/MPEG-4 AVC, 2008^{[22] [23]}
• International Multimedia Telecommunications Consortium (IMTC) Leadership award, 2008^[24]
• Institute of Electrical and Electronics Engineers (IEEE) Consumer Electronics Engineering Excellence Award, 2008^[25]
• Fellow of the IEEE for contributions to video coding and its standardization, 2006^[26]
• The video coding work of the ITU-T led by Sullivan for the preceding ten years was voted as the most influential area of the standardization work of the CCITT and ITU-T in their 50-year history, 2006^[27]
• Technical Achievement award of the International Committee for Information Technology Standards (INCITS) for his work on H.264/MPEG-4 AVC and other video standardization topics, 2005^[28]

Leadership

Sullivan has held the following chairmanships in video coding standardization organizations:

• Rapporteur/chairman of the ITU-T Video Coding Experts Group (VCEG) of ITU-T Study Group 16 – since 1996
• Chairman and co-chairman of the video part of the ISO/IEC Moving Picture Experts Group (MPEG) – chairman March 2001 to May 2002, co-chairman January 2005 to January 2018
• Chairman and co-chairman of the Joint Video Team – chairman for the development of the next generation H.264/MPEG-4 AVC video coding standard and its fidelity-range extensions (FRExt), and co-chairman for the development of the Scalable Video Coding (SVC) and Multiview Video Coding (MVC) extensions – founded December 2001 (group closed November 2009)
• Co-chairman of Joint Collaborative Team on Video Coding (JCT-VC) for developing the High Efficiency Video Coding (HEVC) standard – founded January 2010 (group closed July 2020)
• Co-chairman of Joint Collaborative Team on 3D Video Coding (JCT-3V) for developing 3D extensions of video coding standards – founded July 2012 (group closed June 2016)
• Co-chairman of the Joint Video Experts Team (JVET) for the development of the Versatile Video Coding standard – founded October 2015, served until July 2021
• Chair of ISO/IEC JTC 1/SC 29 – selected as chair-elect in June 2020, chair since January 2021
• Liaison representative to MPEG and JPEG from ITU-T on video and image coding topics

The JVT, JCT-VC, JCT-3V, and JVET have been joint projects between the VCEG and MPEG organizations.

See also

• Moving Picture Experts Group (MPEG)
• Video Coding Experts Group (VCEG)
• Joint Photographic Experts Group (JPEG)
• JPEG XR
• High Efficiency Video Coding (HEVC)
• H.264/MPEG-4 AVC
• H.263 and MPEG-4 Part 2
• H.262/MPEG-2 Part 2
• H.261 and MPEG-1 Part 2
• DirectX Video Acceleration
• Versatile Video Coding
• Windows Media Video
• VC-1

External links

Video coding standardization organizations

• Joint Video Experts Team (JVET)
• Joint Collaborative Team on Video Coding (JCT-VC)
• Joint Collaborative Team on 3D Video (JCT-3V)
• Joint Video Team (JVT)
• ISO/IEC Moving Picture Experts Group (MPEG)
• ITU-T Video Coding Experts Group (VCEG)
• ITU-T Study Group 16 (SG16)

Video coding standards

• ITU-T Rec. H.266, also standardized as ISO/IEC MPEG-I Part 3 (also known as VVC)
• ITU-T Rec. H.265, also standardized as ISO/IEC MPEG-H Part 2 (also known as HEVC)
• ITU-T Rec. H.264, also standardized as ISO/IEC MPEG-4 Part 10 (also known as AVC)
• ISO/IEC MPEG-4 Part 2
• ITU-T Rec. H.263
• ITU-T Rec. H.262, also standardized as ISO/IEC MPEG-2 Video
• ISO/IEC MPEG-1 Video
• ITU-T Rec. H.261

DirectX Video Acceleration

• DirectX Video Acceleration (DXVA)
• DXVA for Video Decoding
• DXVA for VP8 and VP9
• DXVA for HEVC
• DXVA for H.264/MPEG-4 AVC
  • DXVA for H.264/MPEG-4 MVC extensions
  • DXVA for H.264/MPEG-4 SVC extensions
• DXVA for Windows Media Video v8, v9 and vA (Including SMPTE 421M "VC-1")
• DXVA for H.261, MPEG-1, MPEG-2 (H.262), H.263, and MPEG-4 Part 2
  • DXVA for MPEG-4 Part 2 Off-Host VLD Mode (archive link)
  • DXVA for MPEG-1 Off-Host VLD Mode

Notes and References

1. Web site: Gary Sullivan '78 wins IEEE Award . https://web.archive.org/web/20141214115155/http://www.thsrock.net/news/918-gary-sullivan-78-wins-ieee-award . dead . December 14, 2014 . 2014-09-29 . . August 16, 2011.
2. Web site: Gary Sullivan Leads Engineering Team to Emmy Award . . March 17, 2009 . 2015-06-17 . dead . https://web.archive.org/web/20150617125737/https://louisville.edu/speed/ergonomics/site-speed-electrical/spotlights/gary-sullivan-leads-engineering-team-to-emmy-award . June 17, 2015 .
3. Web site: SG16 – List of Questions and Rapporteurs (Study Period 2022–2024) . . 2023-12-27.
4. Web site: . Gary J. Sullivan . 2023-12-27.
5. http://pages.cs.brandeis.edu/~dcc/Programs/Program2013.pdf Data Compression Conference (DCC 2013)
6. https://web.archive.org/web/20181004182910/http://www.vcip2012.org/files/Gary%20J.%20Sullivan.pdf Gary J. Sullivan biography, Visual Communication and Image Processing (VCIP 2012)
7. Web site: Global computing association names 57 fellows for outstanding contributions that propel technology today. Association for Computing Machinery. January 18, 2023. 2023-01-18.
8. Web site: Fellow Memberships Conferred in 2022. 2022-12-21. Society of Motion Picture and Television Engineers.
9. Web site: Gary J. Sullivan. 2022-12-21. Society of Motion Picture and Television Engineers.
10. Web site: Digital Processing Medal: Gary J. Sullivan . 2019-10-25. Society of Motion Picture and Television Engineers.
11. Web site: Digital Processing Medal Recipients: 2019: Gary J. Sullivan . 2019-10-25. Society of Motion Picture and Television Engineers.
12. Web site: Gary Sullivan and team to receive an Engineering Emmy . Society of Photo-Optical Instrumentation Engineers . SPIE . October 4, 2017 . 2017-12-27.
13. Web site: 69th Engineering Emmy Awards: Joint Collaborative Team on Video Coding wins Emmy Award . . November 1, 2017. 2017-11-13.
14. Web site: ITU, ISO and IEC receive another Primetime Emmy for video compression . . October 26, 2017 . 2017-11-13 . 2019-04-19 . https://web.archive.org/web/20190419174859/https://news.itu.int/itu-iso-iec-receive-another-primetime-emmy-for-video-compression-video/ . dead .
15. Web site: Engineering Emmy Award for HEVC Standard . . November 2, 2017 . 2017-11-13 .
16. Web site: John . Roach . Primetime Engineering Emmy Award goes to HEVC, a key technology behind ultra-high definition TV . . September 29, 2017. 2017-11-13.
17. Web site: CSVT Transactions – Best Paper Award . . 2019-10-25 . 2019-12-28 . https://web.archive.org/web/20191228023800/https://ieee-cas.org/csvt-transactions-best-paper-award . dead .
18. Web site: Rob. Knies. Microsoft Research. Video Architect, Microsoft Research Collaborator Wins IEEE Award. 2011-08-30. 2011. Microsoft Research. dead. https://web.archive.org/web/20121012195922/http://research.microsoft.com/en-us/news/headlines/ibukaaward-081511.aspx. 2012-10-12.
19. Web site: Society of Photo-Optical Instrumentation Engineers. SPIE Fellows: 59 New SPIE Fellows Elected. 2009-04-21. 2009. SPIE. dead. https://web.archive.org/web/20090309235035/http://spie.org/x32.xml. 2009-03-09.
20. Web site: Institute of Electrical and Electronics Engineers Communication Society. IEEE CCNC Panelist biographies. 2011-02-28. 2011. dead. https://archive.today/20130414124732/http://cms.comsoc.org/eprise/main/SiteGen/CCNC_2011/Content/Home/conf_agenda/PANELS.html. 2013-04-14.
21. Web site: National Academy of Television Arts and Sciences. Honorees Announced for 60th Annual Technology & Engineering Emmy Awards. 2009-04-21. 2008. dead. https://web.archive.org/web/20090327025620/http://www.emmyonline.org/mediacenter/tech_2k8_winners.html. 2009-03-27. National Academy of Television Arts and Sciences.
22. News: Dolby Laboratories. Dolby Congratulates the Joint Video Team Standards Committee on Its 2008 Primetime Emmy for Developing the H.264/MPEG-4 AVC High Profile. 2009-04-21. Reuters. August 21, 2008. dead. https://web.archive.org/web/20090917030451/http://www.reuters.com/article/pressRelease/idUS126897+21-Aug-2008+BW20080821. 2009-09-17. Dolby Laboratories.
23. Web site: Academy of Television Arts and Sciences. Academy of Television Arts & Sciences Announces Recipients for the 2008 Primetime Emmy Engineering Awards. 2009-04-21. 2008. dead. https://web.archive.org/web/20090203145534/http://cdn.emmys.tv/media/releases/2008/rel-pte60-eng.php. 2009-02-03. Academy of Television Arts and Sciences.
24. Web site: International Multimedia Telecommunications Consortium. IMTC Leadership and Service Awards. 2012-03-24. 2008.
25. Web site: Institute of Electrical and Electronics Engineers. Recipients of the IEEE International Symposium on Consumer Electronics Engineering Excellence Award. 2009-04-21. 2008. dead. https://web.archive.org/web/20080830092940/http://ewh.ieee.org/soc/ces/eng_excellence.html. 2008-08-30. Institute of Electrical and Electronics Engineers.
26. IEEE Announces 2006 Fellows. Computer. 39. 2. 79–83. Institute of Electrical and Electronics Engineers. 2008. 10.1109/MC.2006.59. Ward. B..
27. Web site: ITU-T Newslog. Video Coding Work Voted Most Influential. dead. https://web.archive.org/web/20070930155432/http://www.itu.int/ITU-T/newslog/Video+Coding+Work+Voted+Most+Influential.aspx. 2007-09-30 . October 2, 2006.
28. Web site: International Committee on Technology Standards. INCITS Awards Honor Roll. 2005. INCITS. dead. https://web.archive.org/web/20080517010654/http://www.incits.org/honor.htm. 2008-05-17.