Video file format explained

A video file format is a type of file format for storing digital video data on a computer system. Video is almost always stored using lossy compression to reduce the file size.

A video file normally consists of a container (e.g. in the Matroska format) containing visual (video without audio) data in a video coding format (e.g. VP9) alongside audio data in an audio coding format (e.g. Opus). The container can also contain synchronization information, subtitles, and metadata such as title. A standardized (or in some cases de facto standard) video file type such as .webm is a profile specified by a restriction on which container format and which video and audio compression formats are allowed.

The coded video and audio inside a video file container (i.e. not headers, footers, and metadata) is called the essence. A program (or hardware) which can decode compressed video or audio is called a codec; playing or encoding a video file will sometimes require the user to install a codec library corresponding to the type of video and audio coding used in the file.

Good design normally dictates that a file extension enables the user to derive which program will open the file. That is the case with some video file formats, such as WebM (.webm), Windows Media Video (.wmv), Flash Video (.flv), and Ogg Video (.ogv), each of which can only contain a few well-defined subtypes of video and audio coding formats, making it relatively easy to know which codec will play the file. In contrast to that, some very general-purpose container types like AVI (.avi) and QuickTime (.mov) can contain video and audio in almost any format, and have file extensions named after the container type, making it very hard for the end user to use the file extension to derive which codec or program to use to play the files.

The free software FFmpeg project's libraries have very wide support for encoding and decoding video file formats. For example, Google uses ffmpeg to support a wide range of upload video formats for YouTube.[1] One widely used media player using the ffmpeg libraries is the free software VLC media player, which can play most video files that end users will encounter.

List of video file formats

NameFile extension(s)Container formatVideo coding format(s)Audio coding format(s)Notes
WebM.webmMatroskaVP8, VP9, AV1Vorbis, OpusRoyalty-free format created for HTML video.
Matroska.mkvMatroskaanyany
Flash Video (FLV).flvFLVVP6, Sorenson Spark, Screen video, Screen video 2, H.264MP3, ADPCM, Nellymoser, Speex, AACUse of the H.264 and AAC compression formats in the FLV file format has some limitations and authors of Flash Player strongly encourage everyone to embrace the new standard F4V file format[2] de facto standard for web-based streaming video (over RTMP).
F4V.flvMPEG-4 Part 12H.264MP3, AACReplacement for FLV.
Vob.vobVOBH.262/MPEG-2 Part 2 or MPEG-1 Part 2PCM, DTS, MPEG-1, Audio Layer II (MP2), or Dolby Digital (AC-3)Files in VOB format have .vob filename extension and are typically stored in the VIDEO_TS folder at the root of a DVD. The VOB format is based on the MPEG program stream format.
Ogg Video.ogv, .oggOggTheora, DiracVorbis, FLAC
Dirac.drc?Dirac?
GIF.gifN/AN/AnoneSimple animation, inefficient compression, no sound, widely supported
Video alternative to GIF.gifvHTMLanynoneNot standardized, and not a real video file in the classical meaning since it merely references the real video file (e.g. a .webm file), which has to exist separately elsewhere. A .gifv "file" is simply a HTML webpage which includes a HTML video tag, where the video has no sound. As there were large communities online which create art using the medium of short soundless videos in GIF format, GIFV was created as a functionally similar replacement with vastly smaller filesizes than the inefficient GIF format.
Multiple-image Network Graphics.mngN/AN/AnoneInefficient, not widely used.
AVI.aviAVIanyanyUses RIFF
MPEG Transport Stream.MTS, .M2TS, .TSAVCHDAVCHD (MPEG-4 / H.264)Dolby AC-3 or uncompressed linear PCMThe standard video format used by many Sony and Panasonic HD camcorders. It is also used for storing high definition video on Blu-ray discs.
QuickTime File Format.mov, .qtQuickTimemany[3] AAC, MP3, others
Windows Media Video.wmvASFWindows Media Video, Windows Media Video Screen, Windows Media Video ImageWindows Media Audio, Sipro ACELP.net
Raw video format.yuvFurther documentation neededDoesn't applyDoesn't applySupports all resolutions, sampling structures, and frame rates
RealMedia (RM).rmRealMediaRealVideoRealAudioMade for RealPlayer
RealMedia Variable Bitrate (RMVB).rmvbRealMedia Variable BitrateRealVideoRealAudioMade for RealPlayer
VivoActive (VIV).vivVIVbased upon H.263 video G.723 ADPCM audio (not the G.723.1 speech codec)Made for VivoActive Player
Advanced Systems Format (ASF).asfASFanyany
AMV video format.amvModified version of AVI[4] Variant of Motion JPEGVariant of IMA, ADPCMProprietary video file format produced for MP4 players and S1 MP3 players with video playback
MPEG-4 Part 14 (MP4).mp4, .m4p (with DRM), .m4vMPEG-4 Part 12H.264, H.265, MPEG-4 Part 2, MPEG-2, MPEG-1Advanced Audio Coding, MP3, others
MPEG-1.mpg, .mp2, .mpeg, .mpe, .mpvMPEG-1 part 1MPEG-1 part 2MPEG-1 Audio Layer I, MPEG-1 Audio Layer III (MP3)Old, but very widely used due to installed base.
MPEG-2 – Video.mpg, .mpeg, .m2v?H.262AAC, MP3, MPEG-2 Part 3, others
M4V.m4vMPEG-4 Part 12H.264AAC, Dolby DigitalDeveloped by Apple, used in iTunes. Very similar to MP4 format, but may optionally have DRM.
SVI.sviMPEG-4 utilising a special header??Samsung video format for portable players
3GPP.3gpMPEG-4 Part 12MPEG-4 Part 2, H.263, H.264AMR-NB, AMR-WB, AMR-WB+, AAC-LC, HE-AAC v1 or Enhanced aacPlus (HE-AAC v2)Common video format for cell phones
3GPP2.3g2MPEG-4 Part 12MPEG-4 Part 2, H.263, H.264AMR-NB, AMR-WB, AMR-WB+, AAC-LC, HE-AAC v1 or Enhanced aacPlus (HE-AAC v2), EVRC, SMV or VMR-WBCommon video format for cell phones
Material Exchange Format (MXF).mxfMXF??
ROQ.roq???used by Quake 3[5]
Nullsoft Streaming Video (NSV).nsvNSV??For streaming video content over the Internet
Flash Video (FLV).flv .f4v .f4p .f4a .f4bAudio, video, text, dataAdobe Flash PlatformSWF, F4V, ISO base media file formatDeveloped by the Adobe Flash Platform

See also

References

  1. Web site: Google's YouTube Uses FFmpeg Breaking Eggs And Making Omelettes. multimedia.cx. 9 February 2011.
  2. Kaourantin.net (31 October 2007) Tinic Uro New File Extensions and MIME Types, Retrieved on 2009-08-03
  3. Web site: QuickTime File Format. 2013-02-14. www.digitalpreservation.gov.
  4. https://code.google.com/archive/p/amv-codec-tools/wikis/AmvDocumentation.wiki "AMV codec tools"
  5. Web site: RoQ - MultimediaWiki. wiki.multimedia.cx.