MPEG

		quincunx_sampling_flag
frame_packing_arrangement_type		0	1
0	checkerboard	D-1
1	column based interleaving	D-2
2	row based interleaving	D-3
3	side-by-side	D-4	D-6
4	top-and-bottom	D-5
5	temporal interleaving of alternating frames	D-7

Free viewpoint television

Free viewpoint television (wp)
Implementations

iview (BBC)
Eye Vision (Carnegie Melon / Super Bowl)

Standards

MPEG-4 part 10 "Multiview coding (MVC)" (3DAV group)

MPEG at LTS
Re Technology Technical Library

ITU-T		(joint)	ISO-IEC (standards)						part	name		layer	free public standard		doc		implementation		application
			JTC	SC	WG	number	title	name					ISO/IEC	ITU	MPEG technologies	Tutorials and seminars MPEG Visions /	programari	maquinari
			1	24 (Computer graphics and image processing)			GKS, PHIGS, CGM, VRML, X3D
				29 (Coding of audio, picture, multimedia and hypermedia)	1	03 (11544)	JBIG-1
						04 (10918)	JPEG
						10 (14492)	JBIG-2
						12 (14495)	JPEG-LS
						14 (15444)	JPEG 2000
						16 (16485)	MRC
						20 (24800)	JPSearch
					11 (MPEG)	11172	MPEG-1	Coding of moving pictures and associated audio for digital storage media at up to about 1,5 Mbit/s	1	Systems - Program streams
									2	Video for CD-I
									3	Audio		I
												II
												III (mp3)
									4	Conformance			x
									5	Technical report - Software simulation			x
						13818	MPEG-2	Generic coding of moving pictures and associated audio information	1	Systems (TS) (amdt. 6 "Transport of scalable video over ITU-T Rec H.220/ ISO/IEC 13818-1": AVC_video_descriptor)							ts-muxer
H.262 (doc)	VCEG								2	Video (profiles/levels)				07/95			ffmpeg
									3	Audio
									4	Conformance			x
									5	Technical report			x
									6	DSMCC
									7	AAC
									8
									9	RTI
									10	Conformance Extensions for DSMCC
									11	IPMP on MPEG2
						14496	MPEG-4	Coding of audio-visual objects	1	Sytems						MPEG-4 Sytems FAQ (Chiariglione)
									2	Visual (profiles/levels)	SP					MPEG-4 Video FAQ (Chiariglione)
H.263 (doc)									2	Visual (profiles/levels)	ASP			01/05					Flash Video DivX >=4.0 Xvid
									3	Audio (AAC)						MPEG-4 Audio FAQ (Chiariglione)	faac, faad (RareWares)
									4	Conformance			x
									5	Reference software			x
									6	DMIF						MPEG-4 DMIF FAQ (Chiariglione)
									7	Optimized software			x
									8	MPEG-4 on IP
									9	Reference hardware
H.264 (1,2) (doc)	VCEG								10	AVC (profiles/levels)				11/07 03/10 corrigendum		JVT (ITU-T) JVT-G050r1 JVT-T202 Overview Wikipedia MPEG-4 & co MP4 FAQ White papers (Envivio): MPEG4 over RTP/TS MPEG-4 RTP transport	Comparison with previous codecs (ITU H.264 flyer) comparison (doom9) MPEG-4 AVC/H.264 video codecs list (doom9) Wikipedia (products and implementations) x264 () nvidia PureVideo () coreAVC TML with KorFMD DGAVCDec	Wikipedia ATI Nvidia Pure Video iPod MPEG-4 AVC/H.264 video codecs list (doom9)	Wikipedia HD DVD (HiP) Blue Ray (HiP)
H.264 (1,2) (doc)	VCEG	JVT								SVC (Annex G)						JVT (ftp) JVT-T202 Annex G JVT-U202 (oct 2006) JVT-X201 (jun 2007) Scalable Extension of H.264/AVC (HHI) EBU Technical 2008 2008 Q2 Test sequences RTP transport NAL unit type Multimedia Communications with Scalable Video Coding Overview of the real-time SVC en/decoder (pdf) Scalable Video Coding: The Future of Video Delivery? (Streamingmedia)	SVC Reference software (HHI) IMEC analysis SVC Analyzer EvalSVC search svc on lists coder x264-devel eInfochips (*) MainConcept Vanguard Software (packet loss demo) decoder OpenSVC decoder Wiki Tutorial ffmpeg-devel GoC 2008 and H264 SVC decoder svcfilters (DirectShow)	Texas Instruments ms320c6474 Freescale-DSP	GE Security Global IP Solutions Vidyo (Google gmail) Vidiyocast Radvision Projects: Scalim@ages SVC4QOE Scalnet
										MVC (Annex H)					1-pager	Advances on Coding and Transmission of Scalable Video and Multiview Video 1-pager Multimedia Communications with Scalable Video Coding Test sequences	Fraunhofer HHI Main Concept Net Blender Nokia MVC software		DIOMEDES Nem Summit MUSCADE Nem Summit
									11	Scene Description and Application Engine (BIFS MPEG-J)
									12	ISO Base Media File Format			x			Formats de fichiers MPEG			(MP4, 3GP, MJP2, MP21, AVC)
									12	AMD 1: General Improvements including hint tracks, metadata support and sample groups
									13	IPMP Extensions
									14	MP4 File format						(extension of part 12)
									15	Advanced Video Coding File Format (amd. 2008: includes SVC)						(extension of part 12)
									16	AFX (3D)						MPEG-4 3D Graphics FAQ (Chiariglione)
									17	Streaming Text Format
									18	Font Compression and Streaming
									19	Synthesized Streams
									20	Laser			x
									20	SAF			x
									21	MPEG-J Graphical Framework eXtension (GFX) (3D)						MPEG-4 3D Graphics FAQ (Chiariglione)
									22	Open Font Format
									23	Symbolic Music Representation (SMR)
									24	Audio and systems interaction
									25	3D Graphics Compression Model						MPEG-4 3D Graphics FAQ (Chiariglione)
									26	Audio conformance
									27	3D Graphics conformance
H.265 / H.NGVC / ...		JCT							?	HEVC (High Efficiency Video Coding)						H265.net DVB Scence #36
						15938	MPEG-7	Multimedia content description interface	1	Systems						MPEG-7 FAQ (Chiariglione)
									2	DDL
									3	Visual
									4	Audio
									5	Multimedia description schemes
			6						Reference software			x
			7	Conformance testing							x
			8	Extraction and use of description
			9	MPEG-7 Profiles
			10	Schema Definition							x
			11	Profile schemas							x
			21000	MPEG-21		Multimedia framework	1	Technical Report			x			MPEG-21 FAQ (chiariglione) Klagenfurt University
							2	DID			x
					3		DII
					4		IPMP
					5		Rights Expression Language
					6		Rights Data Dictionary
					7		DIA
					8		Reference Software			x
					9		File Format									MP21Box
					10		DIP
					11		Evaluation Methods for Persistent Association
					12		Test Bed for MPEG-21 Resource Delivery
					13		SVC
					14		Conformance Testing
					15		Event Reporting
					16		Binary Format
					17		Fragment Identification of MPEG Resources
					18		DIS
			23000	MPEG-A	Multimedia Application Format - MAF	1	Purpose of MAFs
						2	Music player AF
						3	Photo player AF
						4	Musical slide show AF
						5	Media streaming AF
						6	Professional archiver AF
						7	Open access AF
						8	Portable video AF
						9	Digital Multimedia Broadcasting - DMB AF
						10	Video surveillance AF
						11	Stereoscopic video AF
			23001	MPEG-B	MPEG systems technologies	1	Binary MPEG format for XML
						2	Fragment Request Units
						3	XML IPMP messages
						4	Codec configuration representation
						5	Bitstream Syntax Description Language (BSDL)
						?	Dynamic Adaptive Streaming over HTTP (DASH)
			23002	MPEG-C	MPEG video technologies	1	Accuracy requirements for implementation of integer-output 8x8 inverse discrete cosine transform
						2	Fixed-point 8x8 inverse discrete cosine transform and discrete cosine transform
						3	Representation of auxiliary video streams and supplemental information (2D+Depth)
						4	Video tool library
			23003	MPEG-D	MPEG audio technologies	1	MPEG Surround
						2	Spatial Audio Object Coding (SAOC)
						3	Unified Speech and Audio Coding (USAC)
			23004	MPEG-E	Multimedia Middleware	1	Architecture
						2	Multimedia application programming interface (API)
						3	Component model
						4	Resource and quality management
						5	Component download
						6	Fault management
						7	System integrity management
						8	Reference software
				(MPEG-J)
			23006	MPEG-M	MPEG extensible middleware (MXM) Multimedia Service Platform Technologies	1	MXM architecture and technologies						MPEG eXtensible Middleware Vision
						2	MXM API
						3	MXM Reference software
						4	MXM Protocols
H.721	Q.13 / SG16						ITU-T: The IPTV Terminal (Basic Model)				03/09
						?	Advanced IPTV Terminal						AIT Call for Proposals AIT Context & Objectives AIT Use cases AIT Requirements
							(Mobile IPTV Terminal)
			23007	MPEG-U	Rich media user interfaces (widgets)	1	Widgets						Presentation of MPEG-U (C. Concolato)
						2	Advanced User Interaction Interface
						3	Conformance and reference software
			23005	MPEG-V	Information exchange with virtual worlds (Metaverse) Media Context and Control	1	Architecture						Interfacing with virtual worlds (Media Context and control) (NEM)
						2	Control information
						3	Sensory information
						4	Virtual world object characteristics
						5	Data formats for interaction devices
						6	Common types and tools
						7	Conformance and reference software
			?	MMT	MPEG Media Transport								Kyoto workshop 2010 London workshop 2009



			12	13522	MHEG		5	MHEG-5
			JTC	SC	WG	number	title	name					ISO/IEC	ITU			programari	maquinari
ITU-T		(joint)	ISO-IEC (standards)						part	name		layer	free public standard			doc	implementation		application

ES (0xa6)	PES	SPTS	TS
ES (0x65)	PES	SPTS
ES (0xa7)	PES	SPTS
ES (0x66)	PES	SPTS

MPEG technologies (summary, 1-pager, white paper, presentation)

			standards
1. Media Coding	2D video coding	MPEG-1 video	MPEG-1/2
		MPEG-2 Video	MPEG-2/2
		MPEG-4 Visual (rect)	MPEG-4/2
		Shape coding
		Advanced video coding	MPEG-4/10
		Scalable video coding	MPEG-4/10
		Multi-view coding	MPEG-4/10
		High performance video coding
	Decoder representation	Reconfigurable video coding
	Decoder representation	Coding tool repository
	3D video coding	Auxiliary video data	MPEG-C/3 ?
	3D video coding	3D video coding
	Audio coding	...
	2D graphic coding	Texture coding
	2D graphic coding	2D mesh coding
	3D graphic coding	Face and body animation
		3D mesh coding
		AFX
	Synthetic audio coding	...
	Text coding	...
	Font coding	Font compression and streaming
	Font coding	Open Font Format
	Music coding	...
	Media Context and control	Control information
		Sensory information
		Virtual object characteristics
	Media value chains
2. Composition coding	Composition coding	Binary format for scenes
		Audio BIFS
		BIFS for digital audio
		Lightweigth scene representation	MPEG-4/20
		Presentation and modification od structured information
3. Description coding	Description technologies	Description definition language
	Description technologies	MPEG-7 schemas
	Video description	Low level descriptions
		High level descriptions
		Overview
		Visual description tools
		Image and video signature
	Audio description	Low level descriptions
	Audio description	High level descriptions
	Multimedia description	Multimedia description schemes
4. Systems support	Multiplexing and synchronization	MPEG-1
		MPEG-2
		MPEG-4
	Signaling	DSM-CC user to user
		DSM-CC user to network
		DMIF
5. IPMP	General	MPEG technologies for DRM
	Identification technologies	MPEG-2 copyright identifier
		Object content information
		Digital Item identification	MPEG-21/3
	Rights expression technologies	...
	Persitent association technologies	...
	Access technologies
6. Digital Item	Digital item technologies	Digital item declaration	MPEG-21/2
		Digital item processing
		C++ bindings
		Session mobility
		Event reporting
		Schema files
		Digital item representation
	Resources in Digital Items	Digital item adaptation
	Resources in Digital Items	Fragment identification for MPEG resources
7. Transport and file format	Transport of media streams	Program stream	MPEG-1/1
		Transport stream	MPEG-2/1
		M4Mux
		MPEG Media Transport
	Media file formats	ISO base media file formats	MPEG-4/12
		MPEG-4 file format	MPEG-4/14
		AVC file format	MPEG-4/15
		SVC file format	MPEG-4/15
		MVC file format
		Digital item file format	MPEG-21/9
	Transport of digital items	Digital item streaming
8. User interaction	User interaction	Widgets	MPEG-U
8. User interaction	User interaction	Advanced user interaction
9. Multimedia architecture	Terminal architecture	...
	Application programming interfaces	MPEG-J
		MPEG-J GFX	MPEG-4/21
		M3W multimedia API
		MXM API	MPEG-M
	Terminals	...
10. Application formats	Application formats	Music player	MPEG-A/2
		Photo player	MPEG-A/3
		Musical slide show	MPEG-A/4
		Media streaming	MPEG-A/5
		Professional archiving	MPEG-A/6
		Open access	MPEG-A/7
		Portable video	MPEG-A/8
		Digital multimedia broadcasting	MPEG-A/9
		Video surveillance	MPEG-A/10
		Stereoscopic video	MPEG-A/11
		Interactive music
11. Generic media technologies	XML technologies	Binary MPEG format for XML	MPEG-B/1
	Signal processing technologies	Generic inverse DCT specification	MPEG-C/1
	Signal processing technologies	Fixed point implementation of DCT/IDCT	MPEG-C/2
	Bitstream technologies	...
12. Protocols	Protocols	MXM protocols	MPEG-M
13. Reference implementations	Reference software
13. Reference implementations	Reference hardware description
14. Conformance	MPEG-1		MPEG-1/4
	MPEG-2		MPEG-2/4
	MPEG-4		MPEG-4/4
	MPEG-7		MPEG-7/7
	MPEG-21		MPEG-21/14
	MPEG-A
	MPEG-B
	MPEG-C
	MPEG-D
	MPEG-E
	MPEG-M
	MPEG-U
	MPEG-V
15. Maintenance	MPEG-1
	MPEG-2
	MPEG-4
	MPEG-7
	MPEG-21
	MPEG-A
	MPEG-B
	MPEG-C
	MPEG-D
	MPEG-E
	MPEG-M
	MPEG-U
	MPEG-V

Estàndards / Standards

ISO/IEC freely available standards

WD	Working Draft
CD	Comitee Draft
FCD	Final Comitee Draft
FDIS	Final Draft International Standard
IS	International Standard
PDAM	Proposed Amendment
FPDAM	Final Proposed Draft Amendment
FDAM	Final Draft Amendment
AMD	Amendment
DCOR	Draft Corrigenda
COR	Corrigenda
PDTR	Proposed Draft Technical Report
DTR	Draft Technical Report
TR	Technical Report

		3m		4m		2m
Specification	CD	->	FCD	->	FDIS	->	IS
Amendment	PDAM	->	FPDAM	->	FDAM	->	AMD
Corrigenda	-	->	DCOR	->	-	->	COR
Technical report	PDTR	->	-	->	DTR	->	TR

m: input documents; w:output documents

Maquinari
- MPEG hardware acceleration
Programari / Software
- Utilitats (analitzadors)
Taules SI
- PAT
- PMT
- NIT

MPEG-2 (ISO/IEC 13818)

MPEG-2

MPEG headers

Appendix A: MPEG header tables (Investigation into digital video streams, Peter Daniel)

part 2: video

video sequence

sequence header: aspect ratio (AR), [AFD]
[additional sequence header]
group of pictures (GOP)

group_of_pictures_header: [AFD]
picture: I, B, P

picture header: [AFD]
slice

macroblock (16x16 pixels): 4 Y blocks + 1 Cr block + 1 Cb block

block (8x8 pixels)

end of sequence

A beginners guide for MPEG-2 standard
MPEG-2 encoder chip (Sony)

max br (bps)	max samples			maximum video bit rate (bps)
80M	1920x1080@30 1920x1152@25 1280x720@60	levels	high		80M	300M			100M
60M	1440x1080@30 1440x1152@25 1280x720@30		high-1440		60M	80M		60M	80M
15M	720x480@30 720x576@25 352x288@15 320x240@24		main	15M 384k	15M	50M	15M		20M
4M	352x240@30 352x288@25 352x288@30 176x144@15		low	96k	4M		4M
				simple	main	422	SNR	spatial	high
				profiles
frames			I	x	x	x	x	x	x
			P	x	x	x	x	x	x
			B		x	x	x	x	x
YCbCr			4:2:0	x	x		x	x	x
YCbCr			4:2:2			x			x
scalable			SNR				x	x	x
scalable			spatial					x	x

ISO_639_language_descriptor (used in PMT) (dvbsnoop source code: dvbstrAudio_TYPE) (ISO/IEC 13818-1 2.6.19)

lang: ISO 639-2 (Alpha-3) (added by DVB)

audio_type		used for
0x00	undefined	main audio
0x01	clean effects	no language
0x02	hearing impaired	Clean Audio
0x03	visual impaired commentary
0x04 - 0xff	reserved

stream_type (used in PMT) (dvbsnoop source code: dvbstrStream_TYPE)

0x00	ITU-T \| ISO/IEC Reserved
0x01	ISO/IEC 11172 Video
0x02	ITU-T Rec. H.262 \| ISO/IEC 13818-2 Video or ISO/IEC 11172-2 constrained parameter video stream
0x03	ISO/IEC 11172 Audio (MPEG-1 audio)
0x04	ISO/IEC 13818-3 Audio (MPEG-2 audio)
0x05	ITU-T Rec. H.222.0 \| ISO/IEC 13818-1 private_sections
0x06	ITU-T Rec. H.222.0 \| ISO/IEC 13818-1 PES packets containing private data
0x07	ISO/IEC 13522 MHEG
0x08	ITU-T Rec. H.222.0 \| ISO/IEC 13818-1 Annex A DSM CC
0x09	ITU-T Rec. H.222.1
0x0a	ISO/IEC 13818-6 type A
0x0b	ISO/IEC 13818-6 type B
0x0c	ISO/IEC 13818-6 type C
0x0d	ISO/IEC 13818-6 type D
0x0e	ISO/IEC 13818-1 auxiliary
0x0f	ISO/IEC 13818-7 Audio with ADTS transport sytax
0x10	ISO/IEC 14496-2 Visual
0x11	ISO/IEC 14496-3 Audio with LATM transport syntax as def. in ISO/IEC 14496-3/AMD1
0x12	ISO/IEC 14496-1 SL-packetized stream or FlexMux stream carried in PES packets
0x13	ISO/IEC 14496-1 SL-packetized stream or FlexMux stream carried in ISO/IEC 14496 sections
0x14	ISO/IEC 13818-6 DSM-CC synchronized download protocol
0x15	Metadata carried in PES packets using the Metadata Access Unit Wrapper
0x16	Metadata carried in metadata_sections
0x17	Metadata carried in ISO/IEC 13818-6 (DSM-CC) Data Carousel
0x18	Metadata carried in ISO/IEC 13818-6 (DSM-CC) Object Carousel
0x19	Metadata carried in ISO/IEC 13818-6 Synchronized Download Protocol using the Metadata Access Unit Wrapper
0x1a	IPMP stream (defined in ISO/IEC 13818-11, MPEG-2 IPMP)
0x1b	AVC video stream as defined in ITU-T Rec. H.264 \| ISO/IEC 14496-10 Video
0x1c-0x7e	ITU-T Rec. H.222.0 \| ISO/IEC 13818-1 Reserved
0xd1	Dirac video
0x7f	IPMP stream
0x08-0xff	User Private

MPEG-7 (ISO/IEC 15938)

MPEG-7
- MPEG-4 and MPEG-7 (seminar in smd074)
- MPEG-7
- Multimedia Metadata Community
- M-Tool (Enthrone)
- Axmedis
- Caliph & Emir (for images)

MPEG-21 (ISO/IEC 21000)

MPEG-21

MPEG21

Bitstream Syntax Description Language (BSDL)

"XML-based Exploitation of Region of Interest Scalability in Scalable Video Coding" (pdf)

"Using MPEG-21 DIDL to Represent Complex Digital Objects in the Los Alamos National Laboratory Digital Library" (UUID)
GPAC

MMT (MPEG Media Transport / MPEG Modern Transport / Modern Media Transport / Multi Media Transport)

Kyoto Workshop

MMT Workshop in Kyoto 2009 (Kyoto, JP, 2010/01/20)

DVB Work on Multimedia Transport (estàndards DVB, esquemes de piles de protocols, GSE, MMT, HBB...)
Industry viewpoint of Internet TV over IP Networks: Trends and Technologies (OTT, P2P streaming, CDN-P2P...)
...

89th MPEG London Workshop 2009

Workshop on MMT (Modern Media Transport) – Call for Contributions (Multimedia Communication blog)
Presentations of MMT Workshop in London 2009 (Chiariglione)
Use cases and requirements of MMT

Fixed and mobile convergence (FMC)
Post HD
Adaptive progressive download
Open IPTV over unmanaged network
Context-aware streaming

Draft MPEG Media Transport (MMT) Context and Objectives

http://www.terra.es/personal9/francesc.pinyol/mpeg.html
Primera versió: 22 de febrer de 2008 / First version: 22nd February 2008
Darrera modificació: 29 de desembre de 2010 / Last update: 29th December 2010

Cap a casa / Back home.

MPEG

Index

General

MPEG

MPEG-2 (ISO/IEC 13818)

MPEG-4 (ISO/IEC 14496)

MPEG-7 (ISO/IEC 15938)

MPEG-21 (ISO/IEC 21000)

MMT (MPEG Media Transport / MPEG Modern Transport / Modern Media Transport / Multi Media Transport)