MPEG BASICS

CIE Diagram
Developed in 1931 by a group of scientists under
the umbrella of Commission
Internationale de l'Eclairage (CIE),
or International Lighting
Commission, using a two-dimensional (x,y)
representation of the visible colors.
This diagram allows the user to specify colors by
assigning values to x and y variables. All visible
colors are confined inside a horseshoe-shaped
area.
Saturated colors occupy positions on the curve.
Lower saturation colors occupy positions nearer
to the center of the display.
In addition to defining colors, the CIE diagram
identifies the white light as a set of x and y
values describing a point in the central area of
the diagram.
YEAR ITU ISO/IEC COMMENTS
International
International Standardization
Telecommunications Organization/International
Union Electro-Technical
(Telecommunications, Commission
Radio, TV) (Photography, Computer,
Consumer Electronics)
Very good spatial resolution but poor temporal resolution
1984 H.120
(1544 kbit/s for NTSC and 2048 kbit/s for PAL)
Video Conferencing (originally designed for transmission over
ISDN lines with data rates on multiples of 64 kbit/s. Video bit
1990 H.261
rates are between 40 kbit/s and 2 Mbit/s. Video frame sizes:
CIF (352x288) and QCIF (176x144)
MPEG-1 Video CD (Lossy A/V compression intended to fit a VHS
1993
(ISO/IEC 11172) quality to a CD with a maximum data rate of 1.5MBPS)
MPEG-2
1994 H.262 Digital Cable and Satellite TV
(ISO/IEC 13818-1,2,3)

1995 H.263 Audio Streaming

1997 ATSC-US HDTV Audio/Video Streaming (WM)

MPEG-4
1999
(ISO/IEC 14496) Coding of both Natural and Synthetic images with variable
MPEG-4 part 10 macroblock sizing
2002 H.264 AVC
(ISO/IEC 14496 part 10)
MPEG-H part 2 Enhanced precision and color format support, scalable video
2013 H.265
(ISO/IEC 23008 part 2) coding and 3D/Stereo/Multiview video coding
 General Overview of MPEG
1. Encode and compress the picture from an analog video
2. Encode and compress the audio
3. Get the elementary video/audio streams and packetise them to
form a PES (Program Elementary Stream)
4. Create a transport stream from multiple PES
5. Bind them together with PSI/SI tables (PAT,PMT)
6. Add the PCR to time the system properly
7. Add DVB-SI, (EPG) to describe services and NIT to aid
transmission
8. Send to transmitter for Cable,Satellite or Terrestrial
 MPEG-2 Core Standards
• ISO/IEC 13818-1 (Systems)
– Transport Stream and PES syntax
– T-STD Buffer model (decoder)
– PSI definition (PAT,PMT, CAT,NIT)
– Definition of PCRs, PTS and DTS
• ISO/IEC 13818-2 (Video coding)
– Uses MPEG-1 as base syntax for Sequence, GOP, Picture, Slice and Macro Block
syntax
– Five coding Profiles and four source formats or Levels
– Coding on frame or field basis-interlace.
• ISO/IEC 13818-3 (Audio coding)
– Builds upon ISO/IEC11172-3 (MPEG-1)
– Defines extensions for Multichannel audio and lower sampling frequencies
• ISO/IEC 13818-6 (DSM-CC) Data
– User-to-User functionality
– User-to-Network functionality
– Basis for Data Broadcast
Conversion from Analog to Digital 1-2
5.75Mhz Fs=13.5Mhz
Y Y
RED A/D
Conversion
(8 or 10bit)

2.75Mhz Fs=6.75Mhz
MATRIX

GREEN Cr A/D
Conversion
Cr ITU-BT.R 601
(8 or 10bit) 270MBPS
2.75Mhz Fs=6.75Mhz
BLUE Cb A/D Cb
Conversion
(8 or 10bit)
Conversion from Analog to Digital 2-2
NORTH AMERICAN STANDARD
In an uncompressed video, DEFINITION
all pixels in each frame is Active Lines 483
transmitted and unchanged. Width 720 Pixels

The bitrate is best suited for Frame Rate 30 Frames/second

professional use (editing/ Color Depth 20 bits/pixel

contribution) but is excessive Framing Head 1.3
for practical use or transmission Total Bitrate 270MBPS
 Video Elementary Streams
1.5GBPS (HDTV), 270 MBPS (SDTV)CCIR601“ / ITU-R.BT 601

Compression
to MPEG-1,
MPEG-2,
MPEG-4 or
HEVC
MPEG-1 MPEG-2 HD MPEG-4 HD HEVC
≈ 1.5MBPS ≈ 12 – 20MBPS ≈ 6 – 10MBPS Promises a 50%
More reduction in
MPEG-2 SD MPEG-4 SD The required Data
To represent an image
≈ 3 – 5MBPS ≈ 1.5 – 2.5MBPS
 Video Encoding schemes
• SD Video (Standard Definition)
• HD Video (High definition)

Intended delivery method

• Terrestrial
• Cable TV
• Satellite
• Coaxial/Fiber/HFC
• IP
 MPEG-2 Profiles and Levels
Profile
LEVEL simple main snr spatial high
(also 4:2:2
profile)

High 80Mbit/s 100 Mbit/s

1920 pixels
x 128Mb x x
1152 lines RAM
High 60Mbit/s 80Mb/s
1440 pixels
x 64Mb
x 128Mb
1152 lines RAM
RAM
Main 15Mbit/s 15Mbit/s 15Mbit/s 20Mb/s
720 pixels 8Mb 16Mb 32Mb x 32Mb
576 lines RAM RAM RAM RAM
Low 14Mbit/s 4Mbit/s
352 pixels
x 4Mb 8Mb x x
288 lines RAM RAM
No B frames B frames B frames B frame
B frames 4:2:0 4:2:0 or
4:2:0 4:2:0 4:2:0 SNR & 4:2:2
Not Not SNR spatial SNR &
scaleable scaleable scaleable scaleable spatial
scale
Image courtesy of www.eetimes.com
 4:4:4

Y Luminance

Line M Line M+1 Line M+2 Line M+3

Cr Cb Chrominance
Line N Cr Cr Cr Cr
Y Y Y Y
Cb Cb Cb Cb
Line N+1
Cr Cr Cr Cr
Y Y Y Y
Cb Cb Cb Cb
Line N+2
Cr Cr Cr Cr
Y Y Y Y
Cb Cb Cb Cb
Line N+3
Cr Cr Cr Cr
Y Y Y Y
Cb Cb Cb Cb
 4:2:2

Y Luminance

Line M Line M+1 Line M+2 Line M+3

Cr Cb Chrominance
Line N Cr Cr
Y Y Y Y
Cb Cb
Line N+1
Cr Cr
Y Y Y Y
Cb Cb
Line N+2
Cr Cr
Y Y Y Y
Cb Cb
Line N+3
Cr Cr
Y Y Y Y
Cb Cb
 4:2:0

Y Luminance

Line M Line M+1 Line M+2 Line M+3

Cr Cb Chrominance
Line N
Y Cr Y Y Cr Y

Line N+1
Y Cr Y Y Cr Y

Line N+2
Y Cr Y Y Cr Y

Line N+3
Y Cr Y Y Cr Y
 4:1:1

Y Luminance

Line M Line M+1 Line M+2 Line M+3

Cr Cb Chrominance
Line N
Y Cr Y Y Cr Y

Line N+1
Y Cb Y Y Cb Y

Line N+2
Y Cr Y Y Cr Y

Line N+3
Y Cb Y Y Cb Y
 VIDEO DATA RATES
ANALOG TO DIGITAL CONVERSION
8 BIT 10 BIT
MPEG PROFILE MPEG PROFILE
SAMPLING
FREQ. 4:4:4 4:2:2 4:2:0 4:1:1 4:4:4 4:2:2 4:2:0 4:1:1

VIDEO 3.375
LUMINANCE (Y) 3.375 108 108 108 108 135 135 135 135

CHROMINANCE (Cr) 3.375 108 54 54 27 135 67.5 67.5 33.75

CHROMINANCE
(Cb) 3.375 108 54 0 27 135 67.5 0 33.75

TOTAL
DATA RATE 324 216 162 162 405 270 202.5 202.5
(MBPS)
Capability of MPEG for transmission
IT SENDS :-
• Multiple Compressed Video streams
• Multiple Compressed Audio streams
• Data content, synchronous and
asynchronous
• Synchronisation and timing information
• Programme Guide information
• ….. Joined or ‘Multiplexed’ together
into a single data stream called a
….
TRANSPORT STREAM
 Elementary Stream
• Encoding
– Analogue video input from camera or VCR

• Noise filters,Motion predictors,frame

buffers DCT compressors - all sorts of
stuff
 MPEG-1
• Intra-Frame compression (JPEG)

• No interlace support (Not Broadcast quality)

• CD-ROM bitrates (1.5Mbps)

 MPEG-2
• Ratified as International Standard 1994

• Inter-frame compression
• Spatial (I-frames)
• Temporal (B,P frames)

• Broadcast resolution
• Higher definition
• scalable by profiles and levels
 Number of Lines and Pixels per line
The picture are composed of horizontal slices

Each slice are

divided into
Macroblocks of
16 x 16 pixels

More lines of video results The macroblocks are divided into blocks
into higher resolution of 8 x 8 pixels

Applying Discrete Cosine Transform using

Irrelevancy Reduction
 Transformation from the
Spatial domain to the Frequency domain
Horizontal DC Increasing Horizontal Frequency

Increasing Vertical Frequency

X X X X X X X X X X X X X X X X
X X X X X X X X X X X X X X X X
X X X X X X X X X X X X X X X X
Vertical

X X X X X X X X X X X X X X X X
X X X X X X X X X X X X X X X X
X X X X X X X X X X X X X X X X
X X X X X X X X X X X X X X X X
X X X X X X X X X X X X X X X X

SPATIAL FREQUENCY

Applying Discrete Cosine Transform using

Irrelevancy Reduction
 8 x 8 DCT / IDCT
Time Domain Frequency Domain

DCT

IDCT

8 x 8 pixel block 8 x 8 DCT coefficients

 DCT Coefficients
low high
DC coefficient
Coefficient of highest
horizontal frequency
low

high
Coefficient of highest Coefficient of highest
vertical frequency h+v frequency
Discrete Cosine Transform Scanning
 DCT Scanning on a Macroblock

Original Image Sampled Values DCT Coefficients

The Picture Divided into 8 x 8 Blocks
 Motion Prediction

I Frame B Frame P Frame

Only Motion Encoded
Complete Frame Encoded Ball Encoded with Motion Vector
Ball Bidirectionally from I & P
from I frame
Revealed Knee from P frame
 Moving Pictures

Moving Parts and Fix Parts of Pictures

 Difference of Pictures
GOP
D D D D

I P P P P I
I = Intra Frame Coded Picture
P = Predicted Picture
GOP = Group of Pictures
Difference Pictures with Motion Detection
GOP

D D D D

I P P P P I
I = Intra Frame Coded Picture
= Motion Vector = Block P = Predicted Picture
GOP = Group of Pictures
 GOP
D
Difference
D
Pictures
D
D
D D

I B B P B I = IntraI Frame Coded Picture

Forward Backward P = Predicted Picture
Prediction Prediction B = Bidirectional Predicted Picture
GOP = Group of Pictures
Transmission Sequence
I10
B5
B4
P6
B2
B1
P3
B-1
B-2
I0
Experimental Results stemming from eye tracking

Source Density Map Human eye

Auto-Region of Interest Detection

ROI Markers

If No
Markers,
then
Center Cut
 MOTION VECTORS

Moving pictures in “MPEG’’ is subjected to the determination of

Differences on the succeeding and preceding frames, as such,
The ‘delta’ of pixels, blocks or macroblocks from the frames are
Moved through the estimated position.
http://xiph.org/~xiphmont/demo/theora/demo2.html
Data distribution in each frame of GOP
MPEG-4 AVC Coder
MPEG-H part 2 (HEVC)
 Summary of Display formats
Super High
Standard Definition Near HD High Definition
Definition
Number of Lines 525 525 750 1125 1125 8000
Number of Active
483 483 720 1080 1080 7680
Lines
Scanning format Interlaced Progressive Progressive Interlaced Progressive Interlaced

Pixels per line

Lines per Frame
Concept of Super Hi-Vision
Comparison between HDTV and SHV
SHV Image format

Image Property of NHK, Japan

Concept of Super Hi-Vision
 Comparing Picture Resolutions
Standard Definition 640 x
480

Television resolution 1920 x 1080

(ok)
representative of
High
AnalogDefinition
TV quality 2160 x 3840

Television
(480i). resolution
representative of
Ultra HighHDTV
Standard Definition 4320 x 7680 (ok)
Television resolution
quality (1080i).
representative of the
next generation TV
Super High(4K).
resolution Definition
Television resolution
for the ultimate
realism of the video
experience (8K).
SHV Video System

Image Property of NHK, Japan

SHV Projection System

Image Property of NHK, Japan

SHV Audio Configuration

Image Property of NHK, Japan

Developed in 1931 by a group of
scientists under the umbrella of
Commission Internationale de
l'Eclairage (CIE), or International
Lighting Commission, using a
two-dimensional (x,y)
representation of the visible colors.
This diagram allows the user to
specify colors by assigning values
to x and y variables. All visible
colors are confined inside a
horseshoe-shaped area.
Saturated colors occupy positions
on the curve.
Lower saturation colors occupy
positions nearer to the center of
 Reference

NHK SCIENCE AND TECHNICAL RESEARCH LABORATORIES

www.nhk.or.jp/english

DIGITAL BROADCASTING EXPERTS GROUP

www.dibeg.org

ASIA PACIFIC BROADCASTING UNION

www.abu.org.my

NATIONAL ASSOCIATION OF BROADCASTERS

www.nab.org

ROHDE & SCHWARZ

www.rohde-schwarz.com

TEKTRONIX
www.tektronix.com