1. •1
MPEG-7
STANDARDS
[MULTIMEDIA CONTENT
DISCRIPTION INTERFACE]
PRESENTED BY:
NILESH R. JAISWAR

2. INDEX
•2
MPEG-7 OVERVIEW
MAJOR FUNCTIONALITIES
DETAILED TECHNICAL DISCRIPTION
PROFILING
BEYOND VERSION -1
CONCLUSION

3. •3
MPEG-7:
•An international standard for descriptions and description systems
•Goal: To search, identify, filter and browse audiovisual content
•Image/Video Retrieval
•Text-based Retrieval
•Content-based Retrieval
INTRODUCTION

4. •4
Why DO WE NEED MPEG-7 ?
N e e d
• Content Management
• Fast & Accurate Access
• Personalized Content
Production and
Consumption
• Automation
+
Support for Advanced Query
•Visual
•Audio
•Sketch

5. MPEG: A BRIEF hISTORy
•5
 MPEG: Moving Picture Experts
Group
 ISO / IEC/JTC1/SC29/WG11
A Working Group of ISO/IEC in charge of the
Development of Standards for
Coded Representation of Digital Audio and Video
Established in 1988

6. MPEG: A BRIEF hISTORy
•6
 MPEG-1: Interactive CD and MP3 11 / 1992
 MPEG-2: DTV, STB, DVD 11 / 1994
 MPEG-4: Web and Mobility ver1: 09 /1998
ver2: 11 /1999
 MPEG-7: ??? 09 / 2001
 MPEG-21: Multimedia Framework 11 / 2001

7. MPEG-7: WhAT IS IT ?
•7
THE MPEG 7THE MPEG 7
STANDARDSTANDARD
THE MPEG 7THE MPEG 7
STANDARDSTANDARD
Content Description of
Various Audio Visual
Information
IS NOT a COMPRESSION Standard
similar to MPEG-1/2/4 or their
Extension
IS NOT a STANDARD for
FEATURE
EXTRACTION/MATCHING
Types of Audio Visual Information
• Audio, Speech
• Moving video, still pictures, graphics
• Information on how objects are
combined in scenes
Types of Audio Visual Information
• Audio, Speech
• Moving video, still pictures, graphics
• Information on how objects are
combined in scenes

8. MPEG-7: APPlicAtion ArEAs
Storage and retrieval of audiovisual databases (image, film,
radio archives)
Broadcast media selection (radio, TV programs)
E-commerce and Tele-shopping (searching for clothes / patterns)
Remote sensing (cartography, ecology, natural resources management)
Entertainment (searching for a game, for a karaoke)
Cultural services (museums, art galleries)
Journalism (searching for events, persons)
Intelligent multimedia presentations
Educational applications
Bio-medical applications

9. MPEG-7: MAin ElEMEnts
•9
Descriptors (D)
syntax and semantics of each feature representation
Description Schemes (DS)
structure and semantics of the relationships between
components
Description Definition Language (DDL)
creation of new DS’s
modification/extension of existing DS’s

10. MPEG-7: MAjor
FunctionAlitiEs
•10
Systems (ISO / IEC 15938 )
Description Definition Language (ISO / IEC 15938)
Visual (ISO / IEC 15938)
Audio (ISO / IEC 15938)
Multimedia Description Schemes (ISO / IEC 15938)

11. MPEG-7: systEMs
•11
It defines tools to:
 manage and protect intellectual property
Includes currently the binary format for encoding
 synchronize between content and description
 provide for efficient storage and transport

12. MPEG-7: DDl AnD its coMPonEnts
•12
 A language that allows the creation of new Description
Schemes and, possibly, Descriptors.”
“It also allows the extension and modification of existing
Description Schemes.”
Description Definition Language:
It is based on XML Schema Language
Consists of
XML Schema Structural Components
XML Schema Data Types
MPEG-7 Specific Extensions

13. MPEG-7: AuDio
•13
Sound Effects
• High-Level Audio Description Tools (Ds & DSs)
•Instrumental timbre description tools
•Sound recognition tools
•Spoken content description tools
•Melody description tools (facilitate query-by- humming)

14. MPEG-7: VisuAl
•14
Consist of basic structures and description
Color
quantization, dominant, scalable, color-structure, layout,
GoF/GoP
Texture
Shape
region-based, contour-based, 3D
Motion
camera motion, motion trajectory, parametric motion,
motion activity

15. DETAILED TECHNICAL DISCRIPTION
VISuAL DESCRIPTORS
It describe tools included in the std consist of basic
structure & descriptor that covers the feature like-
Color Descriptors
Texture Descriptors
Shape Descriptors
Motion Descriptors for Video

16. BASIC VISuAL STRuCTuRES
•16
Grid Layout
2D-3D Multiple View
Time Series
Spatial 2D Coordinates
Temporal Interpolation

17. COLOR DESCRIPTORS

18. COLOR SPACES
In this description following color space are supported-
RGB, YCrCb, HSV, MONOCHROME etc.
COLOR LAYOuT
It effectively represent the spatial description of color of
visual signals in a very compact form. It Clusters the
image into 64 (8x8) blocks
COLOR STRuCTuRE
It is a color feature descriptor that captures both color
content & information about the structure of this content.

19. TExTuRE DESCRIPTORS
Homogenous Texture Descriptor
Non-Homogenous Texture Descriptor (Edge Histogram &
Texture)
HOmOgENOuS TExTuRE
It has emerged as an important visual primitive for
searching & browsing through large collection of similar
looking pattern.
The computation of this descriptor is based on filtering
using scale and orientation selective kernels.

20. NON-HOmOgENOuS TExTuRE
It is useful for representing homogenous texture for
browsing type application & requires only 12 bit
(max).
It provide perceptual characteristic of texture similar
to human characterization in terms of regularity,
coarseness & directionality.
Represents the spatial distribution of five types of
edges.
Dividing the image into 16 (4x4) blocks.
Generating a 5-bin histogram for each block.
It is scale invariant.

21. SHAPE DESCRIPTORS
Region-based Descriptor
Contour-based Shape Descriptor
2D/3D Shape Descriptor

22. Region-based descRiptoR
The shape of an object may consist of either a single
region or a set of region as well as some holes in the
object.
Advantages:
Describes complex shapes with disconnected
regions.
Robust to segmentation noise.
Small size , Fast extraction and matching.

23. contouR-based descRiptoR
The contour shape descriptor
captures characteristic shape
feature of an object or region
based on its contour.
It uses so called curvature scale-
space representation, which
captures perceptually meaningful
features of the shape.

24. •24
audio
MPEG-7 audio provide stuctures bulding upon some basic
structures from the MDS for discribing audio content.
1.audio FRaMeWoRK
• It contains low level tools designed to provide a basis for
the construction of higher level audio application.
• By providing a common platform for the structure of
description & the basic semantics for commonly regarded
audio feature.

25. •25
pRoFiLing
•Similar to all MPEG Standards profiling of the tools
specified in the standard will play an important role to allow
deployment of MPEG-7 technology with reasonable costs &
complexity.
•A profile is a set of functionality for one or more classes of
application.
•The keyword to define profile is functionality.

26. •26
Mpeg-7 teRMinaL
•MPEG-7 system provide the means to represent coded
multimedia content description .
•The entity that makes use of such coded representation of
the multimedia content description is generally referred as
the ISO/IEC 15938 terminal or ‘MPEG-7 terminal’.
conFoRMance testing
•It includes the guideline & procedures for testing
conformance of MPEG-7 implementation both for
description & terminals.

27. •27
concLusion
MPEG-7 is advance version. It is better
than below versions of MPEG.
Because, It includes new audio , video
tools. It is not aimed at any one application
in particular rather the elements that
standardizes support as broad a range of
applications as possible.

28. •gRoup MeMbeRs:
1.SAGAR NIKAM
2. NILESH JAISWAR
•guide:
M/S PRADNYA VARTAK