Introduction 0 3H 3222012 1 Multimedia Communications Associate Prof Nguyen Chan Hung, Ph D Vice Head | Department of Telecommunication System | School of Electronics and Telecom Head of Research and Development Laboratory of Multimedia Technology (RDLAB) Hanoi University of Science and Technology (HUST) Tel +84 0904186221 | Fax +84 4 38692241 E mail chanhungmail hut edu vn , hungncgmx net URL http set hut edu vn~nguyenchanhung 2022012 1Prof Nguyen Chan Hung HUST Course syllabus � Intr.
Trang 1Multimedia Communications
Associate Prof Nguyen Chan Hung, Ph.D.
Vice-Head | Department of Telecommunication System |
School of Electronics and Telecom.
Head of Research and Development Laboratory of
Multimedia Technology (RDLAB) Hanoi University of Science and Technology (HUST)
Tel: +84-0904186221 | Fax: +84-4-38692241 E-mail: chanhung@mail.hut.edu.vn , hungnc@gmx.net
Video coding/compression techniques
Emerging multimedia communication
systems
Trang 2◦ To be familiar with Multimedia products
◦ To be aware of the networking evolution.
◦ To understand the network types.
◦ To discuss multimedia requirements in the
communication systems.
◦ To understand the basics of a multimedia
communication system.
◦ To illustrate multimedia networks.
◦ To know the Internet protocol suite for multimedia
communications
Trang 3Multimedia communication in
Vietnamese market
A potential emerging market…
Digital TV / Pay-TV booming
◦ 3G: Viettel, Mobiphone, Vinaphone, etc…
◦ Services: MobiTV, Traffic Camera, VideoPhone, etc
Web Video: Clip.vn
Music network: Zing mp3, sannhac, etc
Tools that is used to represent or do a certain things,
delivery medium, a form of mass communication –
Trang 4Definition of Multimedia
Multimedia is a combination of text, graphic,
sound, animation, and video that is delivered
interactively to the user by electronic or
digitally manipulated means.
A broad term for something that contains words to express
something
Text is the most basic element of multimedia
A good choice of words could help convey the intended message
to the users (keywords)
Used in contents, menus, navigational buttons
Trang 520/2/2012 Prof Nguyen Chan Hung - HUST 9
Elements of Multimedia
GRAPHIC
Two-dimensional figure or illustration
Could be produced manually (by drawing, painting,
TEXT
AUDIO
GRAPHIC
VIDEO ANIMATION
Trang 620/2/2012 Prof Nguyen Chan Hung - HUST 11
Produced by vibration, as perceived by the
sense of hearing
In multimedia, audio could come in the form of
speech, sound effects and also music score.
Trang 7The illusion of motion created by the consecutive
display of images of static elements
Trang 8Is the technology of capturing, recording, processing,
transmitting, and reconstructing moving pictures
Video is more towards photo realistic image sequence /
live recording as in comparison to animation.
Video also takes a lot of storage space So plan carefully
before you are going to use it.
Trang 9Interactive Multimedia
When the user is given the option of
controlling the elements.
Hyper Media
A combination of hypertext, graphics,
audio, video, (linked elements) and
interactivity culminating in a complete,
non-linear computer-based experience
20/2/2012 Prof Nguyen Chan Hung - HUST 17
Example
Interactive Multimedia
Trang 10A Multimedia Project is identified as Linear when:
Trang 11Linear VS Non Linear VS Non Linear Linear
A Multimedia Project is identified as Non-Linear when:
◦ It is interactive
◦ Users have control over the content that is being showed to them
◦ Users are given navigational control
Use to merge multimedia elements (text, audio,
graphic, animation, video) into a project.
Designed to manage individual multimedia
elements and provide user interaction (if
required).
Trang 12There are a number of fields where
multimedia could be of use Examples
Trang 13Importance of Multimedia
Business
◦ Use and Applications
Sales / Marketing Presentation
Trade show production
Staff Training Application
Trang 14Importance of Multimedia
Entertainment
◦ Use and Applications
Games (Leisure / Educational)
Trang 15Importance of Multimedia
Public Places
◦ Use and Applications
Information Kiosk
Smart Cards, Security
20/2/2012 Prof Nguyen Chan Hung - HUST 29
Trang 16Multimedia Products
Briefing Products
information quickly and concisely
Short Development Cycle
Limited Number of Presentations
Usage of text to present information with limited use of
graphic, audio and video
Have few navigational controls (mouse click and button
press to move from one page to another)
Content and the format are suitable for the audience and
fulfill the purpose of the presentation
1/2
20/2/2012 Prof Nguyen Chan Hung - HUST 31
Multimedia Products
Briefing Products
The understanding of the presented subject
Seamless integration of content
Trang 17Multimedia Products
Reference Products
1/2
• Often used for answering specific questions or for general browsing of
information (stored on CD/ DVD ROM)
• Characteristic of reference product:
Used by wide range of user (small – adult)
Have navigational menu, book marking, searching, printing utility
• 2 Basic classes of reference product:
Generalized Content (dictionary/encyclopedia)
Broad treatment of content at a limited depth
Detailed Content
Focus on specific area and provide extensive information
20/2/2012 Prof Nguyen Chan Hung - HUST 33
Multimedia Products
Reference Products
The developers understanding the body of information and
how the end user will want to access it
Help function should always available to explain how to
access and use the information
Trang 18• Similar to reference product in a sense that large amount of information
are made available to the end user
• Focus on storing and accessing the actual data (multimedia data such
as text, graphic, audio, animation and video)
• Characteristics of Database Products are:
Manages multimedia data (large data)
Descriptive finding methods
Content based search
Simultaneous access
Online database
Relational consistency in data management
Trang 19Education and Training Products
• Similar to textbook or training manuals but have added media such as
audio, animation and video
• Make up a significant share of the multimedia market ranging from
pre-kindergarten to postgraduate offerings from technical to corporate
training products
• 2 categories of reference product:
Trang 20• A product which is usually stationed at public places and allow the user
to find information interactively and also other types of transaction
• Characteristics of Kiosk
Products:-Limited target users and usage
User friendly and easily used by user
Fast response
Trang 21Provide certain information (example map, timetable etc)
Point Of Sales System
Allow users to purchase or make orders
• Example of Kiosk
Products:-Instant Photo Booth
Banking Kiosk (money deposit, cheque)
University Information Kiosk
20/2/2012 Prof Nguyen Chan Hung - HUST 41
Multimedia Products
Entertainment & Games
• Most popular
• Shipped in the form of Interactive CD / DVD ROM
• Characteristics of E & G
Products:-Immersive
Requires constant feedback and interaction with the user
Challenging and sometimes intriguing for user
Trang 22MULTIMEDIA COMMUNICATIONS
20/2/2012 Prof Nguyen Chan Hung - HUST 43
Trends of next generation ICT applications
and services
Facts
◦ Network grows fast in size, capacity
and diversity
◦ Multimedia traffic becomes the largest
portions of the whole Internet traffic
◦ Terminal become Smarter
Trang 23Trends of ICT
Multimedia applications are converging toward a new form: Unified
Communication & Unified Messaging, where all traditional
communication services are combined and deliver to any device
P2P networking is becoming a major trend that affect multimedia
applications and Internet architecture Many of P2P mechanisms is
being reused in Grid Computing, Cloud Computing and
Ubiquitous Computing
P2P is spreading to mobile multimedia applications run over
broadband wireless infrastructure such as 3G, LTE, WiFi, WiMax thus
require significant modification in protocols.
When smart terminals are equipped with sensors (GPS, G-sensors,
etc), the system can detect and predict user’s context to deliver
appropriate information in the right time, at the right place
Ubiquitous Information System
22/03/2012
Dr Nguyen Chan Hung - Hanoi University of Science and Technology 45
Multimedia Requirements
To develop schemes for multi-access networks which
can provide performance guarantees.
To develop a distribute route-selection strategy for
point-to-point networks.
Real-time multimedia applications require guaranteed
performance communication services, such as
throughput, delay, jitter and loss rate.
Trang 24Communication Service for
Multimedia
Quality-of-service (QoS) support and group communication system:
and network control; and
Bandwidth, delay, delay jitter (variance), and reliability.
Audio/Video groups can:
◦ have static or dynamic memberships during their lifetime,
◦ have centrally (typically sender) or distributed (typically receiver) controlled
membership,
◦ consist of members with homogeneous or be heterogeneous characteristics
and requirements
20/2/2012 Prof Nguyen Chan Hung - HUST 47
Multimedia Application Environment
Trang 2520/2/2012 Prof Nguyen Chan Hung - HUST 49
Multimedia File types
Some examples of types:
◦ Text Files: txt, doc, rtf
◦ Audio Files: au, aif, wav, mp3,
◦ Graphic files: jpg, gif, tif, bmp, pict, pcx
◦ Moving video files: mov, avi, mpg, mpeg, mp4, 3gp, flv, mkv
◦ Animation: fli, flc
Trang 26Multimedia Communication System
Network Access Method
Routing
Frame and Packet Structures
Packet Discrimination
◦ Identify packets that require special handling.
◦ Be capable of accommodating those special
requirements.
Bandwidth Requirement, Reservation and
Conservation
High bandwidth and low latency
20/2/2012 Prof Nguyen Chan Hung - HUST 51
Multimedia Communication System Architecture
The ability to manage dynamically the achieved QoS of each
service component
The possibility for users to select some resources that best
meet their needs.
The possibility to interact with another user whose equipment
has differing characteristics.
The communications network must allow any user to select
the service components he/she wants:
◦ The possibility for users to join in or withdraw from a communication session
according to certain policies, such as agreement of all interacting partners before
admitting a new user
◦ The possibility to set such quality of service parameters as the synchronization
tolerance between the service components, the echo sensitivity, the burst
sensitivity, and so on.
Trang 29Real-time Transport Protocol (RTP) provides support
for the transport of real-time data such as video and
audio streams.
RTP needs support from lower layers that actually have
control over resources in switches and routers
RTP/RTCP provides functionality and control
mechanisms necessary for carrying real-time content.
RTP/RTCP itself is not responsible for the higher-level
tasks like assembly and synchronization These have to
be done at application level.
20/2/2012 Prof Nguyen Chan Hung - HUST 57
RTCP
Real-Time Control Protocol extends RTP
In an RTP session, participants periodically send RTCP packets to convey feedback on
quality of data delivery and information of membership
Packets defined for carrying control information:
◦ SR: Sender report, for transmission and reception statistics from session
participants that are
◦ active senders
◦ RR: Receiver report, for reception statistics from session participants, that are not
active
Trang 30Multimedia Internet Protocols
SAP & SDP
◦ Peer to peer communication, the concept of session.
SIP
◦ Signalling mechanisms that are necessary to establish
a session and to negotiate the parameters to be used
in it, such as codecs, media, location, etc.
MBONE Tools
◦ SDR, VIC, VAT and RAT, WB, NTE.
20/2/2012 Prof Nguyen Chan Hung - HUST 59
Multimedia Internet Protocols
RSVP
◦ Network control protocol
◦ Allows data receiver to request a special end-to-end
quality of service for its data flows.
RTSP
◦ A client-server multimedia presentation protocol to
enable controlled delivery of streamed multimedia
data over IP network.
◦ Aims to provide the same services on streamed
audio and video just as HTTP does for text and
graphics
Trang 31Multimedia Communications
High-Density File Transfers
Graphics File Transfers
Audio File Transfers
Video File Transfers
Trang 32Admission Control
Call Admission Control (CAC) prevents oversubscription
ofVoIPnetworks
◦ It is used in the call set-up phase and applies to real-time media traffic as opposed to
data traffic CAC mechanisms complement and are distinct from the capabilities
of Quality of Service tools to protect voice traffic from the negative effects of other
voice traffic and to keep excess voice traffic off the network
◦ Since it averts voice traffic congestion, it is a preventiveCongestion Control Procedure
It ensures that there is enough bandwidth for authorized flows.
Integrated Services with RSVP (which reserve resources for the flow of
packets through the network) using controlled-load service ensures that a
call cannot be set up if it cannot be supported
CAC rejects calls when:
◦ there is insufficient CPU processing power,
◦ the upstream and downstream traffic exceeds prespecified thresholds,
◦ the number of calls being handled exceeds a prespecified limit [1]
Connection Admission Control (CAC) can be used to prevent congestion in
connection-oriented protocols such asATM
◦ In that context, there are several schemes available [2] However, VoIP differs in that it
uses RTP , UDP and IP , all of which are connectionless protocols.
20/2/2012 Prof Nguyen Chan Hung - HUST 63