Multimedia

Multimedia
3- ‫ نال‬435

‫قسم علوم الحاسب‬

0
 Multimedia

Table of Contents

.Chapter No Table of Contents

1 Introduction to Multimedia

2 Multimedia Elements

3 Multimedia Communication Tools

4 Multimedia Hardware Peripherals

5 Analog and Digital Signals

6 Compression in Multimedia Data

7 Synchronization

1
 Multimedia

Chapter-1

Introduction to Multimedia

2
 Multimedia

Introduction to Multimedia

...
is ... it is at ng ...
at i t
ere goi
Wh Wh re it is
e
Wh

...What it is

“Multimedia is, (in theory), the seamless

integration under computer control of any
text, sound, still and animated images, and
motion video. The computer enables this mix of media to be interactive, as opposed to
current broadcasting and publishing practices which for the most part are aimed at a passive
audience. In other words, while broadcasting and publishing are essentially one-way,
interactive multimedia by its very nature demands active participation.”

Concept of Multimedia

 Multimedia has been used in many aspects in our lives, for example in the field of

business, entertainment and the sciences. Multimedia is nothing but the processing and

presentation of information in a more structured and understandable manner using more

than one media such as text, graphics, animation, audio and video.

 Multimedia systems are those computer platforms and software tools that support the

interactive uses of text, graphics, animation, audio, or motion video.

 In other words, a computer capable of handling text, graphics, audio, animation and video

is called multimedia computer. If the sequence and timing of these media elements can

be controlled by the user, then one can name it as Interactive Multimedia.

Multimedia
3
 Multimedia
“Multimedia” derived from the word “Multi” and “Media”.
 “Multi” means Many, Multiple.
 “Media” refers to any hardware or software used for communicating.

Examples of hardware are: Radio, Television, Computer and Mobile Phone.

Examples of software are: Email, Yahoo Messenger, Multimedia Message Service (MMS) and
Video conferencing.

What is Multimedia?

4
 Multimedia
Multimedia means computer information that can be represented through audio, video, and
animation in addition to traditional media. (i.e., text, graphics/drawings, images)
General Definition
Multimedia is the field concerned with the computer controlled integration of text, graphics,
drawings, still and moving images (Video), animation, audio, and any other media where
every type of information can be represented, stored, transmitted and processed digitally.
Thus, the meaning of multimedia has changed as technology advanced in our lives.

Importance of Multimedia
There are a number of fields where multimedia could be of use.
Business – Education – Entertainment – Home – Public Places
Business
 Sales / Marketing Presentation
 Trade show production
 Staff Training Application
 Company Kiosk
Education
 Courseware / Simulations
 E-Learning / Distance Learning
 Information Searching
Entertainment
 Games (Leisure / Educational)
 Movies
 Video on Demand –Online
Home
 Television
 Satellite TV
 SMS services (chats, voting, reality TV)
Public Places
 Information Kiosk
 Smart Cards, Security

Why Use It -
What Are Its Benefits???

5
 Multimedia
 Multimedia communication is similar to face-to-face communication.
 Multimedia is less restricted than written text. Many people come to understand text
better with broader media support for its interpretation.
 Multimedia can place abstract concepts in a specific context (for example, refraction
in physics might be depicted in a film of lens and light behaviour).
 Multimedia allows for individual differences in preferred sensory channels for learning.
 Multimedia lets you coordinate diverse external representations (with distinctive
strengths) for different perspectives.

Benefits of Multimedia
:Four main areas for which multimedia is providing real benefits

 Presentations

 Reference

 Education / Training / Learning

 Entertainment

Multimedia Application

A Multimedia Application is an application which uses a collection of multiple media sources

e.g. text, graphics, images, sound/audio, animation and/or video.

Examples of Multimedia Application

• World Wide Web

• Games
• Home shopping
• Interactive TV
• Groupware
• Virtual reality
• Video conferencing
• Video-on-demand
• Hypermedia courseware
• Digital video editing and production systems
• Multimedia Database systems

Multimedia Application Design

• Designers work closely with producers or clients throughout the process.

6
 Multimedia
• The conceptual model between the designers and the producers/clients must be
closely matched.
• The more works put in design help to eliminate tedious and costly alteration at the
end of the project.
Multimedia Application Design involves a few interrelated aspects:
• Interactivity – how does the process work? Allow users to control the application in a
way that works with the content.
• Structure – the flow (navigation) and content structure of the multimedia application.
• Appearance – determine how the screen will look like.

Hypertext
• Hypertext is a text which contains links to other texts.
• The term was invented by Ted Nelson around 1965.

Hypertext Navigation

Hypermedia
• Hypermedia is not constrained to be text-based.
• Hypermedia can include other media, e.g., graphics, images, and especially the
continuous media – sound and video.
7
 Multimedia

Example of Hypermedia Applications

• The World Wide Web (WWW) is the best example of a hypermedia application.
• Powerpoint.
• Adobe Acrobat (or other PDF software).
• Adobe Flash.

Types of Multimedia Presentation

Multimedia presentation can be categorize into two:
1. Linear Multimedia
2. Non-Linear Multimedia (Interactive)
Linear Multimedia
 In Linear Multimedia the users have very little control over the presentation.
 The users would only sit back and watch the presentation.
 The presentation normally plays from the start to end or even loops continually to
present the information.
 A movie is a common type of linear multimedia.
Non-Linear Multimedia (Interactive)
In interactive Multimedia, users dictate the flow of delivery.
 The users control the delivery of elements and control the what and when.
 Users have the ability to move around or follow different path through the information
presentation.
 Hypermedia is also used in non-linear interactivity.
Example: Games, Courseware, Interactive CD

Multimedia Systems
 A Multimedia System is a system capable of processing multimedia data and
applications.
 A Multimedia System is characterised by the processing, storage, generation,
manipulation and rendition of Multimedia information.
Characteristics of Multimedia Systems
8
 Multimedia
A Multimedia system has four basic characteristics:
• Multimedia systems must be computer controlled.

• Multimedia systems are integrated.(balanced)

• The interface to the final presentation of media is usually interactive.

• The information they handle must be represented digitally.

I. Computer Controlled

Computer is used for:

 Producing the content of the information – e.g. by using the authoring tools,

image editor, sound and video editor

 Storing the information – providing large and shared capacity for multimedia

information.

 Transmitting the information – through the network.

 Presenting the information to the end user – make direct use of computer

peripheral such as display device (monitor) or sound generator (speaker).

II. Integrated

All multimedia components (audio, video, text, graphics) used in the system must be

somehow integrated.

Example:

 Every device, such as microphone and camera is connected to and controlled by a

single computer.

 A single type of digital storage is used for all media type.

 Video sequences are shown on computer screen instead of TV monitor.

III. Interactivity

There are three levels of Interactivity:

 Level 1: Interactivity strictly on information delivery. Users select the time at which

the presentation starts, the order, the speed and the form of the presentation

itself.

 Level 2: Users can modify or enrich the content of the information, and this
9
 Multimedia
modification is recorded.

 Level 3: Actual processing of users input and the computer generate genuine

result based on the users input.

IV. Digitally represented

Digitization: process involved in transforming an analog signal to digital signal.

Why represent information in digital form?

 Digital representation permits the storage of different information types on the

same devices.

 Information may also be transmitted over a single digital network.

 When digitised, all form of information may be treated by computer programs,

for editing, quality improvement, or recognition of the meaning of the information.

Challenges for Multimedia Systems

10
 Multimedia
 Distributed Networks
 Temporal relationship between data
 Render different data at same time - continuously
 Sequencing within the media - playing frames in correct order/time frame in
video.
 Synchronization — inter-media scheduling
Eg: Video and Audio — Lip synchronization is clearly important for humans to
watch playback of video and audio and even animation and audio.
Desirable Features for a Multimedia System

Given the above challenges the following features are desirable (if not a prerequisite) for a

Multimedia System:

 Very High Processing Power — needed to deal with large data processing and real

time delivery of media.

Special hardware common place.

 Multimedia Capable File System — needed to deliver real-time media — e.g.

Video/Audio Streaming.

 Special Hardware/Software needed – e.g. RAID technology.

 Data Representations — File Formats that support multimedia should be easy to

handle yet allow for compression/decompression in real-time.

 Efficient and High I/O —input and output to the file subsystem needs to be efficient

and fast.

Needs to allow for real-time recording as well as playback of data.

Eg. Direct to Disk recording systems.

 Special Operating System —to allow access to file system and process data

efficiently and quickly.

Needs to support direct transfers to disk, real-time scheduling, fast interrupt

processing, I/O streaming etc.

 Storage and Memory — large storage units (of the order of hundreds of Tb if not

more) and large memory (several Gb or more).

11
 Multimedia
Large Caches also required and high speed buses for efficient management.

 Network Support — Client-server systems common as distributed systems common.

Software Tools — user friendly tools needed to handle media, design and develop

applications, deliver media.

Components of a Multimedia System

Let us consider the Components (Hardware & Software) required for a multimedia system.

• Capture devices — Video Camera, Video Recorder, Audio, Microphone, Keyboards,

Mice, Graphics Tablets, 3D input devices, Tactile Sensors, VR Devices, Digitising

Hardware.

• Storage Devices — Hard disks, CD-ROMs, DVD-ROM.

• Communication Networks — Local Networks, Intranets, Internet, Multimedia or

other special high speed networks.

• Computer Systems — Multimedia Desktop Machines, Workstations,

MPEG/VIDEO/DSP Hardware.

• Display Devices — CD-quality speakers, HDTV,SVGA, Hi-Res monitors, Color

printers.

Multimedia Data Basics

Multimedia Systems/Applications have to deal with the

 Generation of data.

 Manipulation of data.

 Storage of data.

 Presentation of data.

 Communication of information/data.

Introduction to Multimedia Production

• Multimedia enhances the way we learn and understand about things.

12
 Multimedia
• Integration of multiple media such as text, audio, video, graphics and animation

together multiply the impact of the message.

Multimedia Production Team

1. Production Manager
2. Content Specialist
3. Script Writer
4. Text Editor
5. Multimedia Architect (or Program Authoring Specialist)
6. Computer Graphic Artist
7. Audio Video Specialist
8. Computer Programmer

Multimedia Production Phases

• The production of interactive multimedia applications is a complex one, involving

multiple steps.
• This process can be divided into the following phases:
1. Conceptualization
2. Development plan
3. Preproduction
4. Production
5. Postproduction
6. Documentation

13