Next:
Introduction to Multimedia
Multimedia
Module No: CM0340
A. D. Marshall 1999
Introduction to Multimedia
About This Course
Aims of Module
Objectives of Module
Syllabus Outline
Recommended Course Books
Introduction
History of Multimedia Systems
Multimedia/Hypermedia
What is Multimedia?
What is HyperText and HyperMedia?
Multimedia Systems
Characteristics of a Multimedia System
Challenges for Multimedia Systems
Desirable Features for a Multimedia System
Components of a Multimedia System
Applications
Trends in Multimedia
Further Reading/Exploration
Multimedia Authoring
Multimedia Authoring:Systems and Applications
What is an Authoring System?
Why should you use an authoring system?
Multimedia Authoring Paradigms
Issues in Multimedia Applications Design
Content Design
Technical Design
Visual Design
Storyboarding
Overview of Multimedia Software Tools
Digital Audio
Music Sequencing and Notation
Image/Graphics Editing
Image/Graphics Editing
Animation
Multimedia Authoring
Further Information
Multimedia Programming:Scripting (Lingo)
Director programming/Lingo Scripting
Director Basics
Overview and Definitions
The Score and the Stage
Using The Score
The playback head
Channels
Frames
Sprites
Cast members
Lingo
Markers
Editing Frames
Identifying Frames with Lingo
Lingo Scripting
When does Lingo run?
The Lingo language
Dot Syntax
Parentheses
Character spaces
Comments
Optional keywords and abbreviated commands
Literal Values
Identifying cast members and casts
Lingo operators
Lingo Lists
Types of Scripts
Messages and Events
Director Example 1: Simple Animation
Director Example 2:Importing media
Director Example 3:Simple Lingo Scripting
Director Example 4:Controlling Navigation with Lingo
Multimedia Programming:Tagging (SMIL)
What it is SMIL?
SMIL support
Running SMIL Applications
Using RealPlayer G2
Using the SOJA applet
another SMILE viewer:GRINS
Let us begin to SMIL -- SMIL Authoring
SMIL Syntax Overview
Basic Layout
SMIL Layout
Positioning Media
fit
ting media to regions
Synchronisation
SMIL Events
SMIL ON
Multimedia Technology
Multimedia Systems Technology
Discrete v continuous media
Analog and Digital Signals
Input Devices and Storage
Text and Static Data
Graphics
Images
Audio
Video
Output Devices
Storage Media
High performance I/O
Basic Storage
RAID -- Redundant Array of Inexpensive Disks
Optical Storage
CD Storage
DVD
DVD and computers
Multimedia Data
Multimedia Data Representations
Basics of Digital Audio
Digitization of Sound
Digitizing Audio
Typical Audio Formats
Implications of Sample Rate and Bit Size
Synthetic Sounds
Applications of Digital Audio
Introduction to MIDI (Musical Instrument Digital Interface)
Components of a MIDI System
Hardware Aspects of MIDI
MIDI Messages
General MIDI
Digital Audio and MIDI
Digital Audio, Synthesis, Midi and Compression -- MPEG 4 Structured Audio
MPEG 4 Structured Audio
Further Reading/Information for Digital Audio and Midi
Graphic/Image File Formats
Graphic/Image Data Structures
Standard System Independent Formats
System Dependent Formats
Further Reading/Information
Colour in Image and Video
Basics of Colour
CIE Chromaticity Diagram
Colour Image and Video Representations
Summary of Colour
Basics of Video
Types of Colour Video Signals
Analog Video
Digital Video
Chroma Subsampling
CCIR Standards for Digital Video
ATSC Digital Television Standard
Further Reading/Information
Video and Audio Compression
Classifying Compression Algorithms
What is Compression?
Lossless Compression Algorithms (Entropy Encoding)
Basics of Information Theory
The Shannon-Fano Algorithm
Huffman Coding
Adaptive Huffman Coding
Arithmetic Coding
Lempel-Ziv-Welch (LZW) Algorithm
Entropy Encoding Summary
Further Reading/Information
Source Coding Techniques
Transform Coding
The Discrete Cosine Transform (DCT)
Differential Encoding
Vector Quantisation
Video Compression
JPEG Compression
Quantization
Zig-zag Scan
Differential Pulse Code Modulation (DPCM) on DC component
Run Length Encode (RLE) on AC components
Entropy Coding
Summary of the JPEG bitstream
Practical JPEG Compression
Further Reading
H. 261 Compression
Overview of H.261
Intra Frame Coding
Inter-frame (P-frame) Coding
The H.261 Bitstream Structure
Hard Problems in H.261
MPEG Compression
MPEG Video
The MPEG Video Bitstream
Decoding MPEG Video in Software
Further Reading/Information
Audio Compression
Simple Audio Compression Methods
Psychoacoustics
MPEG Audio Compression
Streaming Audio (and video)
Further Exploration
Multimedia Integration, Interaction and Interchange
Integrating Multimedia
Interactive Multimedia
Multimedia Interachange
Quicktime
Introduction
Quicktime Support of Media Formats
QuickTime Concepts
The QuickTime Architecture
QuickTime Components
Quicktime File Format
Further Information
Open Media Framework Interchange (OMFI) Format
Multimedia and Hypermedia Information Encoding Expert Group (MHEG)
The family of MHEG standards
MHEG-5 overview
MHEG Programming Principles
Interaction within a Scene
Availability; Running Status
Visual Representation
Object Sharing Between Scenes
Object Encoding
Conformance
MHEG Coding Examples
Relationships to Major Standards
MHEG Implementation
MHEG Future
Further Reading/Information
Multimedia Sytems
Multimedia Systems Design Issues
Multimedia Systems Design
Applications and Operations Required for Multimedia
Distributed Systems
Mutlimedia System Issues
Issues in Multimedia Systems Design
Network Connection
Traffic Analysis
Buffer Design
Scheduling and Synchronisation
Congestion Control
Architecture and Networks
Multimedia Architecture
Components of a Multimedia System
An Architecture for Multimedia Systems
Multimedia Networking
Challenges in Multimedia Network Communications:
Basics of Computer Networks
New Generation Networks
Multimedia Data Transmission
Further Reading Reference
Applications
Current Multimedia Applications
Taxonomy of Multimedia Applications
Multimedia Conferencing
Further Information
Multimedia Groupware
HyperMedia Applications
Microcosm
Hyperwave
Key Features of Hyperwave
Further Reading
RMM
Further Reading
Virtual Reality
What is Virtual Reality?
Virtual Reality:Hardware and Software
VR Hardware
Computers
Sensory Displays
Input Devices
VR Software
Virtual Reality Authoring Tools
VRML
Virtual Reality Applications
Further Information
Future Directions for Multimedia
Digital Libraries: Content-Based Retrieval
Introduction
Applications of Content-Based Retrieval
CBR in Image and Video Databases
Some Existing CBR Systems/Applications
Further Reading
Interactive Television
Basics of Interactive TV
Solutions under Experiment
Set-top Box
Further Reading
HDTV
Basic ideas for HDTV
Issues in HDTV
MUSE - Japanese HDTV
All digital HDTV and the future
Further Information
About this document ...
dave@cs.cf.ac.uk
