Next:
Introduction to Multimedia
Online Course HTML Notes
Introduction to Multimedia
About This Course
Aims of Module
Objectives of Module
Syllabus Outline
Recommended Course Books
Introduction
History of Multimedia Systems
Multimedia/Hypermedia
What is Multimedia?
What is HyperText and HyperMedia?
Multimedia Systems
Characteristics of a Multimedia System
Challenges for Multimedia Systems
Desirable Features for a Multimedia System
Components of a Multimedia System
Applications
Trends in Multimedia
Further Reading/Exploration
Multimedia Authoring
Multimedia Authoring:Systems and Applications
What is an Authoring System?
Why should you use an authoring system?
Multimedia Authoring Paradigms
Multimedia Programming vs Multimedia Authoring
Issues in Multimedia Applications Design
Content Design
Technical Design
Visual Design
Storyboarding
Overview of Multimedia Software Tools
Digital Audio
Music Sequencing and Notation
Image/Graphics Editing
Image/Graphics Editing
Animation
Multimedia Authoring
Further Information
Multimedia Programming:Scripting (Lingo)
Director programming/Lingo Scripting
Director Basics
Overview and Definitions
The Score and the Stage
Using The Score
The playback head
Channels
Frames
Sprites
Cast members
Lingo
Markers
Editing Frames
Identifying Frames with Lingo
Lingo Scripting
When does Lingo run?
The Lingo language
Dot Syntax
Parentheses
Character spaces
Comments
Optional keywords and abbreviated commands
Literal Values
Identifying cast members and casts
Lingo operators
Lingo Lists
Types of Scripts
Messages and Events
Director Example 1: Simple Animation
Director Example 2:Importing media
Director Example 3:Simple Lingo Scripting
Director Example 4:Controlling Navigation with Lingo
Multimedia Programming:Tagging (SMIL)
What it is SMIL?
SMIL support
Running SMIL Applications
Using Quicktime
Using RealPlayer G2
Using the SOJA applet
another SMILE viewer:GRINS
Let us begin to SMIL -- SMIL Authoring
SMIL Syntax Overview
Basic Layout
SMIL Layout
Positioning Media
fit
ting media to regions
Synchronisation
SMIL Events
SMIL ON
Multimedia Technology
Multimedia Systems Technology
Discrete v continuous media
Analog and Digital Signals
Input Devices and Storage
Text and Static Data
Graphics
Images
Audio
Video
Output Devices
Storage Media
High performance I/O
Basic Storage
RAID -- Redundant Array of Inexpensive Disks
Optical Storage
CD Storage
DVD
DVD and computers
Multimedia Data
Multimedia Data Representations
Basics of Digital Audio
Application of Digital Audio -- Selected Examples
Digitization of Sound
Digitizing Audio
Computer Manipulation of Sound
Sample Rates and Bit Size
Nyquist's Sampling Theorem
Implications of Sample Rate and Bit Size
Typical Audio Formats
Delivering Audio over a Network
Synthetic Sounds
Introduction to MIDI (Musical Instrument Digital Interface)
Components of a MIDI System
Hardware Aspects of MIDI
MIDI Messages
General MIDI
Digital Audio and MIDI
Digital Audio, Synthesis, Midi and Compression -- MPEG 4 Structured Audio
MPEG 4 Structured Audio
Further Reading/Information for Digital Audio and Midi
Graphic/Image File Formats
Graphic/Image Data Structures
Standard System Independent Formats
System Dependent Formats
Further Reading/Information
Colour in Image and Video
Basics of Colour
CIE Chromaticity Diagram
Colour Image and Video Representations
Summary of Colour
Basics of Video
Types of Colour Video Signals
Analog Video
Digital Video
Chroma Subsampling
Further Reading/Information
Video and Audio Compression
Classifying Compression Algorithms
What is Compression?
Lossless Compression Algorithms (Repetitive Sequence Suppression)
Simple Repetition Suppresion
Run-length Encoding
Lossless Compression Algorithms (Pattern Substitution)
Lossless Compression Algorithms (Entropy Encoding)
Basics of Information Theory
The Shannon-Fano Algorithm
Huffman Coding
Huffman Coding of Images
Adaptive Huffman Coding
Arithmetic Coding
Lempel-Ziv-Welch (LZW) Algorithm
Entropy Encoding Summary
Further Reading/Information
Source Coding Techniques
Transform Coding
Frequency Domain Methods
Fourier Theory
The Discrete Cosine Transform (DCT)
Differential Encoding
Vector Quantisation
JPEG Compression
Quantization
Zig-zag Scan
Differential Pulse Code Modulation (DPCM) on DC component
Run Length Encode (RLE) on AC components
Entropy Coding
Summary of the JPEG bitstream
Practical JPEG Compression
Further Reading
Video Compression
H. 261 Compression
Overview of H.261
Intra Frame Coding
Inter-frame (P-frame) Coding
The H.261 Bitstream Structure
Hard Problems in H.261
MPEG Compression
MPEG Video
The MPEG Video Bitstream
Decoding MPEG Video in Software
Further Reading/Information
Audio Compression
Simple Audio Compression Methods
Psychoacoustics
MPEG Audio Compression
Streaming Audio (and video)
Further Exploration
Multimedia Integration, Interaction and Interchange
Integrating Multimedia
Interactive Multimedia
Multimedia Interchange
Quicktime
Introduction
Quicktime Support of Media Formats
QuickTime Concepts
The QuickTime Architecture
QuickTime Components
Quicktime File Format
Further Information
Open Media Framework Interchange (OMFI) Format
Multimedia and Hypermedia Information Encoding Expert Group (MHEG)
The family of MHEG standards
MHEG-5 overview
MHEG Programming Principles
Interaction within a Scene
Availability; Running Status
Interactibles
Visual Representation
Object Sharing Between Scenes
Object Encoding
Conformance
MHEG Coding Examples
An MHEG Player Java Applet -- Futher MHEG Examples
Relationships to Major Standards
MHEG Implementation
MHEG Future
Further Reading/Information
About this document ...
Dave Marshall
10/4/2001