This page will contain information regarding the lectures, and will be updated regularly during the term.
--------------
Scanned Lecture Notes
These are scans of the notes that I use when delivering my lectures. I'm not sure how useful they will be, as they are by no means comprehensive (a lot of what I lecture on comes from my head, and the notes just remind me of the topics). However, I'm going to post them here in case they may be of use.
These are posted as jpeg files, and run about 200-300k each.
Image Representaion and Perception: Jan 6 - Jan 11
Text Chapters
Chapter 3: 3.1, Portions of 3.2
Chapter 4: Portions of 4.1, Portions of 4.2, Portions of 4.3
Useful Links
Wikipedia link regarding CIE Colour Standardisation
Topics
- Representation of greyscale bitmap images
- What dithering is, and one straightforward way of doing it
- Representation of 24-bit colour images
- Use of colour lookup tables to represent colour images using 8 bits
- A simplification of the median-cut algorithm for computing a colour lookup table
- Vector graphic representations and their uses.
- Human perception of colour
- Spectral Power Distribution diagrams
- CIE colour standardisation
- CMYK colour printing
- Colour representation for video
Concepts in Video: Jan 13 - 16
Text Chapters
Chapter 5: 5.1, Portions of 5.2, 5.3
Useful Links
Restored clip from (very) early television
Animation illustrating interlaced scanning
Animation illustrating analog video recording
HowStuffWorks link describing how a VCR works (including the image of a VCR head)
Wikipedia link discussing chroma subsampling
Topics
- Analog video formats
- Interlaced video
- Differences in bandwidth used for luminance and chrominance
- Analog video recording
- Composite, S-Video and Component Video
- Variations in quality of recording formats
Digital Audio: Jan 16 - 23
Text Chapters
Chapter 6: Portions of 6.1, Portions of 6.3
Useful Links
Samples of sounds at various rates/sizes
A quicktime movie illustrating aliasing
A quicktime movie showing effects of sample rate on captured frequencies
A site with lots of stuff about localisaion of audio (and psychoacoustics in general), including the illustration I used in class of the 'pinna notch.'
A pdf file with the illustrations I used to show sound localisation.
Topics
- Signal Sampling
- Sampling Rate
- Sample Size
- Nyquist Rate
- Quantisation Noise
- Aliasing
- Effects of low sample rate or size, on images and audio
- Re-creating sampled signals
- Non-linear quantisation
- DPCM and ADPCM
- Audio Localisation
Lossless Compression: Jan 25-27
Text Chapters:
Chapter 7: 7.1, 7.2, 7.3, 7.4, Overview of 7.5, Overview of 7.6, 7.7
Useful Links
You can find lots of useful information on these topics on Wikipedia.
Topics
- Lossy vs Lossless compression
- Run Length Encoding
- Entropy
- Variable length encodings
- Shannon-Fano
- Huffman Coding
- Adadptive Huffman Encoding
- Dictionary Based Encoding
- LZW Compression
- Arithmetic Coding
- Lossless Image Compression
- GIF
- Differential Coding
- Lossless JPEG
Lossy Compression: Jan 30
Text Chapters:
Chapter 8: 8.1, 8.2, 8.3, 8.5
Topics
- Distortion Measures
- Transform Coding
- Discrete Transform Transform (1-D and 2-D)
Image Compression: Feb 6-Feb 17
Text Chapters:
Chapter 9: 9.1
Topics
- JPEG Compression
- Compression Steps
- Transforming Colour Space
- DCT
- Quantization
- Zig-zag ordering
- Run-length, and entropy coding
- Separate treatments of AC and DC components
- JPEG Mode
- Sequential
- Progressive
- Hierarchical
- Lossless
Video Compression: Feb 27-March 15
Text Chapters:
Chapter 10: Basically the entire chapter, but less detail in some sections.
Chapter 11: Basically the entire chapter, but less detail in some sections.
Chapter 12: 12.1, 12.2 (up to 12.2.2), 12.3 (overview), 12.6 (overview), 12.7 (overview)
Topics
- Video compression
- Motion Compensation
- Search Algorithms
- Sequential
- 2D Logaritmic
- Hierarchical
- H.261
- I and P Frames
- Encoder and Decoder
- Improvements in H.263
- MPEG-1
- Motion Compensation
- Frame Ordering
- MPEG-2
- Interlaced Video
- Scalability
- MPEG -4
- MPEG-7 & 21
- Only a very quick overview of the aims of these.
Multimedia Authoring: March 17-20
Text Chapters:
Chapters 1&2
Useful Links
You can get Simon Gauvin's PowerPoint presentation here.
Topics
- Multimedia vs Software Development
- Development Metaphors
- SlideShow
- Iconic Flow
- Hierarchical
- Iconic Flow
- Frames
- Cards/Stacks
- Movie/Filmstrip
- Scripting Language
- Development Tools
- Hypercard
- PowerPoint
- Quest
- Authorware
- Flash
- Director
- Development Process
- Inception
- Script writing
- Storyboaring
- Media Creation
- Programming
- Testing
- Deployment
- Development Team
- Presentation Styles
- Automatic Authoring
- Hypermedia
- Tweening
- 2D & 3D Autotracing
- Templates
- CMS
- Object Orientation
- AI Engines
- Compositing
- Alpha Channel
- Transparency
- Dissolve
- Cross Dissolve
- Animation
- Location
- Shape
- Paths
- Frames & Key Frames
- Interpolation
- Linear, Quadratic, Cubic
- Double Buffering
- Painter Algorithm
- Event Loops
- Delivery Platform Issues
- Supporting Libs
- Text
- Graphics
- Sound
- Video
- Game Engines
Audio Compression: March 22-27
Text Chapters:
Chapter 13: 13.3-13.3.4
Chapter 14: Basically the entire chapter, but less detail in some sections.
Topics
- Vocoders
- Phase Insensitivity
- Channel & Formant Vocoders
- Linear Predective Coding
- Psychoacoustics
- Threshold of Hearing
- Frequency Masking
- Temporal Masking
- Critical Bands
- MPEG Audio Compression
- Perceptual Audio Compression
- Use of Psychoacoustic Model
- MPEG Layers
- MPEG-2 (AAC)
- MPEG-4
- MPEG-7 for Audio
3D Modelling and Rendering: Mar 29 - Apr 5
[This topic is not covered in the text]
Useful Links
Here is an outline of Backward Ray Tracing rendering, and here is a more detailed discussion.
Here is a thorough discussion of Radioisty rendering.
A general discussion of Photon Mapping is available on Wikipedia
You can download a demo version of the modelling tool I was using in class (Strata 3D CX) here (Both Mac and Windows versions are available). This includes documentation, which discusses modelling, textures, lights and cameras, as well as some things regarding rendering.
Topics
- Constructive Solid Modelling
- Surface Modelling
- Textures
- Lights
- Cameras
- Rendering
- Wire Frame
- HIdden Line Removal
- Flat and Smooth Shading
- Backward Ray Tracing
- Shadow, Reflected and Transmitted Rays
- Limitations
- Radiosity
- Photon Mapping
|