Table of Contents

Cover image

Title page

Copyright

1. Video in the Modern World

2. Introduction to Video Processing

2.1 Digital Video: Pixels and Resolution

2.2 Digital Video: Pixels and Bits

2.3 Digital Video: Color Spaces

2.4 Video Processing Performance

3. Sampling and Aliasing

3.1 Nyquist Sampling Rule

4. Introduction to Digital Filtering

4.1 Median Filtering

4.2 FIR Filters

4.3 FIR Filter Construction

4.4 Computing Frequency Response

5. Video Scaling

5.1 Understanding Video Scaling

5.2 Implementing Video Scaling

5.3 Video Scaling for Different Aspect Ratios

5.4 Conclusion

6. Video Deinterlacing

6.1 Basic Deinterlacing Techniques

6.2 Motion-Adaptive Deinterlacing: The Basics

6.3 Logic Requirements

6.4 Cadence Detection

6.5 Conclusion

7. Alpha Blending

7.1 Introduction

7.2 Concept and Math Behind Alpha Blending

7.3 Implementing Alpha Blending in Hardware

7.4 Creating a Different Background

7.5 Conclusion

8. Sensor Processing for Image Sensors

8.1 CMOS Sensor Basics

8.2 A Simplistic HW Implementation of Bayer Demosaicing

8.3 Sensor Processing in Military Electro-optical Infrared Systems

8.4 Conclusion

9. Video Interfaces

9.1 SDI

9.2 Display Port

9.3 HDMI

9.4 DVI

9.5 VGA

9.6 CVBS

9.7 S-Video

9.8 Component Video

10. Video Rotation

10.1 Interpolation

11. Entropy, Predictive Coding and Quantization

11.1 Entropy

11.2 Huffman Coding

11.3 Markov Source

11.4 Predictive Coding

11.5 Differential Encoding

11.6 Lossless Compression

11.7 Quantization

11.8 Decibels

12. Frequency Domain Representation

12.1 DFT and IDFT Equations

12.2 Fast Fourier Transform

12.3 Discrete Cosine Transform

13. Image Compression Fundamentals

13.1 Baseline JPEG

13.2 DC Scaling

13.3 Quantization Tables

13.4 Entropy Coding

13.5 JPEG Extensions

14. Video Compression Fundamentals

14.1 Block Size

14.2 Motion Estimation

14.3 Frame Processing Order

14.4 Compressing I-frames

14.5 Compressing P-frames

14.6 Compressing B-frames

14.7 Rate Control and Buffering

14.8 Quantization Scale Factor

15. From MPEG to H.264 Video Compression

15.1 MPEG-2

15.2 H.264 Video Compression Standard

15.3 Digital Cinema Applications

16. Video Noise and Compression Artifacts

16.1 Salt-and-pepper Noise

16.2 Mosquito Noise

16.3 Block Artifacts

17. Video Modulation and Transport

17.1 Complex Modulation and Demodulation

17.2 Modulated Signal Bandwidth

17.3 Pulse Shaping Filter

17.4 Raised Cosine Filter

17.5 Signal Upconversion

17.6 Digital Upconversion

Chapter 18. Video over IP

18.1 Basics of Internet Protocol (IP)

18.2 Encapsulation

18.3 Video Streams

18.4 Transport Protocols

18.5 IP Transport

18.6 Video Over Internet Issues

18.7 Video Streaming

18.8 Multicast Video

18.9 Video Conferencing

19. Segmentation and Focus

19.1 Measuring Focus

19.2 Segmentation

20. Memory Considerations When Building a Video Processing Design

20.1 The Frame Buffer

20.2 Calculating External Memory Bandwidth Required

20.3 Calculating On-Chip Memory

20.4 Conclusion

21. Debugging FPGA-based Video Systems

21.1 Timing Analysis

21.2 The SystemConsole Debugger

21.3 Check That Clocks and Resets are Working

21.4 Clocked and Flow Controlled Video Streams

21.5 Debugging Tools

21.6 Converting from Clocked to Flow-controlled Video Streams

21.7 Converting from Flow-controlled to Clocked Video Streams

21.8 Free-running Streaming Video Interfaces

21.9 Insufficient Memory Bandwidth

21.10 Check Data Within Stream

21.11 Summary

Index