视频信号处理与通信 影印本PDF|Epub|txt|kindle电子书版本网盘下载

视频信号处理与通信 影印本PDF格式电子书版下载

注意：本站所有压缩包均有解压码： 点击下载压缩包解压工具

1 VIDEO FORMATION, PERCEPTION,AND REPRESENTATION1

1.1 Color Perception and Specification2

1.1.1 Light and Color，2

1.1.2 Human Perception of Color，3

1.1.3 The Trichromatic Theory of Color Mixture，4

1.1.4 Color Specification by Tristimulus Values，5

1.1.5 Color Specification by Luminance and Chrominance Attributes，6

1.2 Video Capture and Display7

1.2.1 Principles of Color Video Imaging，7

1.2.2 Video Cameras，8

1.2.3 Video Display，10

1.2.5 Gamma Correction，11

1.2.4 Composite versus Component Video，11

1.3 Analog Video Raster12

1.3.1 Progressive and Interlaced Scan，12

1.3.2 Characterization of a Video Raster，14

1.4 Analog Color Television Systems16

1.4.1 Spatial and Temporal Resolution，16

1.4.2 Color Coordinate，17

1.4.3 Signal Bandwidth，19

1.4.4 Multiplexing of Luminance, Chrominance, and Audio，19

1.4.5 Analog Video Recording，21

1.5.1 Notation，22

1.5 Digital Video22

1.5.2 ITU-R BT．601 Digital Video，23

1.5.3 Other Digital Video Formats and Applications，26

1.5.4 Digital Video Recording，28

1.5.5 Video Quality Measure，28

1.6 Summary30

1.7 Problems31

1.8 Bibliography32

2 FOURIER ANALYSIS OF VIDEO SIGNALS AND FREQUENCY RESPONSE OF THE HUMAN VISUAL SYSTEM33

2.1 Multidimensional Continuous-Space Signals and Systems33

2.2 Multidimensional Discrete-Space Signals and Systems36

2.3.1 Spatial and Temporal Frequencies，38

2.3 Frequency Domain Characterization of Video Signals38

2.3.2 Temporal Frequencies Caused by Linear Motion，40

2.4 Frequency Response of the Human Visual System42

2.4.1 Temporal Frequency Response and Flicker Perception，43

2.4.2 Spatial Frequency Response，45

2.4.3 Spatiotemporal Frequency Response，46

2.4.4 Smooth Pursuit Eye Movement，48

2.5 Summary50

2.6 Problems51

2.7 Bibliography52

3 VIDEO SAMPLING53

3.1 Basics of the Lattice Theory54

3.2 Sampling over Lattices59

3.2.1 Sampling Process and Sampled-Space Fourier Transform，60

3.2.2 The Generalized Nyquist Sampling Theorem，61

3.2.3 Sampling Efficiency，63

3.2.4 Implementation of the Prefilter and Reconstruction Filter，65

3.2.5 Relation between Fourier Transforms over Continuous, Discrete,and Sampled Spaces，66

3.3 Sampling of Video Signals67

3.3.1 Required Sampling Rates，67

3.3.2 Sampling Video in Two Dimensions：Progressive versus Interlaced Scans，69

3.3.3 Sampling a Raster Scan：BT. 601 Format Revisited，71

3.3.4 Sampling Video in Three Dimensions，72

3.3.5 Spatial and Temporal Aliasing，73

3.4 Filtering Operations in Cameras and Display Devices76

3.4.1 Camera Apertures，76

3.4.2 Display Apertures，79

3.5 Summary80

3.6 Problems80

3.7 Bibliography83

4 VIDEO SAMPLING RATE CONVERSION84

4.1 Conversion of Signals Sampled on Different Lattices84

4.1.1 Up-Conversion，85

4.1.2 Down-Conversion，87

4.1.3 Conversion between Arbitrary Lattices，89

4.1.4 Filter Implementation and Design, and Other Interpolation Approaches，91

4.2 Sampling Rate Conversion of Video Signals92

4.2.1 Deinterlacing，93

4.2.2 Conversion between PAL and NTSC Signals，98

4.2.3 Motion-Adaptive Interpolation，104

4.3 Summary105

4.4 Problems106

4.5 Bibliography109

5 VIDEO MODELING111

5.1.1 Pinhole Model，112

5.1 Camera Model112

5.1.2 CAHV Model，114

5.1.3 Camera Motions，116

5.2 Illumination Model116

5.2.1 Diffuse and Specular Reflection，116

5.2.2 Radiance Distribution under Differing Illumination and Reflection Conditions，117

5.2.3 Changes in the Image Function Due to Object Motion，119

5.3 Object Model120

5.3.1 Shape Model，121

5.3.2 Motion Model，122

5.4 Scene Model125

5.5.1 Definition and Notation，128

5.5 Two-Dimensional Motion Models128

5.5.2 Two-Dimensional Motion Models Corresponding to Typical Camera Motions，130

5.5.3 Two-Dimensional Motion Corresponding to Three-Dimensional Rigid Motion，133

5.5.4 Approximations of Projective Mapping，136

5.6 Summary137

5.7 Problems138

5.8 Bibliography139

6 TWO-DIMENSIONAL MOTION ESTIMATION141

6.1 Optical Flow142

6.1.1 Two-Dimensional Motion versus Optical Flow，142

6.1.2 Optical Flow Equation and Ambiguity in Motion Estimation，143

6.2 General Methodologies145

6.2.1 Motion Representation，146

6.2.2 Motion Estimation Criteria，147

6.2.3 Optimization Methods，151

6.3 Pixel-Based Motion Estimation152

6.3.1 Regularization Using the Motion Smoothness Constraint，153

6.3.2 Using a Multipoint Neighborhood，153

6.3.3 Pel-Recursive Methods，154

6.4 Block-Matching Algorithm154

6.4.1 The Exhaustive Block-Matching Algorithm，155

6.4.2 Fractional Accuracy Search，157

6.4.3 Fast Algorithms，159

6.4.4 Imposing Motion Smoothness Constraints，161

6.4.5 Phase Correlation Method，162

6.4.6 Binary Feature Matching，163

6.5 Deformable Block-Matching Algorithms165

6.5.1 Node-Based Motion Representation，166

6.5.2 Motion Estimation Using the Node-Based Model，167

6.6 Mesh-Based Motion Estimation169

6.6.1 Mesh-Based Motion Representation，171

6.6.2 Motion Estimation Using the Mesh-Based Model，173

6.7 Global Motion Estimation177

6.7.1 Robust Estimators，177

6.7.3 Indirect Estimation，178

6.7.2 Direct Estimation，178

6.8 Region-Based Motion Estimation179

6.8.1 Motion-Based Region Segmentation，180

6.8.2 Joint Region Segmentation and Motion Estimation，181

6.9 Multiresolution Motion Estimation182

6.9.1 General Formulation，182

6.9.2 Hierarchical Block Matching Algorithm，184

6.10 Application of Motion Estimation in Video Coding187

6.11 Summary188

6.12 Problems189

6.13 Bibliography191

7 THREE-DIMENSIONAL MOTION ESTIMATION194

7.1 Feature-Based Motion Estimation195

7.1.1 Objects of Known Shape under Orthographic Projection，195

7.1.2 Objects of Known Shape under Perspective Projection，196

7.1.3 Planar Objects，197

7.1.4 Objects of Unknown Shape Using the Epipolar Line，198

7.2 Direct Motion Estimation203

7.2.1 Image Signal Models and Motion，204

7.2.2 Objects of Known Shape，206

7.2.3 Planar Objects，207

7.2.4 Robust Estimation，209

7.3 Iterative Motion Estimation212

7.4 Summary213

7.5 Problems214

7.6 Bibliography215

8 FOUNDATIONS OF VIDEO CODING217

8.1 Overview of Coding Systems218

8.1.1 General Framework，218

8.1.2 Categorization of Video Coding Schemes，219

8.2 Basic Notions in Probability and Information Theory221

8.2.1 Characterization of Stationary Sources，221

8.2.2 Entropy and Mutual Information for Discrete Sources，222

8.2.3 Entropy and Mutual Information for Continuous Sources，226

8.3.1 Bound for Lossless Coding，227

8.3 Information Theory for Source Coding227

8.3.2 Bound for Lossy Coding，229

8.3.3 Rate-Distortion Bounds for Gaussian Sources，232

8.4 Binary Encoding234

8.4.1 Huffman Coding，235

8.4.2 Arithmetic Coding，238

8.5 Scalar Quantization241

8.5.1 Fundamentals，241

8.5.2 Uniform Quantization，243

8.5.3 Optimal Scalar Quantizer，244

8.6.1 Fundamentals，248

8.6 Vector Quantization248

8.6.2 Lattice Vector Quantizer，251

8.6.3 Optimal Vector Quantizer，253

8.6.4 Entropy-Constrained Optimal Quantizer Design，255

8.7 Summary257

8.8 Problems259

8.9 Bibliography261

9 WAVEFORM-BASED VIDEO CODING263

9.1 Block-Based Transform Coding263

9.1.1 Overview，264

9.1.2 One-Dimensional Unitary Transform，266

9.1.3 Two-Dimensional Unitary Transform，269

9.1.4 The Discrete Cosine Transform，271

9.1.5 Bit Allocation and Transform Coding Gain，273

9.1.6 Optimal Transform Design and the KLT，279

9.1.7 DCT-Based Image Coders and the JPEG Standard，281

9.1.8 Vector Transform Coding，284

9.2 Predictive Coding285

9.2.1 Overview，285

9.2.2 Optimal Predictor Design and Predictive Coding Gain，286

9.2.3 Spatial-Domain Linear Prediction290

9.2.4 Motion-Compensated Temporal Prediction，291

9.3.1 Block-Based Hybrid Video Coding，293

9.3 Video Coding Using Temporal Prediction and Transform Coding293

9.3.2 Overlapped Block Motion Compensation，296

9.3.3 Coding Parameter Selection，299

9.3.4 Rate Control，302

9.3.5 Loop Filtering，305

9.4 Summary308

9.5 Problems309

9.6 Bibliography311

10 CONTENT-DEPENDENT VIDEO CODING314

10.1 Two-Dimensional Shape Coding314

10.1.1 Bitmap Coding，315

10.1.2 Contour Coding，318

10.1.3 Evaluation Criteria for Shape Coding Efficiency，323

10.2 Texture Coding for Arbitrarily Shaped Regions324

10.2.1 Texture Extrapolation，324

10.2.2 Direct Texture Coding，325

10.3 Joint Shape and Texture Coding326

10.4 Region-Based Video Coding327

10.5 Object-Based Video Coding328

10.5.1 Source Model F2D，330

10.5.2 Source Models R3D and F3D，332

10.6 Knowledge-Based Video Coding336

10.7 Semantic Video Coding338

10.8 Layered Coding System339

10.9 Summary342

10.10 Problems343

10.11 Bibliography344

11 SCALABLE VIDEO CODING349

11.1 Basic Modes of Scalability350

11.1.1 Quality Scalability，350

11.1.2 Spatial Scalability，353

11.1.3 Temporal Scalability，356

11.1.4 Frequency Scalability，356

11.1.6 Fine-Granularity Scalability，357

11.1.5 Combination of Basic Schemes，357

11.2 Object-Based Scalability359

11.3 Wavelet-Transform-Based Coding361

11.3.1 Wavelet Coding of Still Images，363

11.3.2 Wavelet Coding of Video，367

11.4 Summary370

11.5 Problems370

11.6 Bibliography371

12 STEREO AND MULTIVIEW SEQUENCE PROCESSING374

12.1.2 Visual Sensitivity Thresholds for Depth Perception，375

12.1.1 Binocular Cues—Stereopsis，375

12.1 Depth Perception375

12.2 Stereo Imaging Principle377

12.2.1 Arbitrary Camera Configuration，377

12.2.2 Parallel Camera Configuration，379

12.2.3 Converging Camera Configuration，381

12.2.4 Epipolar Geometry，383

12.3 Disparity Estimation385

12.3.1 Constraints on Disparity Distribution，386

12.3.2 Models for the Disparity Function，387

12.3.3 Block-Based Approach，388

12.3.4 Two-Dimensional Mesh-Based Approach，388

12.3.5 Intra-Line Edge Matching Using Dynamic Programming，391

12.3.6 Joint Structure and Motion Estimation，392

12.4 Intermediate View Synthesis393

12.5 Stereo Sequence Coding396

12.5.1 Block-Based Coding and MPEG-2 Multiview Profile，396

12.5.2 Incomplete Three-Dimensional Representation of Multiview Sequences，398

12.5.3 Mixed-Resolution Coding，398

12.5.4 Three-Dimensional Object-Based Coding，399

12.5.5 Three-Dimensional Model-Based Coding，400

12.6 Summary400

12.7 Problems402

12.8 Bibliography403

13 VIDEO COMPRESSION STANDARDS405

13.1 Standardization406

13.1.1 Standards Organizations，406

13.1.2 Requirements for a Successful Standard，409

13.1.3 Standard Development Process，411

13.1.4 Applications for Modem Video Coding Standards，412

13.2 Video Telephony with H.261 and H.263413

13.2.1 H.261 Overview，413

13.2.2 H. 263 Highlights，416

13.2.3 Comparison，420

13.3 Standards for Visual Communication Systems421

13.3.1 H. 323 Multimedia Terminals，421

13.3.2 H. 324 Multimedia Terminals，422

13.4 Consumer Video Communications with MPEG-1423

13.4.1 Overview，423

13.4.2 MPEG-1 Video，424

13.5 Digital TV with MPEG-2426

13.5.1 Systems，426

13.5.2 Audio，426

13.5.3 Video，427

13.5.4 Profiles，435

13.6 Coding of Audiovisual Objects with MPEG-4437

13.6.1 Systems，437

13.6.2 Audio，441

13.6.3 Basic Video Coding，442

13.6.4 Object-Based Video Coding，445

13.6.5 Still Texture Coding，447

13.6.6 Mesh Animation，447

13.6.7 Face and Body Animation，448

13.6.8 Profiles，451

13.6.9 Evaluation of Subjective Video Quality，454

13.7 Video Bit Stream Syntax454

13.8 Multimedia Content Description Using MPEG-7458

13.8.1 Overview，458

13.8.2 Multimedia Description Schemes，459

13.8.3 Visual Descriptors and Description Schemes，461

13.9 Summary465

13.10 Problems466

13.11 Bibliography467

14 ERROR CONTROL IN VIDEO COMMUNICATIONS472

14.1 Motivation and Overview of Approaches473

14.2 Typical Video Applications and Communication Networks476

14.2.1 Categorization of Video Applications，476

14.2.2 Communication Networks，479

14.3 Transport-Level Error Control485

14.3.1 Forward Error Correction，485

14.3.2 Error-Resilient Packetization and Multiplexing，486

14.3.3 Delay-Constrained Retransmission，487

14.3.4 Unequal Error Protection，488

14.4 Error-Resilient Encoding489

14.4.1 Error Isolation，489

14.4.2 Robust Binary Encoding，490

14.4.3 Error-Resilient Prediction，492

14.4.4 Layered Coding with Unequal Error Protection，493

14.4.5 Multiple-Description Coding，494

14.4.6 Joint Source and Channel Coding，498

14.5 Decoder Error Concealment498

14.5.1 Recovery of Texture Information，500

14.5.2 Recovery of Coding Modes and Motion Vectors，501

14.5.3 Syntax-Based Repair，502

14.6 Encoder-Decoder Interactive Error Control502

14.6.1 Coding-Parameter Adaptation Based on Channel Conditions，503

14.6.2 Reference Picture Selection Based on Feedback Information，503

14.6.3 Error Tracking Based on Feedback Information，504

14.6.4 Retransrnission without Waiting，504

14.7 Error-Resilience Tools in H.263 and MPEG-4505

14.7.1 Error-Resilience Tools in H. 263，505

14.7.2 Error-Resilience Tools in MPEG-4，508

14.8 Summary509

14.9 Problems511

14.10 Bibliography513

15 STREAMING VIDEO OVER THE INTERNET AND WIRELESS IP NETWORKS519

15.1 Architecture for Video Streaming Systems520

15.2 Video Compression522

15.3 Application-Layer QoS Control for Streaming Video522

15.3.1 Congestion Control，522

15.3.2 Error Control，525

15.4 Continuous Media Distribution Services529

15.4.1 Network Filtering，529

15.4.2 Application-Level Multicast，531

15.4.3 Content Replication，532

15.5 Streaming Servers533

15.5.1 Real-Time Operating System，534

15.5.2 Storage System，537

15.6 Media Synchronization539

15.7 Protocols for Streaming Video542

15.7.1 Transport Protocols，543

15.7.2 Session Control Protocol：RTSP，545

15.8 Streaming Video over Wireless IP Networks546

15.8.1 Network-Aware Applications，548

15.8.2 Adaptive Service549

15.9 Summary554

15.10 Bibliography555

A.1 First-and Second-Order Gradient562

APPENDIX A: DETERMINATION OF SPATIAL-TEMPORAL GRADIENTS562

A.2 Sobel Operator563

A.3 Difference of Gaussian Filters563

APPENDIX B: GRADIENT DESCENT METHODS565

B.1 First-Order Gradient Descent Method565

B.2 Steepest Descent Method566

B.3 Newton’s Method566

B.4 Newton-Ralphson Method567

B.5 Bibliography567

APPENDIX C: GLOSSARY OF ACRONYMS568

APPENDIX D: ANSWERS TO SELECTED PROBLEMS575