Visual media coding and transmission

1 Introduction......Page 21
2.2 Redundancy in Video Signals......Page 27
2.3.1 Video Signal Representation and Picture Structure......Page 28
2.3.2 Removing Spatial Redundancy......Page 29
2.3.3 Removing Temporal Redundancy......Page 34
2.3.4 Basic Video Codec Structure......Page 36
2.4.1 Frame Types......Page 37
2.4.2 MC Accuracy......Page 39
2.4.3 MB Mode Selection......Page 40
2.4.4 Integer Transform......Page 41
2.4.6 Deblocking Filters......Page 42
2.4.8 Error-Robust Video Coding......Page 44
2.5.1 Standardization Bodies......Page 48
2.5.3 MPEG Standards......Page 49
2.6.1 Subjective Performance Evaluation......Page 51
2.6.2 Objective Performance Evaluation......Page 52
2.7 Conclusions......Page 55
3.1 Introduction......Page 59
3.1.1 Applications and Scenarios......Page 60
3.2 Overview of the State of the Art......Page 61
3.2.1 Scalable Coding Techniques......Page 62
3.2.2 Multiple Description Coding......Page 65
3.2.3 Stereoscopic 3D Video Coding......Page 67
3.3.1 Scalable Coding for Shape, Texture, and Depth for 3D Video......Page 68
3.3.2 3D Wavelet Coding......Page 88
3.4.1 Correlated Frames for Error Robustness......Page 94
3.4.2 Odd–Even Frame Multiple Description Coding for Scalable H.264/AVC......Page 102
3.4.3 Wireless JPEG 2000: JPWL......Page 111
3.4.4 JPWL Simulation Results......Page 114
3.4.5 Towards a Theoretical Approach for Optimal Unequal Error Protection......Page 116
3.5 Conclusions......Page 118
4.1 Introduction......Page 125
4.1.1 The Video Codec Complexity Balance......Page 126
4.2.1 The Slepian–Wolf Theorem......Page 129
4.2.2 The Wyner–Ziv Theorem......Page 130
4.2.3 DVC Codec Architecture......Page 131
4.2.5 Turbo Encoder......Page 132
4.2.7 Side Information......Page 134
4.2.8 Turbo Decoder......Page 135
4.2.9 Reconstruction: Inverse Quantization......Page 136
4.2.10 Key Frame Coding......Page 137
4.3.1 Proposed Technical Solution......Page 138
4.3.2 Performance Evaluation......Page 140
4.4.1 Proposed Technical Solution......Page 142
4.4.2 Performance Evaluation......Page 146
4.5.1 Proposed Technical Solution......Page 149
4.5.2 Performance Evaluation......Page 152
4.6.1 Proposed Technical Solution......Page 154
4.6.2 Performance Evaluation......Page 157
4.7.1 Proposed Technical Solution......Page 159
4.7.2 Performance Evaluation......Page 160
4.8 Modeling the DVC Decoder for Error-prone Wireless Channels......Page 164
4.8.1 Proposed Technical Solution......Page 165
4.8.2 Performance Evaluation......Page 169
4.9 Error Concealment Using a DVC Approach for Video Streaming Applications......Page 171
4.9.1 Proposed Technical Solution......Page 172
4.9.2 Performance Evaluation......Page 175
4.10 Conclusions......Page 178
5.1 Introduction......Page 181
5.2.1 Rate Control......Page 182
5.2.2 Error Resilience......Page 184
5.3.1 Problem Definition\rand Objectives......Page 185
5.3.2 Proposed Technical Solution......Page 186
5.3.3 Performance Evaluation......Page 189
5.4.1 Problem Definition\rand Objectives......Page 191
5.4.2 Proposed Technical Approach......Page 192
5.4.3 Performance Evaluation......Page 197
5.5.1 Problem Definition\rand Objectives......Page 199
5.5.2 Proposed Technical Solution......Page 200
5.5.3 Performance Evaluation......Page 201
5.6.1 Problem Definition\rand Objectives......Page 202
5.6.2 Proposed Technical Solution......Page 203
5.6.3 Performance Evaluation......Page 207
5.6.4 Conclusions......Page 208
5.7.2 Proposed Technical Solution......Page 209
5.8.2 Proposed Technical Solution......Page 215
5.8.3 Performance Evaluation......Page 217
5.8.4 Conclusions......Page 218
5.9 Conclusions......Page 219
6.1 Introduction......Page 223
6.2.2 Proposed Technical Solution......Page 225
6.3.2 Proposed Technical Solution......Page 228
6.3.3 Performance Evaluation......Page 230
6.3.4 Conclusions and Further Work......Page 231
6.4.2 Proposed Technical Solution......Page 232
6.4.3 Performance Evaluation......Page 235
6.5.2 Proposed Technical Solution......Page 236
6.5.3 Performance Evaluation......Page 239
6.5.4 Conclusions and Further Work......Page 242
7.1 Introduction......Page 245
7.2.1 QoS in Wireless Networks......Page 248
7.2.2 Constraints on Wireless Multimedia Communications......Page 251
7.2.3 Multimedia Compression Technologies......Page 254
7.2.4 Multimedia Transmission Issues in Wireless Networks......Page 255
7.2.5 Resource Management Strategy in Wireless Multimedia Communications......Page 259
7.3 Conclusions......Page 264
8.2.1 GSM/EDGE Radio Access Network (GERAN)......Page 267
8.2.2 GPRS Physical Link Layer Model Description......Page 270
8.2.3 EGPRS Physical Link Layer Model Description......Page 272
8.2.4 GPRS Physical Link Layer Simulator......Page 276
8.2.5 EGPRS Physical Link Layer Simulator......Page 281
8.2.6 E/GPRS Radio Interface Data Flow Model......Page 288
8.2.7 Real-time GERAN Emulator......Page 290
8.2.8 Conclusion......Page 291
8.3.1 UMTS Terrestrial Radio Access Network (UTRAN)......Page 292
8.3.2 UMTS Physical Link Layer Model Description......Page 299
8.3.3 Model Verificatio for Forward Link......Page 310
8.3.4 UMTS Physical Link Layer Simulator......Page 318
8.3.5 Performance Enhancement Techniques......Page 327
8.3.6 UMTS Radio Interface Data Flow Model......Page 329
8.3.7 Real-time UTRAN Emulator......Page 332
8.3.8 Conclusion......Page 333
8.4.1 Introduction......Page 336
8.4.2 WIMAX System Description......Page 337
8.4.3 Physical Layer Simulation Results and Analysis......Page 343
8.4.4 Error Pattern Files Generation......Page 344
8.5 Conclusions......Page 348
8.6\rAppendix......Page 349
9.1.1 3G Real-time Audiovisual Requirements......Page 353
9.1.2 Video Transmission over Mobile Communication Systems......Page 355
9.1.3 Circuit-switched Bearers......Page 359
9.1.4 Packet-switched Bearers......Page 368
9.1.5 Video Communications over GPRS......Page 370
9.1.6 GPRS Traffic\rCapacity......Page 371
9.1.7 Error Performance......Page 374
9.1.9 Traffic\rCharacteristics......Page 377
9.1.10 Error Performance......Page 378
9.1.11 Voice Communication over Mobile Channels......Page 379
9.1.12 Support of Voice over UMTS Networks......Page 380
9.1.13 Error-free Performance......Page 381
9.1.15 Support of Voice over GPRS Networks......Page 382
9.1.16 Conclusion......Page 383
9.2.1 Performance Modeling......Page 385
9.2.2 Probability Calculation......Page 387
9.2.4 Propagation Loss Modeling......Page 388
9.2.5 Energy-optimized UEP Scheme......Page 389
9.2.6 Simulation Setup......Page 390
9.2.7 Performance Analysis......Page 392
9.3 Link Adaptation for Video Services......Page 393
9.3.1 Time-varying Channel Model Design......Page 394
9.3.2 Link Adaptation for Real-time Video Communications......Page 399
9.3.3 Link Adaptation for Streaming Video Communications......Page 409
9.3.4 Link Adaptation for UMTS......Page 416
9.3.5 Conclusion......Page 422
9.4.2 Implementation of UTRAN System-level Simulator......Page 423
9.4.3 Performance Evaluation of Enhanced CAC Scheme......Page 430
9.5 Conclusions......Page 431
10.1 Introduction......Page 437
10.2.1 State of the Art......Page 438
10.2.2 Optimisation of QoS for Heterogeneous Networks......Page 440
10.3 Implementation of a QoS-optimized Inter-networked Emulator......Page 442
10.3.1 Emulation System Physical Link Layer Simulation......Page 446
10.3.3 QoS Mapping Architecture......Page 448
10.3.4 General User Interface......Page 458
10.4.1 Experimental Setup......Page 462
10.4.2 Test for the EDGE System......Page 463
10.4.4 Tests for the EDGE-to-UMTS System......Page 465
10.5 Conclusions......Page 472
11.1 Introduction......Page 475
11.2.1 Recent Developments in Context-aware Systems......Page 477
11.2.2 Standardization Efforts on Contextual Information for Content Adaptation......Page 487
11.3 Other Standardization Efforts by the IETF and W3C......Page 496
11.4 Summary of Standardization Activities......Page 499
11.4.2 Existing DRM Initiatives......Page 500
11.4.3 The New ‘‘Adaptation Authorization’’ Concept......Page 501
11.4.4 Adaptation Decision......Page 502
11.4.5 Context-based Content Adaptation......Page 508
11.5.1 Types and Representations of Contextual Information......Page 512
11.5.2 Context Providers and Pro ling......Page 514
11.5.3 User Privacy......Page 517
11.5.4 Generation of Contextual Information......Page 518
11.6 The Application Scenario for Context-based Adaptation of Governed Media Contents......Page 519
11.6.1 Virtual Classroom Application Scenario......Page 520
11.6.2 Mechanisms Using Contextual Information in a Virtual Collaboration Application......Page 522
11.6.3 Ontologies in Context-aware Content Adaptation......Page 523
11.6.4 System Architecture of a Scalable Platform for Context-aware and DRM-enabled Content Adaptation......Page 524
11.6.5 Context Providers......Page 527
11.6.6 Adaptation Decision Engine......Page 530
11.6.7 Adaptation Authorization......Page 534
11.6.8 Adaptation Engines Stack......Page 537
11.6.9 Interfaces between Modules of the Content Adaptation Platform......Page 564
11.7 Conclusions......Page 572
Index......Page 579