The handbook of MPEG applications: Standards in practice

THE HANDBOOK OF MPEG APPLICATIONS......Page 3
Contents......Page 7
List of Contributors......Page 17
MPEG Standards in Practice......Page 21
1.1 Introduction......Page 53
1.2 Design and Architecture......Page 54
1.2.1 Media Processing Mechanism......Page 56
1.3 HD Video Acquisition......Page 57
1.3.1 MPEG-4/AVC HD System Chain......Page 59
1.4 Network and Topology Considerations......Page 60
1.4.1 Packetization and Depacketization......Page 62
1.4.2 Retransmission-Based Packet Recovery......Page 63
1.4.3 Network Topology Models......Page 65
1.4.4 Relaying......Page 66
1.4.5 Extension to Wireless Networks......Page 67
1.5 Real-Time Transcoding......Page 68
1.6 HD Video Rendering......Page 70
1.6.1 Rendering Multiple Simultaneous HD Video Streams on a Single Machine......Page 72
1.6.2 Deinterlacing......Page 74
1.7.3 Stream Format Selection......Page 75
1.8 Other HD Streaming Systems......Page 76
References......Page 77
2.1 Introduction......Page 79
2.2 Content in the Context of Production and Management......Page 80
2.2.1 Requirements on Video and Audio Encoding Standards......Page 82
2.2.2 Requirements on Metadata Standards in CMS and Production......Page 85
2.3.1 MPEG-1......Page 87
2.3.2 MPEG-2-Based Formats and Products......Page 88
2.3.3 MPEG-4......Page 90
2.3.4 Summary......Page 92
2.4.1 MPEG-7 in the Context of Content Management, Broadcasting and Media Production......Page 93
2.4.2 MPEG-21 and its Impact on Content Management and Media Production......Page 95
2.5 Conclusions......Page 97
References......Page 98
3.1 Introduction......Page 101
3.2 Previous Work......Page 104
3.3.1 Spatial Quality Assessment......Page 106
3.3.2 Temporal Quality Assessment......Page 107
3.3.3 Pooling Strategy......Page 108
3.3.4 MPEG-4 Specific Quality Assessment......Page 109
3.3.5 Relationship to Human Visual System......Page 111
3.4 MPEG-4 Compressed Videos in Wireless Environments......Page 112
3.4.1 Videos for the Study......Page 113
3.4.2 The Study......Page 116
3.5 Conclusion......Page 118
References......Page 119
4.1 Introduction......Page 123
4.2 Related Work......Page 125
4.3 Enabling the New Advertising Model......Page 127
4.3.1 Broadcasting Ad-Free TV Programs and Advertising Material......Page 128
4.3.2 Identifying the Most Suitable Items for Each Viewer......Page 131
4.3.3 Integrating the Selected Material in the Scenes of the TV Programs......Page 132
4.3.4 Delivering Personalized Commercial Functionalities......Page 133
4.4 An Example......Page 134
4.5.1 Technical Settings......Page 135
4.5.2 Evaluation Methodology and Results......Page 137
4.6 Conclusions......Page 139
References......Page 141
5.1 Introduction......Page 145
5.2.1 Video Summarization......Page 146
5.2.2 Video Adaptation......Page 148
5.3 A Summarization Framework Using MPEG Standards......Page 149
5.4.1 Coding Units and Summarization Units......Page 150
5.4.2 Modalities of Video Summaries......Page 152
5.5.2 Examples of Descriptions......Page 153
5.6 Integrated Summarization and Adaptation Framework in MPEG-4 SVC......Page 154
5.6.1 MPEG-21 Tools for Usage Environment Description......Page 155
5.6.2 Summarization Units in MPEG-4 SVC......Page 156
5.6.3 Extraction Process in MPEG-4 SVC......Page 157
5.6.4 Including Summarization in the Framework......Page 158
5.6.5 Further Use of MPEG-21 Tools......Page 160
5.7.1 Test Scenario......Page 162
5.7.3 Experimental Results......Page 164
References......Page 168
6.1 Introduction......Page 171
6.2 Demands for Video Security......Page 172
6.3.2 Complexity Issue......Page 173
6.4 Previous Work on Video Encryption......Page 174
6.5 H.264 Video Encryption Techniques......Page 178
6.5.1 Complete Encryption Technique......Page 179
6.5.5 Entropy Coding Encryption Technique......Page 180
6.6.1 Related Work......Page 181
6.6.2 New H.264 Encryption Scheme......Page 182
6.6.3 Chaotic Stream Cipher......Page 183
6.6.4 CABAC Encryption......Page 185
6.6.5 Experimental Results and Analysis......Page 187
6.7 Concluding Remarks and Future Works......Page 189
References......Page 191
7.1 Introduction to Video Coding Optimization Methods......Page 195
7.2.1 Rate–Distortion Theory......Page 196
7.2.2 Rate Control Algorithms......Page 197
7.2.3 Rate–Distortion Optimization......Page 200
7.3.1 Motion Estimation Algorithm......Page 202
7.3.5 Frame Rate......Page 204
7.4 Joint Computational Complexity and Rate Control Optimization......Page 205
7.4.1 Computational Complexity and Bit Allocation Problems......Page 207
7.4.2 Optimal Coding Modes Selection......Page 209
7.4.3 C-R-D Approach for Solving Encoding Computational Complexity and Bit Allocation Problems......Page 211
7.4.4 Allocation of Computational Complexity and Bits......Page 213
7.5 Transform Coding Optimization......Page 218
References......Page 221
8.1 Introduction......Page 225
8.2 Background......Page 226
8.3 Literature Review......Page 227
8.4.1 Compressed Video and Metadata Generation......Page 229
8.4.2 Adapting the Video......Page 231
8.4.3 Slicing Strategies......Page 232
8.4.4 Performance Evaluation......Page 233
8.5 On-line Video Adaptation for P2P Overlays......Page 235
8.5.2 Peer Joining......Page 236
8.5.4 Video Buffering, Adaptation, and Transmission......Page 237
8.7 Conclusion......Page 238
References......Page 239
9.1 Introduction......Page 241
9.2.1 Representation of Image Data......Page 242
9.2.2 State of the Art in Image Clustering and Retrieval......Page 244
9.2.3 Image Clustering and Retrieval Systems Based on MPEG-7......Page 245
9.2.4 Evaluation of MPEG-7 Features......Page 247
9.3.1 Visual Keyword Generation......Page 248
9.3.2 Text Keyword Generation......Page 250
9.4 Dimensionality Reduction of Multimodal Vector Representation Using a Nonlinear Diffusion Kernel......Page 251
9.5.1 Image Dataset......Page 253
9.5.2 Image Clustering Experiments......Page 254
9.6 Conclusion......Page 256
References......Page 257
10.1 Introduction......Page 261
10.2 Literature Review......Page 263
10.3.1 Feature Distance......Page 264
10.3.2 Applications Using Single Visual Descriptor......Page 265
10.3.3 Evaluation of Single Visual Descriptor......Page 267
10.4.1 Feature Aggregation......Page 272
10.4.2 Applications Using the Aggregated Visual Descriptors......Page 275
10.4.3 Evaluation of the Aggregated Visual Descriptors......Page 277
References......Page 281
11.1 Introduction......Page 283
11.2 MPEG-7 as a Means for Collaborative Multimedia Annotation......Page 285
11.3 Experiment Design......Page 288
11.4 Research Method......Page 290
11.5.1 Tag Usage......Page 292
11.5.2 Effect of Time......Page 300
11.6 MPEG-7 Profile......Page 301
11.6.2 User Details......Page 303
11.6.4 Implications......Page 305
11.7 Related Research Work......Page 306
11.8 Concluding Discussion......Page 309
References......Page 310
12.1 Introduction......Page 313
12.2 MPEG-7-Based Domain Knowledge Representation......Page 315
12.3 Domain Ontology Representation......Page 317
12.4 Property Representation......Page 319
12.4.1 Property Value Representation......Page 322
12.5 Class Representation......Page 325
12.6 Representation of Individuals......Page 327
12.7 Representation of Axioms......Page 329
12.8.2 Semantic-Based Multimedia Content Retrieval......Page 334
12.9 Conclusions......Page 335
References......Page 336
13 Survey of MPEG-7 Applications in the Multimedia Lifecycle......Page 337
13.1 MPEG-7 Annotation Tools......Page 339
13.2 MPEG-7 Databases and Retrieval......Page 342
13.3 MPEG-7 Query Language......Page 345
13.4 MPEG-7 Middleware......Page 350
13.5 MPEG-7 Mobile......Page 352
13.6 Summarization and Outlook......Page 356
References......Page 357
14.1 Background on Content-Based Indexing and Retrieval......Page 363
14.2 MPEG-7 and MPEG-21 in ETSI TV-Anytime......Page 364
14.3 MPEG-7 and MPEG-21 in ATIS IPTV Specifications......Page 365
14.4 MEPG-21 in the Digital Living Network Alliance (DLNA)......Page 367
14.5 Content Analysis for MPEG-7 Metadata Generation......Page 369
14.6.2 Temporal Decompositions for Video Shots......Page 370
14.6.3 Spatial Decompositions......Page 373
14.6.4 Textual Content......Page 374
14.7.1 Brief Introduction to MPEG-7 Audio......Page 376
14.7.2 Content Processing Using MPEG-7 Audio......Page 377
14.8 Summary......Page 379
References......Page 380
15.1 Introduction......Page 383
15.1.1 Application Scenarios......Page 384
15.2 The Digital Item Adaptation Framework for Personalization......Page 385
15.2.1 Usage Environment......Page 386
15.3 Use Case Scenario......Page 388
15.3.1 A Deeper Look at the MPEG-7/21 Preference Model......Page 389
15.4.1 Using Semantic Web Languages and Ontologies for Media Retrieval......Page 390
15.4.2 XML Databases and Query Languages for Semantic Multimedia Retrieval......Page 395
15.4.3 Exploiting More Expressive Preference Models......Page 399
15.5 Example Application......Page 403
15.6 Summary......Page 405
References......Page 406
16.1 Introduction......Page 409
16.2 Related Work......Page 410
16.3 Dealing Bandwidth Using Game Theory......Page 412
16.3.1 Integration of MPEG-7 and MPEG-21 into the Game Approach......Page 413
16.3.2 The Bandwidth Dealing Game Approach......Page 415
16.3.3 Implementing the Bandwidth Allocation Model......Page 419
16.4 An Application Example......Page 420
References......Page 422
17.1 Introduction......Page 425
17.2 Overview of the Usage of MPEG-21 Digital Items......Page 426
17.3 Universal Plug and Play (UPnP): DIDL-Lite......Page 427
17.4 Microsoft’s Interactive Media Manager (IMM)......Page 431
17.5.1 Objectives......Page 436
17.5.2 Architecture......Page 437
17.5.3 Interaction of Content- and Application-Level Processing......Page 439
17.6.1 Introduction......Page 440
17.6.2 Use Case Scenarios......Page 441
17.6.3 Data Model in Use Case Scenario 1......Page 442
17.6.4 Data Model in Use Case Scenario 2......Page 444
17.6.5 Evaluation and Discussion......Page 445
17.7 Information Asset Management in a Digital Library......Page 446
References......Page 450
18.1 Introduction......Page 453
18.2 Digital Rights Management in MPEG-21......Page 455
18.2.1 Intellectual Property Management and Protection......Page 456
18.2.2 Rights Expression Language......Page 459
18.2.3 Other Parts......Page 460
18.2.4 SITDRM......Page 461
18.3 MPEG-21 in Copyright Protection......Page 462
18.4 MPEG-21 in Enterprise Digital Rights Management......Page 465
18.5 MPEG-21 in Privacy Protection......Page 468
18.5.1 Roles and Authorised Domains in MPEG REL......Page 469
18.5.2 Extending MPEG REL for Privacy......Page 470
18.5.3 Verifying Licences without a Central Licence Issuer......Page 471
References......Page 472
19.1 Introduction......Page 475
19.2.1 CAM4Home Framework Overview......Page 477
19.2.3 Content Adaptation Requirements......Page 478
19.2.5 Extensibility......Page 479
19.3 CAM Metadata Model......Page 480
19.3.2 CAM Supplementary Metamodel......Page 481
19.3.3 CAM External Metamodel......Page 482
19.4 Study of the Existing Multimedia Standards......Page 483
19.5 CAM Metadata Encoding Using MPEG-21/7......Page 485
19.5.1 CAM Object Encoding......Page 486
19.5.2 CAM Bundle Encoding......Page 487
19.5.3 Core Metadata Encoding......Page 488
19.5.4 Supplementary Metadata Encoding......Page 492
19.6 Discussion......Page 493
References......Page 494
20.1 Introduction......Page 497
20.2.1 Motivation......Page 499
20.2.2 Model for Media Bitstreams......Page 500
20.2.3 Adaptation and Packaging Workflow......Page 502
20.3.1 Architecture......Page 505
20.3.3 Performance Measurements......Page 509
20.4 Directions for Future Research......Page 513
20.5 Discussion and Conclusions......Page 514
References......Page 516
21.1 Introduction......Page 519
21.2.1 Concept......Page 520
21.2.2 Components and Relations to Other Standards......Page 522
21.2.3 Advantages for the Industry and Organizations......Page 523
21.3.2 Concept......Page 524
21.3.3 Application Domains......Page 525
21.3.4 Components......Page 527
21.3.5 Realization of the Functionalities......Page 528
21.3.6 Implementation and Application of the Format......Page 534
References......Page 541
Index......Page 543