3d Online Multimedia and Games: Processing, Visualization and Transmission

Contents......Page 6
1.1 Overview......Page 13
1.2 Networking Issues in Online Multimedia......Page 16
1.3 Joint Texture-Mesh Simplification and View Independent Transmission......Page 17
1.4 View Dependent Transmission......Page 18
1.5 Content and Background Creation......Page 19
1.6 Implementing Simple Online Games......Page 20
1.7 Online Appendices......Page 21
2.1 Introduction......Page 23
2.2 Probabilistic QoS Based Retrieval from a Single or Distributed Independent Servers......Page 27
2.3 Collaborative Distributed Retrieval......Page 43
2.4 Summary......Page 51
References......Page 52
3.1 Introduction......Page 55
3.2 Transmission Control Protocol......Page 56
3.4 Limitation of TCP in Wireless Networks......Page 64
3.5 Improving Performance......Page 66
3.5.1.1 Snoop......Page 67
3.5.1.2 New Snoop......Page 68
3.5.2.1 Selective Acknowledgments......Page 69
3.5.2.2 Fast Retransmit......Page 71
3.5.2.3 Explicit Bad State Notification......Page 72
3.5.3.1 Multiple TCP and Selective Repeat Protocol......Page 74
3.5.3.2 Indirect-TCP......Page 77
3.5.3.3 Mobile-TCP......Page 78
3.6 Discussion and Final Thoughts......Page 80
References......Page 82
4.1 Texture Compression for Video Cards......Page 85
4.2 Overview of Mesh Coding......Page 87
4.3 Overview of Level of Detail (LOD) Techniques......Page 92
4.4 Motivation......Page 95
References......Page 102
5.2 LOD in Scale-Space......Page 105
5.3 Spherical Scanned Data......Page 108
5.4 Scale Map......Page 111
5.5 Fragmentation Approach for Texture Transmission......Page 112
5.6 Fragment Map and Variable Texture Quality......Page 113
References......Page 121
6.1 Introduction......Page 123
6.2 Overview of Adaptive Strategy......Page 126
6.3 Adaptive Bandwidth Monitoring and Texture Quality Determination......Page 127
6.4 Harmonic Time Compensation Algorithm......Page 129
6.5 Experimental Results......Page 130
6.6 Summary......Page 134
References......Page 135
7.1 Introduction......Page 137
7.2 Psycho-Visual Factors A ecting Visual Fidelity......Page 138
7.3 Preparation for Visual Discrimination Experiments......Page 140
7.4 Tradeo  Between Geometry and Texture......Page 142
7.5 Feature Point Density, Perception of Depth and Contrast Sensitivity......Page 144
7.7 Two-Alternatives-Forced-Choice (2AFC)......Page 146
7.9 Summary......Page 147
References......Page 148
8.1 Introduction......Page 151
8.2 Review of Perceptual Quality Evaluation......Page 153
8.3 Experimental Environment and Derivation of a Perceptual Metric......Page 157
8.4 Experimental Results and Analysis......Page 159
8.5 Summary......Page 165
References......Page 166
9.1 Introduction......Page 169
9.2 Perceptually Optimized Transmission......Page 171
9.3 Experimental Results......Page 177
References......Page 181
10.1 Introduction......Page 185
10.2 Structure of a Remote 3D Visualization System by Image Transmission (RV-I)......Page 188
10.3.1 3D Warping......Page 191
10.3.2 3D Warping: Extensions......Page 194
10.3.3 Model-Based Prediction......Page 195
10.4 Residual Selection Strategies......Page 196
10.5 Compression of the Transmitted Data......Page 202
10.6 Summary......Page 205
References......Page 206
11.1 Introduction......Page 209
11.2 The Basic RV-RD Framework......Page 213
11.3 Rendering from a Single View by A ne Warping......Page 216
11.4 Rendering from Multiple Views by DWT Analysis, Warping and DWT Synthesis......Page 218
11.5 The Client Policy......Page 222
11.6 How to Compute the Distortion Contribution?......Page 225
11.6.1 Effects of the Affine Warping......Page 226
11.6.2 Effects of Analysis and Synthesis......Page 227
11.6.3 Effects of Extra-Band Energy......Page 228
11.6.4 Effects of Geometry......Page 231
11.7 Experimental Results......Page 235
11.8 Summary......Page 239
References......Page 240
12.1 Introduction......Page 243
12.2 Basic Notation and Calibrated Images......Page 245
12.3.1 Silhouette......Page 249
12.3.2 Shading......Page 254
12.3.2.1 Photometric Stereo......Page 256
12.3.2.2 Shape from Shading......Page 257
12.3.2.3 Estimating the Light Source Properties......Page 258
12.3.3 Shadows......Page 260
12.3.4 Focus/Defocus......Page 264
12.3.5 Picture Differences: Stereo Methods......Page 267
12.4 Multimodal Methods......Page 274
12.4.1 Deformable Models......Page 276
12.4.2 Application Examples......Page 280
12.5 Summary......Page 282
References......Page 283
13.1 Introduction......Page 289
13.2 Basic Characteristics of Panoramic Images......Page 293
13.3 Visualization of Panoramic Images......Page 297
13.4 Progressive Compression of Panoramic Images......Page 301
13.5 Summary......Page 309
References......Page 310
14.2 Game Design......Page 313
14.3 Implementation Details......Page 316
15.2 Game Design and User Manual......Page 323
15.3 Implementation Details......Page 324
15.3.1 Password Encryption......Page 329
15.4 Summary and Future Work......Page 334
15.5 Appendix: User Manual......Page 335
16.3 User Manual......Page 341
16.4 Technologies, Algorithms and Data Structures......Page 345
16.5 Appendix: Source Code Description......Page 347
17.1 Introduction and Related Work......Page 351
17.3 Summary......Page 352
17.4 Using RMI for Collaborative 3D Editing......Page 353
References......Page 369