Image Registration for Remote Sensing

Cover......Page 1
Half-title......Page 3
Title......Page 5
Copyright......Page 6
Dedication......Page 8
Contents......Page 9
Contributors......Page 11
Foreword......Page 14
Acknowledgements......Page 16
Part I The Importance of Image Registration for Remote Sensing......Page 17
1 Introduction......Page 19
1.1 A need for accurate image registration......Page 20
1.2 What is image registration?......Page 21
1.3 Remote sensing fundamentals......Page 24
1.3.1 Characteristics of satellite orbits......Page 25
1.3.2 Sensor characteristics......Page 26
1.4 Issues involved with remote sensing image registration......Page 28
1.5 Book contents......Page 34
1.6 Terminology......Page 35
References......Page 38
Abstract......Page 40
2.1 Introduction......Page 41
2.2 Product and algorithm validation......Page 42
2.3 Locational errors introduced in image registration......Page 43
2.4 Impact of locational error in validation efforts......Page 45
2.5 Summary......Page 48
References......Page 49
3.1 Introduction......Page 51
3.2 Elements of image registration algorithms......Page 54
3.3 General approaches to registration......Page 55
3.3.2 Correlation-related methods......Page 56
3.3.3 Fourier-domain and other transform-based methods......Page 62
3.3.4 Mutual information and distribution-based approaches......Page 63
3.3.5 Feature-point methods......Page 65
3.3.6 Contour-and region-based approaches......Page 70
3.4 Geometric transformations......Page 72
3.5 Radiometric transformations and resampling......Page 74
3.6 Evaluation of image registration algorithms......Page 76
3.6.1 Operational and user oriented evaluation......Page 77
3.6.2 Algorithm evaluation......Page 79
References......Page 81
Part II Similarity Metrics for Image Registration......Page 93
4.1 Underlying theory......Page 95
4.2 Practical implementations of the theory......Page 99
4.3 Finding rotation, scale, and translation using Fourier techniques......Page 104
4.4 Very high precision translational registration......Page 109
4.5 Estimating rotation and scale......Page 114
4.6 Summary and conclusions......Page 125
References......Page 126
5.1 Introduction......Page 128
5.2 Matched filter......Page 129
5.3 Importance of spectral phase......Page 131
5.4 Phase-only and symmetric phase-only matched filtering......Page 135
5.5 Fourier-Mellin invariant transforms......Page 137
5.6 Fourier-Mellin matched filtering......Page 140
5.7 Experimental results......Page 141
References......Page 145
6.1 Introduction......Page 147
6.2 MI as a similarity measure for registration......Page 149
6.3 Joint histogram and PDF estimation......Page 151
6.4 Normalized MI......Page 152
6.5 Interpolation methods and MI surface artifacts......Page 153
6.6.1 Brief overview......Page 155
6.6.2 Stochastic gradient optimization for image registration......Page 157
6.6.3 Multiresolution pyramid and wavelet-based schemes......Page 160
6.7 Conclusions......Page 161
References......Page 162
Part III Feature Matching and Strategies for Image Registration......Page 167
7.1 Introduction......Page 169
7.3 Surface approximation methods......Page 171
7.4 Weighted linear transformation......Page 174
7.5 Properties of the weighted linear transformation......Page 180
7.6.1 Experiment 1......Page 183
7.6.2 Experiment 2......Page 186
7.7 Registration using weighted linear transformation......Page 188
7.8 Conclusions......Page 191
References......Page 192
8.1 Introduction......Page 195
8.2 Distance measures......Page 198
8.3 Framework of the registration algorithm......Page 199
8.3.1 Multiresolution registration......Page 203
8.4 Experimental studies......Page 204
8.4.1 Experiment 1: Comparison of distance functions......Page 205
8.4.2 Experiment 2: Different sensors and bands......Page 209
8.4.3 Experiment 3: Multiresolution framework......Page 211
Conclusions......Page 212
References......Page 213
9.1 Introduction......Page 216
9.2 Point matching sensitivity......Page 219
9.3.2 General condition measures......Page 220
9.3.3 Conditioning of objective function......Page 221
9.3.4 Optical flow......Page 224
9.3.5 A thought experiment......Page 226
9.4 Conclusions......Page 227
References......Page 228
10.1 Introduction......Page 231
10.2 Contours......Page 232
10.3 Detection and matching of feature points......Page 240
10.3.1 Robustness in registration via RANSAC......Page 242
10.4 Registration using feature points......Page 244
10.4.1 A consistency framework for registration......Page 246
Acknowledgements......Page 253
References......Page 254
11.1 Introduction......Page 256
11.2.1 Wavelet theory and orthogonalorthonormal wavelets......Page 257
11.2.2 Shift-invariant wavelets and Simoncelli steerable decomposition......Page 260
11.3.1 Translation sensitivity experiments......Page 263
11.3.2 Orthogonal wavelets for image registration......Page 264
11.4 Steerable pyramid experiments......Page 266
11.4.2 Systematic experiments setup......Page 267
11.4.3.1 Orthogonal and steerable filters study......Page 268
11.4.3.2 Spline and Simoncelli filters study......Page 269
11.5 Conclusion......Page 277
References......Page 278
12.1 Introduction......Page 281
12.2.2 Sum of squared differences (SSD)......Page 283
12.2.3 Mutual information metric......Page 284
12.3.1 Gradient descent approaches......Page 285
12.4 Experiments......Page 287
References......Page 290
13.1 Introduction......Page 292
13.2 Image modeling......Page 294
13.3.1 Cramér-Rao lower bound for intensity-based registration......Page 295
13.3.1.1 Translation-only distortion......Page 296
13.3.1.2 Rigid-body transformation distortion......Page 299
13.3.2 Other performance bounds for intensity-based registration......Page 301
13.3.3 CRLB for control point-based image registration......Page 302
13.4 Summary......Page 304
References......Page 305
Part IV Applications and Operational Systems......Page 307
14.1 Introduction......Page 309
14.2 A framework for the evaluation of image registration of remote sensing data......Page 310
14.2.1.1 Correlation-based experiments......Page 311
14.2.1.2 Wavelet-based experiments......Page 312
14.2.2 Feature matching......Page 313
14.2.3 Testing framework......Page 314
14.3 Comparative studies......Page 315
14.3.1.1 Synthetic datasets......Page 316
14.3.1.2 Multitemporal datasets......Page 317
14.3.2 Experiments and results......Page 322
14.3.2.1 Synthetic data experiments......Page 324
14.3.2.2 Multitemporal experiments......Page 327
14.3.2.3 Multisensor experiments......Page 331
14.3.2.4 Subpixel accuracy assessment......Page 345
14.4 Conclusions......Page 350
References......Page 352
15.1 Introduction to meteorological satellites......Page 371
15.2 Geolocating meteorological data......Page 373
15.3 Control points......Page 376
15.4 Cloud masking and quality metrics......Page 379
References......Page 384
Abstract......Page 387
16.1 Introduction......Page 388
16.2 MISR mission overview: Imaging event......Page 389
16.3 Required georectified and coregistered data products......Page 390
16.4 Production algorithm......Page 391
16.4.1 Camera Geometric Model (CGM)......Page 393
16.4.2 Projection parameters (PP) and reference orbit imagery (ROI)......Page 395
16.4.3 Standard production......Page 397
16.5.1 Camera geometric model, PP, and ROI......Page 399
16.5.2 Final validation results......Page 401
16.6.1 Surface properties retrievals......Page 403
16.6.2.1 Introduction......Page 406
16.6.2.2 Operational coregistration of multiangle measurements of clouds......Page 407
16.6.2.3 Height-resolved winds......Page 408
16.6.2.4 Cloud heights and Reflecting Layer Reference Altitude (RLRA) assignment......Page 409
16.7 Conclusion......Page 410
References......Page 411
17.1 Introduction......Page 415
17.2.1 The maximum cross-correlation (MCC) method......Page 416
17.2.2 Creating the base image and cloud filtering......Page 417
17.2.3 Calculating the attitude corrections......Page 418
17.2.4 Applying the attitude corrections......Page 420
17.2.5 AUTONAV georegistration accuracy......Page 423
17.3 Comparison with other georegistration techniques......Page 424
17.4 AUTONAV georegistration over the open ocean......Page 427
Acknowledgements......Page 430
Abstract......Page 432
18.2 Landsat overview......Page 433
18.3 Landsat image systematic geocorrection......Page 435
18.4 Landsat image precise geocorrection......Page 438
18.5 Landsat-7 ETM+ scan line corrector failure......Page 441
18.7 Landsat band-to-band registration......Page 443
References......Page 445
19.1 Introduction......Page 447
19.2.1 First stage: Generation of a simulated image......Page 449
19.2.2 Second stage: Determination of the correction model by multiresolution image matching......Page 450
Tuning of the image matching algorithm and tie-point filtering method......Page 452
19.3.1 Modeling and tie-point selection strategy......Page 454
19.3.2 Measuring rectification accuracy......Page 455
19.4 Conclusion......Page 456
References......Page 457
20.1 Introduction......Page 458
20.2.2 Space triangulation principle......Page 460
20.2.4 Selection of VEGETATION images......Page 461
20.3.1.2 Principle of the geometric registration......Page 463
20.4.1.1 Geometric calibration principle......Page 465
20.4.1.3 Geometric calibration validation......Page 466
20.4.2.3 VEGETATION1/VEGETATION2 continuity......Page 467
References......Page 468
21.1 Introduction......Page 469
21.2.1 Geometric model......Page 470
21.2.2 Control points......Page 473
21.2.3 Matching approach......Page 474
21.2.4 Error analysis......Page 477
21.3.1 Initial on-orbit bias correction......Page 478
21.3.2 Trend and cyclic correction......Page 479
21.3.3 Sun-angle correction......Page 480
21.3.4 Current results......Page 482
21.3.5 Orbit and attitude maneuvers......Page 485
References......Page 486
22.1 Introduction......Page 488
22.2 Methods......Page 489
22.2.1 Sensed image data classification......Page 491
22.2.3 Generation of the reference island catalog......Page 494
22.2.4 Island matching......Page 495
22.2.5 Interpretation of geolocation errors......Page 497
22.3.1 Routine geolocation assessment results......Page 498
22.3.2 Improvements to geolocation......Page 500
22.4 Conclusion......Page 502
References......Page 503
Part V Conclusion......Page 505
23 Concluding remarks......Page 507
References......Page 509
Index......Page 510