We develop a new estimation technique for recovering depth-of-field from multiple stereo images. Depth-of-field is estimated by determining the shift in image location resulting from different camera viewpoints. When this shift is not divisible by pixel width, the multiple stereo images can be combined to form a super-resolution image. By modeling this super-resolution image as a realization of a random field, one can view the recovery of depth as a likelihood estimation problem. We apply these modeling techniques to the recovery of cloud height from multiple viewing angles provided by the MISR instrument on the Terra Satellite. Our efforts are focused on a two layer cloud ensemble where both layers are relatively planar, the bottom layer is optically thick and textured, and the top layer is optically thin. Our results demonstrate that with relative ease, we get comparable estimates to the M2 stereo matcher which is the same algorithm used in the current MISR standard product (details can be found in [IEEE Transactions on Geoscience and Remote Sensing 40 (2002) 1547–1559]). Moreover, our techniques provide the possibility of modeling all of the MISR data in a unified way for cloud height estimation. Research is underway to extend this framework for fast, quality global estimates of cloud height.
References
Barker, H. and Davies, J. (1992). Solar radiative fluxes for stochastic, scale-invariant broken cloud fields. J. Atmospheric Sci. 49 1115–1126.
Brown, M., Burschka, D. and Hager, G. (2003). Advances in computational stereo. IEEE Transactions on Pattern Analysis and Machine Intelligence 25 993–1008.
Cahalan, R. and Snider, J. (1989). Marine stratocumulus structure. Remote Sens. Environ. 28 95–107.
Chilès, J. and Delfiner, P. (1999). Geostatistics: Modeling Spatial Uncertainty. Wiley, New York.
Davis, A., Marshak, A., Cahalan, R. and Wiscombe, W. (1997). The landsat scale break in stratocumulus as a three-dimensional radiative transfer effect: Implications for cloud remote sensing. J. Atmospheric Sci. 54 241–260.
Dhond, U. and Aggarwal, J. (1989). Structure from stero—a review. IEEE Transactions on Systems, Man, and Cybernetics 19 1489–1510.
Diner, D. J., Davies, R., Di Girolamo, L., Horvath, A., Moroney, C., Muller, J.-P., Paradise, S. R., Wenkert, D. and Zong, J. (1997). Misr: Level 2 cloud detection and classification. Technical report, Jet Propul. Lab., Pasadena, CA.
Farsiu, S., Robinson, D., Elad, M. and Milanfar, P. (2004). Advances and challenges in super-resolution. International Journal of Imaging Systems and Technology 14 47–57.
Khachiyan, L. and Kalantari, B. (1992). Diagonal matrix scaling and linear programming. SIAM J. Optim. 2 668–672.
Light, W. and Wayne, H. (1998). On power functions and error estimates for radial basis function interpolation. J. Approx. Theory 92 245–266.
Marshall, A. W. and Olkin, I. (1968). Scaling of matrices to achieve specified row and column sums. Numer. Math. 12 83–90.
Muller, J., Mandanayake, A., Moroney, C., Davies, R., Diner, D. and Paradise, S. (2002). Misr stereoscopic image matchers: Techniques and results. IEEE Transactions on Geoscience and Remote Sensing 40 1547–1559.
O’Leary, D. P. (2003). Scaling symmetric positive definite matrices to prescribed row sums. Linear Algebra Appl. 370 185–191.
Oreopoulos, L., Marshak, A., Cahalan, R. and Wen, G. (2000). Cloud three-dimensional effects evidenced in landsat spatial power spectra and autocorrelation functions. Journal of Geophysical Research 105 14, 777–14, 788.
Park, S., Park, M. and Kang, M. (2003). Super-resolution image reconstruction: A technical overview. IEEE Signal Processing Magazine 20 21–36.
Shi, T., Yu, B., Clothiaux, E. E. and Braverman, A. J. (2008). Daytime arctic cloud detection based on multi-angle satellite data with case studies. J. Amer. Statist. Assoc. 103 584–593.
Stein, M. L. (1988). Asymptotically efficient prediction of a random field with a misspecified covariance function. Ann. Statist. 16 55–63.
Stein, M. L. (1990). Uniform asymptotic optimality of linear predictions of a random field using an incorrect second-order structure. Ann. Statist. 18 850–872.
Stein, M. L. (1999). Interpolation of Spatial Data: Some Theory for Kriging. Springer, New York.
Várnai, T. (2000). Influence of three-dimensional radiative effects on the spatial distribution of shortwave cloud reflection. J. Atmospheric Sci. 57 216–229.
