POINT-BY-POINT AND COMPLEX QUALITY METRICS IN ATMOSPHERE AND OCEAN RESEARCH: REVIEW OF METHODS AND APPROACHES

Authors

  • V. Yu. Rezvov Shirshov Institute of Oceanology, Russian Academy of Sciences; Moscow Institute of Physics and Technology National Research University)
  • M. A. Krinitskiy Shirshov Institute of Oceanology, Russian Academy of Sciences; Moscow Institute of Physics and Technology National Research University)
  • N. D. Tilinina Shirshov Institute of Oceanology, Russian Academy of Sciences

DOI:

https://doi.org/10.29006/1564-2291.JOR-2024.52(4).10

Keywords:

quality metrics, grid data, downscaling, verification, point-by-point metrics, complex metrics, ensemble forecasting, object-oriented metrics

Abstract

In the oceanic and atmospheric sciences, various general quantitative indicators, or quality metrics, describe the quality of the various modeling products, including numerical weather prediction, statistical correction, and downscaling. Metrics provide the level of accuracy of model processes reproduction and allow for comparison of models by estimating the uncertainty of their results. This paper presents a classification of the most frequently encountered quality metrics in the scientific literature. Examples are given for each group of quality metrics. In addition to assessing traditional point-by-point metrics, complex metrics that consider various aspects of modeling results are studied. Such specific metrics have an emphasis on the spatial structure, internal correlations, and heterogeneity of the predicted variable fields, ensemble forecasts etc. Special attention in this paper is also devoted to the object-oriented metrics or metrics based for rare and extreme events.

References


  1. Alessi, M. J. and A. T. DeGaetano, 2021: A comparison of statistical and dynamical downscaling methods for short‐term weather forecasts in the US Northeast. Meteorological Applications, 28 (1), https://doi.org/10.1002/met.1976.

  2. Baño-Medina, J., R. Manzanas, and J. M. Gutiérrez, 2021: On the suitability of deep convolutional neural networks for continental-wide downscaling of climate change projections. Climate Dynamics, 57 (11), 2941–2951, https://doi.org/10.1007/s00382-021-05847-0.

  3. Barnston, A. G. and J. L. Thomas, 1983: Rainfall measurement accuracy in FACE: A comparison of gage and radar rainfalls. Journal of Applied Meteorology and Climatology, 22 (12), 2038–2052, https://doi.org/10.1175/1520-0450(1983)022%3C2038:RMAIFA%3E2.0.CO;2.

  4. Barnston, A. G., 1992: Correspondence among the correlation, RMSE, and Heidke forecast verification measures; refinement of the Heidke score. Weather and Forecasting, 7 (4), 699–709, https://doi.org/10.1175/1520-0434(1992)007%3C0699:CATCRA%3E2.0.CO;2.

  5. Barsugli, J. J., G. Guentchev, R. M. Horton, A. Wood, L. O. Mearns, X. Z. Liang, J. A. Winkler, K. Dixon, K. Hayhoe, R. B. Rood, L. Goddard, A. Ray, L. Buja, and C. Ammann, 2013: The practitioner’s dilemma: How to assess the credibility of downscaled climate projections. Eos, Transactions American Geophysical Union, 94 (46), 424–425, https://doi.org/10.1002/2013EO460005.

  6. Böker, B., P. Laux, P. Olschewski, and H. Kunstmann, 2023: Added value of an atmospheric circulation pattern‐based statistical downscaling approach for daily precipitation distributions in complex terrain. International Journal of Climatology, 43 (11), 5130–5153, https://doi.org/10.1002/joc.8136.

  7. Briley, L., R. Kelly, E. D. Blackmer, A. V. Troncoso, R. B. Rood, J. Andresen, and M. C. Lemos, 2020: Increasing the usability of climate models through the use of consumer-report-style resources for decision-making. Bulletin of the American Meteorological Society, 101 (10), E1709–E1717, https://doi.org/10.1175/BAMS-D-19-0099.1.

  8. Bröcker, J., 2012: Evaluating raw ensembles with the continuous ranked probability score. Quarterly Journal of the Royal Meteorological Society, 138 (667), 1611–1617, https://doi.org/10.1002/qj.1891.

  9. Buizza, R. and T. N. Palmer, 1998: Impact of ensemble size on ensemble prediction. Monthly Weather Review, 126 (9), 2503–2518, https://doi.org/10.1175/1520-0493(1998)126%3C2503:IOESOE%3E2.0.CO;2.

  10. Bundel, A. Yu., A. V. Muravev, and E. D. Olhovaya, 2021: Obzor metodov prostranstvennoj verifikacii i ih primenenie dlya ansamblevyh prognozov (Review of spatial verification methods and their application to ensemble forecasts). Gidrometeorologicheskie issledovaniya i prognozy, 4 (382), 30, https://doi.org/10.37162/2618-9631-2021-4-30-49.

  11. Buschow, S., J. Pidstrigach, and P. Friederichs, 2019: Assessment of wavelet-based spatial verification by means of a stochastic precipitation model (wv_verif v0. 1.0). Geoscientific Model Development, 12 (8), 3401–3418, https://doi.org/10.5194/gmd-12-3401-2019.

  12. Carroll, R. J., D. Ruppert, L. A. Stefanski, and C. M. Crainiceanu, 2006: Measurement error in nonlinear models: a modern perspective. Chapman and Hall/CRC.

  13. Casati, B., L. J. Wilson, D. B. Stephenson, P. Nurmi, A. Ghelli, M. Pocernich, U. Damrath, E. E. Ebert, B. G. Brown, and S. Mason, 2008: Forecast verification: current status and future directions. Meteorological Applications: A journal of forecasting, practical applications, training techniques and modelling, 15 (1), 3–18, https://doi.org/10.1002/met.52.

  14. Chai, T., and R. R. Draxler, 2014: Root mean square error (RMSE) or mean absolute error (MAE)?–Arguments against avoiding RMSE in the literature. Geoscientific model development, 7 (3), 1247–1250, https://doi.org/10.5194/gmd-7-1247-2014.

  15. Cho, D., J. Im, and S. Jung, 2024: A new statistical downscaling approach for short‐term forecasting of summer air temperatures through a fusion of deep learning and spatial interpolation. Quarterly Journal of the Royal Meteorological Society, 150 (760), 1222–1242, https://doi.org/10.1002/qj.4643.

  16. Collier, N., F. M. Hoffman, D. M. Lawrence, G. Keppel-Aleks, C. D. Koven, W. J. Riley, M. Mu, and J. T. Randerson, 2018: The international land model benchmarking (ILAMB) system: Design, theory, and implementation. Journal of Advances in Modeling Earth Systems, 10 (11), 2731–2754, https://doi.org/10.1029/2018MS001354.

  17. Davis, C., B. Brown, and R. Bullock, 2006: Object-based verification of precipitation forecasts. Part I: Methodology and application to mesoscale rain areas. Monthly Weather Review, 134 (7), 1772–1784, https://doi.org/10.1175/MWR3145.1.

  18. De Haan, L. L., M. Kanamitsu, F. De Sales, and L. Sun, 2015: An evaluation of the seasonal added value of downscaling over the United States using new verification measures. Theoretical and applied climatology, 122, 47–57, https://doi.org/10.1007/s00704-014-1278-9.

  19. Dosselmann, R. and X. D. Yang, 2011: A comprehensive assessment of the structural similarity index. Signal, Image and Video Processing, 5, 81–91, https://doi.org/10.1007/s11760-009-0144-1.

  20. Ebert, E. E. and J. L. McBride, 2000: Verification of precipitation in weather systems: Determination of systematic errors. Journal of hydrology, 239 (1–4), 179–202, https://doi.org/10.1016/S0022-1694(00)00343-7.

  21. Ebert, E. E., 2008: Fuzzy verification of high‐resolution gridded forecasts: a review and proposed framework. Meteorological Applications: A journal of forecasting, practical applications, training techniques and modelling, 15 (1), 51–64, https://doi.org/10.1002/met.25.

  22. Ebert, E., L. Wilson, A. Weigel, M. Mittermaier, P. Nurmi, P. Gill, M. Göber, S. Joslyn, B. Brown, T. Fowler, and A. Watkins, 2013: Progress and challenges in forecast verification. Meteorological Applications, 20 (2), 130–139, https://doi.org/10.1002/met.1392.

  23. Ebert, P. and P. Milne, 2022: Methodological and conceptual challenges in rare and severe event forecast-verification. Natural Hazards and Earth System Sciences Discussions, 20, 539–557, https://doi.org/10.5194/nhess-22-539-2022.

  24. Ebtehaj, A. M., E. Foufoula‐Georgiou, and G. Lerman, 2012: Sparse regularization for precipitation downscaling. Journal of Geophysical Research: Atmospheres, 117 (D8), https://doi.org/10.1029/2011JD017057.

  25. Entekhabi, D., R. H. Reichle, R. D. Koster, and W. T. Crow, 2010: Performance metrics for soil moisture retrievals and application requirements. Journal of Hydrometeorology, 11 (3), 832–840, https://doi.org/10.1175/2010JHM1223.1.

  26. Faggian, N., B. Roux, P. Steinle, and B. Ebert, 2015: Fast calculation of the fractions skill score. Mausam, 66 (3), 457–466, http://dx.doi.org/10.54302/mausam.v66i3.555.

  27. Fisher, S. R. A., 1958: Statistical Methods for Research Workers. 13th ed. Hafner Publishing Co., 356 p.

  28. Geiss, A., S. J. Silva, and J. C. Hardin, 2022: Downscaling atmospheric chemistry simulations with physically consistent deep learning. Geoscientific Model Development, 15 (17), 6677–6694, https://doi.org/10.5194/gmd-15-6677-2022.

  29. Gentile, E. S., S. L. Gray, and H. W. Lewis, 2022: The sensitivity of probabilistic convective‐scale forecasts of an extratropical cyclone to atmosphere–ocean–wave coupling. Quarterly Journal of the Royal Meteorological Society, 148 (743), 685–710, https://doi.org/10.1002/qj.4225.

  30. Gilabert, M. A., A. Moreno, F. Maselli, B. Martinez, M. Chiesi, S. Sanchez-Ruiz, F. J. Garcia-Haro, A. Perez-Hoyos, M. Campos-Taberner, O. Perez-Priego, P. Serrano-Ortiz, and A. Carrara, 2015: Daily GPP estimates in Mediterranean ecosystems by combining remote sensing and meteorological data. ISPRS Journal of Photogrammetry and Remote Sensing, 102, 184–197, https://doi.org/10.1016/j.isprsjprs.2015.01.017.

  31. Gilleland, E., D. Ahijevych, B. G. Brown, B. Casati, and E. E. Ebert, 2009: Intercomparison of Spatial Forecast Verification Methods. Weather Forecasting, 24, 1416–1430, https://doi.org/10.1175/2009WAF2222269.1.

  32. Glawion, L., J. Polz, H. Kunstmann, B. Fersch, and C. Chwala, 2023: spateGAN: spatio‐temporal downscaling of rainfall fields using a cGAN approach. Earth and Space Science, 10 (10), https://doi.org/10.1029/2023EA002906.

  33. Gong, W., H. V. Gupta, D. Yang, K. Sricharan, and A. O. Hero III, 2013: Estimating epistemic and aleatory uncertainties during hydrologic modeling: An information theoretic approach. Water resources research, 49 (4), 2253–2273, https://doi.org/10.1002/wrcr.20161.

  34. Gupta, H. V., H. Kling, K. K. Yilmaz, and G. F. Martinez, 2009: Decomposition of the mean squared error and NSE performance criteria: Implications for improving hydrological modelling. Journal of hydrology, 377 (1–2), 80–91, https://doi.org/10.1016/j.jhydrol.2009.08.003.

  35. Habib, E., W. F. Krajewski, and G. J. Ciach, 2001: Estimation of rainfall interstation correlation. Journal of Hydrometeorology, 2 (6), 621–629, https://doi.org/10.1175/1525-7541(2001)002%3C0621:EORIC%3E2.0.CO;2.

  36. Harris, L., A. T. McRae, M. Chantry, P. D. Dueben, and T. N. Palmer, 2022: A generative deep learning approach to stochastic downscaling of precipitation forecasts. Journal of Advances in Modeling Earth Systems, 14 (10), https://doi.org/10.1029/2022MS003120.

  37. Hersbach, H., 2000: Decomposition of the continuous ranked probability score for ensemble prediction systems. Weather and Forecasting, 15 (5), 559–570, https://doi.org/10.1175/1520-0434(2000)015%3C0559:DOTCRP%3E2.0.CO;2.

  38. Hertig, E., D. Maraun, J. Bartholy, R. Pongracz, M. Vrac, I. Mares, J. M. Gutiérrez, J. Wibig, A. Casanueva, and P. M. M. Soares, 2019: Comparison of statistical downscaling methods with respect to extreme events over Europe: Validation results from the perfect predictor experiment of the COST Action VALUE. International Journal of Climatology, 39 (9), 3846–3867, https://doi.org/10.1002/joc.5469.

  39. Hewitson, B. C. and R. G. Crane, 1996: Climate downscaling: techniques and application. Climate Research, 7 (2), 85–95, https://doi.org/10.3354/cr007085.

  40. Hodson, T. O., 2022: Root mean square error (RMSE) or mean absolute error (MAE): When to use them or not. Geoscientific Model Development Discussions, 15 (14), 5481–5487, https://doi.org/10.5194/gmd-15-5481-2022.

  41. Jagannathan, K., A. D. Jones, and I. Ray, 2020: The making of a metric: Coproducing decision-relevant climate science. Bulletin of the American Meteorological Society, 102 (8), 1–33, https://doi.org/10.1175/BAMS-D-19-0296.1.

  42. Jin, H., W. Jiang, M. Chen, M. Li, K. S. Bakar, and Q. Shao, 2023: Downscaling long lead time daily rainfall ensemble forecasts through deep learning. Stochastic Environmental Research and Risk Assessment, 37 (8), 3185–3203, https://doi.org/10.1007/s00477-023-02444-x.

  43. Jolliffe, I. T. and D. B. Stephenson, 2012: Forecast verification: a practitioner’s guide in atmospheric science. John Wiley & Sons.

  44. Kalmykova, O. V., 2021: Metodika ocenki smercheopasnosti vblizi Chernomorskogo poberezh’ya Rossii i rezul’taty ee ispytanij (Methodology for assessing tornado hazard near the Black Sea coast of Russia and the results of its tests). Rezul’taty ispytaniya novyh i usovershenstvovannyh tekhnologij, modelej i metodov gidrometeorologicheskih prognozov, 48, 42–61.

  45. Kharin, V. V. and F. W. Zwiers, 2003: On the ROC score of probability forecasts. Journal of Climate, 16 (24), 4145–4150, https://doi.org/10.1175/1520-0442(2003)016%3C4145:OTRSOP%3E2.0.CO;2.

  46. Kikumoto, H., R. Ooka, Y. Arima, and T. Yamanaka, 2015: Study on the future weather data considering the global and local climate change for building energy simulation. Sustainable Cities and Society, 14, 404–413, https://doi.org/10.1016/j.scs.2014.08.007.

  47. Kling, H., M. Fuchs, and M. Paulin, 2012: Runoff conditions in the upper Danube basin under an ensemble of climate change scenarios. Journal of hydrology, 424, 264–277, https://doi.org/10.1016/j.jhydrol.2012.01.011.

  48. Knoben, W. J. M., J. E. Freer, and R. A. Woods, 2019: Inherent benchmark or not? Comparing Nash–Sutcliffe and Kling–Gupta efficiency scores. Hydrology and Earth System Sciences, 23 (10), 4323–4331, https://doi.org/10.5194/hess-23-4323-2019.

  49. Lerch, S., T. L. Thorarinsdottir, F. Ravazzolo, and T. Gneiting, 2017: Forecaster’s dilemma: extreme events and forecast evaluation. Statistical Science, 32 (1), 106–127, https://www.jstor.org/stable/26408123.

  50. Manzanas, R., M. D. Frías, A. S. Cofiño, and J. M. Gutiérrez, 2014: Validation of 40 year multimodel seasonal precipitation forecasts: The role of ENSO on the global skill. Journal of Geophysical Research: Atmospheres, 119 (4), 1708–1719, https://doi.org/10.1002/2013JD020680.

  51. Maina, F. Z., E. R. Siirila-Woodburn, and P. Vahmani, 2020: Sensitivity of meteorological-forcing resolution on hydrologic variables. Hydrology and Earth System Sciences, 24 (7), 3451–3474, https://doi.org/10.5194/hess-24-3451-2020.

  52. Mason, S. J. and N. E. Graham, 1999: Conditional probabilities, relative operating characteristics, and relative operating levels. Weather and Forecasting, 14 (5), 713–725, https://doi.org/10.1175/1520-0434(1999)014%3C0713:CPROCA%3E2.0.CO;2.

  53. McKeen, S. A., J. Wilczak, G. Grell, I. Djalalova, S. Peckham, E. Hsie, W. Gong, V. Bouchet, S. Menard, R. Moffet, J. McHenry, J. McQueen, Y. Tang, G. R. Carmichael, M. Pagowski, A. Chan, T. Dye, G. Frost, P. Lee, and R. Mathur, 2005: Assessment of an ensemble of seven real‐time ozone forecasts over eastern North America during the summer of 2004. Journal of Geophysical Research: Atmospheres, 110 (D21), https://doi.org/10.1029/2005JD005858.

  54. Mittermaier, M., N. Roberts, and S. A. Thompson, 2013: A long‐term assessment of precipitation forecast skill using the fractions skill score. Meteorological Applications, 20 (2), 176–186, https://doi.org/10.1002/met.296.

  55. Moss, R. H., S. Avery, K. Baja, M. Burkett, A. M. Chischilly, J. Dell, P. A. Fleming, K. Geil, K. Jacobs, A. Jones, K. Knowlton, J. Koh, M. C. Lemos, J. Melillo, R. Pandya, T. C. Richmond, L. Scarlett, J. Snyder, M. Stults, A. M. Waple, J. Whitehead, D. Zarrilli, B. Ayyub M., J. Fox, A. Ganguly, L. Joppa, S. Julius, P. Kirshen, R. Kreutter, A. McGovern, R. Meyer, J. Neumann, W. Solecki, J. Smith, P. Tissot, G. Yohe, and R. Zimmerman, 2019: Evaluating knowledge to support climate action: A framework for sustained assessment. Report of an independent advisory committee on applied climate assessment. Weather, Climate, and Society, 11 (3), 465–487, https://doi.org/10.1175/WCAS-D-18-0134.1.

  56. Murphy, A. H., 1988: Skill scores based on the mean square error and their relationships to the correlation coefficient. Monthly weather review, 116 (12), 2417–2424, https://doi.org/10.1175/1520-0493(1988)116%3C2417:SSBOTM%3E2.0.CO;2.

  57. Murphy, A. H., B. G. Brown, and Y. S. Chen, 1989: Diagnostic verification of temperature forecasts. Weather and Forecasting, 4 (4), 485–501, https://doi.org/10.1175/1520-0434(1989)004%3C0485:DVOTF%3E2.0.CO;2.

  58. Murphy, A. H., 1991: Probabilities, odds, and forecasts of rare events. Weather and forecasting, 6 (2), 302–307, https://doi.org/10.1175/1520-0434(1991)006%3C0302:POAFOR%3E2.0.CO;2.

  59. Murphy, A. H., 1993: What Is a Good Forecast? An Essay on the Nature of Goodness in Weather Forecasting. Weather Forecasting, 8 (2), 281–293, https://doi.org/10.1175/1520-0434(1993)008<0281:WIAGFA>2.0.CO;2.

  60. Nearing, G. S. and H. V. Gupta, 2015: The quantity and quality of information in hydrologic models. Water Resources Research, 51 (1), 524–538, https://doi.org/10.1002/2014WR015895.

  61. O’Neill, A. C., L. H. Erikson, and P. L. Barnard, 2017: Downscaling wind and wavefields for 21st century coastal flood hazard projections in a region of complex terrain. Earth and Space Science, 4 (5), 314–334, https://doi.org/10.1002/2016EA000193.

  62. Pool, S., M. Vis, and J. Seibert, 2018: Evaluating model performance: towards a non-parametric variant of the Kling-Gupta efficiency. Hydrological Sciences Journal, 63 (13–14), 1941–1953, https://doi.org/10.1080/02626667.2018.1552002.

  63. RD 52.27.284-91. Metodicheskie ukazaniya. Provedenie proizvodstvennyh (operativnyh) ispytanij novyh i usovershenstvovannyh metodov gidrometeorologicheskih i geliofizicheskih prognozov (RD 52.27.284-91. Methodical instructions. Carrying out production (operational) testing of new and improved methods of hydrometeorological and heliophysical forecasts). Leningrad, Gidrometeoizdat, 150 p.

  64. Reed, K. A., N. Goldenson, R. Grotjahn, W. J. Gutowski, K. Jagannathan, A. D. Jones, L. R. Leung, S. A. McGinnis, S. C. Pryor, A. K. Srivastava, P. A. Ullrich, and C. M. Zarzycki, 2022: Metrics as tools for bridging climate science and applications. Wiley Interdisciplinary Reviews: Climate Change, 13 (6), P. e799, https://doi.org/10.1002/wcc.799.

  65. Roberts, N. M., 2008: Assessing the spatial and temporal variation in the skill of precipitation forecasts from an NWP model. Meteorological Applications: A journal of forecasting, practical applications, training techniques and modelling, 15 (1), 163–169, https://doi.org/10.1002/met.57.

  66. Roberts, N. M. and H. W. Lean, 2008: Scale-selective verification of rainfall accumulations from high-resolution forecasts of convective events. Monthly Weather Review, 136 (1), 78–97, https://doi.org/10.1175/2007MWR2123.1.

  67. Robertson, C., J. A. Long, F. S. Nathoo, T. A. Nelson, and C. C. Plouffe, 2014: Assessing quality of spatial models using the structural similarity index and posterior predictive checks. Geographical Analysis, 46 (1), 53–74, https://doi.org/10.1111/gean.12028.

  68. Savage, N. H., P. Agnew, L. S. Davis, C. Ordóñez, R. Thorpe, C. E. Johnson, F. M. O’Connor, and M. Dalvi, 2013: Air quality modelling using the Met Office Unified Model (AQUM OS24-26): model description and initial evaluation. Geoscientific Model Development, 6 (2), 353–372, https://doi.org/10.5194/gmd-6-353-2013.

  69. Schoof, J. T., 2013: Statistical downscaling in climatology. Geography Compass, 7 (4), 249–265, https://doi.org/10.1111/gec3.12036.

  70. Schultz, M. G., C. Betancourt, B. Gong, F. Kleinert, M. Langguth, L. H. Leufen, A. Mozaffari, and S. Stadtler, 2021: Can deep learning beat numerical weather prediction? Philosophical Transactions of the Royal Society A, 379 (2194), https://doi.org/10.1098/rsta.2020.0097.

  71. Shahriar, S. A., M. A. M. Siddique, and S. M. A. Rahman, 2021: Climate change projection using statistical downscaling model over Chittagong Division, Bangladesh. Meteorology and Atmospheric Physics, 133 (4), 1409–1427, https://doi.org/10.1007/s00703-021-00817-x.

  72. Skok, G., 2015: Analysis of fraction skill score properties for a displaced rainband in a rectangular domain. Meteorological Applications, 22 (3), 477–484, https://doi.org/10.1002/met.1478.

  73. Skok, G. and N. Roberts, 2018: Estimating the displacement in precipitation forecasts using the Fractions Skill Score. Quarterly Journal of the Royal Meteorological Society, 144 (711), 414–425, https://doi.org/10.1002/qj.3212.

  74. Song, L., C. Xu, Y. Long, X. Lei, N. Suo, and L. Cao, 2022: Performance of seven gridded precipitation products over arid central Asia and subregions. Remote Sensing, 14 (23), 6039, https://doi.org/10.3390/rs14236039.

  75. Stephenson, D. B., B. Casati, C. A. T. Ferro, and C. A. Wilson, 2008: The extreme dependency score: A non‐vanishing measure for forecasts of rare events. Meteorological Applications: A journal of forecasting, practical applications, training techniques and modelling, 15 (1), 41–50, https://doi.org/10.1002/met.53.

  76. Sun, Y., K. Deng, K. Ren, J. Liu, C. Deng, and Y. Jin, 2024: Deep learning in statistical downscaling for deriving high spatial resolution gridded meteorological data: A systematic review. ISPRS Journal of Photogrammetry and Remote Sensing, 208, 14–38, https://doi.org/10.1016/j.isprsjprs.2023.12.011.

  77. Taylor, K. E., 2001: Summarizing multiple aspects of model performance in a single diagram. Journal of Geophysical Research: Atmospheres, 106, 7183–7192, https://doi.org/10.1029/2000JD900719.

  78. Tian, Y., G. S. Nearing, C. D. Peters-Lidard, K. W. Harrison, and L. Tang, 2016: Performance metrics, error modeling, and uncertainty quantification. Monthly Weather Review, 144 (2), 607–613, https://doi.org/10.1175/MWR-D-15-0087.1.

  79. Vaughan, A., W. Tebbutt, J. S. Hosking, and R. E. Turner, 2022: Convolutional conditional neural processes for local climate downscaling. Geoscientific Model Development, 15 (1), 251–268, https://doi.org/10.5194/gmd-15-251-2022.

  80. Vrugt, J. A. and M. Sadegh, 2013: Toward diagnostic model calibration and evaluation: Approximate Bayesian computation. Water Resources Research, 49 (7), 4335–4345, https://doi.org/10.1002/wrcr.20354.

  81. Wang Z., A. C. Bovik, H. R. Sheikh, and E. P. Simoncelli, 2004: Image quality assessment: from error visibility to structural similarity. IEEE transactions on image processing, 13 (4), 600–612, https://doi.org/10.1109/TIP.2003.819861.

  82. Wehner, M. F., 2013: Very extreme seasonal precipitation in the NARCCAP ensemble: Model performance and projections. Climate Dynamics, 40, 59–80, https://doi.org/10.1007/s00382-012-1393-1.

  83. Weijs, S. V., G. Schoups, and N. Van De Giesen, 2010: Why hydrological predictions should be evaluated using information theory. Hydrology and Earth System Sciences, 14 (12), 2545–2558, https://doi.org/10.5194/hess-14-2545-2010.

  84. Weniger, M., F. Kapp, and P. Friederichs, 2017: Spatial verification using wavelet transforms: a review. Quarterly Journal of the Royal Meteorological Societ, 143 (702), 120–136, https://doi.org/10.1002/qj.2881.

  85. Wilby, R. L. and T. M. L. Wigley, 1997: Downscaling general circulation model output: a review of methods and limitations. Progress in physical geography, 21 (4), 530–548, https://doi.org/10.1177/030913339702100403.

  86. Wilks, D. S., 2011: Statistical methods in the atmospheric sciences. Academic press, 676 p.

  87. Willmott, C. J. and K. Matsuura, 2005: Advantages of the mean absolute error (MAE) over the root mean square error (RMSE) in assessing average model performance. Climate research, 30 (1), 79–82, https://doi.org/10.3354/cr030079.

  88. Willmott, C. J., K. Matsuura, and S. M. Robeson, 2009: Ambiguities inherent in sums-of-squares-based error statistics. Atmospheric Environment, 43 (3), 749–752, https://doi.org/10.1016/j.atmosenv.2008.10.005.

  89. Yeggina, S., R. S. V. Teegavarapu, and S. Muddu, 2020: Evaluation and bias corrections of gridded precipitation data for hydrologic modelling support in Kabini River basin, India. Theoretical and Applied Climatology, 140, 1495–1513, https://doi.org/10.1007/s00704-020-03175-7.

  90. Zandler, H., T. Senftl, and K. A. Vanselow, 2020: Reanalysis datasets outperform other gridded climate products in vegetation change analysis in peripheral conservation areas of Central Asia. Scientific Reports, 10 (1), https://doi.org/10.1038/s41598-020-79480-y.

  91. Zhong, X., F. Du, L. Chen, Z. Wang, and H. Li, 2024: Investigating transformer‐based models for spatial downscaling and correcting biases of near‐surface temperature and wind‐speed forecasts. Quarterly Journal of the Royal Meteorological Society, 150 (758), 275–289, https://doi.org/10.1002/qj.4596.

Downloads

Published

2024-12-29

Issue

Vol. 52 No. 4 (2024): Journal of Oceanological Research

Section

Ocean physics and climate

License

Transfer of copyrights occurs on the basis of a license agreement between the Author and Shirshov Institute of Oceanology, RAS

Most read articles by the same author(s)