Next Article in Journal
Experimental Study on the Potential Use of Bundled Crop Straws as Subsurface Drainage Material in the Newly Reclaimed Coastal Land in Eastern China
Previous Article in Journal
Global Water Governance and Climate Change: Identifying Innovative Arrangements for Adaptive Transformation
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Comparison of GCM Precipitation Predictions with Their RMSEs and Pattern Correlation Coefficients

School of Civil, Environmental and Architectural Engineering, College of Engineering, Korea University, Seoul 02841, Korea
*
Author to whom correspondence should be addressed.
Water 2018, 10(1), 28; https://doi.org/10.3390/w10010028
Submission received: 7 September 2017 / Revised: 24 December 2017 / Accepted: 29 December 2017 / Published: 2 January 2018

Abstract

:
This study evaluated 20 general circulation models (GCMs) of the Coupled Model Intercomparison Project, Phase 5 (CMIP5), which provide the prediction results for the period of 2006 to 2014, the period from which the observation data (the Global Precipitation Climatology Project (GPCP) data) are available. Both the GCM predictions of precipitation and the GPCP data were compared for three data structures—the global, zonal, and grid mean—with conventional statistics like the root mean square error (RMSE) and the pattern correlation coefficient of the cyclostationary empirical orthogonal functions (CSEOFs). As a result, it was possible to select a GCM which showed the best performance among the 20 GCMs considered in this study. Overall, the NorSM1-M model was found to be the most similar to the GPCP data. Additionally, the IPSL-CM5A-LR, BCC-CSM, and GFDL-CMS models were also found to be quite similar to the GPCP data.

1. Introduction

Due to global warming, most countries are currently preparing for a future with different climate conditions. The greenhouse effect has been especially considered as a key factor of global warming since the twentieth century [1]. Recently, the Intergovernmental Panel on Climate Change (IPCC) stated that the main cause of global warming is the ongoing emission of greenhouse gases from various anthropogenic activities [2]. Rapid climate change can have a significantly negative impact on a county’s economy and industry, while the health of the ecosystem is also believed to be significantly affected. As climate change has continued globally, both national and international cooperation is now becoming increasingly urgent [3,4]. Highly reliable scenarios of climate change are very important for preparing countermeasures to the possible impact of climate change [5]. The IPCC presented four different scenarios of representative concentration pathways (RCP) for climate change predictions [2]. RCP scenarios were proposed by converting the emitted greenhouse gases into solar radiative forcing, such as in the cases of RCP2.6, RCP4.5, RCP6.0, and RCP8.5. For example, the RCP2.6 scenario represents the case where the total greenhouse gases emitted is 2.6 W/m2, in addition to the solar radiative forcing at a preindustrial condition, defined as the year 1750. The RCP2.6 scenario represents the case in which the earth can recover its original pre-anthropogenic state prior to the emission of the greenhouse gases. The RCP4.5 represents the case where the reduction of greenhouse gases is successfully achieved, and the RCP6.0 represents the case where the reduction of the greenhouse gases is moderately achieved. Finally RCP8.5 represents the case where the total greenhouse gases is that predicted if no changes are implemented, and the trend of emission observed in the early 21st century continues [2].
Along with providing the RCP scenarios, the IPCC has also presented the Coupled Model Intercomparison Project, Phase 5 (CMIP5) for evaluating and comparing the general circulation model (GCM) predictions based on RCP scenarios [2]. More than 60 GCMs were used in the CMIP5, all of which were developed to make predictions about the future state of meteorology, considering both the non-stationarity of the climate system and the physical process of meteorological phenomena [6]. However, as the theories and algorithms applied for each GCM differ, unique predictions cannot be made. The purpose of CMIP5 is simply to evaluate and compare these GCM predictions. Currently, the use of GCM predictions is assumed to be the best way to acquire information about future meteorological global data [7,8]; it is also true that considerable differences exist among the GCM predictions [9,10,11].
Since the GCM predictions have become available through the CMIP5, many studies have reported the use and application of GCM predictions for hydrology as well as for meteorology. For example, Landerer et al. [12] evaluated the spatial and temporal features of sea surface height simulated by 33 GCMs of CMIP5, by using observed data from satellite altimetry. Also, Tabari et al. [13] investigated the potential impact of climate change on water availability in central Belgium, by using 30 GCMs of CMIP5. Ning and Bradley [14] examined the regional winter temperature and precipitation over the eastern United States by using 17 GCMs of CMIP5. Aloysius et al. [9] assessed the performance of 25 GCMs of CMIP5, by analyzing the precipitation and temperature predictions over central Africa.
While many studies have concentrated on the comparison and application of the GCM predictions of the CMIP5, few studies have been presented that validate the potential ability of each GCM to simulate the future climate. Most studies have focused on comparing the basic statistics of the GCM predictions with observed data; however, this is insufficient for application to the global climate system, which shows a strong non-linear behavior. For example, Lovejoy and Varotsos [15] examined the GCM output, and found that the linear assumption can be invalid for GCM output with timescales less than 50 years. Therefore, a more fundamental approach is necessary to evaluate various GCMs and their predictions. Principle component analysis can also be a good option.
Over the past few decades, meteorologists have proposed many methodologies to derive the principle components of climate variability, such as empirical orthogonal function (EOF) analysis [16,17,18,19,20,21,22,23,24]. Additionally, to consider the cyclic behavior of the meteorological and hydrological data, the cyclostationary empirical orthogonal functions (CSEOF) analysis has been developed [25,26,27,28,29,30,31]. The CSEOF analysis is known to be superior to the EOF analysis when analyzing data that have obvious spatial or temporal cyclic behavior, like global data, monthly ENSO data, and seasonal temperature data [32,33,34,35]. The intrinsic properties of the data with spatiotemporal variability may also be analyzed by applying the CSEOF analysis [36].
In this study, the GCM predictions of precipitation will be compared with conventional statistics like the root mean square error (RMSE) and the pattern correlation coefficient of the CSEOF. The GCMs to be compared are those that provide the GCM predictions over the period of 2006 to 2014, which is the period for which the global precipitation data from GPCP are available. The comparison will also be repeated with several data structures, such as the global, zonal, and grid means. It is especially important to check if the result derived by comparing the conventional statistics is similar to that from the comparison of their major principle components (i.e., CSEOFs), derived by applying the CSEOF analysis. The comparison results will also be merged, to distinguish one GCM to others.

2. Data

More than 60 GCM predictions of CMIP5 are available from the World Data Center for Climate (WDCC). There are a total of 23 development institutes which contributed to CMIP5 GCM data. First, the authors selected one GCM simulation from each development institute. Also, among 23 development institutes, the National Institute for Space Research and Institute of Atmospheric Physics and the Chinese Academy of Sciences were excluded, as their simulations were not based on the RCP scenarios. In the case of the CMCC-CM model, its grid size was too small (0.750° × 0.750°) to conduct CSEOF analysis. Finally, the authors selected a total of 20 GCMs to be used for the CSEOF analysis in this study. Table 1 summarizes these GCMs with their development institute and grid-resolution. As can be seen in Table 1, each GCM has each own grid system, which varies from the smallest, at 1.250° × 0.938° (NCAR-CAM5 model), to the largest at 3.750° × 1.875° (IPSL-CM5A-LR model).
Among GCM predictions available, for the period of from 2001 to 2300, only the predictions from 2006 to 2014 were used in this study in order to compare those with the observed data. Among four RCP scenarios, the RCP8.5 was selected, as it is based on the assumption of the continuing trend of greenhouse gas emission observed in the early 21st century. The GCM precipitation data collected in this study were monthly ones, which were also accumulated to make the annual data. All the analyses in this study were based on these annual data. However, spatially, three different data structures were considered, which are global, zonal, and grid data.
The observed data used for the validation of these 20 GCMs are sourced from the Global Precipitation Climatology Project (GPCP) version 2.3 of the Combined Precipitation Data Set [37]. The GPCP-observed precipitation data were constructed by the Mesoscale Atmospheric Processes Laboratory of the National Aeronautics and Space Administration (NASA) Goddard Space Flight Center. The GPCP data are well-organized grid data, developed by merging the rain gauge data and the satellite data. The GPCP data are available from 1979 to 2016 in the form of monthly average data. In this study, the GPCP data were collected for the period of 2006 to 2014, for comparison with the GCM predictions. The GPCP data were also accumulated to make the annual data.

3. Comparison of Global Precipitation Climatology Project Data and General Circulation Model Predictions Using Conventional Statistics

3.1. Global Data

In this study, the global data was made simply as the arithmetic mean of all grid values. Figure 1 compares the global mean precipitations of eight GCMs to the GPCP data from 2006 to 2014. Eight GCMs were selected from the 20 GCMs, to clarify the comparison. As can be seen in Figure 1, first, all eight GCMs considered in this study show higher annual precipitation than the observed. Among them, the IPSL-CM5A-LR model was found to have the most similar predictions (about 810 mm) to the GPCP data (about 800 mm), with the NorESM1-M model second (about 820 mm). On the other hand, the MIROC5 model provided the highest value (about 950 mm). The GISS-E2-R model also provided annual precipitation data higher than 900 mm. In addition, the GPCP data showed a weak decreasing trend, and the GCMs showed steady or weak increasing trends. However, the trends during this period of 2006 to 2014 were very weak, so all the GCM and GPCP annual precipitation amounts may be assumed to be stationary.

3.2. Zonal Data

In this study, the zonal data were derived as the arithmetic mean of each 10° latitudinal zone, from −90° to 90° latitude. The comparison of zonal data can also be found in Yoo [38], where the annual mean temperature was of interest for the validation of the GCM predictions. A total of 18 zonal mean data were made each year for each GCM and GPCP data, whose annual mean is compared with other GCMs in Figure 2. Again, eight GCMs from 20 GCMs were selected to compare the zonal average more clearly. In this figure, zone 1 indicates the latitudinal zone from −90° to –80°, zone 2 from −80° to −70°, and finally zone 18 indicates the latitudinal zone with latitude zone from 80° to 90°.
As can be seen in Figure 2, overall pattern of zonal mean data was similar in both the GCM predictions and the GPCP data. Very high precipitation was found around the equator in all GCMs and GPCP data, and medium-high precipitation was also found in the mid-latitude zones of both northern and southern hemispheres. However, in greater detail, it can be found that each GCM prediction is a bit different from others. First of all, in most GCMs, the annual precipitation in zones 9 and 10, around the equator, were predicted very similarly, but the GPCP data does not show this similarity. Specifically, the GPCP precipitation in zone 9 was found to be less than the zone 10. Only the GCMs like NCAR-CAM5 and MIROC5 predicted this non-symmetric pattern of annual precipitation around the equator.
In Figure 2, it can also be found that some of the GCMs produced rather high precipitation predictions around the equator. In particular, the GISS-E2-R, MIROC5, and NCAR-CAM5 models had relatively high precipitation predictions, with a difference of more than 500 mm from other GCMs and the GPCP data. The high equatorial predictions may be the main reason for these GCMs to have the high annual mean precipitation amount (see Figure 1). Most of the GCMs considered in this study seem to follow the pattern of the GPCP data well, especially the IPSL-CM5A-LR and NorESM1-M models, which seem to be very close to the pattern of the GPCP data over all latitudinal zones.

3.3. Grid Data

The grid data were derived as the arithmetic mean for the 10° × 10° grid, and as a result, a total of 648 grid data were prepared for each year. In this study, first, basic statistics of global, zonal, and grid mean data of GCM predictions and GPCP data were compared. The mean, standard deviation, coefficient of variance, and normalized root mean square error (NRMSE) of GCM prediction and GPCP data are summarized in Table 2. As can be found in this table, each GCM shows a slightly different mean, standard deviation, and NRMSE. In the case of global mean, the GISS-E2-R model showed the highest value, and the CanESM2 model the lowest. As seen in Figure 1, the annual mean precipitation of all GCMs are found to be higher than that of GPCP data.
The standard deviation of the global data was also found to be different among GCMs and the GPCP data. Different from the annual mean, the standard deviation of the GPCP was found to be the highest. Among the GCMs, the MRI-CGCM3 model showed the highest standard deviation of 5.7 mm. The GISS-E2-R model showed the lowest standard deviation, at just 1.9 mm. The standard deviation of the grid data considers both the temporal and spatial variation of the precipitation data. Very different from the global data, the standard deviation of the GPCP data (652.5 mm) was found to be smaller than most of the GCM data. Even though the GISS-E2-R model showed a very high standard deviation (780.0 mm), most other GCMs showed less than 5% difference from the GPCP data. The zonal data are not appropriate to be considered for calculating the standard deviation, which was not derived in this study.
Table 2 also shows the NRMSE estimated for each GCM. The NRMSE is a dimensionless measure, calculated by dividing the error of the GCM predictions by the mean of the observed data [39]. The NRMSE counts both the mean difference (or bias) and the variability of the difference between two dataset. The NRMSE is calculated by the following equation:
N R M S E = i = 1 N ( X o b s ,   i X s i m u l ,   i ) 2 i = 1 N X o b s ,   i 2
As the NRMSE represents the arithmetic difference between the GCM predictions and the observed data, a smaller NRMSE indicates GCM predictions that are closer to the observed data. As the GPCP data were considered to be the truth in this study, their NRMSE became zero in all three cases of data structure.
As can be found in Table 2, for the global data, the NRMSE of the IPSL-CM5A-LR model was estimated to be the smallest (0.03), followed by the NorESM1-M model (0.04) and the BCC-CSM model (0.06). For the zonal data, the BCC-CSM model was found to have the smallest NRMSE (0.19), followed by the IPSL-CM5A-LR model (0.20) and the NorESM1-M model (0.21). Finally, for the grid data, the IPSL-CM5A-LR model showed the smallest NRMSE (0.60), followed by the BCC-CSM (0.63), NorESM1-M (0.63), EC-EARTH (0.63), and FGOAL-g2 (0.63) models. Based on these results, it could be concluded that GCMs like IPSL-CM5A-LR, NorESM1-M, and BCC-CSM showed higher similarity to the GPCP data than the other GCMs.

4. Comparison of Global Precipitation Climatology Project Data and General Circulation Model Predictions with Cyclostationary Empirical Orthogonal Functions

4.1. EOF and CSEOF Analysis

Empirical orthogonal function (EOF) analysis is another term used for principle component analysis (PCA). Proposed in 1901 by Pearson [40], and independently developed by Hotelling [41], PCA is known by various terms, depending on the field of application, such as the discrete Kosambi–Karhunen–Loeve Transform in signal processing [42], the proper orthogonal decomposition in mechanical engineering [43], singular value decomposition (SVD) in linear algebra [44], and empirical modal analysis in structural dynamics [45].
EOF analysis is a statistical procedure used to convert a set of observations into a set of values of linearly uncorrelated variables, called EOFs. EOF analysis can be performed easily by the eigenvalue decomposition of a data covariance (or correlation) matrix, or the SVD of a data matrix X. The number of EOFs in a set of data is less than or equal to the number of original variables, and the resulting EOFs are orthogonal to each other. Since efficient algorithms are now available for the SVD of X without needing to form the matrix XTX, the SVD is now the standard way to derive EOFs from a data matrix. The simplicity of EOF analysis is largely the reason for its popularity in study areas such as meteorology, geology, and oceanography [16,17,18,19,20,21,22,24,35,46].
In contrast to EOF analysis, cyclostationary empirical orthogonal function (CSEOF) analysis is used to extract the major principle components, to explain the spatial variability of the raw data while considering the cyclostationarity. Cyclic behavior occurs in various climatological and hydrological data, among which the seasonal data and the global data are typical [47,48,49,50]. CSEOF analysis was introduced by Kim and North [20], and many application examples can be found in the field of meteorology [26,27,28,30,35,51,52,53] and oceanography [54,55,56,57].
As the CSEOF analysis considers the cyclic behavior of the data, the variable showing this cyclic behavior should be defined correctly. The global data analysis can be divided into two cases, one to consider the spatial cyclic behavior, and the other to consider the seasonal cyclic behavior. Specifically, the spatial cyclic behavior is used to consider the shape of earth, in which the longitudinal characteristics are repeated at each orbit of the earth. Seasonal cyclic behavior can be easily understood, as it is repeated every year. As this study focuses on the annual precipitation data, the CSEOF analysis was used to consider the spatial cyclic behavior.
The pattern correlation coefficient, as well as the NRMSE given in Equation (2), was generally used to compare the major CSEOFs, derived from the GCM predictions, and those from the observed data [11,39,58,59,60,61]. The pattern correlation coefficient indicated the correlation coefficient of the data, given as forms of a matrix or vector. The mean difference was not considered in the pattern correlation coefficient. On the other hand, the NRMSE could be bigger than the pattern correlation coefficient, especially when the mean difference was large, which was the main difference between the pattern correlation coefficient and the NRMSE. The pattern correlation coefficient R p a t is defined as the absolute value of the correlation coefficient as follows [20]:
R p a t = | i = 1 N ( X o b s ,   i X ¯ o b s ) ( X s i m u l ,   i X ¯ s i m u l ) σ o b s σ s i m u l |
where N is the total number of GCM predictions and observed data, X o b s represents the observed data, X ¯ o b s is the mean of the observed data, X s i m u l represents the GCM predictions, X ¯ s i m u l is the mean of the GCM predictions, σ o b s is the standard deviation of the observed data, and σ s i m u l is the standard deviation of the GCM predictions. The range of the pattern correlation coefficient, calculated using the above equation, is from zero to 1. If the pattern correlation coefficient is 1, both data are assumed to be perfectly linearly correlated. If the pattern correlation coefficient is zero, neither data are assumed to be linearly correlated.

4.2. Comparison of Cyclostationary Empirical Orthogonal Functions of General Circulation Model Predictions and Global Precipitation Climatology Project Data

Various spatial patterns were derived by the CSEOF analysis of the GCM predictions and the GPCP data (see Figure 3 as an example). All of these patterns were independent and orthogonal to each other. Among the CSEOFs derived, relatively important patterns could be selected, based on the ratio of variance that each CSEOF explains. Table 3 summarizes the ratio of variance that each CSEOF of the GCM predictions and GPCP data explains. As can be found in this table, the ratio of variance that the first CSEOF explains was higher than 95% in all GCM predictions: the highest was 98.49% in the INMCM4.0 model, and the lowest was 95.29% in the NorESM1-M model. The first CSEOF of the GPCP data explained 97.23% of the original variance, which was similar to the NCAR-CAM5, GISS-E2-R, CNRM-CM5, EC-EARTH, and IPSL-CM5A-LR models.
As can be seen in Figure 3, each CSEOF shows a very unique pattern, which may be interpreted as typical behavior of the annual precipitation field recorded in the GPCP data. For example, the first CSEOF in Figure 3 is composed of all positive numbers, which is believed to represent the spatial variation of the annual mean precipitation over the globe. Rather high annual precipitation amount was noticed around the equator, as well as in the Pacific and Atlantic Ocean of the northern hemisphere. In fact, the dominance of the first CSEOF was expected, given how the annual precipitation data is handled in this study. Seasonal variation was removed in the process of temporal averaging. Only the spatial variability remained in the resulting annual precipitation data, so the annual climatology seems to be the dominant characteristic in this data.
However, it was not so obvious what other CSEOFs explain exactly. Most of them seemed to explain somewhat different spatial patterns, with some distinctions around the equator. In the second CSEOF, very strong precipitation spots were found around the equator; on the other hand, very weak precipitation spots were found in the same region in the third CSEOF. The fourth CSEOF seems rather opposite to the first CSEOF. The ratio of variance was around 0.38–1.87% for the second CSEOF, around 0.30–1.19% for the third CSEOF, and around 0.26–0.63% for the fourth CSEOF. In all models, including the GPCP data, more than 98% of the total variance was explained by the first four CSEOFs.
Before analyzing the characteristics of the CSEOFs derived from 20 GCM predictions and the GPCP data, it should be mentioned here that the difference in the level of darkness between the CSEOFs did not represent the difference of the precipitation amount. As the NCAR-CAM5, MRI-CGCM3, and MIROC5 models have a greater number of cells (due to higher spatial resolution), the CSEOF derived for those GCM predictions looks rather brighter than others. On the other hand, for the BCM-CSM1.1 and IPSL-CM5a-LR models, as the number of cells is rather small, the CSEOF derived can be seen a bit darker than others. This is simply because these CSEOFs were normalized to make the sum of squares of each CSEOF be unified.
Figure 4 compares the first CSEOFs, derived from eight GCM predictions and the GPCP data. Among 20 GCMs, eight GCMs were selected to show the first CSEOF. Similar to the first CSEOF of GPCP data, the first CSEOFs of all eight GCMs in Figure 4 are composed of only positive numbers. All of these first CSEOFs show the obvious and major spatial pattern of annual precipitation around the equator. Different from the first CSEOF of the GPCP data, the precipitation was mostly and clearly concentrated around the ±5° latitude, not the equator. A strong and clear symmetric pattern in the northern and southern hemisphere around the equator was also common in all eight GCM predictions. High precipitation amount in Southeast Asia was also a common pattern to be found in all eight GCM predictions. Some dominant patterns around the equator could also be found in other CSEOFs. However, as they look similar each other, it was not easy to distinguish one from another. As provided in Table 3, the ratios of variance explained by these second to fourth CSEOFs were all far less than two percent, so it may be absurd to try to link these CSEOFs to some spatial patterns of physical meaning.
The CSEOFs derived from 20 GCM predictions were compared with those from the GPCP data, to evaluate the prediction ability of each GCM. As the CSEOFs were used as building blocks in the prediction of precipitation field, it may be assumed that more accurate prediction results can be expected with more similar CSEOFs to the observed data. As measures for the evaluation of the GCM predictions, the pattern correlation coefficient and NRMSE were derived from the CSEOFs of the GCM predictions and the GPCP data. Table 4 summarizes the resulting pattern correlation coefficients and the NRMSEs between CSEOFs, respectively. Even though this table provides the pattern correlation coefficients and NRMSEs from the first to the fourth CSEOF, those derived for the first CSEOF played a dominant role in evaluating the GCM predictions.
As can be seen in Table 4, the pattern correlation coefficients estimated for the first CSEOF were higher than 0.4 in all GCM predictions. In particular, the pattern correlation coefficients of the NCAR-CAM5 and NorESM1-M models were estimated to be very high, at more than 0.6. In fact, the pattern correlation coefficient of 0.4 was not high enough for the CSEOF to be used for the purpose of prediction. Only the NorESM1-M model showed a pattern correlation coefficient higher than 0.7. In this study, the statistical significance of the pattern correlation was tested based on the critical value under given significance level. When n = 9 (the degree of freedom is 7), the critical value for correlation coefficient is equal to 0.666, under a significance level of 5% [62]. In this case, only the NorESM1-M model was found to be better than others. However, if the significance level was 10% (the critical value is 0.582), three GCMs, including BCC-CSM, NCAR-CAM5, and MRI-CGCM3 were found to be better.
In the cases of the second to the fourth CSEOF, the overall pattern correlation coefficients of the 20 GCMs were lower than that for the first CSEOF. For the second CSEOF, the pattern correlation coefficients of 10 GCMs were less than 0.3, which is also very low for the purpose of prediction. Only the pattern correlation coefficients of the MRI-CGCM3, MIROC5, CanESM2, and MPI-ESM-LR models were higher than 0.4. All of the pattern correlation coefficients for the third CSEOF were less than 0.3. The only pattern correlation coefficient estimated to be close to 0.3 was that of the NorESM1-M model. The pattern correlation coefficients estimated for the fourth CSEOF were estimated to be very low. The pattern correlation coefficients of all GCMs, except for the NorESM1-M model, were less than 0.2. The pattern correlation coefficient of the NorESM1-M model was around 0.4.
Contrary to the pattern correlation coefficient, the NRMSE decreased as the GCM prediction became more accurate (Table 4). For the first CSEOF, a total of 18 GCMs were found to have NRMSE values higher than 0.5. Only two GCMs, GFDL-CM3 and NorESM1-M, had an NRMSE value smaller than 0.5. In particular, the first CSEOF of the NorESM1-M model was found to have the lowest NRMSE value of 0.443, while the NRMSE for the GFDL-CM3 model was 0.490.
The NRMSE estimated for the second to fourth CSEOFs was much higher than that for the first CSEOF. In the case of the second CSEOF, six GCMs had NRMSE values smaller than 1.0. The second CSEOF of the FGOALS-g2 model had the lowest NRMSE value of 0.814, and the NRMSE of CanESM2 was the second lowest, at 0.863. For the third CSEOF, all GCMs except for the MIROC5, FIO-ESM, and FGOALS-g2 models had an NRMSE value higher than 1.0. The NRMSE for the third CSEOF of the FIO-ESM model was 0.809. The fourth CSEOF of the NorESM1-M, CanESM2, FIO-ESM, and FGOALS-g2 models were found to have an NRMSE value of less than 1.0, which was 0.988, 0.960, 0.970 and 0.953.
Additionally, it should be mentioned that the pattern correlation coefficients and the NRMSEs estimated in this study could have been affected by the different spatial resolutions of GCM predictions. The spatial resolution of the GPCP data is 2.5° × 2.5°, but the spatial resolution of the GCMs considered in this study are very different each other. Thus, in this study, when comparing the CSEOFS of the GCM predictions with those of the GPCP data (i.e., when estimating the pattern correlation coefficient and the NRMSE), the spatial resolution of both the GCM prediction and the GPCP data were harmonized by the smallest common multiple. It was also possible to consider the smallest common multiple of all the GCMs, but it was excluded, as the resulting resolution was too coarse. Thus, the result in this study can have some uncertainty, due to this inconsistency of the spatial resolution used when comparing the GCM prediction and the GPCP data. The uncertainty, however, was found to be not so serious, based on the evaluation with some other possible spatial resolutions based on common multiples.

5. Discussions on the Performance of GCM Predictions

In the previous two sections, the GCM predictions of precipitation were compared with the GPCP observed data. The comparison was based on two methods: first, using conventional statistics, like the mean and standard deviation; and second, using the pattern correlation coefficient and NRMSE of those CSEOFs derived from the GCM predictions and the GPCP data. In this part of the study, both the conventional statistics and statistics for the comparison of CSEOFs were merged to evaluate the performance of GCM predictions.
Among many conventional statistics considered in the comparison, the NRMSEs of the grid mean and zonal mean were selected for the evaluation of the GCM predictions. The reason for selecting these two statistics was to make the comparison of GCMs easier, as the NRMSE can consider both the bias (i.e., mean difference) and random error (i.e., standard deviation). The NRMSE for the global data was not considered, as it was too small to be used with other statistics. Both the pattern correlation coefficient and the NRMSE were selected as measures for the comparison of the CSEOFs. Only the first CSEOF was considered in this comparison, as it covers most of the original variability. As a result, a total of four different statistics were selected, which were used to compare the GCM predictions such as in Figure 5. In this figure, as the NRMSE is the measure of badness (i.e., zero represents the best), the pattern correlation coefficient was replaced by the value of the pattern correlation coefficient subtracted from one.
Figure 5 can be interpreted as showing that the closer the GCM is to the origin, the more similar it is with the GPCP data. The first quadrant in Figure 5 shows that NorESM1-M is the closest to the origin. That is, when the pattern correlation coefficient and NRMSE of the first CSEOF are considered, the NorESM1-M model becomes the most similar one to the GPCP data. In the second quadrant where the pattern correlation coefficient for the first CSEOF and the NRMSE of the grid mean are concerned, the NorESM1-M model was also found the nearest to the origin. However, the IPSL-CM5A-LR model was found to be closer to the origin in the third quadrant, where the NRMSEs of the grid and zonal means were concerned. Finally, in the fourth quadrant, where the NRMSEs of the zonal mean and the first CSEOF were considered, the NorESM1-M model was also found to be the nearest to the origin. Overall, it is obvious that the NorSM1-M model is the most similar to the GPCP data. However, the IPSL-CM5A-LR model was found to be the best when only the conventional statistics are concerned. Additionally, the BCC-CSM model was found to be similar to the GPCP data in all four quadrants.

6. Conclusions

In this study, 20 GCM predictions of precipitation were compared with the observed GPCP data. The GCMs considered in this study were all those covering the period from 2006 to 2014, which was the maximum to be considered in this study for the comparison of the GCM predictions and GPCP data. Among 23 development institutes for GCMs, a total of 20 GCMs were selected for the CSEOF analysis in this study. The comparison was done for three data structures, being the global, zonal, and grid means, along with those conventional statistics like the root mean square error (RMSE) and the pattern correlation coefficient of the CSEOF. The results obtained from this study are summarized as follows.
In the comparison of the GCM predictions and GPCP data with the conventional statistics, the IPSL-CM5A-LR and NorESM1-M models were found most similar to the GPCP data. This result was consistent in all the comparisons of annual mean, as well as in the NRMSEs of global, zonal and grid data.
The CSEOF analysis of the GCM predictions and GPCP data showed that the first CSEOF was dominant, in that it covered more than 95% of the total variance of the original data. Thus, the comparison was done only for the first CSEOF, to derive the pattern correlation coefficient and NRMSE. In this comparison, the NorESM1-M model was also found to be the most similar to the GPCP data. The BCC-CSM, NCAR-CAM5, and MRI-CGCM3 models were also found to have quite a high pattern correlation coefficient.
Similar results were also derived from the merged comparison of both the conventional statistics and the statistics for the comparison of CSEOFs. Overall, the NorSM1-M model was found to be the most similar to the GPCP data. Additionally, the IPSL-CM5A-LR, BCC-CSM, and GFDL-CMS models were also found to be quite similar to the GPCP data.
As a result in this study, the precipitation predictions of the NorSM1-M model were found to be the most similar to the GPCP data. However, it should be remembered that this result is based only on several statistics. The fact that the annual data were used in the comparison may be the most serious limitation of this study. It may be possible to derive a different conclusion when considering the monthly or daily data. Additionally, it should also be remembered that the results of this study do not guarantee the quality of the future prediction. It is also true that we do not have many other measures to be used for the selection of a proper GCM. Consideration of multiple GCMs, not just one, may be a better method for the study of global warming and climatic change.

Acknowledgments

This work is supported by the Korea Agency for Infrastructure Technology Advancement (KAIA) grant funded by the Ministry of Land, Infrastructure and Transport (Grant 17AWMP-B083066-04).

Author Contributions

Chulsang Yoo conceived and designed the idea of this research and wrote the manuscript. Eunsaem Cho collected the data and conducted CSEOF analysis using that data.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Kondratyev, K.Y.; Varotsos, C. Atmospheric greenhouse effect in the context of global climate change. Il Nuovo Cimento C 1995, 18, 123–151. [Google Scholar] [CrossRef]
  2. Intergovernmental Panel on Climate Change (IPCC). Climate Change 2014–Impacts, Adaptation and Vulnerability: Regional Aspects; Cambridge University Press: New York, NY, USA, 2014; pp. 1133–1655. [Google Scholar]
  3. Victor, D.G. Toward effective international cooperation on climate change: Numbers, interests and institutions. Glob. Environ. Polit. 2006, 6, 90–103. [Google Scholar] [CrossRef]
  4. De Coninck, H.; Stephens, J.C.; Metz, B. Global learning on carbon capture and storage: A call for strong international cooperation on CCS demonstration. Energy Policy 2009, 37, 2161–2165. [Google Scholar] [CrossRef]
  5. Moss, R.H.; Edmonds, J.A.; Hibbard, K.A.; Manning, M.R.; Rose, S.K.; Van Vuuren, D.P.; Carter, T.R.; Emori, S.; Kainuma, M.; Kram, T. The next generation of scenarios for climate change research and assessment. Nature 2010, 463, 747–756. [Google Scholar] [CrossRef] [PubMed]
  6. Shin, J.; Lee, H.-S.; Kim, M.; Kwon, W.-T. An uncertainty assessment for annual variability of precipitation simulated by AOGCMs over East Asia. Atmosphere 2010, 20, 111–130. [Google Scholar]
  7. Hwang, S. Assessing the Performance of CMIP5 GCMs for Various Climatic Elements and Indicators over the Southeast US. J. Korea Water Resour. Assoc. 2014, 47, 1039–1050. [Google Scholar] [CrossRef]
  8. Milly, P.; Betancourt, J.; Falkenmark, M.; Hirsch, R.M.; Kundzewicz, Z.W.; Lettenmaier, D.P.; Stouffer, R.J. Stationarity is dead: Whither water management? Science 2008, 319, 573–574. [Google Scholar] [CrossRef] [PubMed]
  9. Aloysius, N.R.; Sheffield, J.; Saiers, J.E.; Li, H.; Wood, E.F. Evaluation of historical and future simulations of precipitation and temperature in central Africa from CMIP5 climate models. J. Geophys. Res. Atmos. 2016, 121, 130–152. [Google Scholar] [CrossRef]
  10. Dai, A. Precipitation characteristics in eighteen coupled climate models. J. Clim. 2006, 19, 4605–4630. [Google Scholar] [CrossRef]
  11. Fu, G.; Liu, Z.; Charles, S.P.; Xu, Z.; Yao, Z. A score-based method for assessing the performance of GCMs: A case study of southeastern Australia. J. Geophys. Res. Atmos. 2013, 118, 4154–4167. [Google Scholar] [CrossRef]
  12. Landerer, F.W.; Gleckler, P.J.; Lee, T. Evaluation of CMIP5 dynamic sea surface height multi-model simulations against satellite observations. Clim. Dyn. 2014, 43, 1271–1283. [Google Scholar] [CrossRef]
  13. Tabari, H.; Taye, M.T.; Willems, P. Water availability change in central Belgium for the late 21st century. Glob. Planet. Chang. 2015, 131, 115–123. [Google Scholar] [CrossRef]
  14. Ning, L.; Bradley, R.S. NAO and PNA influences on winter temperature and precipitation over the eastern United States in CMIP5 GCMs. Clim. Dyn. 2016, 46, 1257–1276. [Google Scholar] [CrossRef]
  15. Lovejoy, S.; Varotsos, C. Scaling regimes and linear/nonlinear responses of last millennium climate to volcanic and solar forcings. Earth Syst. Dyn. 2016, 7, 133–150. [Google Scholar] [CrossRef]
  16. Kutzbach, J.E. Empirical eigenvectors of sea-level pressure, surface temperature and precipitation complexes over North America. J. Appl. Meteorol. 1967, 6, 791–802. [Google Scholar] [CrossRef]
  17. Wallace, J.M.; Dickinson, R.E. Empirical orthogonal representation of time series in the frequency domain. Part I: Theoretical considerations. J. Appl. Meteorol. 1972, 11, 887–892. [Google Scholar] [CrossRef]
  18. Singh, S.; Kripalani, R. Application of extended empirical orthogonal function analysis to interrelationships and sequential evolution of monsoon fields. Mon. Weather Rev. 1986, 114, 1603–1611. [Google Scholar] [CrossRef]
  19. Wagner, D.; Ruprecht, E.; Simmer, C. A combination of microwave observations from satellites and an EOF analysis to retrieve vertical humidity profiles over the ocean. J. Appl. Meteorol. 1990, 29, 1142–1157. [Google Scholar] [CrossRef]
  20. Kim, K.Y.; North, G.R. EOF analysis of surface temperature field in a stochastic climate model. J. Clim. 1993, 6, 1681–1690. [Google Scholar] [CrossRef]
  21. Kim, K.-Y. Sensitivity of a linear detection procedure to the accuracy of empirical orthogonal functions. J. Geophys. Res. Atmos. 1996, 101, 23423–23432. [Google Scholar] [CrossRef]
  22. Yoo, C.; Kim, S. EOF analysis of surface soil moisture field variability. Adv. Water Resour. 2004, 27, 831–842. [Google Scholar] [CrossRef]
  23. Jawson, S.D.; Niemann, J.D. Spatial patterns from EOF analysis of soil moisture at a large scale and their dependence on soil, land-use, and topographic properties. Adv. Water Resour. 2007, 30, 366–381. [Google Scholar] [CrossRef]
  24. Deser, C.; Alexander, M.A.; Xie, S.-P.; Phillips, A.S. Sea surface temperature variability: Patterns and mechanisms. Annu. Rev. Mar. Sci. 2010, 2, 115–143. [Google Scholar] [CrossRef] [PubMed]
  25. Kim, K.-Y.; North, G.R. EOFs of harmonizable cyclostationary processes. J. Atmos. Sci. 1997, 54, 2416–2427. [Google Scholar] [CrossRef]
  26. Kim, K.-Y. Investigation of ENSO variability using cyclostationary EOFs of observational data. Meteorol. Atmos. Phys. 2002, 81, 149–168. [Google Scholar] [CrossRef]
  27. Trenberth, K.E.; Stepaniak, D.P.; Smith, L. Interannual variability of patterns of atmospheric mass distribution. J. Clim. 2005, 18, 2812–2825. [Google Scholar] [CrossRef]
  28. Lim, Y.-K.; Kim, K.-Y. ENSO impact on the space-time evolution of the regional Asian summer monsoons. J. Clim. 2007, 20, 2397–2415. [Google Scholar] [CrossRef]
  29. Na, H.; Kim, K.Y.; Chang, K.I.; Kim, K.; Yun, J.Y.; Minobe, S. Interannual variability of the Korea Strait Bottom Cold Water and its relationship with the upper water temperatures and atmospheric forcing in the Sea of Japan (East Sea). J. Geophys. Res. Oceans 2010, 115, C09031. [Google Scholar] [CrossRef]
  30. Roh, J.W.; Kim, K.Y.; Jhun, J.G. Decadal changes in the physical mechanisms of the seasonal cycle of summertime precipitation variability in Korea. J. Geophys. Res. Atmos. 2012, 117, D07115. [Google Scholar] [CrossRef]
  31. Kim, Y.; Kim, K.-Y.; Park, S. Seasonal scale variability of the East Asian winter monsoon and the development of a two-dimensional monsoon index. Clim. Dyn. 2014, 42, 2159–2172. [Google Scholar] [CrossRef]
  32. Kim, K.-Y.; Roh, J.-W. Physical mechanisms of the wintertime surface air temperature variability in South Korea and the near-7-day oscillations. J. Clim. 2010, 23, 2197–2212. [Google Scholar] [CrossRef]
  33. Na, H.; Jang, B.-G.; Choi, W.-M.; Kim, K.-Y. Statistical simulations of the future 50-year statistics of cold-tongue El Niño and warm-pool El Niño. Asia-Pac. J. Atmos. Sci. 2011, 47, 223–233. [Google Scholar] [CrossRef]
  34. Oh, J.-H.; Kim, K.-Y.; Lim, G.-H. Impact of MJO on the diurnal cycle of rainfall over the western Maritime Continent in the austral summer. Clim. Dyn. 2012, 38, 1167–1180. [Google Scholar] [CrossRef]
  35. Hamlington, B.; Leben, R.; Strassburg, M.; Kim, K.Y. Cyclostationary empirical orthogonal function sea-level reconstruction. Geosci. Data J. 2014, 1, 13–19. [Google Scholar] [CrossRef]
  36. Efstathiou, M.N.; Varotsos, C.A. Intrinsic properties of Sahel precipitation anomalies and rainfall. Theor. Appl. Climatol. 2012, 109, 627–633. [Google Scholar] [CrossRef]
  37. Adler, R.F.; Huffman, G.J.; Chang, A.; Ferraro, R.; Xie, P.-P.; Janowiak, J.; Rudolf, B.; Schneider, U.; Curtis, S.; Bolvin, D. The version-2 global precipitation climatology project (GPCP) monthly precipitation analysis (1979–present). J. Hydrometeorol. 2003, 4, 1147–1167. [Google Scholar] [CrossRef]
  38. Yoo, C. Evaluation of GFDL GCM climate variability using EOFS of zonal average temperature data. Water Eng. Res. 2004, 5, 69–79. [Google Scholar]
  39. Conway, D.; Hanson, C.; Doherty, R.; Persechino, A. GCM simulations of the Indian Ocean dipole influence on East African rainfall: Present and future. Geophys. Res. Lett. 2007, 34, L03705. [Google Scholar] [CrossRef]
  40. Pearson, K. Principal components analysis. Philos. Mag. 1901, 6, 566. [Google Scholar]
  41. Hotelling, H. Analysis of a complex of statistical variables into principal components. J. Educ. Psychol. 1933, 24, 417–441. [Google Scholar] [CrossRef]
  42. Kosambi, D.D. The estimation of map distances from recombination values. Ann. Eugen. 1943, 12, 172–175. [Google Scholar] [CrossRef]
  43. Sirovich, L. Turbulence and the dynamics of coherent structures part I: Coherent structures. Q. Appl. Math. 1987, 45, 561–571. [Google Scholar] [CrossRef]
  44. Golub, G.H.; Reinsch, C. Singular value decomposition and least squares solutions. Numer. Math. 1970, 14, 403–420. [Google Scholar] [CrossRef]
  45. Huang, N.E.; Shen, Z.; Long, S.R.; Wu, M.C.; Shih, H.H.; Zheng, Q.; Yen, N.-C.; Tung, C.C.; Liu, H.H. The empirical mode decomposition and the Hilbert spectrum for nonlinear and non-stationary time series analysis. Proc. Math Phys. Eng. Sci. 1998, 454, 903–995. [Google Scholar] [CrossRef]
  46. Bergant, K.; Belda, M.; Halenka, T. Systematic errors in the simulation of European climate (1961–2000) with RegCM3 driven by NCEP/NCAR reanalysis. Int. J. Climatol. 2007, 27, 455–472. [Google Scholar] [CrossRef]
  47. Hardy, J.T. Climate Change: Causes, Effects, and Solutions; John Wiley & Sons: Chichester, UK, 2003; pp. 3–211. [Google Scholar]
  48. Franks, S.W.; Wagener, T. Regional Hydrological Impacts of Climatic Change: Hydroclimatic Variability; International Assn of Hydrological Sciences: Wallingford, UK, 2005; pp. 7–291. [Google Scholar]
  49. Rohli, R.V.; Vega, A.J. Climatology; Jones & Bartlett Publishers: Burlington, MA, USA, 2013. [Google Scholar]
  50. Hipel, K.W.; Fang, L. Stochastic and Statistical Methods in Hydrology and Environmental Engineering: Volume 4: Effective Environmental Management for Sustainable Development; Springer Science & Business Media: Berlin, Germany, 2013; pp. 3–457. [Google Scholar]
  51. Lim, Y.-K.; Kim, K.-Y.; Lee, H.-S. Temporal and spatial evolution of the Asian summer monsoon in the seasonal cycle of synoptic fields. J. Clim. 2002, 15, 3630–3644. [Google Scholar] [CrossRef]
  52. Annamalai, H.; Sperber, K. Regional heat sources and the active and break phases of boreal summer intraseasonal (30–50 day) variability. J. Atmos. Sci. 2005, 62, 2726–2748. [Google Scholar] [CrossRef]
  53. Lim, Y.K.; Shin, D.; Cocke, S.; LaRow, T.; Schoof, J.T.; O’Brien, J.J.; Chassignet, E.P. Dynamically and statistically downscaled seasonal simulations of maximum surface air temperature over the southeastern United States. J. Geophys. Res. Atmos. 2007, 112, D24102. [Google Scholar] [CrossRef]
  54. Kim, K.Y.; Kim, Y.Y. Investigation of tropical Pacific upper-ocean variability using cyclostationary EOFs of assimilated data. Ocean Dyn. 2004, 54, 489–505. [Google Scholar] [CrossRef]
  55. Alvera-Azcárate, A.; Barth, A.; Beckers, J.M.; Weisberg, R.H. Multivariate reconstruction of missing data in sea surface temperature, chlorophyll, and wind satellite fields. J. Geophys. Res. Oceans 2007, 112, C03008. [Google Scholar] [CrossRef]
  56. Na, H.; Kim, K.Y.; Chang, K.I.; Park, J.J.; Kim, K.; Minobe, S. Decadal variability of the upper ocean heat content in the East/Japan Sea and its possible relationship to northwestern Pacific variability. J. Geophys. Res. Oceans 2012, 117, C02017. [Google Scholar] [CrossRef]
  57. Pei, Y.; Zhang, R.-H.; Zhang, X.; Jiang, L.; Wei, Y. Variability of sea surface height in the South China Sea and its relationship to Pacific oscillations. Acta. Oceanol. Sin. 2015, 34, 80–92. [Google Scholar] [CrossRef]
  58. Singhrattna, N.; Babel, M.S. Changes in summer monsoon rainfall in the Upper Chao Phraya River Basin, Thailand. Clim. Res. 2011, 49, 155–168. [Google Scholar] [CrossRef]
  59. Wu, W.; Liu, Y.; Ge, M.; Rostkier-Edelstein, D.; Descombes, G.; Kunin, P.; Warner, T.; Swerdlin, S.; Givati, A.; Hopson, T. Statistical downscaling of climate forecast system seasonal predictions for the Southeastern Mediterranean. Atmos. Res. 2012, 118, 346–356. [Google Scholar] [CrossRef]
  60. Su, F.; Duan, X.; Chen, D.; Hao, Z.; Cuo, L. Evaluation of the global climate models in the CMIP5 over the Tibetan Plateau. J. Clim. 2013, 26, 3187–3208. [Google Scholar] [CrossRef]
  61. Liu, Z.; Xu, Z. Climate change scenarios generated by using GCM outputs and statistical downscaling in an arid region. Desert 2015, 20, 101–115. [Google Scholar]
  62. Rohlf, F.J.; Sokal, R.R. Statistical Tables; Macmillan: Basingstoke, UK, 1995. [Google Scholar]
Figure 1. Annual variation of global mean precipitations of eight GCMs and Global Precipitation Climatology Project (GPCP) data from 2006 to 2014.
Figure 1. Annual variation of global mean precipitations of eight GCMs and Global Precipitation Climatology Project (GPCP) data from 2006 to 2014.
Water 10 00028 g001
Figure 2. Zonal mean precipitation of eight GCM predictions and GPCP data from 2006 to 2014.
Figure 2. Zonal mean precipitation of eight GCM predictions and GPCP data from 2006 to 2014.
Water 10 00028 g002
Figure 3. Ten cyclostationary empirical orthogonal functions (CSEOFs) of the GPCP annual precipitation data. (a) 1st CSEOF; (b) 2nd CSEOF; (c) 3rd CSEOF; (d) 4th CSEOF; (e) 5th CSEOF; (f) 6th CSEOF; (g) 7th CSEOF; (h) 8th CSEOF; (i) 9th CSEOF; (j) 10th CSEOF.
Figure 3. Ten cyclostationary empirical orthogonal functions (CSEOFs) of the GPCP annual precipitation data. (a) 1st CSEOF; (b) 2nd CSEOF; (c) 3rd CSEOF; (d) 4th CSEOF; (e) 5th CSEOF; (f) 6th CSEOF; (g) 7th CSEOF; (h) 8th CSEOF; (i) 9th CSEOF; (j) 10th CSEOF.
Water 10 00028 g003aWater 10 00028 g003b
Figure 4. Comparison of eight GCM predictions and GPCP data with their first CSEOFs. (a) BCC-CSM1.1; (b) NCAR-CAM5; (c) MRI-CGCM3; (d) GFDL-CM3; (e) Observed data (GPCP data); (f) GISS-E2-R; (g) IPSL-CM5A-LR; (h) MIROC5; (i) NorESM1-M.
Figure 4. Comparison of eight GCM predictions and GPCP data with their first CSEOFs. (a) BCC-CSM1.1; (b) NCAR-CAM5; (c) MRI-CGCM3; (d) GFDL-CM3; (e) Observed data (GPCP data); (f) GISS-E2-R; (g) IPSL-CM5A-LR; (h) MIROC5; (i) NorESM1-M.
Water 10 00028 g004aWater 10 00028 g004b
Figure 5. Evaluation of 20 GCM predictions, with their NRMSEs and pattern correlations of CSEOF.
Figure 5. Evaluation of 20 GCM predictions, with their NRMSEs and pattern correlations of CSEOF.
Water 10 00028 g005
Table 1. Description of Coupled Model Intercomparison Project, Phase 5 (CMIP5) general circulation models (GCMs) used in this study.
Table 1. Description of Coupled Model Intercomparison Project, Phase 5 (CMIP5) general circulation models (GCMs) used in this study.
No.GCMDevelopment InstituteGrid Resolution
1BCC-CSM1.1Beijing Climate Center2.813° × 2.813°
2NCAR-CAM5National Centre for Atmospheric Research1.250° × 0.938°
3MRI-CGCM3Meteorological Research Institute1.125° × 1.125°
4GFDL-CM3Geophysical Fluid Dynamics Laboratory2.500° × 2.000°
5GISS-E2-RNASA/Goddard Institute for Space Studies2.500° × 2.000°
6IPSL-CM5A-LRInstitute Pierre-Simon Laplace3.750° × 1.875°
7MIROC5Japan Agency for Marine-Earth Science and Technology, Atmosphere and Ocean Research Institute, and National Institute for Environmental Studies1.406° × 1.406°
8NorESM1-MNorwegian Climate Centre2.500° × 1.875°
9BNU-ESMBeijing Normal University2.813° × 2.813°
10CanESM2Canadian Centre for Climate Modelling and Analysis2.813° × 2.813°
11CNRM-CM5Centre National de Recherches Météorologiques, Centre Européen de Recherche et de Formation Avancée en Calcul Scientifique1.406° × 1.406°
12ACCESS1.3Commonwealth Scientific and Industrial Research Organization/Bureau of Meteorology1.875° × 1.241°
13CSIRO-Mk3.6.0Commonwealth Scientific and Industrial Research Organization/Queensland Climate Change Centre of Excellence1.875° × 1.875°
14FIO-ESMThe First Institute of Oceanography2.813° × 2.813°
15EC-EARTHEC-EARTH consortium published at Irish Centre for High-End Computing1.125° × 1.125°
16INMCM4.0Russian Academy of Sciences, Institute of Numerical Mathematics2.000° × 1.500°
17FGOALS-g2Institute of Atmospheric Physics, Chinese Academy of Sciences2.813° × 3.000°
18MPI-ESM-LRMax Planck Institute for Meteorology1.875° × 1.875°
19HadGEM2-AONational Institute of Meteorological Research, Korea Meteorological Administration1.875° × 1.241°
20HadGEM2-ESMet Office Hadley Centre1.875° × 1.250°
Table 2. Some statistics of eight 20 GCM predictions and GPCP data. The normalized root mean squares (NRMSEs) were calculated by assuming the GPCP data as truth.
Table 2. Some statistics of eight 20 GCM predictions and GPCP data. The normalized root mean squares (NRMSEs) were calculated by assuming the GPCP data as truth.
DataGlobal MeanZonal MeanGRID Mean
Mean (mm)SD (mm)NRMSEMean (mm)SD (mm)NRMSEMean (mm)SD (mm)NRMSE
GPCP792.010.50--0-652.50
BCC-CSM1.1842.43.00.06--0.19-653.20.63
NCAR-CAM5880.14.70.11--0.27-681.20.65
MRI-CGCM3864.95.70.09--0.22-671.80.63
GFDL-CM3893.33.10.13--0.23-663.20.64
GISS-E2-R925.81.90.17--0.33-780.00.69
IPSL-CM5A-LR808.74.60.03--0.20-626.10.60
MIROC5955.24.80.21--0.33-676.70.70
NorESM1-M826.24.80.04--0.21-658.50.63
BNU-ESM949.33.90.20--0.30-639.30.68
CanESM2823.23.90.04--0.28-691.70.69
CNRM-CM5901.43.30.14--0.27-637.20.64
ACCESS1.3937.13.40.18--0.32-756.70.75
CSIRO-Mk3.6.0848.63.30.07--0.36-791.50.80
FIO-ESM925.03.70.17--0.28-634.30.64
EC-EARTH856.72.40.08--0.25-615.10.63
INMCM4.0935.02.30.18--0.29-700.20.66
FGOALS-g2875.83.40.11--0.26-625.80.63
MPI-ESM-LR884.82.30.12--0.31-696.80.71
HadGEM2-AO919.22.00.16--0.30-726.40.74
HadGEM2-ES916.03.70.16 0.30 732.40.72
Table 3. Variance explained by CSEOFs derived (%).
Table 3. Variance explained by CSEOFs derived (%).
DataCSEOF
12345
GPCP97.230.660.430.370.29
BCC-CSM1.196.320.780.530.490.44
NCAR-CAM597.660.620.340.260.22
MRI-CGCM396.211.120.550.400.38
GFDL-CM395.651.711.190.350.22
GISS-E2-R97.780.380.330.260.25
IPSL-CM5A-LR97.510.920.300.270.20
MIROC595.361.871.000.520.28
NorESM1-M95.291.620.960.630.39
BNU-ESM95.552.010.770.390.29
CanESM295.532.370.690.330.24
CNRM-CM597.720.650.290.250.24
ACCESS1.396.820.890.480.400.35
CSIRO-Mk3.6.096.600.980.690.370.27
FIO-ESM96.191.270.740.460.33
EC-EARTH97.500.830.380.270.21
INMCM4.098.490.320.230.160.15
FGOALS-g296.671.130.590.330.30
MPI-ESM-LR96.201.430.540.410.32
HadGEM2-AO96.331.230.540.430.33
HadGEM2-ES95.871.480.620.450.36
Table 4. Pattern correlation coefficients and NRMSEs estimated for the CSEOFs of GCM Predictions and GPCP data.
Table 4. Pattern correlation coefficients and NRMSEs estimated for the CSEOFs of GCM Predictions and GPCP data.
GCMPattern CorrelationNRMSE
CSEOF12341234
BCC-CSM1.10.583 *0.3870.0820.0260.5351.0131.2121.177
NCAR-CAM50.662 *0.0190.0360.1660.7291.0921.0811.120
MRI-CGCM30.592*0.4020.1690.1170.6440.9181.1351.019
GFDL-CM30.5740.2600.0670.0690.4901.1061.3601.308
GISS-E2-R0.5450.1890.0550.0170.5321.1151.2911.238
IPSL-CM5A-LR0.5470.1920.0080.0890.5691.2501.4261.481
MIROC50.5700.5220.2180.1060.5680.8650.9981.062
NorESM1-M0.702 **0.0840.2960.4150.4431.2851.0950.988
BNU-ESM0.5010.2910.0540.0360.5700.9420.8611.009
CanESM20.4710.4190.0800.1000.6220.8630.8380.960
CNRM-CM50.5020.3370.0060.0621.1521.5661.5821.964
ACCESS1.30.4600.2190.0180.0951.1051.9521.7301.798
CSIRO-Mk3.6.00.4210.2500.1620.0170.9211.2171.3351.442
FIO-ESM0.5260.0890.0040.0120.5600.9920.8090.970
EC-EARTH0.4980.3760.1760.0481.5591.8441.8992.210
INMCM4.00.5640.3260.0390.0740.8431.1611.0501.322
FGOALS-g20.5170.3850.0310.0600.5660.8140.9200.953
MPI-ESM-LR0.4570.4160.0180.1400.8441.0791.2111.223
HadGEM2-AO0.4450.3550.1230.1281.0961.5141.7221.823
HadGEM2-ES0.4770.2020.1260.0501.0721.4641.4721.603
* statistically significant at α = 0.10; ** statistically significant at α = 0.05.

Share and Cite

MDPI and ACS Style

Yoo, C.; Cho, E. Comparison of GCM Precipitation Predictions with Their RMSEs and Pattern Correlation Coefficients. Water 2018, 10, 28. https://doi.org/10.3390/w10010028

AMA Style

Yoo C, Cho E. Comparison of GCM Precipitation Predictions with Their RMSEs and Pattern Correlation Coefficients. Water. 2018; 10(1):28. https://doi.org/10.3390/w10010028

Chicago/Turabian Style

Yoo, Chulsang, and Eunsaem Cho. 2018. "Comparison of GCM Precipitation Predictions with Their RMSEs and Pattern Correlation Coefficients" Water 10, no. 1: 28. https://doi.org/10.3390/w10010028

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop