1.National Meteorological Center, China Meteorological Administration, Beijing 100081, China 2.State Key Laboratory of Numerical Modeling for Atmospheric Sciences and Geophysical Fluid Dynamics, Institute of Atmospheric Physics, Chinese Academy of Sciences, Beijing 100029, China 3.University of Chinese Academy of Sciences, Beijing 100049, China 4.Laboratory of Cloud-Precipitation Physics and Severe Storms, Institute of Atmospheric Physics, Chinese Academy of Sciences, Beijing 100029, China Manuscript received: 2018-01-09 Manuscript revised: 2018-09-13 Manuscript accepted: 2018-10-09 Abstract:This paper preliminarily investigates the application of the orthogonal conditional nonlinear optimal perturbations (CNOPs)-based ensemble forecast technique in MM5 (Fifth-generation Pennsylvania State University-National Center for Atmospheric Research Mesoscale Model). The results show that the ensemble forecast members generated by the orthogonal CNOPs present large spreads but tend to be located on the two sides of real tropical cyclone (TC) tracks and have good agreements between ensemble spreads and ensemble-mean forecast errors for TC tracks. Subsequently, these members reflect more reasonable forecast uncertainties and enhance the orthogonal CNOPs-based ensemble-mean forecasts to obtain higher skill for TC tracks than the orthogonal SVs (singular vectors)-, BVs (bred vectors)- and RPs (random perturbations)-based ones. The results indicate that orthogonal CNOPs of smaller magnitudes should be adopted to construct the initial ensemble perturbations for short lead-time forecasts, but those of larger magnitudes should be used for longer lead-time forecasts due to the effects of nonlinearities. The performance of the orthogonal CNOPs-based ensemble-mean forecasts is case-dependent, which encourages evaluating statistically the forecast skill with more TC cases. Finally, the results show that the ensemble forecasts with only initial perturbations in this work do not increase the forecast skill of TC intensity, which may be related with both the coarse model horizontal resolution and the model error. Keywords: ensemble forecast, initial perturbation, conditional nonlinear optimal perturbation, tropical cyclone 摘要:基于MM5模式(Fifth-generation Pennsylvania State University–National Center for Atmospheric Research Mesoscale Model), 探讨了正交条件非线性最优扰动(conditional nonlinear optimal perturbations, CNOPs)-集合预报方法在热带气旋路径预报中的应用. 结果表明, 正交CNOPs-集合预报产生的集合成员具有较大的离散度, 合理地位于热带气旋(tropical cyclone, TC)实况路径的两侧, 且较好地呈现了集合离散度和集合平均预报误差近似相等的关系; 与正交奇异向量(singular vectors, SVs), 繁殖向量(bred vectors, BVs), 和随机扰动(random perturbations, RPs)-集合预报方法相比, 正交CNOPs在TC路径预报中具有更高的预报技巧. 此外, 结果还表明, 较小振幅的正交CNOPs, 线性近似的有效性决定了它在TC预报时间较短时具有更高预报技巧, 而对于较大振幅的正交CNOPs, 因为其更多地包含了非线性物理过程的影响, 从而使得其在预报时间较长时产生更高预报技巧. 关键词:集合预报, 初始扰动, 条件非线性最优扰动, 热带气旋
HTML
--> --> --> -->
3.1. Orthogonal CNOPs
The orthogonal CNOPs method is the same as proposed and employed by (Duan and Huo, 2016). Specifically, orthogonal CNOPs are a group of nonlinear optimal initial perturbations denoted as 1st-CNOP, 2nd-CNOP, 3rd-CNOP, …, nth-CNOP. The 1st-CNOP is the nonlinear optimal initial perturbation that has the largest nonlinear evolution at the end of the optimization time period in the whole perturbation phase space Ω1. The jth-CNOP represents the nonlinear optimal initial perturbation in the subspace Ωj that is orthogonal to 1st-CNOP, 2nd-CNOP, 3rd-CNOP, …, (j-1)th-CNOP. In present study, the jth-CNOP can be defined as the initial perturbation x0,j*, which satisfies the following optimization problem: \begin{eqnarray} J({x}_{0,j}^\ast)&=&\max_{{x}_{0,j}\in \Omega_j}J({x}_{0,j})\nonumber\\ &=&\max_{{x}_{0,j}\in \Omega_j} [M_{\tau}({X}_0+{x}_{0,j})-M_{\tau}({X}_0)]^{\rm T}\times\nonumber\\ &&{C}[M_{\tau}({X}_0+{x}_{0,j})-M_{\tau}({X}_0)] , \ \ (1)\end{eqnarray} where X0, composed of zonal wind u, meridional wind v, temperature T and surface pressure p s, is the initial condition of a reference state, where the reference state can be understood as a control forecast; x0,j is the corresponding initial perturbation in the subspace Ωj; τ is the optimization time period; Mτ is the propagator of MM5; the superscript "T" is the transposition symbol; the objective function J(x0,j) evaluates the magnitude of the nonlinear evolution of the initial perturbation x0,j at the end of the optimization time period τ, which is the dry energy of the nonlinear evolved perturbation; and C is the operator corresponding to the dry energy norm, which satisfies: \begin{equation} \delta{X}^{\rm T}{C}\delta{X}=\dfrac{1}{D}\int_{D}\int_0^1\!\left[{u}'^2+{v}'^2+\dfrac{c_p}{T_{\rm r}}{T}'^2 +R_{\rm a}T_{\rm r}\left(\dfrac{{p}'_{\rm s}}{p_{\rm r}}\right)^2\right]{\rm d}\sigma{\rm d}D , \ \ (2)\end{equation} where the perturbation vector δ X is composed of the perturbed zonal wind u', the perturbed meridional wind v', the perturbed temperature T' and the perturbed surface pressure p' s. D is the horizontal domain, which corresponds to the operator C, and σ represents the vertical coordinate. The constant cp=1005.71 J kg-1 K-1 is the specific heat at a constant pressure, R a=287.04 J kg-1 K-1 is the gas constant of the dry air, and p r=1000 hPa and T r=270 K are the reference parameters. The subspace Ωj is described by: \begin{equation} \Omega_j\!=\!\left\{ \begin{array}{l@{\ \ }l} \!\{{x}_{0,j}\!\in\!\mathbb{R}^n|{x}_{0,j}^{\rm T}{C}_1{x}_{0,j}\!\leq\!\beta\}, & j\!\!=\!\!1\\[2.5mm] \!\{{x}_{0,j}\!\in\!\mathbb{R}^n|{x}_{0,j}^{\rm T}{C}_1{x}_{0,j}\!\leq\!\beta,{x}_{0,j}\perp\Omega_j,k\!\!=\!\!1,\ldots,j\!-\!1\}, & j\!\!>\!\!1 \end{array} \right.\!, \ \ (3)\end{equation} where x0,j is the initial perturbation, $\mathbb{ R}$ denotes the real number symbol, n is the vector dimension of x0,j, β is a positive number that limits the amplitudes of the initial perturbations with units of J kg-1, and C1 is the operator corresponding to the initial dry energy norm. x0,j TC1x0,j evaluates the magnitude of the initial perturbation, which is the dry energy of the initial perturbation corresponding to the whole model domain. Note that, when the objective function is defined to evaluate the dry energy for the evolved perturbations in the whole domain, there are always instabilities in the computation of CNOPs. Therefore, the initial perturbations x0,j are produced over the whole model domain D1 (C1 corresponds to D1), but the objective function is defined to evaluate the dry energy in the remaining domain D by removing three grids near the boundary of the whole model domain (C corresponds to D) to confirm the computational stability. Here, we use the SPG2 [Spectral Projected Gradient 2 (Birgin et al., 2000)] method to compute the jth-CNOP (j=1,2,3,…,n) with the optimization time period τ being 24 h.
2 3.2. Orthogonal SVs, RPs, and BVs -->
3.2. Orthogonal SVs, RPs, and BVs
The orthogonal SVs, RPs, and BVs methods are used in the same environment as that of the orthogonal CNOPs. In other words, the perturbed physical variables, the model domains and the norms to measure the perturbations are the same as those used for the orthogonal CNOPs. According to the definition of orthogonal SVs, the cost function of SVs can be written as shown in Eq. (2), which measures the linear growth rates of the initial perturbations. Obviously, the orthogonal SVs represent the linear fastest-growing initial perturbations in their respective subspaces: \begin{equation} \label{eq1} J({x}_0^\ast)=\max_{{x}_0\in\Omega}\frac{({\rm L}{x}_0)^{\rm T}{C}({\rm L}{x}_0)}{{x}_0^{\rm T}{C}_1{x}_0} , \ \ (4)\end{equation} where x0 is the initial perturbation, $\Omega={x_0\in\mathbb R^n|x_0^\rm TC_1x_0\le\beta}$ is the constraint condition of the initial perturbations, and L is the linear propagator of MM5. The SVs are computed using the Lanczos algorithm (Simon, 1984), with the optimization time period being 24 h, and are then scaled to match the magnitudes of the orthogonal CNOPs, which guarantees a fair comparison between the CNOPs and SVs. For the RPs approach, the initial perturbations are random. Compared with the orthogonal CNOPs and SVs, the computations of RPs save computational resources and time, but RPs do not have specific dynamical significances, i.e., they could be either growing initial perturbations or decaying initial perturbations. The RPs are produced using the following steps: (i) subtract the initial analysis field from the forecast field of the control forecast at 24 h to get the error field E; (ii) for the components u',v',T' and p' s in the error field E, compute their maximum a and minimum b at each σ level; (iii) generate random numbers that obey the uniform distribution and belong to [a,b], and then use them to create a random perturbation x0 with the components u',v',T' and p' s; (iv) scale the perturbation x0 so that it has the same magnitude as the orthogonal CNOPs. Using these steps, we get one RP. Repeating steps (iii) to (iv), we can get different RPs. BVs, as mentioned above, are also used to generate ensemble forecasts. The performance of BVs is compared with that of the orthogonal CNOPs. In a data assimilation cycle, random errors may evolve in fast-growing directions in the atmospheric flow. According to this rationale, BVs are proposed to simulate the initial perturbations with fast-growing directions by periodically rescaling the differences between a set of forecasts and the corresponding perturbation forecasts. In this study, the components of the BVs are the same as in the above methods, i.e., the horizontal wind, meridional wind, temperatures and surface pressure. The norm to measure the initial perturbations and scale the perturbations is the same as that used for computing orthogonal CNOPs. The computation of the BVs starts 24 h ahead of the start time of the ensemble forecast, and the rescaling period is 6 h. Specifically, we add the RP obtained as described in the last paragraph to the initial analysis field of the control forecast to get the perturbed initial field. Integrating the perturbed initial field for 6 h, we can get the perturbed forecast. Subtracting the control forecast from that of the perturbed forecast, we can get the error field. Second, we scale the error field so that it has the same magnitude as the orthogonal CNOPs. Then, we apply this scaled error field as the initial perturbation over the next 6-h integration. After four integrations, we can get the final scaled error field, i.e., the BV. Using different RPs, we can obtain different BVs that are used for ensemble forecasts.
-->
5.1. Reason for the lower forecast skills of the orthogonal CNOPs-based ensemble-mean forecasts at the lead time of 24 h
As stated in section 4, the orthogonal CNOPs-based ensemble-mean forecasts present lower forecast skills at the lead time of 24 h. In this section, we analyze the reason. The orthogonal CNOPs represent the initial perturbations that have the largest growth in their respective phase subspaces at the final point of the optimization time period (i.e., 24 h). Therefore, at the final point of the optimization period, the ensemble members generated by the orthogonal CNOPs should have the largest ensemble spreads. Indeed, we find that the ensemble members generated by the orthogonal CNOPs show ensemble spreads with maximum uncertainties that can reach 274.88 km, while the averaged track forecast errors of the control forecasts of the five TC cases at 24 h is only 125.54 km (see Fig. 6). It is obvious that the spread of the ensemble members generated by the orthogonal CNOPs at a lead time of 24 h overestimates the uncertainties of the control forecast, which causes the ensemble-mean forecasts at the lead time of 24 h to present forecast errors even larger than those of the control forecasts. But why do the ensemble members possess large spreads and overestimate the uncertainties of the control forecast at the lead time of 24 h? To address this question, we investigate the effects of the magnitude of the initial perturbations on the forecast skills of the ensemble-mean forecasts at the lead time of 24 h. Here, we choose the constraint conditions x0 TC1x0≤β with β=0.3× 4 J kg-1 and β=0.3× 9 J kg-1 to compute the orthogonal CNOPs for the optimization time of 24 h. Then, we compare the forecast skills of the orthogonal CNOPs-based ensemble-mean forecasts for these two constraint conditions. Figure 5b plots the ensemble-mean forecast error of the TC track when using β=0.3× 4 J kg-1 to constrain the initial perturbations for the ensemble forecasts based on the different methods. It is shown that the orthogonal CNOPs-based ensemble-mean forecast still tends to show much higher forecast skills than those of the other methods at longer lead times. However, when comparing the results between β=0.3× 4 J kg-1 and β=0.3× 9 J kg-1, we find that the former shows smaller forecast errors at the lead time of 24 h, increasing the forecast skill of the ensemble-mean forecast for the TC track with β=0.3× 9 J kg-1 during the early period, but decreasing it during the later period. This shows that it is the large magnitude of orthogonal CNOPs that plays negative roles in improving the forecast skill of the ensemble-mean forecast during the earlier periods of the forecast, which may interpret why the orthogonal CNOPs-based ensemble-mean forecasts show lower forecast skills at the lead time of 24 h. It is therefore inferred that the forecast skills of the orthogonal CNOPs-based ensemble-mean forecasts are related to the magnitude of the initial perturbations. Combining the results for β=0.3× 4 J kg-1 and β=0.3× 9 J kg-1, we would suggest that the orthogonal CNOPs-based ensemble-mean forecasts use small CNOP initial perturbations to generate the ensemble members for short-period forecasts, such as for less than three days; otherwise, they should adopt much larger CNOP initial perturbations. The exact magnitude of the CNOPs for ensemble forecasts remains to be explored in depth by future studies.
2 5.2. Forecast skills of the orthogonal CNOPs-based ensemble-mean forecasts for different TC cases -->
5.2. Forecast skills of the orthogonal CNOPs-based ensemble-mean forecasts for different TC cases
The above results are derived by evaluating the average forecast error of the five TC cases, and demonstrate that the orthogonal CNOPs are more favorable than the orthogonal SVs, RPs, and BVs for improving the ensemble forecast skills. Next, we investigate the forecast skills of the orthogonal CNOPs-based ensemble-mean forecasts for different TC cases. Figure 8 illustrates the evolution of the TC track forecast errors of the control forecasts and the ensemble-mean forecasts for each TC case, and Fig. 9a shows the means of the corresponding forecast errors of all the lead times (6 h, 12 h, …, 120 h) for each TC case. Specifically, for STY Matsa (2005), Super TY Sepat (2007) and TY Morakot (2009), the orthogonal CNOPs-based ensemble-mean forecasts improve their control forecast, and the improvement is much larger than those of the orthogonal SVs-, RPs-, and BVs-based ensemble-mean forecasts. For STS Fungwong (2014), although the orthogonal CNOPs-based ensemble-mean forecast has a skill slightly lower than that of the orthogonal BVs-based ensemble-mean forecast, the skill is higher than those of the orthogonal SVs- and RPs-based ensemble-mean forecasts. However, for STS Bilis (2006), all the orthogonal CNOPs-, SVs-, RPs-, and BVs-based ensemble-mean forecasts fail to improve the control forecast skill, and the orthogonal CNOPs-based ensemble-mean forecast has the lowest skill. Why, then, does the orthogonal CNOPs-based ensemble-mean forecast show the lowest skill for STS Bilis (2006)? Figure8. Time-dependent forecast errors of the typhoon tracks for the control forecast (black line) and the orthogonal CNOPs (red line)-, SVs (green line)-, BVs (blue line)-, and RPs (orange line)-based ensemble-mean forecasts, with β=0.3× 9 J kg-1, for the typhoon cases of (a) STY Matsa (2005), (b) STS Bilis (2006), (c) Super TY Sepat (2007), (d) TY Morakot (2009), and (e) STS Fungwong (2014).
One possible reason is related with the magnitude of the initial perturbations. Figure 9b shows the results of the experiment with β=0.3× 4 J kg-1. It is shown that the track error of the orthogonal CNOPs-based ensemble-mean forecast for STS Bilis (2006) is largely reduced when the magnitude of the initial perturbations is reduced to β=0.3× 4 J kg-1. Therefore, this result can be seen as evidence of the statement that the poor performance of the orthogonal CNOPs-based ensemble-mean forecast for STS Bilis (2006) is possibly due to the overly large initial perturbations. In fact, for a given reference state, the difference between the nonlinear evolution and the linear evolution of the initial perturbation increases with the magnitude of the initial perturbation, i.e., the initial perturbations of large magnitude evolve more nonlinearly than those of small magnitude. In the present study, for all the TC cases, the orthogonal CNOPs are calculated with the same magnitude. Therefore, the orthogonal CNOPs for STS Bilis (2006) could be too large and then overestimate the nonlinearities existing in the control forecasts. Note that the orthogonal CNOPs represent the fastest growing initial perturbations in their relevant subspaces and have much larger perturbation growths than those of the BVs and SVs. This encourages BVs and SVs to show much weaker nonlinear behaviors and be more likely to depict the nonlinear behavior of STS Bilis (2006), and to show higher skill in the ensemble-mean forecast for STS Bilis (2006) than the orthogonal CNOPs-based ensemble-mean forecasts. In addition, we notice that for STS Bilis (2006), when the magnitude of the initial perturbations is reduced to β=0.3× 4 J kg-1, the track errors of the orthogonal SVs- and RPs-based ensemble-mean forecasts change negligibly, but the track errors of the BVs- and CNOPs-based ensemble-mean forecasts are obviously reduced, with the latter reduction being more significant. This indicates that the sensitivity of ensemble forecasts (especially the CNOPs-based ensemble forecasts) to initial perturbation magnitudes also influences its skill. Therefore, an appropriate magnitude of initial perturbations helps achieve a much higher forecast skill for ensemble forecasts, which also sheds light on why the CNOPs-based ensemble forecasts show much lower forecast skill for STS Bilis (2006). Figure9. Mean forecast errors of the control forecast (black) and the orthogonal CNOPs-based (red), SVs-based (green), BVs-based (blue), and RPs-based (orange) ensemble-mean forecasts for the five typhoon cases and all lead times (6 h, 12 h, …, 120 h), and initial-perturbation magnitudes of (a) β=0.3× 9 J kg-1 and (b) β=0.3× 4 J kg-1.
Another possible reason is related with the model errors. We compare the values of the cost functions [as shown in Eq. (1)] corresponding to the first five CNOPs for the different TC cases (see Table 2). It is found that the values of the cost function of the CNOPs for STS Bilis (2006) are the smallest of those for the considered TC cases, despite the CNOPs having the same amplitude for different TC cases. This indicates that STS Bilis (2006) is the least sensitive to initial perturbations among our investigated TC cases. This implies that the forecast for STS Bilis (2006), compared with those of other TC cases, is greatly influenced by model errors. Despite the ensemble forecast members generated by the RPs, BVs, and SVs, compared with those generated by the orthogonal CNOPs, estimating more appropriately the nonlinear growth of the initial analysis errors, they cannot capture the effect of the model errors on the forecast for STS Bilis (2006). All these aspects may explain why all the above ensemble-mean forecasts fail to show high forecast skill for STS Bilis (2006). It is therefore inferred that the skill of the ensemble forecasts for STS Bilis (2006) may be greatly improved by considering ensemble forecasts associated with model errors.
2 5.3. Ensemble forecast skill for TC intensity -->
5.3. Ensemble forecast skill for TC intensity
In addition to the TC-track forecast, we also analyze the skills of the ensemble forecasts for TC intensity based on the different methods. Figure 10 illustrates the evolution of the minimum sea level pressure of the control forecasts and the ensemble-mean forecasts for each TC case. The results show that the TC intensities simulated by MM5 are often significantly underestimated when they are strong but overestimated when they are weak. This may be due to the model horizontal resolution in this work not being fine enough to describe the TC structure and intensity realistically, and MM5 has model errors such as inaccurate descriptions of physical processes. Notably, there are huge gaps between the observed and modeled initial intensity of STS Bilis (2006), Super TY Sepat (2007), and STS Fungwong (2014) in Fig. 10. In the present study, we use NCEP FNL data to generate the initial conditions. It has been revealed previously that these data possess large differences with observations of TC intensity for TC cases (Zhou et al., 2016). Thus, when using the FNL data to generate the initial conditions, the modeled initial intensity of the TCs will have obvious bias compared with observations. That is, the huge gaps between the observed and modeled initial intensity in the present study may be caused by the FNL data. (Zhou et al., 2016) showed that when the initial TC intensity error is sizeable, the TC-track forecast skill can be greatly increased by improving the geopotential height and wind fields in and around the TC center at the initial time (i.e., improving the model initial intensity of TCs). Therefore, we infer that the TC-track forecasts in the present study can be further improved if the initial intensity is better described by the model. However, MM5, together with FNL data, cannot estimate the TC intensities well. It is therefore expected that future work can improve the forecast skill of the TC intensity forecast and then further increase the skill of the TC-track forecasts. Figure10. Time-dependent minimum sea level pressure for the observation (black line with plus signs), control forecast (black line with solid circles), and the orthogonal CNOPs (red line with solid circles)-, SVs (green line with solid circles)-, BVs (blue line with solid circles)-, and RPs (orange line with solid circles)-based ensemble-mean forecasts, with β=0.3× 9 J kg-1, for the typhoon cases of (a) STY Matsa (2005), (b) STS Bilis (2006), (c) Super TY Sepat (2007), (d) TY Morakot (2009), and (e) STS Fungwong (2014).
As discussed above, the model horizontal resolution in this work is not suitable to discuss TC intensity. The results show that all the methods, including the orthogonal CNOPs-based method cannot effectively improve the forecast skill of TC intensity. In other words, the ensemble forecasts with only the initial perturbations in this work do not increase the forecast skill of TC intensity. This may be related to both the coarse model horizontal resolution used in this work and the model error. In fact, previous studies (Zhao et al., 2007; Zhao and Wang, 2008) have also shown that large differences exist between the sea level pressures forecasted by MM5 and those observed, indicating the role of model errors in forecasting the TC intensity. In addition, as TCs originate and absorb energy from the ocean and stay over the ocean during most of their lifetime, the ocean will influence the development of TCs considerably. Therefore, ocean-typhoon feedbacks are essential to the forecasting of TCs. However, MM5 does not sufficiently consider the effects of ocean-typhoon feedbacks and involves model errors. These model errors encourage us to consider the ensemble forecasts with multiple models or model perturbations. For the latter, the nonlinear forcing singular vectors (NFSVs) method has been proposed by (Duan and Zhou, 2013). NFSVs describe the model tendency errors that have the largest impact on the forecast results in nonlinear models (Duan and Zhou, 2013; Duan and Zhao, 2015). Therefore, when the model horizontal resolution is increased to be suitable for the simulation of TC intensity, model perturbations with NFSVs may improve the forecasting of TC intensity, and it is expected that ensemble forecasts with both orthogonal CNOPs and NFSVs can increase the ensemble forecast skill of not only TC track but also TC intensity.
-->
APPENDIX
The TC tracks are identified by the TC center locations, which are identified by the locations where the sea level pressures are minimal. The forecast error of the TC track is that of the TC center locations, which is determined by the great-circle distance between the two points on the Earth. Assume that F=(a f,y f) is the central location of the forecast TC and A=(a o,y o) is that of the observed TC, where a f and a o are the longitudes and y f and y o are the latitudes. Then, the forecast error of the TC track at some forecast time can be expressed as \begin{eqnarray} |F-A|&=&111.11\cos^{-1}[\sin y_{\rm o}\sin y_{\rm f}+\nonumber\\ &&\cos y_{\rm o}\cos y_{\rm f}\cos(a_{\rm o}-a_{\rm f})] . \ \ (A1)\end{eqnarray}
3 Ensemble spread -->
Ensemble spread
The ensemble spread is the RMSE of the ensemble forecast members with respect to the ensemble mean, i.e., $\delta=\sqrt{\frac{1}{N}\sum_{i=1}^{N}|F_i-\overline{F}|^2}$, where $\overline{F}=\frac{1}{N}\sum_{i=1}^{N}F_{i}$ is the ensemble mean, and $|F_i-\overline{F}|$ is the great-circle distance between ensemble member Fi and ensemble-mean $\overline{F}$. A good ensemble forecast system should have a suitable ensemble spread. If the ensemble spread is too small, one cannot effectively estimate the forecast uncertainty and it causes the true state to be located outside of the forecast ensemble, in turn causing a low forecast skill for the true state. If the ensemble spread is too large, additional errors are easily introduced, thus bringing about negative influences on the forecast results.
3 Improvement -->
Improvement
Improvement of the ensemble-mean forecast over the control forecast is described by s: \begin{equation} s=\frac{E_{\rm c}-E_{\rm e}}{E_{\rm c}}\times 100\% , \ \ (A2)\end{equation} where E c is the forecast error of the control forecast and E e is the forecast error of the ensemble-mean forecast. The ensemble-mean forecast improves the skill of the control forecast when s>0. Otherwise, the ensemble-mean forecast does not increase the skill of the control forecast. The larger the value of s, the higher the skill of the ensemble-mean forecast.