HTML
--> --> --> -->2.1. Multigrid NLS-4DVar method and covariance localization
The multigrid NLS-4DVar method described by Zhang and Tian (2018b) is used to obtain the analysis. The fundamental principle of multigrid NLS-4DVar is to sequentially minimize the 4DVar cost functions from the coarsest to the finest grid scales to obtain the analysis incrementAs an advanced 4DEnVar method, NLS-4DVar (Tian and Feng, 2015; Tian et al., 2018) assumes that the optimal analysis increment
where:
Where
According to Zhang and Tian (2018b), the cost function can generally reach the minimization convergence standard after three iterations. Because the multigrid technique can speed up the convergence and SNAP has three grid scales, the maximum iterations of each grid scale is
However, due to the limited number of ensembles
where
2
2.2. Initial ensemble generation and ensemble update
The initial ensemble perturbations are generated by the random state variable method (Tian and Zhang, 2019, step2 b and c in section 2.2; Zhang, 2019, appendix) and then added to the background to obtain the initial ensembles. The random state variable includes the singular value decomposition and the random orthogonal matrix (Evensen, 2007). In the real assimilation system, the state variables are usually composed of multiple state variables, such as the u/v wind components, perturbation potential temperature T, perturbation pressure P, and water vapor mixing ratio q. To reduce the calculation cost and programming difficulty, all state variables were determined individually. The cost of calculation and the difficulty of programming were reduced, and the differences in units and magnitude among variables were avoided, along with increasing ensemble spreads.SNAP uses the covariance relaxation of Zhang et al. (2009) to in?ate the background error covariance, which needs not only the prior perturbation, but also the posterior perturbation as follows:
In this paper,
2
2.3. Verification techniques
(1) Root-mean-square error (RMSE) and correlation coefficient (CC):where
(2) Precipitation threat score (TS) and equitable threat score (ETS):
where a is the number of correct hits, b is the number of false alarms, c is the number of misses, d is the number of occasions that both forecast and observations are under a specific threshold, and
(3) The relative percentage improvement (RPI, unit: %) for the RMSE is computed as follows:
If the
-->
3.1. Experimental setup
From 0000 UTC 8 June 2010 to 0000 UTC 9 June 2010, heavy precipitation occurred in South China, at a concentrated precipitation range and high intensity. The rain band was zonally distributed from the southwest to the northeast. The 24-h accumulated precipitation exceeded 100 mm.We used WRF-ARW version 3.7.1 as the numerical forecast model in the following numerical experiments. The domain covered the whole of China in the region (15.5°?43.5°N, 88.5°?131.5°E) with the central point of (30°N, 110°E). SNAP adopted three grid scales (coarsest, fine, and finest) to conduct the assimilation analysis and the model forecast was at the finest scale. The finest grid scale contained 120 × 100 (longitude × latitude) grid points in the horizontal direction, with 30-km grid spacing. The numbers of grid points in the coarsest and fine scales were 30 × 25 and 60 × 50, with horizontal resolutions of 120 km and 60 km, respectively. It is worth noting that the latitude and longitude ranges of the three grid scales were different, because the simulation domains of the three grid scales in these experiments were generated with the same center point (30°N, 110°E) and the map projection (Lambert), but the grid points and resolutions were different. In the vertical direction, we used 30 layers from η = 0 to η = 1. The top pressure of the model layer was 50 hPa. The main physical components of the WRF model included the rapid radiative transfer model for longwave radiation (Mlawer et al., 1997), the Dudhia shortwave radiation scheme (Dudhia, 1989), the Yonsei University planetary boundary layer scheme (Hong et al., 2006), the Purdue Lin explicit cloud microphysics parameterization (Lin et al., 1983; Rutledge and Hobbs, 1984; Chen and Sun, 2002), and the Noah land surface model land scheme (Chen and Dudhia, 2001). First-guess field and boundary conditions in the experiments were generated using NCEP final (FNL) operational global analysis data (
Two window cycling assimilation experiments were designed. The length of each assimilation window was six hours ([?3, 3]). The first assimilation window (named W1) was ranged from 2100 UTC 7 June 2010 to 0300 UTC 8 June 2010 and the second assimilation window (named W2) was ranged from 0300 UTC 8 June 2010 to 0900 UTC 8 June 2010. The analysis time was at the beginning of each assimilation window, at which time the optimal analysis is obtained by minimizing the cost function. In each assimilation window, observations were assimilated hourly; that is, each assimilation window contained seven observation bins, and the assimilated observations were reprocessed as hourly data batches, including data within
The conventional observations for assimilation were from the China Meteorological Administration (CMA) National Meteorological Information Center, and were used for China’s first-generation global atmospheric reanalysis product (CRA-40), which consist of surface and upper-air observations. Surface observations were available from ships, drifting buoys, land stations, and airports. In-situ measurements of the upper air were available from radiosonde, pilot balloon, aircraft, and wind profile data. Liao et al. (2018) describe the integrated conventional data sources, the quality control process, evaluation procedure and rejected observations, etc. Figure 2 shows the horizontal distribution of the assimilated observations after the GSI-based data processing (including read-in of observations, data thinning, data time and localization check, and gross error check) and observation operator module. Different colors represent the observations assimilated at different times. For these evaluation experiments, we focused on precipitation verification, using the hourly precipitation observations from more than 2400 national observation sites.
Figure2. Horizontal distribution of the assimilated observations in the first assimilation window. Different colors represent different observation times.
2
3.2. Experimental results
First, the experiments of the first assimilation window (W1) were used to comprehensively evaluate the correctness of SNAP. The precipitation forecast evaluation is described in section 3.2.1. The analysis of the improvements of the initial analysis field is discussed in section 3.2.2. The parameters of SNAP were determined by sensitivity experiments (section 3.2.3). Furthermore, the cycle assimilation performance of SNAP and the validity of the ensemble perturbation update scheme are illustrated through the experiments using the second assimilation window (section 3.2.4).3
3.2.1. Precipitation forecast skill
Figure 3 shows the 24-h accumulated precipitation from 0000 UTC 8 June 2010 to 0000 UTC 9 June 2010, which initializes from 2100 UTC 7 June 2010. Figure 3a shows the precipitation observations (OBS) obtained from the hourly accumulated precipitation of more than 2400 national observation stations. Figures 3b-d show the precipitation forecasts obtained by model integration initialized from CTRL and assimilation analyses of SNAP_S and SNAP, respectively. The precipitation intensity predicted by the model (Figs. 3b-d) was greater than the cumulative precipitation observations (Fig. 3a). Heavy precipitation of up to 100 mm mainly occurred in Anhui, southeast Hubei, and central Hunan (Fig. 3a). At the same time, there were different degrees of precipitation in northern Jiangxi, eastern and western Guangxi, and western Guangdong. There was a false heavy precipitation center at the junction of Anhui and Hubei, where the precipitation reached 140 mm (Fig. 3b). There was obvious false precipitation in central Jiangxi, and the precipitation center in Hunan was to the southeast. At the same time, the precipitation forecast in western Guangxi was markedly stronger. However, there was little precipitation forecasting capability in western Guangdong. Figures 3c and d show the precipitation forecast simulated by models of different initial fields, generated through three iterations at a single grid scale (SNAP_S, Fig. 3c) and three grid scales with only one iteration at each grid scale (SNAP, Fig. 3d) after assimilating conventional observations. Compared to CTRL (Fig. 3b), the assimilation of conventional observations of SNAP reduced the false precipitation at the junction of central Jiangxi, Anhui, and Hubei, as well as to the west of Guangxi, but it could not forecast the precipitation in western Guangdong. Comparing Figs. 3c and d, the cumulative precipitation distribution of SNAP was closer to reality (Fig. 3a), especially in Anhui, northern Jiangxi, and other areas, which to some extent showed the importance of the multigrid assimilation framework.Figure3. The 24-h accumulated precipitation from 0000 UTC 8 June 2010 to 0000 UTC 9 June 2010 (units: mm): precipitation observations (a) OBS; and precipitation forecasts (b) CTRL; (c) SNAP_S; (d) SNAP.
Table 1 presents the results of the quantitative analysis of the RMSE and CC of precipitation forecasts and observations in the rainy region. The RMSE of CTRL and precipitation observations was 21.07174. After assimilating conventional observations, the RMSE of SNAP_S and precipitation observations was 18.87847. The RMSE of SNAP and precipitation observations (18.47027) was even smaller than that of SNAP_S, mainly due to using the multigrid NLS-4DVar assimilation framework to improve the assimilation accuracy. At the same time, the CC (passing the t-test at the 99% confidence level) between SNAP and precipitation observations (0.702526) was larger than those between precipitation observations and CTRL (0.641511)/SNAP_S (0.686377), which further quantitatively indicated that the cumulative precipitation forecasts of SNAP were closer to the precipitation observations.
CTRL | SNAP_S | SNAP | |
RMSE | 21.07174 | 18.87847 | 18.47027 |
CC | 0.641511 | 0.686377 | 0.702526 |
Table1. RMSE and CC values of 24-h cumulative precipitation forecasts with different initial fields and observations.
Figure 4 shows the 24-h cumulative precipitation TS values predicted from different initial fields. For the forecast of light rain, the scores were almost the same, although SNAP_S was slightly better. For moderate rain and heavy rain, SNAP_S and SNAP were better than CTRL, and SNAP was better than SNAP_S. For rainstorms, CTRL was better than SNAP_S and SNAP, and SNAP_S was better than SNAP. There are two possible reasons for these results; one is the relatively coarse resolution of the experiments, and the other is that only conventional observations were assimilated, and they were sparse, representing a large scale. For torrential rainfall, the score was almost 0. It was not surprising that the assimilation of conventional observations led to a higher TS than CTRL. These results further demonstrate that the multigrid NLS-4DVar assimilation framework can further improve the initial field and precipitation forecast.
Figure4. The TS of 24-h cumulative precipitation classifications from 0000 UTC 8 June 2010 to 0000 UTC 9 June 2010.
Table 2 presents a comparison of the CPU times required for SNAP and SNAP_S to solve the optimal analysis field. The numerical experiments were conducted on the TH-1A system of the National Supercomputer Center in Tianjin, with 600 CPUs (50 nodes × 12 cores) and 5 TB of memory, and all assimilation calculations were serial on a single node single core. The total CPU time required by SNAP_S to obtain the optimal analysis field was 129.52 s, with 31 584 observations used for each iteration. The total CPU time of SNAP was 102.22 s (Table 2). Therefore, SNAP was more efficient than SNAP_S. This was because the observation operators of each grid scale were different in the multigrid assimilation framework and the longitudes and latitudes of the three grid scales were different (the finest grid scale covers the maximum domain, the fine grid scale comes next, and the coarsest grid scale is the minimum coverage). Consequently, the number of observations assimilated at each grid scale had a certain difference. In this experiment, 28 120, 30 338, and 31 584 assimilated observations were included, respectively, from the coarsest to the finest grid. In summary, using the multigrid assimilation framework SNAP can improve the assimilation accuracy using fewer observations and less computational cost (Table 2), while revising multiscale errors (Figs. 3 and 4, Table 1).
CPU time (s) | ||
SNAP_S | SNAP | |
$ {l}_{1} $/L1 | 43.04 | 27.27 |
$ {l}_{2} $/L2 | 42.98 | 32.02 |
$ {l}_{3} $/L3 | 43.30 | 42.93 |
Total CPU time | 129.32 | 102.22 |
Table2. CPU times required for SNAP and SNAP_S to solve the optimal analysis field, in which
3
3.2.2. Optimal initial analysis field
The improvement of precipitation forecasts is attributed to the assimilation of conventional observations by SNAP and SNAP_S to obtain the optimal initial field. Thus, from the perspective of the initial field increment, the reasons for the improvement of precipitation forecasts were analyzed. Figure 5 shows the analysis increment of water vapor mixing ratio (SNAP-CTRL and SNAP_S-CTRL) at the analysis time of the 12th layer of the model (850 hPa). The analysis increments of water vapor mixing ratio in central Jiangxi, north of central Hunan, and northeast Anhui were negative, and they were revised to different degrees by SNAP and SNAP_S (Figs. 5a and b), which was consistent with the decreases in false precipitation in central Jiangxi, Anhui, Hubei, and central Hunan of SNAP_S and SNAP compared to CTRL (Figs. 3b-d). Figure 6 shows the vertical distribution of the water vapor mixing ratio analysis increment (SNAP-CTRL and SNAP_S-CTRL) along 28°N. In the vertical direction, the analysis increments of the water vapor mixing ratio within the region 110?118°E of SNAP_S and SNAP were negative, especially below 400 hPa (Fig. 6). This is consistent with SNAP_S and SNAP weakening false precipitation in central Jiangxi and central Hunan (Fig. 3). By comparing the precipitation forecasts in Fig. 3 and the analyses increment fields in Figs. 5 and 6, it could be seen that central Jiangxi, Hunan, and the junction of Anhui and Hubei in the central region of the precipitation forecast and analysis increment field had a good corresponding relationship, and the SNAP_S and SNAP assimilation systems could absorb well the observation information, improving the structure of the initial field, thereby improving the precipitation forecast.Figure5. Analysis increment of the water vapor mixing ratio (units: g kg?1) at the 12th layer of the model (850 hPa): (a) SNAP_S-CTRL; (b) SNAP-CTRL.
Figure6. Vertical distribution of the analysis increment of the water vapor mixing ratio (units: g kg?1) along 28°N: (a) SNAP_S-CTRL; (b) SNAP-CTRL.
3
3.2.3. Sensitivity to the system parameters
Next, we conducted sensitivity experiments for the horizontal localization radius and the number of truncated modes selected in SNAP, based on the RMSE, CC and TS of 24-h precipitation forecasts and the CPU time required for assimilation calculations [Fig. S1, and Tables S3 in Electronic Supplementary Material (ESM) and Table 3]. When the localization radius was 2100 km, the RMSE was smaller and the CC was larger (Fig. S1). At the same time, the TS showed that for light rain, moderate rain, and heavy rain, the local precipitation forecast with a radius of 2100 km had an absolute advantage. In fact, when the localization radius is about 1000 km, the distribution and intensity of precipitation has been significantly improved (not shown). However, by comparing all the indexes of assimilation accuracy, we think that 2100 km is the best localization radius in these experiments. For rainstorms and torrential rainfall, the TS of CTRL was higher. For the selected number of optimal truncation modes, this section focuses on the assimilation accuracy and calculation efficiency, as shown in Table 3. When the cumulative variance was greater than 90%, the assimilation accuracy was significantly improved (Table 3). In terms of statistical error, when the cumulative variance was 95%, there was a smaller RMSE and a larger CC (passing the t-test at the 99% confidence level). For precipitation, the TS of a precipitation forecast with a cumulative variance of 99% was better than that for 95%, except for light rain. However, with the increase of the truncated mode number (cumulative variance), the CPU time for the assimilation calculation also increased. Therefore, considering the assimilation accuracy and calculation efficiency, we chose the optimal truncated mode number with a cumulative variance of 95%; namely,CTRL | Cumulative variances | |||
90% (${r}_{x}=7,\,{r}_{y}=6$) | 95% (${r}_{x}=9,\,{r}_{y}=7$) | 99% (${r}_{x}=11,\,{r}_{y}=9$) | ||
RMSE | 21.07174 | 19.06320 | 18.87847 | 19.09410 |
CC | 0.641511 | 0.681729 | 0.686377 | 0.682230 |
Threshold=$ 0.1 $ (mm) | 0.7957 | 0.8030 | 0.8039 | 0.8019 |
Threshold=$ 10.0 $ (mm) | 0.6945 | 0.7114 | 0.7076 | 0.7095 |
Threshold=$ 25.0 $ (mm) | 0.5647 | 0.5843 | 0.5856 | 0.5963 |
Threshold=$ 50.0 $ (mm) | 0.3922 | 0.3315 | 0.3279 | 0.3405 |
Threshold=$ 100.0 $ (mm) | 0.05 | 0.0 | 0.0 | 0.0 |
Time (s) | ? | 38.99 | 43.04 | 51.09 |
Table3. RMSE and CC values of 24-h precipitation observations and forecasts, and TSs of 24-h cumulative precipitation classifications with different cumulative variances (truncated modes) and CTRL. CPU times required for SNAP to solve the optimal analysis with different cumulative variances are also shown.
3
3.2.4. Results of the cycle system
The two-window cyclic assimilation experiments used to evaluate SNAP were designed by continuous assimilation of observations (total of 12 hours), and the optimal analysis field was obtained at the start of the second window (0300 UTC 9 June 2010). To verify the cyclic assimilation performance of SNAP, the 12-h cumulative precipitation results were selected for evaluation in this section. Figure 7 shows the 12-h cumulative precipitation distribution from 0300 to 1500 on 9 June 2010. SNAP and SNAP_S improved the precipitation forecast through the assimilation of conventional observations, which was closer to observations (Figs. 7a, c and d). Table 4 shows the RMSE and CC of 12-h cumulative precipitation forecasts of different initial fields (CTRL, SNAP_S, and SNAP). The RMSE was lower for SNAP_S and SNAP than for CTRL, while CC was greater than CTRL. In addition, SNAP was better than SNAP_S. Furthermore, the TS of the precipitation forecast was better than that of CTRL except for torrential rainfall (Fig. 8). SNAP_S and SNAP were almost the same for the precipitation forecast of light rainfall, moderate rainfall, and rainstorms. SNAP was better than SNAP_S at forecasting heavy rainfall. The above results all demonstrate the cyclic assimilation capacity of SNAP and the effectiveness of the ensemble perturbation updating scheme used for the second assimilation window.CTRL | SNAP_S | SNAP | |
RMSE | 8.831729 | 8.529635 | 8.470109 |
CC | 0.7460064 | 0.7666475 | 0.7688572 |
Table4. RMSE and CC values of 12-h cumulative precipitation observations and forecasts for different initial fields.
Figure7. The 12-h accumulated precipitation forecast from 0300 UTC 9 June 2010 to 1500 UTC 9 June 2010 (unit: mm): precipitation observations (a) OBS; and precipitation forecast (b) CTRL; (c) SNAP_S; (d) SNAP.
Figure8. The TS of 12-h cumulative precipitation classifications from 0300 UTC 9 June 2010 to 1500 UTC 9 June 2010.
-->
4.1. Experimental setup
The one-week (16?23 July 2016) evaluation experiments were designed with continuous six-hourly assimilation cycles throughout this period, which started at 0300 UTC 16 July 2016 and ended at 0300 UTC 23 July 2016. This period included an extreme rainstorm in North China (35°?43°N, 113°?122°E) that occurred between 18 and 21 July 2016 (Fig. 9). There were two heavy rainfall centers in North China. The first one was located in the Taihang Mountains and occurred as a consequence of convective precipitation. The second one was located in south-central Beijing and occurred as a consequence of stratiform precipitation. A 30-h forecast was generated, initialed from the six-hourly cycled multigrid NLS-4DVar assimilation analyses. Parallel experiments using the GSI 4DEnVar system were also run to enable comparison with the GSI 4DEnVar scheme. It should be noted that there were many differences between SNAP and GSI including the analysis time and variables. The SNAP/GSI analysis time was at the beginning/middle of the assimilation window, respectively. Therefore, a 27-h forecast was generated, initialed from the six-hourly cycled GSI 4DEnVar assimilation analyses assimilating the same observations as in SNAP. The SNAP analysis variables were model variables, and the GSI analysis variables were control variables. The horizontal localization radius of SNAP was 300 km. Both the experiments used seven time levels of each assimilation window (as in section 3.1). Sixty ensemble members were employed. Only the ensemble-based background error covariance was used in both SNAP and GSI. The total number of iterations solved by GSI was 100, including 2 outer loops and 50 inner loops. First-guess field and boundary conditions were generated using ECMWF ERA-Interim global analysis data (Figure9. The accumulated precipitation observations from 0000 UTC 18 July 2016 to 0000 UTC 22 July 2016 (unit: mm).
The conventional observational data for assimilation in these evaluation experiments were GDAS PrepBUFR data, including the surface observations (land-reporting stations, ships, buoys, etc.) and the upper-air observations (radiosondes, aircrafts, wind profilers, etc.). The observations were treated in accordance with the time levels of the background and ensembles. The forecasts were verified against the conventional observations from the CMA National Meteorological Information Center used for China’s first-generation global atmospheric reanalysis product (CRA-40) after the GSI-based data-processing and observation operator module, which converts relative humidity to humidity. Precipitation verification used hourly precipitation observations from 2380 national observation stations.
2
4.2. Experimental results
Figure 10 shows the one-week and domain-averaged RMSEs at different forecast hours out of the assimilation window, verified against all the conventional observations for the u/v wind components, temperature, and humidity. It can be seen that the averaged RMSEs of SNAP were slightly lower than those of GSI at most forecast hours, especially for u wind and temperature. And for v wind and humidity, the forecast improvements were evident. This may be due to the multigrid NLS-4DVar being able to correct multiscale errors to improve the initial field and forecast.Figure10. The one-week and domain-averaged RMSEs at different forecast hours out of the assimilation window from SNAP and GSI, verified against all conventional observations for the (a) u and (b) v wind components, (c) temperature, and (d) humidity. The horizontal axis shows the forecast hour.
Figure11. Vertical profiles of the 6-h averaged RMSEs of the SNAP and GSI forecasts’ fit to conventional observations for the (a) u and (b) v wind components, (c) temperature and (d) humidity for the testing period.
Figures 11 and 12 show the vertical profiles of 6-h and 24-h forecast averaged RMSEs, verified against all conventional observations for the u/v wind components, temperature, and humidity. It should be noted that the statistical values of 1000 hPa include the results for cases with pressure greater than 1000 hPa. As can be seen from Fig. 11, for the u/v wind and temperature, SNAP and GSI had their own advantages in different pressure levels. According to Figs. 10 and 11, the 6-h forecast averaged RMSEs of SNAP were slightly lower than those of GSI for u/v wind. The 6-h forecast averaged RMSEs of SNAP were also lower than those of GSI for the humidity variable at most pressure layers, suggesting a better analysis of all layer structures (Fig. 11 and Table 5). Except for the higher RMSEs at the upper level for u wind, and at lower middle levels (700 hPa) for humidity, the performance of SNAP was superior to that of GSI throughout the 24-h forecast (Fig. 12 and Table 5). For temperature, SNAP was better at the upper pressure levels, suggesting that the SNAP forecast was generally a better fit to the observations than the GSI forecast.
Pressure (hPa) | RPIRMSE | ||||||||||
u (%) | v (%) | T (%) | q (%) | ||||||||
6-h | 24-h | 6-h | 24-h | 6-h | 24-h | 6-h | 24-h | ||||
50 | 20.81 | ?6.26 | ?0.85 | 0.07 | ?0.82 | ?5.44 | ? | ? | |||
100 | ?0.29 | ?0.82 | 9.29 | ?1.24 | ?0.9 | 0.37 | ? | ? | |||
200 | ?4.26 | ?0.23 | 4.46 | 2.89 | ?0.52 | 2.91 | ? | ? | |||
300 | 0.37 | 2.61 | 3.13 | 2.81 | ?3.99 | 3.29 | 3.36 | 0.35 | |||
400 | 0.56 | ?1.06 | 4.29 | ?4.51 | ?0.94 | 5.33 | ?0.72 | ?1.38 | |||
500 | 0.75 | 1.41 | ?1.447 | 0.96 | ?2.35 | 2.34 | 4.92 | 2.75 | |||
600 | ?7.35 | 1.51 | 3.31 | ?0.06 | ?1.42 | 0.54 | 2.67 | 4.34 | |||
700 | ?3.27 | 2.82 | ?2.27 | 1.93 | 1.24 | ?1.38 | 5.56 | ?11.95 | |||
800 | 4.16 | 2.91 | ?3.68 | 2.85 | 2.32 | ?1.19 | 1.93 | 0.01 | |||
900 | ?0.19 | 1.47 | ?4.09 | 0.68 | ?0.04 | ?0.54 | ?0.01 | 0.56 | |||
1000 | 1.06 | 0.96 | ?3.64 | ?1.04 | ?0.17 | ?1.28 | ?0.15 | 1.41 |
Table5. The RPI of the RMSE for 6-h and 24-h forecasts over all forecast cycles throughout the experimental period.
Figure12. As in Fig. 11 but for the 24-h forecast averaged RMSEs.
To quantify the improvement of SNAP over GSI, the RPI for RMSE was computed (Table 5). It can be seen from Table 5 that SNAP produced slightly lower forecast RMSEs than GSI 4DEnVar as a whole in the prediction verification of u/v wind, temperature and humidity (Figs. 10-12). The 6-h forecast averaged RMSE of u wind was improved by 20.81% at 50 hPa, which represents the largest improvement among all variables and the 24-h RPI at above 400 hPa was positive, which means that SNAP has a good forecast of u wind in the middle and lower layers. For the humidity, except for the 700- and 400-hPa levels, the values of the 24-h RPI were positive. For the v wind and temperature, SNAP and GSI have their own advantages in different pressure layers.
Figure 13 shows the 12-h accumulated precipitation for a case of extreme precipitation from 1800 UTC 19 to 0600 UTC 20 July 2016 in North China. Figure 13a shows the precipitation observations (OBS) obtained from hourly precipitation observations of 2380 national observation stations; the amount of 12-h accumulated precipitation exceeded 140 mm. Figures 13b and c show the 12-h precipitation forecasts of SNAP and GSI, respectively. It can be seen from Fig. 13 that the precipitation forecast intensity (Figs. 13b and c) was weaker than the observed precipitation (Fig. 13a). Heavy rainfall mainly occurred in the Taihang Mountains, the south-central part of Beijing, and Tianjin. SNAP was better than GSI for predicting the location of precipitation. Furthermore, the RMSEs and spatial CCs between the observations and precipitation forecasts of SNAP/GSI were 30.20/30.39 and 0.82/0.81 respectively, which quantitatively showed that the performance of SNAP was superior to GSI. Figure 14 shows the 12-h accumulated precipitation classification ETS values for thresholds of 5, 15, 30, 70 and 100 mm. It can be seen that, except for the threshold of 70 mm and 100 mm, SNAP outperformed GSI for the other thresholds shown.
Figure13. The 12-h accumulated precipitation forecast from 1800 UTC 19 to 0600 UTC 20 July 2016 (unit: mm): observations (a) OBS; forecasts (b) SNAP and (c) GSI.
Figure14. The ETS of 12-h cumulative precipitation classifications from 1800 UTC 19 to 0600 UTC 20 July 2016.
Ensemble members are very important for the ensemble-based data assimilation methods, which use the linear combination of ensemble perturbations to express the analysis increment. Therefore, the generation and updating strategy of ensemble perturbations are of great importance. In this part, the time period from 0300 UTC 19 to 1500 UTC 20 July 2016, characterized by heavy rainfall events, was selected by the ensemble spread test, which had six assimilation windows. Figure 15 shows time series of ensemble spread during the test period for the u/v horizontal wind components, perturbation potential temperature T, and water vapor mixing ratio q state variables. It can be seen that the ensemble spread did not decrease with the increase in forecast time, and showed a cyclic characteristic in each assimilation window. For the u and q variables, the ensemble spread in an assimilation window was reduced. However, for the v and T variables, the ensemble spread was first smaller, and then larger in each assimilation window, which may be due to the nonlinearity of the numerical model. The assimilation results showed that the generation and update schemes of ensemble perturbations adopted in this study were effective.
Figure15. Time series of the ensemble spread during six cycle assimilation windows from 0300 UTC 19 to 1500 UTC 20 July 2016, for U: u wind, V: v wind, T: perturbation potential temperature, and Q: water vapor mixing ratio state variables of cases of heavy rainfall.