HTML
--> --> -->Weakening, distortion, and displacement of the stratospheric polar vortex during major SSWs project onto a negative stratospheric annular mode, which propagates downward gradually in the following month(s) after onset of SSWs (Baldwin and Dunkerton, 1999; Baldwin et al., 2003; Cai and Ren, 2007; Sigmond et al., 2013). Therefore, stratospheric disturbance associated with SSWs is strongly coupled with the troposphere and serves as a potential source for tropospheric variability and predictability on the subseasonal time scale (e.g., Karpechko et al., 2018; Rao et al., 2018; Domeisen et al., 2020; Taguchi, 2020). For example, tropospheric and near-surface predictability is enhanced following SSWs (Sigmond et al., 2013; Tripathi et al., 2015, 2016). On average, a cold Eurasian continent–warm North American continent pattern is observed before SSWs at 850 hPa, while the two continents are anomalously cold after SSWs (Cao et al., 2019; Liu et al., 2019).
Based on the morphology of the stratospheric polar vortex, SSWs are classified into vortex displacement and vortex split events (Charlton and Polvani, 2007; Seviour et al., 2013; Liu et al., 2019; Rao et al., 2019). Early studies reported that the surface impact of displacement and split SSWs is similar (Charlton and Polvani, 2007; Mitchell et al., 2013), while other recent studies emphasize their differences (Nakagawa and Yamazaki, 2006; Seviour et al., 2016). Rao et al. (2020a) attribute the different impacts of displacement and split SSWs to their intensities, because on average the composite of displacement events is weaker than split events, although the methods and sample sizes might also cause a debate on whether impacts of the two SSW types are significantly different (Seviour et al., 2013, 2016; O’Callaghan et al., 2014).
Due to their important role in the climate system, a successful simulation of SSWs acts as an indispensable requisite when we score a model. For example, some models from phase 5 of the Coupled Model Intercomparison Project (CMIP5) can simulate several aspects of SSWs to different degrees of success based on single-model assessments [e.g., HadGEM2 in Osprey et al. (2013); CESM1-WACCM in Cao et al. (2019)] and multimodel studies [e.g., 21 models in Charlton-Perez et al. (2013); 13 high-top models in Seviour et al. (2016)]. Especially, Charlton-Perez et al. (2013) suggest low-top models underestimate stratospheric variability on interannual and daily time scales. Osprey et al. (2013) compared the SSW frequency in the high-top and low-top configuration of their model and found a better reproduction of the SSW frequency in the high-top version than the low-top version. A suitable vertical resolution in the stratosphere is also necessary for models to capably simulate the stratospheric processes and stratosphere–troposphere coupling (Charlton-Perez et al., 2013; Osprey et al., 2013), although the high horizontal resolution is less important than the nice vertical resolution for models to simulate SSWs and the quasi-biennial oscillation (QBO) (Rao et al., 2020b, c).
Using a loose definition of SSWs and three criteria based on the leading mode of the extratropical zonal winds, Rao et al. (2015) found the CMIP5 multimodel ensemble, including four Chinese models (BCC-CSM1-1, BCC-CSM1-1-m, FGOALS-g2, and FGOALS-s2), underestimates the frequency of weak stratospheric polar vortex events. Such a bias is not exclusive to CMIP5 models, with it being also found in other models (Charlton et al., 2007; Mitchell et al., 2012; Ayarzagüena et al., 2013). However, we still know little about the performance of CMIP6 models in simulating SSWs. Recently, different CMIP6 modeling groups released their Diagnostic, Evaluation and Characterization of Klima (DECK) experiments (Kclima in Greek means “Climate”). One of the DECK experiments is a historical Atmospheric Model Intercomparison Project (AMIP) simulation from 1979–2014 (the other three are piControl, 4×CO2, and 1ptCO2) (Eyring et al., 2016). Our interest is not to include all of the CMIP6 models but to focus on four Chinese CMIP6 models that have been widely used in operations and/or some research projects in China (Zhou et al., 2020).
By using a strict WMO definition of SSWs and an available DECK experiment, this paper assesses the general performance of the four Chinese CMIP6 models in simulating SSWs, including their frequency, evolution, types, downward propagation, and surface impact. The paper is constructed as follows. Following the introduction, section 2 describes the models, experiments, and datasets. The SSW frequency and its seasonal distribution are compared in section 3. Evolutions and downward propagation of the stratospheric signals associated with SSWs follow in section 4. The tropospheric and near-surface responses to SSWs are shown in section 5. Finally, the main findings are summarized and discussed in section 6. It is expected that our assessments can help the four modeling groups locate the main biases of their models in the stratosphere, and thereby continue to improve these models in the future.
2.1. Models, experiments and datasets
Table 1 lists the four CMIP6 models with daily outputs available for AMIP experiments. The four models are BCC-CSM2-MR, FGOALS-f3-L, FGOALS-g3, and NESM3, with their full name extensions and affiliations listed in the second column of Table 1. BCC-CSM2-MR is developed by the National Climate Center, China Meteorological Administration, and has a moderate horizontal resolution (T106, i.e., 320 × 160 grids, longitude × latitude). FGOALS-f3-L is developed by the State Key Laboratory of Numerical Modeling for Atmospheric Sciences and Geophysical Fluid Dynamics (LASG), Institute of Atmospheric Physics, Chinese Academy of Sciences, and has a moderate (although “L” denotes “low resolution”) horizontal resolution (i.e., C96, i.e., 382 × 194 grids, longitude × latitude). FGOALS-g3 is also developed by LASG, but the atmospheric component is different and has a low horizontal resolution (i.e., 180 × 80 grids, longitude × latitude). NESM3 is developed by the Earth System Modeling Center, Nanjing University of Information Science and Technology, and has a low horizontal resolution (i.e., T63, 190 × 95 grids, longitude × latitude). For full details, readers are directed to the model descriptions (Cao et al., 2018; He et al., 2019; Wu et al., 2019; Li et al., 2020). All models have a model top around 1–2 hPa, incorporating the mid-to-lower stratosphere, where SSWs happen. In contrast, BCC-CSM2-MR and NESM3 (46 and 47 levels in total; 18 and 19 levels around 100–10 hPa) have a nicer vertical resolution than FGOALS-f3-L and FGOALS-g3 (32 and 26 levels in total; 8 and 7 levels around 100–10 hPa).Model | Full name (and affiliation) | Ensemble members | Resolution (and model top/levels around 100–10 hPa) | Total SSWs (and D/S) | Reference |
BCC-CSM2-MR | Beijing Climate Center, Climate System Model version two, Medium Resolution (National Climate Center, China Meteorological Administration) | 3 | T106L46 (1.459 hPa / 18) | 9 + 13 + 8 (17/13 or 1.31) | Wu et al., 2019 |
FGOALS-f3-L | Flexible Global Ocean–Atmosphere–Land System model, Finite-volume version 3, Low Resolution (State Key Laboratory of Numerical Modeling for Atmospheric Sciences and Geophysical Fluid Dynamics, Institute of Atmospheric Physics, Chinese Academy of Sciences) | 3 | C96L32 (2.16 hPa / 8) | 12 + 12 + 7 (11/20 or 0.55) | He et al., 2019 |
FGOALS-g3 | Flexible Global Ocean–Atmosphere–Land System model, Grid-point version 3 (State Key Laboratory of Numerical Modeling for Atmospheric Sciences and Geophysical Fluid Dynamics, Institute of Atmospheric Physics, Chinese Academy of Sciences) | 5 | 180×80L26 (2.194 hPa / 7) | 7 + 12 + 6 + 12 + 10 (19/28 or 0.68) | Li et al., 2020 |
NESM3 | Nanjing University of Information Science and Technology Earth System Model version 3 (Earth System Modeling Center, Nanjing University of Information Science and Technology) | 5 | T63L47 (1 hPa / 19) | 43 + 31 + 40 + 39 + 39 (116/76 or 1.53) | Cao et al., 2018 |
Table1. The four Chinese CMIP6 models used in this study. One of the DECK experiments, AMIP, is commonly available for the four models. The size of the AMIP runs for each model is listed in the third column, and all ensemble members are analyzed in the composite. D/S in the fifth column represents the ratio of the vortex displacement and split SSWs. The CMIP6 AMIP experiments start from 1979 and end in 2014.
Because daily data from AMIP experiments were available for all of the four models at the beginning of this study (October 2019), we use the AMIP outputs. BCC-CSM2-MR and FGOALS-f3-L have three ensemble members, while FGOALS-g3 and NESM3 have five ensemble members (see the third column of Table 1). All the AMIP experiments are forced by the same external forcings, but the initial fields are different. All the ensemble members from the four Chinese CMIP6 models are used in our paper. Considering that the CMIP6 AMIP runs are from 1979–2014, the extracted Japanese 55-year Reanalysis (JRA-55) from 1979–2014 (JRA-55; Kobayashi et al., 2015) is used as a baseline for model evaluations. The SSW events from different reanalyses show little difference, especially during the satellite era since 1979 (Rao et al., 2015; Butler et al., 2017), so only the JRA-55 reanalysis is shown. Variables used in our paper include zonal and meridional winds, heights, and temperatures at pressure levels. Because NESM3 does not provide daily heights, we also calculate Ertel’s potential vorticity (PV) as a substitute for height in the stratosphere.
2
2.2. Methods
There are many SSW definitions in the literature (Butler et al., 2015), which is not the focus of this study. Because the WMO definition is one of the most popular algorithms in the literature and considering that our results can be easily compared with earlier studies (Charlton et al., 2007; Butchart et al., 2011; Charlton-Perez et al., 2013; Hu et al., 2014; Manzini et al., 2014; Rao et al., 2018, 2020a), we still use this WMO SSW identification algorithm. According to the WMO SSW definition, the major SSW onset time is the first day when zonal-mean zonal winds at 10 hPa and 60°N reverse from westerlies to easterlies (Charlton and Polvani, 2007). The eddy heat flux (
A vortex-centric diagnostic procedure developed by Seviour et al. (2013) is used to classify the SSW type. This method is established based on the geometry of the stratospheric polar vortex using the geopotential height or PV at 10 hPa. Two-dimensional vortex moments day by day are calculated in the procedure. Two parameters are required, including the centroid and aspect ratio of the stratospheric polar vortex represented by an equivalent ellipse (Mitchell et al., 2011; Seviour et al., 2016). Time series of the centroid and aspect ratio of the stratospheric polar vortex are calculated using a two-dimensional moment equation. The absolute and relative vortex moments (denoted by Mab and Jab) of the modified PV (or height) field are extracted in the Cartesian coordinate. The latitude of the vortex centroid and the aspect ratio of polar vortex during each SSW event are saved using two-dimensional moment diagnostics and geopotential heights (or PVs) on isobaric levels (Matthewman et al., 2009). Note that the results from geopotential height and PV are highly correlated (Seviour et al., 2013, 2016).
Following Seviour et al. (2013, 2016), an SSW is classified into the vortex split group if the aspect ratio of the vortex is above 2.4 for at least seven days. An SSW is classified into the vortex displacement group if the centroid of the vortex is situated equatorward of 66°N for at least seven days. This threshold-based method has been confirmed to present a similar classification of split and displaced vortices as conventional methods (e.g., Charlton and Polvani, 2007; Mitchell et al., 2011). To show the feasibility of the threshold-based method, examples of vortex displacement and split SSWs are provided in Fig. 1 from JRA-55 and four CMIP6 models. Obviously, for displacement SSWs, the vortex is far biased from the North Pole, resembling a comma-like shape (Figs. 1a–e). In contrast, for split SSWs, the vortex breaks into two comparable pieces in models, as observed in the selected sample from the reanalysis (Figs. 1f–1j). Although the PV (value range: 30–50 PVU, ?PV is drawn for an easy comparison with other models) is diagnosed for the vortex parameters in NESM3, the displacement and split are also clearly present as in other models.

SSW date | SSW type |
22 Feb 1979 | D |
29 Feb 1980 | D |
6 Feb 1981 | D |
4 Dec 1981 | D |
1 Jan 1985 | S |
23 Jan 1987 | D |
8 Dec 1987 | S |
14 Mar 1988 | S |
21 Feb 1989 | S |
15 Dec 1998 | D |
26 Feb 1999 | S |
20 Mar 2000 | D |
11 Feb 2001 | S |
31 Dec 2001 | D |
18 Jan 2003 | S |
5 Jan 2004 | D |
21 Jan 2006 | D |
24 Feb 2007 | D |
22 Feb 2008 | D |
24 Jan 2009 | S |
9 Feb 2010 | S |
24 Mar 2010 | D |
7 Jan 2013 | S |
Table2. Onset dates of SSW events and the corresponding type of the stratospheric polar vortex (D indicates a vortex displacement and S indicates a vortex split) in the JRA-55 reanalysis (1979–2014). The ratio of the vortex displacement and split SSWs is 1.3 (13/10) in JRA-55 during 1979–2014.

Seasonal distributions of vortex displacement and vortex split SSWs from November–March are shown in Fig. 3. As seen in Fig. 3a, vortex displacement SSWs are nearly uniformly distributed in December–February, followed by March. This peak in February is successfully simulated in NESM3, although SSWs occur much more frequently in this model than in JRA-55. Consistent with the distribution of SSWs in Fig. 2, all the other three models simulate much fewer displacement SSWs, and SSWs are drifted to late winter (February and/or March).

A stronger seasonality of split SSWs than displacement SSWs is observed for JRA-55, comparing the unfilled bars in Figs. 3a and b. More split SSWs appear in midwinter (January–February) in observations, and far fewer are observed in other wintertime months. Such a seasonality of SSWs observed in JRA-55 is drifted one month later to February–March for most models except BCC-CSM2-MR. Such a climate drift can be tracked to the seasonal evolution of the stratospheric polar vortex, which tends to get strongest in February (January) in models (reanalyses) [Fig. 5 in Rao et al. (2015)]. Compared with the three other models, BCC-CSM2-MR is the only one of the four Chinese CMIP6 models that simulates a stratospheric QBO (Rao et al., 2020b, c), which might also affect SSWs.

In addition to their contrasting seasonal distributions for both types of SSWs in JRA-55, the difference can also be identified for their intensities. We use the warming anomalies in the stratospheric polar cap to denote the intensity of SSWs. The composite strength of SSWs in each month for each type is shown in Fig. 4. To reverse the polar night jet that usually reaches climatological maxima in midwinter (Rao et al., 2015), the polar vortex anomalies are expected to be stronger for midwinter SSWs than events in November and March. This expectation is observed in JRA-55 (< 15 K in November and March versus > 20 K in midwinter) and simulated in almost all models for both displacement and split SSWs. Although the SSW frequency is not satisfactorily simulated by most models, the contrast in strength between displacement and split is simulated by models to different degrees of success. Specifically, on average, the strength of split SSWs is larger than displacement SSWs in JRA-55, which is simulated in some models (especially in BCC-CSM2-MR and NESM3).

The stronger stratospheric anomalies for split SSWs are simulated in three models (i.e., BCC-CSM2-MR, FGOALS-f3-L, and NESM3), consistent with the temperature anomalies in Fig. 4. It is easy to conclude that the split SSWs have a stronger impact on the troposphere than displacement SSWs, but Rao et al. (2020a) argue that the SSW strength is more important than the vortex morphology in inducing a low-level negative NAM response, which is beyond the scope of this study. It is also noticed that the composite intensity of displacement SSWs from FGOALS-g3 is stronger than split SSWs (maximum easterly anomaly magnitude: 20 versus 25 m s?1; Figs. 5d, i and n). Although the composite difference between displacement and split SSWs is not significant most of the time after the SSW onset, the stronger easterlies for split SSWs are consistently simulated in the other three models (maximum easterly anomaly magnitude for displacement and split SSWs: 30 versus 35 m s?1 for BCC-CSM2-MR, 15 versus 20 m s?1 for FGOALS-f3-L, and 10 versus 15 m s?1 for NESM3) as observed. The near-surface response due to the downward propagation of easterly anomalies is also simulated.
The evolutions of the polar cap temperature anomalies during SSWs are also compared for both SSW types in JRA-55 and the models (not shown). The temperature anomalies are observed to be larger for split SSWs than displacement SSWs in JRA-55 (maximum positive anomalies: ~8 versus ~10 K) and simulated to be so in BCC-CSM2-MR (~18 versus ~22 K), FGAOLS-f3-L (~8 versus ~10 K), and NESM3 (~6 versus ~7 K). Warm anomalies can propagate downward to the upper troposphere, but easterly anomalies can reach the near surface following onset of SSWs.
The stronger downward propagation and strength for split SSWs can be tracked to the stronger wave activities in the (upper) troposphere. As the eddy heat flux is proportional to the vertical component of EP flux, evolutions of eddy heat flux anomalies at 100 hPa in the 45°–75°N latitude band are shown in Fig. 6 for displacement and split SSWs, respectively. As seen from JRA-55 (green curves), although the total eddy heat flux anomalies for split SSWs are comparable to displacement SSWs from day ?20 to day 0 (comparable maximum values: ~20 K m s?1; Figs. 6a and b), the eddy heat flux anomalies by the wavenumber-1 for the vortex displacement SSWs are larger than those for the vortex split SSWs (maximum values: ~20 K versus ~15 K m s?1, significantly different at the 95% confidence level). This means that within three weeks before onset of the vortex displacement SSWs, the upward propagation of planetary waves (especially wavenumber-1) strengthens (Figs. 6c and d). Similarly, the increase in the eddy heat flux by wavenumber-2 is larger for vortex split SSWs than for vortex displacement SSWs (maximum values: ~20 versus ~15 K m s?1; Figs. 6e and f). After the onset of SSWs, the negative eddy heat flux anomalies develop. Namely, upward propagation of waves is prohibited after onset of SSWs due to the development of easterlies in the stratosphere. Compared with displacement SSWs, the longer time of eddy heat flux anomalies above zero (rather than the peak maxima) before day 0 in JRA-55 means more extra accumulation of energy in the stratospheric Arctic for split SSWs. This is successfully simulated by BCC-CSM2-MR, FGAOLS-f3-L, and NESM3.

5.1. Lower-tropospheric temperature response to SSWs
Previous studies have confirmed that the continental cold surge is modulated by extreme stratospheric events such as SSWs (Yu et al., 2018; Zhang et al., 2019). Composite temperature anomalies at 850 hPa for displacement SSWs are shown in Fig. 7 for JRA-55 and the models. In JRA-55, continental cold anomalies develop in North Eurasia before onset of SSWs from day ?25 to day ?5 (cold anomaly center magnitude: 3 K), and North America is covered with warm anomalies (warm anomaly center magnitude: 4 K). After the onset of displacement SSWs, cold anomalies decay in North Eurasia (cold anomaly center magnitude: 1.5 K), and cold anomalies develop in North America (cold anomaly center magnitude: 1.5 K; Fig. 7a). The four Chinese CMIP6 models simulate the evolution of the lower-tropospheric temperature response with different degrees of success (Figs. 7b–e). Specifically, BCC-CSM2-MR fails to reproduce the continental-scale cold anomalies in Eurasia before the onset of displacement SSWs, and North America is covered by large cold anomalies (albeit insignificant for most parts of the anomalies) in this model (Fig. 7b). In contrast, the other models generally simulate the cold Eurasian pattern before onset of displacement SSWs (Figs. 7c–e), although the temperature anomalies in FGOALS-f3-L and FGOALS-g3 are not as significant as in JRA-55 and NESM3 due to their different sample sizes. The cold North American pattern is also simulated by all of the four models.
Similarly, Fig. 8 presents composite temperature anomalies at 850 hPa for split SSWs in JRA-55 and the models. A significant cold Eurasia (cold center anomaly magnitude: 4 K) and warm North America (warm center anomaly magnitude: 2–4 K) pattern is observed before onset of split SSWs in JRA55, whereas both continents are anomalously cold (3 versus 1.5 K) after onset of split SSWs (Fig. 8a). The temperature pattern before day 0 is not well simulated by BCC-CSM2-MR, but the uniform cold pattern in most parts of the Eurasian and North American continents (less significant than the observations) after day 0 (i.e., following onset of split SSWs) is successfully simulated (Fig. 8b). As for displacement SSWs, the other three models simulate the cold signals in most parts of Eurasia before and around the onset date of split SSWs, albeit with a low significance level (Figs. 8b–e). However, the cold anomalies after split SSWs in most parts of North America are underestimated.

Comparing displacement and split SSWs, the cold patterns after the onset date are different. For displacement SSWs, cold anomalies mainly develop in North America, and the cold anomalies in Eurasia decay, more resembling a wavenumber-1 pattern. For split SSWs, most parts of both the Eurasian and North American continents are covered with cold anomalies, more resembling a wavenumber-2 pattern. Liu et al. (2019) evaluated two high-top models (CESM1-WACCM and CESM2-WACCM) from CMIP5/6, and the simulated low-tropospheric response was similar to that in other CMIP5/6 models (Seviour et al., 2016; Cao et al., 2019; Liu et al., 2019). In short, the surface response to SSWs is more consistently captured by models than the SSW frequency.
2
5.2. Tropospheric circulation response to SSWs
On the one hand, tropospheric wave activities can force the development of SSWs; and on the other hand, SSWs can impact the troposphere after onset by inducing a NAM-like response from the stratosphere to the troposphere (i.e., easterly anomalies in the circumpolar region, Fig. 5; or positive polar cap height anomalies; not shown). The two-way coupling is dominated by different processes before and after onset of SSWs. To test the variation of the tropospheric circulation, Fig. 9 shows the evolution of height anomalies at 500 hPa in JRA-55 and models during displacement SSWs. As seen from JRA-55, a significant low anomaly center develops over the North Pacific from day ?25 to day ?5, and a significant high anomaly center forms in the subtropical central Pacific in observations (Fig. 9a). Such a height anomaly distribution resembles a positive phase of the Pacific–North American (PNA) pattern, with another positive lobe in North Canada and another negative lobe in the eastern U.S., respectively. The negative height anomalies over the North Pacific extend westward to the coastal region of China, which can be projected onto the negative phase of the western Pacific (WP) pattern (Wallace and Gutzler, 1981). The low anomaly center over the North Pacific has been reported as a precursor of a (following) weakening stratospheric polar vortex on both subseasonal and interannual time scales (Garfinkel et al., 2010; Dai and Tan, 2016; Hu et al., 2017; Rao et al., 2019). Around and after onset of SSWs, the tropospheric circulation anomalies decay and no significant circulation systems are observed (Fig. 9a).
The models simulate the tropospheric circulation anomaly pattern with different degrees of fidelity. The negative height anomaly center over the North Pacific in observations is biased to the Arctic in BCC-CSM2-MR from day ?25 to day ?5, and the high anomaly center over the subtropical central Pacific is located further poleward (Fig. 9b). In contrast, the negative height anomaly (i.e., the cyclone anomaly) center over the North Pacific before SSWs is well simulated in the other models (Figs. 9c–e). As the tropospheric wave perturbation propagates upward (denoted by the large eddy heat flux pulse in Fig. 6a), the precursor decays and the low center moves westward to North Asia during day ?5 to day 5 in JRA-55 and the models (middle column in Fig. 9). Although the height dipole (a high center over Iceland and a low center in the subtropics) in the Atlantic sector is not clearly observed in JRA-55, it is consistently simulated in the four CMIP6 models from day 15 to day 25, resembling the negative phase of the North Atlantic Oscillation (NAO).
Similarly, the evolution of height anomalies at 500 hPa in JRA-55 and the models during vortex split SSWs is shown in Fig. 10. Different from the observed tropospheric height pattern associated with displacement SSWs, the negative height anomaly center is situated further west from the Aleutian Islands, more resembling a WP pattern most of the time from day ?25 to day 5 in JRA-55 (Fig. 10a). The circulation anomalies in the Pacific sector gradually decay after onset of SSWs, and a strong NAO is observed after onset of SSWs in observations.

Models have different skills in simulating tropospheric circulation evolutions during SSWs. The low center develops only during day ?25 to day ?15 in BCC-CSM2-MR (Fig. 10b), but decays faster than in JRA-55 and other models. A negative NAO is not clearly simulated after onset of SSWs for this model. In contrast, the WP-like pattern during day ?25 to day 5 is well captured by FGAOLS-f3-L, FGOALS-g3, and NESM3 (Figs. 10c–e). Models tend to underestimate the post-SSW tropospheric response amplitude in the Atlantic sector.
In observations (represented by JRA-55), six or seven SSWs happen in 10 years (0.64 events per year). BCC-CSM2-MR, FGOALS-f3-L, and FGOALS-g3 underestimate the SSW frequency nearly by half, while NESM3 doubles the SSW frequency. In addition, most SSWs appear in midwinter (January and February), but one-month climate drift for SSWs is consistently simulated in models (SSWs mainly appear in February and March).
As shown in observations, displacement SSWs are nearly evenly distributed in December–March, while split SSWs primarily happen in January and February, determining the seasonal distribution of total SSWs. Both displacement and split SSWs tend to appear in late winter in models, so models cannot capture the seasonality of split (and therefore total) SSWs.
On average, the composite strength of split SSWs is larger than that of displacement SSWs in both the reanalysis and most models, although it does not mean that a split SSW is necessarily stronger than a displacement SSW. The longer pulse of strong positive eddy heat flux before onset of split SSWs explains the stronger stratospheric signals than displacement SSWs for reanalysis and most models. An exception is that the composite of displacement SSWs is stronger than the composite of split SSWs in FGAOLS-g3, although the cause for such a bias is still unknown.
Displacement SSWs and split SSWs have different impacts on lower troposphere (or the near surface), and the air temperature pattern is also different before and after the onset of SSWs. Before onset of displacement SSWs, cold anomalies cover North Eurasia and warm anomalies cover Arctic Canada in observations. After that, cold anomalies in North Eurasia gradually decay and the cold anomalies are confined to North America. Such a wavenumber-1-like temperature anomaly pattern (cold Eurasia and warm North America) in the Northern Hemisphere before onset of displacement SSWs are well forecasted by FGOALS-f3-L, FGOALS-g3, and NESM3 (the skill in BCC-CSM2-MR is relatively low). The cold anomalies in North America after onset of displacement SSWs are captured by all models.
Similarly, warm anomalies also form in Arctic Canada before onset of split SSWs, but most parts of the two continents after onset of split SSWs are covered by cold anomalies in midlatitudes as seen from JRA-55. The models have different degrees of fidelity for the temperature anomaly pattern before onset of split SSWs, but the two cold continents are captured by all the models. The two cold continents after onset of split SSWs generally display a wavenumber-2-like temperature anomaly pattern in both the reanalysis and models.
The tropospheric circulation precursors are different for both types of SSWs in observations. Before displacement SSWs, the North Pacific height anomalies are situated near the Aleutian Islands and the PNA pattern develops to its positive phase in JRA-55. However, before split SSWs, the negative height anomalies in the Pacific sector move westward to the coast of East Asia, and the WP pattern develops to its negative phase. The center of the negative height anomalies in the Pacific sector before onset of SSWs is also sensitive to the SSW type in the models. In observations, a negative NAO is observed only after split SSWs, but it is simulated after both types of SSWs in the models, with the response amplitude underestimated.
To summarize, many aspects of SSWs can be well simulated by Chinese CMIP6 models, although some biases also exist. Rao et al. (2015) used a loose SSW definition and still found that far fewer SSWs were simulated in CMIP5 models. In addition, it is also noted that the CMIP6 models (i.e., BCC-CSM2-MR, FGOALS-f3-L, and FGOALS-g3) simulate more SSWs than their CMIP5 versions (i.e., BCC-CSM1-1, FGOALS-s2, and FGOALS-g2) (2–3 versus 1–2 SSWs per decade). A comparison of SSW simulation between CMIP5 and CMIP6 models is left for a future study. It is also noted that the significance levels in the models are relatively lower than in the reanalysis, although their composite patterns are very similar. This relatively low significance level is mainly attributed to a small sample size of SSWs in the models due to their underestimation of the SSW frequency and the deficiency of the model’s configuration and coarse (vertical) resolution in capturing the characteristics of the SSW (Charlton-Perez et al., 2013; Osprey et al., 2013; Cai et al., 2017; Rao et al., 2020b, c). Comparing with some previous studies (Cao et al., 2019; Liu et al., 2019), high-top models with a finer vertical resolution in the stratosphere (e.g., CESM1-WACCM, CESM2-WACCM) tend to simulate more SSWs. In our four Chinese CMIP6 models, the atmospheric top is around 1 or 2 hPa, so the middle and lower stratosphere is included in those coupled models. In contrast, it is also found that NESM3 has the highest top of the four models, which stops around 1 hPa. Actually, NESM3 also simulates the most SSWs out of the four models.
Although the SSW frequency is underestimated in three models, the tropospheric precursors for SSWs are realistically simulated by most models, reflecting a better capture of bottom-up effect in models. The bias in the top-down effect of the stratospheric variability related to the SSW in low-top models might explain the deficiency in the simulation of the near-surface Arctic Oscillation pattern and East Asian winter climate (e.g., Wei et al., 2018; Gong et al., 2019), although the four models have a good simulation in some aspects of the tropospheric variability, including monsoon systems, Madden–Julian Oscillation, rainfall and typhoons (He et al., 2019; Li et al., 2020). However, SSWs are forced by different sources: some are caused by lower-tropospheric perturbation, while more are related to lower-stratospheric wave activities (de la Cámara et al., 2019; White et al., 2019). More efforts are still required for the modeling developers to improve several aspects of those models, including a higher model top to incorporate the whole stratosphere and even the mesosphere, a complete gravity wave parameterization from different sources, a chemical feedback to the stratosphere by adding a chemistry module, and improvements in other model components (e.g., ocean, land, and ice) to produce a better stratospheric response to boundary variations.
Acknowledgements. The authors thank the BCC modeling group, two LASG modeling groups, and the NUIST modeling group for uploading their AMIP experiments to CMIP6. All the CMIP6 AMIP data are collected by ESGF (