HTML
--> --> --> -->2.1. FY-3B MWHS-1
MWHS-1 is a five-channel cross-track scanning radiometer, launched for the first time onboard the FY-3A platform in 2008 and then onboard FY-3B in 2010 on an afternoon orbit [1445 Equator Crossing Time (ECT), ascending node] (Dong et al., 2009). With two window channels at 150 GHz and three channels sounding the water vapor line at 183 GHz, the MWHS-1 sounding capability is comparable with, although not identical to, the Microwave Humidity Sounder (MHS) (Kleespies and Watts, 2006), as shown in Table 1. The MWHS-1 scanning geometry provides cross-track scans of 98 16-km steps (at nadir) for a total swath of about 2600 km and an instantaneous field of view on the surface at nadir of approximately 16 km. Channels 3, 4 and 5 peak in the upper, mid and lower troposphere, respectively, allowing between two and three pieces of independent information in the vertical direction.Figure1. MWHS-1 channel 5 observations-minus-background (a) before correction (O-B) and (b) after correction (C-B) as a function of the scene temperature (right). The color illustrates the number of observations per 1 K bin. Vertical bars show the 1σ standard deviation.
The quality of MWHS-1 data has been assessed by (Lu et al., 2011b) and (Chen et al., 2015). In both studies, data were found of matching quality with those of the MHS, although observations from MWHS-1 have a random noise 0.8-1 K greater than that from the MHS. They also reported a scanning-angle bias of complex modulations, varying with the channel frequencies, reaching up to 2 K peak-to-peak amplitude.
Similar conclusions have been drawn from an internal evaluation conducted at the Met Office. However, a scene temperature dependency was also observed in MWHS-1 observations, not reported in the studies referred to previously. The cause of this bias variation with scene temperature is not known. Figure 1 illustrates this scene temperature dependency for one day of background departure (i.e., the difference observation-minus-model background, referred to as innovation or O-B). The background is computed from the short-range forecasts (T+6) from the Met Office global model interpolated at the location and time of the observation and processed through the fast radiative transfer model RTTOV version 11 (Saunders et al., 2013a). Data are from 13 December 2016, quality-controlled (left), quality-controlled and corrected (right), as in operation (see section 4.1). In the most densely populated segment, between 260 and 280 K, the O-Bs increase by 0.1 K for every 1 K increase in scene temperature. The slope in that segment disappears in the corrected dataset, attesting of the bias correction scheme efficiency.
2
2.2. FY-3C MWHS-2
MWHS-2 is an advanced version of MWHS-1 and was launched in 2013 onboard FY-3C on a morning orbit (1015 ECT, descending node). The instrument has sounding capability in the 183 GHz water vapor band (five channels), in the window frequencies at 89 and 150 GHz (two channels), and a unique set of eight channels in the 118 GHz oxygen band improving the instrument sensitivity to humidity, temperature, and ice particles (Li et al., 2016). The MWHS-2 window and 183 GHz channels are similar to those of the Advanced Technology Microwave Sounder (ATMS) (Muth et al., 2004), as shown in Table 1. Like its predecessor, the instrument has 98 steps across track, with a resolution of 16 km at nadir for the 183 GHz channels and 32 km at nadir for the window and 118 GHz channels.The present study focuses on MWHS-2 183 GHz frequencies, as they are the channels assimilated in operation at the Met Office. The quality assessment of those channels has been reported by (Lawrence et al., 2015), (Lu et al., 2015), and (Li et al., 2016). The quality of MWHS-2 data was found to be comparable with that of ATMS, with mean global biases of the same magnitude, albeit slightly larger and (for some channels) of opposite sign. The noise and scanning-angle biases were shown to be comparable for both instruments, apart from more variability in ATMS data. A low-magnitude striping similar to or smaller than that of ATMS has been observed in MWHS-2 data.
2
2.3. FY-3C MWRI
MWRI is a microwave conical-scanning imager that measures frequencies at 10.65, 18.7, 23.8, 36.5 and 89 GHz both in vertical polarization (V-pol) and horizontal polarization (Yang et al., 2011). MWRI is part of the payload of all FY-3 platforms launched to date, although FY-3A MWRI failed soon after launch in 2008. The instrument shares frequencies with other imagers, including the Advanced Microwave Scanning Radiometer-2 (AMSR-2) (Imaoka et al., 2010), but has a new design that provides an improved calibration method, as described by (Yang et al., 2011). This calibration system relies on a main reflector that is common to the Earth, cold and warm views, in addition to two independent reflectors exclusively used for the cold and warm targets. The aim was to avoid the solar-dependent biases that used to affect past imagers (Bell et al., 2008; Geer et al., 2010) whose calibration could not account for the emissions due to the sun-heated main reflector. Table 2 summarizes the instrument characteristics.An assessment of FY-3C MWRI has been provided by (Lawrence et al., 2017). The authors compared observations to short-range forecasts from both the ECMWF and Met Office global models. They concluded that MWRI suffers a 2 K bias between the ascending and descending half-orbits, consistent across all channels, with complex geographical patterns. Although the calibration excludes the main reflector as a source of emissions inducing this bias, it is possible that other parts of the instrument, such as the calibration mirrors, contribute to it. It was also suggested that the contamination of the warm load by the Earth scene, as described by (Yang et al., 2011), might not be fully removed and also contributes to the bias.
The assessment also showed that MWRI is affected by television radio frequency interference (TFI) at 10.65 and 18.7GHz. TFI affects the channels overlapping with unprotected parts of the spectrum used by geostationary telecommunication satellites, whose signals bounce back from the ocean surface and contaminate the instrument observations.
These findings are in line with the work of (Zou et al., 2014) and (Tian and Zou, 2016), who reported TFI affecting AMSR-E and AMSR-2 observations at similar frequencies and locations. This also complements the work of (Zou et al., 2012), who showed that FY-3B MWRI is subject to RFI (radio frequency interference) from active ground-based transmitters used for military and civil applications.
These biases are a challenge for NWP centers wishing to assimilate the MWRI data. In particular, the ascending-descending bias requires a correction scheme with orbital angle-based predictors similar to that developed for the Special Sensor Microwave Imager/Sounder (SSMIS) by (Booton et al., 2013). Such a scheme is under development at the Met Office and further discussed in the next section.
-->
4.1. Data processing
MWHS-1 and MWHS-2 observations have been assimilated in operation in the Met Office global system since December and March 2016, respectively. This section describes the processing of those data.The Met Office data assimilation system operates as follows.
Firstly, raw global data for FY-3B and FY-3C are transmitted by the satellite to CMA ground stations, normally once per orbit. CMA carries out the processing to transform the raw MWHS data to files containing calibrated, geolocated brightness temperatures. Data are then sent to EUMETSAT for onward distribution to European users via EUMETCast.
At the Met Office, the brightness temperatures are spatially averaged and thinned, in line with current practice for instruments such as ATMS, MHS and SSMIS. This has the effect of reducing random instrument noise. A 2× 2 average is used for MWHS-1 (giving 49 spots per scan) and a 3× 3 average for MWHS-2 (30 spots per scan). The reason for the difference is that, originally, it was intended to map MWHS-2 to the Microwave Temperature Sounder-2 (MWTS-2) sample positions, similar to the process of mapping the MHS to AMSU-A. MWTS-2 has 90 spots, and a 1 in 3 sampling was to be used. When FY-3C MWTS-2 failed in 2015, the 30 spots per scan sampling was retained. The ATOVS and AVHRR Preprocessing Package (https://nwpsaf.eu/site/ software/aapp/) is used to ingest the incoming data and to perform the averaging and thinning. Finally, the data are converted to BUFR format and stored in the Met Office observational database ready for use in NWP.
Secondly, a one-dimensional variational analysis (1D-Var) is performed to derive physical parameters used in the subsequent main variational process. For the MWHS instruments, atmospheric temperature and specific humidity, surface temperature, specific humidity and pressure, and skin temperature are retrieved. The retrieval uses as first guess, or background, the information coming from the 6-h forecast (T+6) of the previous assimilation cycle, interpolated at the observation location and time. Various quality controls are conducted as part of the 1D-Var analysis. Some quality controls are common to all processed instruments and include a gross error check on the observation brightness temperature and coordinates, a gross error check on the background, a convergence check, a radiative transfer error check, and a check on background departure before and after retrieval. Instrument-specific quality controls, including rejection of cloud- and rain-contaminated observations, surface type selection, or spatiotemporal screening can be applied.
The DA system at the Met Office uses a clear-sky scheme; therefore, radiances that are significantly affected by clouds must be discarded. In that respect, a cirrus cloud test discussed by (Doherty et al., 2012) is applied to both MWHS instruments. The test rejects observations based on a cost function using the 183 7, 183 3 and 183 1 GHz channels, in combination with an imposed threshold on the magnitude of the background departure at 183 7 GHz. For MWHS-2, a scattering test is also applied, using the 89 and 150 GHz channels for the calculation of a scattering index, as described by (English et al., 1999) and (Bennartz et al., 2002). Note that those channels are used passively in 1D-Var but not assimilated. As a final pre-processing step, a 25-km 1-h window thinning, followed by two 80-km 1-h thinnings, is applied to both instruments. Typically, 88%-92% of MWHS-1 and 79%-84% of MWHS-2 total data are rejected per cycle.
Thirdly, the data go through the main assimilation system, a hybrid incremental 4D-Var assimilation model of resolution N320L70 (~ 40 km at midlatitudes, 70 levels from surface to 80 km) and 6-h time window (Courtier et al., 1994; Rawlins et al., 2007). The forecast model used in the operational suite 37 (OS37) in 2016, when FY-3 observations were first assimilated, had a resolution N768L70 (~ 17 km at midlatitudes, 70 levels). The resolution has increased to N1280L70 (~ 10 km at midlatitudes, 70 levels) with the upgrade to the operational suite 39 (OS39) in July 2017. The implementation of OS39 also marks the transition from the radiative transfer model RTTOV 9 to RTTOV 11 (Saunders et al., 2013a). The ocean emissivity model used for the MWHS instruments is FASTEM-2 (Deblonde and English, 2000).
Since OS37 in 2016, a variational bias correction of satellite radiance observations has been used at the Met Office (Aulignè et al., 2007). For MWHS, seven predictors are used, including a constant bias offset, two (200-50 hPa and 850-300 hPa) thickness predictors, and four Legendre polynomial predictors correcting residual scan biases after a static spot-dependent offset is applied prior to 4D-Var.
The operational configuration for MWHS-1 and MWHS-2 is summarized in Table 3.
2
4.2. Monitoring in operation
Continuous monitoring of satellite observations assimilated in NWP is a key task that allows the rapid detection of data anomalies, the implementation of remedies, and the feedback to data providers.Diagnostics of satellite observations are done in brightness temperature space. During the assimilation cycle, RTTOV is used to convert model geophysical fields from the short-range forecast interpolated at the observation time and location into simulated brightness temperatures. This forward approach is better posed than in an inverse problem, which consists of comparing retrieved satellite profiles to the model, because the inverse method may have several valid solutions and therefore greater uncertainties. Similarly, the model analyses can be compared to observations instead of the forecasts, in which case the difference between observation and analysis is referred to as the residual or O-A. Note that the analysis is not independent of the observation that has already been assimilated.
Figure 4 shows, from top to bottom, the daily averaged innovation and 1σ standard deviation, the daily averaged residual and 1σ standard deviation, the difference between the innovation and residual and its standard deviation, and the number of observations as assimilated in operation, for MWHS-1 channel 4 (left) and MWHS-2 channel 13 (right), respectively.
In late November 2016, an anomaly leading to a significant increase in both MWHS-1 innovation and residual (and their respective standard deviations) was detected. Consequently, the instrument was removed from operational assimilation during the period marked by the red shading, and the report of the anomaly was fed back to CMA for investigation. The archiving of MWHS-1 data in the Met Office database was also stopped for a few days. The problem was traced back to a failure of the instrument's storage disk static random-access memory, and the backup disk has been activated instead. New bias correction coefficients, used to initiate the variational bias correction, have been generated and the instrument was reintroduced into operation in mid-January 2017.
Three other minor events have affected MWHS-1. On 14 February 2017, a small increase of a few tenths of a Kelvin in the innovation occurred because of a ground segment processing problem for the Sondeur Atmospherique du Profil d'Humidite Intertropicale par Radiometrie (SAPHIR), whose spurious data have impacted the background fit of other instruments in the system, including MWHS-1. In early March, MWHS-1 data were unavailable for a couple of days, which caused a small increase in the innovation when the number of data dropped. Finally, on 8 June 2017, a small increase in the innovation, residual, and standard deviation was detected (of maximum amplitude 0.4 K in channel 5; not shown) and fed back to the CMA. After investigation, it was found that the bias change coincided with changes in the platform energy supply scheme, adjusted to compensate for seasonal variations in the solar energy at the platform, as the eclipse pattern changes. It is not clear why these energy changes affected the instrument bias.
Figure4. The MWHS-1 (a) innovation, (b) residual, (c) difference between innovation and residual, and (d) observation count. (e-h) As in (a-d) but for MWHS-2. Red shading shows the period MWHS-1 was blacklisted.
Away from these sudden bias changes, the MWHS-1 standard deviation is about 1.3 K (1.1 K) in the innovation (residual). Note that the standard deviation is slightly larger in channel 3 (not shown), with values up to 2.2 K (1.9 K) in the innovation (residual).
MWHS-2 time series are marked by three major bias changes occurring in May and September 2016, and February 2017. The latter is a consequence of the SAPHIR ground segment problem, as described previously.
The bias changes, of opposite sign, occurring in May and in September 2016, have been related to changes in the instrument working temperature, as discussed by (Lawrence et al., 2017). Over this period, modifications of the platform thermal compensation system caused the instrument environment temperature to increase by 5 K (see Lawrence et al., 2017, Fig. 3).
It is not clear, however, why systematic errors induced by the temperature changes are not removed by the onboard calibration of the instrument. The radiometric gain may have changed with the temperature, but this should not have resulted in changes to the calibrated brightness temperatures. Furthermore, the receiver nonlinearities may also have been affected, but a nonlinearity error would result in geographical bias patterns varying with the scene temperature (Lu et al., 2011b); such an effect was not observed during this period.
Apart from those spikes, the MWHS-2 standard deviation for channel 13 is 0.95 K (0.6 K) in the innovation (residual). The standard deviation is similar in channels 13-15 and slightly larger in channels 11-12 (1.5 K and 1 K in the innovation and in the residual, respectively), likely due to the different cloud screening applied to those two sets of channels (see Table 3).
Figure5. Maps of the MWHS-1 channel 4 (a) innovation, (b) residual, and (c) residual using new observation errors averaged over June 2017. (d, e) As in (a, b) but for the MWHS-2 channel 13 (d) innovation and (e) residual. The table in the bottom right gives the minimum, maximum, mean, 1σ standard deviation, mode (in K), and the number of observations for each panel.
Geographical patterns may also help to identify regional biases. Figure 5 shows maps of the innovation (top) and residual (middle) for MWHS-1 channel 4 (left) and MWHS-2 channel 13 (right), averaged in 1°× 1° bins over the month of June 2017. The innovations present similar, although not identical, patterns, including a negative bias in the tropical band and a positive bias in the Southern Ocean. The negative bias is consistent with cloudy areas: the ITCZ, that is slightly north of the equator in this season, the eastern Indian Ocean and the Maritime Continent, which suggests that the bias is principally caused by the presence of unscreened clouds in the observations. Brightness temperatures of cloud-contaminated observations are lower (brightness temperature of the cloud top) compared to those of clear sky assumed by the model background. This means that tighter quality controls and/or the use of the 118 GHz channel's cloud-sensitivity (only for MWHS-2) might help further improve the quality of the data. The warm bias in the Southern Ocean probably results from a known bias in the model. Bodas-Salcedo et al. (2012, 2014, 2016) suggested that the global atmospheric model used at the Met Office tends to underrepresent low-level clouds above the midlatitude Southern Ocean, which results in too little solar radiation being reflected. This surplus of solar energy leads to a shortwave bias in the atmosphere model and a warm bias in sea surface temperature.
For MWHS-2, those patterns mostly disappear in the residual, whose standard deviation is driven down to 0.60 K, compared to 0.93 K in the innovation. The improvement is not as large for MWHS-1, mostly because MWHS-1 observation errors used in the 4D-Var are larger than those of MWHS-2 at equivalent frequency (i.e., greater observation errors mean less weight given to observation). In the future Met Office suite upgrade (OS40), MWHS-1 will receive observation errors equivalent to those for MWHS-2. This upcoming configuration has been used to generate the residual map shown at the bottom of Fig. 5. In this configuration, the standard deviation of the residual is reduced to 0.93 K compared to 1.07 K in the residual (OS39-like configuration) and 1.25 K in the innovation.
2
4.3. Operational performance
There are several ways to estimate the impact on a system of an individual or a group of instruments. Observing System Experiments (OSEs) can be used to determine how a system reacts to the addition or the removal of instruments (Bauer, 2009).Changes in the forecast root-mean-square error (RMSE) and forecast skill (mean-square error normalized by the mean-square error of the reference or control) can be calculated from an OSE and its control experiment. Change in the background fit for independent instruments——that is, the standard deviation of the background departures——is another metric that can be derived from OSEs.
As part of the Met Office standard pre-operational testing, several OSEs have been conducted to investigate the impact of adding MWHS-1 and MWHS-2 (separately) in a low resolution (N320L70 UM, N108/N216 4D-Var uncoupled) full global system. Those experiments are documented by (Carminati et al., 2015). The impact on the forecast errors was found to be neutral overall, but benefits were shown for the background fit to the humidity-sensitive channels of independent instruments, which improved by 0.2%-2%.
Here, we investigate the combined impact of MWHS-1 and MWHS-2 with a denial experiment——an OSE where both instruments are removed from a low-resolution version of the full global system (N320 UM, N108/N216 4D-Var uncoupled). This OSE and its control have been conducted for the summer 2016, starting on 1 July and running until 30 September.
As expected from the previous experiments, the removal of FY-3 instruments has not impacted the forecast RMSE and skill (not shown). Note, this does not mean that the humidity sounders are not beneficial to the global forecasting system; rather, that the system is not optimally designed to represent those benefits. Assimilation of humidity channels has the potential to improve the model wind field. This is due to the "tracer effect", in which successive observations of the humidity field over the assimilation time-window should cause the assimilation system to adjust both the humidity and the wind fields in a consistent manner. Within the 4DVar scheme, an analysis is performed via a global minimization to reduce the discrepancy between the model first guess and the observations. In this minimization process, the full nonlinear model is run for a short forecast period; this is termed the outer loop of the minimization. Currently, the Met Office uses one cycle of the outer loop in the operational 4DVar scheme (Rawlins et al., 2007). Successive cycles of the outer loop should, in principle, improve the link between the observations and the dynamical field through successive updates of the model forecast's initial conditions. Tests of the NWP system with an increased number of outer loops are planned, with the expectation of forecast benefits to tropospheric wind, humidity and cloud fields from the humidity channels, such as those centered around 183 GHz.
A significant impact of the removal of MWHS instruments is found in the change in background fit to observations of the remaining instruments. Figure 6 shows the change in standard deviation of the innovation with respect to the control experiment for the Infrared Atmospheric Sounding Interferometer (IASI on MetOp-B), the Cross-track Infrared Sounder (CrIS on SNPP), ATMS (on SNPP), SAPHIR (Megha-Tropiques), and MHS (on NOAA19). Note the arrangement of the infrared sounder channels going from the lowest to the highest peaking temperature, and then humidity-sensitive channels.
Figure6. Change in innovation standard deviation for (a) IASI, (b) CrIS, (c) ATMS, (d) SAPHIR, and (e) MHS, related to the denial of MWHS-1 and MWHS-2 over the period July-September 2016. Red indicates a significant increase, green a significant decrease, and blue no significant change. Note that IASI and CrIS channel numbers are not the channel numbers used in the instrument definitions, but the channel selections used at the Met Office. The red number at the top of each plot indicates the mean change across all channels ( 1σ).
Figure7. (a) FSO total impact per instrument type as of June 2017. (b) FSO total impact per channel for MWHS-1 as of June 2017. (c) As in (b) but for MWHS-2.
Because the OSE is a denial experiment, we interpret the degradation of the system——here, the increase in standard deviation——as the benefit shortfall from the non-assimilation of MWHS data.
The MHS (channels 3-5), SAPHIR, and ATMS (channels 18-22) all sound the 183 GHz water vapor line. The standard deviation of their innovations all degrade by 0.2% to 1%. The overall lesser impact on SAPHIR (0.3%-0.4%) might be related to the low inclination of its orbit allowing sounding exclusively in the tropics where statistically more MWHS data are screened out due to cloud contamination.
The humidity-sensitive channels of the infrared instruments also show an increase in standard deviation by up to 0.5%, with the exception of the highermost peaking upper-tropospheric IASI channels, whose standard deviation reduces by 0.1%. It is not clear why upper-tropospheric channels are affected by the removal of MWHS data (mostly sensitive to the mid-troposphere). This might be a side effect of changes to other IASI channels. Nevertheless, this reduction is largely compensated by the increase in standard deviation at other levels.
It is worth noting that, in addition to the benefit shortfall seen at frequencies sensitive to humidity, the fit to observations for the infrared surface and tropospheric temperature channels also degrades by up to 0.7%. This illustrates how the water vapor continuum affects the observations, even at frequencies principally sensitive to temperature, and further stresses the importance of the humidity component in DA systems.
A complementary diagnostic to OSEs is the adjoint-based Forecast Sensitivity to Observation (FSO) method described by (Lorenc and Marriott, 2014). FSO uses the DA system to simultaneously estimate the impact of each individual piece of information in the system. FSO scores are expressed as an energy norm (J kg-1). They are obtained from the sensitivity of the reduction in forecast error, which results from an assimilated observation to which is applied the adjoint of the linearized forecast model and that resulting from the 4D-Var. The FSO impact of this observation is a function of its sensitivity multiplied by its innovation.
Figure 7 (top) presents the FSO total impact per instrument type for all instruments in the system as of June 2017. Note that negative values of FSO indicate a contribution to the reduction of the 24-h forecast errors. The MWHS-2 total impact is about a fifth of that of the MHS (which includes the four MHS instruments on board MetOp-A, -B, NOAA18, and 19). The MWHS-1 total impact is about half of that of MWHS-2. The total impact per channel, shown in Fig. 7 (bottom) confirms that all assimilated channels of MWHS contribute, to various extents, to the reduction in forecast errors.
It is also worth noting the large benefits resulting from the assimilation of AMSR-2 data (four times that of MWHS-2). Because MWRI and AMSR-2 share similar radiometric capability, the future assimilation of MWRI data is expected to yield benefits of the same order. Microwave imagers like MWRI or AMSR-2 are sensitive to cloud and water vapor in the boundary layer. Near-surface information is essential for the correct initialization of the forecast model and only two instruments (i.e., AMSR-2 and SSMIS) are currently used in operation. In comparison, nine instruments have sounding capability in the free troposphere at 183 GHz (including MWHS-1 and -2), making the total impact per instrument (or instrument family) smaller than that of the imagers.