Operational Data Checking

An automatic data checking system has been implemented at ECMWF to trigger warnings in case of anomalies affecting the quality or the availability of the data assimilated by the model. Selected statistical parameters (number of observations, bias correction, and mean bias-corrected background, analysis departures and probability of gross error) are checked against an expected range. An appropriate alert message (including a time series plot) is generated if statistics are outside the specified ranges. A severity level (slight, considerable, severe) is assigned to each message depending on how far statistics are from the expected values. Two kinds of ranges are used by the automatic checking: Soft and Hard limits. Soft limits are updated automatically using statistics from the last twenty days (extremes are excluded during this process). Hard limits are adjusted manually when required.

Currently, the automatic checking is limited to data passing through the minimisation process (including VarBC passive data). It's being applied twice a day to the delayed cut-off 4D-VAR cycles (00 and 12) and four times a day to the early delivery assimilation system (00,06,12 and 18).

The alarm system results are based on feedback information from the ECMWF data assimilation and consequently reflect the ECMWF data usage. Although most warnings are related to data problems, they may on occasion also be related to model issues. Alerts are provided for information on an as-is basis and may be withdrawn or changed without notice. ECMWF accepts no responsibility for actions taken on the basis of these results.

Delayed cut-off 4DVAR at 2020-07-09 12:00

amsua
NOAA-18 AMSUA RADIANCES CHANNEL 11 : out of range
Slight: stdev_fgdepar=0.2829, expected range: 0.2468 0.2752
airs
AQUA AIRS RADIANCES (52 channels affected) : out of range
Considerable: obs_number=15643.0000, expected range: 17070.6383 20394.8911
saphir
All MEGHA-TROPIQUES SAPHIR ALLSKY ALL CHANNELS Global : all data missing
Severely_persistent: obs_number=0, expected range: 128.84 16866.85
mwhs2
FY-3D MWHS2 ALLSKY RADIANCES (6 channels affected) : out of range
Slight: obs_number=50983.0000, expected range: 55352.6583 57615.4593
gpsro
All KOMPSAT-5 GPSRO SETTING ALL HEIGHTS Global : all data missing
Severe: obs_number=0, expected range: 286.49 1273.56
Atmospheric Motion Vector
METEOSAT-8 AMV VIS2 WIND VECTOR DIFF (M/S) PRESSURE LAYER 900-1200 (HP : out of range
Considerable: stdev_fgdepar=1.5914, expected range: 0.8211 1.2195
resat
NOAA-19 SBUV OZONE, TOP PRESSURE LAYER 20-21 (HPA) : out of range
22 times in the last 10 days for at least one item
Severely_persistent: stdev_fgdepar=0.0144, expected range: 0.0074 0.0113
NOAA-19 SBUV OZONE, TOP PRESSURE LAYER 1-2 (HPA) : out of range
16 times in the last 10 days for at least one item
Severely_persistent: stdev_fgdepar=0.0219, expected range: 0.0023 0.0131
Radiosondes
LAND TEMP TEMPERATURE (K) 61660 PRESSURE LAYER 0-300 (HPA) : out of range
10 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-10.1114, expected range: -29.0290 24.0950
Severely_persistent: rms_fgdepar=18.1138, expected range: -33.5317 42.5944
LAND TEMP Q (G/KG) 38341 PRESSURE LAYER 900-1200 (HPA) : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=7.2985, expected range: -7.0902 15.7955
Severely_persistent: rms_fgdepar=7.5789, expected range: 0.0000 15.7434
HIGH RESO LAND TEMP TEMPERATURE (K) (2 pressure layers affected) : missing
3 times in the last 10 days for at least one item
Severely_persistent: obs_number=0.0000, expected range: 22.2372 355.5054
Severely_persistent: obs_number=0.0000, expected range: 69.6180 359.6321
Severe: obs_number=0.0000, expected range: 28.6421 324.1883
Considerable: obs_number=380.0000, expected range: 248.9584 303.0416
LAND TEMP WIND VECTOR DIFF (M/S) 38341 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: avg_fgdepar=22.5245, expected range: -3.6979 12.1845
Severe: rms_fgdepar=23.7790, expected range: 0.0000 19.2838
LAND TEMP WIND VECTOR DIFF (M/S) 74646 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: avg_fgdepar=22.8491, expected range: -1.0945 6.5330
Severe: rms_fgdepar=22.8491, expected range: 0.0000 7.4899
Severe: avg_pge=0.8168, expected range: -0.7785 0.7500
LAND TEMP Q (G/KG) 42809 PRESSURE LAYER 300-600 (HPA) : out of range
Severe: rms_fgdepar=2.5760, expected range: 0.0336 0.8489
LAND TEMP Q (G/KG) 23802 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=4.6664, expected range: 0.0000 1.6120
HIGH RESO LAND TEMP Q (G/KG) 72501 PRESSURE LAYER 600-900 (HPA) : out of range
Severe: rms_fgdepar=3.0507, expected range: 0.0000 1.7279
HIGH RESO LAND TEMP Q (G/KG) 72649 PRESSURE LAYER 600-900 (HPA) : out of range
Severe: rms_fgdepar=4.9853, expected range: 0.0281 2.7711
All HIGH RESO LAND TEMP ALL LAYERS WMO BLOCK 26 : all data missing
Severe: obs_number=0, expected range: 100.44 128.36
LAND TEMP Q (G/KG) PRESSURE LAYER 300-600 (HPA) : out of range
Considerable: obs_number=105.0000, expected range: 51.1319 83.6181
HIGH RESO LAND TEMP WIND VECTOR DIFF (M/S) PRESSURE LAYER 0-300 (HPA) : out of range
1 times in the last 10 days for at least one item
Considerable: obs_number=79.0000, expected range: 143.1635 176.0865
amdar
WIGOS AMDAR WIND VECTOR DIFF (M/S) TCAAYBBA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=19.6675, expected range: 0.0000 10.5494
WIGOS AMDAR WIND VECTOR DIFF (M/S) WVCWUUJA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=16.6591, expected range: 0.0000 8.5896
WIGOS AMDAR WIND VECTOR DIFF (M/S) F5XINEZA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: avg_fgdepar=21.6987, expected range: -1.7607 8.5374
Severe: rms_fgdepar=21.6987, expected range: 0.0000 10.0206
WIGOS AMDAR WIND VECTOR DIFF (M/S) EHLUISJA PRESSURE LAYER 300-600 (HP : out of range
Severe: avg_fgdepar=20.0167, expected range: -7.5378 13.3387
Severe: rms_fgdepar=20.0167, expected range: 0.0000 13.6049
WIGOS AMDAR WIND VECTOR DIFF (M/S) HR40JFBA PRESSURE LAYER 900-1200 (H : out of range
Severe: avg_fgdepar=27.9076, expected range: 0.1194 6.7161
Severe: rms_fgdepar=28.1500, expected range: 0.6767 6.7695
WIGOS AMDAR WIND VECTOR DIFF (M/S) Z3NGU1JA PRESSURE LAYER 900-1200 (H : out of range
Severe: rms_fgdepar=16.0960, expected range: 0.0000 7.5613
WIGOS AMDAR WIND VECTOR DIFF (M/S) LJDGU1ZA PRESSURE LAYER 900-1200 (H : out of range
Severe: avg_fgdepar=31.8142, expected range: 0.0416 5.5524
airep
All AIREP ALL LAYERS Indian Ocean : all data missing
Severely_persistent: obs_number=0, expected range: 109.54 525.38
All AIREP ALL LAYERS Indian Ocean Tropica : all data missing
Severely_persistent: obs_number=0, expected range: 62.03 262.17
pilot
LAND PILOT WIND VECTOR DIFF (M/S) 48480 PRESSURE LAYER 0-300 (HPA) : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=23.3415, expected range: -0.3393 23.0374
Severe: rms_fgdepar=26.5798, expected range: 0.2338 26.0151
LAND PILOT WIND VECTOR DIFF (M/S) 48551 PRESSURE LAYER 0-300 (HPA) : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=20.4974, expected range: 0.0000 25.9708
LAND PILOT WIND VECTOR DIFF (M/S) 43346 PRESSURE LAYER 600-900 (HPA) : out of range
Severe: avg_pge=0.8632, expected range: -0.4260 0.7500
LAND PILOT WIND VECTOR DIFF (M/S) 74646 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: avg_fgdepar=23.2125, expected range: 0.1428 5.2426
Severe: rms_fgdepar=23.3164, expected range: 0.0000 6.7076
Severe: avg_pge=0.8172, expected range: -0.7005 0.7500
synop
MANUAL LAND SYNOP RH2M (%) 76040 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.9314, expected range: -0.8147 0.7500
AUTOMATIC LAND SYNOP RH2M (%) 68926 : out of range
Severe: rms_fgdepar=34.5935, expected range: 0.0000 15.3651
AUTOMATIC LAND SYNOP SURFACE PRESSURE (PA) 89799 : out of range
Severe: avg_fgdepar=-539.6991, expected range: -165.7683 213.7214
Severe: rms_fgdepar=539.7015, expected range: 0.0000 189.8789
Severe: avg_pge=0.8825, expected range: -0.0415 0.0496
MANUAL LAND SYNOP RH2M (%) 43200 : out of range
Severe: rms_fgdepar=43.0389, expected range: 0.0000 24.6389
Severe: avg_pge=0.9785, expected range: -0.0532 0.0672
MANUAL LAND SYNOP RH2M (%) 62120 : out of range
2 times in the last 10 days for at least one item
Severe: avg_pge=0.9725, expected range: -1.0420 0.7500
MANUAL LAND SYNOP RH2M (%) 38933 : out of range
3 times in the last 10 days for at least one item
Severe: avg_pge=0.9632, expected range: -0.5325 0.7500
MANUAL LAND SYNOP RH2M (%) 76253 : out of range
Severe: avg_fgdepar=52.0039, expected range: -42.3155 86.2911
Severe: rms_fgdepar=52.0039, expected range: 0.0000 89.9354
Severe: avg_pge=1.0000, expected range: -0.9928 0.7500
MANUAL LAND SYNOP RH2M (%) 44305 : out of range
Severe: rms_fgdepar=43.5103, expected range: 0.0000 21.7652
MANUAL LAND SYNOP RH2M (%) 41746 : out of range
2 times in the last 10 days for at least one item
Severe: avg_pge=0.9848, expected range: -1.3732 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 72450 : out of range
Severe: rms_fgdepar=353.0171, expected range: 0.0000 177.8891
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 62259 : out of range
Severe: avg_fgdepar=560.7980, expected range: -124.1050 170.4002
Severe: rms_fgdepar=752.5231, expected range: 0.0000 190.2501
BUFR LAND SYNOP Z (M) 08103 : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.9454, expected range: -0.6760 0.7500
BUFR LAND SYNOP RH2M (%) 27872 : out of range
Severe: rms_fgdepar=35.7814, expected range: 0.0000 24.5741
Severe: avg_pge=0.8394, expected range: -0.0143 0.0239
BUFR LAND SYNOP RH2M (%) 29553 : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.9673, expected range: -1.3827 0.7500
BUFR LAND SYNOP RH2M (%) 22778 : out of range
Severe: rms_fgdepar=35.8725, expected range: 0.0000 17.2621
BUFR LAND SYNOP SURFACE PRESSURE (PA) 72451 : out of range
Severe: rms_fgdepar=416.3392, expected range: 0.0000 105.8697
BUFR LAND SYNOP SURFACE PRESSURE (PA) 60136 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=337.0626, expected range: 12.0337 166.5409
BUFR LAND SYNOP SURFACE PRESSURE (PA) 72546 : out of range
Severe: rms_fgdepar=400.9387, expected range: 0.0000 165.9520
BUFR LAND SYNOP SURFACE PRESSURE (PA) 72327 : out of range
3 times in the last 10 days for at least one item
Severe: avg_pge=0.8712, expected range: 0.8444 0.7500
MANUAL LAND SYNOP RH2M (%) : out of range
1 times in the last 10 days for at least one item
Considerable: obs_number=139.0000, expected range: 109.0523 122.2810
Considerable: obs_number=165.0000, expected range: 65.3397 85.1603
BUFR LAND SYNOP RH2M (%) : out of range
3 times in the last 10 days for at least one item
Considerable: obs_number=168.0000, expected range: 150.2222 153.5556
ship
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 9V6212 : out of range
Severe: rms_fgdepar=382.2563, expected range: 0.0000 215.7159
BUFR SHIP SYNOP SURFACE PRESSURE (PA) CFL24 : out of range
Severe: rms_fgdepar=550.1586, expected range: 0.0000 1729.8458
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) 9V6212 : out of range
Severe: avg_fgdepar=22.0486, expected range: -2.1642 9.8024
Severe: rms_fgdepar=22.0540, expected range: 0.0000 10.0580
Severe: avg_pge=0.9214, expected range: -0.7643 0.7500
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) A8OH7 : out of range
Severe: rms_fgdepar=17.7570, expected range: 0.0000 13.7049
Severe: avg_pge=0.9015, expected range: -1.0550 0.7500
All BUFR SHIP SYNOP WMO BLOCK 41 : all data missing
Severe: obs_number=0, expected range: 232.57 373.43
All BUFR SHIP SYNOP WMO BLOCK 42 : all data missing
Severe: obs_number=0, expected range: 170.52 411.36
All BUFR SHIP SYNOP WMO BLOCK 51 : all data missing
Severe: obs_number=0, expected range: 63.05 136.33
buoy
All MOORED BUOYS WMO BLOCK 32 : all data missing
Severe: obs_number=0, expected range: 37.37 170.90
All MOORED BUOYS South West Pacific : all data missing
Severe: obs_number=0, expected range: 8.85 228.20
DRIFTING BUOYS SURFACE PRESSURE (PA) 2501647 : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=303.3736, expected range: 0.0000 99.5423
DRIFTING BUOYS SURFACE PRESSURE (PA) 1701529 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=409.1216, expected range: 0.0000 104.8347
metar
METAR SURFACE PRESSURE (PA) LTCR : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-511.4142, expected range: -629.7198 -267.2188
Severely_persistent: rms_fgdepar=511.8858, expected range: 269.4903 629.9088
METAR SURFACE PRESSURE (PA) KGCK : out of range
Severe: rms_fgdepar=302.2505, expected range: 0.0000 149.3151
METAR SURFACE PRESSURE (PA) OPSK : out of range
Severe: avg_fgdepar=513.9262, expected range: -298.3859 109.7200
Severe: rms_fgdepar=694.6439, expected range: 0.0000 322.2738
METAR SURFACE PRESSURE (PA) KDSM : out of range
Severe: rms_fgdepar=315.4560, expected range: 0.0000 158.6955
AUTOMATIC METAR SURFACE PRESSURE (PA) KP28 : out of range
Severe: rms_fgdepar=307.5140, expected range: 0.0000 165.4455
AUTOMATIC METAR SURFACE PRESSURE (PA) KSDA : out of range
Severe: rms_fgdepar=324.5244, expected range: 0.0000 165.5404
AUTOMATIC METAR SURFACE PRESSURE (PA) KDDC : out of range
Severe: rms_fgdepar=336.1435, expected range: 0.0000 117.6552
AUTOMATIC METAR SURFACE PRESSURE (PA) KHLC : out of range
Severe: rms_fgdepar=329.5053, expected range: 0.0000 174.4990
AUTOMATIC METAR SURFACE PRESSURE (PA) KPNC : out of range
Severe: rms_fgdepar=303.0565, expected range: 0.0000 142.5504
AUTOMATIC METAR SURFACE PRESSURE (PA) KGBD : out of range
Severe: rms_fgdepar=305.1954, expected range: 0.0000 147.1920
AUTOMATIC METAR SURFACE PRESSURE (PA) KFOE : out of range
Severe: rms_fgdepar=412.8791, expected range: 0.0000 181.8043
AUTOMATIC METAR SURFACE PRESSURE (PA) KAWG : out of range
Severe: rms_fgdepar=311.8850, expected range: 0.0000 139.4460
AUTOMATIC METAR SURFACE PRESSURE (PA) KHJH : out of range
Severe: rms_fgdepar=358.0982, expected range: 0.0000 160.9628
AUTOMATIC METAR SURFACE PRESSURE (PA) KAVK : out of range
Severe: rms_fgdepar=315.3552, expected range: 0.0000 120.5535
AUTOMATIC METAR SURFACE PRESSURE (PA) KOTM : out of range
Severe: rms_fgdepar=308.1226, expected range: 0.0000 137.0278
AUTOMATIC METAR SURFACE PRESSURE (PA) KAIO : out of range
Severe: rms_fgdepar=308.3405, expected range: 0.0000 175.6395
AUTOMATIC METAR SURFACE PRESSURE (PA) KTOP : out of range
Severe: rms_fgdepar=370.0372, expected range: 0.0000 176.0642
AUTOMATIC METAR SURFACE PRESSURE (PA) KHYS : out of range
Severe: rms_fgdepar=310.4543, expected range: 0.0000 151.4871
AUTOMATIC METAR SURFACE PRESSURE (PA) KPTT : out of range
Severe: rms_fgdepar=315.6342, expected range: 0.0000 130.6072
AUTOMATIC METAR SURFACE PRESSURE (PA) KHUT : out of range
Severe: rms_fgdepar=313.9867, expected range: 0.0000 149.3539
AUTOMATIC METAR SURFACE PRESSURE (PA) KSAW : out of range
Severe: rms_fgdepar=315.7296, expected range: 0.0000 116.5491
snow
BUFR LAND SYNOP SNOW (CM) 01035 : out of range
38 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=89.7964, expected range: 81.6998 132.7660
Severely_persistent: rms_fgdepar=89.7964, expected range: 81.7011 132.7688
BUFR LAND SYNOP SNOW (CM) : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=66.5581, expected range: 2.1391 3.9678
t2m
MANUAL LAND SYNOP 2M TEMPERATURE (K) 87405 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=15.7354, expected range: -5.9566 15.8756
Severely_persistent: rms_fgdepar=15.7354, expected range: 0.0000 14.7574
Severely_persistent: avg_est_pge=0.8667, expected range: 0.1120 1.0312
MANUAL LAND SYNOP 2M TEMPERATURE (K) 89606 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_est_pge=0.8090, expected range: 0.1432 1.1522
BUFR LAND SYNOP 2M TEMPERATURE (K) 87405 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=15.6854, expected range: -5.8871 16.3391
Severely_persistent: rms_fgdepar=15.6854, expected range: 0.0000 15.4773
Severely_persistent: avg_est_pge=0.8663, expected range: 0.1124 1.0317
BUFR LAND SYNOP 2M TEMPERATURE (K) 27415 : out of range
28 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-17.6864, expected range: -21.7757 -12.7522
Severely_persistent: rms_fgdepar=17.7748, expected range: 12.9451 21.6544
MANUAL LAND SYNOP 2M TEMPERATURE (K) : out of range
Considerable: obs_number=208.0000, expected range: 34.5443 128.7188