Operational Data Checking

An automatic data checking system has been implemented at ECMWF to trigger warnings in case of anomalies affecting the quality or the availability of the data assimilated by the model. Selected statistical parameters (number of observations, bias correction, and mean bias-corrected background, analysis departures and probability of gross error) are checked against an expected range. An appropriate alert message (including a time series plot) is generated if statistics are outside the specified ranges. A severity level (slight, considerable, severe) is assigned to each message depending on how far statistics are from the expected values. Two kinds of ranges are used by the automatic checking: Soft and Hard limits. Soft limits are updated automatically using statistics from the last twenty days (extremes are excluded during this process). Hard limits are adjusted manually when required.

Currently, the automatic checking is limited to data passing through the minimisation process (including VarBC passive data). It's being applied twice a day to the delayed cut-off 4D-VAR cycles (00 and 12) and four times a day to the early delivery assimilation system (00,06,12 and 18).

The alarm system results are based on feedback information from the ECMWF data assimilation and consequently reflect the ECMWF data usage. Although most warnings are related to data problems, they may on occasion also be related to model issues. Alerts are provided for information on an as-is basis and may be withdrawn or changed without notice. ECMWF accepts no responsibility for actions taken on the basis of these results.

Delayed cut-off 4DVAR at 2021-04-06 12:00

amsua
METOP-A AMSUA RADIANCES (8 channels affected) : out of range
Considerable: obs_number=5069.0000, expected range: 6598.8588 8006.7883
iasi
METOP-A IASI RADIANCES CHANNEL 5383 : out of range
1 times in the last 10 days for at least one item
Severe: avg_biascorr=-0.1066, expected range: -0.1473 -0.1296
METOP-B IASI RADIANCES CHANNEL 214 : out of range
Considerable: avg_biascorr=0.1504, expected range: 0.1254 0.1404
METOP-B IASI RADIANCES CHANNEL 1521 : out of range
Slight: stdev_fgdepar=0.4525, expected range: 0.3629 0.4326
METOP-B IASI RADIANCES CHANNEL 1626 : out of range
Slight: stdev_fgdepar=0.4765, expected range: 0.3859 0.4575
cris
NOAA20 CRIS RADIANCES CHANNEL 143 : out of range
15 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.1017, expected range: -0.0925 -0.0872
atms
NPP ATMS RADIANCES (7 channels affected) : out of range
1 times in the last 10 days for at least one item
Considerable: obs_number=3563.0000, expected range: 2994.5135 3426.5453
gpsro
COSMIC2-E4 GPSRO RISING HEIGHT 18-20 KM : out of range
Slight: avg_norm_fgdepar=0.2725, expected range: 0.0014 0.2162
Radiosondes
LAND TEMP TEMPERATURE (K) 24688 PRESSURE LAYER 900-1200 (HPA) : out of range
7 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8905, expected range: -0.9539 0.7500
All LAND TEMP ALL LAYERS WMO BLOCK 62 : all data missing
Severe: obs_number=0, expected range: 0.86 312.21
HIGH RESO LAND TEMP Q (G/KG) 72645 PRESSURE LAYER 600-900 (HPA) : out of range
Severe: rms_fgdepar=2.5023, expected range: 0.0000 1.1961
HIGH RESO LAND TEMP TEMPERATURE (K) 57461 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=7.0829, expected range: 0.8172 2.3756
HIGH RESO LAND TEMP TEMPERATURE (K) PRESSURE LAYER 0-300 (HPA) : out of range
2 times in the last 10 days for at least one item
Severe: obs_number=142.0000, expected range: 61.8843 67.8935
Considerable: obs_number=280.0000, expected range: 364.7070 410.0430
BUFR TEMP DESCENT Q (G/KG) PRESSURE LAYER 900-1200 (HPA) : missing
2 times in the last 10 days for at least one item
Severe: obs_number=0.0000, expected range: 0.0000 437.6905
HIGH RESO LAND TEMP TEMPERATURE (K) (2 pressure layers affected) : out of range
1 times in the last 10 days for at least one item
Considerable: obs_number=361.0000, expected range: 438.3412 471.9088
HIGH RESO LAND TEMP WIND VECTOR DIFF (M/S) PRESSURE LAYER 0-300 (HPA) : out of range
1 times in the last 10 days for at least one item
Considerable: obs_number=152.0000, expected range: 239.4791 268.9654
amdar
ADS-C WIND VECTOR DIFF (M/S) PRESSURE LAYER 300-600 (HPA) : missing
5 times in the last 10 days for at least one item
Severely_persistent: obs_number=0.0000, expected range: 0.1225 263.9043
AMDAR WIND VECTOR DIFF (M/S) JP9ZXY59 PRESSURE LAYER 300-600 (HPA) : out of range
Severe: rms_fgdepar=25.2435, expected range: 0.0000 6.1224
ADS-C WIND VECTOR DIFF (M/S) GQBUILBA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=30.2350, expected range: 0.5111 8.8607
ADS-C WIND VECTOR DIFF (M/S) IRPYEJJA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=28.0726, expected range: 0.0000 16.4706
ADS-C WIND VECTOR DIFF (M/S) 4RYAPWRA PRESSURE LAYER 0-300 (HPA) : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=25.1524, expected range: 0.0000 44.3687
airep
AIREP WIND VECTOR DIFF (M/S) UAL433 PRESSURE LAYER 0-300 (HPA) : out of range
3 times in the last 10 days for at least one item
Severe: rms_fgdepar=23.7954, expected range: 0.0000 8.4661
prof
EUROPEAN WIND PROFILER VECTOR DIFF (M/S) 07460 PRESSURE LAYER 900-1200 : out of range
Severe: avg_fgdepar=41.6026, expected range: 1.1143 6.4254
Severe: rms_fgdepar=41.6026, expected range: 0.0000 16.9559
Severe: avg_pge=0.9608, expected range: -0.3650 0.7500
pilot
LAND PILOT WIND VECTOR DIFF (M/S) 42498 PRESSURE LAYER 600-900 (HPA) : out of range
Severe: rms_fgdepar=17.3742, expected range: 0.0000 8.7830
Severe: avg_pge=0.8233, expected range: -0.7625 0.7500
synop
AUTOMATIC LAND SYNOP SURFACE PRESSURE (PA) 17847 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=538.3762, expected range: -603.6447 1247.5452
Severely_persistent: rms_fgdepar=538.8237, expected range: 0.0000 1201.1737
Severely_persistent: avg_pge=0.8855, expected range: -1.5016 0.7500
MANUAL LAND SYNOP RH2M (%) 42963 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=52.8791, expected range: 32.6426 64.6281
Severely_persistent: rms_fgdepar=52.8791, expected range: 32.6426 64.6281
MANUAL LAND SYNOP RH2M (%) 42915 : out of range
5 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.9990, expected range: -2.0212 0.7500
MANUAL LAND SYNOP RH2M (%) 43177 : out of range
9 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8445, expected range: -1.4190 0.7500
BUFR LAND SYNOP RH2M (%) 86850 : out of range
15 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-56.7440, expected range: -74.3543 -35.1294
Severely_persistent: rms_fgdepar=57.0777, expected range: 36.3593 73.7776
BUFR LAND SYNOP RH2M (%) 81732 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-74.6163, expected range: -127.1194 61.4641
Severely_persistent: rms_fgdepar=74.7913, expected range: 0.0000 111.0844
Severely_persistent: avg_pge=1.0000, expected range: -1.5969 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 29471 : out of range
32 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=630.3796, expected range: -1153.1151 1528.6045
Severely_persistent: rms_fgdepar=630.3796, expected range: 0.0000 1765.2884
Severely_persistent: avg_pge=0.9159, expected range: -1.9159 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 13464 : out of range
18 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8381, expected range: -1.0848 0.7500
AUTOMATIC LAND SYNOP RH2M (%) 12910 : out of range
Severe: avg_fgdepar=59.4433, expected range: -21.2123 16.3194
Severe: rms_fgdepar=59.4433, expected range: 0.0000 11.7952
Severe: avg_pge=0.9971, expected range: 0.0010 0.0046
AUTOMATIC LAND SYNOP RH2M (%) 12815 : out of range
Severe: rms_fgdepar=42.3329, expected range: 0.0000 23.2164
MANUAL LAND SYNOP RH2M (%) 37871 : out of range
Severe: rms_fgdepar=37.6190, expected range: 0.0000 20.6452
Severe: avg_pge=0.8531, expected range: -0.0008 0.0065
MANUAL LAND SYNOP RH2M (%) 42273 : out of range
4 times in the last 10 days for at least one item
Severe: rms_fgdepar=35.7953, expected range: 0.0000 16.2107
Severe: avg_pge=0.9952, expected range: 0.0010 0.0047
MANUAL LAND SYNOP RH2M (%) 42056 : out of range
Severe: rms_fgdepar=31.7439, expected range: 0.0000 14.9387
MANUAL LAND SYNOP RH2M (%) 42077 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=34.4448, expected range: 0.0000 14.8669
MANUAL LAND SYNOP RH2M (%) 43197 : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.9885, expected range: -0.0179 0.0343
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 40030 : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=502.1247, expected range: -112.0686 174.4127
Severe: rms_fgdepar=502.6746, expected range: 0.0000 142.9202
Severe: avg_pge=0.8579, expected range: -0.7747 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 63331 : out of range
Severe: avg_pge=0.8275, expected range: 0.6285 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 63882 : out of range
Severe: rms_fgdepar=642.7299, expected range: 0.0000 228.1802
BUFR LAND SYNOP RH2M (%) 11010 : out of range
Severe: rms_fgdepar=35.7313, expected range: 0.0000 18.6789
BUFR LAND SYNOP RH2M (%) 12910 : out of range
1 times in the last 10 days for at least one item
Severe: avg_fgdepar=52.3988, expected range: -17.2972 10.2651
Severe: rms_fgdepar=53.3396, expected range: 0.2292 11.9762
BUFR LAND SYNOP RH2M (%) 11244 : out of range
Severe: rms_fgdepar=38.3593, expected range: 0.0000 18.6462
BUFR LAND SYNOP RH2M (%) 06465 : out of range
Severe: rms_fgdepar=33.6837, expected range: 0.0000 18.4317
BUFR LAND SYNOP RH2M (%) 14248 : out of range
Severe: rms_fgdepar=33.6316, expected range: 0.0000 16.1449
BUFR LAND SYNOP RH2M (%) 11078 : out of range
Severe: rms_fgdepar=32.5013, expected range: 0.0000 13.6899
BUFR LAND SYNOP RH2M (%) 26078 : out of range
Severe: avg_fgdepar=52.7568, expected range: -34.5936 29.1392
Severe: rms_fgdepar=53.1535, expected range: 0.0000 24.4084
Severe: avg_pge=0.9350, expected range: -0.0003 0.0067
BUFR LAND SYNOP RH2M (%) 11298 : out of range
Severe: rms_fgdepar=43.0012, expected range: 2.6856 13.3728
BUFR LAND SYNOP SURFACE PRESSURE (PA) 22100 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=305.2809, expected range: 18.0760 170.0826
Severe: avg_pge=0.8094, expected range: -0.4165 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 25400 : out of range
Severe: rms_fgdepar=549.0412, expected range: 0.0000 171.5884
BUFR LAND SYNOP SURFACE PRESSURE (PA) 16190 : out of range
Severe: rms_fgdepar=393.2411, expected range: 0.0000 127.6132
BUFR LAND SYNOP SURFACE PRESSURE (PA) 29481 : out of range
Severe: rms_fgdepar=323.3511, expected range: 0.0000 119.1125
BUFR LAND SYNOP SURFACE PRESSURE (PA) 29122 : out of range
Severe: rms_fgdepar=352.8439, expected range: 0.0000 172.4406
BUFR LAND SYNOP SURFACE PRESSURE (PA) 24933 : out of range
Severe: rms_fgdepar=628.8616, expected range: 0.0000 106.8716
BUFR LAND SYNOP SURFACE PRESSURE (PA) 48064 : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=-613.1592, expected range: -575.8942 213.6255
Severe: rms_fgdepar=717.1573, expected range: 0.0000 638.8931
Severe: avg_pge=0.8345, expected range: -0.6294 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 23606 : out of range
Severe: rms_fgdepar=548.2590, expected range: 0.0000 143.0277
BUFR LAND SYNOP SURFACE PRESSURE (PA) : out of range
3 times in the last 10 days for at least one item
Severe: rms_fgdepar=197.8751, expected range: 112.2715 157.7697
MANUAL LAND SYNOP SURFACE PRESSURE (PA) : out of range
1 times in the last 10 days for at least one item
Considerable: obs_number=183.0000, expected range: 54.6763 116.0737
Considerable: obs_number=99.0000, expected range: 54.3438 78.3229
ship
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 9V9402 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=566.7336, expected range: 366.1876 1045.4737
Severely_persistent: rms_fgdepar=568.6731, expected range: 371.2223 1042.6420
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 9V3286 : out of range
5 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=505.6024, expected range: 0.0000 969.4128
BUFR SHIP SYNOP SURFACE PRESSURE (PA) C6TQ6 : out of range
26 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-666.5729, expected range: -834.9932 -474.6917
Severely_persistent: rms_fgdepar=667.4125, expected range: 480.1883 831.2321
BUFR SHIP SYNOP SURFACE PRESSURE (PA) VRHY7 : out of range
9 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8346, expected range: 0.5235 0.7500
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) EUCDE56 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=20.4928, expected range: -16.7312 46.5302
Severely_persistent: rms_fgdepar=20.4928, expected range: 0.0000 46.7439
Severely_persistent: avg_pge=0.9112, expected range: 0.1395 0.7500
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) VEP717 : out of range
5 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8494, expected range: 0.1292 0.7500
SHIP SURFACE PRESSURE (PA) V7DR9 : out of range
Severe: avg_fgdepar=-572.6132, expected range: -261.4492 244.8221
Severe: rms_fgdepar=572.6132, expected range: 0.0000 321.4280
Severe: avg_pge=0.8747, expected range: -0.9792 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) OUHC2 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=514.7739, expected range: 0.0000 220.6978
BUFR SHIP SYNOP SURFACE PRESSURE (PA) V7YW2 : out of range
Severe: avg_fgdepar=-738.2493, expected range: -555.3927 -87.4839
Severe: rms_fgdepar=738.2493, expected range: 87.4839 555.3927
Severe: avg_pge=0.8707, expected range: 0.4685 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) VRRP8 : out of range
Severe: rms_fgdepar=403.9768, expected range: 0.0000 303.1662
Severe: avg_pge=0.8016, expected range: -0.7117 0.7500
buoy
MOORED BUOYS SURFACE PRESSURE (PA) 4400062 : out of range
7 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8553, expected range: -1.1714 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 6202694 : out of range
25 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-539.3298, expected range: -1309.0315 700.6114
Severely_persistent: rms_fgdepar=540.2461, expected range: 0.0000 1262.1016
Severely_persistent: avg_pge=0.8937, expected range: -0.6577 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 4402687 : out of range
5 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=512.6318, expected range: -242.8961 345.2206
Severely_persistent: avg_pge=0.8437, expected range: -0.8790 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 4101719 : out of range
3 times in the last 10 days for at least one item
Severe: rms_fgdepar=511.3089, expected range: 0.0000 104.3251
Severe: avg_pge=0.8757, expected range: -0.1103 0.1348
DRIFTING BUOYS SURFACE PRESSURE (PA) : out of range
Considerable: obs_number=2733.0000, expected range: 2395.2223 2551.2483
Considerable: obs_number=543.0000, expected range: 405.1863 485.4020
snow
AUTOMATIC LAND SYNOP SNOW (CM) 71743 : out of range
18 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-76.4433, expected range: -82.4805 -68.6129
Severely_persistent: rms_fgdepar=76.4433, expected range: 68.6129 82.4805
AUTOMATIC LAND SYNOP SNOW (CM) 71576 : out of range
18 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-56.5602, expected range: -59.5004 -56.0882
Severely_persistent: rms_fgdepar=56.5602, expected range: 56.0882 59.5004
MANUAL LAND SYNOP SNOW (CM) 71816 : out of range
32 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-73.2506, expected range: -82.0968 -42.1721
Severely_persistent: rms_fgdepar=73.2547, expected range: 42.1791 82.1028
BUFR LAND SYNOP SNOW (CM) 01192 : out of range
38 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-64.5757, expected range: -82.7264 -62.4576
Severely_persistent: rms_fgdepar=64.6069, expected range: 62.4579 82.7305
BUFR LAND SYNOP SNOW (CM) 01435 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=51.0589, expected range: 44.2235 56.6255
Severely_persistent: rms_fgdepar=51.0963, expected range: 44.3342 56.5525
BUFR LAND SYNOP SNOW (CM) 71816 : out of range
32 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-73.2050, expected range: -81.9487 -42.1590
Severely_persistent: rms_fgdepar=73.2091, expected range: 42.1658 81.9574
BUFR LAND SYNOP SNOW (CM) 01036 : out of range
24 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-53.2323, expected range: -72.3192 -41.6524
Severely_persistent: rms_fgdepar=53.2323, expected range: 41.6724 72.3248
AUTOMATIC LAND SYNOP SNOW (CM) 71134 : out of range
Severe: avg_fgdepar=-51.7697, expected range: -46.7918 -42.8211
Severe: rms_fgdepar=51.7697, expected range: 42.8211 46.7918
MANUAL LAND SYNOP SNOW (CM) 14219 : out of range
Severe: rms_fgdepar=21.9510, expected range: -0.3061 0.5343
t2m
MANUAL LAND SYNOP 2M TEMPERATURE (K) 24477 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-14.6383, expected range: -18.3202 13.0452
Severely_persistent: rms_fgdepar=14.6383, expected range: 0.0000 15.8067
BUFR LAND SYNOP 2M TEMPERATURE (K) 24477 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-14.6883, expected range: -18.3703 12.9952
Severely_persistent: rms_fgdepar=14.6883, expected range: 0.0000 15.9032
MANUAL LAND SYNOP 2M TEMPERATURE (K) 72410 : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=13.6853, expected range: -4.0332 18.3773
Severe: rms_fgdepar=13.6853, expected range: 0.0000 18.3773
MANUAL LAND SYNOP 2M TEMPERATURE (K) 25335 : out of range
Severe: avg_fgdepar=-12.5361, expected range: -14.0629 10.6166
Severe: rms_fgdepar=12.5594, expected range: 0.0000 11.5347
MANUAL LAND SYNOP 2M TEMPERATURE (K) 25248 : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=-12.5845, expected range: -17.8375 10.9434
Severe: rms_fgdepar=12.5845, expected range: 0.0000 15.8312
METAR 2M TEMPERATURE (K) OPSW : out of range
Severe: avg_fgdepar=-13.5865, expected range: -12.0793 -0.7044
Severe: rms_fgdepar=14.0014, expected range: 1.6752 12.1819
LAND TEMP 2M TEMPERATURE (K) 04220 : out of range
Severe: avg_fgdepar=15.7723, expected range: -5.8626 4.6262
Severe: rms_fgdepar=15.7723, expected range: 0.0000 4.8171
BUFR LAND SYNOP 2M TEMPERATURE (K) 25335 : out of range
Severe: avg_fgdepar=-12.6599, expected range: -14.1410 10.5816
Severe: rms_fgdepar=12.6833, expected range: 0.0000 11.6684
BUFR LAND SYNOP 2M TEMPERATURE (K) 25248 : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=-12.6151, expected range: -17.8650 10.8727
Severe: rms_fgdepar=12.6151, expected range: 0.0000 15.9032
BUFR LAND SYNOP 2M TEMPERATURE (K) : out of range
Considerable: obs_number=178.0000, expected range: 120.6378 139.5975
rh2m
MANUAL LAND SYNOP RH2M (%) 82191 : out of range
Severe: rms_fgdepar=30.4942, expected range: 0.0000 16.1337