Operational Data Checking

An automatic data checking system has been implemented at ECMWF to trigger warnings in case of anomalies affecting the quality or the availability of the data assimilated by the model. Selected statistical parameters (number of observations, bias correction, and mean bias-corrected background, analysis departures and probability of gross error) are checked against an expected range. An appropriate alert message (including a time series plot) is generated if statistics are outside the specified ranges. A severity level (slight, considerable, severe) is assigned to each message depending on how far statistics are from the expected values. Two kinds of ranges are used by the automatic checking: Soft and Hard limits. Soft limits are updated automatically using statistics from the last twenty days (extremes are excluded during this process). Hard limits are adjusted manually when required.

Currently, the automatic checking is limited to data passing through the minimisation process (including VarBC passive data). It's being applied twice a day to the delayed cut-off 4D-VAR cycles (00 and 12) and four times a day to the early delivery assimilation system (00,06,12 and 18).

The alarm system results are based on feedback information from the ECMWF data assimilation and consequently reflect the ECMWF data usage. Although most warnings are related to data problems, they may on occasion also be related to model issues. Alerts are provided for information on an as-is basis and may be withdrawn or changed without notice. ECMWF accepts no responsibility for actions taken on the basis of these results.

Delayed cut-off 4DVAR at 2022-08-16 00:00

amsua
NOAA-15 AMSUA ALL SKY RADIANCES CHANNEL 13 : out of range
7 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.0379, expected range: -0.0073 0.0282
NOAA-19 AMSUA ALL SKY RADIANCES CHANNEL 8 : out of range
7 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.0843, expected range: -0.4971 -0.2586
iasi
METOP-C IASI RADIANCES CHANNEL 5379 : out of range
5 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.1499, expected range: -0.1300 -0.1165
METOP-B IASI RADIANCES (176 channels affected) : out of range
Severe: obs_number=1818.0000, expected range: 6074.6730 7099.2020
METOP-C IASI RADIANCES (218 channels affected) : out of range
Severe: obs_number=1809.0000, expected range: 5982.2881 7247.0869
cris
All NPP CRIS ALL CHANNELS Global : all data missing
Severely_persistent: obs_number=0, expected range: 14969.75 15838.06
NOAA20 CRIS RADIANCES CHANNEL 594 : out of range
16 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.0470, expected range: -0.0616 -0.0551
NOAA20 CRIS RADIANCES CHANNEL 598 : out of range
16 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.0584, expected range: -0.0697 -0.0644
mwhs2
FY-3C MWHS2 ALLSKY RADIANCES CHANNEL 14 : out of range
1 times in the last 10 days for at least one item
Considerable: avg_biascorr=3.1519, expected range: 3.8734 5.1285
atms
All NPP ATMS ALL CHANNELS Global : all data missing
Severely_persistent: obs_number=0, expected range: 11599.55 13890.70
gpsro
METOP-B GRAS RISING (24 impact heights affected) : out of range
Slight: obs_number=926.0000, expected range: 1106.7800 1699.5950
METOP-C GRAS SETTING (24 impact heights affected) : out of range
2 times in the last 10 days for at least one item
Slight: obs_number=1161.0000, expected range: 1513.4150 2011.5850
Atmospheric Motion Vector
All AQUA MODIS CLEAR WV ALL LAYERS Global : all data missing
Severely_persistent: obs_number=0, expected range: 41.55 1189.83
All NPP VIIRS AMV IR ALL LAYERS Global : all data missing
Severely_persistent: obs_number=0, expected range: 192.48 1431.33
GOES-17 AMV VIS1 WIND VECTOR DIFF (M/S) PRESSURE LAYER 900-1200 (HPA) : out of range
Considerable: obs_number=5450.0000, expected range: 14809.4535 20963.0465
Radiosondes
LAND TEMP Q (G/KG) 38341 PRESSURE LAYER 900-1200 (HPA) : out of range
14 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=6.0279, expected range: 0.1884 9.5846
Severely_persistent: rms_fgdepar=6.0279, expected range: 0.3980 9.4687
LAND TEMP WIND VECTOR DIFF (M/S) 42701 PRESSURE LAYER 0-300 (HPA) : out of range
7 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=25.3740, expected range: 6.0040 38.2000
Severely_persistent: rms_fgdepar=25.9688, expected range: 5.5876 39.6121
Severely_persistent: avg_pge=0.8247, expected range: 0.6165 0.7500
All HIGH RESO LAND TEMP ALL LAYERS WMO BLOCK 46 : all data missing
Severely_persistent: obs_number=0, expected range: 94.75 521.66
All HIGH RESO SEA TEMP ALL LAYERS North East Pacific : all data missing
Severely_persistent: obs_number=0, expected range: 5.55 355.29
All BUFR TEMP DESCENT ALL LAYERS North pole : all data missing
Severely_persistent: obs_number=0, expected range: 91.25 101.08
LAND TEMP TEMPERATURE (K) 36096 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=7.6343, expected range: 0.4658 2.7448
LAND TEMP TEMPERATURE (K) 36872 PRESSURE LAYER 600-900 (HPA) : out of range
Severe: rms_fgdepar=9.7218, expected range: 0.0000 4.9872
LAND TEMP WIND VECTOR DIFF (M/S) 36003 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=15.6899, expected range: 0.2181 5.8047
LAND TEMP WIND VECTOR DIFF (M/S) 32215 PRESSURE LAYER 900-1200 (HPA) : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=20.1197, expected range: -5.7836 12.1503
Severe: avg_pge=0.9054, expected range: -0.8344 0.7500
HIGH RESO LAND TEMP Q (G/KG) 72240 PRESSURE LAYER 600-900 (HPA) : out of range
Severe: rms_fgdepar=4.3838, expected range: 0.0000 1.8948
HIGH RESO LAND TEMP Q (G/KG) 47155 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=4.8204, expected range: 0.0000 2.2816
HIGH RESO LAND TEMP Q (G/KG) 47138 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=3.8335, expected range: 0.3084 1.8561
HIGH RESO LAND TEMP TEMPERATURE (K) 30673 PRESSURE LAYER 900-1200 (HPA : out of range
2 times in the last 10 days for at least one item
Severe: avg_pge=0.8060, expected range: -1.0784 0.7500
HIGH RESO LAND TEMP TEMPERATURE (K) (2 pressure layers affected) : out of range
1 times in the last 10 days for at least one item
Severe: obs_number=749.0000, expected range: 553.5000 573.5000
HIGH RESO LAND TEMP WIND VECTOR DIFF (M/S) 16245 (3 pressure layers af : out of range
Severe: rms_fgdepar=17.1539, expected range: 2.7369 4.4264
HIGH RESO LAND TEMP WIND VECTOR DIFF (M/S) 51839 PRESSURE LAYER 0-300 : out of range
Severe: rms_fgdepar=17.1076, expected range: 0.3778 5.6063
All HIGH RESO LAND TEMP ALL LAYERS WMO BLOCK 42 : all data missing
Severe: obs_number=0, expected range: 0.00 321.89
All BUFR TEMP DESCENT ALL LAYERS North Atlantic : all data missing
Severe: obs_number=0, expected range: 65.02 136.58
HIGH RESO LAND TEMP Q (G/KG) PRESSURE LAYER 900-1200 (HPA) : out of range
Slight: rms_fgdepar=1.4480, expected range: 1.0988 1.3922
amdar
AMDAR TEMPERATURE (K) 00000251 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=10.7226, expected range: 0.0000 3.6466
Severe: avg_pge=0.9211, expected range: -0.6579 0.7500
WIGOS AMDAR WIND VECTOR DIFF (M/S) EU1123 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=18.2081, expected range: 0.0000 6.8204
WIGOS AMDAR WIND VECTOR DIFF (M/S) EU1656 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=19.2086, expected range: 0.0000 9.4004
MODE-S WIND VECTOR DIFF (M/S) M54D3D1 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=17.0307, expected range: 0.0000 6.4085
MODE-S WIND VECTOR DIFF (M/S) MA07544 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=17.8068, expected range: 0.1274 5.6330
MODE-S WIND VECTOR DIFF (M/S) M1FC7E4 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=15.9505, expected range: 0.0000 7.5322
MODE-S WIND VECTOR DIFF (M/S) M7B0175 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=15.4219, expected range: 0.0000 5.7677
MODE-S WIND VECTOR DIFF (M/S) MF9BDC6 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=15.5945, expected range: 0.0000 6.9067
MODE-S WIND VECTOR DIFF (M/S) M225EE7 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=18.5641, expected range: 0.0000 6.3096
MODE-S WIND VECTOR DIFF (M/S) M775619 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=18.0087, expected range: 0.0000 7.1112
MODE-S WIND VECTOR DIFF (M/S) MA93659 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=16.2776, expected range: 0.0000 6.5009
MODE-S WIND VECTOR DIFF (M/S) M64513C PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=15.2092, expected range: 0.2670 4.9461
MODE-S WIND VECTOR DIFF (M/S) MD63C5C PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=17.1380, expected range: 0.0000 7.5107
MODE-S WIND VECTOR DIFF (M/S) MA9AE0D PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=17.5690, expected range: 0.0000 9.4831
ADS-C WIND VECTOR DIFF (M/S) BRNUU1BA PRESSURE LAYER 0-300 (HPA) : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=17.2661, expected range: 0.0000 6.6343
ADS-C WIND VECTOR DIFF (M/S) ENVEDQBA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=22.0479, expected range: 0.0000 15.9328
ADS-C WIND VECTOR DIFF (M/S) R0M2QHZA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=20.0283, expected range: 0.0000 23.0563
prof
EUROPEAN WIND PROFILER VECTOR DIFF (M/S) 07460 PRESSURE LAYER 900-1200 : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=22.7900, expected range: -0.4013 9.5591
Severe: rms_fgdepar=22.8625, expected range: 0.0000 13.0651
Severe: avg_pge=0.9303, expected range: -0.4509 0.7500
pilot
LAND PILOT WIND VECTOR DIFF (M/S) 42701 PRESSURE LAYER 0-300 (HPA) : out of range
12 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=22.9792, expected range: 10.9112 33.3063
Severely_persistent: rms_fgdepar=23.9853, expected range: 11.3839 33.9203
LAND PILOT WIND VECTOR DIFF (M/S) 89664 PRESSURE LAYER 900-1200 (HPA) : out of range
2 times in the last 10 days for at least one item
Severe: avg_pge=0.9170, expected range: -0.0321 0.7500
synop
AUTOMATIC LAND SYNOP SURFACE PRESSURE (PA) 17928 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-558.8249, expected range: -1686.4040 1040.4899
Severely_persistent: rms_fgdepar=588.3922, expected range: 53.6277 1190.1533
AUTOMATIC LAND SYNOP RH2M (%) 18156 : out of range
21 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-55.6500, expected range: -57.8026 -42.8250
Severely_persistent: rms_fgdepar=55.6500, expected range: 42.9111 57.8669
BUFR LAND SYNOP SURFACE PRESSURE (PA) 60507 : out of range
5 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8071, expected range: 0.2789 0.7500
AUTOMATIC LAND SYNOP RH2M (%) 68840 : out of range
Severe: avg_fgdepar=57.4034, expected range: -64.2644 71.9321
Severe: rms_fgdepar=57.4034, expected range: -44.1895 63.3234
Severe: avg_pge=0.9530, expected range: -0.1904 0.2364
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 60461 : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.8021, expected range: 0.6037 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 83912 : out of range
Severe: avg_fgdepar=-572.1100, expected range: -351.2569 -15.3290
Severe: rms_fgdepar=572.1100, expected range: 15.3290 351.2569
Severe: avg_pge=0.8792, expected range: -0.6574 0.7500
MANUAL LAND SYNOP RH2M (%) 60732 : out of range
Severe: rms_fgdepar=33.3098, expected range: 0.0000 14.4287
Severe: rms_fgdepar=33.9497, expected range: 0.0000 12.6543
MANUAL LAND SYNOP RH2M (%) 60775 : out of range
Severe: rms_fgdepar=49.7363, expected range: 0.0000 23.6591
BUFR LAND SYNOP SURFACE PRESSURE (PA) 42460 : out of range
Severe: avg_fgdepar=990.3640, expected range: -476.2791 273.2572
Severe: rms_fgdepar=990.3640, expected range: 0.0000 408.3968
Severe: avg_pge=0.9383, expected range: -1.2134 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 76581 : out of range
Severe: rms_fgdepar=384.0813, expected range: 0.0000 199.7037
BUFR LAND SYNOP SURFACE PRESSURE (PA) 94525 : out of range
Severe: avg_fgdepar=929.7111, expected range: -120.8188 95.4255
Severe: rms_fgdepar=929.7111, expected range: 0.0000 99.5301
Severe: avg_pge=0.9367, expected range: -0.3364 0.3818
BUFR LAND SYNOP SURFACE PRESSURE (PA) 04018 : out of range
Severe: rms_fgdepar=341.5813, expected range: 0.0000 92.2403
BUFR LAND SYNOP RH2M (%) 60520 : out of range
Severe: rms_fgdepar=43.5585, expected range: 0.0000 34.2911
Severe: avg_pge=0.9513, expected range: -0.0140 0.0231
BUFR LAND SYNOP RH2M (%) 71030 : out of range
Severe: avg_pge=0.8729, expected range: -0.1105 0.1501
BUFR LAND SYNOP RH2M (%) 81643 : out of range
2 times in the last 10 days for at least one item
Severe: avg_pge=0.9157, expected range: -1.3284 0.7500
BUFR LAND SYNOP RH2M (%) 62455 : out of range
Severe: rms_fgdepar=36.0255, expected range: 0.0000 25.7294
Severe: avg_pge=0.9815, expected range: -0.0118 0.0223
ship
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) S6OM : out of range
5 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8547, expected range: -0.7777 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 9V7980 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=662.4572, expected range: -1069.7519 1249.1741
Severely_persistent: rms_fgdepar=662.4572, expected range: 0.0000 902.9666
Severely_persistent: avg_pge=0.8516, expected range: -1.1522 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 9V3735 : out of range
14 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=896.8531, expected range: -36.3067 2058.7962
Severely_persistent: rms_fgdepar=896.8531, expected range: 0.0000 2062.1410
BUFR SHIP SYNOP SURFACE PRESSURE (PA) V7OJ5 : out of range
18 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=1169.6118, expected range: 829.6567 1551.1790
Severely_persistent: rms_fgdepar=1169.6118, expected range: 833.1211 1550.0509
BUFR SHIP SYNOP SURFACE PRESSURE (PA) C6NR7 : out of range
24 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8918, expected range: 0.0833 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) : out of range
7 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=569.7296, expected range: -1138.9747 1555.0541
Severely_persistent: rms_fgdepar=569.7296, expected range: 0.0000 1266.2893
Severely_persistent: avg_pge=0.8374, expected range: -1.3016 0.7500
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) 9HA4902 : out of range
Severe: rms_fgdepar=15.8464, expected range: 0.0000 10.8433
Severe: avg_pge=0.8536, expected range: -0.7625 0.7500
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) OYGM2 : out of range
Severe: rms_fgdepar=18.0600, expected range: 0.0000 8.3141
Severe: avg_pge=0.8943, expected range: -1.1045 0.7500
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) D7AR : out of range
2 times in the last 10 days for at least one item
Severe: avg_pge=0.9020, expected range: -1.1848 0.7500
BUFR SHIP SYNOP RH2M (%) V7A4221 : out of range
Severe: avg_pge=0.8098, expected range: -1.4510 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 9HA5180 : out of range
Severe: rms_fgdepar=660.5163, expected range: 0.0000 521.9726
BUFR SHIP SYNOP SURFACE PRESSURE (PA) OYGM2 : out of range
Severe: avg_fgdepar=-1220.5714, expected range: -228.8967 538.8346
Severe: rms_fgdepar=1220.5714, expected range: 0.0000 358.3150
Severe: avg_pge=0.9272, expected range: -0.8026 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) C6WW4 : out of range
Severe: rms_fgdepar=414.2089, expected range: 22.0849 160.2998
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 3E2426 : out of range
Severe: rms_fgdepar=609.8849, expected range: 0.0000 449.1754
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 9V6207 : out of range
3 times in the last 10 days for at least one item
Severe: avg_fgdepar=860.1232, expected range: -143.3345 428.8501
Severe: rms_fgdepar=868.1723, expected range: 0.0000 428.9649
Severe: avg_pge=0.8758, expected range: -0.7532 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) V7DS8 : out of range
Severe: avg_pge=0.8076, expected range: -0.7467 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) PHDL : out of range
3 times in the last 10 days for at least one item
Severe: rms_fgdepar=394.7056, expected range: 0.0000 191.0185
BUFR SHIP SYNOP SURFACE PRESSURE (PA) WMKN : out of range
Severe: rms_fgdepar=456.1077, expected range: 0.0000 205.8902
buoy
DRIFTING BUOYS SURFACE PRESSURE (PA) 5601693 : out of range
5 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=501.6829, expected range: -226.1436 164.1193
Severely_persistent: rms_fgdepar=501.9917, expected range: 0.0000 196.0156
Severely_persistent: avg_pge=0.9006, expected range: -0.0951 0.1246
DRIFTING BUOYS SURFACE PRESSURE (PA) 5401576 : out of range
9 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-643.1937, expected range: -1283.3377 92.6230
Severely_persistent: rms_fgdepar=644.3485, expected range: 0.0000 1435.1090
Severely_persistent: avg_pge=0.9169, expected range: 0.2325 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 4801707 : out of range
7 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8316, expected range: -0.4231 0.7500
metar
METAR SURFACE PRESSURE (PA) DTTX : out of range
Severe: rms_fgdepar=386.5225, expected range: 0.0000 80.7741
snow
MANUAL LAND SYNOP SNOW (CM) 37552 : out of range
21 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=66.0000, expected range: 19.2836 96.7831
Severely_persistent: rms_fgdepar=66.0303, expected range: 20.8287 96.1235
BUFR LAND SYNOP SNOW (CM) _MF1EB15 : out of range
38 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-772.5641, expected range: -773.0677 -772.3660
BUFR LAND SYNOP SNOW (CM) _MF1EB15 : out of range
38 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=772.5642, expected range: 772.3662 773.0676
t2m
BUFR LAND SYNOP 2M TEMPERATURE (K) _MI158E9 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-17.1828, expected range: -21.8733 -13.9255
BUFR LAND SYNOP 2M TEMPERATURE (K) _MI158E9 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=17.2005, expected range: 13.9822 21.8506
METAR 2M TEMPERATURE (K) LSMP : out of range
Severe: avg_fgdepar=-15.8595, expected range: -3.8456 4.7447
Severe: rms_fgdepar=15.8595, expected range: 0.0000 4.9063
METAR 2M TEMPERATURE (K) KRIV : out of range
Severe: avg_fgdepar=-14.8224, expected range: -8.6702 8.1719
Severe: rms_fgdepar=14.8224, expected range: 1.1377 4.8753
METAR 2M TEMPERATURE (K) MMMV : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=12.3026, expected range: 0.0000 4.9357
rh2m
MANUAL LAND SYNOP RH2M (%) 67861 : out of range
Severe: rms_fgdepar=31.0663, expected range: 0.0000 16.8367
MANUAL LAND SYNOP RH2M (%) 61017 : out of range
Severe: rms_fgdepar=39.3980, expected range: 0.0000 21.7417
All BUFR LAND SYNOP WMO BLOCK 66 : all data missing
Severe: obs_number=0, expected range: 65.42 366.43