Operational Data Checking

An automatic data checking system has been implemented at ECMWF to trigger warnings in case of anomalies affecting the quality or the availability of the data assimilated by the model. Selected statistical parameters (number of observations, bias correction, and mean bias-corrected background, analysis departures and probability of gross error) are checked against an expected range. An appropriate alert message (including a time series plot) is generated if statistics are outside the specified ranges. A severity level (slight, considerable, severe) is assigned to each message depending on how far statistics are from the expected values. Two kinds of ranges are used by the automatic checking: Soft and Hard limits. Soft limits are updated automatically using statistics from the last twenty days (extremes are excluded during this process). Hard limits are adjusted manually when required.

Currently, the automatic checking is limited to data passing through the minimisation process (including VarBC passive data). It's being applied twice a day to the delayed cut-off 4D-VAR cycles (00 and 12) and four times a day to the early delivery assimilation system (00,06,12 and 18).

The alarm system results are based on feedback information from the ECMWF data assimilation and consequently reflect the ECMWF data usage. Although most warnings are related to data problems, they may on occasion also be related to model issues. Alerts are provided for information on an as-is basis and may be withdrawn or changed without notice. ECMWF accepts no responsibility for actions taken on the basis of these results.

Delayed cut-off 4DVAR at 2022-08-15 00:00

amsua
NOAA-19 AMSUA ALL SKY RADIANCES CHANNEL 8 : out of range
5 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.0182, expected range: -0.4931 -0.2586
iasi
METOP-B IASI RADIANCES CHANNEL 284 : out of range
2 times in the last 10 days for at least one item
Considerable: avg_biascorr=-0.0099, expected range: -0.0306 -0.0170
cris
All NPP CRIS ALL CHANNELS Global : all data missing
Severely_persistent: obs_number=0, expected range: 14977.99 15832.95
atms
All NPP ATMS ALL CHANNELS Global : all data missing
Severely_persistent: obs_number=0, expected range: 11500.42 13940.17
gpsro
All KOMPSAT-5 GPSRO SETTING ALL HEIGHTS Global : all data missing
Severe: obs_number=0, expected range: 132.89 717.41
Atmospheric Motion Vector
All AQUA MODIS CLEAR WV ALL LAYERS Global : all data missing
Severely_persistent: obs_number=0, expected range: 118.44 1097.51
All NPP VIIRS AMV IR ALL LAYERS Global : all data missing
Severely_persistent: obs_number=0, expected range: 183.86 1421.23
Radiosondes
LAND TEMP Q (G/KG) 36872 PRESSURE LAYER 900-1200 (HPA) : out of range
7 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=7.3922, expected range: -2.0223 7.8232
Severely_persistent: rms_fgdepar=7.3922, expected range: 0.0000 7.6286
All HIGH RESO LAND TEMP ALL LAYERS WMO BLOCK 46 : all data missing
Severely_persistent: obs_number=0, expected range: 108.76 517.71
All HIGH RESO SEA TEMP ALL LAYERS North East Pacific : all data missing
Severely_persistent: obs_number=0, expected range: 41.70 312.68
All BUFR TEMP DESCENT ALL LAYERS North pole : all data missing
Severely_persistent: obs_number=0, expected range: 84.68 106.17
LAND TEMP Q (G/KG) 97900 PRESSURE LAYER 900-1200 (HPA) : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=3.3043, expected range: 0.2836 1.6528
LAND TEMP Q (G/KG) 06060 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: avg_fgdepar=-6.4101, expected range: -1.1059 1.3677
Severe: rms_fgdepar=6.4101, expected range: 0.0000 3.1469
LAND TEMP TEMPERATURE (K) 36003 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=6.2796, expected range: 0.0000 3.5669
LAND TEMP WIND VECTOR DIFF (M/S) 30054 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=18.6177, expected range: 1.1929 4.3763
LAND TEMP WIND VECTOR DIFF (M/S) 29231 PRESSURE LAYER 900-1200 (HPA) : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=16.2395, expected range: 0.0000 6.5574
Severe: avg_pge=0.8922, expected range: -0.8058 0.7500
LAND TEMP WIND VECTOR DIFF (M/S) 91376 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=16.1780, expected range: 0.0000 6.2766
LAND TEMP WIND VECTOR DIFF (M/S) 30309 PRESSURE LAYER 900-1200 (HPA) : out of range
1 times in the last 10 days for at least one item
Severe: avg_fgdepar=29.9696, expected range: -6.6420 11.3495
Severe: rms_fgdepar=29.9696, expected range: 0.0000 11.3417
Severe: avg_pge=0.9450, expected range: -1.3419 0.7500
HIGH RESO LAND TEMP Q (G/KG) 94998 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=2.3397, expected range: 0.0000 0.7067
HIGH RESO LAND TEMP WIND VECTOR DIFF (M/S) PRESSURE LAYER 300-600 (HPA : missing
2 times in the last 10 days for at least one item
Severe: obs_number=0.0000, expected range: 0.0000 269.2115
BUFR TEMP DESCENT Q (G/KG) 10035 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=2.5536, expected range: 0.0000 1.1916
All BUFR TEMP DESCENT ALL LAYERS North Atlantic : all data missing
Severe: obs_number=0, expected range: 61.43 136.90
HIGH RESO LAND TEMP TEMPERATURE (K) (2 pressure layers affected) : out of range
Considerable: obs_number=652.0000, expected range: 552.4856 573.0144
BUFR TEMP DESCENT Q (G/KG) PRESSURE LAYER 900-1200 (HPA) : out of range
1 times in the last 10 days for at least one item
Slight: rms_fgdepar=1.0597, expected range: 0.1020 1.0080
amdar
ADS-C WIND VECTOR DIFF (M/S) NTQKG1BA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=17.6575, expected range: 0.0000 8.0557
ADS-C WIND VECTOR DIFF (M/S) ETASO5BA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: avg_fgdepar=20.4305, expected range: -2.7144 9.3008
Severe: rms_fgdepar=20.4305, expected range: 0.0000 11.0115
ADS-C WIND VECTOR DIFF (M/S) 5B5F5EBA PRESSURE LAYER 0-300 (HPA) : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=24.3822, expected range: 0.0000 19.7968
ADS-C WIND VECTOR DIFF (M/S) SRAHMGBA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=15.7813, expected range: 0.2860 6.8959
ADS-C WIND VECTOR DIFF (M/S) Y5FYCOBA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=18.7947, expected range: 0.0000 9.3463
ADS-C WIND VECTOR DIFF (M/S) RF0DPMJA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=17.5831, expected range: 0.0000 7.7051
ADS-C WIND VECTOR DIFF (M/S) J4RYCOJA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=16.3303, expected range: 0.0000 7.1888
ADS-C WIND VECTOR DIFF (M/S) NMXX1TJA PRESSURE LAYER 0-300 (HPA) : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=17.8591, expected range: 0.0000 7.8714
ADS-C WIND VECTOR DIFF (M/S) E15SBZJA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=15.1994, expected range: 1.0247 5.1956
ADS-C WIND VECTOR DIFF (M/S) PIKRV4RA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=18.6386, expected range: 0.0000 9.2593
ADS-C WIND VECTOR DIFF (M/S) 4MVHHLRA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=19.1900, expected range: 0.1645 7.2482
ADS-C WIND VECTOR DIFF (M/S) IEYF5URA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=34.8221, expected range: 0.6265 5.6785
ADS-C WIND VECTOR DIFF (M/S) GYOTA4ZA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=23.8746, expected range: 0.9563 5.6955
ADS-C WIND VECTOR DIFF (M/S) G0Q0Q5ZA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=23.8743, expected range: 0.0000 9.3841
ADS-C WIND VECTOR DIFF (M/S) LIFMAAZA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=19.0960, expected range: 0.4445 6.1543
ADS-C WIND VECTOR DIFF (M/S) SN3SPDZA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=20.1661, expected range: 0.3647 8.0044
ADS-C WIND VECTOR DIFF (M/S) 0NRTSKZA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=24.7938, expected range: 0.0000 10.5540
ADS-C WIND VECTOR DIFF (M/S) 3TQEILZA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=22.7095, expected range: 0.0000 6.8915
ADS-C WIND VECTOR DIFF (M/S) 1AQICMZA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=18.7465, expected range: 0.0000 7.9964
airep
AIREP WIND VECTOR DIFF (M/S) ETD140 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=20.2435, expected range: 0.0000 14.1046
AIREP WIND VECTOR DIFF (M/S) AAL150 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=21.1634, expected range: 0.0000 7.8772
AIREP WIND VECTOR DIFF (M/S) UAL970 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=15.6897, expected range: 0.0000 6.6029
AIREP WIND VECTOR DIFF (M/S) ACA854 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=19.5602, expected range: 0.0697 6.7714
AIREP WIND VECTOR DIFF (M/S) AAL86 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=16.2714, expected range: 0.0000 8.6202
AIREP WIND VECTOR DIFF (M/S) UAL987 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=18.6054, expected range: 0.0000 10.3634
AIREP WIND VECTOR DIFF (M/S) THY7LK PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=19.0208, expected range: 0.0000 7.5179
AIREP WIND VECTOR DIFF (M/S) BAW24R PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=21.0292, expected range: 0.0000 8.4174
prof
EUROPEAN WIND PROFILER VECTOR DIFF (M/S) 07460 PRESSURE LAYER 900-1200 : out of range
Severe: rms_fgdepar=17.4460, expected range: 0.0000 13.3215
Severe: avg_pge=0.8952, expected range: -0.3927 0.7500
pilot
LAND PILOT WIND VECTOR DIFF (M/S) 42701 (2 pressure layers affected) : out of range
1 times in the last 10 days for at least one item
Severe: avg_fgdepar=20.6315, expected range: 7.6597 23.1678
Severe: rms_fgdepar=21.0570, expected range: 7.5948 23.4557
LAND PILOT WIND VECTOR DIFF (M/S) 42701 (3 pressure layers affected) : out of range
Severe: avg_pge=0.8077, expected range: 0.2925 0.7500
LAND PILOT WIND VECTOR DIFF (M/S) 42123 PRESSURE LAYER 300-600 (HPA) : out of range
Severe: rms_fgdepar=16.7732, expected range: 0.3576 4.8094
synop
AUTOMATIC LAND SYNOP SURFACE PRESSURE (PA) 41244 : out of range
5 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8921, expected range: -0.1338 0.7500
AUTOMATIC LAND SYNOP RH2M (%) 18156 : out of range
21 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-54.0340, expected range: -64.8980 -33.2040
Severely_persistent: rms_fgdepar=54.2413, expected range: 33.1104 65.1420
Severely_persistent: avg_pge=0.9918, expected range: -0.5805 0.7500
AUTOMATIC LAND SYNOP SURFACE PRESSURE (PA) 17928 : out of range
3 times in the last 10 days for at least one item
Severe: rms_fgdepar=518.3669, expected range: 52.5223 1226.7257
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 60430 : out of range
3 times in the last 10 days for at least one item
Severe: avg_pge=0.8286, expected range: 0.5507 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 42811 : out of range
Severe: rms_fgdepar=360.9284, expected range: 0.0000 116.4302
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 37621 : out of range
Severe: rms_fgdepar=384.8932, expected range: 0.0000 119.0558
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 42571 : out of range
Severe: rms_fgdepar=569.1776, expected range: 0.0000 234.8614
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 47022 : out of range
Severe: avg_fgdepar=659.5895, expected range: -140.2403 202.7139
Severe: rms_fgdepar=662.5919, expected range: 0.0000 157.2313
Severe: avg_pge=0.8839, expected range: -0.9678 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 38396 : out of range
Severe: rms_fgdepar=591.7933, expected range: 29.5818 172.6772
MANUAL LAND SYNOP Z (M) 38856 : out of range
Severe: avg_pge=0.8783, expected range: -0.5864 0.7500
MANUAL LAND SYNOP RH2M (%) 41710 : out of range
Severe: rms_fgdepar=32.4432, expected range: 0.0000 16.5453
Severe: avg_pge=0.8145, expected range: 0.0016 0.0038
MANUAL LAND SYNOP RH2M (%) 62120 : out of range
3 times in the last 10 days for at least one item
Severe: avg_pge=0.9041, expected range: -0.0170 0.0281
BUFR LAND SYNOP SURFACE PRESSURE (PA) 17282 : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=303.9816, expected range: 0.0000 71.8162
Severe: avg_pge=0.8365, expected range: -0.1344 0.1626
BUFR LAND SYNOP SURFACE PRESSURE (PA) 41764 : out of range
Severe: rms_fgdepar=303.8663, expected range: 0.0000 256.7852
Severe: avg_pge=0.8475, expected range: -1.3301 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 36736 : out of range
Severe: rms_fgdepar=306.0322, expected range: 0.0000 238.6458
Severe: avg_pge=0.8351, expected range: -0.7352 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 60507 : out of range
4 times in the last 10 days for at least one item
Severe: avg_pge=0.8291, expected range: 0.2772 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 23657 : out of range
Severe: rms_fgdepar=468.1500, expected range: 0.0000 155.1049
BUFR LAND SYNOP RH2M (%) 72672 : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=45.1644, expected range: 0.0000 23.5463
ship
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) A8FG3 : out of range
9 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=25.9774, expected range: -18.5807 34.2156
Severely_persistent: rms_fgdepar=25.9774, expected range: 0.0000 40.6181
Severely_persistent: avg_pge=0.9309, expected range: -0.8779 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 9V3735 : out of range
12 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=967.5832, expected range: -36.3690 2114.1723
Severely_persistent: rms_fgdepar=967.5832, expected range: 0.0000 2117.6813
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 3ETR7 : out of range
5 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=989.4998, expected range: -488.0802 1179.9014
Severely_persistent: rms_fgdepar=989.4998, expected range: 0.0000 1206.3418
Severely_persistent: avg_pge=0.8997, expected range: -0.6224 0.7500
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) ZMMC : out of range
Severe: avg_pge=0.8987, expected range: -0.7144 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 9V7980 : out of range
3 times in the last 10 days for at least one item
Severe: avg_fgdepar=548.1293, expected range: -1018.4536 1142.3216
Severe: rms_fgdepar=548.1293, expected range: 0.0000 885.6193
Severe: avg_pge=0.8056, expected range: -1.2460 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) VRLJ4 : out of range
Severe: avg_fgdepar=1084.9963, expected range: -97.8666 2170.1132
Severe: rms_fgdepar=1084.9963, expected range: 0.0000 2171.7291
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 9HA5028 : out of range
Severe: avg_fgdepar=-545.7709, expected range: -388.4776 252.8493
Severe: rms_fgdepar=545.7709, expected range: 0.0000 342.3728
Severe: avg_pge=0.8335, expected range: -0.4873 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) PHDL : out of range
Severe: avg_fgdepar=-515.8492, expected range: -199.7727 135.1424
Severe: rms_fgdepar=515.8492, expected range: 0.0000 211.6429
Severe: avg_pge=0.8272, expected range: -0.3613 0.4151
buoy
DRIFTING BUOYS SURFACE PRESSURE (PA) 1501741 : out of range
22 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=513.6960, expected range: 0.0000 1332.5121
Severely_persistent: avg_pge=0.8802, expected range: -0.0904 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 5401576 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-750.4105, expected range: -1537.6535 586.3309
Severely_persistent: rms_fgdepar=750.4105, expected range: 0.0000 1356.4178
Severely_persistent: avg_pge=0.9251, expected range: 0.0520 0.7500
MOORED BUOYS SURFACE PRESSURE (PA) 2200108 : out of range
Severe: rms_fgdepar=389.2524, expected range: 0.0000 122.1796
DRIFTING BUOYS SURFACE PRESSURE (PA) 5102811 : out of range
Severe: avg_fgdepar=-502.5837, expected range: -447.7359 371.4617
Severe: rms_fgdepar=505.2715, expected range: 0.0000 338.8119
Severe: avg_pge=0.8918, expected range: -0.8227 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 5601693 : out of range
Severe: avg_fgdepar=601.5733, expected range: -217.9372 150.5590
Severe: rms_fgdepar=604.0418, expected range: 0.0000 197.6140
Severe: avg_pge=0.8869, expected range: -0.0911 0.1242
DRIFTING BUOYS SURFACE PRESSURE (PA) 4801707 : out of range
4 times in the last 10 days for at least one item
Severe: rms_fgdepar=441.1516, expected range: 0.0000 271.6591
Severe: avg_pge=0.8777, expected range: -0.3150 0.7500
metar
METAR SURFACE PRESSURE (PA) GOGG : out of range
Severe: rms_fgdepar=410.8968, expected range: 0.0000 187.5710
snow
MANUAL LAND SYNOP SNOW (CM) 37552 : out of range
21 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=56.5000, expected range: 16.6467 96.4866
Severely_persistent: rms_fgdepar=57.1358, expected range: 19.7072 95.2417
BUFR LAND SYNOP SNOW (CM) _MF1EB15 : out of range
38 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-772.8368, expected range: -773.0454 -772.3656
BUFR LAND SYNOP SNOW (CM) _MF1EB15 : out of range
38 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=772.8368, expected range: 772.3658 773.0453
t2m
BUFR LAND SYNOP 2M TEMPERATURE (K) 80010 : out of range
11 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=16.1276, expected range: -9.1966 19.9224
Severely_persistent: rms_fgdepar=16.1276, expected range: 0.0000 19.0628
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 68398 : out of range
Severe: avg_fgdepar=14.5763, expected range: -5.5952 8.4361
Severe: rms_fgdepar=14.5763, expected range: -5.2790 10.2094
METAR 2M TEMPERATURE (K) RODN : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=14.0711, expected range: 0.0000 3.4620
METAR 2M TEMPERATURE (K) KHWO : out of range
Severe: rms_fgdepar=11.0789, expected range: 0.1744 4.0135
BUFR LAND SYNOP 2M TEMPERATURE (K) 89504 : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=12.4701, expected range: -0.7773 15.7343
Severe: rms_fgdepar=12.4828, expected range: 0.0000 15.7378
BUFR LAND SYNOP 2M TEMPERATURE (K) _MI158E9 : out of range
4 times in the last 10 days for at least one item
Severe: avg_fgdepar=-17.7083, expected range: -22.4641 -12.9021
BUFR LAND SYNOP 2M TEMPERATURE (K) _MI158E9 : out of range
4 times in the last 10 days for at least one item
Severe: rms_fgdepar=17.7244, expected range: 12.9276 22.4656
BUFR LAND SYNOP 2M TEMPERATURE (K) : out of range
4 times in the last 10 days for at least one item
Severe: avg_lsm=0.8366, expected range: 0.9244 0.9626
rh2m
MANUAL LAND SYNOP RH2M (%) 60417 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=32.9260, expected range: 0.0000 8.7356
METAR RH2M (%) KBLI : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=36.2001, expected range: 0.0000 18.8361
BUFR LAND SYNOP RH2M (%) : out of range
4 times in the last 10 days for at least one item
Severe: avg_lsm=0.8328, expected range: 0.9059 0.9657