Climate metrics jobsTimes in UTC

Failures

MongoDB keeps a finished job 7 days; the error's traceback is in the worker's logs.

What fails

4,151 failures, by kind and step

KindStepFailuresShareLast
compute_errorS3_ALGO_PHYSICAL_ERROR4,149100 %2 Oct 23:33:10
infrastructureS3_ALGO_PHYSICAL_ERROR20 %3 Oct 13:18:15

Failed jobs

4,151, latest first

FailedAssetKindErrorAttemptsWorker
2 Oct 23:04:52GBR_00027compute_error
S3_ALGO_PHYSICAL_ERROR
NetCDF: HDF error1climate-metrics-worker-7b6cddc9fc-2wn4r
2 Oct 23:04:51FRA_00020compute_error
S3_ALGO_PHYSICAL_ERROR
NetCDF: HDF error1climate-metrics-worker-7b6cddc9fc-7rvrq
2 Oct 23:04:50ESP_00009compute_error
S3_ALGO_PHYSICAL_ERROR
NetCDF: HDF error1climate-metrics-worker-7b6cddc9fc-v2mxp
2 Oct 23:04:48ESP_00001compute_error
S3_ALGO_PHYSICAL_ERROR
NetCDF: HDF error1climate-metrics-worker-7b6cddc9fc-2wn4r
2 Oct 23:04:47CAN_00003compute_error
S3_ALGO_PHYSICAL_ERROR
NetCDF: HDF error1climate-metrics-worker-7b6cddc9fc-7rvrq
2 Oct 23:04:44JOR_00001compute_error
S3_ALGO_PHYSICAL_ERROR
NetCDF: HDF error1climate-metrics-worker-7b6cddc9fc-v2mxp
2 Oct 23:04:43HUN_00002compute_error
S3_ALGO_PHYSICAL_ERROR
NetCDF: HDF error1climate-metrics-worker-7b6cddc9fc-2wn4r
2 Oct 23:04:42DEU_00004compute_error
S3_ALGO_PHYSICAL_ERROR
NetCDF: HDF error1climate-metrics-worker-7b6cddc9fc-7rvrq
2 Oct 23:04:37TWN_00002compute_error
S3_ALGO_PHYSICAL_ERROR
NetCDF: HDF error1climate-metrics-worker-7b6cddc9fc-v2mxp
2 Oct 23:04:37PRT_00001compute_error
S3_ALGO_PHYSICAL_ERROR
NetCDF: HDF error1climate-metrics-worker-7b6cddc9fc-fd7hr
2 Oct 23:04:37PHL_00003compute_error
S3_ALGO_PHYSICAL_ERROR
NetCDF: HDF error1climate-metrics-worker-7b6cddc9fc-7rvrq
2 Oct 23:04:36MLT_00001compute_error
S3_ALGO_PHYSICAL_ERROR
NetCDF: HDF error1climate-metrics-worker-7b6cddc9fc-2wn4r
2 Oct 23:04:34IRL_00001compute_error
S3_ALGO_PHYSICAL_ERROR
NetCDF: HDF error1climate-metrics-worker-7b6cddc9fc-v2mxp
2 Oct 23:04:33GBR_00025compute_error
S3_ALGO_PHYSICAL_ERROR
NetCDF: HDF error1climate-metrics-worker-7b6cddc9fc-fd7hr
2 Oct 23:04:32FRA_00026compute_error
S3_ALGO_PHYSICAL_ERROR
NetCDF: HDF error1climate-metrics-worker-7b6cddc9fc-7rvrq
2 Oct 23:04:31FRA_00021compute_error
S3_ALGO_PHYSICAL_ERROR
NetCDF: HDF error1climate-metrics-worker-7b6cddc9fc-2wn4r
2 Oct 23:04:30ESP_00002compute_error
S3_ALGO_PHYSICAL_ERROR
NetCDF: HDF error1climate-metrics-worker-7b6cddc9fc-v2mxp
2 Oct 23:04:29DEU_00009compute_error
S3_ALGO_PHYSICAL_ERROR
NetCDF: HDF error1climate-metrics-worker-7b6cddc9fc-fd7hr
2 Oct 23:04:28CHL_00005compute_error
S3_ALGO_PHYSICAL_ERROR
NetCDF: HDF error1climate-metrics-worker-7b6cddc9fc-7rvrq
2 Oct 23:04:28CHN_00001compute_error
S3_ALGO_PHYSICAL_ERROR
NetCDF: HDF error1climate-metrics-worker-7b6cddc9fc-2wn4r
2 Oct 23:04:25CAN_00004compute_error
S3_ALGO_PHYSICAL_ERROR
NetCDF: HDF error1climate-metrics-worker-7b6cddc9fc-v2mxp
2 Oct 23:04:24BRA_00009compute_error
S3_ALGO_PHYSICAL_ERROR
NetCDF: HDF error1climate-metrics-worker-7b6cddc9fc-fd7hr
2 Oct 23:04:23BRA_00002compute_error
S3_ALGO_PHYSICAL_ERROR
NetCDF: HDF error1climate-metrics-worker-7b6cddc9fc-2wn4r
2 Oct 23:04:23BMU_00001compute_error
S3_ALGO_PHYSICAL_ERROR
NetCDF: HDF error1climate-metrics-worker-7b6cddc9fc-7rvrq
2 Oct 23:04:22SAU_00001compute_error
S3_ALGO_PHYSICAL_ERROR
NetCDF: HDF error1climate-metrics-worker-7b6cddc9fc-v2mxp
2 Oct 23:04:20MYS_00095compute_error
S3_ALGO_PHYSICAL_ERROR
NetCDF: HDF error1climate-metrics-worker-7b6cddc9fc-fd7hr
2 Oct 23:04:20ITA_00006compute_error
S3_ALGO_PHYSICAL_ERROR
NetCDF: HDF error1climate-metrics-worker-7b6cddc9fc-2wn4r
2 Oct 23:04:18GBR_00026compute_error
S3_ALGO_PHYSICAL_ERROR
NetCDF: HDF error1climate-metrics-worker-7b6cddc9fc-7rvrq
2 Oct 23:04:16FRA_00009compute_error
S3_ALGO_PHYSICAL_ERROR
NetCDF: HDF error1climate-metrics-worker-7b6cddc9fc-v2mxp
2 Oct 23:04:16FRA_00010compute_error
S3_ALGO_PHYSICAL_ERROR
NetCDF: HDF error1climate-metrics-worker-7b6cddc9fc-fd7hr
2 Oct 23:04:16FRA_00019compute_error
S3_ALGO_PHYSICAL_ERROR
NetCDF: HDF error1climate-metrics-worker-7b6cddc9fc-2wn4r
2 Oct 23:04:15ESP_00010compute_error
S3_ALGO_PHYSICAL_ERROR
NetCDF: HDF error1climate-metrics-worker-7b6cddc9fc-7rvrq
2 Oct 23:04:12DEU_00001compute_error
S3_ALGO_PHYSICAL_ERROR
NetCDF: HDF error1climate-metrics-worker-7b6cddc9fc-fd7hr
2 Oct 23:04:12DEU_00129compute_error
S3_ALGO_PHYSICAL_ERROR
NetCDF: HDF error1climate-metrics-worker-7b6cddc9fc-v2mxp
2 Oct 23:04:11CAN_00010compute_error
S3_ALGO_PHYSICAL_ERROR
NetCDF: HDF error1climate-metrics-worker-7b6cddc9fc-7rvrq
2 Oct 23:04:08PAN_00001compute_error
S3_ALGO_PHYSICAL_ERROR
NetCDF: HDF error1climate-metrics-worker-7b6cddc9fc-v2mxp
2 Oct 23:04:08NZL_00013compute_error
S3_ALGO_PHYSICAL_ERROR
NetCDF: HDF error1climate-metrics-worker-7b6cddc9fc-fd7hr
2 Oct 23:04:07MEX_00001compute_error
S3_ALGO_PHYSICAL_ERROR
NetCDF: HDF error1climate-metrics-worker-7b6cddc9fc-7rvrq
2 Oct 23:04:06NPL_00001compute_error
S3_ALGO_PHYSICAL_ERROR
NetCDF: HDF error1climate-metrics-worker-7b6cddc9fc-2wn4r
2 Oct 23:04:04IND_00001compute_error
S3_ALGO_PHYSICAL_ERROR
NetCDF: HDF error1climate-metrics-worker-7b6cddc9fc-v2mxp
2 Oct 23:04:03GHA_00001compute_error
S3_ALGO_PHYSICAL_ERROR
NetCDF: HDF error1climate-metrics-worker-7b6cddc9fc-fd7hr
2 Oct 23:04:02BRA_00005compute_error
S3_ALGO_PHYSICAL_ERROR
NetCDF: HDF error1climate-metrics-worker-7b6cddc9fc-2wn4r
2 Oct 23:04:01BRA_00001compute_error
S3_ALGO_PHYSICAL_ERROR
NetCDF: HDF error1climate-metrics-worker-7b6cddc9fc-7rvrq
2 Oct 23:04:00PRK_00001compute_error
S3_ALGO_PHYSICAL_ERROR
NetCDF: HDF error1climate-metrics-worker-7b6cddc9fc-v2mxp
2 Oct 23:04:00BEL_00002compute_error
S3_ALGO_PHYSICAL_ERROR
NetCDF: HDF error1climate-metrics-worker-7b6cddc9fc-fd7hr
2 Oct 23:03:59GUF_00001compute_error
S3_ALGO_PHYSICAL_ERROR
NetCDF: HDF error1climate-metrics-worker-7b6cddc9fc-2wn4r
2 Oct 23:03:58USA_00086compute_error
S3_ALGO_PHYSICAL_ERROR
NetCDF: HDF error1climate-metrics-worker-7b6cddc9fc-7rvrq
2 Oct 23:03:56SGP_00028compute_error
S3_ALGO_PHYSICAL_ERROR
NetCDF: HDF error1climate-metrics-worker-7b6cddc9fc-v2mxp
2 Oct 23:03:55USA_00086compute_error
S3_ALGO_PHYSICAL_ERROR
NetCDF: HDF error2climate-metrics-worker-7b6cddc9fc-2wn4r
2 Oct 23:03:53FRA_00029compute_error
S3_ALGO_PHYSICAL_ERROR
NetCDF: HDF error1climate-metrics-worker-7b6cddc9fc-7rvrq