Climate metrics jobsTimes in UTC
Queued
5,873
oldest waiting 57 min
Running
52
on 10 of 10 worker pods
Longest wait now
57 min
oldest queued job
Succeeded, last hour
2,821
jobs finished
Failure rate, 24 h
7.8 %
1,221 failed of 15.7K
Run time p95, 24 h
9.6 s
median 4.7 s

26 Sep 00:00 – now · 14.5K succeeded, 1,226 failed, run time p95 9.6 s, longest wait 1 h 39 min

Queue

peak per 6 h

  • Queued
  • Running
Table
TimeQueuedRunning
2 Oct 18:009,99066

Worker pods

peak per 6 h

  • Ready
  • Busy
  • Starting
  • Waiting for a node
Table
TimeReadyBusyStartingWaiting for a node
2 Oct 18:00101070

Throughput

jobs per 6 h

  • Succeeded
  • Failed
  • Cancelled
  • Submitted
Table
TimeSucceededFailedCancelledSubmitted
1 Oct 18:0010250107
2 Oct 06:0010.1K12010.1K
2 Oct 12:001,401901,410
2 Oct 18:002,9571,200010.2K

Run time

succeeded jobs, started to finished

  • Median
  • 95th percentile
  • Longest
Table
TimeMedian95th percentileLongest
1 Oct 18:004.2 s9.4 s38 s
2 Oct 06:004.4 s9.5 s56 s
2 Oct 12:006.0 s9.8 s56 s
2 Oct 18:006.1 s9.8 s1 min 1 s

Wait time

created to started

  • 95th percentile (started)
  • Longest (started)
  • Oldest still queued
Table
Time95th percentile (started)Longest (started)Oldest still queued
1 Oct 18:001 min 36 s1 min 36 s–
2 Oct 06:001 h 34 min1 h 39 min–
2 Oct 12:0018 min19 min–
2 Oct 18:0056 min56 min56 min

Failures

by kind, per 6 h

Details →
  • compute_error
  • invalid_asset
  • worker_lost
  • internal
Table
Timecompute_errorinvalid_assetworker_lostinternal
1 Oct 18:004100
2 Oct 06:0012000
2 Oct 12:009000
2 Oct 18:001,200000

Next in the queue

first in, first out

AssetSubmittedWaitingAttempts
BEL_000022 Oct 21:33:1757 min0
BRA_000032 Oct 21:33:1757 min0
CPV_000012 Oct 21:33:1757 min0
GUF_000012 Oct 21:33:1757 min0
PRK_000012 Oct 21:33:1757 min0
TUR_000012 Oct 21:33:1757 min0
USA_000142 Oct 21:33:1757 min0
BRA_000012 Oct 21:33:1757 min0
BRA_000052 Oct 21:33:1757 min0
CHL_000012 Oct 21:33:1757 min0

and 5,863 more

Worker pods now

10 ready, 0 starting, 0 waiting for a node

PodStateJobAge
climate-metrics-worker-standby-57c4499f86-g7vrh
standby · ip-10-40-15-254
readyUSA_000052 h 36 min
climate-metrics-worker-7b6cddc9fc-2wn4r
pool · ip-10-40-20-253
readyFRA_0003056 min
climate-metrics-worker-7b6cddc9fc-6sbnv
pool · ip-10-40-20-253
readyBRA_0000156 min
climate-metrics-worker-7b6cddc9fc-7rvrq
pool · ip-10-40-20-253
readyGBR_0002756 min
climate-metrics-worker-7b6cddc9fc-8fsxj
pool · ip-10-40-20-253
readyPSE_0000156 min
climate-metrics-worker-7b6cddc9fc-fd7hr
pool · ip-10-40-20-253
readyUSA_0001756 min
climate-metrics-worker-7b6cddc9fc-v2mxp
pool · ip-10-40-20-253
readyFRA_0002956 min
climate-metrics-worker-7b6cddc9fc-w7kzj
pool · ip-10-40-20-253
readyUSA_0008656 min
climate-metrics-worker-7b6cddc9fc-x5zvn
pool · ip-10-40-93-92
readyITA_0000552 min
climate-metrics-worker-7b6cddc9fc-zxdzw
pool · ip-10-40-93-92
readySGP_0002852 min

Running

52 jobs

AssetWorkerStepProgressWaitedRunning forAttempt
VUT_00001climate-metrics-worker-7b6cddc9fc-6sbnvPHYSICAL
2/6
55 min2 min 5 s1
FRA_00009climate-metrics-worker-7b6cddc9fc-zxdzwstarting
0/6
55 min1 min 58 s1
FRA_00019climate-metrics-worker-7b6cddc9fc-zxdzwstarting
0/6
55 min1 min 56 s1
ITA_00006climate-metrics-worker-7b6cddc9fc-zxdzwstarting
0/6
55 min1 min 53 s1
MYS_00095climate-metrics-worker-7b6cddc9fc-x5zvnstarting
0/6
55 min1 min 52 s1
SWE_00002climate-metrics-worker-7b6cddc9fc-zxdzwstarting
0/6
55 min1 min 50 s1
BRA_00002climate-metrics-worker-7b6cddc9fc-zxdzwstarting
0/6
55 min1 min 47 s1
CHL_00002climate-metrics-worker-7b6cddc9fc-zxdzwstarting
0/6
55 min1 min 44 s1
KEN_00001climate-metrics-worker-7b6cddc9fc-zxdzwstarting
0/6
55 min1 min 41 s2
DNK_00013climate-metrics-worker-7b6cddc9fc-zxdzwstarting
0/6
55 min1 min 38 s1
GBR_00028climate-metrics-worker-7b6cddc9fc-zxdzwstarting
0/6
55 min1 min 35 s1
JOR_00001climate-metrics-worker-7b6cddc9fc-zxdzwstarting
0/6
55 min1 min 31 s2
PHL_00001climate-metrics-worker-7b6cddc9fc-x5zvnstarting
0/6
55 min1 min 30 s1
PHL_00003climate-metrics-worker-7b6cddc9fc-zxdzwstarting
0/6
55 min1 min 29 s1
FRA_00017climate-metrics-worker-7b6cddc9fc-x5zvnstarting
0/6
55 min1 min 26 s2
PRT_00001climate-metrics-worker-7b6cddc9fc-zxdzwstarting
0/6
55 min1 min 25 s1
ITA_00005climate-metrics-worker-7b6cddc9fc-zxdzwstarting
0/6
55 min1 min 22 s2
CAN_00007climate-metrics-worker-7b6cddc9fc-zxdzwstarting
0/6
55 min1 min 19 s1
FRA_00005climate-metrics-worker-7b6cddc9fc-zxdzwstarting
0/6
55 min1 min 13 s1
FRA_00028climate-metrics-worker-7b6cddc9fc-zxdzwstarting
0/6
55 min1 min 10 s1
USA_00005climate-metrics-worker-7b6cddc9fc-zxdzwstarting
0/6
55 min1 min 8 s1
CPV_00001climate-metrics-worker-7b6cddc9fc-zxdzwstarting
0/6
56 min1 min 3 s1
BRA_00001climate-metrics-worker-7b6cddc9fc-6sbnvPHYSICAL
2/6
56 min1 min 2 s1
ESP_00010climate-metrics-worker-7b6cddc9fc-zxdzwstarting
0/6
56 min1 min 1 s2
NLD_00003climate-metrics-worker-7b6cddc9fc-zxdzwstarting
0/6
56 min56 s1
SWE_00001climate-metrics-worker-7b6cddc9fc-zxdzwstarting
0/6
56 min54 s1
BEL_00025climate-metrics-worker-7b6cddc9fc-zxdzwstarting
0/6
56 min51 s1
ESP_00003climate-metrics-worker-7b6cddc9fc-zxdzwstarting
0/6
56 min47 s1
GBR_00013climate-metrics-worker-7b6cddc9fc-zxdzwstarting
0/6
56 min44 s1
HUN_00001climate-metrics-worker-7b6cddc9fc-zxdzwstarting
0/6
56 min39 s1
AUS_00003climate-metrics-worker-7b6cddc9fc-zxdzwstarting
0/6
56 min35 s1
CHL_00002climate-metrics-worker-7b6cddc9fc-zxdzwstarting
0/6
56 min32 s1
DEU_00009climate-metrics-worker-7b6cddc9fc-zxdzwstarting
0/6
56 min29 s1
FRA_00026climate-metrics-worker-7b6cddc9fc-zxdzwstarting
0/6
56 min26 s1
MLT_00001climate-metrics-worker-7b6cddc9fc-zxdzwstarting
0/6
56 min23 s1
PRT_00001climate-metrics-worker-7b6cddc9fc-zxdzwstarting
0/6
56 min19 s1
TWN_00002climate-metrics-worker-7b6cddc9fc-x5zvnstarting
0/6
56 min18 s1
USA_00086climate-metrics-worker-7b6cddc9fc-zxdzwstarting
0/6
56 min16 s2
AUS_00004climate-metrics-worker-7b6cddc9fc-x5zvnstarting
0/6
56 min15 s1
PSE_00001climate-metrics-worker-7b6cddc9fc-8fsxjstarting
0/6
56 min14 s1
NOR_00001climate-metrics-worker-7b6cddc9fc-zxdzwstarting
0/6
56 min14 s1
ESP_00009climate-metrics-worker-7b6cddc9fc-zxdzwstarting
0/6
56 min11 s1
SWE_00001climate-metrics-worker-7b6cddc9fc-zxdzwstarting
0/6
57 min8.1 s2
FRA_00020climate-metrics-worker-7b6cddc9fc-zxdzwstarting
0/6
57 min5.3 s1
FRA_00029climate-metrics-worker-7b6cddc9fc-v2mxpstarting
0/6
57 min3.3 s1
GBR_00027climate-metrics-worker-7b6cddc9fc-7rvrqstarting
0/6
57 min2.9 s1
ITA_00005climate-metrics-worker-7b6cddc9fc-x5zvnstarting
0/6
57 min2.8 s1
SGP_00028climate-metrics-worker-7b6cddc9fc-zxdzwstarting
0/6
57 min2.8 s1
USA_00005climate-metrics-worker-standby-57c4499f86-g7vrhstarting
0/6
57 min2.4 s1
USA_00017climate-metrics-worker-7b6cddc9fc-fd7hrstarting
0/6
57 min2.3 s1
USA_00086climate-metrics-worker-7b6cddc9fc-w7kzjstarting
0/6
57 min1.0 s1
FRA_00030climate-metrics-worker-7b6cddc9fc-2wn4rstarting
0/6
57 min0.4 s1