Climate metrics jobsTimes in UTC
Queued
9,055
oldest waiting 17 min
Running
20
on 10 of 10 worker pods
Longest wait now
17 min
oldest queued job
Succeeded, last hour
924
jobs finished
Failure rate, 24 h
0.18 %
23 failed of 12.6K
Run time p95, 24 h
9.6 s
median 4.6 s

1 Oct 22:00 – now · 12.5K succeeded, 23 failed, run time p95 9.6 s, longest wait 1 h 39 min

Queue

peak per 1 h

  • Queued
  • Running
Table
TimeQueuedRunning
2 Oct 21:009,99039

Worker pods

peak per 1 h

  • Ready
  • Busy
  • Starting
  • Waiting for a node
Table
TimeReadyBusyStartingWaiting for a node
2 Oct 21:00101070

Throughput

jobs per 1 h

  • Succeeded
  • Failed
  • Cancelled
  • Submitted
Table
TimeSucceededFailedCancelledSubmitted
1 Oct 22:001102
2 Oct 06:005840010.1K
2 Oct 07:006,036000
2 Oct 08:003,4681200
2 Oct 13:008008
2 Oct 14:00991901,000
2 Oct 15:0010200102
2 Oct 17:0030000300
2 Oct 18:00500050
2 Oct 19:001001
2 Oct 20:0010800108
2 Oct 21:008881010K

Run time

succeeded jobs, started to finished

  • Median
  • 95th percentile
  • Longest
Table
TimeMedian95th percentileLongest
1 Oct 22:003.5 s3.6 s3.6 s
2 Oct 06:004.9 s9.6 s41 s
2 Oct 07:004.5 s9.6 s56 s
2 Oct 08:004.1 s9.4 s42 s
2 Oct 13:003.5 s4.8 s4.8 s
2 Oct 14:005.9 s9.7 s47 s
2 Oct 15:006.5 s10.0 s56 s
2 Oct 17:006.1 s9.8 s55 s
2 Oct 18:004.3 s9.8 s43 s
2 Oct 19:005.8 s5.8 s5.8 s
2 Oct 20:006.1 s9.8 s56 s
2 Oct 21:006.0 s9.8 s57 s

Wait time

created to started

  • 95th percentile (started)
  • Longest (started)
  • Oldest still queued
Table
Time95th percentile (started)Longest (started)Oldest still queued
1 Oct 22:001.5 s1.5 s–
2 Oct 06:004 min 42 s4 min 57 s–
2 Oct 07:0060 min1 h 2 min–
2 Oct 08:001 h 37 min1 h 39 min–
2 Oct 13:001.9 s2.0 s–
2 Oct 14:0019 min19 min–
2 Oct 15:004 min 33 s4 min 39 s–
2 Oct 17:009 min 40 s10 min–
2 Oct 18:002 min 40 s2 min 40 s–
2 Oct 19:000.4 s0.4 s–
2 Oct 20:004 min 56 s6 min 6 s–
2 Oct 21:0016 min16 min16 min

Failures

by kind, per 1 h

Details →
  • compute_error
  • invalid_asset
  • worker_lost
  • internal
Table
Timecompute_errorinvalid_assetworker_lostinternal
1 Oct 22:001000
2 Oct 08:0012000
2 Oct 14:009000
2 Oct 21:001000

Next in the queue

first in, first out

AssetSubmittedWaitingAttempts
PAN_000012 Oct 21:32:5917 min0
POL_000022 Oct 21:32:5917 min0
SWE_000012 Oct 21:32:5917 min0
TWN_000012 Oct 21:32:5917 min0
VUT_000012 Oct 21:32:5917 min0
BEL_000252 Oct 21:32:5917 min0
CAN_000102 Oct 21:32:5917 min0
DEU_000012 Oct 21:32:5917 min0
DEU_001292 Oct 21:32:5917 min0
EGY_000012 Oct 21:32:5917 min0

and 9,045 more

Worker pods now

10 ready, 0 starting, 0 waiting for a node

PodStateJobAge
climate-metrics-worker-standby-57c4499f86-g7vrh
standby · ip-10-40-15-254
readyMEX_000011 h 56 min
climate-metrics-worker-7b6cddc9fc-2wn4r
pool · ip-10-40-20-253
readyNZL_0001315 min
climate-metrics-worker-7b6cddc9fc-6sbnv
pool · ip-10-40-20-253
readyNPL_0000115 min
climate-metrics-worker-7b6cddc9fc-7rvrq
pool · ip-10-40-20-253
readyDNK_0000215 min
climate-metrics-worker-7b6cddc9fc-8fsxj
pool · ip-10-40-20-253
readyFRA_0003015 min
climate-metrics-worker-7b6cddc9fc-fd7hr
pool · ip-10-40-20-253
readyIND_0000115 min
climate-metrics-worker-7b6cddc9fc-v2mxp
pool · ip-10-40-20-253
readyJPN_0000215 min
climate-metrics-worker-7b6cddc9fc-w7kzj
pool · ip-10-40-20-253
readyNLD_0000315 min
climate-metrics-worker-7b6cddc9fc-x5zvn
pool · ip-10-40-93-92
readyUSA_0001412 min
climate-metrics-worker-7b6cddc9fc-zxdzw
pool · ip-10-40-93-92
readyPHL_0000112 min

Running

20 jobs

AssetWorkerStepProgressWaitedRunning forAttempt
AUS_00002climate-metrics-worker-7b6cddc9fc-8fsxjPHYSICAL
2/6
14 min2 min 20 s1
CHL_00002climate-metrics-worker-7b6cddc9fc-2wn4rPHYSICAL
2/6
14 min2 min 15 s1
POL_00003climate-metrics-worker-7b6cddc9fc-x5zvnstarting
0/6
15 min1 min 59 s1
FRA_00028climate-metrics-worker-7b6cddc9fc-x5zvnstarting
0/6
15 min1 min 43 s1
TWN_00001climate-metrics-worker-7b6cddc9fc-8fsxjPHYSICAL
2/6
15 min1 min 17 s1
ESP_00003climate-metrics-worker-7b6cddc9fc-2wn4rPHYSICAL
2/6
15 min1 min 13 s1
GBR_00025climate-metrics-worker-7b6cddc9fc-2wn4rstarting
0/6
16 min43 s1
PHL_00001climate-metrics-worker-7b6cddc9fc-zxdzwPHYSICAL
2/6
16 min38 s1
PSE_00001climate-metrics-worker-7b6cddc9fc-2wn4rstarting
0/6
16 min31 s1
FRA_00030climate-metrics-worker-7b6cddc9fc-8fsxjstarting
0/6
16 min14 s1
BEL_00002climate-metrics-worker-7b6cddc9fc-x5zvnstarting
0/6
16 min13 s1
USA_00014climate-metrics-worker-7b6cddc9fc-x5zvnstarting
0/6
16 min10 s1
DNK_00002climate-metrics-worker-7b6cddc9fc-7rvrqstarting
0/6
16 min4.7 s1
GHA_00001climate-metrics-worker-7b6cddc9fc-2wn4rstarting
0/6
16 min4.1 s1
IND_00001climate-metrics-worker-7b6cddc9fc-fd7hrstarting
0/6
16 min3.4 s1
JPN_00002climate-metrics-worker-7b6cddc9fc-v2mxpstarting
0/6
16 min3.0 s1
MEX_00001climate-metrics-worker-standby-57c4499f86-g7vrhstarting
0/6
16 min2.1 s1
NLD_00003climate-metrics-worker-7b6cddc9fc-w7kzjstarting
0/6
16 min1.7 s1
NPL_00001climate-metrics-worker-7b6cddc9fc-6sbnvstarting
0/6
17 min0.5 s1
NZL_00013climate-metrics-worker-7b6cddc9fc-2wn4rstarting
0/6
17 min0.2 s1