Climate metrics jobsTimes in UTC
Queued
5,800
oldest waiting 57 min
Running
48
on 10 of 10 worker pods
Longest wait now
57 min
oldest queued job
Succeeded, last hour
2,837
jobs finished
Failure rate, 24 h
8.1 %
1,281 failed of 15.8K
Run time p95, 24 h
9.6 s
median 4.7 s

5 Jul 00:00 – now · 14.6K succeeded, 1,286 failed, run time p95 9.6 s, longest wait 1 h 39 min

Queue

peak per day

  • Queued
  • Running
Table
TimeQueuedRunning
2 Oct 00:009,99066

Worker pods

peak per day

  • Ready
  • Busy
  • Starting
  • Waiting for a node
Table
TimeReadyBusyStartingWaiting for a node
2 Oct 00:00101070

Throughput

jobs per day

  • Succeeded
  • Failed
  • Cancelled
  • Submitted
Table
TimeSucceededFailedCancelledSubmitted
1 Oct 00:0010250107
2 Oct 00:0014.5K1,281021.7K

Run time

succeeded jobs, started to finished

  • Median
  • 95th percentile
  • Longest
Table
TimeMedian95th percentileLongest
1 Oct 00:004.2 s9.4 s38 s
2 Oct 00:004.7 s9.6 s1 min 1 s

Wait time

created to started

  • 95th percentile (started)
  • Longest (started)
  • Oldest still queued
Table
Time95th percentile (started)Longest (started)Oldest still queued
1 Oct 00:001 min 36 s1 min 36 s–
2 Oct 00:001 h 31 min1 h 39 min57 min

Failures

by kind, per day

  • compute_error
  • invalid_asset
  • worker_lost
  • internal
Table
Timecompute_errorinvalid_assetworker_lostinternal
1 Oct 00:004100
2 Oct 00:001,281000

Next in the queue

first in, first out

AssetSubmittedWaitingAttempts
HUN_000022 Oct 21:33:1757 min0
PHL_000112 Oct 21:33:1757 min0
MCO_000012 Oct 21:33:1757 min0
DEU_000042 Oct 21:33:1757 min0
AUS_000042 Oct 21:33:1757 min0
PSE_000012 Oct 21:33:1757 min0
NOR_000012 Oct 21:33:1757 min0
JOR_000012 Oct 21:33:1757 min0
CAN_000072 Oct 21:33:1757 min0
IND_000022 Oct 21:33:1757 min0

and 5,790 more

Worker pods now

10 ready, 0 starting, 0 waiting for a node

PodStateJobAge
climate-metrics-worker-standby-57c4499f86-g7vrh
standby · ip-10-40-15-254
readyPHL_000012 h 37 min
climate-metrics-worker-7b6cddc9fc-2wn4r
pool · ip-10-40-20-253
readyPHL_0000357 min
climate-metrics-worker-7b6cddc9fc-6sbnv
pool · ip-10-40-20-253
readyBRA_0000356 min
climate-metrics-worker-7b6cddc9fc-7rvrq
pool · ip-10-40-20-253
readyTWN_0000256 min
climate-metrics-worker-7b6cddc9fc-8fsxj
pool · ip-10-40-20-253
readyPSE_0000156 min
climate-metrics-worker-7b6cddc9fc-fd7hr
pool · ip-10-40-20-253
readyMLT_0000156 min
climate-metrics-worker-7b6cddc9fc-v2mxp
pool · ip-10-40-20-253
readyFRA_0002856 min
climate-metrics-worker-7b6cddc9fc-w7kzj
pool · ip-10-40-20-253
readyPOL_0000356 min
climate-metrics-worker-7b6cddc9fc-x5zvn
pool · ip-10-40-93-92
readySGP_0000153 min
climate-metrics-worker-7b6cddc9fc-zxdzw
pool · ip-10-40-93-92
readyUSA_0000553 min

Running

48 jobs

AssetWorkerStepProgressWaitedRunning forAttempt
VUT_00001climate-metrics-worker-7b6cddc9fc-6sbnvPHYSICAL
2/6
55 min2 min 58 s1
CPV_00001climate-metrics-worker-7b6cddc9fc-zxdzwstarting
0/6
56 min1 min 56 s1
BRA_00001climate-metrics-worker-7b6cddc9fc-6sbnvPHYSICAL
2/6
56 min1 min 54 s1
ESP_00010climate-metrics-worker-7b6cddc9fc-zxdzwstarting
0/6
56 min1 min 53 s2
NLD_00003climate-metrics-worker-7b6cddc9fc-zxdzwstarting
0/6
56 min1 min 49 s1
SWE_00001climate-metrics-worker-7b6cddc9fc-zxdzwstarting
0/6
56 min1 min 46 s1
BEL_00025climate-metrics-worker-7b6cddc9fc-zxdzwstarting
0/6
56 min1 min 43 s1
ESP_00003climate-metrics-worker-7b6cddc9fc-zxdzwstarting
0/6
56 min1 min 40 s1
GBR_00013climate-metrics-worker-7b6cddc9fc-zxdzwstarting
0/6
56 min1 min 36 s1
HUN_00001climate-metrics-worker-7b6cddc9fc-zxdzwstarting
0/6
56 min1 min 32 s1
AUS_00003climate-metrics-worker-7b6cddc9fc-zxdzwstarting
0/6
56 min1 min 27 s1
CHL_00002climate-metrics-worker-7b6cddc9fc-zxdzwstarting
0/6
56 min1 min 25 s1
DEU_00009climate-metrics-worker-7b6cddc9fc-zxdzwstarting
0/6
56 min1 min 21 s1
FRA_00026climate-metrics-worker-7b6cddc9fc-zxdzwstarting
0/6
56 min1 min 19 s1
MLT_00001climate-metrics-worker-7b6cddc9fc-zxdzwstarting
0/6
56 min1 min 15 s1
PRT_00001climate-metrics-worker-7b6cddc9fc-zxdzwstarting
0/6
56 min1 min 11 s1
TWN_00002climate-metrics-worker-7b6cddc9fc-x5zvnstarting
0/6
56 min1 min 11 s1
USA_00086climate-metrics-worker-7b6cddc9fc-zxdzwstarting
0/6
56 min1 min 8 s2
AUS_00004climate-metrics-worker-7b6cddc9fc-x5zvnstarting
0/6
56 min1 min 7 s1
PSE_00001climate-metrics-worker-7b6cddc9fc-8fsxjstarting
0/6
56 min1 min 7 s1
NOR_00001climate-metrics-worker-7b6cddc9fc-zxdzwstarting
0/6
56 min1 min 6 s1
ESP_00009climate-metrics-worker-7b6cddc9fc-zxdzwstarting
0/6
56 min1 min 3 s1
SWE_00001climate-metrics-worker-7b6cddc9fc-zxdzwstarting
0/6
57 min1 min2
FRA_00020climate-metrics-worker-7b6cddc9fc-zxdzwstarting
0/6
57 min58 s1
SGP_00028climate-metrics-worker-7b6cddc9fc-zxdzwstarting
0/6
57 min55 s1
FRA_00030climate-metrics-worker-7b6cddc9fc-2wn4rstarting
0/6
57 min53 s1
BRA_00003climate-metrics-worker-7b6cddc9fc-6sbnvPHYSICAL
2/6
57 min51 s1
GUF_00001climate-metrics-worker-7b6cddc9fc-zxdzwstarting
0/6
57 min51 s1
USA_00014climate-metrics-worker-7b6cddc9fc-x5zvnPHYSICAL
2/6
57 min50 s1
BRA_00005climate-metrics-worker-7b6cddc9fc-zxdzwstarting
0/6
57 min46 s1
JPN_00002climate-metrics-worker-7b6cddc9fc-zxdzwstarting
0/6
57 min43 s1
PAN_00001climate-metrics-worker-7b6cddc9fc-zxdzwstarting
0/6
57 min40 s1
VUT_00001climate-metrics-worker-7b6cddc9fc-zxdzwstarting
0/6
57 min36 s1
FRA_00009climate-metrics-worker-7b6cddc9fc-zxdzwstarting
0/6
57 min30 s1
HUN_00001climate-metrics-worker-7b6cddc9fc-zxdzwstarting
0/6
57 min26 s1
AUS_00002climate-metrics-worker-7b6cddc9fc-zxdzwstarting
0/6
57 min21 s1
BRA_00002climate-metrics-worker-7b6cddc9fc-zxdzwstarting
0/6
57 min18 s1
COL_00001climate-metrics-worker-7b6cddc9fc-zxdzwstarting
0/6
57 min14 s1
GBR_00025climate-metrics-worker-7b6cddc9fc-zxdzwstarting
0/6
57 min9.3 s1
MLT_00001climate-metrics-worker-7b6cddc9fc-fd7hrstarting
0/6
57 min4.3 s1
PHL_00001climate-metrics-worker-standby-57c4499f86-g7vrhstarting
0/6
57 min4.2 s1
PHL_00003climate-metrics-worker-7b6cddc9fc-2wn4rstarting
0/6
57 min4.1 s1
POL_00003climate-metrics-worker-7b6cddc9fc-w7kzjstarting
0/6
57 min4.0 s1
PRT_00001climate-metrics-worker-7b6cddc9fc-zxdzwstarting
0/6
57 min3.7 s1
FRA_00028climate-metrics-worker-7b6cddc9fc-v2mxpstarting
0/6
57 min2.2 s2
SGP_00001climate-metrics-worker-7b6cddc9fc-x5zvnstarting
0/6
57 min1.4 s1
TWN_00002climate-metrics-worker-7b6cddc9fc-7rvrqstarting
0/6
57 min1.0 s1
USA_00005climate-metrics-worker-7b6cddc9fc-zxdzwstarting
0/6
57 min0.1 s2