Queued
5,800
oldest waiting 57 min
Running
48
on 10 of 10 worker pods
Longest wait now
57 min
oldest queued job
Succeeded, last hour
2,837
jobs finished
Failure rate, 24 h
8.1 %
1,281 failed of 15.8K
Run time p95, 24 h
9.6 s
median 4.7 s
5 Jul 00:00 – now · 14.6K succeeded, 1,286 failed, run time p95 9.6 s, longest wait 1 h 39 min
Queue
peak per day
- Queued
- Running
Table
| Time | Queued | Running |
|---|---|---|
| 2 Oct 00:00 | 9,990 | 66 |
Worker pods
peak per day
- Ready
- Busy
- Starting
- Waiting for a node
Table
| Time | Ready | Busy | Starting | Waiting for a node |
|---|---|---|---|---|
| 2 Oct 00:00 | 10 | 10 | 7 | 0 |
Throughput
jobs per day
- Succeeded
- Failed
- Cancelled
- Submitted
Table
| Time | Succeeded | Failed | Cancelled | Submitted |
|---|---|---|---|---|
| 1 Oct 00:00 | 102 | 5 | 0 | 107 |
| 2 Oct 00:00 | 14.5K | 1,281 | 0 | 21.7K |
Run time
succeeded jobs, started to finished
- Median
- 95th percentile
- Longest
Table
| Time | Median | 95th percentile | Longest |
|---|---|---|---|
| 1 Oct 00:00 | 4.2 s | 9.4 s | 38 s |
| 2 Oct 00:00 | 4.7 s | 9.6 s | 1 min 1 s |
Wait time
created to started
- 95th percentile (started)
- Longest (started)
- Oldest still queued
Table
| Time | 95th percentile (started) | Longest (started) | Oldest still queued |
|---|---|---|---|
| 1 Oct 00:00 | 1 min 36 s | 1 min 36 s | – |
| 2 Oct 00:00 | 1 h 31 min | 1 h 39 min | 57 min |
- compute_error
- invalid_asset
- worker_lost
- internal
Table
| Time | compute_error | invalid_asset | worker_lost | internal |
|---|---|---|---|---|
| 1 Oct 00:00 | 4 | 1 | 0 | 0 |
| 2 Oct 00:00 | 1,281 | 0 | 0 | 0 |
Next in the queue
first in, first out
| Asset | Submitted | Waiting | Attempts |
|---|---|---|---|
| HUN_00002 | 2 Oct 21:33:17 | 57 min | 0 |
| PHL_00011 | 2 Oct 21:33:17 | 57 min | 0 |
| MCO_00001 | 2 Oct 21:33:17 | 57 min | 0 |
| DEU_00004 | 2 Oct 21:33:17 | 57 min | 0 |
| AUS_00004 | 2 Oct 21:33:17 | 57 min | 0 |
| PSE_00001 | 2 Oct 21:33:17 | 57 min | 0 |
| NOR_00001 | 2 Oct 21:33:17 | 57 min | 0 |
| JOR_00001 | 2 Oct 21:33:17 | 57 min | 0 |
| CAN_00007 | 2 Oct 21:33:17 | 57 min | 0 |
| IND_00002 | 2 Oct 21:33:17 | 57 min | 0 |
and 5,790 more
Worker pods now
10 ready, 0 starting, 0 waiting for a node
| Pod | State | Job | Age |
|---|---|---|---|
climate-metrics-worker-standby-57c4499f86-g7vrh standby · ip-10-40-15-254 | ready | PHL_00001 | 2 h 37 min |
climate-metrics-worker-7b6cddc9fc-2wn4r pool · ip-10-40-20-253 | ready | PHL_00003 | 57 min |
climate-metrics-worker-7b6cddc9fc-6sbnv pool · ip-10-40-20-253 | ready | BRA_00003 | 56 min |
climate-metrics-worker-7b6cddc9fc-7rvrq pool · ip-10-40-20-253 | ready | TWN_00002 | 56 min |
climate-metrics-worker-7b6cddc9fc-8fsxj pool · ip-10-40-20-253 | ready | PSE_00001 | 56 min |
climate-metrics-worker-7b6cddc9fc-fd7hr pool · ip-10-40-20-253 | ready | MLT_00001 | 56 min |
climate-metrics-worker-7b6cddc9fc-v2mxp pool · ip-10-40-20-253 | ready | FRA_00028 | 56 min |
climate-metrics-worker-7b6cddc9fc-w7kzj pool · ip-10-40-20-253 | ready | POL_00003 | 56 min |
climate-metrics-worker-7b6cddc9fc-x5zvn pool · ip-10-40-93-92 | ready | SGP_00001 | 53 min |
climate-metrics-worker-7b6cddc9fc-zxdzw pool · ip-10-40-93-92 | ready | USA_00005 | 53 min |
Running
48 jobs
| Asset | Worker | Step | Progress | Waited | Running for | Attempt |
|---|---|---|---|---|---|---|
| VUT_00001 | climate-metrics-worker-7b6cddc9fc-6sbnv | PHYSICAL | 2/6 | 55 min | 2 min 58 s | 1 |
| CPV_00001 | climate-metrics-worker-7b6cddc9fc-zxdzw | starting | 0/6 | 56 min | 1 min 56 s | 1 |
| BRA_00001 | climate-metrics-worker-7b6cddc9fc-6sbnv | PHYSICAL | 2/6 | 56 min | 1 min 54 s | 1 |
| ESP_00010 | climate-metrics-worker-7b6cddc9fc-zxdzw | starting | 0/6 | 56 min | 1 min 53 s | 2 |
| NLD_00003 | climate-metrics-worker-7b6cddc9fc-zxdzw | starting | 0/6 | 56 min | 1 min 49 s | 1 |
| SWE_00001 | climate-metrics-worker-7b6cddc9fc-zxdzw | starting | 0/6 | 56 min | 1 min 46 s | 1 |
| BEL_00025 | climate-metrics-worker-7b6cddc9fc-zxdzw | starting | 0/6 | 56 min | 1 min 43 s | 1 |
| ESP_00003 | climate-metrics-worker-7b6cddc9fc-zxdzw | starting | 0/6 | 56 min | 1 min 40 s | 1 |
| GBR_00013 | climate-metrics-worker-7b6cddc9fc-zxdzw | starting | 0/6 | 56 min | 1 min 36 s | 1 |
| HUN_00001 | climate-metrics-worker-7b6cddc9fc-zxdzw | starting | 0/6 | 56 min | 1 min 32 s | 1 |
| AUS_00003 | climate-metrics-worker-7b6cddc9fc-zxdzw | starting | 0/6 | 56 min | 1 min 27 s | 1 |
| CHL_00002 | climate-metrics-worker-7b6cddc9fc-zxdzw | starting | 0/6 | 56 min | 1 min 25 s | 1 |
| DEU_00009 | climate-metrics-worker-7b6cddc9fc-zxdzw | starting | 0/6 | 56 min | 1 min 21 s | 1 |
| FRA_00026 | climate-metrics-worker-7b6cddc9fc-zxdzw | starting | 0/6 | 56 min | 1 min 19 s | 1 |
| MLT_00001 | climate-metrics-worker-7b6cddc9fc-zxdzw | starting | 0/6 | 56 min | 1 min 15 s | 1 |
| PRT_00001 | climate-metrics-worker-7b6cddc9fc-zxdzw | starting | 0/6 | 56 min | 1 min 11 s | 1 |
| TWN_00002 | climate-metrics-worker-7b6cddc9fc-x5zvn | starting | 0/6 | 56 min | 1 min 11 s | 1 |
| USA_00086 | climate-metrics-worker-7b6cddc9fc-zxdzw | starting | 0/6 | 56 min | 1 min 8 s | 2 |
| AUS_00004 | climate-metrics-worker-7b6cddc9fc-x5zvn | starting | 0/6 | 56 min | 1 min 7 s | 1 |
| PSE_00001 | climate-metrics-worker-7b6cddc9fc-8fsxj | starting | 0/6 | 56 min | 1 min 7 s | 1 |
| NOR_00001 | climate-metrics-worker-7b6cddc9fc-zxdzw | starting | 0/6 | 56 min | 1 min 6 s | 1 |
| ESP_00009 | climate-metrics-worker-7b6cddc9fc-zxdzw | starting | 0/6 | 56 min | 1 min 3 s | 1 |
| SWE_00001 | climate-metrics-worker-7b6cddc9fc-zxdzw | starting | 0/6 | 57 min | 1 min | 2 |
| FRA_00020 | climate-metrics-worker-7b6cddc9fc-zxdzw | starting | 0/6 | 57 min | 58 s | 1 |
| SGP_00028 | climate-metrics-worker-7b6cddc9fc-zxdzw | starting | 0/6 | 57 min | 55 s | 1 |
| FRA_00030 | climate-metrics-worker-7b6cddc9fc-2wn4r | starting | 0/6 | 57 min | 53 s | 1 |
| BRA_00003 | climate-metrics-worker-7b6cddc9fc-6sbnv | PHYSICAL | 2/6 | 57 min | 51 s | 1 |
| GUF_00001 | climate-metrics-worker-7b6cddc9fc-zxdzw | starting | 0/6 | 57 min | 51 s | 1 |
| USA_00014 | climate-metrics-worker-7b6cddc9fc-x5zvn | PHYSICAL | 2/6 | 57 min | 50 s | 1 |
| BRA_00005 | climate-metrics-worker-7b6cddc9fc-zxdzw | starting | 0/6 | 57 min | 46 s | 1 |
| JPN_00002 | climate-metrics-worker-7b6cddc9fc-zxdzw | starting | 0/6 | 57 min | 43 s | 1 |
| PAN_00001 | climate-metrics-worker-7b6cddc9fc-zxdzw | starting | 0/6 | 57 min | 40 s | 1 |
| VUT_00001 | climate-metrics-worker-7b6cddc9fc-zxdzw | starting | 0/6 | 57 min | 36 s | 1 |
| FRA_00009 | climate-metrics-worker-7b6cddc9fc-zxdzw | starting | 0/6 | 57 min | 30 s | 1 |
| HUN_00001 | climate-metrics-worker-7b6cddc9fc-zxdzw | starting | 0/6 | 57 min | 26 s | 1 |
| AUS_00002 | climate-metrics-worker-7b6cddc9fc-zxdzw | starting | 0/6 | 57 min | 21 s | 1 |
| BRA_00002 | climate-metrics-worker-7b6cddc9fc-zxdzw | starting | 0/6 | 57 min | 18 s | 1 |
| COL_00001 | climate-metrics-worker-7b6cddc9fc-zxdzw | starting | 0/6 | 57 min | 14 s | 1 |
| GBR_00025 | climate-metrics-worker-7b6cddc9fc-zxdzw | starting | 0/6 | 57 min | 9.3 s | 1 |
| MLT_00001 | climate-metrics-worker-7b6cddc9fc-fd7hr | starting | 0/6 | 57 min | 4.3 s | 1 |
| PHL_00001 | climate-metrics-worker-standby-57c4499f86-g7vrh | starting | 0/6 | 57 min | 4.2 s | 1 |
| PHL_00003 | climate-metrics-worker-7b6cddc9fc-2wn4r | starting | 0/6 | 57 min | 4.1 s | 1 |
| POL_00003 | climate-metrics-worker-7b6cddc9fc-w7kzj | starting | 0/6 | 57 min | 4.0 s | 1 |
| PRT_00001 | climate-metrics-worker-7b6cddc9fc-zxdzw | starting | 0/6 | 57 min | 3.7 s | 1 |
| FRA_00028 | climate-metrics-worker-7b6cddc9fc-v2mxp | starting | 0/6 | 57 min | 2.2 s | 2 |
| SGP_00001 | climate-metrics-worker-7b6cddc9fc-x5zvn | starting | 0/6 | 57 min | 1.4 s | 1 |
| TWN_00002 | climate-metrics-worker-7b6cddc9fc-7rvrq | starting | 0/6 | 57 min | 1.0 s | 1 |
| USA_00005 | climate-metrics-worker-7b6cddc9fc-zxdzw | starting | 0/6 | 57 min | 0.1 s | 2 |