Queued
5,846
oldest waiting 57 min
Running
52
1 lost by their worker
Longest wait now
57 min
oldest queued job
Succeeded, last hour
2,827
jobs finished
Failure rate, 24 h
8.1 %
1,281 failed of 15.8K
Run time p95, 24 h
9.6 s
median 4.7 s
3 Sep 00:00 – now · 14.6K succeeded, 1,286 failed, run time p95 9.6 s, longest wait 1 h 39 min
Queue
peak per day
- Queued
- Running
Table
| Time | Queued | Running |
|---|---|---|
| 2 Oct 00:00 | 9,990 | 66 |
Worker pods
peak per day
- Ready
- Busy
- Starting
- Waiting for a node
Table
| Time | Ready | Busy | Starting | Waiting for a node |
|---|---|---|---|---|
| 2 Oct 00:00 | 10 | 10 | 7 | 0 |
Throughput
jobs per day
- Succeeded
- Failed
- Cancelled
- Submitted
Table
| Time | Succeeded | Failed | Cancelled | Submitted |
|---|---|---|---|---|
| 1 Oct 00:00 | 102 | 5 | 0 | 107 |
| 2 Oct 00:00 | 14.5K | 1,281 | 0 | 21.7K |
Run time
succeeded jobs, started to finished
- Median
- 95th percentile
- Longest
Table
| Time | Median | 95th percentile | Longest |
|---|---|---|---|
| 1 Oct 00:00 | 4.2 s | 9.4 s | 38 s |
| 2 Oct 00:00 | 4.7 s | 9.6 s | 1 min 1 s |
Wait time
created to started
- 95th percentile (started)
- Longest (started)
- Oldest still queued
Table
| Time | 95th percentile (started) | Longest (started) | Oldest still queued |
|---|---|---|---|
| 1 Oct 00:00 | 1 min 36 s | 1 min 36 s | – |
| 2 Oct 00:00 | 1 h 31 min | 1 h 39 min | 57 min |
- compute_error
- invalid_asset
- worker_lost
- internal
Table
| Time | compute_error | invalid_asset | worker_lost | internal |
|---|---|---|---|---|
| 1 Oct 00:00 | 4 | 1 | 0 | 0 |
| 2 Oct 00:00 | 1,281 | 0 | 0 | 0 |
Next in the queue
first in, first out
| Asset | Submitted | Waiting | Attempts |
|---|---|---|---|
| EGY_00001 | 2 Oct 21:33:17 | 57 min | 0 |
| ESP_00003 | 2 Oct 21:33:17 | 57 min | 0 |
| ESP_00010 | 2 Oct 21:33:17 | 57 min | 0 |
| FIN_00001 | 2 Oct 21:33:17 | 57 min | 0 |
| FRA_00003 | 2 Oct 21:33:17 | 57 min | 0 |
| FRA_00009 | 2 Oct 21:33:17 | 57 min | 0 |
| FRA_00010 | 2 Oct 21:33:17 | 57 min | 0 |
| FRA_00019 | 2 Oct 21:33:17 | 57 min | 0 |
| GBR_00013 | 2 Oct 21:33:17 | 57 min | 0 |
| GBR_00026 | 2 Oct 21:33:17 | 57 min | 0 |
and 5,836 more
Worker pods now
10 ready, 0 starting, 0 waiting for a node
| Pod | State | Job | Age |
|---|---|---|---|
climate-metrics-worker-standby-57c4499f86-g7vrh standby · ip-10-40-15-254 | ready | CAN_00010 | 2 h 36 min |
climate-metrics-worker-7b6cddc9fc-2wn4r pool · ip-10-40-20-253 | ready | BEL_00025 | 56 min |
climate-metrics-worker-7b6cddc9fc-6sbnv pool · ip-10-40-20-253 | ready | BRA_00003 | 56 min |
climate-metrics-worker-7b6cddc9fc-7rvrq pool · ip-10-40-20-253 | ready | CHL_00002 | 56 min |
climate-metrics-worker-7b6cddc9fc-8fsxj pool · ip-10-40-20-253 | ready | PSE_00001 | 56 min |
climate-metrics-worker-7b6cddc9fc-fd7hr pool · ip-10-40-20-253 | ready | DEU_00001 | 56 min |
climate-metrics-worker-7b6cddc9fc-v2mxp pool · ip-10-40-20-253 | ready | DEU_00129 | 56 min |
climate-metrics-worker-7b6cddc9fc-w7kzj pool · ip-10-40-20-253 | ready | TWN_00001 | 56 min |
climate-metrics-worker-7b6cddc9fc-x5zvn pool · ip-10-40-93-92 | ready | USA_00014 | 53 min |
climate-metrics-worker-7b6cddc9fc-zxdzw pool · ip-10-40-93-92 | ready | VUT_00001 | 53 min |
Running
52 jobs
| Asset | Worker | Step | Progress | Waited | Running for | Attempt |
|---|---|---|---|---|---|---|
| VUT_00001 | climate-metrics-worker-7b6cddc9fc-6sbnv | PHYSICAL | 2/6 | 55 min | 2 min 25 s | 1 |
| KEN_00001 | climate-metrics-worker-7b6cddc9fc-zxdzw | lease expired, waiting for a worker | 0/6 | 55 min | 2 min 1 s | 2 |
| DNK_00013 | climate-metrics-worker-7b6cddc9fc-zxdzw | starting | 0/6 | 55 min | 1 min 58 s | 1 |
| GBR_00028 | climate-metrics-worker-7b6cddc9fc-zxdzw | starting | 0/6 | 55 min | 1 min 55 s | 1 |
| JOR_00001 | climate-metrics-worker-7b6cddc9fc-zxdzw | starting | 0/6 | 55 min | 1 min 51 s | 2 |
| PHL_00001 | climate-metrics-worker-7b6cddc9fc-x5zvn | starting | 0/6 | 55 min | 1 min 49 s | 1 |
| PHL_00003 | climate-metrics-worker-7b6cddc9fc-zxdzw | starting | 0/6 | 55 min | 1 min 48 s | 1 |
| FRA_00017 | climate-metrics-worker-7b6cddc9fc-x5zvn | starting | 0/6 | 55 min | 1 min 46 s | 2 |
| PRT_00001 | climate-metrics-worker-7b6cddc9fc-zxdzw | starting | 0/6 | 55 min | 1 min 45 s | 1 |
| ITA_00005 | climate-metrics-worker-7b6cddc9fc-zxdzw | starting | 0/6 | 55 min | 1 min 41 s | 2 |
| CAN_00007 | climate-metrics-worker-7b6cddc9fc-zxdzw | starting | 0/6 | 55 min | 1 min 38 s | 1 |
| FRA_00005 | climate-metrics-worker-7b6cddc9fc-zxdzw | starting | 0/6 | 55 min | 1 min 33 s | 1 |
| FRA_00028 | climate-metrics-worker-7b6cddc9fc-zxdzw | starting | 0/6 | 55 min | 1 min 30 s | 1 |
| USA_00005 | climate-metrics-worker-7b6cddc9fc-zxdzw | starting | 0/6 | 55 min | 1 min 27 s | 1 |
| CPV_00001 | climate-metrics-worker-7b6cddc9fc-zxdzw | starting | 0/6 | 56 min | 1 min 23 s | 1 |
| BRA_00001 | climate-metrics-worker-7b6cddc9fc-6sbnv | PHYSICAL | 2/6 | 56 min | 1 min 21 s | 1 |
| ESP_00010 | climate-metrics-worker-7b6cddc9fc-zxdzw | starting | 0/6 | 56 min | 1 min 20 s | 2 |
| NLD_00003 | climate-metrics-worker-7b6cddc9fc-zxdzw | starting | 0/6 | 56 min | 1 min 16 s | 1 |
| SWE_00001 | climate-metrics-worker-7b6cddc9fc-zxdzw | starting | 0/6 | 56 min | 1 min 13 s | 1 |
| BEL_00025 | climate-metrics-worker-7b6cddc9fc-zxdzw | starting | 0/6 | 56 min | 1 min 10 s | 1 |
| ESP_00003 | climate-metrics-worker-7b6cddc9fc-zxdzw | starting | 0/6 | 56 min | 1 min 7 s | 1 |
| GBR_00013 | climate-metrics-worker-7b6cddc9fc-zxdzw | starting | 0/6 | 56 min | 1 min 3 s | 1 |
| HUN_00001 | climate-metrics-worker-7b6cddc9fc-zxdzw | starting | 0/6 | 56 min | 59 s | 1 |
| AUS_00003 | climate-metrics-worker-7b6cddc9fc-zxdzw | starting | 0/6 | 56 min | 54 s | 1 |
| CHL_00002 | climate-metrics-worker-7b6cddc9fc-zxdzw | starting | 0/6 | 56 min | 52 s | 1 |
| DEU_00009 | climate-metrics-worker-7b6cddc9fc-zxdzw | starting | 0/6 | 56 min | 48 s | 1 |
| FRA_00026 | climate-metrics-worker-7b6cddc9fc-zxdzw | starting | 0/6 | 56 min | 46 s | 1 |
| MLT_00001 | climate-metrics-worker-7b6cddc9fc-zxdzw | starting | 0/6 | 56 min | 43 s | 1 |
| PRT_00001 | climate-metrics-worker-7b6cddc9fc-zxdzw | starting | 0/6 | 56 min | 38 s | 1 |
| TWN_00002 | climate-metrics-worker-7b6cddc9fc-x5zvn | starting | 0/6 | 56 min | 38 s | 1 |
| USA_00086 | climate-metrics-worker-7b6cddc9fc-zxdzw | starting | 0/6 | 56 min | 35 s | 2 |
| AUS_00004 | climate-metrics-worker-7b6cddc9fc-x5zvn | starting | 0/6 | 56 min | 34 s | 1 |
| PSE_00001 | climate-metrics-worker-7b6cddc9fc-8fsxj | starting | 0/6 | 56 min | 34 s | 1 |
| NOR_00001 | climate-metrics-worker-7b6cddc9fc-zxdzw | starting | 0/6 | 56 min | 33 s | 1 |
| ESP_00009 | climate-metrics-worker-7b6cddc9fc-zxdzw | starting | 0/6 | 56 min | 30 s | 1 |
| SWE_00001 | climate-metrics-worker-7b6cddc9fc-zxdzw | starting | 0/6 | 57 min | 28 s | 2 |
| FRA_00020 | climate-metrics-worker-7b6cddc9fc-zxdzw | starting | 0/6 | 57 min | 25 s | 1 |
| SGP_00028 | climate-metrics-worker-7b6cddc9fc-zxdzw | starting | 0/6 | 57 min | 22 s | 1 |
| FRA_00030 | climate-metrics-worker-7b6cddc9fc-2wn4r | starting | 0/6 | 57 min | 20 s | 1 |
| BRA_00003 | climate-metrics-worker-7b6cddc9fc-6sbnv | PHYSICAL | 2/6 | 57 min | 18 s | 1 |
| GUF_00001 | climate-metrics-worker-7b6cddc9fc-zxdzw | starting | 0/6 | 57 min | 18 s | 1 |
| USA_00014 | climate-metrics-worker-7b6cddc9fc-x5zvn | PHYSICAL | 2/6 | 57 min | 17 s | 1 |
| BRA_00005 | climate-metrics-worker-7b6cddc9fc-zxdzw | starting | 0/6 | 57 min | 13 s | 1 |
| JPN_00002 | climate-metrics-worker-7b6cddc9fc-zxdzw | starting | 0/6 | 57 min | 9.6 s | 1 |
| PAN_00001 | climate-metrics-worker-7b6cddc9fc-zxdzw | starting | 0/6 | 57 min | 6.7 s | 1 |
| TWN_00001 | climate-metrics-worker-7b6cddc9fc-w7kzj | starting | 0/6 | 57 min | 3.6 s | 1 |
| CHL_00002 | climate-metrics-worker-7b6cddc9fc-7rvrq | starting | 0/6 | 57 min | 3.2 s | 2 |
| VUT_00001 | climate-metrics-worker-7b6cddc9fc-zxdzw | starting | 0/6 | 57 min | 3.1 s | 1 |
| BEL_00025 | climate-metrics-worker-7b6cddc9fc-2wn4r | starting | 0/6 | 57 min | 2.4 s | 1 |
| CAN_00010 | climate-metrics-worker-standby-57c4499f86-g7vrh | starting | 0/6 | 57 min | 2.1 s | 1 |
| DEU_00001 | climate-metrics-worker-7b6cddc9fc-fd7hr | starting | 0/6 | 57 min | 1.9 s | 1 |
| DEU_00129 | climate-metrics-worker-7b6cddc9fc-v2mxp | starting | 0/6 | 57 min | 1.1 s | 1 |