Skip to content

SCAN_ALL failing in staging due to jobservice OOM

Ref: #139 (comment 9905346) kubectl events

LAST SEEN              TYPE      REASON         OBJECT                    MESSAGE 
10m                    Warning   SystemOOM      Node/kops-registry-stg-00-gva-c-nuzf4poyguel-node-1   System OOM encountered, victim process: harbor_jobservi, pid: 1239786 
10m (x2 over 10m)      Warning   OOMKilling     Node/kops-registry-stg-00-gva-c-nuzf4poyguel-node-1   Out of memory: Killed process 1239786 (harbor_jobservi) total-vm:7473500kB, anon-rss:5950044kB, file-rss:128kB, shmem-rss:0kB, UID:10000 pgtables:11892kB oom_score_adj:859 
5m41s (x11 over 27d)   Normal    NodeNotReady   Node/kops-registry-stg-00-gva-b-mxt2gbywb5uh-node-1   Node kops-registry-stg-00-gva-b-mxt2gbywb5uh-node-1 status is now: NodeNotReady 
5m19s                  Warning   SystemOOM      Node/kops-registry-stg-00-gva-c-nuzf4poyguel-node-1   System OOM encountered, victim process: harbor_jobservi, pid: 1239996 
5m18s                  Warning   OOMKilling     Node/kops-registry-stg-00-gva-c-nuzf4poyguel-node-1   Out of memory: Killed process 1239996 (harbor_jobservi) total-vm:7540256kB, anon-rss:5937360kB, file-rss:304kB, shmem-rss:0kB, UID:10000 pgtables:11864kB oom_score_adj:859 
5m18s                  Warning   OOMKilling     Node/kops-registry-stg-00-gva-c-nuzf4poyguel-node-1   Out of memory: Killed process 1240015 (harbor_jobservi) total-vm:7540256kB, anon-rss:5937360kB, file-rss:176kB, shmem-rss:0kB, UID:10000 pgtables:11864kB oom_score_adj:859