Skip to content

[CP 1603] fix(olm): raise controller-manager memory limit to 1Gi (KUBE-49)#604

Merged
spraveenio merged 2 commits into
ROCm:mainfrom
ci-penbot-01:CP.O2O.pensando.gpu-operator.1603.rocm.gpu-operator.main
Jul 15, 2026
Merged

[CP 1603] fix(olm): raise controller-manager memory limit to 1Gi (KUBE-49)#604
spraveenio merged 2 commits into
ROCm:mainfrom
ci-penbot-01:CP.O2O.pensando.gpu-operator.1603.rocm.gpu-operator.main

Conversation

@ci-penbot-01

Copy link
Copy Markdown
Contributor

cp of pensando/gpu-operator#1603


Source PR Description (pensando/gpu-operator#1603):

Summary

Aligns the OpenShift OLM bundle controller-manager pod resources with the Helm chart. The OLM bundle shipped the kubebuilder scaffold defaults (384Mi limit / 64Mi request) while the Helm chart was tuned to 1Gi / 256Mi. The under-provisioned OLM limit intermittently OOMKills the controller-manager under load (KMM builds, ANR remediation, DRA reconciles).

  • Reported by: IBM customer on AMD GPU Operator 1.5.0 / OpenShift 4.20 (raising the limit to ~600Mi resolved it on their side).
  • Fix: set controller-manager resources to limits: cpu 1000m / memory 1Gi, requests: cpu 100m / memory 256Mi in the manifest source of truth (config/manager-base/manager.yaml) and regenerate the bundle CSV. 1Gi (over the customer's minimal 600Mi) converges both install paths on a single already-validated value with headroom.

Jira: https://amd.atlassian.net/browse/KUBE-49
Plan: docs-internal/knowledge/plans/2026-07-14-olm-bundle-manager-memory-limit.md

Test plan

  • operator-sdk bundle validate ./bundle passes
  • Diff scoped to two manifest files (+ plan): CSV delta is only the four resource values
  • Deploy regenerated bundle on OpenShift; confirm controller-manager comes up with limits.memory: 1Gi and no OOMKills under the customer workload

🤖 Generated with Claude Code

Cherrypick triggered by: ACP-Automation

yansun1996 and others added 2 commits July 15, 2026 06:35
The OpenShift OLM bundle shipped the kubebuilder scaffold defaults
(384Mi limit / 64Mi request) for the controller-manager pod, while the
Helm chart was tuned to 1Gi / 256Mi. The two install paths drifted out
of sync, and the under-provisioned OLM limit intermittently OOMKills the
controller-manager under load (KMM builds, ANR remediation, DRA
reconciles). Reported by an IBM customer on AMD GPU Operator 1.5.0 /
OpenShift 4.20.

Align the OLM bundle with the Helm chart at 1Gi limit / 256Mi request by
updating the manifest source of truth and regenerating the CSV.

Co-authored-by: Claude <noreply@anthropic.com>
(cherry picked from commit 00cce5b676c7a2158cba1844a8cef931321c8750)

@spraveenio spraveenio left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Lgtm

@spraveenio spraveenio merged commit 32bd06b into ROCm:main Jul 15, 2026
4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants