Skip to content

ROX-35435: Support differing versions of Central and SecuredCluster#246

Open
vladbologa wants to merge 5 commits into
mainfrom
vb/differing-central-sc-versions
Open

ROX-35435: Support differing versions of Central and SecuredCluster#246
vladbologa wants to merge 5 commits into
mainfrom
vb/differing-central-sc-versions

Conversation

@vladbologa

@vladbologa vladbologa commented Jul 17, 2026

Copy link
Copy Markdown
Collaborator

Description

Roxie can now deploy Central and SecuredCluster at different versions on the same cluster (for compatibility testing), while keeping the single-version path unchanged.

Config and CLI

  • roxie.version / --tag remains the global default.
  • Optional overrides: central.version / --central-tag and securedCluster.version / --secured-cluster-tag.
  • Effective versions are resolved via EffectiveCentralVersion() / EffectiveSecuredClusterVersion(). When they differ, HasMixedVersions() is true.
  • Precedence: component-specific tag > --tag / roxie.version.

Operators

When versions match (common case):

  • One operator in rhacs-operator-system (unchanged).

When versions differ:

  • Operator for Central in rhacs-operator-central with SECURED_CLUSTER_RECONCILER_ENABLED=false.
  • Operator for SecuredCluster in rhacs-operator-sensor with CENTRAL_RECONCILER_ENABLED=false.
  • Distinct ClusterRole / ClusterRoleBinding names per instance (…-central / …-sensor).

This is derived automatically from version mismatch; users do not configure reconciler toggles or operator namespaces.

Limitations

  • Mixed versions with --olm / OLM deploy are not supported (hard error).
  • Mixed versions with roxie deploy operator (operator-only) are not supported (hard error).

Approaches considered

Approach Why not
Pause-reconcile annotation Leaves either Central or the Secured Cluster without an active operator.
Two separate roxie deploy invocations Awkward UX, problems with roxie shell.
Label selectors (CENTRAL_LABEL_SELECTOR / …) Designed for multi-tenant multi-CR setups. Overkill when there is one Central and one SecuredCluster; reconciler toggles are simpler.

Manual testing on an infra cluster

  1. Fresh mixed deploy — Central 4.11.1, SecuredCluster 4.10.0. Confirmed dual operators, correct reconciler toggles, matching product images; rhacs-operator-system unused.
  2. Teardown after mixed deployroxie teardown removed both mixed operator namespaces and component CRs/workloads.
  3. Same-version deploy--tag 4.11.1 only. Single operator in rhacs-operator-system, no reconciler toggles, no double namespaces.
  4. In-place single → mixed — Without prior teardown, switched to Central 4.11.1 / SecuredCluster 4.10.0. rhacs-operator-system removed; mixed operators stood up correctly.

TBD: Check switching from OLM to mixed versions, and back.

Summary by CodeRabbit

  • New Features

    • Added component-specific version overrides for Central and Secured Cluster (including new CLI flags to set image tags).
    • Enhanced mixed-version deployments with separate operator instances and component-appropriate image selection.
    • Improved handling of OLM vs non-OLM operator deployment mode switching.
  • Bug Fixes

    • Strengthened deployment validation for mixed/split version scenarios and added additional tag conflict checks.
    • Prevented older operator instances from downgrading shared resources.
    • Updated Konflux-related image/tag propagation per operator instance to ensure correct environment wiring.
  • Tests

    • Added/expanded unit tests covering effective version selection and image/tag generation.

@coderabbitai

coderabbitai Bot commented Jul 17, 2026

Copy link
Copy Markdown
Contributor

Review Change Stack

📝 Walkthrough

Walkthrough

Per-component Central and SecuredCluster versions now drive image generation, operator instance planning, validation, Konflux variables, deployment orchestration, and deployment summaries.

Changes

Split Operator Support

Layer / File(s) Summary
Operator version model and planning
internal/deployer/config.go, internal/deployer/operator_instance.go, internal/deployer/operator_instance_test.go
Central and SecuredCluster overrides produce effective versions, mixed-version operator instances, instance-scoped RBAC names, newest-version selection, and corresponding tests.
Per-instance operator deployment lifecycle
internal/deployer/operator.go
Non-OLM deployment, CRD application, RBAC, manager configuration, readiness, and teardown operate per operator instance and namespace.
Deployment mode orchestration and validation
internal/deployer/deploy_via_operator.go, cmd/deploy.go
Deployment planning handles OLM/non-OLM transitions, stale namespaces, per-instance version checks, and split-version validation.
Versioned images and Konflux environment assembly
internal/deployer/acs_images.go, internal/deployer/konflux.go, internal/deployer/deployer.go, internal/deployer/*_test.go
Image lists, operator bundles, Konflux environment variables, deployment summaries, and tests use effective or per-instance versions.

Estimated code review effort: 4 (Complex) | ~60 minutes

Sequence Diagram(s)

sequenceDiagram
  participant DeployCommand
  participant Config
  participant ImageBuilder
  participant OperatorDeployment
  participant Kubernetes
  DeployCommand->>Config: apply component version flags
  Config->>Config: build OperatorInstances()
  Config-->>ImageBuilder: effective versions and operator instances
  ImageBuilder-->>DeployCommand: versioned image list
  DeployCommand->>OperatorDeployment: ensure operator instances
  OperatorDeployment->>Kubernetes: inspect, deploy, or tear down namespaces
  Kubernetes-->>OperatorDeployment: deployment state
Loading

Possibly related PRs

Suggested reviewers: porridge

🚥 Pre-merge checks | ✅ 4 | ❌ 1

❌ Failed checks (1 warning)

Check name Status Explanation Resolution
Docstring Coverage ⚠️ Warning Docstring coverage is 24.14% which is insufficient. The required threshold is 80.00%. Write docstrings for the functions missing them to satisfy the coverage threshold.
✅ Passed checks (4 passed)
Check name Status Explanation
Linked Issues check ✅ Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check ✅ Passed Check skipped because no linked issues were found for this pull request.
Description Check ✅ Passed Check skipped - CodeRabbit’s high-level summary is enabled.
Title check ✅ Passed The title accurately summarizes the main change: enabling different Central and SecuredCluster versions.
✨ Finishing Touches
📝 Generate docstrings
  • Create stacked PR
  • Commit on current branch
🧪 Generate unit tests (beta)
  • Create PR with unit tests
  • Commit unit tests in branch vb/differing-central-sc-versions

Comment @coderabbitai help to get the list of available commands.

@coderabbitai

coderabbitai Bot commented Jul 17, 2026

Copy link
Copy Markdown
Contributor
✅ Action performed

Review finished.

Note: CodeRabbit is an incremental review system and does not re-review already reviewed commits. This command is applicable only when automatic reviews are paused.

@coderabbitai coderabbitai Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actionable comments posted: 6

🤖 Prompt for all review comments with AI agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

Inline comments:
In `@internal/deployer/acs_images.go`:
- Around line 38-40: Update the image collection loop in the deployer flow
around OperatorInstances so single-operator configurations consistently use the
explicit Operator.Version override instead of mixing it with the resolved
instance version; alternatively, unify OperatorBundleImageForVersion and the OLM
Konflux environment-variable path on the same resolved version. Add a regression
test covering both Roxie.Version and Operator.Version being set, ensuring all
generated image references use one consistent operator version.

In `@internal/deployer/deploy_via_operator.go`:
- Around line 138-141: Update the early-return logic in the deployment flow
around isOperatorVersionCorrect so it also verifies the manager environment
matches instance.EnvVars, including component-specific reconciler flags and
Konflux/custom variables. Only return when both the image version and
environment are correct; otherwise reapply the desired Deployment using the
existing operator deployment path, preserving the split-mode flags defined by
the operator instance plan.
- Around line 110-125: The cleanup loop in deploy_via_operator.go around
AllOperatorNamespaces must attempt teardown for every undesired known namespace
without gating on operatorDeploymentExists or namespaceExists, allowing
teardownOperatorNonOLMInNamespace to remove namespaced and cluster-scoped
resources idempotently. In operator.go around the non-OLM cleanup flow, invoke
cleanup even when no Deployment is detected so partial resources are removed;
apply the change at both affected sites.

In `@internal/deployer/operator_instance.go`:
- Around line 78-82: Update the single-operator path in NeedsSplitOperators to
derive the operator version from the effective component version, honoring equal
Roxie and Operator overrides instead of using Roxie.Version directly. Preserve
the fallback behavior when no converted version is available, and extend
TestEffectiveVersions_BothOverridesSame_NoSplit with an assertion that the
deployed operator uses the override version.

In `@internal/deployer/operator.go`:
- Around line 575-598: Update the teardown flow around the kubectl deletion
calls and waitForNamespaceDeletion to propagate genuine deletion or timeout
errors instead of ignoring them or returning nil. Keep --ignore-not-found=true
for idempotent cleanup, but capture each runKubectl error and return it
immediately; likewise return the waitForNamespaceDeletion error before logging
success. Only log the success message and return nil after all cleanup steps
complete successfully.
- Around line 217-222: Update the EnvVars logging block in the operator
deployment flow to stop emitting environment values, since entries may contain
credentials or tokens. Preserve the existing count log and, if individual
entries are still needed, log only each variable’s name from envVarsToSortedList
without accessing or formatting ev["value"].
🪄 Autofix (Beta)

Fix all unresolved CodeRabbit comments on this PR:

  • Push a commit to this branch (recommended)
  • Create a new PR with the fixes

ℹ️ Review info
⚙️ Run configuration

Configuration used: Path: .coderabbit.yml

Review profile: CHILL

Plan: Enterprise

Run ID: b2693e61-392e-405e-a4bb-6dd14e9c6436

📥 Commits

Reviewing files that changed from the base of the PR and between 4f94203 and 9500218.

📒 Files selected for processing (10)
  • cmd/deploy.go
  • internal/deployer/acs_images.go
  • internal/deployer/config.go
  • internal/deployer/deploy_via_operator.go
  • internal/deployer/deployer.go
  • internal/deployer/konflux.go
  • internal/deployer/konflux_test.go
  • internal/deployer/operator.go
  • internal/deployer/operator_instance.go
  • internal/deployer/operator_instance_test.go

Comment thread internal/deployer/acs_images.go
Comment thread internal/deployer/deploy_via_operator.go
Comment thread internal/deployer/deploy_via_operator.go
Comment thread internal/deployer/operator_instance.go Outdated
Comment thread internal/deployer/operator.go
Comment thread internal/deployer/operator.go
@vladbologa
vladbologa force-pushed the vb/differing-central-sc-versions branch from 3c45e8d to 3776248 Compare July 21, 2026 12:01
@vladbologa
vladbologa marked this pull request as ready for review July 21, 2026 12:01
Copilot AI review requested due to automatic review settings July 21, 2026 12:01

@coderabbitai coderabbitai Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🧹 Nitpick comments (1)
internal/deployer/operator_instance_test.go (1)

74-109: 📐 Maintainability & Code Quality | 🔵 Trivial | ⚡ Quick win

Make override fixtures distinct from the global version.

These cases can pass if downstream planning accidentally uses Roxie.Version for a component, because it equals one expected component version.

  • internal/deployer/operator_instance_test.go#L74-L109: use a third Roxie version and verify the sensor instance still uses SecuredCluster.Version.
  • internal/deployer/operator_instance_test.go#L123-L139: set Roxie.Version below the Central override so this case proves Central participates in newest-version selection.
  • internal/deployer/operator_instance_test.go#L151-L165: use a third Roxie version and assert no global-version-only images are collected when both components override it.
🤖 Prompt for AI Agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

In `@internal/deployer/operator_instance_test.go` around lines 74 - 109, The
operator instance tests use Roxie versions that can mask incorrect
global-version handling. In internal/deployer/operator_instance_test.go:74-109,
choose a distinct third Roxie version and keep asserting the sensor uses
SecuredCluster.Version; at 123-139, set Roxie.Version below the Central override
to verify Central drives newest-version selection; at 151-165, use a distinct
Roxie version and assert no images for the global-only version are collected
when both components override it.
🤖 Prompt for all review comments with AI agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

Nitpick comments:
In `@internal/deployer/operator_instance_test.go`:
- Around line 74-109: The operator instance tests use Roxie versions that can
mask incorrect global-version handling. In
internal/deployer/operator_instance_test.go:74-109, choose a distinct third
Roxie version and keep asserting the sensor uses SecuredCluster.Version; at
123-139, set Roxie.Version below the Central override to verify Central drives
newest-version selection; at 151-165, use a distinct Roxie version and assert no
images for the global-only version are collected when both components override
it.

ℹ️ Review info
⚙️ Run configuration

Configuration used: Path: .coderabbit.yml

Review profile: CHILL

Plan: Enterprise

Run ID: 57f74974-e5ca-442d-b25f-d4c9e9bd1f49

📥 Commits

Reviewing files that changed from the base of the PR and between 9500218 and 3776248.

📒 Files selected for processing (10)
  • cmd/deploy.go
  • internal/deployer/acs_images.go
  • internal/deployer/config.go
  • internal/deployer/deploy_via_operator.go
  • internal/deployer/deployer.go
  • internal/deployer/konflux.go
  • internal/deployer/konflux_test.go
  • internal/deployer/operator.go
  • internal/deployer/operator_instance.go
  • internal/deployer/operator_instance_test.go
🚧 Files skipped from review as they are similar to previous changes (9)
  • internal/deployer/config.go
  • internal/deployer/konflux.go
  • internal/deployer/konflux_test.go
  • internal/deployer/operator_instance.go
  • internal/deployer/deployer.go
  • cmd/deploy.go
  • internal/deployer/acs_images.go
  • internal/deployer/operator.go
  • internal/deployer/deploy_via_operator.go

Copilot AI left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Adds mixed-version deployment support so Roxie can deploy Central and SecuredCluster at different versions on the same cluster, while preserving the existing single-version behavior.

Changes:

  • Introduces per-component version overrides (central.version / securedCluster.version, plus CLI flags) and resolves effective versions from config.
  • Enables dual non-OLM operator deployments (separate namespaces + per-instance reconciler toggles + distinct cluster-scoped RBAC names) and improves teardown/mode switching logic.
  • Updates image planning (including operator/bundle images) and deployment summaries to reflect effective component versions.

Reviewed changes

Copilot reviewed 10 out of 10 changed files in this pull request and generated 2 comments.

Show a summary per file
File Description
internal/deployer/operator.go Refactors non-OLM operator deployment/teardown to support multiple operator instances and per-instance RBAC names; gates CRD apply to the newest planned operator version.
internal/deployer/operator_instance.go Adds effective version resolution, mixed-version detection, operator instance planning, and “newest operator version” selection.
internal/deployer/operator_instance_test.go Adds unit tests for effective versions, operator instance planning, newest-version selection, and mixed-version image planning.
internal/deployer/konflux.go Refactors Konflux env-var population to support per-instance operator versions (merge-style API).
internal/deployer/konflux_test.go Updates tests for new Konflux APIs and adds coverage for per-instance version merging.
internal/deployer/deployer.go Updates deployment summaries to display effective Central/SecuredCluster versions rather than the global Roxie version.
internal/deployer/deploy_via_operator.go Extends operator deployment logic to deploy/validate multiple non-OLM operator instances and handle transitions between modes/namespaces.
internal/deployer/config.go Adds version override fields to Central and SecuredCluster config structs.
internal/deployer/acs_images.go Updates image selection to include unique effective main versions plus per-instance operator/bundle images (deduped).
cmd/deploy.go Adds CLI flags for per-component tags, validates unsupported mode combinations for mixed versions, and adjusts version-gated checks/Konflux behavior.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Comment thread cmd/deploy.go
Comment thread internal/deployer/deploy_via_operator.go
@vladbologa
vladbologa force-pushed the vb/differing-central-sc-versions branch from 3776248 to d63b2af Compare July 21, 2026 14:07
@vladbologa
vladbologa requested a review from Copilot July 21, 2026 14:21

Copilot AI left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 10 out of 10 changed files in this pull request and generated 1 comment.

Comment thread internal/deployer/operator_instance.go
@vladbologa
vladbologa requested a review from mclasmeier July 21, 2026 14:39
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants