Migration BackfillProjectIdForProjectsWithPipelineVariables: p_ci_pipeline_variables stalled

Description

Post Upgrade the BackfillProjectIdForProjectsWithPipelineVariables: p_ci_pipeline_variables batched background migration is stuck at 0.00%

rake aborted!
ActiveRecord::QueryCanceled: PG::QueryCanceled: ERROR:  canceling statement due to statement timeout
/opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/connection_proxy.rb:107:in `public_send'
/opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/connection_proxy.rb:107:in `block in read_using_load_balancer'
/opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/load_balancer.rb:141:in `block in read_write'

Environment

Impacted offerings:

  • GitLab Self-Managed

Impacted versions:

  • 17.11.0
  • 17.11.1
  • 17.11.2

Solution

The permanent fix is tracked in this merge request.

Fixed Versions:

  • 17.11.3
  • 18.0

Workaround

If you upgrade to an impacted version:

  1. Roll back the migration via gitlab-rake db:migrate:down VERSION=20250320192213
  2. Upgrade to a fixed version

Cause

Similar to this Issue.

On this page...