Known issues

Common problems encountered while running the air-gapped build pipeline and quick references to fixes.

Mirror drift

• Symptom: unexpected package or image changes between builds.
• Fix: snapshot mirrors regularly and pin digests in kolla-build.conf to avoid surprise updates.

Disk pressure on builders

• Symptom: builds fail due to insufficient space in /var/lib/docker or /var/lib/containers.
• Fix: size disks to keep >60GB free during builds and prune caches between runs.

TLS/CA errors

• Symptom: jobs cannot reach internal registries or mirrors due to certificate validation failures.
• Fix: distribute internal CA bundles to all Nodepool images; set REQUESTS_CA_BUNDLE and SSL_CERT_FILE in jobs.

Slow pushes

• Symptom: pushing layers to the registry takes too long or times out.
• Fix: throttle concurrent builds with Zuul semaphores and ensure registry servers have adequate IOPS.