03:04:36 Started by timer 03:04:36 Running as SYSTEM 03:04:36 [EnvInject] - Loading node environment variables. 03:04:36 Building remotely on prd-centos8-builder-2c-4g-2425 (centos8-builder-2c-4g) in workspace /w/workspace/ci-management-openstack-cron 03:04:36 [ssh-agent] Looking for ssh-agent implementation... 03:04:36 $ ssh-agent 03:04:37 SSH_AUTH_SOCK=/tmp/ssh-RBjgdDFvuJVy/agent.5166 03:04:37 SSH_AGENT_PID=5168 03:04:37 [ssh-agent] Started. 03:04:37 Running ssh-add (command line suppressed) 03:04:37 Identity added: /w/workspace/ci-management-openstack-cron@tmp/private_key_7589049071335060692.key (jenkins-ssh) 03:04:37 [ssh-agent] Using credentials jenkins (jenkins) 03:04:37 The recommended git tool is: NONE 03:04:39 using credential jenkins 03:04:39 Wiping out workspace first. 03:04:39 Cloning the remote Git repository 03:04:39 Cloning repository ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management 03:04:39 > git init /w/workspace/ci-management-openstack-cron # timeout=10 03:04:39 Fetching upstream changes from ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management 03:04:39 > git --version # timeout=10 03:04:39 > git --version # 'git version 2.43.0' 03:04:39 using GIT_SSH to set credentials jenkins 03:04:39 [INFO] Currently running in a labeled security context 03:04:39 [INFO] Currently SELinux is 'enforcing' on the host 03:04:39 > /usr/bin/chcon --type=ssh_home_t /w/workspace/ci-management-openstack-cron@tmp/jenkins-gitclient-ssh12371877458026814612.key 03:04:39 > git fetch --tags --force --progress -- ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management +refs/heads/*:refs/remotes/origin/* # timeout=10 03:04:43 > git config remote.origin.url ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management # timeout=10 03:04:43 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10 03:04:44 Avoid second fetch 03:04:44 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10 03:04:44 Checking out Revision bd99cd2464adefc9a39aad8ae16df0732cbbfdc8 (refs/remotes/origin/master) 03:04:44 > git config core.sparsecheckout # timeout=10 03:04:44 > git checkout -f bd99cd2464adefc9a39aad8ae16df0732cbbfdc8 # timeout=10 03:04:44 Commit message: "CI: Update github2gerrit caller to v2.4.4" 03:04:44 > git rev-list --no-walk bd99cd2464adefc9a39aad8ae16df0732cbbfdc8 # timeout=10 03:04:44 > git remote # timeout=10 03:04:44 > git submodule init # timeout=10 03:04:44 > git submodule sync # timeout=10 03:04:44 > git config --get remote.origin.url # timeout=10 03:04:44 > git submodule init # timeout=10 03:04:44 > git config -f .gitmodules --get-regexp ^submodule\.(.+)\.url # timeout=10 03:04:44 > git config --get submodule.packer/common-packer.url # timeout=10 03:04:44 > git config -f .gitmodules --get submodule.packer/common-packer.path # timeout=10 03:04:44 > git config --get submodule.global-jjb.url # timeout=10 03:04:44 > git config -f .gitmodules --get submodule.global-jjb.path # timeout=10 03:04:45 > git submodule update --init --recursive packer/common-packer # timeout=10 03:04:48 > git submodule update --init --recursive global-jjb # timeout=10 03:04:59 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 03:04:59 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 03:04:59 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 03:04:59 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 03:04:59 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 03:04:59 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 03:04:59 Run condition [Boolean condition] enabling prebuild for step [BuilderChain] 03:04:59 provisioning config files... 03:04:59 copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml 03:04:59 copy managed file [npmrc] to file:/home/jenkins/.npmrc 03:04:59 copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf 03:04:59 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins2199841636742585842.sh 03:04:59 ---> python-tools-install.sh 03:04:59 Setup pyenv: 03:04:59 system 03:04:59 * 3.8.13 (set by /opt/pyenv/version) 03:04:59 * 3.9.13 (set by /opt/pyenv/version) 03:04:59 * 3.10.6 (set by /opt/pyenv/version) 03:05:04 lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-9H2B 03:05:04 lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv 03:05:04 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 03:05:16 lf-activate-venv(): INFO: Installing additional packages: lftools 03:05:51 lf-activate-venv(): INFO: Adding /tmp/venv-9H2B/bin to PATH 03:05:51 Generating Requirements File 03:06:32 ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. 03:06:32 botocore 1.43.127 requires python-dateutil<3.0.0,>=2.1, but you have python-dateutil 3.0.0 which is incompatible. 03:06:32 httplib2 0.30.2 requires pyparsing<4,>=3.0.4, but you have pyparsing 2.4.7 which is incompatible. 03:06:32 Python 3.10.6 03:06:32 pip 26.3 from /tmp/venv-9H2B/lib/python3.10/site-packages/pip (python 3.10) 03:06:33 aiohappyeyeballs==2.7.1 03:06:33 aiohttp==3.14.5 03:06:33 aiosignal==1.4.0 03:06:33 appdirs==1.4.4 03:06:33 argcomplete==3.7.2 03:06:33 aspy.yaml==1.3.0 03:06:33 async-timeout==5.0.1 03:06:33 attrs==26.1.0 03:06:33 autopage==0.6.0 03:06:33 backports.strenum==1.3.1 03:06:33 beautifulsoup4==4.15.0 03:06:33 boto3==1.43.127 03:06:33 botocore==1.43.127 03:06:33 bs4==0.0.2 03:06:33 certifi==2026.10.23 03:06:33 cffi==2.1.1 03:06:33 cfgv==3.5.0 03:06:33 chardet==7.7.0 03:06:33 charset-normalizer==3.5.2 03:06:33 click==8.5.1 03:06:33 cliff==4.14.0 03:06:33 cmd2==3.5.1 03:06:33 cryptography==3.3.2 03:06:33 debtcollector==3.1.0 03:06:33 decorator==5.3.1 03:06:33 defusedxml==0.7.1 03:06:33 Deprecated==1.3.1 03:06:33 distlib==0.4.4 03:06:33 dnspython==2.8.0 03:06:33 docker==7.2.0 03:06:33 dogpile.cache==1.5.0 03:06:33 durationpy==0.11 03:06:33 email-validator==2.3.0 03:06:33 filelock==4.1.0 03:06:33 frozenlist==1.8.0 03:06:33 future==1.0.0 03:06:33 gitdb==4.0.12 03:06:33 GitPython==3.2.1 03:06:33 httplib2==0.30.2 03:06:33 identify==2.6.20 03:06:33 idna==3.20 03:06:33 importlib-resources==1.5.0 03:06:33 iso8601==2.1.0 03:06:33 Jinja2==3.1.6 03:06:33 jmespath==1.1.0 03:06:33 jsonpatch==1.45 03:06:33 jsonpointer==3.10 03:06:33 jsonschema==4.26.0 03:06:33 jsonschema-specifications==2025.9.1 03:06:33 keystoneauth1==5.14.0 03:06:33 kubernetes==36.0.3 03:06:33 lftools==0.37.26 03:06:33 lxml==6.1.3 03:06:33 markdown-it-py==4.3.0 03:06:33 MarkupSafe==3.0.4 03:06:33 mdurl==0.1.2 03:06:33 msgpack==1.2.4 03:06:33 multi_key_dict==2.0.4 03:06:33 multidict==7.1.0 03:06:33 munch==4.0.0 03:06:33 netaddr==1.3.0 03:06:33 niet==1.4.2 03:06:33 nodeenv==1.12.0 03:06:33 oauth2client==4.1.3 03:06:33 oauthlib==4.0.1 03:06:33 openstacksdk==4.13.0 03:06:33 os-service-types==1.8.2 03:06:33 osc-lib==4.6.0 03:06:33 oslo.config==10.4.0 03:06:33 oslo.context==6.4.0 03:06:33 oslo.i18n==6.8.0 03:06:33 oslo.log==8.2.0 03:06:33 oslo.serialization==5.10.0 03:06:33 oslo.utils==10.1.1 03:06:33 packaging==26.3 03:06:33 pbr==7.1.3 03:06:33 platformdirs==4.12.4 03:06:33 prettytable==3.18.0 03:06:33 propcache==0.5.4 03:06:33 psutil==7.2.2 03:06:33 pyasn1==0.6.5 03:06:33 pyasn1_modules==0.4.2 03:06:33 pycparser==3.11 03:06:33 pygerrit2==2.0.15 03:06:33 PyGithub==2.10.0 03:06:33 Pygments==2.21.0 03:06:33 PyJWT==2.15.1 03:06:33 PyNaCl==1.6.2 03:06:33 pyparsing==2.4.7 03:06:33 pyperclip==1.11.0 03:06:33 pyrsistent==0.20.0 03:06:33 python-cinderclient==9.9.0 03:06:33 python-dateutil==3.0.0 03:06:33 python-discovery==1.9.5 03:06:33 python-heatclient==5.2.0 03:06:33 python-jenkins==1.8.3 03:06:33 python-keystoneclient==6.0.0 03:06:33 python-magnumclient==4.11.0 03:06:33 python-openstackclient==10.0.0 03:06:33 python-swiftclient==4.11.0 03:06:33 PyYAML==6.0.3 03:06:33 referencing==0.37.0 03:06:33 requests==2.34.2 03:06:33 requests-oauthlib==2.0.0 03:06:33 rfc3986==2.0.0 03:06:33 rich==15.0.0 03:06:33 rich-argparse==1.8.0 03:06:33 rpds-py==0.30.0 03:06:33 rsa==4.9.1 03:06:33 ruamel.yaml==0.19.1 03:06:33 ruamel.yaml.clib==0.2.15 03:06:33 s3transfer==0.19.3 03:06:33 simplejson==4.3.0 03:06:33 six==1.17.0 03:06:33 smmap==5.0.3 03:06:33 soupsieve==2.10 03:06:33 stevedore==5.8.0 03:06:33 tabulate==0.10.0 03:06:33 toml==0.10.2 03:06:33 tomlkit==0.15.2 03:06:33 tqdm==4.70.1 03:06:33 typing_extensions==4.16.0 03:06:33 tzdata==2026.6 03:06:33 urllib3==1.26.20 03:06:33 virtualenv==21.15.6 03:06:33 wcwidth==0.9.4 03:06:33 websocket-client==1.9.2 03:06:33 wrapt==2.5.2 03:06:33 xdg==6.0.0 03:06:33 xmltodict==1.0.4 03:06:33 yarl==1.25.1 03:06:33 yq==4.4.5 03:06:33 [ci-management-openstack-cron] $ /bin/sh /tmp/jenkins3868435353949101255.sh 03:06:33 ---> uv-install.sh 03:06:33 Installing uv/uvx (latest) using shell installer 03:06:37 2026-11-11 03:06:37 URL:https://releases.astral.sh/installers/uv/latest/uv-installer.sh [71300/71300] -> "/tmp/uv-install-ufUmjX.sh" [1] 03:06:37 downloading uv 0.13.7 x86_64-unknown-linux-gnu 03:06:41 installing to /home/jenkins/.local/bin 03:06:41 uv 03:06:41 uvx 03:06:41 everything's installed! 03:06:41 ---> Validating uv/uvx install 03:06:41 uvx 0.13.7 (x86_64-unknown-linux-gnu) 03:06:41 [EnvInject] - Injecting environment variables from a build step. 03:06:41 [EnvInject] - Injecting as environment variables the properties content 03:06:41 OS_CLOUD=vex 03:06:41 03:06:41 [EnvInject] - Variables injected successfully. 03:06:41 [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True) 03:06:41 Run condition [Boolean condition] enabling perform for step [Execute shell] 03:06:41 [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins1311589494939654673.sh 03:06:41 ---> Orphaned k8s clusters 03:06:41 Setup pyenv: 03:06:41 system 03:06:41 3.8.13 03:06:41 3.9.13 03:06:41 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 03:06:42 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-9H2B from file:/tmp/.os_lf_venv 03:06:42 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 03:06:45 lf-activate-venv(): INFO: Installing additional packages: kubernetes python-heatclient python-openstackclient python-magnumclient 03:07:10 ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. 03:07:10 botocore 1.43.127 requires python-dateutil<3.0.0,>=2.1, but you have python-dateutil 3.0.0 which is incompatible. 03:07:11 lf-activate-venv(): INFO: Adding /tmp/venv-9H2B/bin to PATH 03:07:20 -----> Delete orphaned cluster 03:07:20 [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True) 03:07:20 Run condition [Boolean condition] enabling perform for step [Execute shell] 03:07:20 [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins15172113399231981473.sh 03:07:20 ---> Orphaned stacks 03:07:20 Setup pyenv: 03:07:20 system 03:07:20 3.8.13 03:07:20 3.9.13 03:07:20 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 03:07:20 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-9H2B from file:/tmp/.os_lf_venv 03:07:20 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 03:07:23 lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq 03:07:52 lf-activate-venv(): INFO: Adding /tmp/venv-9H2B/bin to PATH 03:07:52 + mapfile -t OS_COE_CLUSTERS_ID 03:07:52 ++ awk '{print $1}' 03:07:52 ++ openstack --os-cloud vex coe cluster list -f value -c uuid -c name 03:07:52 ++ grep -E '(DELETE_FAILED|UNKNOWN|UNHEALTHY)' 03:08:01 + echo '-----> Active clusters -> stacks' 03:08:01 -----> Active clusters -> stacks 03:08:01 + OS_COE_STACKS=() 03:08:01 + [[ 0 -gt 0 ]] 03:08:01 + mapfile -t OS_STACKS 03:08:01 ++ awk '{print $1}' 03:08:01 ++ openstack --os-cloud vex stack list -f value -c 'Stack Name' -c 'Stack Status' --property stack_status=CREATE_COMPLETE --property stack_status=DELETE_FAILED --property stack_status=CREATE_FAILED 03:08:06 + echo '-----> Active stacks' 03:08:06 -----> Active stacks 03:08:06 + echo '-----> Delete orphaned stacks' 03:08:06 -----> Delete orphaned stacks 03:08:06 [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True) 03:08:06 Run condition [Boolean condition] enabling perform for step [Execute shell] 03:08:06 [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins14240063942382464039.sh 03:08:06 ---> Orphaned servers 03:08:06 Setup pyenv: 03:08:06 system 03:08:06 3.8.13 03:08:06 3.9.13 03:08:06 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 03:08:06 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-9H2B from file:/tmp/.os_lf_venv 03:08:06 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 03:08:10 lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq 03:10:46 WARNING: Connection interrupted while downloading. 03:10:46 WARNING: Attempting to resume incomplete download (8.4 MB/13.4 MB, attempt 1) 03:10:49 WARNING: Attempting to resume incomplete download (8.4 MB/13.4 MB, attempt 2) 03:10:52 WARNING: Attempting to resume incomplete download (8.4 MB/13.4 MB, attempt 3) 03:10:55 WARNING: Attempting to resume incomplete download (8.4 MB/13.4 MB, attempt 4) 03:10:58 WARNING: Attempting to resume incomplete download (8.4 MB/13.4 MB, attempt 5) 03:11:01 error: incomplete-download 03:11:01 03:11:01 × Download failed after 6 attempts because not enough bytes were received (8.4 MB/13.4 MB) 03:11:01 ╰─> URL: https://nexus3.o-ran-sc.org/repository/PyPi/packages/botocore/1.37.19/botocore-1.37.19-py3-none-any.whl#sha256=6e1337e73a6b8146c1ec20a6a72d67e2809bd4c0af076431fe6e1561e0c89415 03:11:01 03:11:01 note: This is an issue with network connectivity, not pip. 03:11:01 hint: Use --resume-retries to configure resume attempt limit. 03:11:03 lf-venv-pip-install(): WARNING: install failed from the configured index, retrying against https://pypi.org/simple 03:14:59 Build timed out (after 10 minutes). Marking the build as failed. 03:14:59 $ ssh-agent -k 03:14:59 unset SSH_AUTH_SOCK; 03:14:59 unset SSH_AGENT_PID; 03:14:59 echo Agent pid 5168 killed; 03:14:59 [ssh-agent] Stopped. 03:14:59 Build was aborted 03:14:59 [PostBuildScript] - [INFO] Executing post build scripts. 03:14:59 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins11379584658200671114.sh 03:14:59 ---> sysstat.sh 03:14:59 /home/jenkins/lf-env.sh: line 73: 6633 Terminated "$venv_python" -m pip install --index-url "$upstream" "$@" 03:14:59 lf-activate-venv(): ERROR: Failed to install packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq 03:14:59 /tmp/jenkins14240063942382464039.sh: line 67: openstack: command not found 03:15:00 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins6958849052537559603.sh 03:15:00 ---> package-listing.sh 03:15:00 ++ facter osfamily 03:15:00 ++ tr '[:upper:]' '[:lower:]' 03:15:01 + OS_FAMILY=redhat 03:15:01 + workspace=/w/workspace/ci-management-openstack-cron 03:15:01 + START_PACKAGES=/tmp/packages_start.txt 03:15:01 + END_PACKAGES=/tmp/packages_end.txt 03:15:01 + DIFF_PACKAGES=/tmp/packages_diff.txt 03:15:01 + PACKAGES=/tmp/packages_start.txt 03:15:01 + '[' /w/workspace/ci-management-openstack-cron ']' 03:15:01 + PACKAGES=/tmp/packages_end.txt 03:15:01 + case "${OS_FAMILY}" in 03:15:01 + rpm -qa 03:15:01 + sort 03:15:08 + '[' -f /tmp/packages_start.txt ']' 03:15:08 + '[' -f /tmp/packages_end.txt ']' 03:15:08 + diff /tmp/packages_start.txt /tmp/packages_end.txt 03:15:08 + '[' /w/workspace/ci-management-openstack-cron ']' 03:15:08 + mkdir -p /w/workspace/ci-management-openstack-cron/archives/ 03:15:08 + cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/ci-management-openstack-cron/archives/ 03:15:08 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins12488972422081317213.sh 03:15:08 ---> capture-instance-metadata.sh 03:15:08 Setup pyenv: 03:15:08 system 03:15:08 3.8.13 03:15:08 3.9.13 03:15:08 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 03:15:08 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-9H2B from file:/tmp/.os_lf_venv 03:15:08 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 03:15:13 lf-activate-venv(): INFO: Installing additional packages: lftools 03:15:28 lf-activate-venv(): INFO: Adding /tmp/venv-9H2B/bin to PATH 03:15:28 INFO: Running in OpenStack, capturing instance metadata 03:15:29 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins11469777222306923919.sh 03:15:29 provisioning config files... 03:15:29 copy managed file [jenkins-log-archives-settings] to file:/w/workspace/ci-management-openstack-cron@tmp/config18084234087637705373tmp 03:15:29 Regular expression run condition: Expression=[^.*logs-s3.*], Label=[] 03:15:29 Run condition [Regular expression match] preventing perform for step [Provide Configuration files] 03:15:29 [EnvInject] - Injecting environment variables from a build step. 03:15:29 [EnvInject] - Injecting as environment variables the properties content 03:15:29 SERVER_ID=logs 03:15:29 03:15:29 [EnvInject] - Variables injected successfully. 03:15:29 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins280333018075687187.sh 03:15:29 ---> create-netrc.sh 03:15:29 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins8247791479579997273.sh 03:15:29 ---> python-tools-install.sh 03:15:29 Setup pyenv: 03:15:29 system 03:15:29 3.8.13 03:15:29 3.9.13 03:15:29 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 03:15:30 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-9H2B from file:/tmp/.os_lf_venv 03:15:30 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 03:15:35 lf-activate-venv(): INFO: Installing additional packages: lftools 03:15:50 lf-activate-venv(): INFO: Adding /tmp/venv-9H2B/bin to PATH 03:15:50 [ci-management-openstack-cron] $ /bin/sh /tmp/jenkins2799378840074341987.sh 03:15:50 ---> uv-install.sh 03:15:50 uv 0.13.7 is already installed 03:15:50 uvx 0.13.7 (x86_64-unknown-linux-gnu) 03:15:50 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins8099809813146036193.sh 03:15:50 ---> sudo-logs.sh 03:15:50 Archiving 'sudo' log.. 03:15:50 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins11617861314712674681.sh 03:15:50 ---> job-cost.sh 03:15:50 INFO: Activating Python virtual environment... 03:15:50 Setup pyenv: 03:15:50 system 03:15:50 3.8.13 03:15:50 3.9.13 03:15:50 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 03:15:51 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-9H2B from file:/tmp/.os_lf_venv 03:15:51 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 03:15:56 lf-activate-venv(): INFO: Installing additional packages: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 03:16:08 lf-activate-venv(): INFO: Adding /tmp/venv-9H2B/bin to PATH 03:16:08 INFO: No stack-cost file found 03:16:08 INFO: Instance uptime: 749s 03:16:08 INFO: Fetching instance metadata (attempt 1 of 3)... 03:16:08 DEBUG: URL: http://169.254.169.254/latest/meta-data/instance-type 03:16:08 INFO: Successfully fetched instance metadata 03:16:08 INFO: Instance type: v3-starter-2 03:16:08 INFO: Retrieving pricing info for: v3-starter-2 03:16:08 INFO: Fetching Vexxhost pricing API (attempt 1 of 3)... 03:16:08 DEBUG: URL: https://pricing.vexxhost.net/v1/pricing/v3-starter-2/cost?seconds=749 03:16:12 INFO: Successfully fetched Vexxhost pricing API 03:16:12 INFO: Retrieved cost: 0.02 03:16:12 INFO: Retrieved resource: v3-starter-2 03:16:12 INFO: Creating archive directory: /w/workspace/ci-management-openstack-cron/archives/cost 03:16:12 INFO: Archiving costs to: /w/workspace/ci-management-openstack-cron/archives/cost.csv 03:16:12 INFO: Successfully archived job cost data 03:16:12 DEBUG: Cost data: ci-management-openstack-cron,63760,2026-11-11 03:16:12,v3-starter-2,749,0.02,0.00,FAILURE 03:16:12 [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins8696634787960930220.sh 03:16:12 ---> logs-deploy.sh 03:16:12 Setup pyenv: 03:16:12 system 03:16:12 3.8.13 03:16:12 3.9.13 03:16:12 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 03:16:12 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-9H2B from file:/tmp/.os_lf_venv 03:16:12 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 03:16:17 lf-activate-venv(): INFO: Installing additional packages: lftools urllib3~=1.26.15 03:16:32 lf-activate-venv(): INFO: Adding /tmp/venv-9H2B/bin to PATH 03:16:32 INFO: Nexus URL https://nexus.o-ran-sc.org path production/vex-sjc-oran-jenkins-prod-1/ci-management-openstack-cron/63760 03:16:32 INFO: archiving workspace using pattern(s): 03:16:38 Archives upload complete. 03:16:38 INFO: archiving logs to Nexus 03:16:39 ---> uname -a: 03:16:39 Linux prd-centos8-builder-2c-4g-2425.novalocal 4.18.0-529.el8.x86_64 #1 SMP Wed Dec 6 01:03:46 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux 03:16:39 03:16:39 03:16:39 ---> lscpu: 03:16:39 Architecture: x86_64 03:16:39 CPU op-mode(s): 32-bit, 64-bit 03:16:39 Byte Order: Little Endian 03:16:39 CPU(s): 2 03:16:39 On-line CPU(s) list: 0,1 03:16:39 Thread(s) per core: 1 03:16:39 Core(s) per socket: 1 03:16:39 Socket(s): 2 03:16:39 NUMA node(s): 1 03:16:39 Vendor ID: AuthenticAMD 03:16:39 CPU family: 23 03:16:39 Model: 49 03:16:39 Model name: AMD EPYC-Rome Processor 03:16:39 Stepping: 0 03:16:39 CPU MHz: 2799.998 03:16:39 BogoMIPS: 5599.99 03:16:39 Virtualization: AMD-V 03:16:39 Hypervisor vendor: KVM 03:16:39 Virtualization type: full 03:16:39 L1d cache: 32K 03:16:39 L1i cache: 32K 03:16:39 L2 cache: 512K 03:16:39 L3 cache: 16384K 03:16:39 NUMA node0 CPU(s): 0,1 03:16:39 Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr wbnoinvd arat npt nrip_save umip rdpid arch_capabilities 03:16:39 03:16:39 03:16:39 ---> nproc: 03:16:39 2 03:16:39 03:16:39 03:16:39 ---> df -h: 03:16:39 Filesystem Size Used Avail Use% Mounted on 03:16:39 devtmpfs 1.8G 0 1.8G 0% /dev 03:16:39 tmpfs 1.8G 0 1.8G 0% /dev/shm 03:16:39 tmpfs 1.8G 17M 1.8G 1% /run 03:16:39 tmpfs 1.8G 0 1.8G 0% /sys/fs/cgroup 03:16:39 /dev/vda1 20G 15G 5.4G 74% / 03:16:39 tmpfs 367M 0 367M 0% /run/user/1001 03:16:39 03:16:39 03:16:39 ---> free -m: 03:16:39 total used free shared buff/cache available 03:16:39 Mem: 3665 464 1246 17 1954 2889 03:16:39 Swap: 1023 1 1022 03:16:39 03:16:39 03:16:39 ---> ip addr: 03:16:39 1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 03:16:39 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 03:16:39 inet 127.0.0.1/8 scope host lo 03:16:39 valid_lft forever preferred_lft forever 03:16:39 inet6 ::1/128 scope host 03:16:39 valid_lft forever preferred_lft forever 03:16:39 2: eth0: mtu 1450 qdisc fq_codel state UP group default qlen 1000 03:16:39 link/ether fa:16:3e:46:b5:9a brd ff:ff:ff:ff:ff:ff 03:16:39 altname enp0s3 03:16:39 altname ens3 03:16:39 inet 10.32.7.226/23 brd 10.32.7.255 scope global dynamic noprefixroute eth0 03:16:39 valid_lft 85652sec preferred_lft 85652sec 03:16:39 inet6 fe80::f816:3eff:fe46:b59a/64 scope link 03:16:39 valid_lft forever preferred_lft forever 03:16:39 03:16:39 03:16:39 ---> sar -b -r -n DEV: 03:16:39 Linux 4.18.0-529.el8.x86_64 (centos-stream-8-builder-7e611857-ce8d-42da-b0f0-357f5fb5fb5a.nov) 11/11/2026 _x86_64_ (2 CPU) 03:16:39 03:16:39 03:03:46 LINUX RESTART (2 CPU) 03:16:39 03:16:39 03:05:02 AM tps rtps wtps bread/s bwrtn/s 03:16:39 03:06:01 AM 51.44 0.68 50.76 46.36 5291.78 03:16:39 03:07:01 AM 70.79 0.70 70.09 201.53 12264.43 03:16:39 03:08:01 AM 42.14 0.55 41.59 61.99 9271.52 03:16:39 03:09:01 AM 81.35 0.20 81.15 43.44 85997.77 03:16:39 03:10:01 AM 116.42 2.53 113.89 190.27 163338.61 03:16:39 03:11:01 AM 102.25 4.11 98.13 473.28 134835.93 03:16:39 03:12:01 AM 51.57 2.60 48.98 379.14 1484.15 03:16:39 03:13:01 AM 72.30 0.03 72.27 1.07 1876.87 03:16:39 03:14:01 AM 63.35 0.05 63.30 1.60 1715.03 03:16:39 03:15:01 AM 82.54 20.36 62.17 2251.22 1627.41 03:16:39 03:16:01 AM 92.27 70.74 21.53 5936.82 680.16 03:16:39 Average: 75.17 9.34 65.83 872.73 38094.83 03:16:39 03:16:39 03:05:02 AM kbmemfree kbavail kbmemused %memused kbbuffers kbcached kbcommit %commit kbactive kbinact kbdirty 03:16:39 03:06:01 AM 1382660 3032420 2371016 63.17 2104 1818700 612036 12.74 136808 1945988 138008 03:16:39 03:07:01 AM 975644 2900832 2778032 74.01 2104 2084692 709340 14.77 141012 2308604 92396 03:16:39 03:08:01 AM 1037388 3002360 2716288 72.36 2104 2122680 606056 12.62 170232 2212512 97572 03:16:39 03:09:01 AM 137172 2841032 3616504 96.35 2104 2860972 757800 15.78 212252 3068656 182044 03:16:39 03:10:01 AM 119964 2828120 3633712 96.80 2104 2859340 816928 17.01 257752 3076644 166868 03:16:39 03:11:01 AM 135680 2787628 3617996 96.39 2104 2799512 862612 17.96 296712 3023368 4 03:16:39 03:12:01 AM 1568956 2915036 2184720 58.20 2104 1496024 734924 15.30 182716 1706044 3176 03:16:39 03:13:01 AM 1517516 2883508 2236160 59.57 2104 1512016 757928 15.78 189228 1738596 3464 03:16:39 03:14:01 AM 1461756 2840596 2291920 61.06 2104 1525668 788160 16.41 194692 1778468 2820 03:16:39 03:15:01 AM 1556592 3010156 2197084 58.53 2104 1604972 611804 12.74 208124 1657876 3400 03:16:39 03:16:01 AM 1347408 2988288 2406268 64.10 2104 1791756 618884 12.89 216584 1855400 8780 03:16:39 Average: 1021885 2911816 2731791 72.78 2104 2043303 716043 14.91 200556 2215651 63503 03:16:39 03:16:39 03:05:02 AM IFACE rxpck/s txpck/s rxkB/s txkB/s rxcmp/s txcmp/s rxmcst/s %ifutil 03:16:39 03:06:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:16:39 03:06:01 AM eth0 45.44 41.21 901.03 4.75 0.00 0.00 0.00 0.00 03:16:39 03:07:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:16:39 03:07:01 AM eth0 69.59 60.13 1071.75 8.10 0.00 0.00 0.00 0.00 03:16:39 03:08:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:16:39 03:08:01 AM eth0 40.26 35.78 687.46 5.07 0.00 0.00 0.00 0.00 03:16:39 03:09:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:16:39 03:09:01 AM eth0 1177.25 868.25 21679.94 61.29 0.00 0.00 0.00 0.00 03:16:39 03:10:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:16:39 03:10:01 AM eth0 2095.62 1565.37 40926.30 106.12 0.00 0.00 0.00 0.00 03:16:39 03:11:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:16:39 03:11:01 AM eth0 1671.80 1235.66 32417.68 84.17 0.00 0.00 0.00 0.00 03:16:39 03:12:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:16:39 03:12:01 AM eth0 62.04 33.14 244.30 8.37 0.00 0.00 0.00 0.00 03:16:39 03:13:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:16:39 03:13:01 AM eth0 43.23 30.94 99.99 10.44 0.00 0.00 0.00 0.00 03:16:39 03:14:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:16:39 03:14:01 AM eth0 36.90 26.76 86.74 8.94 0.00 0.00 0.00 0.00 03:16:39 03:15:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:16:39 03:15:01 AM eth0 38.78 27.26 86.31 9.95 0.00 0.00 0.00 0.00 03:16:39 03:16:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:16:39 03:16:01 AM eth0 11.70 11.40 9.37 5.61 0.00 0.00 0.00 0.00 03:16:39 Average: lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:16:39 Average: eth0 481.94 358.39 8943.03 28.48 0.00 0.00 0.00 0.00 03:16:39 03:16:39 03:16:39 ---> sar -P ALL: 03:16:39 Linux 4.18.0-529.el8.x86_64 (centos-stream-8-builder-7e611857-ce8d-42da-b0f0-357f5fb5fb5a.nov) 11/11/2026 _x86_64_ (2 CPU) 03:16:39 03:16:39 03:03:46 LINUX RESTART (2 CPU) 03:16:39 03:16:39 03:05:02 AM CPU %user %nice %system %iowait %steal %idle 03:16:39 03:06:01 AM all 23.29 0.00 3.04 1.32 0.08 72.27 03:16:39 03:06:01 AM 0 19.46 0.00 3.13 1.48 0.07 75.86 03:16:39 03:06:01 AM 1 27.10 0.00 2.95 1.15 0.10 68.69 03:16:39 03:07:01 AM all 30.19 0.00 3.61 2.16 0.09 63.94 03:16:39 03:07:01 AM 0 19.42 0.00 3.19 1.70 0.08 75.60 03:16:39 03:07:01 AM 1 40.93 0.00 4.03 2.62 0.10 52.32 03:16:39 03:08:01 AM all 29.55 0.00 3.58 0.86 0.09 65.92 03:16:39 03:08:01 AM 0 31.89 0.00 3.27 0.43 0.10 64.31 03:16:39 03:08:01 AM 1 27.23 0.00 3.88 1.28 0.08 67.53 03:16:39 03:09:01 AM all 27.17 0.00 7.13 2.18 0.10 63.42 03:16:39 03:09:01 AM 0 19.41 0.00 7.21 2.33 0.08 70.96 03:16:39 03:09:01 AM 1 34.85 0.00 7.04 2.04 0.12 55.95 03:16:39 03:10:01 AM all 23.99 0.00 11.97 2.69 0.13 61.22 03:16:39 03:10:01 AM 0 24.71 0.00 13.41 2.53 0.14 59.22 03:16:39 03:10:01 AM 1 23.28 0.00 10.57 2.85 0.12 63.18 03:16:39 03:11:01 AM all 16.25 0.00 9.73 2.26 0.09 71.68 03:16:39 03:11:01 AM 0 18.64 0.00 11.34 2.17 0.10 67.75 03:16:39 03:11:01 AM 1 13.89 0.00 8.14 2.34 0.08 75.54 03:16:39 03:12:01 AM all 31.62 0.00 1.65 0.57 0.08 66.08 03:16:39 03:12:01 AM 0 18.51 0.00 1.40 0.55 0.07 79.47 03:16:39 03:12:01 AM 1 44.72 0.00 1.89 0.58 0.10 52.71 03:16:39 03:13:01 AM all 31.50 0.00 1.49 0.43 0.10 66.48 03:16:39 03:13:01 AM 0 22.64 0.00 1.42 0.30 0.08 75.56 03:16:39 03:13:01 AM 1 40.37 0.00 1.57 0.55 0.12 57.39 03:16:39 03:14:01 AM all 35.31 0.00 1.34 0.34 0.10 62.91 03:16:39 03:14:01 AM 0 20.22 0.00 1.12 0.28 0.08 78.30 03:16:39 03:14:01 AM 1 50.41 0.00 1.55 0.40 0.12 47.52 03:16:39 03:15:01 AM all 32.27 0.00 1.55 1.14 0.09 64.94 03:16:39 03:15:01 AM 0 18.39 0.00 1.22 0.84 0.07 79.48 03:16:39 03:15:01 AM 1 46.12 0.00 1.89 1.45 0.12 50.43 03:16:39 03:16:01 AM all 23.45 0.00 2.45 5.71 0.08 68.31 03:16:39 03:16:01 AM 0 17.77 0.00 2.38 10.69 0.08 69.07 03:16:39 03:16:01 AM 1 29.12 0.00 2.52 0.73 0.08 67.55 03:16:39 03:16:39 Average: CPU %user %nice %system %iowait %steal %idle 03:16:39 Average: all 27.71 0.00 4.31 1.79 0.10 66.10 03:16:39 Average: 0 21.01 0.00 4.43 2.12 0.09 72.35 03:16:39 Average: 1 34.38 0.00 4.18 1.45 0.10 59.88 03:16:39 03:16:39 03:16:39