22:04:36 Started by timer 22:04:36 Running as SYSTEM 22:04:36 [EnvInject] - Loading node environment variables. 22:04:36 Building remotely on prd-centos8-builder-2c-4g-2489 (centos8-builder-2c-4g) in workspace /w/workspace/ci-management-openstack-cron 22:04:36 [ssh-agent] Looking for ssh-agent implementation... 22:04:36 $ ssh-agent 22:04:36 SSH_AUTH_SOCK=/tmp/ssh-NMs2rdRg8ujz/agent.5166 22:04:36 SSH_AGENT_PID=5168 22:04:36 [ssh-agent] Started. 22:04:36 Running ssh-add (command line suppressed) 22:04:36 Identity added: /w/workspace/ci-management-openstack-cron@tmp/private_key_2413063691317699829.key (jenkins-ssh) 22:04:37 [ssh-agent] Using credentials jenkins (jenkins) 22:04:37 The recommended git tool is: NONE 22:04:39 using credential jenkins 22:04:39 Wiping out workspace first. 22:04:39 Cloning the remote Git repository 22:04:39 Cloning repository ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management 22:04:39 > git init /w/workspace/ci-management-openstack-cron # timeout=10 22:04:39 Fetching upstream changes from ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management 22:04:39 > git --version # timeout=10 22:04:39 > git --version # 'git version 2.43.0' 22:04:39 using GIT_SSH to set credentials jenkins 22:04:39 [INFO] Currently running in a labeled security context 22:04:39 [INFO] Currently SELinux is 'enforcing' on the host 22:04:39 > /usr/bin/chcon --type=ssh_home_t /w/workspace/ci-management-openstack-cron@tmp/jenkins-gitclient-ssh6088499649200894668.key 22:04:39 > git fetch --tags --force --progress -- ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management +refs/heads/*:refs/remotes/origin/* # timeout=10 22:04:43 > git config remote.origin.url ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management # timeout=10 22:04:43 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10 22:04:43 Avoid second fetch 22:04:43 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10 22:04:43 Checking out Revision bd99cd2464adefc9a39aad8ae16df0732cbbfdc8 (refs/remotes/origin/master) 22:04:43 > git config core.sparsecheckout # timeout=10 22:04:43 > git checkout -f bd99cd2464adefc9a39aad8ae16df0732cbbfdc8 # timeout=10 22:04:44 Commit message: "CI: Update github2gerrit caller to v2.4.4" 22:04:44 > git rev-list --no-walk bd99cd2464adefc9a39aad8ae16df0732cbbfdc8 # timeout=10 22:04:44 > git remote # timeout=10 22:04:44 > git submodule init # timeout=10 22:04:44 > git submodule sync # timeout=10 22:04:44 > git config --get remote.origin.url # timeout=10 22:04:44 > git submodule init # timeout=10 22:04:44 > git config -f .gitmodules --get-regexp ^submodule\.(.+)\.url # timeout=10 22:04:44 > git config --get submodule.packer/common-packer.url # timeout=10 22:04:44 > git config -f .gitmodules --get submodule.packer/common-packer.path # timeout=10 22:04:44 > git config --get submodule.global-jjb.url # timeout=10 22:04:44 > git config -f .gitmodules --get submodule.global-jjb.path # timeout=10 22:04:44 > git submodule update --init --recursive packer/common-packer # timeout=10 22:04:49 > git submodule update --init --recursive global-jjb # timeout=10 22:05:01 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 22:05:01 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 22:05:01 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 22:05:01 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 22:05:01 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 22:05:01 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 22:05:01 Run condition [Boolean condition] enabling prebuild for step [BuilderChain] 22:05:01 provisioning config files... 22:05:01 copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml 22:05:01 copy managed file [npmrc] to file:/home/jenkins/.npmrc 22:05:01 copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf 22:05:01 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins1111821486658919201.sh 22:05:01 ---> python-tools-install.sh 22:05:01 Setup pyenv: 22:05:01 system 22:05:01 * 3.8.13 (set by /opt/pyenv/version) 22:05:01 * 3.9.13 (set by /opt/pyenv/version) 22:05:01 * 3.10.6 (set by /opt/pyenv/version) 22:05:06 lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-faNI 22:05:06 lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv 22:05:06 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 22:05:18 lf-activate-venv(): INFO: Installing additional packages: lftools 22:05:53 lf-activate-venv(): INFO: Adding /tmp/venv-faNI/bin to PATH 22:05:53 Generating Requirements File 22:06:36 ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. 22:06:36 botocore 1.44.0 requires python-dateutil<3.0.0,>=2.1, but you have python-dateutil 3.0.0 which is incompatible. 22:06:36 httplib2 0.30.2 requires pyparsing<4,>=3.0.4, but you have pyparsing 2.4.7 which is incompatible. 22:06:37 Python 3.10.6 22:06:37 pip 26.3 from /tmp/venv-faNI/lib/python3.10/site-packages/pip (python 3.10) 22:06:38 aiohappyeyeballs==2.7.1 22:06:38 aiohttp==3.14.5 22:06:38 aiosignal==1.4.0 22:06:38 appdirs==1.4.4 22:06:38 argcomplete==3.7.2 22:06:38 aspy.yaml==1.3.0 22:06:38 async-timeout==5.0.1 22:06:38 attrs==26.1.0 22:06:38 autopage==0.6.0 22:06:38 backports.strenum==1.3.1 22:06:38 beautifulsoup4==4.15.0 22:06:38 boto3==1.44.0 22:06:38 botocore==1.44.0 22:06:38 bs4==0.0.2 22:06:38 certifi==2026.10.23 22:06:38 cffi==2.1.1 22:06:38 cfgv==3.5.0 22:06:38 chardet==7.7.0 22:06:38 charset-normalizer==3.5.2 22:06:38 click==8.5.1 22:06:38 cliff==4.14.0 22:06:38 cmd2==3.5.1 22:06:38 cryptography==3.3.2 22:06:38 debtcollector==3.1.0 22:06:38 decorator==5.3.1 22:06:38 defusedxml==0.7.1 22:06:38 Deprecated==1.3.1 22:06:38 distlib==0.4.4 22:06:38 dnspython==2.8.0 22:06:38 docker==7.2.0 22:06:38 dogpile.cache==1.5.0 22:06:38 durationpy==0.11 22:06:38 email-validator==2.3.0 22:06:38 filelock==4.1.0 22:06:38 frozenlist==1.8.0 22:06:38 future==1.0.0 22:06:38 gitdb==4.0.12 22:06:38 GitPython==3.2.1 22:06:38 httplib2==0.30.2 22:06:38 identify==2.6.20 22:06:38 idna==3.20 22:06:38 importlib-resources==1.5.0 22:06:38 iso8601==2.1.0 22:06:38 Jinja2==3.1.6 22:06:38 jmespath==1.1.0 22:06:38 jsonpatch==1.46 22:06:38 jsonpointer==3.12 22:06:38 jsonschema==4.26.0 22:06:38 jsonschema-specifications==2025.9.1 22:06:38 keystoneauth1==5.14.0 22:06:38 kubernetes==36.0.3 22:06:38 lftools==0.37.26 22:06:38 lxml==6.1.3 22:06:38 markdown-it-py==4.3.0 22:06:38 MarkupSafe==3.0.4 22:06:38 mdurl==0.1.2 22:06:38 msgpack==1.2.4 22:06:38 multi_key_dict==2.0.4 22:06:38 multidict==7.1.0 22:06:38 munch==4.0.0 22:06:38 netaddr==1.3.0 22:06:38 niet==1.4.2 22:06:38 nodeenv==1.12.0 22:06:38 oauth2client==4.1.3 22:06:38 oauthlib==4.0.1 22:06:38 openstacksdk==4.13.0 22:06:38 os-service-types==1.8.2 22:06:38 osc-lib==4.6.0 22:06:38 oslo.config==10.4.0 22:06:38 oslo.context==6.4.0 22:06:38 oslo.i18n==6.8.0 22:06:38 oslo.log==8.2.0 22:06:38 oslo.serialization==5.10.0 22:06:38 oslo.utils==10.1.1 22:06:38 packaging==26.3 22:06:38 pbr==7.1.3 22:06:38 platformdirs==4.12.4 22:06:38 prettytable==3.18.0 22:06:38 propcache==0.5.4 22:06:38 psutil==7.2.2 22:06:38 pyasn1==0.6.5 22:06:38 pyasn1_modules==0.4.2 22:06:38 pycparser==3.11 22:06:38 pygerrit2==2.0.15 22:06:38 PyGithub==2.10.0 22:06:38 Pygments==2.21.0 22:06:38 PyJWT==2.15.1 22:06:38 PyNaCl==1.6.2 22:06:38 pyparsing==2.4.7 22:06:38 pyperclip==1.11.0 22:06:38 pyrsistent==0.20.0 22:06:38 python-cinderclient==9.9.0 22:06:38 python-dateutil==3.0.0 22:06:38 python-discovery==1.9.5 22:06:38 python-heatclient==5.2.0 22:06:38 python-jenkins==1.8.3 22:06:38 python-keystoneclient==6.0.0 22:06:38 python-magnumclient==4.11.0 22:06:38 python-openstackclient==10.0.0 22:06:38 python-swiftclient==4.11.0 22:06:38 PyYAML==6.0.3 22:06:38 referencing==0.37.0 22:06:38 requests==2.34.2 22:06:38 requests-oauthlib==2.0.0 22:06:38 rfc3986==2.0.0 22:06:38 rich==15.0.0 22:06:38 rich-argparse==1.8.0 22:06:38 rpds-py==0.30.0 22:06:38 rsa==4.9.1 22:06:38 ruamel.yaml==0.19.1 22:06:38 ruamel.yaml.clib==0.2.15 22:06:38 s3transfer==0.19.3 22:06:38 simplejson==4.3.0 22:06:38 six==1.17.0 22:06:38 smmap==5.0.3 22:06:38 soupsieve==2.10 22:06:38 stevedore==5.8.0 22:06:38 tabulate==0.10.0 22:06:38 toml==0.10.2 22:06:38 tomlkit==0.15.2 22:06:38 tqdm==4.70.1 22:06:38 typing_extensions==4.16.0 22:06:38 tzdata==2026.6 22:06:38 urllib3==1.26.20 22:06:38 virtualenv==21.15.6 22:06:38 wcwidth==0.9.4 22:06:38 websocket-client==1.9.2 22:06:38 wrapt==2.5.2 22:06:38 xdg==6.0.0 22:06:38 xmltodict==1.0.4 22:06:38 yarl==1.25.1 22:06:38 yq==4.4.5 22:06:38 [ci-management-openstack-cron] $ /bin/sh /tmp/jenkins3209185451044330052.sh 22:06:38 ---> uv-install.sh 22:06:38 Installing uv/uvx (latest) using shell installer 22:06:44 2026-11-11 22:06:44 URL:https://releases.astral.sh/installers/uv/latest/uv-installer.sh [71300/71300] -> "/tmp/uv-install-nzwtcr.sh" [1] 22:06:44 downloading uv 0.13.7 x86_64-unknown-linux-gnu 22:06:48 installing to /home/jenkins/.local/bin 22:06:48 uv 22:06:48 uvx 22:06:48 everything's installed! 22:06:48 ---> Validating uv/uvx install 22:06:48 uvx 0.13.7 (x86_64-unknown-linux-gnu) 22:06:48 [EnvInject] - Injecting environment variables from a build step. 22:06:48 [EnvInject] - Injecting as environment variables the properties content 22:06:48 OS_CLOUD=vex 22:06:48 22:06:48 [EnvInject] - Variables injected successfully. 22:06:48 [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True) 22:06:48 Run condition [Boolean condition] enabling perform for step [Execute shell] 22:06:48 [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins7941746018196897727.sh 22:06:48 ---> Orphaned k8s clusters 22:06:48 Setup pyenv: 22:06:48 system 22:06:48 3.8.13 22:06:48 3.9.13 22:06:48 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 22:06:49 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-faNI from file:/tmp/.os_lf_venv 22:06:49 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 22:06:54 lf-activate-venv(): INFO: Installing additional packages: kubernetes python-heatclient python-openstackclient python-magnumclient 22:07:20 ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. 22:07:20 botocore 1.44.0 requires python-dateutil<3.0.0,>=2.1, but you have python-dateutil 3.0.0 which is incompatible. 22:07:21 lf-activate-venv(): INFO: Adding /tmp/venv-faNI/bin to PATH 22:07:31 -----> Delete orphaned cluster 22:07:31 [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True) 22:07:31 Run condition [Boolean condition] enabling perform for step [Execute shell] 22:07:31 [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins12644697680690729994.sh 22:07:32 ---> Orphaned stacks 22:07:32 Setup pyenv: 22:07:32 system 22:07:32 3.8.13 22:07:32 3.9.13 22:07:32 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 22:07:32 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-faNI from file:/tmp/.os_lf_venv 22:07:32 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 22:07:37 lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq 22:08:10 lf-activate-venv(): INFO: Adding /tmp/venv-faNI/bin to PATH 22:08:10 + mapfile -t OS_COE_CLUSTERS_ID 22:08:10 ++ awk '{print $1}' 22:08:10 ++ openstack --os-cloud vex coe cluster list -f value -c uuid -c name 22:08:10 ++ grep -E '(DELETE_FAILED|UNKNOWN|UNHEALTHY)' 22:08:20 + echo '-----> Active clusters -> stacks' 22:08:20 -----> Active clusters -> stacks 22:08:20 + OS_COE_STACKS=() 22:08:20 + [[ 0 -gt 0 ]] 22:08:20 + mapfile -t OS_STACKS 22:08:20 ++ openstack --os-cloud vex stack list -f value -c 'Stack Name' -c 'Stack Status' --property stack_status=CREATE_COMPLETE --property stack_status=DELETE_FAILED --property stack_status=CREATE_FAILED 22:08:20 ++ awk '{print $1}' 22:08:28 + echo '-----> Active stacks' 22:08:28 -----> Active stacks 22:08:28 + echo '-----> Delete orphaned stacks' 22:08:28 -----> Delete orphaned stacks 22:08:28 [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True) 22:08:28 Run condition [Boolean condition] enabling perform for step [Execute shell] 22:08:28 [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins6481754297236457688.sh 22:08:28 ---> Orphaned servers 22:08:28 Setup pyenv: 22:08:28 system 22:08:28 3.8.13 22:08:28 3.9.13 22:08:28 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 22:08:29 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-faNI from file:/tmp/.os_lf_venv 22:08:29 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 22:08:34 lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq 22:11:10 ERROR: Could not install packages due to an OSError: [Errno 28] No space left on device 22:11:10 22:11:11 lf-venv-pip-install(): WARNING: install failed from the configured index, retrying against https://pypi.org/simple 22:15:01 Build timed out (after 10 minutes). Marking the build as failed. 22:15:01 $ ssh-agent -k 22:15:01 unset SSH_AUTH_SOCK; 22:15:01 unset SSH_AGENT_PID; 22:15:01 echo Agent pid 5168 killed; 22:15:01 [ssh-agent] Stopped. 22:15:01 Build was aborted 22:15:01 [PostBuildScript] - [INFO] Executing post build scripts. 22:15:01 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins7542202325630204936.sh 22:15:01 ---> sysstat.sh 22:15:01 /home/jenkins/lf-env.sh: line 73: 6632 Terminated "$venv_python" -m pip install --index-url "$upstream" "$@" 22:15:01 lf-activate-venv(): ERROR: Failed to install packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq 22:15:01 /tmp/jenkins6481754297236457688.sh: line 67: openstack: command not found 22:15:01 -----> Active servers 22:15:01 -----> Delete orphaned servers 22:15:02 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins16399464787441432495.sh 22:15:02 ---> package-listing.sh 22:15:02 ++ facter osfamily 22:15:02 ++ tr '[:upper:]' '[:lower:]' 22:15:03 + OS_FAMILY=redhat 22:15:03 + workspace=/w/workspace/ci-management-openstack-cron 22:15:03 + START_PACKAGES=/tmp/packages_start.txt 22:15:03 + END_PACKAGES=/tmp/packages_end.txt 22:15:03 + DIFF_PACKAGES=/tmp/packages_diff.txt 22:15:03 + PACKAGES=/tmp/packages_start.txt 22:15:03 + '[' /w/workspace/ci-management-openstack-cron ']' 22:15:03 + PACKAGES=/tmp/packages_end.txt 22:15:03 + case "${OS_FAMILY}" in 22:15:03 + rpm -qa 22:15:03 + sort 22:15:10 + '[' -f /tmp/packages_start.txt ']' 22:15:10 + '[' -f /tmp/packages_end.txt ']' 22:15:10 + diff /tmp/packages_start.txt /tmp/packages_end.txt 22:15:10 + '[' /w/workspace/ci-management-openstack-cron ']' 22:15:10 + mkdir -p /w/workspace/ci-management-openstack-cron/archives/ 22:15:10 + cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/ci-management-openstack-cron/archives/ 22:15:10 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins1805320906402534854.sh 22:15:10 ---> capture-instance-metadata.sh 22:15:10 Setup pyenv: 22:15:10 system 22:15:10 3.8.13 22:15:10 3.9.13 22:15:10 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 22:15:10 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-faNI from file:/tmp/.os_lf_venv 22:15:10 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 22:15:15 lf-activate-venv(): INFO: Installing additional packages: lftools 22:15:30 lf-activate-venv(): INFO: Adding /tmp/venv-faNI/bin to PATH 22:15:30 INFO: Running in OpenStack, capturing instance metadata 22:15:31 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins13698508378794632850.sh 22:15:31 provisioning config files... 22:15:31 copy managed file [jenkins-log-archives-settings] to file:/w/workspace/ci-management-openstack-cron@tmp/config3840948271174019881tmp 22:15:31 Regular expression run condition: Expression=[^.*logs-s3.*], Label=[] 22:15:31 Run condition [Regular expression match] preventing perform for step [Provide Configuration files] 22:15:31 [EnvInject] - Injecting environment variables from a build step. 22:15:31 [EnvInject] - Injecting as environment variables the properties content 22:15:31 SERVER_ID=logs 22:15:31 22:15:31 [EnvInject] - Variables injected successfully. 22:15:31 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins13901755148323302294.sh 22:15:31 ---> create-netrc.sh 22:15:31 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins10705922899210194363.sh 22:15:31 ---> python-tools-install.sh 22:15:31 Setup pyenv: 22:15:31 system 22:15:31 3.8.13 22:15:31 3.9.13 22:15:31 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 22:15:31 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-faNI from file:/tmp/.os_lf_venv 22:15:31 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 22:15:36 lf-activate-venv(): INFO: Installing additional packages: lftools 22:15:51 lf-activate-venv(): INFO: Adding /tmp/venv-faNI/bin to PATH 22:15:51 [ci-management-openstack-cron] $ /bin/sh /tmp/jenkins7167293738760560052.sh 22:15:51 ---> uv-install.sh 22:15:51 uv 0.13.7 is already installed 22:15:51 uvx 0.13.7 (x86_64-unknown-linux-gnu) 22:15:51 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins16119921939032979253.sh 22:15:51 ---> sudo-logs.sh 22:15:51 Archiving 'sudo' log.. 22:15:52 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins16149466098166628988.sh 22:15:52 ---> job-cost.sh 22:15:52 INFO: Activating Python virtual environment... 22:15:52 Setup pyenv: 22:15:52 system 22:15:52 3.8.13 22:15:52 3.9.13 22:15:52 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 22:15:52 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-faNI from file:/tmp/.os_lf_venv 22:15:52 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 22:15:57 lf-activate-venv(): INFO: Installing additional packages: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 22:16:10 lf-activate-venv(): INFO: Adding /tmp/venv-faNI/bin to PATH 22:16:10 INFO: No stack-cost file found 22:16:10 INFO: Instance uptime: 752s 22:16:10 INFO: Fetching instance metadata (attempt 1 of 3)... 22:16:10 DEBUG: URL: http://169.254.169.254/latest/meta-data/instance-type 22:16:10 INFO: Successfully fetched instance metadata 22:16:10 INFO: Instance type: v3-starter-2 22:16:10 INFO: Retrieving pricing info for: v3-starter-2 22:16:10 INFO: Fetching Vexxhost pricing API (attempt 1 of 3)... 22:16:10 DEBUG: URL: https://pricing.vexxhost.net/v1/pricing/v3-starter-2/cost?seconds=752 22:16:13 INFO: Successfully fetched Vexxhost pricing API 22:16:13 INFO: Retrieved cost: 0.02 22:16:13 INFO: Retrieved resource: v3-starter-2 22:16:13 INFO: Creating archive directory: /w/workspace/ci-management-openstack-cron/archives/cost 22:16:13 INFO: Archiving costs to: /w/workspace/ci-management-openstack-cron/archives/cost.csv 22:16:13 INFO: Successfully archived job cost data 22:16:13 DEBUG: Cost data: ci-management-openstack-cron,63779,2026-11-11 22:16:13,v3-starter-2,752,0.02,0.00,FAILURE 22:16:13 [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins10214904540271917707.sh 22:16:13 ---> logs-deploy.sh 22:16:13 Setup pyenv: 22:16:13 system 22:16:13 3.8.13 22:16:13 3.9.13 22:16:13 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 22:16:14 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-faNI from file:/tmp/.os_lf_venv 22:16:14 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 22:16:19 lf-activate-venv(): INFO: Installing additional packages: lftools urllib3~=1.26.15 22:16:34 lf-activate-venv(): INFO: Adding /tmp/venv-faNI/bin to PATH 22:16:34 INFO: Nexus URL https://nexus.o-ran-sc.org path production/vex-sjc-oran-jenkins-prod-1/ci-management-openstack-cron/63779 22:16:34 INFO: archiving workspace using pattern(s): 22:16:39 Archives upload complete. 22:16:39 INFO: archiving logs to Nexus 22:16:40 ---> uname -a: 22:16:40 Linux prd-centos8-builder-2c-4g-2489.novalocal 4.18.0-529.el8.x86_64 #1 SMP Wed Dec 6 01:03:46 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux 22:16:40 22:16:40 22:16:40 ---> lscpu: 22:16:40 Architecture: x86_64 22:16:40 CPU op-mode(s): 32-bit, 64-bit 22:16:40 Byte Order: Little Endian 22:16:40 CPU(s): 2 22:16:40 On-line CPU(s) list: 0,1 22:16:40 Thread(s) per core: 1 22:16:40 Core(s) per socket: 1 22:16:40 Socket(s): 2 22:16:40 NUMA node(s): 1 22:16:40 Vendor ID: AuthenticAMD 22:16:40 CPU family: 23 22:16:40 Model: 49 22:16:40 Model name: AMD EPYC-Rome Processor 22:16:40 Stepping: 0 22:16:40 CPU MHz: 2799.998 22:16:40 BogoMIPS: 5599.99 22:16:40 Virtualization: AMD-V 22:16:40 Hypervisor vendor: KVM 22:16:40 Virtualization type: full 22:16:40 L1d cache: 32K 22:16:40 L1i cache: 32K 22:16:40 L2 cache: 512K 22:16:40 L3 cache: 16384K 22:16:40 NUMA node0 CPU(s): 0,1 22:16:40 Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr wbnoinvd arat npt nrip_save umip rdpid arch_capabilities 22:16:40 22:16:40 22:16:40 ---> nproc: 22:16:40 2 22:16:40 22:16:40 22:16:40 ---> df -h: 22:16:40 Filesystem Size Used Avail Use% Mounted on 22:16:40 devtmpfs 1.8G 0 1.8G 0% /dev 22:16:40 tmpfs 1.8G 0 1.8G 0% /dev/shm 22:16:40 tmpfs 1.8G 17M 1.8G 1% /run 22:16:40 tmpfs 1.8G 0 1.8G 0% /sys/fs/cgroup 22:16:40 /dev/vda1 20G 15G 5.4G 74% / 22:16:40 tmpfs 367M 0 367M 0% /run/user/1001 22:16:40 22:16:40 22:16:40 ---> free -m: 22:16:40 total used free shared buff/cache available 22:16:40 Mem: 3665 458 1246 17 1960 2907 22:16:40 Swap: 1023 0 1023 22:16:40 22:16:40 22:16:40 ---> ip addr: 22:16:40 1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 22:16:40 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 22:16:40 inet 127.0.0.1/8 scope host lo 22:16:40 valid_lft forever preferred_lft forever 22:16:40 inet6 ::1/128 scope host 22:16:40 valid_lft forever preferred_lft forever 22:16:40 2: eth0: mtu 1450 qdisc fq_codel state UP group default qlen 1000 22:16:40 link/ether fa:16:3e:26:b5:f3 brd ff:ff:ff:ff:ff:ff 22:16:40 altname enp0s3 22:16:40 altname ens3 22:16:40 inet 10.32.7.168/23 brd 10.32.7.255 scope global dynamic noprefixroute eth0 22:16:40 valid_lft 85649sec preferred_lft 85649sec 22:16:40 inet6 fe80::f816:3eff:fe26:b5f3/64 scope link 22:16:40 valid_lft forever preferred_lft forever 22:16:40 22:16:40 22:16:40 ---> sar -b -r -n DEV: 22:16:40 Linux 4.18.0-529.el8.x86_64 (centos-stream-8-builder-7e611857-ce8d-42da-b0f0-357f5fb5fb5a.nov) 11/11/2026 _x86_64_ (2 CPU) 22:16:40 22:16:40 22:03:46 LINUX RESTART (2 CPU) 22:16:40 22:16:40 10:05:01 PM tps rtps wtps bread/s bwrtn/s 22:16:40 10:06:01 PM 57.38 6.36 51.02 933.16 5389.50 22:16:40 10:07:01 PM 61.61 0.73 60.88 202.07 8521.21 22:16:40 10:08:01 PM 47.06 0.47 46.59 60.12 12854.02 22:16:40 10:09:01 PM 37.27 0.05 37.22 1.33 7303.27 22:16:40 10:10:01 PM 122.99 1.53 121.46 188.74 175466.52 22:16:40 10:11:01 PM 124.30 3.27 121.04 201.23 169474.06 22:16:40 10:12:01 PM 68.49 2.98 65.51 396.27 33821.58 22:16:40 10:13:01 PM 68.21 0.07 68.14 2.13 1778.16 22:16:40 10:14:01 PM 58.82 0.07 58.76 2.13 1570.05 22:16:40 10:15:01 PM 57.95 0.02 57.93 0.53 1518.11 22:16:40 10:16:01 PM 110.50 90.59 19.91 8214.33 604.02 22:16:40 Average: 74.06 9.65 64.41 927.43 38038.57 22:16:40 22:16:40 10:05:01 PM kbmemfree kbavail kbmemused %memused kbbuffers kbcached kbcommit %commit kbactive kbinact kbdirty 22:16:40 10:06:01 PM 1383232 3033208 2370444 63.15 2104 1818812 594964 12.39 136552 1945972 138100 22:16:40 10:07:01 PM 1065560 2974736 2688116 71.61 2104 2068652 627320 13.06 138716 2225792 183008 22:16:40 10:08:01 PM 835328 2904328 2918348 77.75 2104 2227440 689340 14.35 154964 2433712 76964 22:16:40 10:09:01 PM 624600 2874004 3129076 83.36 2104 2407720 726516 15.13 181316 2618240 195260 22:16:40 10:10:01 PM 122852 2827784 3630824 96.73 2104 2858348 776540 16.17 243264 3059492 172648 22:16:40 10:11:01 PM 131996 2807540 3621680 96.48 2104 2822484 829028 17.26 295504 3031308 201040 22:16:40 10:12:01 PM 1570648 2926948 2183028 58.16 2104 1505124 720808 15.01 188996 1701008 2996 22:16:40 10:13:01 PM 1525740 2900856 2227936 59.35 2104 1520248 729100 15.18 195144 1728736 3376 22:16:40 10:14:01 PM 1473576 2864496 2280100 60.74 2104 1532984 760872 15.84 200256 1765628 2788 22:16:40 10:15:01 PM 1422680 2827128 2330996 62.10 2104 1545568 784180 16.33 205308 1802188 2800 22:16:40 10:16:01 PM 1362248 3021252 2391428 63.71 2104 1798864 592228 12.33 221320 1840084 9460 22:16:40 Average: 1047133 2905662 2706543 72.10 2104 2009659 711900 14.82 196485 2195651 89858 22:16:40 22:16:40 10:05:01 PM IFACE rxpck/s txpck/s rxkB/s txkB/s rxcmp/s txcmp/s rxmcst/s %ifutil 22:16:40 10:06:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 22:16:40 10:06:01 PM eth0 46.88 38.74 887.29 5.27 0.00 0.00 0.00 0.00 22:16:40 10:07:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 22:16:40 10:07:01 PM eth0 69.86 59.11 1024.04 7.21 0.00 0.00 0.00 0.00 22:16:40 10:08:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 22:16:40 10:08:01 PM eth0 42.01 38.01 738.60 5.79 0.00 0.00 0.00 0.00 22:16:40 10:09:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 22:16:40 10:09:01 PM eth0 69.89 58.90 1851.33 6.82 0.00 0.00 0.00 0.00 22:16:40 10:10:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 22:16:40 10:10:01 PM eth0 1621.48 1270.68 43690.82 87.18 0.00 0.00 0.00 0.00 22:16:40 10:11:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 22:16:40 10:11:01 PM eth0 1675.36 1310.09 42821.42 89.71 0.00 0.00 0.00 0.00 22:16:40 10:12:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 22:16:40 10:12:01 PM eth0 339.80 234.16 6632.31 21.28 0.00 0.00 0.00 0.00 22:16:40 10:13:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 22:16:40 10:13:01 PM eth0 78.69 36.15 96.38 10.28 0.00 0.00 0.00 0.00 22:16:40 10:14:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 22:16:40 10:14:01 PM eth0 65.21 32.08 81.98 8.80 0.00 0.00 0.00 0.00 22:16:40 10:15:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 22:16:40 10:15:01 PM eth0 65.99 32.22 82.49 8.76 0.00 0.00 0.00 0.00 22:16:40 10:16:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 22:16:40 10:16:01 PM eth0 14.95 13.33 10.98 6.62 0.00 0.00 0.00 0.00 22:16:40 Average: lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 22:16:40 Average: eth0 371.93 284.03 8904.48 23.43 0.00 0.00 0.00 0.00 22:16:40 22:16:40 22:16:40 ---> sar -P ALL: 22:16:40 Linux 4.18.0-529.el8.x86_64 (centos-stream-8-builder-7e611857-ce8d-42da-b0f0-357f5fb5fb5a.nov) 11/11/2026 _x86_64_ (2 CPU) 22:16:40 22:16:40 22:03:46 LINUX RESTART (2 CPU) 22:16:40 22:16:40 10:05:01 PM CPU %user %nice %system %iowait %steal %idle 22:16:40 10:06:01 PM all 23.94 0.00 3.25 1.86 0.08 70.87 22:16:40 10:06:01 PM 0 26.84 0.00 3.15 1.68 0.08 68.24 22:16:40 10:06:01 PM 1 21.03 0.00 3.34 2.04 0.08 73.51 22:16:40 10:07:01 PM all 23.74 0.00 3.33 1.88 0.10 70.96 22:16:40 10:07:01 PM 0 32.90 0.00 3.81 1.97 0.10 61.22 22:16:40 10:07:01 PM 1 14.54 0.00 2.84 1.79 0.10 80.73 22:16:40 10:08:01 PM all 27.66 0.00 2.73 2.30 0.09 67.22 22:16:40 10:08:01 PM 0 23.64 0.00 2.82 2.24 0.08 71.22 22:16:40 10:08:01 PM 1 31.68 0.00 2.64 2.37 0.10 63.21 22:16:40 10:09:01 PM all 24.05 0.00 2.74 1.25 0.08 71.89 22:16:40 10:09:01 PM 0 32.04 0.00 3.30 1.72 0.08 62.86 22:16:40 10:09:01 PM 1 16.05 0.00 2.17 0.78 0.07 80.92 22:16:40 10:10:01 PM all 21.95 0.00 12.66 3.14 0.09 62.15 22:16:40 10:10:01 PM 0 27.18 0.00 15.09 3.39 0.10 54.24 22:16:40 10:10:01 PM 1 16.81 0.00 10.27 2.90 0.08 69.93 22:16:40 10:11:01 PM all 21.57 0.00 12.72 2.85 0.11 62.75 22:16:40 10:11:01 PM 0 26.69 0.00 15.79 3.16 0.12 54.24 22:16:40 10:11:01 PM 1 16.53 0.00 9.70 2.53 0.10 71.14 22:16:40 10:12:01 PM all 27.16 0.00 3.50 1.08 0.10 68.16 22:16:40 10:12:01 PM 0 41.04 0.00 4.52 1.49 0.12 52.83 22:16:40 10:12:01 PM 1 13.28 0.00 2.48 0.67 0.08 83.49 22:16:40 10:13:01 PM all 29.83 0.00 1.39 0.49 0.11 68.18 22:16:40 10:13:01 PM 0 51.94 0.00 2.07 0.75 0.13 45.10 22:16:40 10:13:01 PM 1 7.62 0.00 0.70 0.23 0.08 91.35 22:16:40 10:14:01 PM all 31.40 0.00 1.23 0.34 0.08 66.95 22:16:40 10:14:01 PM 0 43.43 0.00 1.62 0.47 0.10 54.38 22:16:40 10:14:01 PM 1 19.34 0.00 0.84 0.22 0.07 79.54 22:16:40 10:15:01 PM all 31.65 0.00 1.20 0.30 0.10 66.75 22:16:40 10:15:01 PM 0 42.82 0.00 1.49 0.33 0.12 55.24 22:16:40 10:15:01 PM 1 20.46 0.00 0.90 0.27 0.08 78.29 22:16:40 10:16:01 PM all 23.08 0.00 2.71 6.58 0.09 67.54 22:16:40 10:16:01 PM 0 37.80 0.00 3.09 2.15 0.10 56.86 22:16:40 10:16:01 PM 1 8.33 0.00 2.32 11.02 0.08 78.24 22:16:40 22:16:40 Average: CPU %user %nice %system %iowait %steal %idle 22:16:40 Average: all 26.01 0.00 4.30 2.01 0.09 67.60 22:16:40 Average: 0 35.14 0.00 5.12 1.75 0.10 57.87 22:16:40 Average: 1 16.88 0.00 3.47 2.26 0.09 77.30 22:16:40 22:16:40 22:16:40