00:04:38 Started by timer 00:04:38 Running as SYSTEM 00:04:38 [EnvInject] - Loading node environment variables. 00:04:38 Building remotely on prd-centos8-builder-2c-4g-2204 (centos8-builder-2c-4g) in workspace /w/workspace/ci-management-openstack-cron 00:04:38 [ssh-agent] Looking for ssh-agent implementation... 00:04:38 $ ssh-agent 00:04:38 SSH_AUTH_SOCK=/tmp/ssh-zb49SArmstzA/agent.5171 00:04:38 SSH_AGENT_PID=5173 00:04:38 [ssh-agent] Started. 00:04:38 Running ssh-add (command line suppressed) 00:04:38 Identity added: /w/workspace/ci-management-openstack-cron@tmp/private_key_12262837500048167244.key (jenkins-ssh) 00:04:38 [ssh-agent] Using credentials jenkins (jenkins) 00:04:38 The recommended git tool is: NONE 00:04:40 using credential jenkins 00:04:40 Wiping out workspace first. 00:04:40 Cloning the remote Git repository 00:04:41 Cloning repository ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management 00:04:41 > git init /w/workspace/ci-management-openstack-cron # timeout=10 00:04:41 Fetching upstream changes from ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management 00:04:41 > git --version # timeout=10 00:04:41 > git --version # 'git version 2.43.0' 00:04:41 using GIT_SSH to set credentials jenkins 00:04:41 [INFO] Currently running in a labeled security context 00:04:41 [INFO] Currently SELinux is 'enforcing' on the host 00:04:41 > /usr/bin/chcon --type=ssh_home_t /w/workspace/ci-management-openstack-cron@tmp/jenkins-gitclient-ssh5500263245182931851.key 00:04:41 > git fetch --tags --force --progress -- ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management +refs/heads/*:refs/remotes/origin/* # timeout=10 00:04:44 > git config remote.origin.url ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management # timeout=10 00:04:44 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10 00:04:45 Avoid second fetch 00:04:45 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10 00:04:45 Checking out Revision bd99cd2464adefc9a39aad8ae16df0732cbbfdc8 (refs/remotes/origin/master) 00:04:45 > git config core.sparsecheckout # timeout=10 00:04:45 > git checkout -f bd99cd2464adefc9a39aad8ae16df0732cbbfdc8 # timeout=10 00:04:45 Commit message: "CI: Update github2gerrit caller to v2.4.4" 00:04:45 > git rev-list --no-walk bd99cd2464adefc9a39aad8ae16df0732cbbfdc8 # timeout=10 00:04:45 > git remote # timeout=10 00:04:45 > git submodule init # timeout=10 00:04:45 > git submodule sync # timeout=10 00:04:46 > git config --get remote.origin.url # timeout=10 00:04:46 > git submodule init # timeout=10 00:04:46 > git config -f .gitmodules --get-regexp ^submodule\.(.+)\.url # timeout=10 00:04:46 > git config --get submodule.packer/common-packer.url # timeout=10 00:04:46 > git config -f .gitmodules --get submodule.packer/common-packer.path # timeout=10 00:04:46 > git config --get submodule.global-jjb.url # timeout=10 00:04:46 > git config -f .gitmodules --get submodule.global-jjb.path # timeout=10 00:04:46 > git submodule update --init --recursive packer/common-packer # timeout=10 00:04:50 > git submodule update --init --recursive global-jjb # timeout=10 00:05:02 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 00:05:02 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 00:05:02 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 00:05:02 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 00:05:02 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 00:05:02 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 00:05:02 Run condition [Boolean condition] enabling prebuild for step [BuilderChain] 00:05:02 provisioning config files... 00:05:02 copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml 00:05:02 copy managed file [npmrc] to file:/home/jenkins/.npmrc 00:05:02 copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf 00:05:02 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins2537381023341277770.sh 00:05:02 ---> python-tools-install.sh 00:05:02 Setup pyenv: 00:05:02 system 00:05:02 * 3.8.13 (set by /opt/pyenv/version) 00:05:02 * 3.9.13 (set by /opt/pyenv/version) 00:05:02 * 3.10.6 (set by /opt/pyenv/version) 00:05:07 lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-RVpK 00:05:07 lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv 00:05:07 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 00:05:18 lf-activate-venv(): INFO: Installing additional packages: lftools 00:05:54 lf-activate-venv(): INFO: Adding /tmp/venv-RVpK/bin to PATH 00:05:54 Generating Requirements File 00:06:37 ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. 00:06:37 botocore 1.43.126 requires python-dateutil<3.0.0,>=2.1, but you have python-dateutil 3.0.0 which is incompatible. 00:06:37 httplib2 0.30.2 requires pyparsing<4,>=3.0.4, but you have pyparsing 2.4.7 which is incompatible. 00:06:38 Python 3.10.6 00:06:38 pip 26.3 from /tmp/venv-RVpK/lib/python3.10/site-packages/pip (python 3.10) 00:06:38 aiohappyeyeballs==2.7.1 00:06:38 aiohttp==3.14.5 00:06:38 aiosignal==1.4.0 00:06:38 appdirs==1.4.4 00:06:38 argcomplete==3.7.2 00:06:38 aspy.yaml==1.3.0 00:06:38 async-timeout==5.0.1 00:06:38 attrs==26.1.0 00:06:38 autopage==0.6.0 00:06:38 backports.strenum==1.3.1 00:06:38 beautifulsoup4==4.15.0 00:06:38 boto3==1.43.126 00:06:38 botocore==1.43.126 00:06:38 bs4==0.0.2 00:06:38 certifi==2026.10.23 00:06:38 cffi==2.1.1 00:06:38 cfgv==3.5.0 00:06:38 chardet==7.7.0 00:06:38 charset-normalizer==3.5.2 00:06:38 click==8.5.1 00:06:38 cliff==4.14.0 00:06:38 cmd2==3.5.1 00:06:38 cryptography==3.3.2 00:06:38 debtcollector==3.1.0 00:06:38 decorator==5.3.1 00:06:38 defusedxml==0.7.1 00:06:38 Deprecated==1.3.1 00:06:38 distlib==0.4.4 00:06:38 dnspython==2.8.0 00:06:38 docker==7.2.0 00:06:38 dogpile.cache==1.5.0 00:06:38 durationpy==0.11 00:06:38 email-validator==2.3.0 00:06:38 filelock==4.1.0 00:06:38 frozenlist==1.8.0 00:06:38 future==1.0.0 00:06:38 gitdb==4.0.12 00:06:38 GitPython==3.2.1 00:06:38 httplib2==0.30.2 00:06:38 identify==2.6.20 00:06:38 idna==3.20 00:06:38 importlib-resources==1.5.0 00:06:38 iso8601==2.1.0 00:06:38 Jinja2==3.1.6 00:06:38 jmespath==1.1.0 00:06:38 jsonpatch==1.44 00:06:38 jsonpointer==3.10 00:06:38 jsonschema==4.26.0 00:06:38 jsonschema-specifications==2025.9.1 00:06:38 keystoneauth1==5.14.0 00:06:38 kubernetes==36.0.3 00:06:38 lftools==0.37.26 00:06:38 lxml==6.1.3 00:06:38 markdown-it-py==4.2.0 00:06:38 MarkupSafe==3.0.4 00:06:38 mdurl==0.1.2 00:06:38 msgpack==1.2.4 00:06:38 multi_key_dict==2.0.4 00:06:38 multidict==7.1.0 00:06:38 munch==4.0.0 00:06:38 netaddr==1.3.0 00:06:38 niet==1.4.2 00:06:38 nodeenv==1.12.0 00:06:38 oauth2client==4.1.3 00:06:38 oauthlib==4.0.1 00:06:38 openstacksdk==4.13.0 00:06:38 os-service-types==1.8.2 00:06:38 osc-lib==4.6.0 00:06:38 oslo.config==10.4.0 00:06:38 oslo.context==6.4.0 00:06:38 oslo.i18n==6.8.0 00:06:38 oslo.log==8.2.0 00:06:38 oslo.serialization==5.10.0 00:06:38 oslo.utils==10.1.1 00:06:38 packaging==26.3 00:06:38 pbr==7.1.3 00:06:38 platformdirs==4.12.4 00:06:38 prettytable==3.18.0 00:06:38 propcache==0.5.4 00:06:38 psutil==7.2.2 00:06:38 pyasn1==0.6.5 00:06:38 pyasn1_modules==0.4.2 00:06:38 pycparser==3.11 00:06:38 pygerrit2==2.0.15 00:06:38 PyGithub==2.10.0 00:06:38 Pygments==2.21.0 00:06:38 PyJWT==2.15.1 00:06:38 PyNaCl==1.6.2 00:06:38 pyparsing==2.4.7 00:06:38 pyperclip==1.11.0 00:06:38 pyrsistent==0.20.0 00:06:38 python-cinderclient==9.9.0 00:06:38 python-dateutil==3.0.0 00:06:38 python-discovery==1.9.5 00:06:38 python-heatclient==5.2.0 00:06:38 python-jenkins==1.8.3 00:06:38 python-keystoneclient==6.0.0 00:06:38 python-magnumclient==4.11.0 00:06:38 python-openstackclient==10.0.0 00:06:38 python-swiftclient==4.11.0 00:06:38 PyYAML==6.0.3 00:06:38 referencing==0.37.0 00:06:38 requests==2.34.2 00:06:38 requests-oauthlib==2.0.0 00:06:38 rfc3986==2.0.0 00:06:38 rich==15.0.0 00:06:38 rich-argparse==1.8.0 00:06:38 rpds-py==0.30.0 00:06:38 rsa==4.9.1 00:06:38 ruamel.yaml==0.19.1 00:06:38 ruamel.yaml.clib==0.2.15 00:06:38 s3transfer==0.19.3 00:06:38 simplejson==4.2.0 00:06:38 six==1.17.0 00:06:38 smmap==5.0.3 00:06:38 soupsieve==2.10 00:06:38 stevedore==5.8.0 00:06:38 tabulate==0.10.0 00:06:38 toml==0.10.2 00:06:38 tomlkit==0.15.2 00:06:38 tqdm==4.70.1 00:06:38 typing_extensions==4.16.0 00:06:38 tzdata==2026.6 00:06:38 urllib3==1.26.20 00:06:38 virtualenv==21.15.6 00:06:38 wcwidth==0.9.4 00:06:38 websocket-client==1.9.2 00:06:38 wrapt==2.5.2 00:06:38 xdg==6.0.0 00:06:38 xmltodict==1.0.4 00:06:38 yarl==1.25.1 00:06:38 yq==4.4.5 00:06:38 [ci-management-openstack-cron] $ /bin/sh /tmp/jenkins12414367170438105301.sh 00:06:38 ---> uv-install.sh 00:06:38 Installing uv/uvx (latest) using shell installer 00:06:45 2026-11-08 00:06:45 URL:https://releases.astral.sh/installers/uv/latest/uv-installer.sh [71300/71300] -> "/tmp/uv-install-gctOQo.sh" [1] 00:06:45 downloading uv 0.13.7 x86_64-unknown-linux-gnu 00:06:49 installing to /home/jenkins/.local/bin 00:06:49 uv 00:06:49 uvx 00:06:49 everything's installed! 00:06:49 ---> Validating uv/uvx install 00:06:49 uvx 0.13.7 (x86_64-unknown-linux-gnu) 00:06:49 [EnvInject] - Injecting environment variables from a build step. 00:06:49 [EnvInject] - Injecting as environment variables the properties content 00:06:49 OS_CLOUD=vex 00:06:49 00:06:49 [EnvInject] - Variables injected successfully. 00:06:49 [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True) 00:06:49 Run condition [Boolean condition] enabling perform for step [Execute shell] 00:06:49 [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins7414281669308577033.sh 00:06:49 ---> Orphaned k8s clusters 00:06:49 Setup pyenv: 00:06:49 system 00:06:49 3.8.13 00:06:49 3.9.13 00:06:49 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 00:06:50 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-RVpK from file:/tmp/.os_lf_venv 00:06:50 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 00:06:55 lf-activate-venv(): INFO: Installing additional packages: kubernetes python-heatclient python-openstackclient python-magnumclient 00:07:20 ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. 00:07:20 botocore 1.43.126 requires python-dateutil<3.0.0,>=2.1, but you have python-dateutil 3.0.0 which is incompatible. 00:07:21 lf-activate-venv(): INFO: Adding /tmp/venv-RVpK/bin to PATH 00:07:32 -----> Delete orphaned cluster 00:07:32 [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True) 00:07:32 Run condition [Boolean condition] enabling perform for step [Execute shell] 00:07:32 [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins6168516889887164431.sh 00:07:32 ---> Orphaned stacks 00:07:32 Setup pyenv: 00:07:32 system 00:07:32 3.8.13 00:07:32 3.9.13 00:07:32 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 00:07:32 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-RVpK from file:/tmp/.os_lf_venv 00:07:32 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 00:07:37 lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq 00:08:09 lf-activate-venv(): INFO: Adding /tmp/venv-RVpK/bin to PATH 00:08:09 + mapfile -t OS_COE_CLUSTERS_ID 00:08:09 ++ openstack --os-cloud vex coe cluster list -f value -c uuid -c name 00:08:09 ++ awk '{print $1}' 00:08:09 ++ grep -E '(DELETE_FAILED|UNKNOWN|UNHEALTHY)' 00:08:18 + echo '-----> Active clusters -> stacks' 00:08:18 -----> Active clusters -> stacks 00:08:18 + OS_COE_STACKS=() 00:08:18 + [[ 0 -gt 0 ]] 00:08:18 + mapfile -t OS_STACKS 00:08:18 ++ openstack --os-cloud vex stack list -f value -c 'Stack Name' -c 'Stack Status' --property stack_status=CREATE_COMPLETE --property stack_status=DELETE_FAILED --property stack_status=CREATE_FAILED 00:08:18 ++ awk '{print $1}' 00:08:27 + echo '-----> Active stacks' 00:08:27 -----> Active stacks 00:08:27 + echo '-----> Delete orphaned stacks' 00:08:27 -----> Delete orphaned stacks 00:08:27 [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True) 00:08:27 Run condition [Boolean condition] enabling perform for step [Execute shell] 00:08:27 [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins4256215275782537025.sh 00:08:27 ---> Orphaned servers 00:08:27 Setup pyenv: 00:08:27 system 00:08:27 3.8.13 00:08:27 3.9.13 00:08:27 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 00:08:27 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-RVpK from file:/tmp/.os_lf_venv 00:08:27 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 00:08:32 lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq 00:11:22 ERROR: Could not install packages due to an OSError: [Errno 28] No space left on device 00:11:22 00:11:23 lf-venv-pip-install(): WARNING: install failed from the configured index, retrying against https://pypi.org/simple 00:15:02 Build timed out (after 10 minutes). Marking the build as failed. 00:15:02 $ ssh-agent -k 00:15:02 unset SSH_AUTH_SOCK; 00:15:02 unset SSH_AGENT_PID; 00:15:02 echo Agent pid 5173 killed; 00:15:02 [ssh-agent] Stopped. 00:15:02 Build was aborted 00:15:02 [PostBuildScript] - [INFO] Executing post build scripts. 00:15:02 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins12874551076120785459.sh 00:15:02 ---> sysstat.sh 00:15:02 /home/jenkins/lf-env.sh: line 73: 6644 Terminated "$venv_python" -m pip install --index-url "$upstream" "$@" 00:15:02 lf-activate-venv(): ERROR: Failed to install packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq 00:15:02 /tmp/jenkins4256215275782537025.sh: line 67: openstack: command not found 00:15:02 -----> Active servers 00:15:02 -----> Delete orphaned servers 00:15:03 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins7676547988772557946.sh 00:15:03 ---> package-listing.sh 00:15:03 ++ facter osfamily 00:15:03 ++ tr '[:upper:]' '[:lower:]' 00:15:04 + OS_FAMILY=redhat 00:15:04 + workspace=/w/workspace/ci-management-openstack-cron 00:15:04 + START_PACKAGES=/tmp/packages_start.txt 00:15:04 + END_PACKAGES=/tmp/packages_end.txt 00:15:04 + DIFF_PACKAGES=/tmp/packages_diff.txt 00:15:04 + PACKAGES=/tmp/packages_start.txt 00:15:04 + '[' /w/workspace/ci-management-openstack-cron ']' 00:15:04 + PACKAGES=/tmp/packages_end.txt 00:15:04 + case "${OS_FAMILY}" in 00:15:04 + rpm -qa 00:15:04 + sort 00:15:11 + '[' -f /tmp/packages_start.txt ']' 00:15:11 + '[' -f /tmp/packages_end.txt ']' 00:15:11 + diff /tmp/packages_start.txt /tmp/packages_end.txt 00:15:11 + '[' /w/workspace/ci-management-openstack-cron ']' 00:15:11 + mkdir -p /w/workspace/ci-management-openstack-cron/archives/ 00:15:11 + cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/ci-management-openstack-cron/archives/ 00:15:11 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins4458954855236524501.sh 00:15:11 ---> capture-instance-metadata.sh 00:15:11 Setup pyenv: 00:15:11 system 00:15:11 3.8.13 00:15:11 3.9.13 00:15:11 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 00:15:11 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-RVpK from file:/tmp/.os_lf_venv 00:15:11 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 00:15:16 lf-activate-venv(): INFO: Installing additional packages: lftools 00:15:31 lf-activate-venv(): INFO: Adding /tmp/venv-RVpK/bin to PATH 00:15:31 INFO: Running in OpenStack, capturing instance metadata 00:15:31 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins17555311183958327989.sh 00:15:31 provisioning config files... 00:15:31 copy managed file [jenkins-log-archives-settings] to file:/w/workspace/ci-management-openstack-cron@tmp/config6302446258834543402tmp 00:15:31 Regular expression run condition: Expression=[^.*logs-s3.*], Label=[] 00:15:31 Run condition [Regular expression match] preventing perform for step [Provide Configuration files] 00:15:31 [EnvInject] - Injecting environment variables from a build step. 00:15:31 [EnvInject] - Injecting as environment variables the properties content 00:15:31 SERVER_ID=logs 00:15:31 00:15:31 [EnvInject] - Variables injected successfully. 00:15:31 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins11953579630351713475.sh 00:15:31 ---> create-netrc.sh 00:15:31 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins9691313538572898313.sh 00:15:31 ---> python-tools-install.sh 00:15:31 Setup pyenv: 00:15:32 system 00:15:32 3.8.13 00:15:32 3.9.13 00:15:32 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 00:15:32 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-RVpK from file:/tmp/.os_lf_venv 00:15:32 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 00:15:37 lf-activate-venv(): INFO: Installing additional packages: lftools 00:15:52 lf-activate-venv(): INFO: Adding /tmp/venv-RVpK/bin to PATH 00:15:52 [ci-management-openstack-cron] $ /bin/sh /tmp/jenkins17840224073086008800.sh 00:15:52 ---> uv-install.sh 00:15:52 uv 0.13.7 is already installed 00:15:52 uvx 0.13.7 (x86_64-unknown-linux-gnu) 00:15:52 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins8046097824695786214.sh 00:15:52 ---> sudo-logs.sh 00:15:52 Archiving 'sudo' log.. 00:15:52 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins12320149450722648249.sh 00:15:52 ---> job-cost.sh 00:15:52 INFO: Activating Python virtual environment... 00:15:52 Setup pyenv: 00:15:52 system 00:15:52 3.8.13 00:15:52 3.9.13 00:15:52 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 00:15:53 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-RVpK from file:/tmp/.os_lf_venv 00:15:53 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 00:15:58 lf-activate-venv(): INFO: Installing additional packages: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 00:16:09 lf-activate-venv(): INFO: Adding /tmp/venv-RVpK/bin to PATH 00:16:09 INFO: No stack-cost file found 00:16:09 INFO: Instance uptime: 749s 00:16:09 INFO: Fetching instance metadata (attempt 1 of 3)... 00:16:09 DEBUG: URL: http://169.254.169.254/latest/meta-data/instance-type 00:16:10 INFO: Successfully fetched instance metadata 00:16:10 INFO: Instance type: v3-starter-2 00:16:10 INFO: Retrieving pricing info for: v3-starter-2 00:16:10 INFO: Fetching Vexxhost pricing API (attempt 1 of 3)... 00:16:10 DEBUG: URL: https://pricing.vexxhost.net/v1/pricing/v3-starter-2/cost?seconds=749 00:16:13 INFO: Successfully fetched Vexxhost pricing API 00:16:13 INFO: Retrieved cost: 0.02 00:16:13 INFO: Retrieved resource: v3-starter-2 00:16:13 INFO: Creating archive directory: /w/workspace/ci-management-openstack-cron/archives/cost 00:16:13 INFO: Archiving costs to: /w/workspace/ci-management-openstack-cron/archives/cost.csv 00:16:13 INFO: Successfully archived job cost data 00:16:13 DEBUG: Cost data: ci-management-openstack-cron,63685,2026-11-08 00:16:13,v3-starter-2,749,0.02,0.00,FAILURE 00:16:13 [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins8557110486815893893.sh 00:16:13 ---> logs-deploy.sh 00:16:13 Setup pyenv: 00:16:13 system 00:16:13 3.8.13 00:16:13 3.9.13 00:16:13 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 00:16:13 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-RVpK from file:/tmp/.os_lf_venv 00:16:13 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 00:16:19 lf-activate-venv(): INFO: Installing additional packages: lftools urllib3~=1.26.15 00:16:33 lf-activate-venv(): INFO: Adding /tmp/venv-RVpK/bin to PATH 00:16:33 INFO: Nexus URL https://nexus.o-ran-sc.org path production/vex-sjc-oran-jenkins-prod-1/ci-management-openstack-cron/63685 00:16:33 INFO: archiving workspace using pattern(s): 00:16:39 Archives upload complete. 00:16:39 INFO: archiving logs to Nexus 00:16:40 ---> uname -a: 00:16:40 Linux prd-centos8-builder-2c-4g-2204.novalocal 4.18.0-529.el8.x86_64 #1 SMP Wed Dec 6 01:03:46 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux 00:16:40 00:16:40 00:16:40 ---> lscpu: 00:16:40 Architecture: x86_64 00:16:40 CPU op-mode(s): 32-bit, 64-bit 00:16:40 Byte Order: Little Endian 00:16:40 CPU(s): 2 00:16:40 On-line CPU(s) list: 0,1 00:16:40 Thread(s) per core: 1 00:16:40 Core(s) per socket: 1 00:16:40 Socket(s): 2 00:16:40 NUMA node(s): 1 00:16:40 Vendor ID: AuthenticAMD 00:16:40 CPU family: 23 00:16:40 Model: 49 00:16:40 Model name: AMD EPYC-Rome Processor 00:16:40 Stepping: 0 00:16:40 CPU MHz: 2799.998 00:16:40 BogoMIPS: 5599.99 00:16:40 Virtualization: AMD-V 00:16:40 Hypervisor vendor: KVM 00:16:40 Virtualization type: full 00:16:40 L1d cache: 32K 00:16:40 L1i cache: 32K 00:16:40 L2 cache: 512K 00:16:40 L3 cache: 16384K 00:16:40 NUMA node0 CPU(s): 0,1 00:16:40 Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr wbnoinvd arat npt nrip_save umip rdpid arch_capabilities 00:16:40 00:16:40 00:16:40 ---> nproc: 00:16:40 2 00:16:40 00:16:40 00:16:40 ---> df -h: 00:16:40 Filesystem Size Used Avail Use% Mounted on 00:16:40 devtmpfs 1.8G 0 1.8G 0% /dev 00:16:40 tmpfs 1.8G 0 1.8G 0% /dev/shm 00:16:40 tmpfs 1.8G 17M 1.8G 1% /run 00:16:40 tmpfs 1.8G 0 1.8G 0% /sys/fs/cgroup 00:16:40 /dev/vda1 20G 15G 5.4G 74% / 00:16:40 tmpfs 367M 0 367M 0% /run/user/1001 00:16:40 00:16:40 00:16:40 ---> free -m: 00:16:40 total used free shared buff/cache available 00:16:40 Mem: 3665 454 1237 17 1973 2911 00:16:40 Swap: 1023 0 1023 00:16:40 00:16:40 00:16:40 ---> ip addr: 00:16:40 1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 00:16:40 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 00:16:40 inet 127.0.0.1/8 scope host lo 00:16:40 valid_lft forever preferred_lft forever 00:16:40 inet6 ::1/128 scope host 00:16:40 valid_lft forever preferred_lft forever 00:16:40 2: eth0: mtu 1450 qdisc fq_codel state UP group default qlen 1000 00:16:40 link/ether fa:16:3e:f1:f7:cb brd ff:ff:ff:ff:ff:ff 00:16:40 altname enp0s3 00:16:40 altname ens3 00:16:40 inet 10.32.7.117/23 brd 10.32.7.255 scope global dynamic noprefixroute eth0 00:16:40 valid_lft 85652sec preferred_lft 85652sec 00:16:40 inet6 fe80::f816:3eff:fef1:f7cb/64 scope link 00:16:40 valid_lft forever preferred_lft forever 00:16:40 00:16:40 00:16:40 ---> sar -b -r -n DEV: 00:16:40 Linux 4.18.0-529.el8.x86_64 (centos-stream-8-builder-7e611857-ce8d-42da-b0f0-357f5fb5fb5a.nov) 11/08/2026 _x86_64_ (2 CPU) 00:16:40 00:16:40 00:03:47 LINUX RESTART (2 CPU) 00:16:40 00:16:40 12:05:01 AM tps rtps wtps bread/s bwrtn/s 00:16:40 12:06:01 AM 52.31 6.42 45.89 934.38 5012.66 00:16:40 12:07:01 AM 63.50 0.77 62.74 202.17 9340.38 00:16:40 12:08:01 AM 43.53 0.47 43.06 60.12 12045.14 00:16:40 12:09:01 AM 40.25 0.05 40.20 1.33 19264.13 00:16:40 12:10:01 AM 96.42 1.10 95.33 129.34 137331.00 00:16:40 12:11:01 AM 118.39 3.21 115.17 235.44 162017.74 00:16:40 12:12:01 AM 81.81 3.68 78.13 433.84 66285.68 00:16:40 12:13:01 AM 84.09 0.20 83.89 6.00 2129.08 00:16:40 12:14:01 AM 72.11 0.38 71.73 71.04 1959.20 00:16:40 12:15:01 AM 77.47 0.05 77.42 1.60 2037.01 00:16:40 12:16:01 AM 111.91 90.64 21.28 8133.02 649.33 00:16:40 Average: 76.53 9.72 66.81 927.90 38027.69 00:16:40 00:16:40 12:05:01 AM kbmemfree kbavail kbmemused %memused kbbuffers kbcached kbcommit %commit kbactive kbinact kbdirty 00:16:40 12:06:01 AM 1399900 3047016 2353776 62.71 2104 1816056 584592 12.17 135024 1930544 136812 00:16:40 12:07:01 AM 1073564 2982180 2680112 71.40 2104 2068148 623956 12.99 138168 2216148 160736 00:16:40 12:08:01 AM 819292 2888240 2934384 78.17 2104 2227196 707056 14.72 154360 2448544 77196 00:16:40 12:09:01 AM 270840 2873424 3482836 92.78 2104 2760268 727464 15.15 184412 2965064 181832 00:16:40 12:10:01 AM 114560 2829000 3639116 96.95 2104 2868800 767388 15.98 230460 3069532 188168 00:16:40 12:11:01 AM 117208 2823332 3636468 96.88 2104 2856536 814388 16.96 283580 3060152 198864 00:16:40 12:12:01 AM 1580200 2932588 2173476 57.90 2104 1501672 715368 14.90 183332 1697924 2088 00:16:40 12:13:01 AM 1523744 2900380 2229932 59.41 2104 1521084 738184 15.37 191116 1732384 4280 00:16:40 12:14:01 AM 1457828 2855912 2295848 61.16 2104 1538780 769984 16.03 197432 1780128 3144 00:16:40 12:15:01 AM 1389424 2808896 2364252 62.98 2104 1556084 807912 16.82 204368 1827936 3788 00:16:40 12:16:01 AM 1352572 3023416 2401104 63.97 2104 1806340 590260 12.29 221164 1841268 8356 00:16:40 Average: 1009012 2905853 2744664 73.12 2104 2047360 713323 14.85 193038 2233602 87751 00:16:40 00:16:40 12:05:01 AM IFACE rxpck/s txpck/s rxkB/s txkB/s rxcmp/s txcmp/s rxmcst/s %ifutil 00:16:40 12:06:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:16:40 12:06:01 AM eth0 47.64 40.44 867.78 5.35 0.00 0.00 0.00 0.00 00:16:40 12:07:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:16:40 12:07:01 AM eth0 67.70 60.12 1052.93 7.29 0.00 0.00 0.00 0.00 00:16:40 12:08:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:16:40 12:08:01 AM eth0 38.63 37.06 737.24 5.89 0.00 0.00 0.00 0.00 00:16:40 12:09:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:16:40 12:09:01 AM eth0 215.66 171.31 4804.57 14.23 0.00 0.00 0.00 0.00 00:16:40 12:10:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:16:40 12:10:01 AM eth0 1508.25 1084.48 34424.64 74.18 0.00 0.00 0.00 0.00 00:16:40 12:11:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:16:40 12:11:01 AM eth0 1850.98 1374.83 40800.86 93.62 0.00 0.00 0.00 0.00 00:16:40 12:12:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:16:40 12:12:01 AM eth0 777.33 566.77 15011.41 42.43 0.00 0.00 0.00 0.00 00:16:40 12:13:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:16:40 12:13:01 AM eth0 53.61 36.78 120.53 12.55 0.00 0.00 0.00 0.00 00:16:40 12:14:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:16:40 12:14:01 AM eth0 42.04 29.69 98.98 10.16 0.00 0.00 0.00 0.00 00:16:40 12:15:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:16:40 12:15:01 AM eth0 47.64 33.11 106.57 11.35 0.00 0.00 0.00 0.00 00:16:40 12:16:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:16:40 12:16:01 AM eth0 15.68 14.23 12.52 10.73 0.00 0.00 0.00 0.00 00:16:40 Average: lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:16:40 Average: eth0 424.34 313.70 8917.96 26.17 0.00 0.00 0.00 0.00 00:16:40 00:16:40 00:16:40 ---> sar -P ALL: 00:16:40 Linux 4.18.0-529.el8.x86_64 (centos-stream-8-builder-7e611857-ce8d-42da-b0f0-357f5fb5fb5a.nov) 11/08/2026 _x86_64_ (2 CPU) 00:16:40 00:16:40 00:03:47 LINUX RESTART (2 CPU) 00:16:40 00:16:40 12:05:01 AM CPU %user %nice %system %iowait %steal %idle 00:16:40 12:06:01 AM all 23.77 0.00 3.44 1.13 0.08 71.58 00:16:40 12:06:01 AM 0 22.45 0.00 3.11 0.77 0.08 73.58 00:16:40 12:06:01 AM 1 25.10 0.00 3.76 1.49 0.08 69.57 00:16:40 12:07:01 AM all 23.33 0.00 3.54 2.31 0.08 70.74 00:16:40 12:07:01 AM 0 35.82 0.00 4.25 2.28 0.08 57.57 00:16:40 12:07:01 AM 1 10.78 0.00 2.83 2.34 0.07 83.98 00:16:40 12:08:01 AM all 29.86 0.00 2.68 1.27 0.08 66.10 00:16:40 12:08:01 AM 0 45.71 0.00 3.40 0.73 0.10 50.05 00:16:40 12:08:01 AM 1 13.99 0.00 1.95 1.80 0.07 82.18 00:16:40 12:09:01 AM all 23.71 0.00 3.46 0.89 0.08 71.85 00:16:40 12:09:01 AM 0 38.39 0.00 3.95 0.75 0.10 56.81 00:16:40 12:09:01 AM 1 8.97 0.00 2.96 1.04 0.07 86.96 00:16:40 12:10:01 AM all 26.97 0.00 10.30 2.53 1.37 58.83 00:16:40 12:10:01 AM 0 24.65 0.00 9.13 2.74 1.16 62.32 00:16:40 12:10:01 AM 1 29.33 0.00 11.50 2.32 1.57 55.28 00:16:40 12:11:01 AM all 22.53 0.00 12.26 2.70 0.59 61.91 00:16:40 12:11:01 AM 0 23.51 0.00 12.12 2.98 0.62 60.77 00:16:40 12:11:01 AM 1 21.54 0.00 12.41 2.42 0.56 63.07 00:16:40 12:12:01 AM all 28.27 0.00 5.79 1.55 0.10 64.30 00:16:40 12:12:01 AM 0 24.63 0.00 4.61 1.57 0.10 69.09 00:16:40 12:12:01 AM 1 31.93 0.00 6.97 1.53 0.10 59.47 00:16:40 12:13:01 AM all 38.04 0.00 1.60 0.50 0.12 59.75 00:16:40 12:13:01 AM 0 61.28 0.00 2.25 0.92 0.15 35.41 00:16:40 12:13:01 AM 1 14.69 0.00 0.94 0.08 0.08 84.20 00:16:40 12:14:01 AM all 40.30 0.00 1.32 0.38 0.10 57.90 00:16:40 12:14:01 AM 0 69.72 0.00 1.88 0.68 0.13 27.57 00:16:40 12:14:01 AM 1 10.78 0.00 0.75 0.07 0.07 88.33 00:16:40 12:15:01 AM all 39.27 0.00 1.40 0.53 0.13 58.66 00:16:40 12:15:01 AM 0 57.67 0.00 1.75 0.95 0.17 39.46 00:16:40 12:15:01 AM 1 20.82 0.00 1.05 0.12 0.08 77.93 00:16:40 12:16:01 AM all 23.21 0.00 2.71 6.20 0.08 67.80 00:16:40 12:16:01 AM 0 31.73 0.00 2.80 5.84 0.08 59.55 00:16:40 12:16:01 AM 1 14.66 0.00 2.63 6.56 0.08 76.07 00:16:40 00:16:40 Average: CPU %user %nice %system %iowait %steal %idle 00:16:40 Average: all 29.03 0.00 4.40 1.82 0.25 64.50 00:16:40 Average: 0 39.60 0.00 4.48 1.84 0.25 53.83 00:16:40 Average: 1 18.39 0.00 4.32 1.80 0.26 75.24 00:16:40 00:16:40 00:16:40