14:04:26 Started by timer 14:04:26 Running as SYSTEM 14:04:26 [EnvInject] - Loading node environment variables. 14:04:26 Building remotely on prd-centos8-builder-2c-4g-2242 (centos8-builder-2c-4g) in workspace /w/workspace/ci-management-openstack-cron 14:04:26 [ssh-agent] Looking for ssh-agent implementation... 14:04:26 $ ssh-agent 14:04:27 SSH_AUTH_SOCK=/tmp/ssh-zfZhWXdHr8Lr/agent.5165 14:04:27 SSH_AGENT_PID=5167 14:04:27 [ssh-agent] Started. 14:04:27 Running ssh-add (command line suppressed) 14:04:27 Identity added: /w/workspace/ci-management-openstack-cron@tmp/private_key_7596762812473614116.key (jenkins-ssh) 14:04:27 [ssh-agent] Using credentials jenkins (jenkins) 14:04:27 The recommended git tool is: NONE 14:04:29 using credential jenkins 14:04:29 Wiping out workspace first. 14:04:29 Cloning the remote Git repository 14:04:29 Cloning repository ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management 14:04:29 > git init /w/workspace/ci-management-openstack-cron # timeout=10 14:04:29 Fetching upstream changes from ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management 14:04:29 > git --version # timeout=10 14:04:29 > git --version # 'git version 2.43.0' 14:04:29 using GIT_SSH to set credentials jenkins 14:04:29 [INFO] Currently running in a labeled security context 14:04:29 [INFO] Currently SELinux is 'enforcing' on the host 14:04:29 > /usr/bin/chcon --type=ssh_home_t /w/workspace/ci-management-openstack-cron@tmp/jenkins-gitclient-ssh15729266094491086325.key 14:04:29 > git fetch --tags --force --progress -- ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management +refs/heads/*:refs/remotes/origin/* # timeout=10 14:04:33 > git config remote.origin.url ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management # timeout=10 14:04:33 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10 14:04:33 Avoid second fetch 14:04:33 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10 14:04:33 Checking out Revision bd99cd2464adefc9a39aad8ae16df0732cbbfdc8 (refs/remotes/origin/master) 14:04:33 > git config core.sparsecheckout # timeout=10 14:04:33 > git checkout -f bd99cd2464adefc9a39aad8ae16df0732cbbfdc8 # timeout=10 14:04:33 Commit message: "CI: Update github2gerrit caller to v2.4.4" 14:04:33 > git rev-list --no-walk bd99cd2464adefc9a39aad8ae16df0732cbbfdc8 # timeout=10 14:04:34 > git remote # timeout=10 14:04:34 > git submodule init # timeout=10 14:04:34 > git submodule sync # timeout=10 14:04:34 > git config --get remote.origin.url # timeout=10 14:04:34 > git submodule init # timeout=10 14:04:34 > git config -f .gitmodules --get-regexp ^submodule\.(.+)\.url # timeout=10 14:04:34 > git config --get submodule.packer/common-packer.url # timeout=10 14:04:34 > git config -f .gitmodules --get submodule.packer/common-packer.path # timeout=10 14:04:34 > git config --get submodule.global-jjb.url # timeout=10 14:04:34 > git config -f .gitmodules --get submodule.global-jjb.path # timeout=10 14:04:34 > git submodule update --init --recursive packer/common-packer # timeout=10 14:04:38 > git submodule update --init --recursive global-jjb # timeout=10 14:04:49 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 14:04:49 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 14:04:49 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 14:04:49 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 14:04:49 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 14:04:49 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 14:04:49 Run condition [Boolean condition] enabling prebuild for step [BuilderChain] 14:04:49 provisioning config files... 14:04:49 copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml 14:04:49 copy managed file [npmrc] to file:/home/jenkins/.npmrc 14:04:49 copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf 14:04:49 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins9961953165411064715.sh 14:04:49 ---> python-tools-install.sh 14:04:49 Setup pyenv: 14:04:49 system 14:04:49 * 3.8.13 (set by /opt/pyenv/version) 14:04:49 * 3.9.13 (set by /opt/pyenv/version) 14:04:50 * 3.10.6 (set by /opt/pyenv/version) 14:04:54 lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-89da 14:04:54 lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv 14:04:54 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 14:05:06 lf-activate-venv(): INFO: Installing additional packages: lftools 14:05:41 lf-activate-venv(): INFO: Adding /tmp/venv-89da/bin to PATH 14:05:41 Generating Requirements File 14:06:23 ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. 14:06:23 botocore 1.43.126 requires python-dateutil<3.0.0,>=2.1, but you have python-dateutil 3.0.0 which is incompatible. 14:06:23 httplib2 0.30.2 requires pyparsing<4,>=3.0.4, but you have pyparsing 2.4.7 which is incompatible. 14:06:24 Python 3.10.6 14:06:24 pip 26.3 from /tmp/venv-89da/lib/python3.10/site-packages/pip (python 3.10) 14:06:24 aiohappyeyeballs==2.7.1 14:06:24 aiohttp==3.14.5 14:06:24 aiosignal==1.4.0 14:06:24 appdirs==1.4.4 14:06:24 argcomplete==3.7.2 14:06:24 aspy.yaml==1.3.0 14:06:24 async-timeout==5.0.1 14:06:24 attrs==26.1.0 14:06:24 autopage==0.6.0 14:06:24 backports.strenum==1.3.1 14:06:24 beautifulsoup4==4.15.0 14:06:24 boto3==1.43.126 14:06:24 botocore==1.43.126 14:06:24 bs4==0.0.2 14:06:24 certifi==2026.10.23 14:06:24 cffi==2.1.1 14:06:24 cfgv==3.5.0 14:06:24 chardet==7.7.0 14:06:24 charset-normalizer==3.5.2 14:06:24 click==8.5.1 14:06:24 cliff==4.14.0 14:06:24 cmd2==3.5.1 14:06:24 cryptography==3.3.2 14:06:24 debtcollector==3.1.0 14:06:24 decorator==5.3.1 14:06:24 defusedxml==0.7.1 14:06:24 Deprecated==1.3.1 14:06:24 distlib==0.4.4 14:06:24 dnspython==2.8.0 14:06:24 docker==7.2.0 14:06:24 dogpile.cache==1.5.0 14:06:24 durationpy==0.11 14:06:24 email-validator==2.3.0 14:06:24 filelock==4.1.0 14:06:24 frozenlist==1.8.0 14:06:24 future==1.0.0 14:06:24 gitdb==4.0.12 14:06:24 GitPython==3.2.1 14:06:24 httplib2==0.30.2 14:06:24 identify==2.6.20 14:06:24 idna==3.20 14:06:24 importlib-resources==1.5.0 14:06:24 iso8601==2.1.0 14:06:24 Jinja2==3.1.6 14:06:24 jmespath==1.1.0 14:06:24 jsonpatch==1.44 14:06:24 jsonpointer==3.10 14:06:24 jsonschema==4.26.0 14:06:24 jsonschema-specifications==2025.9.1 14:06:24 keystoneauth1==5.14.0 14:06:24 kubernetes==36.0.3 14:06:24 lftools==0.37.26 14:06:24 lxml==6.1.3 14:06:24 markdown-it-py==4.2.0 14:06:24 MarkupSafe==3.0.4 14:06:24 mdurl==0.1.2 14:06:24 msgpack==1.2.4 14:06:24 multi_key_dict==2.0.4 14:06:24 multidict==7.1.0 14:06:24 munch==4.0.0 14:06:24 netaddr==1.3.0 14:06:24 niet==1.4.2 14:06:24 nodeenv==1.12.0 14:06:24 oauth2client==4.1.3 14:06:24 oauthlib==4.0.1 14:06:24 openstacksdk==4.13.0 14:06:24 os-service-types==1.8.2 14:06:24 osc-lib==4.6.0 14:06:24 oslo.config==10.4.0 14:06:24 oslo.context==6.4.0 14:06:24 oslo.i18n==6.8.0 14:06:24 oslo.log==8.2.0 14:06:24 oslo.serialization==5.10.0 14:06:24 oslo.utils==10.1.1 14:06:24 packaging==26.3 14:06:24 pbr==7.1.3 14:06:24 platformdirs==4.12.4 14:06:24 prettytable==3.18.0 14:06:24 propcache==0.5.4 14:06:24 psutil==7.2.2 14:06:24 pyasn1==0.6.5 14:06:24 pyasn1_modules==0.4.2 14:06:24 pycparser==3.11 14:06:24 pygerrit2==2.0.15 14:06:24 PyGithub==2.10.0 14:06:24 Pygments==2.21.0 14:06:24 PyJWT==2.15.1 14:06:24 PyNaCl==1.6.2 14:06:24 pyparsing==2.4.7 14:06:24 pyperclip==1.11.0 14:06:24 pyrsistent==0.20.0 14:06:24 python-cinderclient==9.9.0 14:06:24 python-dateutil==3.0.0 14:06:24 python-discovery==1.9.5 14:06:24 python-heatclient==5.2.0 14:06:24 python-jenkins==1.8.3 14:06:24 python-keystoneclient==6.0.0 14:06:24 python-magnumclient==4.11.0 14:06:24 python-openstackclient==10.0.0 14:06:24 python-swiftclient==4.11.0 14:06:24 PyYAML==6.0.3 14:06:24 referencing==0.37.0 14:06:24 requests==2.34.2 14:06:24 requests-oauthlib==2.0.0 14:06:24 rfc3986==2.0.0 14:06:24 rich==15.0.0 14:06:24 rich-argparse==1.8.0 14:06:24 rpds-py==0.30.0 14:06:24 rsa==4.9.1 14:06:24 ruamel.yaml==0.19.1 14:06:24 ruamel.yaml.clib==0.2.15 14:06:24 s3transfer==0.19.3 14:06:24 simplejson==4.2.0 14:06:24 six==1.17.0 14:06:24 smmap==5.0.3 14:06:24 soupsieve==2.10 14:06:24 stevedore==5.8.0 14:06:24 tabulate==0.10.0 14:06:24 toml==0.10.2 14:06:24 tomlkit==0.15.2 14:06:24 tqdm==4.70.1 14:06:24 typing_extensions==4.16.0 14:06:24 tzdata==2026.6 14:06:24 urllib3==1.26.20 14:06:24 virtualenv==21.15.6 14:06:24 wcwidth==0.9.4 14:06:24 websocket-client==1.9.2 14:06:24 wrapt==2.5.2 14:06:24 xdg==6.0.0 14:06:24 xmltodict==1.0.4 14:06:24 yarl==1.25.1 14:06:24 yq==4.4.5 14:06:24 [ci-management-openstack-cron] $ /bin/sh /tmp/jenkins691620877577803574.sh 14:06:24 ---> uv-install.sh 14:06:24 Installing uv/uvx (latest) using shell installer 14:06:31 2026-11-08 14:06:31 URL:https://releases.astral.sh/installers/uv/latest/uv-installer.sh [71300/71300] -> "/tmp/uv-install-O9REoZ.sh" [1] 14:06:31 downloading uv 0.13.7 x86_64-unknown-linux-gnu 14:06:35 installing to /home/jenkins/.local/bin 14:06:35 uv 14:06:35 uvx 14:06:35 everything's installed! 14:06:35 ---> Validating uv/uvx install 14:06:35 uvx 0.13.7 (x86_64-unknown-linux-gnu) 14:06:35 [EnvInject] - Injecting environment variables from a build step. 14:06:35 [EnvInject] - Injecting as environment variables the properties content 14:06:35 OS_CLOUD=vex 14:06:35 14:06:35 [EnvInject] - Variables injected successfully. 14:06:35 [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True) 14:06:35 Run condition [Boolean condition] enabling perform for step [Execute shell] 14:06:35 [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins17492789245756968525.sh 14:06:35 ---> Orphaned k8s clusters 14:06:35 Setup pyenv: 14:06:35 system 14:06:35 3.8.13 14:06:35 3.9.13 14:06:35 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 14:06:35 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-89da from file:/tmp/.os_lf_venv 14:06:35 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 14:06:40 lf-activate-venv(): INFO: Installing additional packages: kubernetes python-heatclient python-openstackclient python-magnumclient 14:07:06 ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. 14:07:06 botocore 1.43.126 requires python-dateutil<3.0.0,>=2.1, but you have python-dateutil 3.0.0 which is incompatible. 14:07:07 lf-activate-venv(): INFO: Adding /tmp/venv-89da/bin to PATH 14:07:17 -----> Delete orphaned cluster 14:07:17 [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True) 14:07:17 Run condition [Boolean condition] enabling perform for step [Execute shell] 14:07:17 [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins15485388842500522258.sh 14:07:17 ---> Orphaned stacks 14:07:17 Setup pyenv: 14:07:17 system 14:07:17 3.8.13 14:07:17 3.9.13 14:07:17 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 14:07:18 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-89da from file:/tmp/.os_lf_venv 14:07:18 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 14:07:23 lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq 14:07:54 lf-activate-venv(): INFO: Adding /tmp/venv-89da/bin to PATH 14:07:54 + mapfile -t OS_COE_CLUSTERS_ID 14:07:54 ++ openstack --os-cloud vex coe cluster list -f value -c uuid -c name 14:07:54 ++ grep -E '(DELETE_FAILED|UNKNOWN|UNHEALTHY)' 14:07:54 ++ awk '{print $1}' 14:08:04 + echo '-----> Active clusters -> stacks' 14:08:04 -----> Active clusters -> stacks 14:08:04 + OS_COE_STACKS=() 14:08:04 + [[ 0 -gt 0 ]] 14:08:04 + mapfile -t OS_STACKS 14:08:04 ++ openstack --os-cloud vex stack list -f value -c 'Stack Name' -c 'Stack Status' --property stack_status=CREATE_COMPLETE --property stack_status=DELETE_FAILED --property stack_status=CREATE_FAILED 14:08:04 ++ awk '{print $1}' 14:08:12 + echo '-----> Active stacks' 14:08:12 -----> Active stacks 14:08:12 + echo '-----> Delete orphaned stacks' 14:08:12 -----> Delete orphaned stacks 14:08:12 [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True) 14:08:12 Run condition [Boolean condition] enabling perform for step [Execute shell] 14:08:12 [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins3298599649017622241.sh 14:08:13 ---> Orphaned servers 14:08:13 Setup pyenv: 14:08:13 system 14:08:13 3.8.13 14:08:13 3.9.13 14:08:13 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 14:08:13 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-89da from file:/tmp/.os_lf_venv 14:08:13 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 14:08:18 lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq 14:10:56 ERROR: Could not install packages due to an OSError: [Errno 28] No space left on device 14:10:56 14:10:57 lf-venv-pip-install(): WARNING: install failed from the configured index, retrying against https://pypi.org/simple 14:14:49 Build timed out (after 10 minutes). Marking the build as failed. 14:14:49 $ ssh-agent -k 14:14:49 unset SSH_AUTH_SOCK; 14:14:49 unset SSH_AGENT_PID; 14:14:49 echo Agent pid 5167 killed; 14:14:49 [ssh-agent] Stopped. 14:14:49 Build was aborted 14:14:49 [PostBuildScript] - [INFO] Executing post build scripts. 14:14:49 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins10860137566313492089.sh 14:14:49 ---> sysstat.sh 14:14:49 /home/jenkins/lf-env.sh: line 73: 6629 Terminated "$venv_python" -m pip install --index-url "$upstream" "$@" 14:14:49 lf-activate-venv(): ERROR: Failed to install packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq 14:14:49 /tmp/jenkins3298599649017622241.sh: line 67: openstack: command not found 14:14:49 -----> Active servers 14:14:49 -----> Delete orphaned servers 14:14:51 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins15514895235045539368.sh 14:14:51 ---> package-listing.sh 14:14:51 ++ facter osfamily 14:14:51 ++ tr '[:upper:]' '[:lower:]' 14:14:51 + OS_FAMILY=redhat 14:14:51 + workspace=/w/workspace/ci-management-openstack-cron 14:14:51 + START_PACKAGES=/tmp/packages_start.txt 14:14:51 + END_PACKAGES=/tmp/packages_end.txt 14:14:51 + DIFF_PACKAGES=/tmp/packages_diff.txt 14:14:51 + PACKAGES=/tmp/packages_start.txt 14:14:51 + '[' /w/workspace/ci-management-openstack-cron ']' 14:14:51 + PACKAGES=/tmp/packages_end.txt 14:14:51 + case "${OS_FAMILY}" in 14:14:51 + rpm -qa 14:14:51 + sort 14:14:58 + '[' -f /tmp/packages_start.txt ']' 14:14:58 + '[' -f /tmp/packages_end.txt ']' 14:14:58 + diff /tmp/packages_start.txt /tmp/packages_end.txt 14:14:58 + '[' /w/workspace/ci-management-openstack-cron ']' 14:14:58 + mkdir -p /w/workspace/ci-management-openstack-cron/archives/ 14:14:58 + cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/ci-management-openstack-cron/archives/ 14:14:58 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins3107077082121899214.sh 14:14:58 ---> capture-instance-metadata.sh 14:14:58 Setup pyenv: 14:14:58 system 14:14:58 3.8.13 14:14:58 3.9.13 14:14:58 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 14:14:59 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-89da from file:/tmp/.os_lf_venv 14:14:59 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 14:15:03 lf-activate-venv(): INFO: Installing additional packages: lftools 14:15:18 lf-activate-venv(): INFO: Adding /tmp/venv-89da/bin to PATH 14:15:18 INFO: Running in OpenStack, capturing instance metadata 14:15:19 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins12577469985043060435.sh 14:15:19 provisioning config files... 14:15:19 copy managed file [jenkins-log-archives-settings] to file:/w/workspace/ci-management-openstack-cron@tmp/config11036939045231203093tmp 14:15:19 Regular expression run condition: Expression=[^.*logs-s3.*], Label=[] 14:15:19 Run condition [Regular expression match] preventing perform for step [Provide Configuration files] 14:15:19 [EnvInject] - Injecting environment variables from a build step. 14:15:19 [EnvInject] - Injecting as environment variables the properties content 14:15:19 SERVER_ID=logs 14:15:19 14:15:19 [EnvInject] - Variables injected successfully. 14:15:19 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins6285975745186537937.sh 14:15:19 ---> create-netrc.sh 14:15:19 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins7423438641209634696.sh 14:15:19 ---> python-tools-install.sh 14:15:19 Setup pyenv: 14:15:19 system 14:15:19 3.8.13 14:15:19 3.9.13 14:15:19 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 14:15:19 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-89da from file:/tmp/.os_lf_venv 14:15:19 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 14:15:24 lf-activate-venv(): INFO: Installing additional packages: lftools 14:15:39 lf-activate-venv(): INFO: Adding /tmp/venv-89da/bin to PATH 14:15:39 [ci-management-openstack-cron] $ /bin/sh /tmp/jenkins4117327283092523185.sh 14:15:39 ---> uv-install.sh 14:15:39 uv 0.13.7 is already installed 14:15:39 uvx 0.13.7 (x86_64-unknown-linux-gnu) 14:15:39 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins7261147445941807071.sh 14:15:39 ---> sudo-logs.sh 14:15:39 Archiving 'sudo' log.. 14:15:40 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins6464693985725716425.sh 14:15:40 ---> job-cost.sh 14:15:40 INFO: Activating Python virtual environment... 14:15:40 Setup pyenv: 14:15:40 system 14:15:40 3.8.13 14:15:40 3.9.13 14:15:40 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 14:15:40 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-89da from file:/tmp/.os_lf_venv 14:15:40 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 14:15:45 lf-activate-venv(): INFO: Installing additional packages: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 14:15:57 lf-activate-venv(): INFO: Adding /tmp/venv-89da/bin to PATH 14:15:57 INFO: No stack-cost file found 14:15:57 INFO: Instance uptime: 748s 14:15:57 INFO: Fetching instance metadata (attempt 1 of 3)... 14:15:57 DEBUG: URL: http://169.254.169.254/latest/meta-data/instance-type 14:15:57 INFO: Successfully fetched instance metadata 14:15:57 INFO: Instance type: v3-starter-2 14:15:57 INFO: Retrieving pricing info for: v3-starter-2 14:15:57 INFO: Fetching Vexxhost pricing API (attempt 1 of 3)... 14:15:57 DEBUG: URL: https://pricing.vexxhost.net/v1/pricing/v3-starter-2/cost?seconds=748 14:16:00 INFO: Successfully fetched Vexxhost pricing API 14:16:00 INFO: Retrieved cost: 0.02 14:16:01 INFO: Retrieved resource: v3-starter-2 14:16:01 INFO: Creating archive directory: /w/workspace/ci-management-openstack-cron/archives/cost 14:16:01 INFO: Archiving costs to: /w/workspace/ci-management-openstack-cron/archives/cost.csv 14:16:01 INFO: Successfully archived job cost data 14:16:01 DEBUG: Cost data: ci-management-openstack-cron,63699,2026-11-08 14:16:01,v3-starter-2,748,0.02,0.00,FAILURE 14:16:01 [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins8931073709815278810.sh 14:16:01 ---> logs-deploy.sh 14:16:01 Setup pyenv: 14:16:01 system 14:16:01 3.8.13 14:16:01 3.9.13 14:16:01 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 14:16:01 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-89da from file:/tmp/.os_lf_venv 14:16:01 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 14:16:06 lf-activate-venv(): INFO: Installing additional packages: lftools urllib3~=1.26.15 14:16:21 lf-activate-venv(): INFO: Adding /tmp/venv-89da/bin to PATH 14:16:21 INFO: Nexus URL https://nexus.o-ran-sc.org path production/vex-sjc-oran-jenkins-prod-1/ci-management-openstack-cron/63699 14:16:21 INFO: archiving workspace using pattern(s): 14:16:26 Archives upload complete. 14:16:27 INFO: archiving logs to Nexus 14:16:28 ---> uname -a: 14:16:28 Linux prd-centos8-builder-2c-4g-2242.novalocal 4.18.0-529.el8.x86_64 #1 SMP Wed Dec 6 01:03:46 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux 14:16:28 14:16:28 14:16:28 ---> lscpu: 14:16:28 Architecture: x86_64 14:16:28 CPU op-mode(s): 32-bit, 64-bit 14:16:28 Byte Order: Little Endian 14:16:28 CPU(s): 2 14:16:28 On-line CPU(s) list: 0,1 14:16:28 Thread(s) per core: 1 14:16:28 Core(s) per socket: 1 14:16:28 Socket(s): 2 14:16:28 NUMA node(s): 1 14:16:28 Vendor ID: AuthenticAMD 14:16:28 CPU family: 23 14:16:28 Model: 49 14:16:28 Model name: AMD EPYC-Rome Processor 14:16:28 Stepping: 0 14:16:28 CPU MHz: 2799.998 14:16:28 BogoMIPS: 5599.99 14:16:28 Virtualization: AMD-V 14:16:28 Hypervisor vendor: KVM 14:16:28 Virtualization type: full 14:16:28 L1d cache: 32K 14:16:28 L1i cache: 32K 14:16:28 L2 cache: 512K 14:16:28 L3 cache: 16384K 14:16:28 NUMA node0 CPU(s): 0,1 14:16:28 Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr wbnoinvd arat npt nrip_save umip rdpid arch_capabilities 14:16:28 14:16:28 14:16:28 ---> nproc: 14:16:28 2 14:16:28 14:16:28 14:16:28 ---> df -h: 14:16:28 Filesystem Size Used Avail Use% Mounted on 14:16:28 devtmpfs 1.8G 0 1.8G 0% /dev 14:16:28 tmpfs 1.8G 0 1.8G 0% /dev/shm 14:16:28 tmpfs 1.8G 17M 1.8G 1% /run 14:16:28 tmpfs 1.8G 0 1.8G 0% /sys/fs/cgroup 14:16:28 /dev/vda1 20G 15G 5.4G 74% / 14:16:28 tmpfs 367M 0 367M 0% /run/user/1001 14:16:28 14:16:28 14:16:28 ---> free -m: 14:16:28 total used free shared buff/cache available 14:16:28 Mem: 3665 489 1212 17 1964 2871 14:16:28 Swap: 1023 0 1023 14:16:28 14:16:28 14:16:28 ---> ip addr: 14:16:28 1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 14:16:28 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 14:16:28 inet 127.0.0.1/8 scope host lo 14:16:28 valid_lft forever preferred_lft forever 14:16:28 inet6 ::1/128 scope host 14:16:28 valid_lft forever preferred_lft forever 14:16:28 2: eth0: mtu 1450 qdisc fq_codel state UP group default qlen 1000 14:16:28 link/ether fa:16:3e:71:60:96 brd ff:ff:ff:ff:ff:ff 14:16:28 altname enp0s3 14:16:28 altname ens3 14:16:28 inet 10.32.6.198/23 brd 10.32.7.255 scope global dynamic noprefixroute eth0 14:16:28 valid_lft 85653sec preferred_lft 85653sec 14:16:28 inet6 fe80::f816:3eff:fe71:6096/64 scope link 14:16:28 valid_lft forever preferred_lft forever 14:16:28 14:16:28 14:16:28 ---> sar -b -r -n DEV: 14:16:28 Linux 4.18.0-529.el8.x86_64 (centos-stream-8-builder-7e611857-ce8d-42da-b0f0-357f5fb5fb5a.nov) 11/08/2026 _x86_64_ (2 CPU) 14:16:28 14:16:28 14:03:36 LINUX RESTART (2 CPU) 14:16:28 14:16:28 02:05:01 PM tps rtps wtps bread/s bwrtn/s 14:16:28 02:06:01 PM 55.10 0.47 54.63 40.92 4375.79 14:16:28 02:07:01 PM 65.46 0.73 64.72 202.10 12663.91 14:16:28 02:08:01 PM 39.40 0.52 38.89 61.45 8506.70 14:16:28 02:09:01 PM 65.83 0.35 65.48 62.77 58985.96 14:16:28 02:10:01 PM 113.37 1.95 111.43 277.68 159729.73 14:16:28 02:11:02 PM 126.74 7.40 119.34 848.64 165194.47 14:16:28 02:12:01 PM 71.06 0.37 70.68 42.30 2072.24 14:16:28 02:13:01 PM 83.59 0.07 83.52 2.13 2238.51 14:16:28 02:14:01 PM 77.62 0.00 77.62 0.00 2065.37 14:16:28 02:15:01 PM 154.10 86.59 67.51 6964.35 1770.08 14:16:28 02:16:01 PM 28.58 6.33 22.25 1333.11 731.59 14:16:28 Average: 80.09 9.54 70.56 895.41 38092.38 14:16:28 14:16:28 02:05:01 PM kbmemfree kbavail kbmemused %memused kbbuffers kbcached kbcommit %commit kbactive kbinact kbdirty 14:16:28 02:06:01 PM 1310504 3006308 2443172 65.09 2104 1863860 620960 12.93 137388 2015356 175556 14:16:28 02:07:01 PM 762956 2785952 2990720 79.67 2104 2179776 810572 16.88 155668 2499120 170784 14:16:28 02:08:01 PM 987204 2951508 2766472 73.70 2104 2122260 645888 13.45 160408 2274944 97572 14:16:28 02:09:01 PM 146580 2827580 3607096 96.10 2104 2838664 762432 15.88 203172 3069900 232484 14:16:28 02:10:01 PM 146836 2805192 3606840 96.09 2104 2809420 824388 17.17 251176 3045900 215388 14:16:28 02:11:02 PM 1702864 3020516 2050812 54.63 2104 1469456 616968 12.85 178888 1581232 4 14:16:28 02:12:01 PM 1539200 2885872 2214476 58.99 2104 1495668 747308 15.56 185180 1730140 3884 14:16:28 02:13:01 PM 1471084 2841104 2282592 60.81 2104 1514432 785308 16.35 192812 1776740 3604 14:16:28 02:14:01 PM 1402012 2793324 2351664 62.65 2104 1531648 824408 17.17 199688 1825880 3856 14:16:28 02:15:01 PM 1377000 2986372 2376676 63.32 2104 1747796 623060 12.97 212964 1824100 2796 14:16:28 02:16:01 PM 1339580 3006812 2414096 64.31 2104 1804340 598856 12.47 220460 1846360 19708 14:16:28 Average: 1107802 2900958 2645874 70.49 2104 1943393 714559 14.88 190709 2135425 84149 14:16:28 14:16:28 02:05:01 PM IFACE rxpck/s txpck/s rxkB/s txkB/s rxcmp/s txcmp/s rxmcst/s %ifutil 14:16:28 02:06:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 14:16:28 02:06:01 PM eth0 47.90 41.07 849.91 4.98 0.00 0.00 0.00 0.00 14:16:28 02:07:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 14:16:28 02:07:01 PM eth0 57.57 49.46 948.40 6.71 0.00 0.00 0.00 0.00 14:16:28 02:08:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 14:16:28 02:08:01 PM eth0 46.25 40.59 688.18 5.34 0.00 0.00 0.00 0.00 14:16:28 02:09:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 14:16:28 02:09:01 PM eth0 628.37 475.78 15238.47 34.74 0.00 0.00 0.00 0.00 14:16:28 02:10:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 14:16:28 02:10:01 PM eth0 1448.77 1132.15 39908.88 77.47 0.00 0.00 0.00 0.00 14:16:28 02:11:02 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 14:16:28 02:11:02 PM eth0 1477.59 1151.12 39665.21 79.36 0.00 0.00 0.00 0.00 14:16:28 02:12:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 14:16:28 02:12:01 PM eth0 92.81 45.13 275.54 11.84 0.00 0.00 0.00 0.00 14:16:28 02:13:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 14:16:28 02:13:01 PM eth0 51.91 35.32 117.00 12.19 0.00 0.00 0.00 0.00 14:16:28 02:14:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 14:16:28 02:14:01 PM eth0 47.71 32.16 109.38 11.15 0.00 0.00 0.00 0.00 14:16:28 02:15:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 14:16:28 02:15:01 PM eth0 42.50 30.32 83.64 15.13 0.00 0.00 0.00 0.00 14:16:28 02:16:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 14:16:28 02:16:01 PM eth0 12.60 12.90 8.52 6.14 0.00 0.00 0.00 0.00 14:16:28 Average: lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 14:16:28 Average: eth0 359.93 277.31 8914.35 24.12 0.00 0.00 0.00 0.00 14:16:28 14:16:28 14:16:28 ---> sar -P ALL: 14:16:28 Linux 4.18.0-529.el8.x86_64 (centos-stream-8-builder-7e611857-ce8d-42da-b0f0-357f5fb5fb5a.nov) 11/08/2026 _x86_64_ (2 CPU) 14:16:28 14:16:28 14:03:36 LINUX RESTART (2 CPU) 14:16:28 14:16:28 02:05:01 PM CPU %user %nice %system %iowait %steal %idle 14:16:28 02:06:01 PM all 21.83 0.00 2.96 1.23 0.08 73.90 14:16:28 02:06:01 PM 0 32.54 0.00 4.15 2.03 0.10 61.17 14:16:28 02:06:01 PM 1 11.09 0.00 1.77 0.42 0.07 86.66 14:16:28 02:07:01 PM all 29.00 0.00 3.64 2.02 0.09 65.24 14:16:28 02:07:01 PM 0 39.95 0.00 3.47 1.75 0.10 54.73 14:16:28 02:07:01 PM 1 18.01 0.00 3.82 2.29 0.08 75.80 14:16:28 02:08:01 PM all 25.48 0.00 2.92 1.40 0.08 70.12 14:16:28 02:08:01 PM 0 41.12 0.00 4.01 1.54 0.08 53.26 14:16:28 02:08:01 PM 1 9.86 0.00 1.83 1.27 0.07 86.97 14:16:28 02:09:01 PM all 23.25 0.00 5.37 2.16 0.08 69.15 14:16:28 02:09:01 PM 0 30.44 0.00 5.75 1.59 0.08 62.14 14:16:28 02:09:01 PM 1 16.00 0.00 4.99 2.73 0.07 76.22 14:16:28 02:10:01 PM all 24.33 0.00 11.53 2.85 0.10 61.19 14:16:28 02:10:01 PM 0 27.88 0.00 11.64 2.60 0.10 57.79 14:16:28 02:10:01 PM 1 20.73 0.00 11.42 3.10 0.10 64.65 14:16:28 02:11:02 PM all 20.22 0.00 12.41 2.88 0.11 64.39 14:16:28 02:11:02 PM 0 19.48 0.00 11.00 2.46 0.10 66.96 14:16:28 02:11:02 PM 1 20.97 0.00 13.84 3.30 0.12 61.78 14:16:28 02:12:01 PM all 38.85 0.00 1.50 0.38 0.11 59.16 14:16:28 02:12:01 PM 0 48.43 0.00 1.66 0.53 0.12 49.26 14:16:28 02:12:01 PM 1 29.25 0.00 1.33 0.24 0.10 69.08 14:16:28 02:13:01 PM all 40.12 0.00 1.53 0.33 0.12 57.91 14:16:28 02:13:01 PM 0 59.38 0.00 1.85 0.47 0.13 38.17 14:16:28 02:13:01 PM 1 20.79 0.00 1.20 0.20 0.10 77.71 14:16:28 02:14:01 PM all 40.60 0.00 1.45 0.41 0.12 57.42 14:16:28 02:14:01 PM 0 68.68 0.00 1.87 0.72 0.13 28.60 14:16:28 02:14:01 PM 1 12.43 0.00 1.04 0.10 0.10 86.33 14:16:28 02:15:01 PM all 34.58 0.00 2.12 6.13 0.11 57.05 14:16:28 02:15:01 PM 0 56.33 0.00 2.74 12.05 0.12 28.77 14:16:28 02:15:01 PM 1 12.76 0.00 1.51 0.20 0.10 85.43 14:16:28 02:16:01 PM all 26.37 0.00 2.41 0.72 0.08 70.43 14:16:28 02:16:01 PM 0 33.38 0.00 2.02 0.75 0.08 63.77 14:16:28 02:16:01 PM 1 19.33 0.00 2.81 0.69 0.07 77.11 14:16:28 14:16:28 Average: CPU %user %nice %system %iowait %steal %idle 14:16:28 Average: all 29.51 0.00 4.34 1.86 0.10 64.19 14:16:28 Average: 0 41.60 0.00 4.56 2.41 0.10 51.33 14:16:28 Average: 1 17.35 0.00 4.12 1.32 0.09 77.13 14:16:28 14:16:28 14:16:28