14:04:26 Started by timer 14:04:26 Running as SYSTEM 14:04:26 [EnvInject] - Loading node environment variables. 14:04:27 Building remotely on prd-centos8-builder-2c-4g-2307 (centos8-builder-2c-4g) in workspace /w/workspace/ci-management-openstack-cron 14:04:27 [ssh-agent] Looking for ssh-agent implementation... 14:04:27 $ ssh-agent 14:04:27 SSH_AUTH_SOCK=/tmp/ssh-BfjOaGV9xno9/agent.5177 14:04:27 SSH_AGENT_PID=5179 14:04:27 [ssh-agent] Started. 14:04:27 Running ssh-add (command line suppressed) 14:04:27 Identity added: /w/workspace/ci-management-openstack-cron@tmp/private_key_9801362720280782170.key (jenkins-ssh) 14:04:27 [ssh-agent] Using credentials jenkins (jenkins) 14:04:27 The recommended git tool is: NONE 14:04:29 using credential jenkins 14:04:29 Wiping out workspace first. 14:04:29 Cloning the remote Git repository 14:04:29 Cloning repository ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management 14:04:29 > git init /w/workspace/ci-management-openstack-cron # timeout=10 14:04:29 Fetching upstream changes from ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management 14:04:29 > git --version # timeout=10 14:04:29 > git --version # 'git version 2.43.0' 14:04:29 using GIT_SSH to set credentials jenkins 14:04:29 [INFO] Currently running in a labeled security context 14:04:29 [INFO] Currently SELinux is 'enforcing' on the host 14:04:29 > /usr/bin/chcon --type=ssh_home_t /w/workspace/ci-management-openstack-cron@tmp/jenkins-gitclient-ssh13136993549775741348.key 14:04:29 > git fetch --tags --force --progress -- ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management +refs/heads/*:refs/remotes/origin/* # timeout=10 14:04:33 > git config remote.origin.url ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management # timeout=10 14:04:33 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10 14:04:34 Avoid second fetch 14:04:34 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10 14:04:34 Checking out Revision bd99cd2464adefc9a39aad8ae16df0732cbbfdc8 (refs/remotes/origin/master) 14:04:34 > git config core.sparsecheckout # timeout=10 14:04:34 > git checkout -f bd99cd2464adefc9a39aad8ae16df0732cbbfdc8 # timeout=10 14:04:34 Commit message: "CI: Update github2gerrit caller to v2.4.4" 14:04:34 > git rev-list --no-walk bd99cd2464adefc9a39aad8ae16df0732cbbfdc8 # timeout=10 14:04:34 > git remote # timeout=10 14:04:34 > git submodule init # timeout=10 14:04:34 > git submodule sync # timeout=10 14:04:34 > git config --get remote.origin.url # timeout=10 14:04:34 > git submodule init # timeout=10 14:04:35 > git config -f .gitmodules --get-regexp ^submodule\.(.+)\.url # timeout=10 14:04:35 > git config --get submodule.packer/common-packer.url # timeout=10 14:04:35 > git config -f .gitmodules --get submodule.packer/common-packer.path # timeout=10 14:04:35 > git config --get submodule.global-jjb.url # timeout=10 14:04:35 > git config -f .gitmodules --get submodule.global-jjb.path # timeout=10 14:04:35 > git submodule update --init --recursive packer/common-packer # timeout=10 14:04:39 > git submodule update --init --recursive global-jjb # timeout=10 14:04:51 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 14:04:51 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 14:04:51 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 14:04:51 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 14:04:51 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 14:04:51 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 14:04:51 Run condition [Boolean condition] enabling prebuild for step [BuilderChain] 14:04:51 provisioning config files... 14:04:51 copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml 14:04:51 copy managed file [npmrc] to file:/home/jenkins/.npmrc 14:04:51 copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf 14:04:51 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins9552078842187566111.sh 14:04:51 ---> python-tools-install.sh 14:04:51 Setup pyenv: 14:04:51 system 14:04:51 * 3.8.13 (set by /opt/pyenv/version) 14:04:51 * 3.9.13 (set by /opt/pyenv/version) 14:04:51 * 3.10.6 (set by /opt/pyenv/version) 14:04:56 lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-jwVk 14:04:56 lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv 14:04:56 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 14:05:08 lf-activate-venv(): INFO: Installing additional packages: lftools 14:05:42 lf-activate-venv(): INFO: Adding /tmp/venv-jwVk/bin to PATH 14:05:42 Generating Requirements File 14:06:25 ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. 14:06:25 botocore 1.43.126 requires python-dateutil<3.0.0,>=2.1, but you have python-dateutil 3.0.0 which is incompatible. 14:06:25 httplib2 0.30.2 requires pyparsing<4,>=3.0.4, but you have pyparsing 2.4.7 which is incompatible. 14:06:26 Python 3.10.6 14:06:26 pip 26.3 from /tmp/venv-jwVk/lib/python3.10/site-packages/pip (python 3.10) 14:06:26 aiohappyeyeballs==2.7.1 14:06:26 aiohttp==3.14.5 14:06:26 aiosignal==1.4.0 14:06:26 appdirs==1.4.4 14:06:26 argcomplete==3.7.2 14:06:26 aspy.yaml==1.3.0 14:06:26 async-timeout==5.0.1 14:06:26 attrs==26.1.0 14:06:26 autopage==0.6.0 14:06:26 backports.strenum==1.3.1 14:06:26 beautifulsoup4==4.15.0 14:06:26 boto3==1.43.126 14:06:26 botocore==1.43.126 14:06:26 bs4==0.0.2 14:06:26 certifi==2026.10.23 14:06:26 cffi==2.1.1 14:06:26 cfgv==3.5.0 14:06:26 chardet==7.7.0 14:06:26 charset-normalizer==3.5.2 14:06:26 click==8.5.1 14:06:26 cliff==4.14.0 14:06:26 cmd2==3.5.1 14:06:26 cryptography==3.3.2 14:06:26 debtcollector==3.1.0 14:06:26 decorator==5.3.1 14:06:26 defusedxml==0.7.1 14:06:26 Deprecated==1.3.1 14:06:26 distlib==0.4.4 14:06:26 dnspython==2.8.0 14:06:26 docker==7.2.0 14:06:26 dogpile.cache==1.5.0 14:06:26 durationpy==0.11 14:06:26 email-validator==2.3.0 14:06:26 filelock==4.1.0 14:06:26 frozenlist==1.8.0 14:06:26 future==1.0.0 14:06:26 gitdb==4.0.12 14:06:26 GitPython==3.2.1 14:06:26 httplib2==0.30.2 14:06:26 identify==2.6.20 14:06:26 idna==3.20 14:06:26 importlib-resources==1.5.0 14:06:26 iso8601==2.1.0 14:06:26 Jinja2==3.1.6 14:06:26 jmespath==1.1.0 14:06:26 jsonpatch==1.44 14:06:26 jsonpointer==3.10 14:06:26 jsonschema==4.26.0 14:06:26 jsonschema-specifications==2025.9.1 14:06:26 keystoneauth1==5.14.0 14:06:26 kubernetes==36.0.3 14:06:26 lftools==0.37.26 14:06:26 lxml==6.1.3 14:06:26 markdown-it-py==4.2.0 14:06:26 MarkupSafe==3.0.4 14:06:26 mdurl==0.1.2 14:06:26 msgpack==1.2.4 14:06:26 multi_key_dict==2.0.4 14:06:26 multidict==7.1.0 14:06:26 munch==4.0.0 14:06:26 netaddr==1.3.0 14:06:26 niet==1.4.2 14:06:26 nodeenv==1.12.0 14:06:26 oauth2client==4.1.3 14:06:26 oauthlib==4.0.1 14:06:26 openstacksdk==4.13.0 14:06:26 os-service-types==1.8.2 14:06:26 osc-lib==4.6.0 14:06:26 oslo.config==10.4.0 14:06:26 oslo.context==6.4.0 14:06:26 oslo.i18n==6.8.0 14:06:26 oslo.log==8.2.0 14:06:26 oslo.serialization==5.10.0 14:06:26 oslo.utils==10.1.1 14:06:26 packaging==26.3 14:06:26 pbr==7.1.3 14:06:26 platformdirs==4.12.4 14:06:26 prettytable==3.18.0 14:06:26 propcache==0.5.4 14:06:26 psutil==7.2.2 14:06:26 pyasn1==0.6.5 14:06:26 pyasn1_modules==0.4.2 14:06:26 pycparser==3.11 14:06:26 pygerrit2==2.0.15 14:06:26 PyGithub==2.10.0 14:06:26 Pygments==2.21.0 14:06:26 PyJWT==2.15.1 14:06:26 PyNaCl==1.6.2 14:06:26 pyparsing==2.4.7 14:06:26 pyperclip==1.11.0 14:06:26 pyrsistent==0.20.0 14:06:26 python-cinderclient==9.9.0 14:06:26 python-dateutil==3.0.0 14:06:26 python-discovery==1.9.5 14:06:26 python-heatclient==5.2.0 14:06:26 python-jenkins==1.8.3 14:06:26 python-keystoneclient==6.0.0 14:06:26 python-magnumclient==4.11.0 14:06:26 python-openstackclient==10.0.0 14:06:26 python-swiftclient==4.11.0 14:06:26 PyYAML==6.0.3 14:06:26 referencing==0.37.0 14:06:26 requests==2.34.2 14:06:26 requests-oauthlib==2.0.0 14:06:26 rfc3986==2.0.0 14:06:26 rich==15.0.0 14:06:26 rich-argparse==1.8.0 14:06:26 rpds-py==0.30.0 14:06:26 rsa==4.9.1 14:06:26 ruamel.yaml==0.19.1 14:06:26 ruamel.yaml.clib==0.2.15 14:06:26 s3transfer==0.19.3 14:06:26 simplejson==4.2.0 14:06:26 six==1.17.0 14:06:26 smmap==5.0.3 14:06:26 soupsieve==2.10 14:06:26 stevedore==5.8.0 14:06:26 tabulate==0.10.0 14:06:26 toml==0.10.2 14:06:26 tomlkit==0.15.2 14:06:26 tqdm==4.70.1 14:06:26 typing_extensions==4.16.0 14:06:26 tzdata==2026.6 14:06:26 urllib3==1.26.20 14:06:26 virtualenv==21.15.6 14:06:26 wcwidth==0.9.4 14:06:26 websocket-client==1.9.2 14:06:26 wrapt==2.5.2 14:06:26 xdg==6.0.0 14:06:26 xmltodict==1.0.4 14:06:26 yarl==1.25.1 14:06:26 yq==4.4.5 14:06:26 [ci-management-openstack-cron] $ /bin/sh /tmp/jenkins15948526109338115782.sh 14:06:26 ---> uv-install.sh 14:06:26 Installing uv/uvx (latest) using shell installer 14:06:33 2026-11-09 14:06:33 URL:https://releases.astral.sh/installers/uv/latest/uv-installer.sh [71300/71300] -> "/tmp/uv-install-aZswAU.sh" [1] 14:06:33 downloading uv 0.13.7 x86_64-unknown-linux-gnu 14:06:37 installing to /home/jenkins/.local/bin 14:06:37 uv 14:06:37 uvx 14:06:37 everything's installed! 14:06:37 ---> Validating uv/uvx install 14:06:37 uvx 0.13.7 (x86_64-unknown-linux-gnu) 14:06:37 [EnvInject] - Injecting environment variables from a build step. 14:06:37 [EnvInject] - Injecting as environment variables the properties content 14:06:37 OS_CLOUD=vex 14:06:37 14:06:37 [EnvInject] - Variables injected successfully. 14:06:37 [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True) 14:06:37 Run condition [Boolean condition] enabling perform for step [Execute shell] 14:06:37 [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins1009737943906046618.sh 14:06:37 ---> Orphaned k8s clusters 14:06:37 Setup pyenv: 14:06:37 system 14:06:37 3.8.13 14:06:37 3.9.13 14:06:37 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 14:06:38 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-jwVk from file:/tmp/.os_lf_venv 14:06:38 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 14:06:43 lf-activate-venv(): INFO: Installing additional packages: kubernetes python-heatclient python-openstackclient python-magnumclient 14:07:08 ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. 14:07:08 botocore 1.43.126 requires python-dateutil<3.0.0,>=2.1, but you have python-dateutil 3.0.0 which is incompatible. 14:07:09 lf-activate-venv(): INFO: Adding /tmp/venv-jwVk/bin to PATH 14:07:17 -----> Delete orphaned cluster 14:07:17 [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True) 14:07:17 Run condition [Boolean condition] enabling perform for step [Execute shell] 14:07:17 [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins8939119534480703262.sh 14:07:17 ---> Orphaned stacks 14:07:17 Setup pyenv: 14:07:18 system 14:07:18 3.8.13 14:07:18 3.9.13 14:07:18 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 14:07:18 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-jwVk from file:/tmp/.os_lf_venv 14:07:18 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 14:07:20 lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq 14:07:49 lf-activate-venv(): INFO: Adding /tmp/venv-jwVk/bin to PATH 14:07:49 + mapfile -t OS_COE_CLUSTERS_ID 14:07:49 ++ openstack --os-cloud vex coe cluster list -f value -c uuid -c name 14:07:49 ++ grep -E '(DELETE_FAILED|UNKNOWN|UNHEALTHY)' 14:07:49 ++ awk '{print $1}' 14:07:55 + echo '-----> Active clusters -> stacks' 14:07:55 -----> Active clusters -> stacks 14:07:55 + OS_COE_STACKS=() 14:07:55 + [[ 0 -gt 0 ]] 14:07:55 + mapfile -t OS_STACKS 14:07:55 ++ openstack --os-cloud vex stack list -f value -c 'Stack Name' -c 'Stack Status' --property stack_status=CREATE_COMPLETE --property stack_status=DELETE_FAILED --property stack_status=CREATE_FAILED 14:07:55 ++ awk '{print $1}' 14:08:00 + echo '-----> Active stacks' 14:08:00 -----> Active stacks 14:08:00 + echo '-----> Delete orphaned stacks' 14:08:00 -----> Delete orphaned stacks 14:08:00 [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True) 14:08:00 Run condition [Boolean condition] enabling perform for step [Execute shell] 14:08:00 [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins685643523647700642.sh 14:08:00 ---> Orphaned servers 14:08:00 Setup pyenv: 14:08:00 system 14:08:00 3.8.13 14:08:00 3.9.13 14:08:00 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 14:08:00 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-jwVk from file:/tmp/.os_lf_venv 14:08:00 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 14:08:04 lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq 14:10:41 ERROR: Could not install packages due to an OSError: [Errno 28] No space left on device 14:10:41 14:10:42 lf-venv-pip-install(): WARNING: install failed from the configured index, retrying against https://pypi.org/simple 14:14:51 Build timed out (after 10 minutes). Marking the build as failed. 14:14:51 $ ssh-agent -k 14:14:51 unset SSH_AUTH_SOCK; 14:14:51 unset SSH_AGENT_PID; 14:14:51 echo Agent pid 5179 killed; 14:14:51 [ssh-agent] Stopped. 14:14:51 Build was aborted 14:14:51 [PostBuildScript] - [INFO] Executing post build scripts. 14:14:51 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins10322795584447864018.sh 14:14:51 ---> sysstat.sh 14:14:51 /home/jenkins/lf-env.sh: line 73: 6657 Terminated "$venv_python" -m pip install --index-url "$upstream" "$@" 14:14:51 lf-activate-venv(): ERROR: Failed to install packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq 14:14:51 /tmp/jenkins685643523647700642.sh: line 67: openstack: command not found 14:14:51 -----> Active servers 14:14:51 -----> Delete orphaned servers 14:14:52 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins14365476779786270107.sh 14:14:52 ---> package-listing.sh 14:14:52 ++ facter osfamily 14:14:52 ++ tr '[:upper:]' '[:lower:]' 14:14:53 + OS_FAMILY=redhat 14:14:53 + workspace=/w/workspace/ci-management-openstack-cron 14:14:53 + START_PACKAGES=/tmp/packages_start.txt 14:14:53 + END_PACKAGES=/tmp/packages_end.txt 14:14:53 + DIFF_PACKAGES=/tmp/packages_diff.txt 14:14:53 + PACKAGES=/tmp/packages_start.txt 14:14:53 + '[' /w/workspace/ci-management-openstack-cron ']' 14:14:53 + PACKAGES=/tmp/packages_end.txt 14:14:53 + case "${OS_FAMILY}" in 14:14:53 + rpm -qa 14:14:53 + sort 14:15:00 + '[' -f /tmp/packages_start.txt ']' 14:15:00 + '[' -f /tmp/packages_end.txt ']' 14:15:00 + diff /tmp/packages_start.txt /tmp/packages_end.txt 14:15:00 + '[' /w/workspace/ci-management-openstack-cron ']' 14:15:00 + mkdir -p /w/workspace/ci-management-openstack-cron/archives/ 14:15:00 + cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/ci-management-openstack-cron/archives/ 14:15:00 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins17714463019736871785.sh 14:15:00 ---> capture-instance-metadata.sh 14:15:00 Setup pyenv: 14:15:00 system 14:15:00 3.8.13 14:15:00 3.9.13 14:15:00 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 14:15:00 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-jwVk from file:/tmp/.os_lf_venv 14:15:00 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 14:15:05 lf-activate-venv(): INFO: Installing additional packages: lftools 14:15:20 lf-activate-venv(): INFO: Adding /tmp/venv-jwVk/bin to PATH 14:15:20 INFO: Running in OpenStack, capturing instance metadata 14:15:20 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins374754718433186003.sh 14:15:20 provisioning config files... 14:15:20 copy managed file [jenkins-log-archives-settings] to file:/w/workspace/ci-management-openstack-cron@tmp/config11340488175316635581tmp 14:15:20 Regular expression run condition: Expression=[^.*logs-s3.*], Label=[] 14:15:20 Run condition [Regular expression match] preventing perform for step [Provide Configuration files] 14:15:20 [EnvInject] - Injecting environment variables from a build step. 14:15:20 [EnvInject] - Injecting as environment variables the properties content 14:15:20 SERVER_ID=logs 14:15:20 14:15:20 [EnvInject] - Variables injected successfully. 14:15:20 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins14692391951076388333.sh 14:15:20 ---> create-netrc.sh 14:15:20 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins8855441081944353621.sh 14:15:20 ---> python-tools-install.sh 14:15:20 Setup pyenv: 14:15:20 system 14:15:20 3.8.13 14:15:20 3.9.13 14:15:20 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 14:15:21 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-jwVk from file:/tmp/.os_lf_venv 14:15:21 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 14:15:26 lf-activate-venv(): INFO: Installing additional packages: lftools 14:15:40 lf-activate-venv(): INFO: Adding /tmp/venv-jwVk/bin to PATH 14:15:40 [ci-management-openstack-cron] $ /bin/sh /tmp/jenkins13813736835970299391.sh 14:15:40 ---> uv-install.sh 14:15:41 uv 0.13.7 is already installed 14:15:41 uvx 0.13.7 (x86_64-unknown-linux-gnu) 14:15:41 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins11772182759590679424.sh 14:15:41 ---> sudo-logs.sh 14:15:41 Archiving 'sudo' log.. 14:15:41 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins10973577402708074970.sh 14:15:41 ---> job-cost.sh 14:15:41 INFO: Activating Python virtual environment... 14:15:41 Setup pyenv: 14:15:41 system 14:15:41 3.8.13 14:15:41 3.9.13 14:15:41 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 14:15:41 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-jwVk from file:/tmp/.os_lf_venv 14:15:41 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 14:15:46 lf-activate-venv(): INFO: Installing additional packages: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 14:15:58 lf-activate-venv(): INFO: Adding /tmp/venv-jwVk/bin to PATH 14:15:58 INFO: No stack-cost file found 14:15:58 INFO: Instance uptime: 751s 14:15:58 INFO: Fetching instance metadata (attempt 1 of 3)... 14:15:58 DEBUG: URL: http://169.254.169.254/latest/meta-data/instance-type 14:15:58 INFO: Successfully fetched instance metadata 14:15:58 INFO: Instance type: v3-starter-2 14:15:58 INFO: Retrieving pricing info for: v3-starter-2 14:15:58 INFO: Fetching Vexxhost pricing API (attempt 1 of 3)... 14:15:58 DEBUG: URL: https://pricing.vexxhost.net/v1/pricing/v3-starter-2/cost?seconds=751 14:16:02 INFO: Successfully fetched Vexxhost pricing API 14:16:02 INFO: Retrieved cost: 0.02 14:16:02 INFO: Retrieved resource: v3-starter-2 14:16:02 INFO: Creating archive directory: /w/workspace/ci-management-openstack-cron/archives/cost 14:16:02 INFO: Archiving costs to: /w/workspace/ci-management-openstack-cron/archives/cost.csv 14:16:02 INFO: Successfully archived job cost data 14:16:02 DEBUG: Cost data: ci-management-openstack-cron,63723,2026-11-09 14:16:02,v3-starter-2,751,0.02,0.00,FAILURE 14:16:02 [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins4123552138293836486.sh 14:16:02 ---> logs-deploy.sh 14:16:02 Setup pyenv: 14:16:02 system 14:16:02 3.8.13 14:16:02 3.9.13 14:16:02 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 14:16:02 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-jwVk from file:/tmp/.os_lf_venv 14:16:02 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 14:16:07 lf-activate-venv(): INFO: Installing additional packages: lftools urllib3~=1.26.15 14:16:22 lf-activate-venv(): INFO: Adding /tmp/venv-jwVk/bin to PATH 14:16:22 INFO: Nexus URL https://nexus.o-ran-sc.org path production/vex-sjc-oran-jenkins-prod-1/ci-management-openstack-cron/63723 14:16:22 INFO: archiving workspace using pattern(s): 14:16:27 Archives upload complete. 14:16:27 INFO: archiving logs to Nexus 14:16:28 ---> uname -a: 14:16:28 Linux prd-centos8-builder-2c-4g-2307.novalocal 4.18.0-529.el8.x86_64 #1 SMP Wed Dec 6 01:03:46 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux 14:16:28 14:16:28 14:16:28 ---> lscpu: 14:16:28 Architecture: x86_64 14:16:28 CPU op-mode(s): 32-bit, 64-bit 14:16:28 Byte Order: Little Endian 14:16:28 CPU(s): 2 14:16:28 On-line CPU(s) list: 0,1 14:16:28 Thread(s) per core: 1 14:16:28 Core(s) per socket: 1 14:16:28 Socket(s): 2 14:16:28 NUMA node(s): 1 14:16:28 Vendor ID: AuthenticAMD 14:16:28 CPU family: 23 14:16:28 Model: 49 14:16:28 Model name: AMD EPYC-Rome Processor 14:16:28 Stepping: 0 14:16:28 CPU MHz: 2799.998 14:16:28 BogoMIPS: 5599.99 14:16:28 Virtualization: AMD-V 14:16:28 Hypervisor vendor: KVM 14:16:28 Virtualization type: full 14:16:28 L1d cache: 32K 14:16:28 L1i cache: 32K 14:16:28 L2 cache: 512K 14:16:28 L3 cache: 16384K 14:16:28 NUMA node0 CPU(s): 0,1 14:16:28 Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr wbnoinvd arat npt nrip_save umip rdpid arch_capabilities 14:16:28 14:16:28 14:16:28 ---> nproc: 14:16:28 2 14:16:28 14:16:28 14:16:28 ---> df -h: 14:16:28 Filesystem Size Used Avail Use% Mounted on 14:16:28 devtmpfs 1.8G 0 1.8G 0% /dev 14:16:28 tmpfs 1.8G 0 1.8G 0% /dev/shm 14:16:28 tmpfs 1.8G 17M 1.8G 1% /run 14:16:28 tmpfs 1.8G 0 1.8G 0% /sys/fs/cgroup 14:16:28 /dev/vda1 20G 15G 5.4G 74% / 14:16:28 tmpfs 367M 0 367M 0% /run/user/1001 14:16:28 14:16:28 14:16:28 ---> free -m: 14:16:28 total used free shared buff/cache available 14:16:28 Mem: 3665 476 1208 17 1981 2858 14:16:28 Swap: 1023 1 1022 14:16:28 14:16:28 14:16:28 ---> ip addr: 14:16:28 1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 14:16:28 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 14:16:28 inet 127.0.0.1/8 scope host lo 14:16:28 valid_lft forever preferred_lft forever 14:16:28 inet6 ::1/128 scope host 14:16:28 valid_lft forever preferred_lft forever 14:16:28 2: eth0: mtu 1450 qdisc fq_codel state UP group default qlen 1000 14:16:28 link/ether fa:16:3e:d7:43:9a brd ff:ff:ff:ff:ff:ff 14:16:28 altname enp0s3 14:16:28 altname ens3 14:16:28 inet 10.32.6.34/23 brd 10.32.7.255 scope global dynamic noprefixroute eth0 14:16:28 valid_lft 85650sec preferred_lft 85650sec 14:16:28 inet6 fe80::f816:3eff:fed7:439a/64 scope link 14:16:28 valid_lft forever preferred_lft forever 14:16:28 14:16:28 14:16:28 ---> sar -b -r -n DEV: 14:16:28 Linux 4.18.0-529.el8.x86_64 (centos-stream-8-builder-7e611857-ce8d-42da-b0f0-357f5fb5fb5a.nov) 11/09/2026 _x86_64_ (2 CPU) 14:16:28 14:16:28 14:03:34 LINUX RESTART (2 CPU) 14:16:28 14:16:28 02:04:01 PM tps rtps wtps bread/s bwrtn/s 14:16:28 02:05:01 PM 176.01 103.03 72.98 13482.37 38665.89 14:16:28 02:06:01 PM 58.61 0.47 58.15 40.92 4856.61 14:16:28 02:07:01 PM 66.44 0.73 65.71 202.10 12755.62 14:16:28 02:08:01 PM 35.19 0.52 34.68 61.46 8297.25 14:16:28 02:09:01 PM 98.83 5.33 93.50 477.15 102671.97 14:16:28 02:10:01 PM 120.22 3.08 117.14 194.84 166177.76 14:16:28 02:11:02 PM 101.20 4.37 96.83 475.44 115594.69 14:16:28 02:12:01 PM 84.60 0.14 84.46 4.34 2149.73 14:16:28 02:13:01 PM 78.97 0.05 78.92 1.60 2129.39 14:16:28 02:14:01 PM 79.89 0.07 79.82 2.13 2113.96 14:16:28 02:15:01 PM 153.03 87.10 65.93 6838.65 1759.20 14:16:28 02:16:01 PM 28.35 6.05 22.30 1279.39 649.78 14:16:28 Average: 90.12 17.60 72.52 1924.39 38207.24 14:16:28 14:16:28 02:04:01 PM kbmemfree kbavail kbmemused %memused kbbuffers kbcached kbcommit %commit kbactive kbinact kbdirty 14:16:28 02:05:01 PM 1586004 3046628 2167668 57.75 2104 1640968 617448 12.86 128720 1794112 50072 14:16:28 02:06:01 PM 1346048 3039012 2407624 64.14 2104 1860896 593544 12.36 136344 1980624 174072 14:16:28 02:07:01 PM 927148 2898768 2826524 75.30 2104 2130192 701816 14.61 149552 2346836 121136 14:16:28 02:08:01 PM 1036864 3001528 2716808 72.38 2104 2122316 593976 12.37 172176 2211460 97588 14:16:28 02:09:01 PM 154016 2831792 3599656 95.90 2104 2834016 751956 15.66 208236 3054900 165460 14:16:28 02:10:01 PM 118028 2822620 3635644 96.86 2104 2854652 814980 16.97 264920 3074200 133520 14:16:28 02:11:02 PM 1573792 2917140 2179880 58.07 2104 1492812 722284 15.04 182520 1707360 388 14:16:28 02:12:01 PM 1529224 2896172 2224448 59.26 2104 1512388 729628 15.19 190064 1732224 4692 14:16:28 02:13:01 PM 1457712 2846536 2295960 61.17 2104 1529988 767364 15.98 197112 1783564 3772 14:16:28 02:14:01 PM 1386844 2785208 2366828 63.05 2104 1547644 812652 16.92 204172 1833460 4480 14:16:28 02:15:01 PM 1378296 2980416 2375376 63.28 2104 1763896 598608 12.47 217096 1816008 2284 14:16:28 02:16:01 PM 1337648 2995928 2416024 64.36 2104 1818864 579412 12.07 223244 1840660 19716 14:16:28 Average: 1152635 2921812 2601037 69.29 2104 1925719 690306 14.37 189513 2097951 64765 14:16:28 14:16:28 02:04:01 PM IFACE rxpck/s txpck/s rxkB/s txkB/s rxcmp/s txcmp/s rxmcst/s %ifutil 14:16:28 02:05:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 14:16:28 02:05:01 PM eth0 251.98 136.10 986.28 56.95 0.00 0.00 0.00 0.00 14:16:28 02:06:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 14:16:28 02:06:01 PM eth0 43.82 37.34 824.48 4.66 0.00 0.00 0.00 0.00 14:16:28 02:07:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 14:16:28 02:07:01 PM eth0 68.31 60.22 978.26 7.71 0.00 0.00 0.00 0.00 14:16:28 02:08:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 14:16:28 02:08:01 PM eth0 40.38 36.06 689.33 5.45 0.00 0.00 0.00 0.00 14:16:28 02:09:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 14:16:28 02:09:01 PM eth0 1087.52 826.28 25652.73 68.83 0.00 0.00 0.00 0.00 14:16:28 02:10:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 14:16:28 02:10:01 PM eth0 1861.27 1380.61 41432.62 94.13 0.00 0.00 0.00 0.00 14:16:28 02:11:02 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 14:16:28 02:11:02 PM eth0 1307.85 976.36 27984.30 68.57 0.00 0.00 0.00 0.00 14:16:28 02:12:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 14:16:28 02:12:01 PM eth0 54.19 35.60 131.06 12.50 0.00 0.00 0.00 0.00 14:16:28 02:13:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 14:16:28 02:13:01 PM eth0 46.43 32.54 110.52 11.38 0.00 0.00 0.00 0.00 14:16:28 02:14:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 14:16:28 02:14:01 PM eth0 49.41 32.76 110.10 11.44 0.00 0.00 0.00 0.00 14:16:28 02:15:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 14:16:28 02:15:01 PM eth0 38.54 27.94 72.26 10.76 0.00 0.00 0.00 0.00 14:16:28 02:16:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 14:16:28 02:16:01 PM eth0 12.38 12.20 9.05 5.76 0.00 0.00 0.00 0.00 14:16:28 Average: lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 14:16:28 Average: eth0 405.72 299.91 8261.08 29.87 0.00 0.00 0.00 0.00 14:16:28 14:16:28 14:16:28 ---> sar -P ALL: 14:16:28 Linux 4.18.0-529.el8.x86_64 (centos-stream-8-builder-7e611857-ce8d-42da-b0f0-357f5fb5fb5a.nov) 11/09/2026 _x86_64_ (2 CPU) 14:16:28 14:16:28 14:03:34 LINUX RESTART (2 CPU) 14:16:28 14:16:28 02:04:01 PM CPU %user %nice %system %iowait %steal %idle 14:16:28 02:05:01 PM all 27.95 0.00 10.01 9.53 0.09 52.43 14:16:28 02:05:01 PM 0 33.68 0.00 9.42 13.49 0.08 43.33 14:16:28 02:05:01 PM 1 22.19 0.00 10.61 5.55 0.10 61.55 14:16:28 02:06:01 PM all 22.54 0.00 3.11 1.42 0.08 72.85 14:16:28 02:06:01 PM 0 33.20 0.00 4.02 1.82 0.08 60.88 14:16:28 02:06:01 PM 1 11.86 0.00 2.21 1.02 0.07 84.85 14:16:28 02:07:01 PM all 27.21 0.00 3.44 2.29 0.09 66.97 14:16:28 02:07:01 PM 0 30.21 0.00 2.91 2.26 0.10 64.51 14:16:28 02:07:01 PM 1 24.19 0.00 3.97 2.31 0.08 69.45 14:16:28 02:08:01 PM all 28.06 0.00 3.35 1.05 0.08 67.46 14:16:28 02:08:01 PM 0 41.54 0.00 4.19 0.73 0.08 53.46 14:16:28 02:08:01 PM 1 14.60 0.00 2.50 1.37 0.08 81.45 14:16:28 02:09:01 PM all 29.08 0.00 8.07 2.68 0.10 60.07 14:16:28 02:09:01 PM 0 31.43 0.00 9.03 2.84 0.10 56.61 14:16:28 02:09:01 PM 1 26.76 0.00 7.11 2.53 0.10 63.50 14:16:28 02:10:01 PM all 22.97 0.00 12.56 2.95 0.13 61.39 14:16:28 02:10:01 PM 0 27.44 0.00 15.28 2.79 0.12 54.36 14:16:28 02:10:01 PM 1 18.56 0.00 9.87 3.11 0.13 68.33 14:16:28 02:11:02 PM all 23.28 0.00 9.21 2.10 0.09 65.32 14:16:28 02:11:02 PM 0 32.67 0.00 12.06 1.81 0.10 53.36 14:16:28 02:11:02 PM 1 13.96 0.00 6.38 2.38 0.08 77.19 14:16:28 02:12:01 PM all 39.68 0.00 1.54 0.40 0.11 58.26 14:16:28 02:12:01 PM 0 47.17 0.00 1.81 0.59 0.12 50.31 14:16:28 02:12:01 PM 1 32.18 0.00 1.27 0.20 0.10 66.24 14:16:28 02:13:01 PM all 40.63 0.00 1.37 0.43 0.11 57.46 14:16:28 02:13:01 PM 0 53.36 0.00 1.67 0.68 0.12 44.17 14:16:28 02:13:01 PM 1 27.85 0.00 1.07 0.17 0.10 70.81 14:16:28 02:14:01 PM all 40.56 0.00 1.36 0.33 0.11 57.64 14:16:28 02:14:01 PM 0 72.56 0.00 2.02 0.62 0.15 24.66 14:16:28 02:14:01 PM 1 8.38 0.00 0.70 0.05 0.07 90.80 14:16:28 02:15:01 PM all 32.10 0.00 1.99 6.19 0.10 59.63 14:16:28 02:15:01 PM 0 60.47 0.00 2.82 12.01 0.12 24.58 14:16:28 02:15:01 PM 1 3.62 0.00 1.16 0.34 0.08 94.80 14:16:28 14:16:28 02:15:01 PM CPU %user %nice %system %iowait %steal %idle 14:16:28 02:16:01 PM all 26.09 0.00 2.36 1.07 0.08 70.41 14:16:28 02:16:01 PM 0 37.99 0.00 2.84 1.00 0.08 58.09 14:16:28 02:16:01 PM 1 14.18 0.00 1.89 1.13 0.07 82.73 14:16:28 Average: all 30.01 0.00 4.85 2.53 0.10 62.50 14:16:28 Average: 0 41.85 0.00 5.65 3.39 0.10 49.01 14:16:28 Average: 1 18.18 0.00 4.06 1.68 0.09 76.00 14:16:28 14:16:28 14:16:28