21:04:33 Started by timer 21:04:33 Running as SYSTEM 21:04:33 [EnvInject] - Loading node environment variables. 21:04:33 Building remotely on prd-centos8-builder-2c-4g-2559 (centos8-builder-2c-4g) in workspace /w/workspace/ci-management-openstack-cron 21:04:33 [ssh-agent] Looking for ssh-agent implementation... 21:04:33 $ ssh-agent 21:04:33 SSH_AUTH_SOCK=/tmp/ssh-jSAXupYuBgeq/agent.5182 21:04:33 SSH_AGENT_PID=5184 21:04:33 [ssh-agent] Started. 21:04:33 Running ssh-add (command line suppressed) 21:04:33 Identity added: /w/workspace/ci-management-openstack-cron@tmp/private_key_13045410821205951370.key (jenkins-ssh) 21:04:33 [ssh-agent] Using credentials jenkins (jenkins) 21:04:33 The recommended git tool is: NONE 21:04:35 using credential jenkins 21:04:35 Wiping out workspace first. 21:04:35 Cloning the remote Git repository 21:04:35 Cloning repository ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management 21:04:35 > git init /w/workspace/ci-management-openstack-cron # timeout=10 21:04:35 Fetching upstream changes from ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management 21:04:35 > git --version # timeout=10 21:04:35 > git --version # 'git version 2.43.0' 21:04:35 using GIT_SSH to set credentials jenkins 21:04:35 [INFO] Currently running in a labeled security context 21:04:35 [INFO] Currently SELinux is 'enforcing' on the host 21:04:35 > /usr/bin/chcon --type=ssh_home_t /w/workspace/ci-management-openstack-cron@tmp/jenkins-gitclient-ssh3313368249064992187.key 21:04:35 > git fetch --tags --force --progress -- ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management +refs/heads/*:refs/remotes/origin/* # timeout=10 21:04:39 > git config remote.origin.url ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management # timeout=10 21:04:39 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10 21:04:39 Avoid second fetch 21:04:39 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10 21:04:39 Checking out Revision bd99cd2464adefc9a39aad8ae16df0732cbbfdc8 (refs/remotes/origin/master) 21:04:39 > git config core.sparsecheckout # timeout=10 21:04:40 > git checkout -f bd99cd2464adefc9a39aad8ae16df0732cbbfdc8 # timeout=10 21:04:40 Commit message: "CI: Update github2gerrit caller to v2.4.4" 21:04:40 > git rev-list --no-walk bd99cd2464adefc9a39aad8ae16df0732cbbfdc8 # timeout=10 21:04:40 > git remote # timeout=10 21:04:40 > git submodule init # timeout=10 21:04:40 > git submodule sync # timeout=10 21:04:40 > git config --get remote.origin.url # timeout=10 21:04:40 > git submodule init # timeout=10 21:04:40 > git config -f .gitmodules --get-regexp ^submodule\.(.+)\.url # timeout=10 21:04:40 > git config --get submodule.packer/common-packer.url # timeout=10 21:04:40 > git config -f .gitmodules --get submodule.packer/common-packer.path # timeout=10 21:04:40 > git config --get submodule.global-jjb.url # timeout=10 21:04:40 > git config -f .gitmodules --get submodule.global-jjb.path # timeout=10 21:04:41 > git submodule update --init --recursive packer/common-packer # timeout=10 21:04:44 > git submodule update --init --recursive global-jjb # timeout=10 21:04:55 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 21:04:55 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 21:04:55 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 21:04:55 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 21:04:55 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 21:04:55 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 21:04:55 Run condition [Boolean condition] enabling prebuild for step [BuilderChain] 21:04:55 provisioning config files... 21:04:55 copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml 21:04:55 copy managed file [npmrc] to file:/home/jenkins/.npmrc 21:04:55 copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf 21:04:55 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins7960172489694948657.sh 21:04:55 ---> python-tools-install.sh 21:04:55 Setup pyenv: 21:04:55 system 21:04:55 * 3.8.13 (set by /opt/pyenv/version) 21:04:55 * 3.9.13 (set by /opt/pyenv/version) 21:04:55 * 3.10.6 (set by /opt/pyenv/version) 21:05:00 lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-4VTl 21:05:00 lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv 21:05:00 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 21:05:12 lf-activate-venv(): INFO: Installing additional packages: lftools 21:05:47 lf-activate-venv(): INFO: Adding /tmp/venv-4VTl/bin to PATH 21:05:47 Generating Requirements File 21:06:31 ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. 21:06:31 botocore 1.44.1 requires python-dateutil<3.0.0,>=2.1, but you have python-dateutil 3.0.0 which is incompatible. 21:06:31 httplib2 0.30.2 requires pyparsing<4,>=3.0.4, but you have pyparsing 2.4.7 which is incompatible. 21:06:32 Python 3.10.6 21:06:32 pip 26.3 from /tmp/venv-4VTl/lib/python3.10/site-packages/pip (python 3.10) 21:06:32 aiohappyeyeballs==2.7.1 21:06:32 aiohttp==3.14.5 21:06:32 aiosignal==1.4.0 21:06:32 appdirs==1.4.4 21:06:32 argcomplete==3.7.2 21:06:32 aspy.yaml==1.3.0 21:06:32 async-timeout==5.0.1 21:06:32 attrs==26.1.0 21:06:32 autopage==0.6.0 21:06:32 backports.strenum==1.3.1 21:06:32 beautifulsoup4==4.15.0 21:06:32 boto3==1.44.1 21:06:32 botocore==1.44.1 21:06:32 bs4==0.0.2 21:06:32 certifi==2026.10.23 21:06:32 cffi==2.1.1 21:06:32 cfgv==3.5.0 21:06:32 chardet==7.7.0 21:06:32 charset-normalizer==3.5.2 21:06:32 click==8.5.1 21:06:32 cliff==4.14.0 21:06:32 cmd2==3.5.1 21:06:32 cryptography==3.3.2 21:06:32 debtcollector==3.1.0 21:06:32 decorator==5.3.1 21:06:32 defusedxml==0.7.1 21:06:32 Deprecated==1.3.1 21:06:32 distlib==0.4.4 21:06:32 dnspython==2.8.0 21:06:32 docker==7.2.0 21:06:32 dogpile.cache==1.5.0 21:06:32 durationpy==0.11 21:06:32 email-validator==2.3.0 21:06:32 filelock==4.1.0 21:06:32 frozenlist==1.8.0 21:06:32 future==1.0.0 21:06:32 gitdb==4.0.12 21:06:32 GitPython==3.2.1 21:06:32 httplib2==0.30.2 21:06:32 identify==2.6.20 21:06:32 idna==3.20 21:06:32 importlib-resources==1.5.0 21:06:32 iso8601==2.1.0 21:06:32 Jinja2==3.1.6 21:06:32 jmespath==1.1.0 21:06:32 jsonpatch==1.46 21:06:32 jsonpointer==3.12 21:06:32 jsonschema==4.26.0 21:06:32 jsonschema-specifications==2025.9.1 21:06:32 keystoneauth1==5.14.0 21:06:32 kubernetes==36.0.3 21:06:32 lftools==0.37.26 21:06:32 lxml==6.1.3 21:06:32 markdown-it-py==4.3.0 21:06:32 MarkupSafe==3.0.4 21:06:32 mdurl==0.1.2 21:06:32 msgpack==1.2.4 21:06:32 multi_key_dict==2.0.4 21:06:32 multidict==7.1.0 21:06:32 munch==4.0.0 21:06:32 netaddr==1.3.0 21:06:32 niet==1.4.2 21:06:32 nodeenv==1.12.0 21:06:32 oauth2client==4.1.3 21:06:32 oauthlib==4.0.1 21:06:32 openstacksdk==4.13.0 21:06:32 os-service-types==1.8.2 21:06:32 osc-lib==4.6.0 21:06:32 oslo.config==10.4.0 21:06:32 oslo.context==6.4.0 21:06:32 oslo.i18n==6.8.0 21:06:32 oslo.log==8.2.0 21:06:32 oslo.serialization==5.10.0 21:06:32 oslo.utils==10.1.1 21:06:32 packaging==26.3 21:06:32 pbr==7.1.3 21:06:32 platformdirs==4.12.4 21:06:32 prettytable==3.18.0 21:06:32 propcache==0.5.4 21:06:32 psutil==7.2.2 21:06:32 pyasn1==0.6.5 21:06:32 pyasn1_modules==0.4.2 21:06:32 pycparser==3.11 21:06:32 pygerrit2==2.0.15 21:06:32 PyGithub==2.10.0 21:06:32 Pygments==2.21.0 21:06:32 PyJWT==2.15.1 21:06:32 PyNaCl==1.6.2 21:06:32 pyparsing==2.4.7 21:06:32 pyperclip==1.11.0 21:06:32 pyrsistent==0.20.0 21:06:32 python-cinderclient==9.9.0 21:06:32 python-dateutil==3.0.0 21:06:32 python-discovery==1.9.5 21:06:32 python-heatclient==5.2.0 21:06:32 python-jenkins==1.8.3 21:06:32 python-keystoneclient==6.0.0 21:06:32 python-magnumclient==4.11.0 21:06:32 python-openstackclient==10.0.0 21:06:32 python-swiftclient==4.11.0 21:06:32 PyYAML==6.0.3 21:06:32 referencing==0.37.0 21:06:32 requests==2.34.2 21:06:32 requests-oauthlib==2.0.0 21:06:32 rfc3986==2.0.0 21:06:32 rich==15.0.0 21:06:32 rich-argparse==1.8.0 21:06:32 rpds-py==0.30.0 21:06:32 rsa==4.9.1 21:06:32 ruamel.yaml==0.19.1 21:06:32 ruamel.yaml.clib==0.2.15 21:06:32 s3transfer==0.19.3 21:06:32 simplejson==4.3.0 21:06:32 six==1.17.0 21:06:32 smmap==5.0.3 21:06:32 soupsieve==2.10 21:06:32 stevedore==5.8.0 21:06:32 tabulate==0.10.0 21:06:32 toml==0.10.2 21:06:32 tomlkit==0.15.2 21:06:32 tqdm==4.70.1 21:06:32 typing_extensions==4.16.0 21:06:32 tzdata==2026.6 21:06:32 urllib3==1.26.20 21:06:32 virtualenv==21.15.6 21:06:32 wcwidth==0.9.4 21:06:32 websocket-client==1.9.2 21:06:32 wrapt==2.5.2 21:06:32 xdg==6.0.0 21:06:32 xmltodict==1.0.4 21:06:32 yarl==1.25.1 21:06:32 yq==4.4.5 21:06:33 [ci-management-openstack-cron] $ /bin/sh /tmp/jenkins3437225190219289116.sh 21:06:33 ---> uv-install.sh 21:06:33 Installing uv/uvx (latest) using shell installer 21:06:39 2026-11-12 21:06:39 URL:https://releases.astral.sh/installers/uv/latest/uv-installer.sh [71300/71300] -> "/tmp/uv-install-l51MVh.sh" [1] 21:06:39 downloading uv 0.13.8 x86_64-unknown-linux-gnu 21:06:43 installing to /home/jenkins/.local/bin 21:06:43 uv 21:06:43 uvx 21:06:43 everything's installed! 21:06:43 ---> Validating uv/uvx install 21:06:43 uvx 0.13.8 (x86_64-unknown-linux-gnu) 21:06:43 [EnvInject] - Injecting environment variables from a build step. 21:06:43 [EnvInject] - Injecting as environment variables the properties content 21:06:43 OS_CLOUD=vex 21:06:43 21:06:43 [EnvInject] - Variables injected successfully. 21:06:43 [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True) 21:06:43 Run condition [Boolean condition] enabling perform for step [Execute shell] 21:06:43 [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins1518600548489149711.sh 21:06:43 ---> Orphaned k8s clusters 21:06:43 Setup pyenv: 21:06:44 system 21:06:44 3.8.13 21:06:44 3.9.13 21:06:44 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 21:06:44 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-4VTl from file:/tmp/.os_lf_venv 21:06:44 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 21:06:49 lf-activate-venv(): INFO: Installing additional packages: kubernetes python-heatclient python-openstackclient python-magnumclient 21:07:15 ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. 21:07:15 botocore 1.44.1 requires python-dateutil<3.0.0,>=2.1, but you have python-dateutil 3.0.0 which is incompatible. 21:07:16 lf-activate-venv(): INFO: Adding /tmp/venv-4VTl/bin to PATH 21:07:26 -----> Delete orphaned cluster 21:07:26 [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True) 21:07:26 Run condition [Boolean condition] enabling perform for step [Execute shell] 21:07:26 [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins13870094373043109566.sh 21:07:26 ---> Orphaned stacks 21:07:26 Setup pyenv: 21:07:26 system 21:07:26 3.8.13 21:07:26 3.9.13 21:07:26 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 21:07:27 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-4VTl from file:/tmp/.os_lf_venv 21:07:27 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 21:07:32 lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq 21:08:03 lf-activate-venv(): INFO: Adding /tmp/venv-4VTl/bin to PATH 21:08:03 + mapfile -t OS_COE_CLUSTERS_ID 21:08:03 ++ awk '{print $1}' 21:08:03 ++ openstack --os-cloud vex coe cluster list -f value -c uuid -c name 21:08:03 ++ grep -E '(DELETE_FAILED|UNKNOWN|UNHEALTHY)' 21:08:13 + echo '-----> Active clusters -> stacks' 21:08:13 -----> Active clusters -> stacks 21:08:13 + OS_COE_STACKS=() 21:08:13 + [[ 0 -gt 0 ]] 21:08:13 + mapfile -t OS_STACKS 21:08:13 ++ awk '{print $1}' 21:08:13 ++ openstack --os-cloud vex stack list -f value -c 'Stack Name' -c 'Stack Status' --property stack_status=CREATE_COMPLETE --property stack_status=DELETE_FAILED --property stack_status=CREATE_FAILED 21:08:22 + echo '-----> Active stacks' 21:08:22 -----> Active stacks 21:08:22 + echo '-----> Delete orphaned stacks' 21:08:22 -----> Delete orphaned stacks 21:08:22 [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True) 21:08:22 Run condition [Boolean condition] enabling perform for step [Execute shell] 21:08:22 [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins8333904389489045411.sh 21:08:22 ---> Orphaned servers 21:08:22 Setup pyenv: 21:08:22 system 21:08:22 3.8.13 21:08:22 3.9.13 21:08:22 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 21:08:22 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-4VTl from file:/tmp/.os_lf_venv 21:08:22 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 21:08:27 lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq 21:11:01 ERROR: Could not install packages due to an OSError: [Errno 28] No space left on device 21:11:01 21:11:03 lf-venv-pip-install(): WARNING: install failed from the configured index, retrying against https://pypi.org/simple 21:14:55 Build timed out (after 10 minutes). Marking the build as failed. 21:14:55 $ ssh-agent -k 21:14:55 unset SSH_AUTH_SOCK; 21:14:55 unset SSH_AGENT_PID; 21:14:55 echo Agent pid 5184 killed; 21:14:55 [ssh-agent] Stopped. 21:14:55 Build was aborted 21:14:55 [PostBuildScript] - [INFO] Executing post build scripts. 21:14:55 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins16214254891790500580.sh 21:14:55 ---> sysstat.sh 21:14:55 /home/jenkins/lf-env.sh: line 73: 6648 Terminated "$venv_python" -m pip install --index-url "$upstream" "$@" 21:14:55 lf-activate-venv(): ERROR: Failed to install packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq 21:14:55 /tmp/jenkins8333904389489045411.sh: line 67: openstack: command not found 21:14:55 -----> Active servers 21:14:55 -----> Delete orphaned servers 21:14:56 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins1919231576924920804.sh 21:14:56 ---> package-listing.sh 21:14:56 ++ facter osfamily 21:14:56 ++ tr '[:upper:]' '[:lower:]' 21:14:57 + OS_FAMILY=redhat 21:14:57 + workspace=/w/workspace/ci-management-openstack-cron 21:14:57 + START_PACKAGES=/tmp/packages_start.txt 21:14:57 + END_PACKAGES=/tmp/packages_end.txt 21:14:57 + DIFF_PACKAGES=/tmp/packages_diff.txt 21:14:57 + PACKAGES=/tmp/packages_start.txt 21:14:57 + '[' /w/workspace/ci-management-openstack-cron ']' 21:14:57 + PACKAGES=/tmp/packages_end.txt 21:14:57 + case "${OS_FAMILY}" in 21:14:57 + rpm -qa 21:14:57 + sort 21:15:04 + '[' -f /tmp/packages_start.txt ']' 21:15:04 + '[' -f /tmp/packages_end.txt ']' 21:15:04 + diff /tmp/packages_start.txt /tmp/packages_end.txt 21:15:04 + '[' /w/workspace/ci-management-openstack-cron ']' 21:15:04 + mkdir -p /w/workspace/ci-management-openstack-cron/archives/ 21:15:04 + cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/ci-management-openstack-cron/archives/ 21:15:04 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins4445021285874449055.sh 21:15:04 ---> capture-instance-metadata.sh 21:15:04 Setup pyenv: 21:15:04 system 21:15:04 3.8.13 21:15:04 3.9.13 21:15:04 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 21:15:04 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-4VTl from file:/tmp/.os_lf_venv 21:15:04 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 21:15:09 lf-activate-venv(): INFO: Installing additional packages: lftools 21:15:25 lf-activate-venv(): INFO: Adding /tmp/venv-4VTl/bin to PATH 21:15:25 INFO: Running in OpenStack, capturing instance metadata 21:15:25 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins9650557575551474911.sh 21:15:25 provisioning config files... 21:15:25 copy managed file [jenkins-log-archives-settings] to file:/w/workspace/ci-management-openstack-cron@tmp/config5367439624939763754tmp 21:15:25 Regular expression run condition: Expression=[^.*logs-s3.*], Label=[] 21:15:25 Run condition [Regular expression match] preventing perform for step [Provide Configuration files] 21:15:25 [EnvInject] - Injecting environment variables from a build step. 21:15:25 [EnvInject] - Injecting as environment variables the properties content 21:15:25 SERVER_ID=logs 21:15:25 21:15:25 [EnvInject] - Variables injected successfully. 21:15:25 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins868081752183869066.sh 21:15:25 ---> create-netrc.sh 21:15:25 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins6845882545620884014.sh 21:15:25 ---> python-tools-install.sh 21:15:25 Setup pyenv: 21:15:25 system 21:15:25 3.8.13 21:15:25 3.9.13 21:15:25 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 21:15:26 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-4VTl from file:/tmp/.os_lf_venv 21:15:26 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 21:15:31 lf-activate-venv(): INFO: Installing additional packages: lftools 21:15:46 lf-activate-venv(): INFO: Adding /tmp/venv-4VTl/bin to PATH 21:15:46 [ci-management-openstack-cron] $ /bin/sh /tmp/jenkins3190065098102164845.sh 21:15:46 ---> uv-install.sh 21:15:46 uv 0.13.8 is already installed 21:15:46 uvx 0.13.8 (x86_64-unknown-linux-gnu) 21:15:46 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins379674478985411259.sh 21:15:46 ---> sudo-logs.sh 21:15:46 Archiving 'sudo' log.. 21:15:46 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins14502735683416208601.sh 21:15:46 ---> job-cost.sh 21:15:46 INFO: Activating Python virtual environment... 21:15:46 Setup pyenv: 21:15:46 system 21:15:46 3.8.13 21:15:46 3.9.13 21:15:46 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 21:15:47 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-4VTl from file:/tmp/.os_lf_venv 21:15:47 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 21:15:52 lf-activate-venv(): INFO: Installing additional packages: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 21:16:03 lf-activate-venv(): INFO: Adding /tmp/venv-4VTl/bin to PATH 21:16:03 INFO: No stack-cost file found 21:16:03 INFO: Instance uptime: 748s 21:16:03 INFO: Fetching instance metadata (attempt 1 of 3)... 21:16:03 DEBUG: URL: http://169.254.169.254/latest/meta-data/instance-type 21:16:04 INFO: Successfully fetched instance metadata 21:16:04 INFO: Instance type: v3-starter-2 21:16:04 INFO: Retrieving pricing info for: v3-starter-2 21:16:04 INFO: Fetching Vexxhost pricing API (attempt 1 of 3)... 21:16:04 DEBUG: URL: https://pricing.vexxhost.net/v1/pricing/v3-starter-2/cost?seconds=748 21:16:07 INFO: Successfully fetched Vexxhost pricing API 21:16:07 INFO: Retrieved cost: 0.02 21:16:07 INFO: Retrieved resource: v3-starter-2 21:16:07 INFO: Creating archive directory: /w/workspace/ci-management-openstack-cron/archives/cost 21:16:07 INFO: Archiving costs to: /w/workspace/ci-management-openstack-cron/archives/cost.csv 21:16:07 INFO: Successfully archived job cost data 21:16:07 DEBUG: Cost data: ci-management-openstack-cron,63802,2026-11-12 21:16:07,v3-starter-2,748,0.02,0.00,FAILURE 21:16:07 [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins11050081449352557771.sh 21:16:07 ---> logs-deploy.sh 21:16:07 Setup pyenv: 21:16:07 system 21:16:07 3.8.13 21:16:07 3.9.13 21:16:07 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 21:16:08 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-4VTl from file:/tmp/.os_lf_venv 21:16:08 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 21:16:13 lf-activate-venv(): INFO: Installing additional packages: lftools urllib3~=1.26.15 21:16:28 lf-activate-venv(): INFO: Adding /tmp/venv-4VTl/bin to PATH 21:16:28 INFO: Nexus URL https://nexus.o-ran-sc.org path production/vex-sjc-oran-jenkins-prod-1/ci-management-openstack-cron/63802 21:16:28 INFO: archiving workspace using pattern(s): 21:16:33 Archives upload complete. 21:16:33 INFO: archiving logs to Nexus 21:16:34 ---> uname -a: 21:16:34 Linux prd-centos8-builder-2c-4g-2559.novalocal 4.18.0-529.el8.x86_64 #1 SMP Wed Dec 6 01:03:46 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux 21:16:34 21:16:34 21:16:34 ---> lscpu: 21:16:34 Architecture: x86_64 21:16:34 CPU op-mode(s): 32-bit, 64-bit 21:16:34 Byte Order: Little Endian 21:16:34 CPU(s): 2 21:16:34 On-line CPU(s) list: 0,1 21:16:34 Thread(s) per core: 1 21:16:34 Core(s) per socket: 1 21:16:34 Socket(s): 2 21:16:34 NUMA node(s): 1 21:16:34 Vendor ID: AuthenticAMD 21:16:34 CPU family: 23 21:16:34 Model: 49 21:16:34 Model name: AMD EPYC-Rome Processor 21:16:34 Stepping: 0 21:16:34 CPU MHz: 2799.998 21:16:34 BogoMIPS: 5599.99 21:16:34 Virtualization: AMD-V 21:16:34 Hypervisor vendor: KVM 21:16:34 Virtualization type: full 21:16:34 L1d cache: 32K 21:16:34 L1i cache: 32K 21:16:34 L2 cache: 512K 21:16:34 L3 cache: 16384K 21:16:34 NUMA node0 CPU(s): 0,1 21:16:34 Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr wbnoinvd arat npt nrip_save umip rdpid arch_capabilities 21:16:34 21:16:34 21:16:34 ---> nproc: 21:16:34 2 21:16:34 21:16:34 21:16:34 ---> df -h: 21:16:34 Filesystem Size Used Avail Use% Mounted on 21:16:34 devtmpfs 1.8G 0 1.8G 0% /dev 21:16:34 tmpfs 1.8G 0 1.8G 0% /dev/shm 21:16:34 tmpfs 1.8G 17M 1.8G 1% /run 21:16:34 tmpfs 1.8G 0 1.8G 0% /sys/fs/cgroup 21:16:34 /dev/vda1 20G 15G 5.4G 74% / 21:16:34 tmpfs 367M 0 367M 0% /run/user/1001 21:16:34 21:16:34 21:16:34 ---> free -m: 21:16:34 total used free shared buff/cache available 21:16:34 Mem: 3665 460 1233 17 1971 2884 21:16:34 Swap: 1023 1 1022 21:16:34 21:16:34 21:16:34 ---> ip addr: 21:16:34 1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 21:16:34 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 21:16:34 inet 127.0.0.1/8 scope host lo 21:16:34 valid_lft forever preferred_lft forever 21:16:34 inet6 ::1/128 scope host 21:16:34 valid_lft forever preferred_lft forever 21:16:34 2: eth0: mtu 1450 qdisc fq_codel state UP group default qlen 1000 21:16:34 link/ether fa:16:3e:3a:c9:30 brd ff:ff:ff:ff:ff:ff 21:16:34 altname enp0s3 21:16:34 altname ens3 21:16:34 inet 10.32.7.224/23 brd 10.32.7.255 scope global dynamic noprefixroute eth0 21:16:34 valid_lft 85653sec preferred_lft 85653sec 21:16:34 inet6 fe80::f816:3eff:fe3a:c930/64 scope link 21:16:34 valid_lft forever preferred_lft forever 21:16:34 21:16:34 21:16:34 ---> sar -b -r -n DEV: 21:16:34 Linux 4.18.0-529.el8.x86_64 (centos-stream-8-builder-7e611857-ce8d-42da-b0f0-357f5fb5fb5a.nov) 11/12/2026 _x86_64_ (2 CPU) 21:16:34 21:16:34 21:03:42 LINUX RESTART (2 CPU) 21:16:34 21:16:34 09:05:02 PM tps rtps wtps bread/s bwrtn/s 21:16:34 09:06:01 PM 54.48 0.49 53.99 42.16 5575.77 21:16:34 09:07:01 PM 64.70 0.73 63.96 202.07 12383.56 21:16:34 09:08:01 PM 38.73 0.47 38.26 60.10 8769.30 21:16:34 09:09:01 PM 48.29 0.23 48.06 52.37 33123.60 21:16:34 09:10:01 PM 122.46 2.06 120.40 293.31 174806.79 21:16:34 09:11:01 PM 131.37 4.31 127.05 498.15 176292.52 21:16:34 09:12:01 PM 67.54 2.57 64.98 382.94 1905.03 21:16:34 09:13:01 PM 82.36 0.10 82.26 3.20 2226.61 21:16:34 09:14:01 PM 75.45 0.07 75.39 2.13 2011.31 21:16:34 09:15:01 PM 132.87 60.28 72.59 5886.97 1909.13 21:16:34 09:16:01 PM 54.04 31.16 22.88 2218.43 695.98 21:16:34 Average: 79.34 9.33 70.01 877.74 38215.40 21:16:34 21:16:34 09:05:02 PM kbmemfree kbavail kbmemused %memused kbbuffers kbcached kbcommit %commit kbactive kbinact kbdirty 21:16:34 09:06:01 PM 1377092 3034664 2376584 63.31 2104 1826344 600572 12.51 136812 1951912 141472 21:16:34 09:07:01 PM 1030848 2945496 2722828 72.54 2104 2074060 642640 13.38 139616 2247312 59948 21:16:34 09:08:01 PM 804048 2852388 2949628 78.58 2104 2203768 742236 15.46 161708 2450828 166088 21:16:34 09:09:01 PM 125508 2868104 3628168 96.66 2104 2901532 723000 15.06 192572 3104288 179868 21:16:34 09:10:01 PM 123336 2838128 3630340 96.71 2104 2867344 782480 16.29 246584 3071852 157708 21:16:34 09:11:01 PM 757644 2797792 2996032 79.82 2104 2185796 835596 17.40 288616 2409016 32 21:16:34 09:12:01 PM 1563480 2920064 2190196 58.35 2104 1503412 720852 15.01 188956 1702040 4228 21:16:34 09:13:01 PM 1497540 2876972 2256136 60.10 2104 1521784 744816 15.51 196360 1747008 3608 21:16:34 09:14:01 PM 1430900 2826896 2322776 61.88 2104 1538472 790620 16.46 203036 1795384 3576 21:16:34 09:15:01 PM 1430988 3004924 2322688 61.88 2104 1728724 592716 12.34 217588 1765340 3140 21:16:34 09:16:01 PM 1296296 2951020 2457380 65.47 2104 1808916 637488 13.27 226500 1888252 14688 21:16:34 Average: 1039789 2901495 2713887 72.30 2104 2014559 710274 14.79 199850 2193930 66760 21:16:34 21:16:34 09:05:02 PM IFACE rxpck/s txpck/s rxkB/s txkB/s rxcmp/s txcmp/s rxmcst/s %ifutil 21:16:34 09:06:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 21:16:34 09:06:01 PM eth0 49.64 42.06 968.27 5.13 0.00 0.00 0.00 0.00 21:16:34 09:07:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 21:16:34 09:07:01 PM eth0 60.03 52.87 963.22 6.99 0.00 0.00 0.00 0.00 21:16:34 09:08:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 21:16:34 09:08:01 PM eth0 43.94 38.48 737.47 5.41 0.00 0.00 0.00 0.00 21:16:34 09:09:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 21:16:34 09:09:01 PM eth0 430.95 329.12 8314.24 24.87 0.00 0.00 0.00 0.00 21:16:34 09:10:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 21:16:34 09:10:01 PM eth0 2288.36 1684.68 43589.14 114.08 0.00 0.00 0.00 0.00 21:16:34 09:11:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 21:16:34 09:11:01 PM eth0 2268.95 1673.96 43054.01 113.76 0.00 0.00 0.00 0.00 21:16:34 09:12:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 21:16:34 09:12:01 PM eth0 76.89 40.44 267.31 10.88 0.00 0.00 0.00 0.00 21:16:34 09:13:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 21:16:34 09:13:01 PM eth0 47.40 33.64 114.28 11.87 0.00 0.00 0.00 0.00 21:16:34 09:14:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 21:16:34 09:14:01 PM eth0 42.98 31.06 106.54 10.80 0.00 0.00 0.00 0.00 21:16:34 09:15:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 21:16:34 09:15:01 PM eth0 41.10 30.36 89.37 11.33 0.00 0.00 0.00 0.00 21:16:34 09:16:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 21:16:34 09:16:01 PM eth0 12.16 12.66 8.75 6.08 0.00 0.00 0.00 0.00 21:16:34 Average: lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 21:16:34 Average: eth0 488.31 361.44 8943.37 29.24 0.00 0.00 0.00 0.00 21:16:34 21:16:34 21:16:34 ---> sar -P ALL: 21:16:34 Linux 4.18.0-529.el8.x86_64 (centos-stream-8-builder-7e611857-ce8d-42da-b0f0-357f5fb5fb5a.nov) 11/12/2026 _x86_64_ (2 CPU) 21:16:34 21:16:34 21:03:42 LINUX RESTART (2 CPU) 21:16:34 21:16:34 09:05:02 PM CPU %user %nice %system %iowait %steal %idle 21:16:34 09:06:01 PM all 22.78 0.00 2.85 1.01 0.08 73.29 21:16:34 09:06:01 PM 0 8.69 0.00 1.88 1.02 0.07 88.34 21:16:34 09:06:01 PM 1 36.86 0.00 3.82 1.00 0.08 58.23 21:16:34 09:07:01 PM all 25.79 0.00 3.47 2.25 0.08 68.41 21:16:34 09:07:01 PM 0 23.80 0.00 3.93 1.96 0.07 70.25 21:16:34 09:07:01 PM 1 27.77 0.00 3.02 2.54 0.10 66.57 21:16:34 09:08:01 PM all 30.80 0.00 3.28 0.93 0.08 64.90 21:16:34 09:08:01 PM 0 21.17 0.00 3.22 1.42 0.08 74.11 21:16:34 09:08:01 PM 1 40.43 0.00 3.35 0.43 0.08 55.71 21:16:34 09:09:01 PM all 21.56 0.00 3.52 1.41 0.08 73.42 21:16:34 09:09:01 PM 0 9.96 0.00 3.31 1.78 0.07 84.89 21:16:34 09:09:01 PM 1 33.09 0.00 3.74 1.05 0.10 62.01 21:16:34 09:10:01 PM all 22.63 0.00 12.64 3.04 0.14 61.55 21:16:34 09:10:01 PM 0 22.06 0.00 13.02 3.34 0.14 61.44 21:16:34 09:10:01 PM 1 23.18 0.00 12.27 2.75 0.15 61.65 21:16:34 09:11:01 PM all 21.59 0.00 12.81 3.23 0.14 62.24 21:16:34 09:11:01 PM 0 25.56 0.00 15.91 2.99 0.12 55.42 21:16:34 09:11:01 PM 1 17.68 0.00 9.76 3.46 0.15 68.95 21:16:34 09:12:01 PM all 35.58 0.00 1.75 0.42 0.10 62.15 21:16:34 09:12:01 PM 0 18.71 0.00 1.82 0.47 0.08 78.92 21:16:34 09:12:01 PM 1 52.43 0.00 1.68 0.37 0.12 45.40 21:16:34 09:13:01 PM all 40.33 0.00 1.49 0.37 0.12 57.69 21:16:34 09:13:01 PM 0 11.78 0.00 0.99 0.08 0.07 87.09 21:16:34 09:13:01 PM 1 68.85 0.00 2.00 0.65 0.17 28.33 21:16:34 09:14:01 PM all 40.41 0.00 1.29 0.45 0.09 57.76 21:16:34 09:14:01 PM 0 7.90 0.00 0.77 0.05 0.05 91.23 21:16:34 09:14:01 PM 1 72.86 0.00 1.80 0.85 0.13 24.35 21:16:34 09:15:01 PM all 37.22 0.00 1.70 3.79 0.12 57.18 21:16:34 09:15:01 PM 0 8.07 0.00 1.51 7.01 0.08 83.33 21:16:34 09:15:01 PM 1 66.34 0.00 1.89 0.57 0.15 31.05 21:16:34 09:16:01 PM all 26.00 0.00 2.46 2.66 0.08 68.78 21:16:34 09:16:01 PM 0 19.51 0.00 2.31 4.38 0.07 73.73 21:16:34 09:16:01 PM 1 32.48 0.00 2.62 0.95 0.10 63.85 21:16:34 21:16:34 Average: CPU %user %nice %system %iowait %steal %idle 21:16:34 Average: all 29.55 0.00 4.28 1.77 0.10 64.30 21:16:34 Average: 0 16.09 0.00 4.39 2.22 0.08 77.21 21:16:34 Average: 1 42.94 0.00 4.17 1.33 0.12 51.44 21:16:34 21:16:34 21:16:34